Your Similarity Cutoff Deletes the Rules First: Constraint Facts Score Below Descriptions in Local Embedders (2026)

Your memory pipeline ends with a score gate: keep rows at or above 0.7 cosine similarity, drop the rest. You tuned that number on topical questions and it looked fine. Then someone asks “May I deploy to production on Friday?” and the agent retrieves nothing — not the wrong thing, nothing — because the one stored sentence that should have stopped the deploy scored 0.660. That is the measurement in this article, scoped to what was actually run. On a 12-fact synthetic fixture with two local Ollama embedders, the prohibition “Deployment to production on Fridays is prohibited for all teams.” scored 0.660 against “May I deploy to production on Friday?” under all-minilm:latest. The two descriptive facts in the same fixture scored 0.764 and 0.773 for their own questions. A 0.7 gate therefore keeps the descriptions and deletes the rule, and the ordering reverses on the second embedder — the same prohibition scores 0.949 under snowflake-arctic-embed:33m. The safe cutoff is a property of the encoder, not of your application. ...

November 14, 2026 · 11 min · baeseokjae