Before you dive in
What you’ll find in the original
- Start with a query and candidate memories, assigning an id to each memory so answers can be mapped back without generated text.
- Batch one yes-or-no relevance question per memory in a single request rather than making a separate LLM call for every item.
- Choose and evaluate an inclusion threshold; probability-ranked decisions do not remove the need to test missed and irrelevant memories.
Worth knowing
Requires TypeSafe access for live runs. The README's latency, price, and example-retrieval comparisons are author-reported snapshots, not independent benchmarks or guarantees.