pi-fast-compaction

What it does

Keeps useful old Pi tool results verbatim and calls the normal summarizer only when the context is still too large.

How you can use it

Your developer can adapt this code to manage long chat histories in your own app. The app sends old messages to an outside AI service to decide which details matter. The software keeps those useful items and drops the rest.

You need an access key to connect the software to TypeSafe. The included code tracks daily spending so you can stop requests at a set limit. If the connection fails or reaches that limit, the app summarizes the chat normally.