Snippet · Building with models
Summarise something too long to send
What to do when the document exceeds the context window.
I need to <summarise / extract from> a document of roughly <length>, which is beyond what I can send in one call. Recommend one approach and say what it costs me in accuracy: - Chunk, process each, then combine the results. - Retrieve only the relevant parts first, then process those. - Progressive refinement — carry a running summary through the chunks. Then implement it, and be explicit about: - What gets lost with this approach. - How chunk boundaries are handled so nothing is cut mid-thought. - What the user is told about the fact this happened. Don't silently truncate. If something is dropped, I want to know.
Silent truncation is the worst outcome: an answer that looks complete and is based on the first third of the document.