Skimmer
Filter documents and result lists with Jev relevance judgments before an agent reads them.
Filter documents and result lists with Jev relevance judgments before an agent reads them.
Skimmer turns each URL, text file, or stdin document into overlapping chunks, then sends a Noul question for each chunk: would this chunk help accomplish the caller’s goal? It retains chunks Jev scores at or above the configured threshold and also keeps chunks Jev could not judge, so a partial Jev failure does not silently drop text. The retained chunks are emitted in document order.
Decide whether this chunk carries substance that would help accomplish the goal; ignore boilerplate, generic background, and keyword-only mentions.
Goal plus one chunk identified as item_0; optional source label and chunk line range are included when available.
Fetch URL text, read text/PDF files, or accept nonempty stdin; record per-source load errors.
Optionally truncate by rune count, split into overlapping chunks, and use each chunk text as one item.
Build a shared goal/context/items state with one Noul question per item; batch requests under configured estimates and retry oversized batches by halving them.
Keep answered chunks meeting the P(yes) threshold and all unjudged chunks; optionally cap kept chunks by score, then emit in source order.
It uses a goal-conditioned relevance question at chunk granularity and batches those questions under a token budget. Oversize requests are recursively split, while failed items remain available to the caller as unjudged content.