Lexical search now works across languages: it matches different forms of a word in Russian, Greek, Arabic, Tamil and accented languages, and finds words inside Chinese, Japanese and Korean text. retrieve now shows each document's frontmatter, memory session start can be capped and filtered with max_tokens and exclude, and a write that fails part way through now rolls back the files it already changed.
iwe
Added
session_start.max_tokensmemory policy setting caps the whole session-start block, policy text included, by dropping listed entries from the endsession_start.excludememory policy setting takes a filter for documents session start never lists, such as retired ones
Changed
retrieveoutput includes each document's frontmatter — afrontmatterobject in JSON and YAML, nested underfrontmatter:in the markdown header — and--frontmatter falseleaves it out (previously frontmatter was never shown)internal claude session inboxwithout a session id prints each candidate's evidence under its summary (previously only the first line of the body was shown)retrieve --excludealso removes the excluded keys from theincludes,includedBy,referencesandreferencedBylists (previously they were still listed there with their titles)internal claude session stagerefuses a proposal whose evidence has no double-quoted text, or quotes text that does not appear in the session transcript (previously any non-empty evidence was accepted)internal claude session completecounts a staged candidate as offered when it settles as written or rejected, and--offeredis only for offers that were never staged (previously distill passed the staged count, so runningcompleteagain counted the same offers twice)- Memory reflect and init texts pass
--stricton everycreate,updateanddeletethey suggest (previously only distill did) - Memory distill, init and query cookbook texts describe user selection as a rule distill follows rather than a guarantee, since other writers can still change the store (previously they said nothing reaches memory unselected)
internal claude session complete --drop-pendingmarks leftover proposals asdroppedand keeps them out of the rejection list that distill and reflect learn from (previously they were recorded as rejected by the user)internal claude session adoptrecords the adopted line range in the session record, andsession listshows a session asadoptedwhen its unread tail was adopted after a partial read (previously it showed as distilled)
Fixed
find --lexicalmatches different forms of a word in Russian, Greek, Arabic and Tamil, and in more cases for accented languages such as French, Portuguese and Turkish (previously stemming silently did nothing for non-Latin scripts)find --lexicalfinds words inside Chinese, Japanese and Korean text, and no longer matches unrelated Chinese characters that sound the same- Memory session start still shows the policy's
At session startsection and the distill backlog when no document matches the listing (previously the whole block was dropped) - Memory session start keeps each listing within its own
max_tokens(previously the first entry was always kept, even over the limit) internal claude session completechecks an area hub against its schema before linking a written document into it, and warns instead of writing when the hub would fail (previously the hub was written without a check)internal claude session completesaves the session record before linking area hubs and records a repeated capture or rejection only once, so a failed run can be run again (previously a failure could leave hubs linked with no record, and a repeated run counted twice)- A write that fails part way through restores the files it already changed (previously the earlier changes stayed on disk)
update -k <key> --contentchecks--expectagainst the document (previously the flag was silently ignored in body-overwrite mode)
iwes
Fixed
- Workspace symbol search matches different forms of a word in Russian, Greek, Arabic and Tamil, and in more cases for accented languages such as French, Portuguese and Turkish (previously stemming silently did nothing for non-Latin scripts)
- Workspace symbol search finds words inside Chinese, Japanese and Korean text, and no longer matches unrelated Chinese characters that sound the same
iwec
Changed
iwe_retrieveresults include each document's frontmatter as afrontmatterobject, andfrontmatter: falseleaves it out (previously frontmatter was never shown)iwe_retrieveexcludealso removes the excluded keys from every edge list (previously they were still listed there with their titles)
Fixed
iwe_querylexical search matches different forms of a word in Russian, Greek, Arabic and Tamil, and in more cases for accented languages such as French, Portuguese and Turkish (previously stemming silently did nothing for non-Latin scripts)iwe_querylexical search finds words inside Chinese, Japanese and Korean text, and no longer matches unrelated Chinese characters that sound the same- A write that fails part way through restores the files it already changed (previously the earlier changes stayed on disk)
Library crates (liwe, diwe)
diwe
Added
RetrieveOptions::frontmatterandDocumentOutput::frontmatter, the document's frontmatter in retrieve output, counted againstmax_tokens
Changed
RetrieveOptions::excludealso removes the excluded keys from every edge list inDocumentOutput
Fixed
apply_changesputs back every file it already removed, created or rewrote when a later write fails, and removes the directories it created for them (previously a failure part way through left the earlier changes on disk)