18.3.0: base tokens cut from 30k to 10k and offline counting for TypeSafe Jev 1.13
A toolchain release cuts base token usage to a third, folds multiple tools together to reduce overhead, and adds offline token counting for TypeSafe Jev 1.13 plus a multimodal auth gateway.
Few interesting changes in 18.3.0: - Reduced base token usage from ~30k to 10k (!!) You should have a much more pleasant experience with local models wrt: prefill. - Multiple tools were folded into read/write/bash eliminating tool overhead. - Skill descriptions are now compressed by default. - Added detection for Codex cyber access entitlements, explicitly requesting it even for non-daybreak models, which should get you less refusals if eligable. - Added support for Apple Foundational Models. (8K context so only viable as a tiny model for the time being) - Offline token counting for TypeSafe Jev 1.13 - Auth gateway support for systemone/image-gen/video-gen/transcription/...