Releases: mlc-ai/xgrammar
v0.1.15
v0.1.14
Highlights
This version supports XGrammar on Linux Arm64, removes the restriction of glibc 2.28, and adds a source distribution.
It fixes the self-recursion error, extends apply_token_mask_inplace to support some corner cases.
It changes the API of StructuralTag, renaming field "start" to "begin".
What's Changed
- update GenerateRangeRegex by @zanderjiang in #182
- [Fix] Fix compatibility for apply_token_bitmask_inplace by @Ubospica in #206
- [Feature] Support self-recursion in json schema reference by @Ubospica in #210
- Modernize build to support sdists by @zbowling in #190
- Update README to announce that Modular MAX uses XGrammar by @zbowling in #217
- [Feature] Support padding for logits and unequal batch size for logits and bitmask by @Ubospica in #220
- [Refactor][Breaking] Rename start->begin in StructuralTag by @Ubospica in #221
- Bump to v0.1.14 by @Ubospica in #222
New Contributors
Full Changelog: v0.1.13...v0.1.14
v0.1.13
Highlight
This version enhances the compatibility of XGrammar on various platforms. It also provides full support for regex. Now most features are supported. It also enhances the efficiency of the token bitmask application kernel.
What's Changed
- [Fix] Fix popcount for windows by @Ubospica in #167
- [Fix] Rollback safely when token acceptance fails by @benchislett in #164
- fix(fsm): fix error of dangling-reference in gcc-13 by @DarkSharpness in #171
- fix(test): fix the concurrency issue in #168 by @DarkSharpness in #170
- [Debug] Support cpptrace by @Ubospica in #176
- [Feature] Support Regex for GrammarCompiler by @Ubospica in #185
- [Docs] Add news section by @Ubospica in #191
- [Fix] Remove redundant grammar_functor.cc by @Ubospica in #195
- [Maintain] Add toml formatter by @Ubospica in #196
- [Maintain] Add no-sort to toml fmt by @Ubospica in #198
- [Maintain] Update toml formatter by @Ubospica in #199
- [Feature] Support Optimized CUDA Token Bitmask Kernel by @syuoni in #186
- [Maintain] Support Python 3.13 for Manylinux by @Ubospica in #200
New Contributors
Full Changelog: v0.1.11...v0.1.12
v0.1.11
Highlight
In this PR we supported the structural tag. This is a new feature that can support strict function calling (and many more flexible patterns). Read the brief doc to learn more. We will introduce it in details soon.
What's Changed
- [Feature] Structural tag by @Ubospica in #162
- [Fix] Fix #162 by @Ubospica in #163
- [Fix] Fix broken rollback char count after accepting stop token by @benchislett in #161
- [Feature] Optional Token Bitmask by @Ubospica in #165
Full Changelog: v0.1.10...v0.1.11
v0.1.10
Highlight
In this version we enhanced the ability of json schema, ebnf, and provided APIs for grammar concat and union.
What's Changed
- [Feature] Support regex and repetition range by @Ubospica in #144
- [Refactor] Rename internal classes for better structure by @Ubospica in #145
- [FunctionCalling] Support TagDispatch by @Ubospica in #146
- [Fix] Fix doc dependencies by @Ubospica in #147
- [Fix] Fix doc dependencies by @Ubospica in #148
- [Feature] Grammar concat and union by @Ubospica in #149
- [Fix] Fix compilation error with virtual overloaded function by @Ubospica in #150
- [Refactor] Refactor GrammarMatcherBase by @Ubospica in #151
- [3rdparty] Avoid macro redefinition in picojson by @MasterJH5574 in #153
Full Changelog: v0.1.9...v0.1.10
Release v0.1.8
Features
- Enhance JSON Schema converter by @Ubospica in #134
- Enhance EBNF Parser by @observerw in #125
- Support sentencepiece tokenizer by @zanderjiang in #120
- Enhance ApplyMask kernels to provide better support in mix-structured-and-unstructured cases by @Ubospica in #128
Release v0.1.6
Features
- The ability of the JSON Schema converter is enhanced to support integer range and regex pattern. Thanks @joennlae
Bug Fixes
- Solves the problem of strict JSON format degrading the LLM output quality
Release v0.1.4
This is the stable release version of XGrammar. It provides efficient and portable API for LLM structured generation.