We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 4700ce2 commit 2478decCopy full SHA for 2478dec
README.rst
@@ -809,6 +809,7 @@ can be found in the file ``test/toktest_normal_gold_expected.txt``.
809
Changelog
810
---------
811
812
+* Version 3.1.1: Minor fixes; added Tok.from_token()
813
* Version 3.1.0: Added `-o` switch to `tokenize` command to return original
814
token text, enabling the tokenizer to run as a sentence splitter only.
815
* Version 3.0.0: Added tracking of character offsets for tokens within the
src/tokenizer/version.py
@@ -1 +1 @@
1
-__version__ = "3.1.0"
+__version__ = "3.1.1"
0 commit comments