✨ New features and improvements
- NEW:
span_finderpipeline component to identify overlapping, unlabeled spans (#12507). - Language updates:
- Add option to return scores separately keyed by component name with
spacy evaluate --per-component,Language.evaluate(per_component=True)andScorer.score(per_component=True)(#12540). - Support custom token/lexeme attribute for vectors (#12625).
- Support
spancat_singlelabelinspacy debug dataCLI (#12749). - Typing updates for
PhraseMatcherandSpanGroup(#12642, #12714).
🔴 Bug fixes
- #12569: Require that all
SpanGroupspans come from the current doc.
📦 Trained pipelines updates
We have added new pipelines for Slovenian that use the trainable lemmatizer and floret vectors.
| Package | UPOS | Parser LAS | NER F |
|---|---|---|---|
sl_core_news_sm
| 96.9 | 82.1 | 62.9 |
sl_core_news_md
| 97.6 | 84.3 | 73.5 |
sl_core_news_lg
| 97.7 | 84.3 | 79.0 |
sl_core_news_trf
| 99.0 | 91.7 | 90.0 |
- 🙏 Special thanks to @orglce for help with the new pipelines!
The English pipelines have been updated to improve handling of contractions with various apostrophes and to lemmatize "get" as a passive auxiliary.
The Danish pipeline da_core_news_trf has been updated to use vesteinn/DanskBERT with performance improvements across the board.
⚠️ Backwards incompatibilities
SpanGroupspans are now required to be from the same doc. When initializing aSpanGroup, there is a new check to verify that all added spans refer to the current doc. Without this check, it was possible to run into string store or other errors.
📖 Documentation and examples
- Various documentation corrections and updates.
- New additions to spaCy Universe:
👥 Contributors
@adrianeboyd, @bdura, @danieldk, @davidberenstein1957, @diyclassics, @essenmitsosse, @honnibal, @ines, @isabelizimm, @jmyerston, @kadarakos, @KennethEnevoldsen, @khursani8, @ljvmiranda921, @rmitsch, @shadeMe, @svlandeg, @tomaarsen, @victorialslocum, @vin-ivar, @ZiadAmerr