github explosion/spacy-models ja_core_news_trf-3.7.0

Downloads Downloads (wheel)

Checksum .tar.gz: 737a99c4f52fb0ab74af7e8fef64bb256e741babc58663dca3d1524728c65458
Checksum .whl: 2ab1bf9cda8ab3c59c031e556e2a15177019589c2315a802d46910e224bb9573

Details: https://spacy.io/models/ja#ja_core_news_trf

Japanese transformer pipeline (Transformer(name='cl-tohoku/bert-base-japanese-char-v2', piece_encoder='char', stride=160, type='bert', width=768, window=216, vocab_size=6144)). Components: transformer, morphologizer, parser, ner.

Feature Description
Name ja_core_news_trf
Version 3.7.0
spaCy >=3.7.0.dev0,<3.8.0
Default Pipeline transformer, morphologizer, parser, attribute_ruler, ner
Components transformer, morphologizer, parser, attribute_ruler, ner
Vectors 0 keys, 0 unique vectors (0 dimensions)
Sources UD Japanese GSD v2.8 (Omura, Mai; Miyao, Yusuke; Kanayama, Hiroshi; Matsuda, Hiroshi; Wakasa, Aya; Yamashita, Kayo; Asahara, Masayuki; Tanaka, Takaaki; Murawaki, Yugo; Matsumoto, Yuji; Mori, Shinsuke; Uematsu, Sumire; McDonald, Ryan; Nivre, Joakim; Zeman, Daniel)
UD Japanese GSD v2.8 NER (Megagon Labs Tokyo)
cl-tohoku/bert-base-japanese-char-v2 (Inui Laboratory, Tohoku University)
License CC BY-SA 3.0
Author Explosion
Model size 320 MB

Label Scheme

View label scheme (64 labels for 3 components)
Component Labels
morphologizer POS=NOUN, POS=ADP, POS=VERB, POS=SCONJ, POS=AUX, POS=PUNCT, POS=PART, POS=DET, POS=NUM, POS=ADV, POS=PRON, POS=ADJ, POS=PROPN, POS=CCONJ, POS=SYM, POS=NOUN|Polarity=Neg, POS=AUX|Polarity=Neg, POS=INTJ, POS=SCONJ|Polarity=Neg
parser ROOT, acl, advcl, advmod, amod, aux, case, cc, ccomp, compound, cop, csubj, dep, det, dislocated, fixed, mark, nmod, nsubj, nummod, obj, obl, punct
ner CARDINAL, DATE, EVENT, FAC, GPE, LANGUAGE, LAW, LOC, MONEY, MOVEMENT, NORP, ORDINAL, ORG, PERCENT, PERSON, PET_NAME, PHONE, PRODUCT, QUANTITY, TIME, TITLE_AFFIX, WORK_OF_ART

Accuracy

Type Score
TOKEN_ACC 99.37
TOKEN_P 97.65
TOKEN_R 97.90
TOKEN_F 97.77
POS_ACC 98.02
MORPH_ACC 0.00
MORPH_MICRO_P 33.56
MORPH_MICRO_R 96.08
MORPH_MICRO_F 49.75
SENTS_P 93.73
SENTS_R 97.24
SENTS_F 95.45
DEP_UAS 93.34
DEP_LAS 92.24
TAG_ACC 97.13
LEMMA_ACC 96.71
ENTS_P 83.74
ENTS_R 82.89
ENTS_F 83.31

Installation

pip install spacy
python -m spacy download ja_core_news_trf

Don't miss a new spacy-models release

NewReleases is sending notifications on new releases.