This is (almost certainly) the last release to support versions of PyTorch earlier than 1.2.0. PyTorch 1.2.0 introduces some breaking changes that require changes to the allennlp library (as well as some new features that will allow us to make allennlp better), and so you should expect that the next release will require torch>=1.2.0
This introduces some changes to the CallbackTrainer, which moves much of the ancillary training behavior into configurable Callbacks. Its API should still be considered somewhat experimental; in particular, we are open to feedback on its design decisions. There are no current plans to get rid of the classic Trainer, although it is likely to get more and more unwieldy as we add new training functionality to the library.
This also includes the "srl_bert" model as featured in the allennlp demo, as well as many other fixes.
Full list of commits:
c8d7327 (tag: v0.8.5) bump version number to v0.8.5
9d8d36a quoref metric and evaluator (#3153)
7bacfad Set pytorch-transformer to 1.1.0 (#3171)
18daa29 Fix pearson correlation.py (#3101)
e641543 Add a test for the subcommands docstring help outputs (#3172)
b6af6eb bug fix for default tokenization of knowledge graph entities (#3170)
0f6b3b8 Make SrlBert model use SrlEvalMetric (#3168)
adad1bc Switch SemanticRoleLabeler metric to SrlEvalScorer. (#3164)
8fffd83 Add missing train command cache options (#3160)
770791a switch for DataIterators whether smaller batches should be skipped (#3140)
111db19 Create method to save instances to cache file. (#3131)
dac486e Fixing NaN warning with single element tensors (#3158)
6bbf82ef Move matplotlib import into function (#3157)
3ef43c9 Upgrade minimum spacy to 2.1.0 (#3152)
1d6e166 Fixing Conda download and install link on Readme (#3151)
f111d8a Pretrained transformer indexer (#3146)
fa1ff67 Add support for running preemptible workloads on beaker (#3143)
0bd3319 Add regularization parameter to Models (#3120)
bf968c6 add keep_as_dict option to Params.pop, use in Vocab and automat… (#3075)
217022f Adding a PretrainedTransformerTokenizer (#3145)
f9e2029 Update HTTP links to HTTPS where possible (#3142)
9093f47 Add dropout option for BERT Pooler (#3109)
23a089c pin pytorch away from 1.2 until we fix the tests (#3128)
0be4b48 fix UpdateMovingAverage.from_params (#3126)
9db0042 Upgrade conllu from 0.11 to 1.3.1 (#3115)
6746d12 pass cache_directory and cache_prefix to non-default trainers (#3077)
031bbf9 allenNLP broken link (#3086)
0caf364 Adding cached_path to input file of the predictor (#3098)
417a757 Adding ability to choose validation DatasetReader with "predict" (#3033)
30c4271 Close tensorboard's event files properly at the end of the training (#3085)
428c151 fix MetadataField.batch_tensors (#3084)
88a61e1 [Embedding] Forward given padding_index param to embedding() (#2504)
9ed9e2c remove executable permission for submods (#3080)
a1476c0 add equality check for index field; allennlp interpret (#3073)
5014d02 remove deprecated function call in hotflip (#3074)
014fe31 Improve dict missing key code (#3071)
9166c18 AllenNLP Interpret Basic Version (#3032)
7728b12 Minor WTQ ERM model and dataset reader fixes for demo (#3068)
ec30c90 remove dropout from test fixtures (#2889)
1cd2193 Revert "Lr scheduler bug" (#3065)
083f343 Lr scheduler bug (#2905)
5c64f9d warn about truncation only once (#3052)
ebe9113 Add options for focal loss (#3036)
c22ed57 Spacy token indexer (#3040)
a33436d Multilabel bug (#3021)
dd3476f simplify callback trainer (#3029)
0663e0b Fixes to ERM decoding script (#3041)
64d16ac fix shape comments (#3025)
354a19b Update documents to sentence_splitter.py (#3023)
427996d Fix forward in EndpointSpanExtractor (#3042)
38a1073 Update README.md
715422c Fix error in BooleanAccuracy when total count is 0 (#2991)
9e52e0f Remove separate start type prediction in state machines (#3030)
c2c4b64 Remove awscli from dependencies (#3024)
ae72049 Make per-batch logging quieter. (#3020)
57870f5 removing unnecessary data iteration (#3027)
e71618d Allow option to only reset some states in _EncoderBase (#2967)
15a9cbe PassThroughIterator (#3015)
70fa4aa Typo in initializers.py (#3016)
c85dcfc fix behavior when num_serialized_models_to_keep is 0 (#2880)
2cce412 fix type in vocab config (#2977)
7943b2f Expose the spacy language model for the word splitter in the se… (#3008)
9b929b2 Fixes inconsistent resetting of metrics with Validate and TrackMetrics callbacks (issue #3001) (#3002)
0a26739 Modified ActionSpaceWalker to use DomainLanguage (#3006)
9a13ab5 (vikigenius/master) do not evaluate after training if non-default trainer (#2997)
30ffaa5 Removed target_token_indexers documentation (#2990)
7b465c6 Clarify docs for CosineWithRestarts (#2953)
fb87872 Add never_split signature (#2463)
b6a2abb correct the wrong parameter note(target_namespace) (#2987)
cf247c6 Add model parameters / modules inspection helper. (#2466)
0fbd1ca WTQ dataset reader and models moved from iterative-search-semparse (#2764)
7e08298 Fix wordpiece indexer truncation (#2931)
03aa838 fix incorrect logging in viterbi decode (#2982)
51b74b1 use starting offsets in the srl model so output is wellformed (#2972)
bcd1070 Add cuda_device to Predictor.from_path (#2974)
459633c rename callbacks (#2966)
0f1bc3b DeprecationWarning removed for op-level token_embedders (#2955)
a655ad5 experimental: add backoff (#2968)
2a59be3 (epwalsh/master) Change registered names of scheduler callbacks (#2964)
2a88450 update sphinx version (#2959)
165b282 Bert srl model (#2961)
3dc99a7 Add missing param in CallbackTrainer.init docstring (#2960)
9e6e0af callback based trainer (#2817)
1b656dd Allowing for bulk adding of tokens to vocab (#2948)
c9eb2d0 Replace current default stopword list with spaCy's. (#2940)
6a3d3a8 ensure regularizers are only computed for parameters requiring gradients (#2887)
acfbb8c Replace s3 path style to virtual host style (#2873)
ac72c88 Fix Model.load fail if model_params is str (#2805)
e7b0013 Linear assignment depricated fix (#2950)
01602c8 Link to Wikitables and ATIS data. (#2947)
eaebe02 Update issue templates to request full stacktrace (#2876)
da16ad1 Multilingual parser and Cross-lingual ELMo (#2628)
92ee421 Fix for cyclic import problems (issue #2935) (#2938)
5e3c4cd token_type_ids fix for window reshaping (#2942)
44ba490 Use unsigned s3 requests when missing credentials (#2939)
c0f44f7 Fixed minor error while calculating span accuracy (#2923)
8e180cb Pad coreference model input to 5 (#2933)
9a0e01f fix trainable and requires_grad kwargs (#2932)
5f37783 Bert srl (#2854)
5b2066b Fix Invalid Index Reference for labels in Vocabulary (#2926)
c629093 CopyNet: replace in-place tensor operation with out-of-place equivalent (#2925)
89700de Change image to docker_image (#2918)
5393882 Change blueprint to image in run_with_beaker (#2903)
6afba9a Fix TextField padding when there are no tokens (#2843)
954a02f (vikigenius/release-v0.8.4, upstream/release-v0.8.4) Bump version numbers to v0.8.5-unreleased