Features
- Add support for MegEngine with examples (#455)
- Add
TaskTypes
to main namespace (#453) - Add
LogUnifomParameterRange
for hyperparameter optimization with Optuna (#462) - Add joblib (equivalent to scikit) to
Task.init(auto_connect_frameworks)
argument - Log environment variables starting with
*
inenviron_bind.py
(#459) - Pipeline
- Add eager decorated pipeline execution
- Support pipeline monitoring for scalers/models/artifacts
- Add
PipelineController.upload_model()
- Add
PipelineController.add_step(configuration_overrides)
argument allowing to override Task configuration objects - Change
PipelineController.start_locally()
defaultrun_pipeline_steps_locally=False
- Add
PipelineController.stop(mark_failed, mark_aborted)
argguments - Add
PipelineController.run_locally
decorator - Add
PipelineController.continue_on_fail
property - Add
PipelineController.__init__(abort_on_failure)
argument - Add ClreamlJob state cache (refresh every second)
- Datasets
- Add
clearml-data
multi-chunk support - Change
clearml-data
default chunk size to 512MB - Change
Dataset.create()
now automatically reverts to using current Task if no project/name provided
- Add
- Add
Optimizer.get_top_experiments_id_metrics_pair()
for top performing experiments - Add support for setting default value to auto connected argparse arguments
- Add
Task.get_script()
andTask.set_script()
for getting and setting task's script prioerties for execution - Add
Task.mark_completed()
force
andstatus_message
arguments - Add
Task.stopped()
reason
argument - Add
Task.query_tasks()
,Task.get_task()
andTask.get_tasks()
tags
argument
Bug Fixes
- Fix PyJWT resiliency support
- Fix xgb train overload (#456)
- Fix
http://
throwsOSError
in Windows by usingpathlib2
instead ofos
(#463) - Fix local diff should include staged commits, otherwise applying git diff fails (#457)
- Fix
task.upload_artifact
non-standard dictionary will now revert topickle
(#452) - Fix
S3BucketConfig.is_valid()
for EC2 environments withuse_credentials_chain
(#478) - Fix audio classifier example when training with a custom dataset (#484)
- Fix
clearml-task
diff was corrupted by Windows drive letter and separator (#483) - Fix TQDM "line cleanup" not using
CR
but rather arrow-up escape sequence (#181) - Fix
task.connect(dict)
value casting - ifNone
is the default value, use backend stored type - Fix Jupyter notebook should always set Task as completed/stopped, never failed (exceptions are caught in interactive session)
- Fix Pipeline support
- Fix
LocalClearmlJob
setting failed status - Fix pipeline stopping all running steps
- Fix nested pipeline component parent point to pipeline Task
- Fix
PipelineController.start()
should not kill the process when done - Fix pipeline failing to create Step Task should cause the pipeline to be marked failed
- Fix nested pipeline components missing pipeline tags
- Fix
- Fix images reported over history size were not sent if frequency was too high
- Fix git detectors missing git repository without origin
- Fix support for upload
LazyEvalWrapper
artifacts - Fix duplicate task dataset tags
- Fix FileLock create target folder
- Fix crash inside forked subprocess might leave SafeQueue in a locked state, causing
task.close()
to hang - Fix PyTorch distributed example
TimeoutSocket
issue in Windows - Fix broken
Dataset.finalize()
- Fix Python 3.5 compatibility