allegroai/clearml 0.17.5

PyPI v0.17.5 - ClearML

on GitHub

Features

• Add force_download argument to Artifact.get() and Artifact.get_local_copy() #319
• Support all reporting using subprocesses instead of threads (default sdk.development.report_use_subprocess=True)
• Improve Datasets support
  • Add clearml-data publish to allow publishing a dataset task
  • Add clearml-data sync can now create, sync and close a dataset with a single command
  • Allow Dataset to be created on a running Task
  • Add dataset_tags argument to Dataset.get()
  • Add Dataset.get_logger()
• Add Task.add_requirements() support for specifying version <>=~ etc.
• Add StorageManager.upload_folder() and StorageManager.download_folder()
• Add progress report logging for StorageHelper.upload_from_stream(), StorageHelper.upload() and StorageHelper.upload_from_stream()
• Add jupyter auto-magic store jupyter notebook as an artifact on the Task (default sdk.development.store_jupyter_notebook_artifact=True)
• Add upload HTML preview of jupyter notebook as an artifact
• Add PipelineController disable clone base task option
• Add links to Tasks in optimization summary table (not just Task IDs)
• Add support for datetime in scatter plots + matplotlib support
• Improve plotly value type conforming
• Improve PyTorch DataLoader speed #207
• Update Auto Scaler default values and configuration
• Examples
  • Add Hydra example
  • Add artifacts retrieval example
  • Update various examples

Bug Fixes

• Fix warning or error message if requirements parsing failed #291
• Fix pytorch-lighting multi node store #292
• Fix strip remote diff #295
• Fix python package detection sklearn -> scikit-learn #296
• Fix argparse issues
  • Fix argparse with [None] in default parameter #297
  • Fix parsing of arguments in scientific notation #313
  • Fix argparser logging always captures defaults (Windows only, ignored cmd)
  • Fix argparse nargs passed in command line --nargs 1 2 should be stored as [1, 2] not as ['1', '2']
  • Fix support for nonstandard argparse with default value that is not of defined type
  • Fix server updated with the argparse in remote before Task.init() is called (respect skipped args)
• Fix Dataset support
  • Fix Dataset.remove_files() can't find files when files are in dataset root #303
  • Fix closing a dataset with only files removed
  • Fix Dataset generate removed / modified / added of summary table
• Fix hydra multi-run support #306
• Fix TF/TensorBoard support
  • Fix TensorBoard multiple Task.init()/Task.close() calls within the same process #312
  • Fix TensorBoard 2+ pr_curve
  • Fix TF pr_curve should not be inverted
  • Fix TF +2.3 mixed eager mode execution summary metrics not reported
  • Fix TF bind keyboard interrupt
  • Fix TF 2.4 keras load/save model
• Fix clearml-task
  • Fix error when script cannot be found
  • Fix --docker flag not passed
  • Fix patching local git diff
• Fix clearml-data
  • Fix clearml-data sync requires --name
  • Fix missing required argument --files in clearml-data remove
• Fix Task.execute_remotely() from Jupyter Notebook
• Fix populate Task called from Jupyter Notebook (use Task.create(packages=True) to auto populate based on locally installed packages)
• Fix plotly plot with numpy containing NaN/datetime
• Fix matplotlib with Agg backend (or in remote execution)
• Fix trying to upload model file as a folder (automatically package the folder)
• Fix broken packages on package importlib detection failed the entire requirements detection
• Fix Task.connect(object) should always return the same object instance
• Fix Task.create() with repo and script that exists locally
• Fix crash in case Logger.get_logger() cannot get the file name
• Fix exception at exit in python 3.8+ on MacOS/Windows
• Fix make pipeline summary table link to Task step logs
• Fix Hydra 1.1 support (argparse description)
• Fix close task after logger is closed
• Fix Task.set_base_docker() in remote execution
• Fix artifact preview limit to 64Kb
• Fix JupyterLab Notebook detection
• Fix Python 2.7 support