ML-Agents Release 10

Package Versions

NOTE: It is strongly recommended that you use packages from the same release together for the best experience.

Major Features and Improvements

New Demo Environment

• The Match3 environment was added to the Project, it uses the new utilities added in com.unity.ml-agents.extensions.

ml-agents / ml-agents-envs / gym-unity (Python)

• PyTorch trainers are now the default. See the installation docs for more information on installing PyTorch. For the time being, TensorFlow is still available; you can use the TensorFlow backend by adding --tensorflow to the CLI, or adding framework: tensorflow in the configuration YAML. (#4517)

Bug Fixes and Minor Changes

com.unity.ml-agents / com.unity.ml-agents.extensions (C#)

• The Barracuda dependency was upgraded to 1.1.2 (#4571)
• Utilities were added to com.unity.ml-agents.extensions to make it easier to integrate with match-3 games. See the readme for more details. (#4515)
• Agent.CollectObservations() and Agent.EndEpisode() will now throw an exception if they are called recursively (for example, if they call Agent.EndEpisode()). Previously, this would result in an infinite loop and cause the editor to hang. (#4573)

ml-agents / ml-agents-envs / gym-unity (Python)

• The action_probs node is no longer listed as an output in TensorFlow models (#4613).