FluxML/Flux.jl v0.16.8

on GitHub

Flux v0.16.8

Diff since v0.16.7

Merged pull requests:

• Enable other reactant tests (#2600) (@wsmoses)
• fix code in docs too wide (#2641) (@CarloLucibello)
• Set early_stopping default value for init_score to Inf (#2642) (@andreuvall)
• extend gradient to take an ADType argument (#2645) (@CarloLucibello)
• allow passing an ADType to train! (#2650) (@CarloLucibello)

Closed issues:

• Local Response Normalisation (#192)
• generic_matmul! hit in back! because type-promotion in activation function (#613)
• Layer Transpose (#635)
• add trainstep! (#666)
• Hypernetwork API (#797)
• Optimizer handling of infinite loss (#821)
• Flux Optimizers should define equality (#823)
• Model optimization fails (NaNs) with Zygote.pullback but works with Tracker.forward (#876)
• more issue labels? (#879)
• Diagonal does not return same size due to broadcast (#890)
• Integrate epochs within Flux.train! (#1058)
• Simplest linear model on housing data w/ Flux (#1122)
• OneHotVector(i, n) when i > n (#1300)
• Support DirectML (#1347)
• Feature request: Modifying Dense Layer to accommodate kernel/bias constraints and kernel/bias regularisation (#1389)
• Flux.softmax returns wrong result with CuArray (#1425)
• Rethink train design and better callbacks support (#1461)
• tied weights (by transposition) are not tied when sent to gpu (#1504)
• Regularization example from docs can't be differentiated (#1588)
• Tied weights using Flux layers (#1592)
• Import Flux on worker crashes (#1625)
• Unclear wording in "Composing Optimizers" section of docs (#1627)
• Recurrent network interface updates/design (#1678)
• Please do not deprecate Dense(...;initb=...) (#1684)
• Triage Meetings (#1709)
• Differentiating a Model While Resetting the Parameters at every Epoch (#1766)
• BatchNorm on GPU without affine or tracking statistics (#1810)
• Float32 parameters in structs unsupported? (#1817)
• using Flux -> InitError: IOError: mkdir("/pbs/software/centos-7-x86_64/julia/1.7.0/share/julia/packages/Flux/BPPNj/src/data/../../deps"; mode=0o777): read-only file system (EROFS) (#1839)
• Easy to make mistake with gpu() (#1887)
• Inline printing for OneHotArray is not GPU-friendly (#1905)
• Freezing layers at model construction time (#1931)
• Unable to precompile -- "allequal not defined" (#1934)
• Weird Side Effects of loadparams! (#1979)
• Taking serialization seriously (#1988)
• Issue with logitcrossentropy on onehotencoded input on GPU (#2002)
• Add default inner constructor to Dense (#2158)
• docs on freezing layers should be ported to the explicit syntax (#2216)
• Loading Flux 0.13.15 for the first time results in error (#2232)
• Default for init_score in early_stopping (#2639)
• Does not compile anymore in conjunction with CUDA due to dependency on MLDataDevices (#2647)