This is a quick bugfix release on top of v1.17.1 to fix some bugs in TensorRT. Only the TensorRT executables are provided in this release since this is the only backend that was affected by the bugs fixed. See v1.17.1 for all other backends and for the new strong transformer nets, and v1.17.0 for the much longer list of changes new in v1.17.x!
Bugs fixed in v1.17.2
- TensorRT 10.16 could nondeterministically segfault or hang on startup when using more than one GPU, when multiple GPU threads built their engines at the same time. Engine builds are now serialized across GPUs. (#1225, thanks @zsqdx!)
- TensorRT could fail to build the network with very large
maxBatchSizeand/or a large number of search threads, because KataGo was capping the TensorRT workspace at 1 GiB and attention tensors alone could exceed it. KataGo now leaves the workspace at TensorRT's automatic device-dependent sizing. (#1229, thanks @zsqdx!) - The humanSL model (
b18c384nbt-humanv0.bin.gzfrom here), failed on TensorRT in v1.17.0 and v1.17.1, erroring with "OnnxModelBuilder: SGF metadata encoder not yet supported". It should work now. - The built TensorRT executables on linux now have protobuf provided as part of the appimage, to resolve the issue where some systems have different versions (#1226)
This release bumps TensorRT plan and timing cache version, both because of the metadata encoder support above and to avoid reusing any caches that might have been polluted by prior bugs. So the first run of this version will be slower to start up while it re-tunes, as usual.