Highlights
- Ray Data: We added fixes for several
to_pandasregressions introduced in 2.56: an opt-out flag (RAY_DATA_ENABLE_ARROW_BACKED_PANDAS_CONVERSION) for Arrow-backed conversion, an int64/double[pyarrow]overflow crash on concatenation, and aTensorDtype.__from_arrow__crash on empty tensor columns (#64793, #64794). - Ray Core: We added early detection for system-slice memory pressure: the memory monitor now snapshots the user and system cgroup slices together and logs an error when the system slice exceeds reserved system memory, warning users to raise
--system-reserved-memorybefore it causes node deaths (#64492). - Ray Serve: We added protobuf 7 compatibility and a routing fix for LLM direct streaming, so body-aware routers like
PrefixCacheAffinityRouterno longer hang whenRAY_SERVE_LLM_ENABLE_DIRECT_STREAMING=1(#64592, #64488).
Ray Data
🔨 Fixes
- Fixed two Arrow-backed
to_pandasregressions: addedDataContext.enable_arrow_backed_pandas_conversionas an opt-out, and reconciled divergent numeric column types before concatenation to avoid int64/double[pyarrow]overflow crashes (#64793, #64768). - Fixed a
TensorDtype.__from_arrow__crash on zero-size tensor elements by using an explicit row count instead of numpy's-1dimension inference (#64794, #64767). - Fixed a crash in hash partition caused by read-only hash arrays (#64584, #64552, #64559).
- Nullified
_input_dependenciesin_get_argsso exporting operator args no longer triggers an exponentialsanitize_for_structcall chain over fused operators (#64412, #64316).
Ray Serve
🔨 Fixes
- Added protobuf
>=7compatibility to_proto_to_dictby binding toFieldDescriptor.is_repeatedwhen the deprecatedlabelattribute is absent (#64592, #64362).
Ray LLM
🔨 Fixes
- Fixed direct-streaming routing for body-aware routers: the ingress now parses the raw request body into a
SimpleNamespaceover routing-key fields (messages,prompt) sochoose_replicareceives the message body instead of raw bytes (#64488, #64328, #64326).
Ray RLlib
🔨 Fixes
- Upgraded the ONNX example from the retired MobileNet v1 to MobileNet v3 via
torchvisionand pinnedonnxscriptin the GPU/ml-build CI dep locks, fixing ONNX export failures (#64591, #64028, #64031, #64590, #64033).
Ray Core
💫 Enhancements
- The threshold memory monitor now snapshots both the user and system cgroup slices and logs an error when system-slice usage exceeds the reserved system memory, prompting users to raise
--system-reserved-memory(#64492).
🔨 Fixes
- Disabled NCCL
cuMemhost buffer registration in CI pytests to stabilize GPU test runs (#64580, #64146).