NVIDIA/NeMo-Guardrails v0.16.0

on GitHub

[0.16.0] - 2025-09-05

Key Features

• Enhanced tracing system with OpenTelemetry semantic conventions. To learn more, refer to . For usage examples, refer to the following notebooks
  • Tracing Guardrails Quickstart
  • Tracing Guardrails with Jaeger
• Community integration with GuardrailsAI and Pangea AI Guard.

Other Changes

• Added documentation about using KV cache reuse for LLM-based NemoGuard NIMs. By using KV cache reuse, you can improve the performance of LLM-based NemoGuard NIMs where the system prompt is the same for all calls up to the point where user query and LLM response are injected. To learn more, refer to .

🚀 Features

• (llmrails) Support method chaining by returning self from LLMRails.register_* methods (#1296)
• Add Pangea AI Guard community integration (#1300)
• (llmrails) Isolate LLMs only for configured actions (#1342)
• Enhance tracing system with OpenTelemetry semantic conventions (#1331)
• Add GuardrailsAI community integration (#1298)

🐛 Bug Fixes

• (models) Suppress langchain_nvidia_ai_endpoints warnings (#1371)
• (tracing) Respect the user-provided log options regardless of tracing configuration
• (config) Ensure adding RailsConfig objects handles None values (#1328)
• (config) Add handling for config directory with .yml/.yaml extension (#1293)
• (colang) Apply guardrails transformations to LLM inputs and bot outputs. (#1297)
• (topic_safety) Handle InternalEvent objects in topic safety actions for Colang 2.0 (#1335)
• (prompts) Prevent IndexError when LLM provided via constructor with empty models config (#1334)
• (llmrails) Handle LLM models without model_kwargs field in isolation (#1336)
• (llmrails) Move LLM isolation setup to after KB initialization (#1348)

🚜 Refactor

• (llm) Move get_action_details_from_flow_id from llmrails.py to utils.py (#1341)

📚 Documentation

• Integrate with multilingual NIM (#1354)
• (tracing) Update tracing notebooks with VDR feedback (#1376)
• Add kv cache reuse documentation (#1330)
• (examples) Add Colang 2.0 example for sensitive data detection (#1301)
• Add extra slash to jailbreak detect nim_base_url(#1345)
• Add tracing notebook (#1337)
• Jaeger tracing notebook (#1353)
• (examples) Add NeMoGuard rails config for colang 2 (#1289)
• (tracing) Add OpenTelemetry span format guide (#1350)
• Add GuardrailsAI integration user guide and example (#1357)

🧪 Testing

• (jailbreak) Add missing pytest.mark.asyncio decorators (#1352)

⚙️ Miscellaneous Tasks

• (docs) Rename test_csl.py to csl.py (#1347)