NVIDIA/NeMo-Guardrails v0.6.0

Release v0.6.0

on GitHub

This release builds on the feedback received over the last few months and brings many improvements and new features. It is also the first beta release for NeMo Guardrails. Equally important, this release is the first to include LLM vulnerability scan results for one of the sample bots.

Release highlights include:

• Better configuration and support for input, output, dialog, retrieval, and execution rails.
• Ability to reduce the overall latency using single_call mode or embeddings_only mode for dialog rails.
• Support for streaming.
• First version of the Guardrails Library.
• Fast fact-checking using AlignScore.
• Updated Getting Started guide.
• Docker image for easy deployment.

Detailed changes are included below.

Added

• Support for explicit definition of input/output/retrieval rails.
• Support for custom tasks and their prompts.
• Support for fact-checking using AlignScore.
• Support for NeMo LLM Service as an LLM provider.
• Support for making a single LLM call for both the guardrails process and generating the response (by setting rails.dialog.single_call.enabled to True).
• Support for sensitive data detection guardrails using Presidio.
• Example using NeMo Guardrails with the LLaMa2-13B model.
• Dockerfile for building a Docker image.
• Support for prompting modes using prompting_mode.
• Support for TRT-LLM as an LLM provider.
• Support for streaming the LLM responses when no output rails are used.
• Integration of ActiveFence ActiveScore API as an input rail.
• Support for --prefix and --auto-reload in the guardrails server.
• Support for loading a configuration from dictionary, i.e. RailsConfig.from_content(config=...).
• Guidance on LLM support.
• Support for LLMRails.explain() (see the Getting Started guide for sample usage).

Changed

• Allow context data directly in the /v1/chat/completion using messages with the type "role".
• Allow calling a subflow whose name is in a variable, e.g. do $some_name.
• Allow using actions which are not async functions.
• Disabled pretty exceptions in CLI.
• Upgraded dependencies.
• Updated the Getting Started Guide.
• Main README now provides more details.
• Merged original examples into a single ABC Bot and removed the original ones.
• Documentation improvements.

Fixed

• Fix going over the maximum prompt length using the max_length attribute in Prompt Templates.
• Fixed problem with nest_asyncio initialization.
• #144 Fixed TypeError in logging call.
• #121 Detect chat model using openai engine.
• #109 Fixed minor logging issue.
• Parallel flow support.
• Fix HuggingFacePipeline bug related to LangChain version upgrade.