Enhancements
General
- Enables AI search, pipelines, and search relevancy features for the 2023 (now default) cluster plans. This makes these features available to all new paid plan customers
Pipelines
- Optimizes latency of the boost stages for pipelines
- Optimizes pipeline invocation calls reporting to happen in batch instead of per each call
- Adds
?debug=true
API flag support to see the response time per stage in the pipeline response
These enhancements make pipelines usable for production scenarios.
AI Search
- Improves AI Answer Dx by returning error when a user-specified
maxToken
value exceeds limit, informing the max valid value that can be set - Adds initial support for FAQ type of suggestions: An AI or human-provided answer can be marked as FAQ and be displayed in the SearchBox UI to end-users
- Adds support for returning
index
anddocument_ids
in the session details API endpoint
Build
- Uses Go1.20.4 as the build image for both Cloud and Docker images
- Includes build time profiling optimizations - expected ~2-4% performance improvement over 8.12 release