1.65.0 (2024-09-04)
⚠ BREAKING CHANGES
- Tokenization - Deprecated
ComputeTokenResult.token_info_listin favor ofComputeTokenResult.tokens_info
Features
- Add support for system instruction and tools in tokenization. (72fcc06)
- Add vector search alpha to rag retrieval for hybrid search ranking (6624ebe)
- Adding Weaviate Vector DB option for RAG corpuses to SDK (9b28202)
- GenAI - Added
system_instructionandtoolssupport toGenerativeModel.count_tokens(50fca69) - GenAI - Added Llama3 support in GenAI batch prediction (6166152)
- PrivateEndpoint.stream_raw_predict (197f333)
- Support reserved_ip_ranges for VPC network in Ray on Vertex cluster (36a56b9)
- Tokenization - Deprecated
ComputeTokenResult.token_info_listin favor ofComputeTokenResult.tokens_info(efbcb54)