zilliztech/GPTCache 0.1.12

v0.1.12

on GitHub

What's Changed

• Add object storage by @junjiejiangjjj in #213
• Only when the eviction policy is LRU, the data access_time is updated by @SimFG in #214
• Add logger for gptcache by @shiyu22 in #216
• The llm request can customize topk search parameters by @SimFG in #217
• Scalar return emb in ndarray by @junjiejiangjjj in #218

🎉 Introduction to new functions of GPTCache

1. The llm request can customize topk search parameters

openai.ChatCompletion.create(
    model="gpt-3.5-turbo",
    messages=[
        {"role": "user", "content": question},
    ],
    top_k=10,
)

Full Changelog: 0.1.11...0.1.12