Installation
pip install openllm==0.3.10To upgrade from a previous version, use the following command:
pip install --upgrade openllm==0.3.10Usage
All available models: openllm models
To start a LLM: python -m openllm start opt
To run OpenLLM within a container environment (requires GPUs): docker run --gpus all -it -P ghcr.io/bentoml/openllm:0.3.10 start opt
To run OpenLLM Clojure UI (community-maintained): docker run -p 8420:80 ghcr.io/bentoml/openllm-ui-clojure:0.3.10
Find more information about this release in the CHANGELOG.md
What's Changed
- chore(deps-dev): bump @typescript-eslint/parser from 6.7.5 to 6.8.0 by @dependabot in #511
- chore(deps-dev): bump @next/eslint-plugin-next from 13.5.4 to 13.5.5 by @dependabot in #510
- chore(deps-dev): bump @typescript-eslint/eslint-plugin from 6.7.5 to 6.8.0 by @dependabot in #509
- ci: pre-commit autoupdate [pre-commit.ci] by @pre-commit-ci in #529
- chore(deps): bump actions/checkout from 4.1.0 to 4.1.1 by @dependabot in #528
- chore(deps): bump github/codeql-action from 2.22.3 to 2.22.4 by @dependabot in #527
- chore(deps): bump taiki-e/install-action from 2.20.3 to 2.20.15 by @dependabot in #526
- chore(deps-dev): bump eslint-plugin-import from 2.28.1 to 2.29.0 by @dependabot in #525
- chore(deps-dev): bump turbo from 1.10.15 to 1.10.16 by @dependabot in #521
- chore(deps-dev): bump @types/dedent from 0.7.0 to 0.7.1 by @dependabot in #524
- chore(falcon): Use official implementation by @aarnphm in #530
- chore(deps-dev): bump @types/node from 20.5.3 to 20.8.7 by @dependabot in #522
- feat: Conversation template by @XunchaoZ in #519
Full Changelog: v0.3.9...v0.3.10