bentoml/BentoML v1.0.15

BentoML - v1.0.15

on GitHub

🍱 BentoML v1.0.15 release is here featuring the introduction of the bentoml.diffusers framework.

• Learn more about the capabilities of the bentoml.diffusers framework in the Creating Stable Diffusion 2.0 Service With BentoML And Diffusers blog and BentoML Diffusers example project.

• Import a diffusion model with the bentoml.diffusers.import_model API.

  import bentoml
  
  bentoml.diffusers.import_model(
      "sd2",
      "stabilityai/stable-diffusion-2",
  )

• Create a text2img service using a Stable Diffusion 2.0 model runner with the familiar to_runner API from the bentoml.diffuser framework.

  import torch
  from diffusers import StableDiffusionPipeline
  
  import bentoml
  from bentoml.io import Image, JSON, Multipart
  
  bento_model = bentoml.diffusers.get("sd2:latest")
  stable_diffusion_runner = bento_model.to_runner()
  
  svc = bentoml.Service("stable_diffusion_v2", runners=[stable_diffusion_runner])
  
  @svc.api(input=JSON(), output=Image())
  def txt2img(input_data):
      images, _ = stable_diffusion_runner.run(**input_data)
      return images[0]

🍱 Fixed a incompatibility change introduced in starlette==0.25.0 result in the type MultiPartMessage not being found in starlette.formparsers.

ImportError: cannot import name 'MultiPartMessage' from 'starlette.formparsers' (/opt/miniconda3/envs/bentoml/lib/python3.10/site-packages/starlette/formparsers.py)

What's Changed

• chore(deps): bump pytest-xdist[psutil] from 3.1.0 to 3.2.0 by @dependabot in #3536
• fix: include dockerfile_template to Bento for containerize by @aarnphm in #3501
• chore: add missing logger and fix types by @aarnphm in #3453
• chore(rtd): disable epub and pdf as format by @aarnphm in #3544
• feat(torchscript): support _extra_files by @aarnphm in #3480
• refactor(ci): make sure to run types on py,pyi files by @aarnphm in #3545
• fix(server): deprecate client and cache get_client by @aarnphm in #3547
• chore(serve): update options for triton_options by @aarnphm in #3503
• tools(linter): Ruff by @aarnphm in #3539
• chore(deps): bump ruff from 0.0.243 to 0.0.244 by @dependabot in #3548
• chore(type): remove cattr type ignore by @aarnphm in #3550
• chore: bumping otlp deps to 1.15 by @aarnphm in #3351
• docs: Add an example index by @ssheng in #3551
• revert: "chore: bumping otlp deps to 1.15" by @bojiang in #3553
• chore(deps): bump bufbuild/buf-setup-action from 1.13.1 to 1.14.0 by @dependabot in #3554
• chore(deps): bump ruff from 0.0.244 to 0.0.246 by @dependabot in #3559
• chore(deps): bump imageio from 2.25.0 to 2.25.1 by @dependabot in #3557
• chore: update README.md by @timliubentoml in #3565
• feat(containerization): support 11.7 by @aarnphm in #3567
• chore: remove deprecation warning when building bentos by @CheeksTheGeek in #3566
• feature(framework): diffusers by @larme in #3534
• fix: update formparser for new starlette by @sauyon in #3569

New Contributors

• @CheeksTheGeek made their first contribution in #3566

Full Changelog: v1.0.14...v1.0.15