databricks/databricks-sdk-py v0.19.0

on GitHub

Improvements and Bug Fixes

• Construct workspace client from account client (#527).
• Enabled Databricks OAuth also for Azure and GCP (#526).
• Do not terminate listing for token-based pagination resources on empty response (#530).
• Renamed databricks.sdk.errors.mapping to databricks.sdk.errors.platform (#522).
• Added Union to content (2nd) parameter in upload function (#493).
• Fixed WorkspaceConf.get_status and WorkspaceConf.set_status (#525).

Documentation

• Make docs useful again (#519).
• Show undocumented fields in dataclasses (#520).

API Changes

Additions:

• Added the following dataclasses:
  • databricks.sdk.service.catalog.CancelRefreshRequest
  • databricks.sdk.service.catalog.GetRefreshRequest
  • databricks.sdk.service.catalog.ListRefreshesRequest
  • databricks.sdk.service.catalog.MonitorRefreshInfo
  • databricks.sdk.service.catalog.MonitorRefreshInfoState
  • databricks.sdk.service.catalog.RunRefreshRequest
  • databricks.sdk.service.compute.Adlsgen2Info
  • databricks.sdk.service.compute.GcsStorageInfo
  • databricks.sdk.service.files.CreateDirectoryRequest
  • databricks.sdk.service.files.DeleteDirectoryRequest
  • databricks.sdk.service.files.DirectoryEntry
  • databricks.sdk.service.files.ListDirectoryContentsRequest
  • databricks.sdk.service.files.ListDirectoryResponse
  • databricks.sdk.service.files.PageToken
  • databricks.sdk.service.jobs.ForEachStats
  • databricks.sdk.service.jobs.ForEachTask
  • databricks.sdk.service.jobs.ForEachTaskErrorMessageStats
  • databricks.sdk.service.jobs.ForEachTaskTaskRunStats
  • databricks.sdk.service.jobs.RunForEachTask
  • databricks.sdk.service.pipelines.PipelineClusterAutoscale
  • databricks.sdk.service.pipelines.PipelineClusterAutoscaleMode
  • databricks.sdk.service.settings.DeleteDefaultNamespaceSettingRequest
  • databricks.sdk.service.settings.DeleteDefaultNamespaceSettingResponse
  • databricks.sdk.service.settings.DeleteRestrictWorkspaceAdminsSettingRequest
  • databricks.sdk.service.settings.DeleteRestrictWorkspaceAdminsSettingResponse
  • databricks.sdk.service.settings.GetDefaultNamespaceSettingRequest
  • databricks.sdk.service.settings.GetPersonalComputeSettingRequest
  • databricks.sdk.service.settings.GetRestrictWorkspaceAdminsSettingRequest
  • databricks.sdk.service.settings.RestrictWorkspaceAdminsMessage
  • databricks.sdk.service.settings.RestrictWorkspaceAdminsMessageStatus
  • databricks.sdk.service.settings.RestrictWorkspaceAdminsSetting
  • databricks.sdk.service.settings.UpdateDefaultNamespaceSettingRequest
  • databricks.sdk.service.settings.UpdateRestrictWorkspaceAdminsSettingRequest
• Added cancel_refresh(), get_refresh(), list_refreshes() and run_refresh() method for w.lakehouse_monitors workspace-level service.
• Added use_preemptible_executors field for databricks.sdk.service.compute.GcpAttributes.
• Added zone_id field for databricks.sdk.service.compute.GcpAttributes.
• Added abfss and gcs field for databricks.sdk.service.compute.InitScriptInfo.
• Added create_directory(), delete_directory() and list_directory_contents() method for w.files workspace-level service.
• Added source field for databricks.sdk.service.jobs.DbtTask and databricks.sdk.service.jobs.SqlTaskFile.
• Added for_each_task field for databricks.sdk.service.jobs.RunTask, databricks.sdk.service.jobs.SubmitTask and databricks.sdk.service.jobs.Task.
• Added field_mask field for databricks.sdk.service.settings.UpdatePersonalComputeSettingRequest.
• Added delta_sync_index_spec field for databricks.sdk.service.vectorsearch.CreateVectorIndexRequest.
• Added file_type field for databricks.sdk.service.workspace.ExportResponse.
• Added resource_id field for databricks.sdk.service.workspace.ObjectInfo.
• Added delete_default_namespace_setting(), delete_restrict_workspace_admins_setting(), get_default_namespace_setting(), get_restrict_workspace_admins_setting(), update_default_namespace_setting() and update_restrict_workspace_admins_setting() method for w.settings workspace-level service.
• Added get_personal_compute_setting() method for a.account_settings account-level service.

Removals:

• Removed the following dataclasses:
  • databricks.sdk.service.settings.ReadDefaultWorkspaceNamespaceRequest
  • databricks.sdk.service.settings.ReadPersonalComputeSettingRequest
  • databricks.sdk.service.settings.UpdateDefaultWorkspaceNamespaceRequest
  • databricks.sdk.service.settings.DeleteDefaultWorkspaceNamespaceRequest
  • databricks.sdk.service.settings.DeleteDefaultWorkspaceNamespaceResponse
  • databricks.sdk.service.pipelines.ResetRequest
• Removed the following methods:
  • get_status() for w.files workspace-level service.
  • reset() for w.pipelines workspace-level service.
  • delete_default_workspace_namespace() for w.settings workspace-level service.
  • read_default_workspace_namespace() for w.settings workspace-level service.
  • update_default_workspace_namespace() for w.settings workspace-level service.
  • read_personal_compute_setting() for a.account_settings account-level service.
• Removed name field for databricks.sdk.service.catalog.UpdateConnection, databricks.sdk.service.catalog.UpdateMetastore, databricks.sdk.service.catalog.UpdateRegisteredModelRequest. databricks.sdk.service.catalog.UpdateSchemaand databricks.sdk.service.catalog.UpdateVolumeRequestContent.
• Removed delta_sync_vector_index_spec field for databricks.sdk.service.vectorsearch.CreateVectorIndexRequest.

Changes:

• Changed max_workers and min_workers field for databricks.sdk.service.compute.AutoScale to no longer be required.
• Changed destination field for databricks.sdk.service.compute.DbfsStorageInfo, databricks.sdk.service.compute.LocalFileInfo, databricks.sdk.service.compute.S3StorageInfo, databricks.sdk.service.compute.VolumesStorageInfo and databricks.sdk.service.compute.WorkspaceStorageInfo to be required.
• Changed clients field for databricks.sdk.service.compute.WorkloadType to be required.
• Changed allow_missing and setting field for databricks.sdk.service.settings.UpdatePersonalComputeSettingRequest to be required.
• Changed etag field for databricks.sdk.service.settings.DeletePersonalComputeSettingRequest to no longer be required.
• Changed autoscale field for databricks.sdk.service.pipelines.PipelineCluster to databricks.sdk.service.pipelines.PipelineClusterAutoscale dataclass.
• Changed delete_personal_compute_setting() and update_personal_compute_setting() method for a.account_settings account-level service with new required argument order.

Internal Changes

• Generate SDK (#536).
• Use fake clock for faster unit tests (#533).
• Skip test_get_workspace_client in Azure and GCP (#531).
• Regenerate from the tip of main (#524).
• Search for both databricks.exe and databricks binaries in windows (#517).

OpenAPI SHA: 6b897bc95b23abed8b9f5eff0e6b8ec034046180, Date: 2024-02-08