mlrun/mlrun v1.3.2-rc1

on GitHub

Features / Enhancements

• CI: Bump unstable version to 1.3.2 [1.3.x], #3600, @liranbg
• Requirements: Blacklist orjson 3.8.12 [1.3.x], #3498, @alonmr
• Model Monitoring: Backport validate access key in grafana only in non-ce deployment [1.3.x], #3479, @Eyal-Danieli
• Requirements: Bump storey to 1.3.19 [1.3.x], #3468, @assaf758
• Model Monitoring: Cherry picks for model monitoring [1.3.x], #3465, @Eyal-Danieli
• CI: Backport ci system tests adjustments [1.3.x], #3455, @Tankilevitch
• API: Add version to healthz endpoint [1.3.x], #3446, @liranbg
• Requirments: Bump storey to v1.3.18 [1.3.x], #3440, @assaf758
• API: Fail healthz requests when offline / waiting for chief [1.3.x], #3427, @liranbg
• DataStore: Enrich v3iodriver with mlconf.v3io_api [1.3.x], #3422, @Tankilevitch
• CI: Add datanode docker images removal command and skip db deletion if db instance is not available [1.3.x], #3423, @Tankilevitch
• Requirements: Bump storey to v1.3.17 [1.3.x] (#3415), #3416, @assaf758
• CI: Backport #3401 and #3393, #3402, @Tankilevitch
• CI: Bump unstable version to 1.3.1, #3392, @Tankilevitch
• Spark: Support more than 2 keys in spark online target ingestion engine [1.3.x], #3379, @assaf758
• Runtimes: Avoid hang on large stderr output in run_exec [1.3.x], #3373, @gtopper
• Model Monitoring: Cherry picks for model monitoring [1.3.x], #3362, @Eyal-Danieli
• API: Reflect correct message wen waiting for chief [1.3.x], #3349, @liranbg
• Model Monitoring: Adjust grafana dashboards to use v3io datasource instead of mlrun api [1.3.x], #3335, @Eyal-Danieli
• Models: Set cflags before requirements installation [1.3.x], #3319, @alonmr
• 1.3.x: [schedule] update type hints for schedulecrontrigger to avoid unexpected pydantic behaviour (#3286), #3316, @assaf758
• API: Allow sorting pipelines when specifying project, #3310, @alonmr
• Models: Add mpi4py requirement, #3303, @alonmr
• Utils: Clone gitlab with fine-grained access tokens, #3297, @alonmr
• Nuclio: with_service_type sdk, #3296, @alonmr
• CI: Update release automation script, #3292, @liranbg
• Requirements: Bump httpx version, #3291, @liranbg
• Spark: Block pull source at runtime, #3275, @alonmr
• Project: Remove unused legacy methods, #3268, @alonmr
• Feature Store: Get_offline_features over relations: add support for spark retrieval engine, #3055, @davesh0812
• UI: Features & enhancement

Bug fixes

• Projects: Fix syncing iguazio projects [1.3.x], #3609, @liranbg
• Serving: Fix graph plot when before param exists [1.3.x], #3603, @davesh0812
• Feature Set: Fix set_targets to overwrite the existing targets and allow no-target ingest if running locally [1.3.x-next], #3595, @davesh0812
• Requirements: Bump fsspec based dependancies to fix gcsfs breakage after transformers==4.11.3 install (#3497) [1.3.x-next], #3566, @assaf758
• Datastore: Fix httpsource initialization [1.3.x-next], #3561, @Eyal-Danieli
• Model Monitoring: Fix error-count by converting it's value to int before writing endpoint to db [1.3.x-next], #3546, @Eyal-Danieli
• Tests: Fix test_sync_pipeline_chunks [1.3.x-next], #3522, @gtopper
• Feature Store: Fix empty dataframe result from preview() with pandas engine [1.3.x-next], #3525, @gtopper
• Model Monitoring: Fix bc issue when deleting a model endpoint from kv [1.3.x], #3494, @Eyal-Danieli
• Spark: Fix treating single string entity as a list when saving to redis [1.3.x], #3493, @alxtkr77
• Docs: Backport fix tutorials sklearn bump version [1.3.x], #3473, @Tankilevitch
• Feature Store: Fix bigquerysource support for passthrough+chunksize [1.3.x], #3469, @gtopper
• Serving: Backport - fix passing mlrun event headers with underscore in remotestep, #3470, @Tankilevitch
• Tests: Fix test_deploy_function_with_error_handler [1.3.x], #3458, @assaf758
• Tests: Fix tests to use preview if ingest is done with no targets and with_default_targets=false [1.3.x], #3441, @assaf758
• Serving: Graph/step custom error-handler - fix bug and provide cleaner api, #3433, @davesh0812
• Feature Set: Fix ingest to raise error when user did not provide targets and called set_targets with_default=false [1.3.x], #3431, @davesh0812
• Spark: Fix redis key generation for single entity [1.3.x], #3429, @assaf758
• Tests: Fix spark system tests [1.3.x], #3421, @davesh0812
• Builder: Fix pushing to ecr [1.3.x], #3410, @liranbg
• Spark: Fix udf - remove dependencies [1.3.x], #3412, @alxtkr77
• Serving: Fix process executer in parallelrun [1.3.x], #3406, @davesh0812
• Spark: Fix unexpected spark job failure [1.3.x], #3399, @gtopper
• Unknown: Revert "[project] fix function name isn't treated uniformly [1.3.x]", #3395, @Tankilevitch
• Features: Fixing issue when value_type is valuetype instance, #3368, @davesh0812
• Tests: Fixing spark system test, #3324, @davesh0812
• Utils: Fix multiple logs [1.3.x], #3382, @gtopper
• Serving: Fix 200x logging in ci (and potentially elsewhere) [1.3.x], #3380, @gtopper
• Spark: Fix resolving code path [1.3.x], #3367, @alonmr
• Runtimes: Fix workdir and source target dir [1.3.x], #3354, @alonmr
• Docs: Fix mlrun 1.3.0 client installation guide [1.3.x], #3343, @alonmr
• Datastore: Fix leading zeros in time partition names [1.3.x], #3340, @gtopper
• Project: Fix function name isn't treated uniformly [1.3.x], #3327, @yaelgen
• Serving: Fix monitoring stream pod losing events when event timestamp's microsecond equals zero [1.3.x], #3317, @assaf758
• Context: Fix failed to import a context from dict, #3308, @yaelgen
• Builder: Fix default workdir and support setting workdir, #3245, @alonmr
• FrontendSpec: Add allowed artifact path prefixes list to frontend spec, #3261, @theSaarco
• CI: Bump prefix version for build images, #3315, @liranbg
• UI: Bug fixes

Pull requests:

b95ec3c [Projects] Fix syncing iguazio projects [1.3.x] (#3609)
d6b4d0c [Serving] Fix graph plot when before param exists [1.3.x] (#3603)
447c71e [CI] Bump unstable version to 1.3.2 [1.3.x] (#3600)
5c3e1cd [13x] Merge 1.3.x-next to 1.3.x (#3601)
980c448 Merge remote-tracking branch 'upstream/1.3.x-next' into 1.3.x
e88b715 [13x] Merge 1.3.x-next to 1.3.x (#3597)
f2a4c47 [Feature Set] Fix set_targets to overwrite the existing targets and allow no-target ingest if running locally [1.3.x-next] (#3595)
eae5ef1 Merge branch '1.3.x-next' into 13x-next-to-13x
9ee6d2b [Requirements] Bump fsspec based dependancies to fix gcsfs breakage after transformers==4.11.3 install (#3497) [1.3.x-next] (#3566)
d19d00b [Datastore] Fix HttpSource initialization [1.3.x-next] (#3561)
c49ec14 [Model Monitoring] Fix error-count by converting it's value to int before writing endpoint to DB [1.3.x-next] (#3546)
3d67b90 [Tests] Fix test_sync_pipeline_chunks [1.3.x-next] (#3522)
e3cb0dd [Feature Store] Fix empty dataframe result from preview() with pandas engine [1.3.x-next] (#3525)
c60ecc0 [Requirements] Blacklist orjson 3.8.12 [1.3.x] (#3498)
e83a2f4 [Model Monitoring] Fix BC issue when deleting a model endpoint from KV [1.3.x] (#3494)
4f3c440 [Spark] Fix treating single string entity as a list when saving to Redis [1.3.x] (#3493)
2e4b42d [Model Monitoring] Backport validate access key in Grafana only in non-CE deployment [1.3.x] (#3479)
545fa3c [Docs] Backport Fix tutorials sklearn bump version [1.3.x] (#3473)
06f998e [Feature Store] Fix BigQuerySource support for passthrough+chunksize [1.3.x] (#3469)
82566ca [Requirements] Bump storey to 1.3.19 [1.3.x] (#3468)
3b5a664 [Serving] Backport - Fix passing MLRun event headers with underscore in RemoteStep (#3470)
71a9661 [Model Monitoring] Cherry picks for model monitoring [1.3.x] (#3465)
21285ed [Tests] Fix test_deploy_function_with_error_handler [1.3.x] (#3458)
9fbfba7 [CI] Backport CI system tests adjustments [1.3.x] (#3455)
b3de4b3 [API] Add version to healthz endpoint [1.3.x] (#3446)
0934bc1 [Tests] Fix tests to use preview if ingest is done with no targets and with_default_targets=False [1.3.x] (#3441)
8ca9cda [Requirments] bump storey to v1.3.18 [1.3.x] (#3440)
948db5e [Serving] Graph/Step custom error-handler - fix bug and provide cleaner api (#3433)
cadfcfa [Feature Set] Fix ingest to raise error when user did not provide targets and called set_targets with_default=False [1.3.x] (#3431)
73d735b [API] Fail healthz requests when offline / waiting for chief [1.3.x] (#3427)
f152232 [Spark] Fix Redis key generation for single entity [1.3.x] (#3429)
ba5f4b1 [DataStore] Enrich V3ioDriver with mlconf.v3io_api [1.3.x] (#3422)
ec980df [CI] Add datanode docker images removal command and skip DB deletion if DB instance is not available [1.3.x] (#3423)
515c501 [Tests] Fix spark system tests [1.3.x] (#3421)
07718d1 [Requirements] Bump storey to v1.3.17 [1.3.x] (#3415) (#3416)
2af8a42 [Builder] Fix pushing to ECR [1.3.x] (#3410)
2c5f00e [Spark] Fix UDF - remove dependencies [1.3.x] (#3412)
288ce02 [Serving] Fix process executer in ParallelRun [1.3.x] (#3406)
7d001f5 [CI] Backport #3401 and #3393 (#3402)
b0aacb6 [Spark] Fix unexpected spark job failure [1.3.x] (#3399)
9f9dfb3 Revert "[Project] Fix function name isn't treated uniformly [1.3.x]" (#3395)
8bb0587 [Features] Fixing issue when value_type is ValueType instance (#3368)
500f972 [Tests] Fixing Spark system test (#3324)
88185b0 [CI] Bump unstable version to 1.3.1 (#3392)
f4663a7 [Utils] Fix multiple logs [1.3.x] (#3382)
1f69c7c [Serving] Fix 200x logging in CI (and potentially elsewhere) [1.3.x] (#3380)
19ad30f [Spark] Support more than 2 keys in spark online target ingestion engine [1.3.x] (#3379)
f34dd64 [Runtimes] Avoid hang on large stderr output in run_exec [1.3.x] (#3373)
0a4e784 [Spark] Fix resolving code path [1.3.x] (#3367)
329e64d [Runtimes] Fix workdir and source target dir [1.3.x] (#3354)
e568327 [Model Monitoring] Cherry picks for model monitoring [1.3.x] (#3362)
711f832 [API] Reflect correct message wen waiting for chief [1.3.x] (#3349)
195f625 [Docs] Fix mlrun 1.3.0 client installation guide [1.3.x] (#3343)
70fc6cc [Datastore] Fix leading zeros in time partition names [1.3.x] (#3340)
326f9b3 [Model Monitoring] Adjust Grafana dashboards to use V3IO datasource instead of MLRun API [1.3.x] (#3335)
ab36c8a [Project] Fix function name isn't treated uniformly [1.3.x] (#3327)
15efe2e [Models] Set CFLAGS before requirements installation [1.3.x] (#3319)
6c81baf [Serving] Fix monitoring stream pod losing events when event timestamp's microsecond equals zero [1.3.x] (#3317)
0898e7d [1.3.x][Schedule] Update type hints for ScheduleCronTrigger to avoid unexpected pydantic behaviour (#3286) (#3316)
98f4370 [API] Allow sorting pipelines when specifying project (#3310)
7d8811c [Context] Fix failed to import a context from dict (#3308)
3cd252b [Models] Add mpi4py requirement (#3303)
8597804 [Utils] Clone gitlab with fine-grained access tokens (#3297)
5b6d492 [Nuclio] with_service_type SDK (#3296)
a6f50ff [CI] Update release automation script (#3292)
5732dcc [Requirements] Bump httpx version (#3291)
b28e464 [Spark] Block pull source at runtime (#3275)
e707823 [Project] Remove unused legacy methods (#3268)
ccc5ef7 [Builder] Fix default workdir and support setting workdir (#3245)
3fb95c9 [FrontendSpec] Add allowed artifact path prefixes list to frontend spec (#3261)
9360dd1 [Feature Store] get_offline_features over relations: add support for spark retrieval engine (#3055)
5df665d [CI] Bump prefix version for build images (#3315)