mlrun/mlrun v1.3.0-rc1

on GitHub

Features / Enhancements

• API: Add project-scope files/filestat API that work with project secrets, #2714, @theSaarco

• API: Fix run paramaters larger than int64 corrupting projects, #2671, @quaark

• API: Remove print from api, #2734, @liranbg

• API: verify cookie session is iguazio-like sessions, #2773, @liranbg

• Artifacts: Don't resolve artifact target_path if explicitly request upload=False, #2732, @Tankilevitch

• Artifacts: Serialize DirArtifact to dictionary using new format, #2778, @theSaarco

• Artifacts: Set dataset stats according to stats flag in log_dataset, #2710, @TomerShor

• CI: Bump prefix version for build images, #2645, @Tankilevitch

• CI: Fix Open Source System Tests Fail Deploy, #2772, @quaark

• CI: Run Open Source System Tests Against MLRun CE, #2667, @quaark

• CI: Updated installation and bug report issue templates, #2193, @nschenone

• CLI: Do not ignore unknown options, #2678, @AlonMaor14

• CLI: Fix cli "get runtime" command, #2676, @yaronha

• CLI: Fix watch when running function through CLI, #2730, @Tankilevitch

• CLI: Support default .env file location + CLI "config set" command, #2690, @yaronha

• CLI: Validate base arguments, #2745, @AlonMaor14

• CLI: Waiting for pod status with timeout fix when running project, #2635, @AlonMaor14

• CLI: [Runtimes] URL placeholder for using run args without URL, #2765, @AlonMaor14

• Config: Skip failures in first init of config (mlrun import), #2742, @yaronha

• DataStore: Allow passing secrets to create datastore and don't cache datastores when running on API, #2633, @Tankilevitch

• DataStore: Fix how we resolve if running as API, #2680, @Tankilevitch

• DataStore: Fix makedirs not threadsafe, #2723, @liranbg

• Datastore: Fix _write_dataframe to pass storage_options to pandas write operations, #2709, @gtopper

• Datastore: Fix handling of DataItem path in windows + support path mappings, #2774, @yaronha

• Docs: Add ecosystem, bug fixes, #2682, @jillnogold

• Docs: Add some docs to artifact client code, #2775, @Tankilevitch

• Docs: Added MLRun Cheat Sheet, #2647, @nschenone

• Docs: Better docstring for mount_s3, added warnings, #2737, @theSaarco

• Docs: CLI project schedule, ML-3007, #2721, @jillnogold

• Docs: Edit wording to make AWS Documentation more clear, #2697, @yevgenykhazan

• Docs: Fix docstring errors, ML-2916, ML-2909, #2662, @jillnogold

• Docs: Improve log_dataset docstring wrt local_path flag, #2753, @TomerShor

• Docs: Typo mistakes, #2731, @george0st

• Docs: Update MLRun CE Kubernetes Installation Docs for new "only full" Deployment, #2673, @quaark

• Docs: Update CONTRIBUTING.md, #2754, @moranbental

• Feature Store: Get time from time-column instead of event metadata, #2660, @gtopper

• FeatureStore: Fix serving to support AVRO encoded kafka, #2658, @assaf758

• FeatureStore: Fixing impute failures when using get_online_feature_service with a feature-vector uri, #2666, @theSaarco

• FeatureStore: Fixing graph plot with multiple targets of same kind + adding storage kind to plot, #2766, @theSaarco

• Frameworks: Adjusted the model servers to support step_to_dict, #2653, @guy1992l

• Frameworks: Remove the handling of regression models, #2722, @guy1992l

• MPI: Fix local variable resp referenced before assignment, #2639, @Tankilevitch

• Model Monitoring: Add abstraction for model endpoint store target, #2378, @Eyal-Danieli

• Model Monitoring: Add model_monitoring package to setup.py, #2674, @Eyal-Danieli

• Model Monitoring: Ensure auth info for model monitoring batch job function, #2688, @Eyal-Danieli

• Project: Set default sync=True in project.get_function(), #2720, @yaronha

• Projects: Raise error for workflow scheduling with non-remote project, #2711, @yonishelach

• Projects: Set default context path to working directory, #2740, @liranbg

• Run: Fix not updating the run state when running local fails on pre-loading of the function, #2762, @Tankilevitch

• Run: Fix outputs wait for completion, #2663, @Tankilevitch

• Run: Normalize function name in new_function, #2696, @TomerShor

• Runtime: Fix resolving completion time, #2738, @liranbg

• Runtime: Move some k8s logic to k8s helpers, #2733, @liranbg

• Schedules: Fix label handling when reloading schedules (ML-3014), #2719, @theSaarco

• Schedules: Scheduled tasks access-key usage refactor, #2695, @theSaarco

• SecretStore: Fix overwriting SecretStore credentials on API, #2661, @Tankilevitch

• Secrets: Add a global get_secret_or_env function to retrieve secret values, #2659, @theSaarco

• Secrets: Fix get_secret_or_env, #2675, @theSaarco

• Serving: Fixing - OneHotEncoder with pandas engine - fails when the values has spaces or hyphens in them, #2713, @davesh0812

• Serving: Improve mock server handling, #2726, @yaronha

• Spark: Shut local spark context down when ingest completes, #2692, @gtopper

• Test: fix mkdir race condition - round 2, #2750, @liranbg

• Tests: Fix failing feature store system tests, #2643, @gtopper

• Unknown: Raise error on ingest with KafkaSource, #2654, @gtopper

• Unknown: Revert "[CLI] Do not ignore unknown options", #2703, @AlonMaor14

• Unknown: Revert "[Spark] Shut spark context down when ingest completes", #2752, @gtopper

• Utils: - Remove spammy logs, #2724, @liranbg

• UI: Features & enhancement

Bug fixes

• UI: Bug fixes

Pull requests:

27e8a95 [Datastore] Fix handling of DataItem path in windows + support path mappings (#2774)
c08f2d1 [CLI][Runtimes] URL placeholder for using run args without URL (#2765)
b1d35de [Feature Store] Get time from time-column instead of event metadata (#2660)
fb2f4a7 [Artifacts] Serialize DirArtifact to dictionary using new format (#2778)
598015a [Docs] Add some docs to artifact client code (#2775)
183506b [FeatureStore] Fixing graph plot with multiple targets of same kind + adding storage kind to plot (#2766)
83e5207 [API] verify cookie session is iguazio-like sessions (#2773)
1613b0d [CI] Fix Open Source System Tests Fail Deploy (#2772)
0124e17 [CI] Updated installation and bug report issue templates (#2193)
d7a7aa6 [Docs] Update MLRun CE Kubernetes Installation Docs for new "only full" Deployment (#2673)
eea96dd [Run] Fix not updating the run state when running local fails on pre-loading of the function (#2762)
aa7e2d0 [API] Fix run paramaters larger than int64 corrupting projects (#2671)
11f3130 [CLI] Validate base arguments (#2745)
70b09e5 [Docs] Improve log_dataset docstring wrt local_path flag (#2753)
915bcf1 [Config] Skip failures in first init of config (mlrun import) (#2742)
4918755 [Test] fix mkdir race condition - round 2 (#2750)
dbeaadd [Serving] Improve mock server handling (#2726)
e8902c4 [Model Monitoring] Ensure auth info for model monitoring batch job function (#2688)
7fdaaa7 [Docs] Update CONTRIBUTING.md (#2754)
cb89a7b Revert "[Spark] Shut spark context down when ingest completes" (#2752)
bdaf21f [Docs] Better docstring for mount_s3, added warnings (#2737)
b71feaa [Projects] Set default context path to working directory (#2740)
e071928 [Runtime] Move some k8s logic to k8s helpers (#2733)
e103e8c [Runtime] Fix resolving completion time (#2738)
1e62788 [CLI] Fix watch when running function through CLI (#2730)
7f17649 [Docs] CLI project schedule, ML-3007 (#2721)
4b4aba1 [API] Remove print from api (#2734)
b67e88c [Docs] Typo mistakes (#2731)
5082072 [Artifacts] Don't resolve artifact target_path if explicitly request upload=False (#2732)
c9b6a91 [Frameworks] Remove the handling of regression models (#2722)
23bbdf9 [Docs] Add ecosystem, bug fixes (#2682)
59a9616 [Project] Set default sync=True in project.get_function() (#2720)
e77d708 [DataStore] Fix makedirs not threadsafe (#2723)
ab2be0f [Utils] - Remove spammy logs (#2724)
10f72b6 [API] Add project-scope files/filestat API that work with project secrets (#2714)
c0f866f [Schedules] Fix label handling when reloading schedules (ML-3014) (#2719)
9ab0f43 [Docs] Edit wording to make AWS Documentation more clear (#2697)
a2e75a0 [Projects] Raise error for workflow scheduling with non-remote project (#2711)
0918ae0 [CLI] Support default .env file location + CLI "config set" command (#2690)
daee4cc [Serving] Fixing - OneHotEncoder with pandas engine - fails when the values has spaces or hyphens in them (#2713)
d85e7e2 [Artifacts] Set dataset stats according to stats flag in log_dataset (#2710)
6edc7ba [Datastore] Fix _write_dataframe to pass storage_options to pandas write operations (#2709)
2589e44 [Schedules] Scheduled tasks access-key usage refactor (#2695)
5497c84 Revert "[CLI] Do not ignore unknown options" (#2703)
47de2bb [Run] Normalize function name in new_function (#2696)
3fc9b84 [CLI] Fix cli "get runtime" command (#2676)
2a9316b [Spark] Shut local spark context down when ingest completes (#2692)
f93d8fe [CLI] Do not ignore unknown options (#2678)
671247a [DataStore] Fix how we resolve if running as API (#2680)
e07e4c2 [Secrets] Fix get_secret_or_env (#2675)
7e3f988 [Frameworks] Adjusted the model servers to support step_to_dict (#2653)
c359b61 [Model Monitoring] Add model_monitoring package to setup.py (#2674)
d560118 [CI] Run Open Source System Tests Against MLRun CE (#2667)
08dc2e9 [FeatureStore] Fix serving to support AVRO encoded kafka (#2658)
3c12c5c [Docs] Fix docstring errors, ML-2916, ML-2909 (#2662)
09c3e9a [Run] Fix outputs wait for completion (#2663)
47a0a62 [FeatureStore] Fixing impute failures when using get_online_feature_service with a feature-vector uri (#2666)
773a623 [MPI] Fix local variable resp referenced before assignment (#2639)
14cba17 [Docs] Added MLRun Cheat Sheet (#2647)
1f07fcd [Secrets] Add a global get_secret_or_env function to retrieve secret values (#2659)
2676f73 [SecretStore] Fix overwriting SecretStore credentials on API (#2661)
264da25 [Model Monitoring] Add abstraction for model endpoint store target (#2378)
7955714 [DataStore] Allow passing secrets to create datastore and don't cache datastores when running on API (#2633)
ca635b8 Raise error on ingest with KafkaSource (#2654)
c693606 [Tests] Fix failing feature store system tests (#2643)
b0be0c9 [CI] Bump prefix version for build images (#2645)
d57ea8d [CLI] Waiting for pod status with timeout fix when running project (#2635)