Armada v0.3.93
For more info, head over to the docs page at https://armadaproject.io
Armada CLI
armadactl controls the Armada batch job queueing system and is used for interacting with the system.
The CLI can be downloaded for a specific OS & Architecture from the Assets section below.
NOTE: The OSX binary is packaged as an universal binary and should work on both Intel and Apple Silicon based Macs.
Docker images
Armada Bundle
docker pull gresearch/armada:0.3.93docker pull gresearch/armada:latest
Armada Lookout Bundle
docker pull gresearch/armada-lookout-bundle:0.3.93docker pull gresearch/armada-lookout-bundle:latest
Armada Full Bundle
docker pull gresearch/armada-full-bundle:0.3.93docker pull gresearch/armada-full-bundle:latest
Armada Server
docker pull gresearch/armada-server:0.3.93docker pull gresearch/armada-server:latest
Armada Executor
docker pull gresearch/armada-executor:0.3.93docker pull gresearch/armada-executor:latest
Armada Lookout
docker pull gresearch/armada-lookout:0.3.93docker pull gresearch/armada-lookout:latest
Armada Lookout V2
docker pull gresearch/armada-lookout-v2:0.3.93docker pull gresearch/armada-lookout-v2:latest
Armada Lookout Ingester
docker pull gresearch/armada-lookout-ingester:0.3.93docker pull gresearch/armada-lookout-ingester:latest
Armada Lookout Ingester V2
docker pull gresearch/armada-lookout-ingester-v2:0.3.93docker pull gresearch/armada-lookout-ingester-v2:latest
Armada Event Ingester
docker pull gresearch/armada-event-ingester:0.3.93docker pull gresearch/armada-event-ingester:latest
Armada Scheduler
docker pull gresearch/armada-scheduler:0.3.93docker pull gresearch/armada-scheduler:latest
Armada Scheduler Ingester
docker pull gresearch/armada-scheduler-ingester:0.3.93docker pull gresearch/armada-scheduler-ingester:latest
Armada Binoculars
docker pull gresearch/armada-binoculars:0.3.93docker pull gresearch/armada-binoculars:latest
Armada Job Service
docker pull gresearch/armada-jobservice:0.3.93docker pull gresearch/armada-jobservice:latest
armadactl
docker pull gresearch/armadactl:0.3.93docker pull gresearch/armadactl:latest
Changelog
Features
- f723e15: feat: Update Semver from version 6.3.0 to 6.3.1 (#2686) (@Ginohmk)
- bb2bf83: feat: separate release CI (#2966) (@dejanzele)
Bug fixes
- ad5bcc7: fix: add more clear instructions to the armada demo page (#2749) (@anshgoyalevil)
- b498d64: fix: add windows specific script for mage ui (#2734) (@anshgoyalevil)
- 108d560: fix: armadactl build flags (#2991) (@dejanzele)
- d75fd44: fix: ci not running on forks (#2989) (@dejanzele)
- a79d242: fix: upgrade @types/react from 16.14.32 to 16.14.43 (#2747) (@dave-gantenbein)
- 801bb8f: fix: upgrade @typescript-eslint/eslint-plugin from 5.52.0 to 5.61.0 (#2744) (@dave-gantenbein)
- c760553: fix: upgrade @typescript-eslint/parser from 5.52.0 to 5.61.0 (#2743) (@dave-gantenbein)
- a6c6922: fix: upgrade react-router-dom from 6.9.0 to 6.14.1 (#2746) (@dave-gantenbein)
Documentation
- 166d375: docs: create README.md for plugins directory (#2897) (@ShivangShandilya)
Other work
- a78d4b3: Allow Routable Service Ips (#3010) (@d80tb7)
- 5d82705: #2905 - fix indentation (#2971) (@dave-gantenbein)
- 7f97192: Add Scheduler Metrics (#2834) (@theAntiYeti)
- d6deb3b: Add cleaner test output for mage with os/exec.Command (#2907) (@Mo-Fatah)
- 0415a30: Add config and dependency injection to scheduler metrics (#2892) (@theAntiYeti)
- f7ebc6d: Add config to globally disable scheduling (#2779) (@JamesMurkin)
- c023660: Add config to use autoupdater on tagged branches (#2905) (@dave-gantenbein)
- cf59f3d: Add fairness tests (#2889) (@severinson)
- 969cf19: Add missing EventSequence_Event_JobRequeued cases (#2886) (@severinson)
- ea1a7c6: Add more scheduler metrics (#2906) (@theAntiYeti)
- 99097de: Add msumner91 and mustafai to magic list of trusted people (#2956) (@severinson)
- 7cdf653: Add note about signed commits to Contributor documentation (#2960) (@itsaviral2609)
- 293c58c: Add per-queue scheduling rate-limiting (#2938) (@severinson)
- 3fa5ab2: Add poll_interval (#2805) (@sarthaksarthak9)
- 1f26977: Add simulator (#2881) (@severinson)
- 3f03d90: Add unit test for ArmadaOperator.execute (#2790) (@ClifHouck)
- 7abc18f: Added if statement to try and fix CI duplication (#2988) (@Sharpz7)
- 0e0b434: Added required changes for new config value (#2801) (@Sharpz7)
- feee9d3: Added test file for armada/cmd/armadactl/cmd/watch.go (#2839) (@biswajit-9776)
- ba8a8f7: Airflow: always set credentials from args in channel ctor (#2952) (@richscott)
- c34ed60: Alpine 3.18 new (#2858) (@kannon92)
- d616feb: ArmadaContext that includes a logger (#2934) (@d80tb7)
- edc1426: ArmadaContext.Log Improvements (#2965) (@d80tb7)
- 6bcb1c6: Better Deduplicaton Logic (#2857) (@d80tb7)
- 221db1c: Changed airflow files location (#2803) (@Sharpz7)
- d34d571: Changes to remove the sleep from localdev (#2802) (@Sharpz7)
- 894fd8c: Do not log evicted jobs (#2829) (@severinson)
- 98bcb76: Enables airflow operator level retry. (#2894) (@ClifHouck)
- 30a29ce: Expose scheduler context to scheduler.go (#2884) (@theAntiYeti)
- fc7e1b8: Feat(job summary): Implement Job Summaries for Lint workflow (#2836) (@itsaviral2609)
- 3656d4f: Feat/improved version checking output (#2862) (@Raajheer1)
- 31cb6fa: Fix "All required checks done" CI job to never be skipped (#2872) (@jgiannuzzi)
- abb09c8: Fix Lookout Routable Service (#3013) (@d80tb7)
- 6340bcb: Fix bug causing GetJobSetEvents to get stuck (#2903) (@JamesMurkin)
- c3d5889: Fix etcd health metric naming conflict (#2939) (@severinson)
- 68a2bd1: Fix golangci-lint errors in Job Service perf test. (#2810) (@richscott)
- 8d9b4c0: Fix jobDb job order (#2888) (@severinson)
- 19f9039: Fix jobservice unit tests (#2825) (@ClifHouck)
- 5398441: Fix race in etcd protections (#2937) (@severinson)
- 0f92935: Fix scheduler test (#2870) (@JamesMurkin)
- 23fa150: Fixing CI (#2823) (@Sharpz7)
- 54e9d03: Goodbye autoupdate. (#2993) (@Sharpz7)
- af6c0d5: Helm chart update: executor (#2917) (@owenthomas17)
- 069dc7d: Improved etcd protection (#2925) (@severinson)
- 2e118fb: Improved preemption logic (#2880) (@severinson)
- a677fb9: Jobservice performance testing tool (#2778) (@ClifHouck)
- 15ed4ee: Log Call Site (#2909) (@d80tb7)
- 304d456: LookoutV2 table should not overflow beyond the viewport (#2977) (@vthemelis)
- 3f0325b: Lookoutv2: Remove unnecessary transactions (#2807) (@Mo-Fatah)
- 2c9e497: Magefile: Clean all Makefile refernces (#2957) (@Mo-Fatah)
- 3d86bc9: Maker Pulsar ReceiverQueueSize Configurable (#2895) (@d80tb7)
- 6000beb: Millisecond Precision Logging (#2874) (@d80tb7)
- f7f8484: Minor Improvement (#2799) (@nitishchauhan0022)
- f6fc9e8: Misc cleanup (#2864) (@severinson)
- 5a0b1dc: More fixes For Routable services (#3012) (@d80tb7)
- 9a66b4f: Order leased jobs by serial (#2912) (@JamesMurkin)
- 59e8f58: Patch/dependencies (#2923) (@Sharpz7)
- b85fe50: Prevent scheduling from mutating the jobDb (#2838) (@JamesMurkin)
- a5e076a: Pull out decision to schedule from cycle (#2835) (@theAntiYeti)
- 33564e1: Push metrics from testsuite (#2970) (@severinson)
- 291ef41: Release Airflow Operator v0.5.6 (#2979) (@richscott)
- c964465: Remove codecov workflows (#2902) (@Mo-Fatah)
- 7ad04e3: Remove gang job cardinality submit check. Add placeholder for min gang size (@msumner91)
- 33e9377: Removed Makefile from repo (#2915) (@MeenuyD)
- 1df7288: Removed a large chunk of bad mage code (#2770) (@Sharpz7)
- ba1973f: Revert to previous unpinned airflow version spec. (#2967) (@richscott)
- 898470c: Run CodeQL once daily on a schedule (#2918) (@Mo-Fatah)
- babce23: Run
on.pushonly for master (#2968) (@Mo-Fatah) - 4ce97e5: Run
yarn run fmt(#2978) (@vthemelis) - 8862282: Self-hosting
armadactlplugin in armada (#2850) (@ShivangShandilya) - 95faa44: Seperate python script for armada v1 and v2 system diagrams (#2758) (@Pradeep-Kurapati)
- 94d0b51: Set executorUpdateFrequency in scheduler config (#2828) (@JamesMurkin)
- 0ad68d6: Sphinx dependencies (#2983) (@Sharpz7)
- cfd257d: Stop executor requesting more jobs when it still has leased jobs (#2932) (@JamesMurkin)
- b411037: Sync quickstart/index.md with gh-pages/quickstart.md (#2891) (@Mo-Fatah)
- 1a45a0f: Tag Patch for CI (#2992) (@dejanzele)
- b5de1c3: Update CronJob version from batch/v1beta1 to batch/v1 (#2883) (@severinson)
- b65c08d: Update Docs (#2879) (@sarthaksarthak9)
- 81ccae8: Update config.yaml (#2953) (@severinson)
- 1a7c42d: Updated correct address on which armada-airflow-ui is available and credentials (#2951) (@itsaviral2609)
- 08149dd: Upgrade Pulsar Client to v0.11 (#2896) (@d80tb7)
- 127e989: Upgrade to ci-alerts to v2 (#2859) (@Mo-Fatah)
- 44c6a29: Use a callback to generate/access grpc credentials for operator use. (#2809) (@ClifHouck)
- 8eb7201: WIP: Airflow: fix undefined poll_interval in Deferrable Operator (#2975) (@richscott)
- 247bf69: [Pulsar Scheduler] Improve Performance Of Scheduling Cycle When Queue Is Large (#2875) (@d80tb7)
- bbcb3eb: [armada-scheduler] Add log lines to make it easier to see where time is spent (#2865) (@JamesMurkin)
- 3159f06: [armada-scheduler] Add metrics for node counts (#2780) (@JamesMurkin)
- b13cdd8: [armada-scheduler] Handle job_run_error not found (#2830) (@JamesMurkin)
- 523b9f7: [armada-scheduler] Respect fail fast flag (#2831) (@JamesMurkin)
- 510d59b: add mage tests instead of make tests (#2861) (@kannon92)
- e8c75a1: ci(Mergify): configuration update (#2871) (@dave-gantenbein)
- 5c5081a: fix docker repo name for testsuite (#2774) (@kannon92)
- 24059d9: fix typo: constaint -> constraint (#2837) (@Raajheer1)
- aa64181: fixes for routable services (#3011) (@d80tb7)
- cfa6dbf: fixing cert tests (#2775) (@nitishchauhan0022)
- c3c5044: fixing goreleaserdockerNNNN directories filling up /tmp (#2688) (@nitishchauhan0022)
- e2f0382: fixing unit test (#2798) (@nitishchauhan0022)
- 6c6fb80: increase runner size (#3015) (@dave-gantenbein)
- 2b914d1: mage test update and go code coverage (#2771) (@nitishchauhan0022)
- 6a1d1e4: remove circleci from our ci forever (#2776) (@kannon92)
- 19a6858: remove codeql from required (#2887) (@Mo-Fatah)
- 7e664e9: remove redundant workflow (#2701) (@dejanzele)
- e4ad098: remove setup go as its a duplicate (#2808) (@kannon92)
- ffe1842: resolve flaky (#2914) (@sarthaksarthak9)
- bfdeeeb: upgrade python dependencies (#2860) (@kannon92)
- 3257ac0: upgrade python to 3.8.15 (#2750) (@kannon92)
- 22e2729: workflow version upgrade protoc & python (#2748) (@nitishchauhan0022)
Full Changelog: v0.3.865...v0.3.93