apache/dolphinscheduler 3.0.0-beta-1 on GitHub

Feature

[Feature- 9837][plugin/ui] support FlinkSQL Task (#9840)
[Feature-9177][Task] The sql task supports configuring segmentation notation to provide execution of multiple statements (#9917)
[Feature][UI] Disabled statistics. (#9935)
[Feature][Log]Add timezone information in log output (#9913)
[Feature] Remove old ui. (#9909)
[Feature][UI Next][V1.0.0-Beta] Add hints to the password repeat. (#9888)
[Feature][UI Next][V1.0.0-Beta] Rename SeaTunnel. (#9839)
[Feature][UI Next] Add front-end for Apache Zeppelin task plugin (#9597) (#9810)
[Feature-9772][plugin/ui] support SparkSQL Task (#9790)
[Feature][Deploy] Add missing default values in dolphinscheduler_env.sh (#9733)
[Feature]The utils configuration files are centrally managed under common (#9706)
[Feature]Unified exposure method class (#9698)
[Feature][UI][V1.0.0-Beta] Modify timeout from 10s to 15s of axios (#9644)
[Feature][UI][V1.0.0-Beta] Add dependent task status in dependent task. (#9663)
[Feature][Task-Plugin]Add zeppelin task-plugin to support Apache Zeppelin (#9327)
[Feature][UI Next][V1.0.0-Beta] Monaco Editor supports theme switching function. (#9521)
[Feature][UI Next][V1.0.0-Beta] Change the css style usage of the blue number flopper in the alarm center to css variables. (#9511)
[python] Add task decorator for python function (#9496)
[python] Support read config in env variable (#9517)
[Feature][Task] K8s namespace auth manager (#9303)
[Feature][API] Refactor get dependent node information api (#9591)
[Feature][UI Next]Added the method of downloading files (#9605)
[Feature] [ALERT-9406]enrich alert info when insert new row into DB (#9445)
[Feature] [ALERT-9406]add new properties to alert class (#9408)
[Feature-9204][alert] Implement alert send status (#9208)
[Improve][API] Allowed the non-root user to create the task group. (#9523)
[DS-9263][Improvement][master]optimize failover (#9281)
[Improvement] change method access (#9390)
[improve][python] Specify warning group when deploy process-definition (#9773)
[improve][api] Support to upload file without file type suffix (#9553)
[Improvement][server] varPool support syntax #{setValue(key=value)} (#9586)
[Improvement-9609][Worker]The resource download method is selected according to the configurati… (#9636)

Bugfix

[Bug] init docker compose DATABASE env (#10244)
[fix] Deploy scp-hosts use fullpath avoid dangling (#10249)
[fix][deploy] File overwrite when specific value set to installPath (#10241)
[Fix][UI] Set task group name empty of default value (#10243)
[Fix#9923] The alarm instance management interface is always in the loading state (#9924)
[fix] Task group queue query all list error (#10237)
[improve] Change Mysql Driver (#10220)
[Fix][UI] Fix issue with treemap depth in workflow relationships. (#10229)
[fix-10207] When the registered alarm plugin is empty, the error message is not clear (#10224)
[Fix][UI] Fix the problem of multi-language support of workflow instance host in Chinese state. (#10223)
[Fix-10103][k8s]Fix k8s Change DataSource Error (#10128)
[Fix][UI] add assignment of totalPage (#10165)
[python] Fix process definition attr release state not work (#10151)
fix#10214 Delete online workflows in batches, prompt information is accurate (#10215)
[Bug][Deploy]Fix worker-server path in script scp-hosts.sh (#10208) (#10209)
[Fix-10199] [Workflow/Workflow Definition] After deleting messages in batches, the error message is repeated (#10201)
[Fix][UI] Fix data-quality component multi-language support. (#10202)
[refactor][perf] cache compiled regex pattern (#10099)
[Fix-10076] queryUserByToken use server timezone (#10177)
fix spcial week init bug (#10183)
[Fix][UI] Add seatunnel icon (#10178)
[Fix-10057][api] api parameter name misspelling (#10063)
[Fix][UI] Fix the problem that the failure strategy field in the time management form is multilingual. (#10169)
[Fix]Change the HTTP or HTTPS regular expression (#10166)
[Fix][UI] Limit task group resource capacity to only positive integers. (#10158)
[Fix][UI] Add the task status of pending. (#10129)
[python] Change distribute name avoid confusion with main pkg (#10134)
Fix alert server curator health check not work (#10111)
[Build][UI] Solve vite config throws terser warning. (#10105)
[BUG][TaskGroup] Task group does not take effect (#10093)
[fix] Enhance name pre checker in resource center (#10094)
[Fix][UI] fulfill missing fields in DataQuality (#10098)
fix issue-10061 (#10062)
[Feat][UI] Add resource username for function and resource manage (#10086)
[Fix-10049] Conditions Task branch flow failed (#10077)
[Fix-10082]Resource userName is null and udf function manager add a username (#10064)
[Fix][Docker] Support Multi-Architecture Docker Images (#10052)
Create process definition with task group and task group priority cannot be save into db (#10078)
[Fix-10080]When the created tenant name is too long, an error message will be prompted (#10081)
[Bug][Master] fix master task failover (#10065)
[Fix][UI] Fix bug where username is empty in file manage (#10070)
[Fix][UI] Fix in the Chinese state, there is a problem with the multi-language support of the form. (#10066)
[Fix][UI]Modify error message (#10054)
[python] Fix pre_submit_check error when local params in tasks (#10032)
[Bug] fix run on docker and k8s (#10026)
[Fix-10039] Flink run command when perfecting Python jobs (#10042)
[dataquality] Fix task commnd null bug (#9974)
[fix-9991][worker]fix statement is closed before resultSet.getMetaData() (#10014)
[Fix][UI] Fix errorOutputPath column in dataquality page (#10015)
[Fix][UI] Support only one file upload on the file manage page. (#10007)
[Fix-9975] The selected task instance was recreated when the Master service fail… (#9976)
[Fix][UI] Fix the task name validator error. (#10008)
[Fix-10002] Fix some bugs in datasource list (#10005)
[Bug] [MASTER-9811]fix cmd param to overwrite global param when executing complement (#9952)
[Fix][UI][V1.0.0-Beta] Fix the problem of packing failure. (#9962)
[Build][UI] Upgrade dependencies. (#9956)
[chore] Combine version 206 and 210 sql upgrade to 300 (#9959)
[Fix][UI][V1.0.0-Beta] Fix the problem of packing failure. (#9966)
[Fix #9925]: fix ellipsis bug in table column (#9936)
fix miss fixvalue input (#9933)
[Fix][UI Next][V1.0.0-Beta] Fix console bug after deleting a node from the context menu. (#9932)
[Fix] add resource capacity required rule (#9922)
[Fix][UI Next][V1.0.0-Beta] Fix data quality data not displayed. (#9930)
[Fix]Added request header validation (#9915)
[Fix-9906] After the serial wait execution strategy stops the running workflow instance, the instance will be woken up and executed if there is a wait instance. (#9907)
[Fix][UI-NEXT] Disable file name (#9893)
[Fix][UI Next][V1.0.0-Beta] Fix jdbc connect parameter validate bug (#9891)
[Fix][UI Next][V1.0.0-Beta] Fix the task group queue display error. (#9890)
[Fix][UI Next][V1.0.0-Beta] Fix edge deletion unhandled and remove the useless nextNodes. (#9875)
[Fix][UI Next][V1.0.0-Beta] Fix some errors on the datasource page. (#9877)
[Fix][UI Next][V1.0.0-Beta] Fix the page input error on the token manage page. (#9879)
[Fix][UI Next][V1.0.0-Beta] Fix bug where logo disappeared when format dag. (#9864)
[Fix-9856]Failed to upload the file but get misleading error message (#9861)
[Fix-9868] A task flow definition isolates the runs of different execution strategies by version numbers. (#9869)
[Bug] [worker] fix CommandType TASK_EXECUTE_RUNNING_ACK don't consumed (#9849) (#9850)
[Fix][UI Next][V1.0.0-Beta] Fix the problem that there is no prompt for selecting users. (#9858)
[fix] fix query access token for specified user failed (#9855)
[Fix][UI Next][V1.0.0-Beta] Add validation rules to dependency of the dependent task. (#9844)
Serial wait for subsequent execution (#9847)
[Bug-9829][Api] Fix schedule timezone (#9830)
[Fix]fix the search bar echoes abnormally (#9835)
[BUG][ALERT-SERVER]validate script before alert script (#9834)
[Fix] json object serialization error (#9828)
[Fix][UI][V1.0.0-Beta] Fix the problem of wrong workflow name. (#9833)
Task queue status update. (#9832)
[Fix][UI] Hide the version control button in workflow instance (#9825)
The node ID under serial is greater than the current ID. (#9820)
[Fix][UI] Fix timing modal start time and end time bug (#9815)
[Bug] [Website-9764]add http alert doc and change body param to unnecessary (#9792)
[Fix-9796] The task queue can be executed normally. (#9797)
[Fix][UI Next][V1.0.0-Beta] Add a return button and set the form to disabled on the file detail page. (#9802)
[Fix][Next-UI][V1.0.0-Beta] Fix placeholder error on the task queue page. (#9805)
[Fix-9352][datasource-api]data source client uses a cache with an expiration time (#9353)
revert delete dumplicate task_definition_log ddl (#8567)
[Bug][dep] Bump httpclient version to 4.5.13 (#9631)
[bug][db] Table relation_project_user have duplicate record (#9536)
[fix-9785][UI Next][dev] dynamic change height in viewlog when full screen (#9788)
[feat] Update README (#8261)
[Bug][Api] Failed to rerun the workflow instance (#9795)
[Bug]Fix log request errors (#9791)
Task group queue supports fuzzy search. (#9784)
[Bug] [Alert-9786] Http alert Get method not working (#9787)
[Bug] [Website-9764]add script doc to the alert function (#9765)
A task instance that normally queries the serial wait state. (#9777)
[Bug]Fix groupId initialization value problem (#9775)
[Fix][UI Next][V1.0.0-Beta] Add the 'startNodeList' field to the 'start-process-instance' interface. (#9769)
[Bug]Fix right-click menu function error (#9766)
[Fix][UI Next][V1.0.0-Beta] Fix cannot select the workload scheduling time bug (#9762)
[Fix][UI Next][V1.0.0-Beta] Remove the default values for node name and child node. (#9760)
[Fix][UI Next][V1.0.0-Beta] Change the label from recovery failed to failed to retry. (#9761)
Add the host address of the execution server to the sub task task instance. (#9758)
fix query issue when update environment (#9752)
improve task flow date time exception handle (#9732)
Subtask component treemap problem fix. (#9755)
[common] Make dolphinscheduler_env.sh work when start server (#9726)
[Fix-9717] The failure policy of the task flow takes effect (#9718)
fix process instance global param not include to task instance when master executing (#9730)
[Fix][UI Next][V1.0.0-Beta] Fix the bug that the tenant is 0 when editing a user. (#9739)
[Bug-9737][Api] fix task plugin load in api (#9744)
[Fix][UI][V1.0.0-Beta] Set the default value of host to '-' and Disable log button without host data. (#9742)
[Fix][UI Next][V1.0.0-Beta] Fix citation errors. (#9741)
[Bug][Script] Fix the type of variable workersGroupMap is not supported in bash 3.x (#9614)
[Bug]Fixed the problem of no request from right click viewing log (#9728)
[Improve][python] Support create table syntax and custom sql type param (#9673)
[Bug][UI][V1.0.0-Beta] Fix action buttons not displayed on one line bug (#9700)
[Bug] [UI][V1.0.0-Beta] Fix task group name can't clear bug (#9708)
[Bug-9719][Master] fix failover fail because task plugins has not been loaded (#9720)
[fix][Service] BusinessTime should format with schedule timezone (#9714)
[Fix][UI Next][V1.0.0-Beta] Set the timout label to not show. (#9710)
[Fix][UI Next][V1.0.0-Beta] Fix bug where route is error in file manage root (#9697)
[Fix][UI Next][V1.0.0-Beta] Fix success logo is not display bug (#9694)
[Fix][UI Next][V1.0.0-Beta] Fix the startup parameter display error. (#9692)
[Fix][UI Next][V1.0.0-Beta] Change update user to edit user. (#9683)
fix alert msg and change primitive to String to avoid wrong format (#9689)
[Fix][UI Next][V1.0.0-Beta] Fix bug where name copy is invalid (#9684)
[Fix] Support more generic tenant code when create tenant (#9634)
[hotfix][docker] Removed extra equals in mail user (#9677)
[chore] Correct the java doc in funtion DagHelperTest generateDag2 (#9602)
fix task dispatch error overload resource pool of task group (#9667)
Project management batch deletion should give a specific description if it fails. (#9669)
[Bug][UI][V1.0.0-Beta] Fix display resource not exist error message bug (#9657)
[Fix][UI][V1.0.0-Beta] Fix the parameter variables and startup parameters window cannot auto close bug (#9653)
[Fix][UI][V1.0.0-Beta] Adjust the UI presentation of the dependent task. (#9649)
[Fix][UI][V1.0.0-Beta] Replace the back-end interface for dependent task. (#9645)
[Fix][UI][V1.0.0-Beta]Fix data not update bug for workflow version switch (#9642)
[Improvement][style]add comment and clear warn (#9247)
[Bug-9608] Serialize the task definition failed (#9622)
[Bug][DAO] Update db init script and soft_version (#9628) (#9637)
[Bug] cancel application when kill task (#9624)
[Fix-9617]New task group project name drop-down data is displayed according to user type. (#9625)
[Fix][UI][V1.0.0-Beta] Fix tooltip not display bug in task instance (#9630)
upgrade commons-compress to 1.21 (#9540)
update jackson and jackson.databind version to fixes many security issues (#9572)
use secure version of postgresql (#9573)
[Fix][UI][V1.0.0-Beta] Fix the task name cleared after switching the task type. (#9623)
[Fix][UI][V1.0.0-Beta] Change node name to task name in the task modal on the task definition page. (#9620)
[Fix][UI][V1.0.0-Beta] Remove the sql comment in the procedure task and add the instructions link to the procedure task. (#9619)
[Fix][UI] Fix the udf function echoed error in the sql task. (#9616)
fix 9584 (#9585)
[Fix-9610] Sub-workflow status check is limited to SUB_PROCESS components (#9611)
[Python] Make detached signature during release (#9607)
[Bug][Standalone Server] Deduplicate the classpath jars in start.sh of the standalone server (#9583)
[Fix-9593] Storage Management StorageOperate No Instance (#9594)
Add ingress annotations (#9492)
[Fix][UI Next][V1.0.0-Beta] The version information creation time in the workflow definition is changed to the operateTime field. (#9590)
fix task kill (#9578)
[Bug] [API-9558]fix homepage task instance count method to use submit time to recount (#9559)
[Refactor][UI Next]Reconstructing the Log Component (#9574)
fix process pause and rerun (#9568)
[fix-9428] [DataSource] delete the password and test again, it is successful without password bug (#9428) (#9531)
[Fix][Master Server] handle warn+failed timeout strategy in workflow execute thread of master server (#8077) (#9485)
Check the status of the child process when the parent process is running (#9567)
fix workflow instance can not be save bug (#9554)
[Perf][UI Next][V1.0.0-Beta] Optimize judgment logic. (#9561)
[Fix][UI Next][V1.0.0-Beta] Fix the color matching problem of the relationship diagram. (#9546)
[Fix][UI] Fix the problem of displaying task execution icons. (#9549)
[Fix][UI] Fix condition task connection failure. (#9548)
fix Fault tolerance warning mapper add alert type to insert (#9533)
[Bug] [Dev] Fix start/stop/status/init script error (#9514)
[Fix-9525] [Worker] Environment did not work as expected (#9527)
[Fix][UI Next][V1.0.0-Beta] Fix the resource Center dark mode display exception when viewing the file details. (#9526)
[Fix][UI Next][V1.0.0-Beta] Added access to the child node function (#9518)
[Fix-9516] [Statistics] Statistics Manager shows data should belongs to current user (#9515)
Add python module dependency in the dist module (#9506)
[Improvement][Master] Fix typo for MasterTaskExecThreadTest (#9513)
[Bug] [ALERT-9487] change email attachment filename to add random string to avoid issues (#9498)
[Bug-9501][Worker] fix kill task error before running (#9509)
[Fix][Next-UI] Fix the jumping problem of close button on dag page. (#9494)
[Fix-9174] [Alert] Fix deduplication of alarm information (#9371)
[FIX][WEBSITE-9224]fix wechat doc and wechat form display (#9439)
[Bug][Next UI] Fix the branch flow options of the switch task is not available. (#9481)
[Fix][UI Next] Fix the problem of disabling owned user input during project editing. (#9476)
[FIX-9471][Script] fix run install.sh error (#9472)
[Fix][Next-UI] Add LIST type to the custom parameter types of task node. (#9468)
fix the OUT direct param could pass to the current script (#9463)
[Bug][UI Next]Fix global variable validation condition for save button in workflow definition. (#9454)
[Fix][UI][2.0.5] Add LIST type to the custom parameter types of task node. (#9455)
[python] Recover python release properties (#9444)
[Future-9396]Support output parameters transfer from parent workflow to child work flow (#9410)
[UI] Migrate NPM to PNPM in CI builds (#9431)
[Fix-9316] [Task] Configure DB2 data source SQL script execution report ResultSet has been closed exception in SQL task (#9317)
[Fix-9251] [WORKER] reslove the sql task about of add the udf resource failed (#9319)
Update inappropriate characters (#9413)
[DS-9387][refactor]Remove the lock in the start method of the MasterRegistryClient class (#9389)
[Bug][UI Next]Modify the display state logic of save buttons under workflow definition (#9403)
[Fix-9221] [alert-server] optimization and gracefully close (#9246)
[BUG][WORKER-9349]fix param priority (#9379)
[Bug][API-9364]fix ProcessInstance wrong alert group id (#9383)
[Dev] Switch version in pom.xml to dev-SNAPSHOT (#9223) (#9299)
[python] Migrate pythonGatewayServer into api server (#9372)
[optimization] [Service] Optimization ProcessService and add ProcessService interface (#9370)
[Bug-9235][Alert]Fix wechat markdown message and change wechat form structure (#9367)

Document

[doc] Correct all setup documents (#10074)
[doc] Add setValue syntax in local param (#10245)
[Fix-10083][Doc]Change Docker cmd && Change WebexTeams Chinese Translation (#10084)
[doc] Refactor local parameter docment (#10119)
[doc] Update kubernetes' FAQ (#10221)
[doc] Migrate develop docs from website (#9457)
[doc] fix url wrong in zh doc (#9421)
[doc] Add some dev missing doc (#9427)
[doc] Remove observability (#9402)
[doc] Change get help from dev mail list to slack (#9377)
[FIX-9355] Fix scheduleTime of start-process-instance api in api-doc (#9359)
[task-spark][docs] Corrected notice section (#9375)
[doc] Update task DataX document (#10218)
[doc] Update delete workflow description (#10203)
[Doc] Add complie supporting system (#10188)
[doc] Update project directory structure in docs (#10107)
[doc] Refactor global parameter docment (#10045)
[doc] Update website docs link (#10161)
[doc] Update editorial workflow content and images (#10130)
[doc] Remove flink call docs (#10122)
[doc] change document structure (#10124)
[doc] Show all the functions of the home page through screenshots (#10118)
[Bug][doc] Fix the open-api docs request error (#10100)
[doc] Correct docs of development-environment-setup (#9995)
[doc] Correct kubernetes (#9985)
[doc] Add example and notice about task type Dependent (#10001)
[doc] Add the description about execute type in SQL task (#9987)
[Doc] Add example and notice about task type Conditions (#9945)
[doc] Update the document picture to new UI (#9953)
[doc] Fix docs deadlink in readme (#9972)
[Docs] Update README. (#9970)
[docs] Correct custom docker image in faq (#9939)
[Docs][UI][Beta] Update README. (#9895)
[Docs][UI Next][V1.0.0-Beta] Add @types-lodash license. (#9883)
[doc] Separate and correct getting start by docker (#9862)
[doc] Fix syntax error cause website not work correctly (#9826)
[doc] Dir development should not ref other dirs content (#9812)
[doc] Add how to change standalone database type (#9376) (#9736)
[Feature][doc] Refactor and separate the Resource Center Document (#9658)
[Feature][Doc] Add docs for zeppelin task plugin (#9866)
[bug] [doc] fix the data quality link error about the navigation of dolphinscheduler 3.0.0-alpha zh docs (#9887)
[Improve][docs] Add spark sql docs to task spark (#9851)
[Feature-9566][Docs] Missing shell script application_id listening logic (#9778)
[doc] Add data quality to sidebar and correct docker resource path (#9662)
[Docs][DataQuality]: Add DataQuality Docs (#9512)
[Docs] enhance alert doc (#9534)
[Bug][Doc]Update database init instruction docs (#9659)
[Docs] Add license file for screenfull. (#9581)
[doc] Fix dead link after 3.0.0 release (#9562)
[python] Add missing doc about config and connect remote server (#9443)
[Improvement][doc] update time zone doc (#9503)
[Feature][Doc] Switch shell task instruction screenshots to latest (#9434)
[task-flink][docs] Corrected name (#9600)

Chore

add_alert_server_cluster_test (#10125)
[Feature-10034][CI] Add postgresql cluster test in CI (#10035)
[docker] Change docker hub HUB
[CI] Enable CI to remove unexpected files in /docs/img dir (#9393)
[Feature-9474] [CI] Add cluster test script verify on shell script (#9997)
[Improve][common] code clean in the common module (#9435)