apache/hop 2.20.0-rc1

2.20.0

on GitHub

What's Changed

• [RELEASE] spotless by @hansva in #7915
• [RELEASE] update doc version by @hansva in #7917
• Improved#3643 Fuzzy Match return distances for multiple matches(Top-K/separate rows) by @leehaut in #7849
• Improved Split fields: option to keep the field to split and append new fields by @leehaut in #7857
• harden javascript get variables button, fixes #3403 by @hansva in #7886
• allow to push git tags to remote. fixes #7880 by @bamaer in #7888
• issue #7456: TextComposite toolbar with find/replace and plugin SPI by @mattcasters in #7907
• Formula transform hardening, fixes #3572 by @hansva in #7916
• Fix "Execute SQL script" bad layout #7923 by @nadment in #7925
• Default language id for BaseTextExplorerFileTypeHandler to “plaintext” #7926 by @nadment in #7927
• Fix doc data stream and ddl by @nadment in #7922
• Add FTP(S) storage type, fixes #7777 by @hansva in #7885
• Translations update from Weblate by @hop-weblate in #7893
• Fix missing/mismatched i18n keyword keys for ActionMQL and FileMetadata by @leehaut in #7914
• Fix moveTo not working in all situations, fixes #5936 by @hansva in #7918
• do not override timestamp when file was skipped, fixes #4143 by @hansva in #7919
• Translations update from Weblate by @hop-weblate in #7928
• fix naviagtion on canvas and some shortcuts, fixes #7848 by @hansva in #7895
• issue #3062: document Hop Server deployment patterns by @mattcasters in #7920
• Issue #7544 : Add a native Spark SQL transform by @vbhanuchander-lang in #7859
• allow creating branches from tags, fixes #7887 by @bamaer in #7892
• openlineage: lineage sink emitting run, file and relational (column-l… by @bamaer in #7767
• git commit perspective Untracked tree #7901 by @bamaer in #7904
• Issue #2653 : Add JMS consumer and producer transforms by @vbhanuchander-lang in #7860
• Detect and mitigate classic pipeline buffer deadlocks (#7752) by @mattcasters in #7854
• issue #3119: drag the execution viewport to navigate the canvas by @mattcasters in #7932
• issue #3105: Hop Web authentication, roles, and UI authorization by @mattcasters in #7819
• Issue #6982 : Add SAS token authentication to the Azure VFS plugin by @vbhanuchander-lang in #7936
• Harden explorer DnD against null drop targets, fixes #7933 by @mattcasters in #7934
• Issue #7935 : Add pretty-print JSON button to Content Editor toolbar by @mattcasters in #7937
• Add empty option to encoding dropdowns, fixes #7938 by @hansva in #7939
• Issue #7903 : Add find and replace to the explorer content editor by @mattcasters in #7947
• Add markdown support and live preview, fixes #7876 by @hansva in #7949
• Bump org.apache.httpcomponents.client5:httpclient5 from 5.6.1 to 5.6.3 in /plugins/tech/openlineage by @dependabot[bot] in #7945
• Brazilian portuguese translation by @jefersonminatozaki in #7965
• issue #3025: unique metadata injection keys for Simple Mapping by @mattcasters in #7956
• issue #7950 Calculator ROUND_2 description by @nprimaux in #7954
• Translations update from Weblate by @hop-weblate in #7941
• issue #2267 : show failed and stalled icons in execution information by @mattcasters in #7951
• Issue #3185 : Add Fields, parameters, and variables documentation page by @mattcasters in #7960
• Fix blurry Hop GUI icons on Windows at 200% display scaling by @leehaut in #7955
• Issue #7902 : Document field format metadata, Script result, and date time zones by @mattcasters in #7961
• Issue #2382 : Add result files and log text options to Simple Evaluation by @mattcasters in #7962
• Include subfolders option did not work correctly, fixes #7952 by @hansva in #7957
• issue #7953 : Add Multi Mapping transform by @mattcasters in #7958
• Issue #7940 : Add a configurator for Hop environment variables by @mattcasters in #7942
• Issue #7891 : Add named table views to TableView by @mattcasters in #7946
• Fix Multi Mapping metadata injection test keys by @mattcasters in #7972
• hide profile selector in full client, fixes #7959 by @hansva in #7967
• New icons for “Find” and “Find and Replace” #7974 by @nadment in #7975
• Brazilian portuguese translation by @jefersonminatozaki in #7973
• Brazilian portuguese translation by @jefersonminatozaki in #7979
• Translations update from Weblate by @hop-weblate in #7978
• Fix#7966 Hop Web ClassNotFoundException for ImageDataProvider after #7955 by @leehaut in #7980
• Issue #2666 : Store HTTP action reply in a variable by @mattcasters in #7969
• Brazilian portuguese translation by @jefersonminatozaki in #7981
• Update the jms component icon to improve its visual representation by @leehaut in #7986
• Brazilian portuguese translation by @jefersonminatozaki in #7982
• [BUILD] fix sonar by @hansva in #7987
• fix highlighting on windows, fixes #7971 by @hansva in #7988
• fix incorrect hop by @hansva in #7989
• Fix #7990: JSON Input emits string "null" instead of Hop null for JSON null values by @kotwal-itpro in #7993
• Fix#6122 Give Get files from result a distinct icon by @leehaut in #7994
• Brazilian portuguese translation by @jefersonminatozaki in #8009
• Issue #7968 : Isolate SWT UI tests from the interactive display by @mattcasters in #7970
• issue #2647 : document Change Data Capture approaches by @mattcasters in #8006
• Fix#8010 NPE when opening Search plugin options in Configuration perspective by @leehaut in #8011
• Issue #7890 : Type-to-search filter for the unit test toolbar combo by @mattcasters in #8014
• Issue #8016 : Group GuiWidgetElement fields into tabs by @mattcasters in #8018
• allow remote branch delete and rename in git perspective. fixes #7996 by @bamaer in #7998
• fix commit during a merge aborting the merge, fixes #8001 by @bamaer in #8004
• added AWS Secrets Manager variable resolver. fixes #8021 by @bamaer in #8023
• .gitignore entries appended without a newline. fixes #8002 by @bamaer in #8005
• add action to run dbt core operations. fixes #8019 by @bamaer in #8020
• Correct inverted input check in Salesforce output transforms by @budaykiran94 in #8025
• Revert file/Cherry-pick file commit the whole index. fixes #8003 by @bamaer in #8007
• Issue #3270 : Restrict external access when building XSD validator schemas by @vbhanuchander-lang in #8026
• Let each database dialect describe its own column types, fixes #7997 by @hansva in #8017
• fix(execution): exclude parameterValues from Execution JSON serialization by @zanarellidev in #8027
• create a copy utility and remove the need for clone and copy constructors in transforms/actions by @hansva in #8031
• Let a database limit rows before the query as well as after it, fixes… by @hansva in #8032
• Switch pipeline and workflow undo/redo to XML snapshots, fixes #8037 by @mattcasters in #8042
• Issue #2383 : Add wait timeout to nested pipeline and workflow execution by @mattcasters in #8043
• Issue #8000 : Route unreadable XML files to error handling by @vbhanuchander-lang in #8029
• add hadoop-shaded-guava in lib/core to allow Parquet transforms to ru… by @bamaer in #8040
• fixed retry options for GCS write operations. fixes 8028 by @bamaer in #8038
• Issue #2722 : Table Input specified fields, named parameters, optional lookup by @mattcasters in #8034
• Issue #7114 : Add optional Spoon-style palette tree to pipeline and workflow graphs by @mattcasters in #8044
• Type hardening for database types, fixes #8015 by @hansva in #8048
• Issue #7789 : Accept underscores in host names when building the request origin by @vbhanuchander-lang in #8046
• fix date handling with SQLite, fixes #3910 by @hansva in #8049
• harden and fix vertica bulkloader, fixes #4394 by @hansva in #8050
• Add a MS SQL Server bulk loader transform, fixes #8051 by @hansva in #8053
• Issue #3127 : Copy parent project folders into child projects by @mattcasters in #8052
• Replace deprecated expression ${parent.version} with ${project.parent.version} by @nadment in #8055
• DuckDB fixes, fixes #3743 and fixes #3744 by @hansva in #8056
• Fix#8033 Database Join add load SQL from a file by @leehaut in #8064
• Fix layout spacing in Load file content in memory dialog by @leehaut in #8065
• Brazilian portuguese translation by @jefersonminatozaki in #8070
• Fix#2301 Remove unused Look & Feel font options by @leehaut in #8068
• Fix #8054: decrypt trustStorePassword in REST transform init by @kotwal-itpro in #8061
• [IT] harden surefire xml by @hansva in #8072
• Brazilian portuguese translation by @jefersonminatozaki in #8081
• add support for jfrog as a marketplace repository, fixes #8073 by @bamaer in #8077
• improve error handling for oracle on table output and SAM, fixes #5758 by @hansva in #8076
• Improve RedShift Bulkloader and related CrateDB, fixes #3621 by @hansva in #8083
• fix wait for sql result type, fixes #2483 by @hansva in #8086
• "Informix Servername" field value not saved or used in Informix conne… by @hansva in #8088
• cancel button does not react properly, fixes #8079 by @hansva in #8090
• fix snowflake bulkloader, fixes #2298 by @hansva in #8089
• do not emit empty row if all files are empty, fixes #8071 by @hansva in #8091
• [IT] fix invalid characters in surefire report output by @hansva in #8092
• Add databricks driver download option, fixes #8058 by @hansva in #8093
• Fix#8063 Join hanging when a parallel branch fails before reaching Join by @leehaut in #8082
• Fix OpenLineage IT test by @hansva in #8102
• Fix#8096 pipeline variable resolver using server default metadata on remote export by @leehaut in #8097
• The “Find Reference” feature in the File Explorer does not work on Windows #8062 by @nadment in #8067
• Issue #8098 : Allow help files to be opened in a dialog window by @mattcasters in #8100
• Issue #8059 : Rebrand hop-env files as Hop install spec and fix Open/Save As by @mattcasters in #8103
• Only truncate data related tableviews, fixes #8060 by @hansva in #8104
• Issue #8087 Configure Hop Environment is not working on Windows by @sramazzina in #8109
• Issue #8057 : Rasterize palette tree icons at the zoomed small-icon size by @mattcasters in #8107
• check and streamline parameter passing/override, fixes #8084 by @hansva in #8101
• Issue #8047 : Isolate Hop Web GUI state across RAP sessions by @mattcasters in #8108
• Rest connection not working in hop server, fixes #8115 by @hansva in #8116
• fix: DatabaseJoin dialog NPE when the configured connection no longer exists by @waterWang in #8110
• Issue #8035 : Add Data set output transform by @mattcasters in #8118
• Give each execution its own VFS namespace, fixes #8106 by @hansva in #8119
• Sanitize project home path #8062 by @nadment in #8111
• Issue #8114 : Focus Launch in the run dialog so Enter and Space start the run by @mattcasters in #8120
• Issue #8113 : Document Hop Web Docker persistence and upgrades by @mattcasters in #8122
• added created and modified hop versions. fixes #8039 by @bamaer in #8121
• feat(action): support hidden arguments in Shell action to prevent credential leaks in execution logs (#4935) by @zanarellidev in #8094
• Fix pipelines going to waiting state on critical fail, fixes #3861 by @hansva in #8123
• Fix regression and workarounds that were only in the validator, fixes… by @hansva in #8126
• Issue #2340 [Bug]: Beam - WriteToLog never logs when running via Beam-Direct by @sramazzina in #8127
• harden incorrect hops and cleanup pipeline/workflow correctly, fixes … by @hansva in #8129
• Fix cramped labels and checkboxes in Get table names Settings by @leehaut in #8137
• correctly merge plugin classloaders, fixes #8133 by @hansva in #8141
• revive selenium tests, fixes #8142 by @hansva in #8149
• Fix execution results Logging toolbar spacing and top-right button alignment by @leehaut in #8140
• Issue #7151 : Load Execute SQL script from a file and restyle the dialog by @mattcasters in #8144
• avoid UI test hang on GHA by @hansva in #8152
• Fix metadata items not opening in Hop Web, fixes #8151 by @bamaer in #8153
• [DOCS] cleanup the developer docs a bit by @hansva in #8157
• enable all selenium tests by @hansva in #8158
• Improve File Metadata error reporting for archive URIs by @sramazzina in #8165
• Issue #2909 Document stream fields as wrapped Java objects in the JavaScript transform by @sramazzina in #8166
• Fix#8160 OData Input shared HTTP pool shutdown and unit test by @leehaut in #8168
• Enforce RBAC on the embedded Hop Server API in Hop Web (fixes #8150) by @bamaer in #8169
• Issue #8154 : Support binary data in bulk load transforms by @mattcasters in #8162
• Fix: Rename pipeline/workflow referenced in files and metadata on Windows #8161 by @nadment in #8167
• fix grid height on previews in linux, fixes #8155 by @hansva in #8171
• Issue #8147 : Stop metrics grid flicker and add column resize controls by @mattcasters in #8174
• fix integer mapping for database dialects, fixes #4174 by @hansva in #8175
• fix dimension lookup/update key issue, fixes #8130 by @hansva in #8177
• Issue #8139 - Formula transform editor layout collapses when reopening formula dialog by @sramazzina in #8146
• Add guardrails for plugin packaging regressions. fixes #8041 by @bamaer in #8170
• Issue #8138 : Do not send a path option when writing with file_format=jdbc by @vbhanuchander-lang in #8176
• Issue #3003 : Add Output transform metrics transform by @mattcasters in #8178
• Issue #2723 : Json Input should not fail when no files if that option is set by @mattcasters in #8186
• Add icon to database meta Databricks, H2 and Exasol #8183 by @nadment in #8184
• Keep Hop Web Help button icon aligned with OK/Cancel by @leehaut in #8181
• Add a Browse button to select a schema #5438 by @nadment in #8179
• Fix#8112 Hop Web: a small loading splash while Hop is waking up by @leehaut in #8182
• Issue #8143 : Add Database value validation transform by @mattcasters in #8148
• Issue #8188 : fold the technical documentation into the user and dev manuals by @hansva in #8189
• Issue #8135 [Feature Request]: Add quick file creation to the Hop file browser by @sramazzina in #8190
• Issue #3051 : Harden Filter Rows date constant parsing by @mattcasters in #8185
• Improve the wording of the rules and samples, #8084 by @hansva in #8191
• Allow multi-delete, add a check on existing folders, fixes #8193 by @hansva in #8194
• fix invalid thread access in hop web, fixes #8195 by @hansva in #8197
• Issue #8163 : Harden XmlInputStream StAX factory against XXE by @mattcasters in #8164
• fond hop-rest and async into Hop server, fixes #8145 by @hansva in #8192
• [IT] fix minio test, caused by hop-server test polution by @hansva in #8200
• “Favorites” Icon for Palette #8201 by @nadment in #8202
• Fix label spacing and clear exclude mask on Add "Get file names" by @leehaut in #8205
• [IT] make selecting elements in selenium simpler by @hansva in #8208
• correctly read binary data, fixes #8207 by @hansva in #8209
• fix eager metadata loading, fixes #8203 by @hansva in #8210
• Add linting for pipelines, workflows and metadata. Fixes #3103 by @bamaer in #8199
• document how to run Hop projects in the cloud. fixes #2427 by @bamaer in #8211
• add PGP signing tests, refs #8206 and #7276 by @bamaer in #8213
• harden VFS namespace split, fixes #8215 by @hansva in #8231
• Fix #8233: write the NUL separator as an escape so the sources stay text by @fskorgen in #8235
• make the lint plugin session aware in Hop Web, fixes #8232 by @hansva in #8236
• [IT] hardening for selenium by @hansva in #8237
• Variablesmap was not passed correctly, fixes #8234 by @hansva in #8240
• guard extension point, fixes #8239 by @hansva in #8241
• Issue #8012 : Resolve marketplace env file paths against the project home by @vbhanuchander-lang in #8136
• Fix Standardize Phone Number country handling, parse failures, and variable field names by @leehaut in #8238
• Issue #2955 : Warn when a referenced database connection does not exist by @mattcasters in #8245
• Fix project variable resolution in environment file paths by @gvdutra in #8246
• Improve the java filter, add options, docs improve editor, fixes #8243 by @hansva in #8250
• Issue #8080 : Support Hive-style partitioning in the Parquet File Output transform by @vbhanuchander-lang in #8254
• engine type should not be driven by Metadata, fixes #8262 by @hansva in #8264
• Issue #2584 : Add Calculator conversions between JDE Julian and ISO dates by @mattcasters in #8257
• Issue #2402 : Support ~ (tilde) at start of path to resolve ${user.home} by @mattcasters in #8256
• keep namespace declarations in the Add XML transform, fixes #3320 by @bamaer in #8258
• Issue #2347 : Add row distribution and partitioning context actions to pipeline hops by @mattcasters in #8253
• Remove OSX reference from variable tip by @dsanderbi in #8269
• Allow ignoring expected lint findings. fixes #8255 by @bamaer in #8268
• Fix#8260 Keep Database Lookup length and precision when a return Type is set by @leehaut in #8267
• issue #2683 : Naming Scheme metadata by @mattcasters in #7735
• Issue #8212 : Add a Database perspective as an alternative to the SQL editor dialog by @mattcasters in #8214
• harden getting the session display, fixes #8248 by @hansva in #8271
• Hop Gui notification system #6188 by @bamaer in #8270
• Fix#8266 Add Enclosure option to Split field to rows by @leehaut in #8275
• Issue #2664 : Harden pipeline unit tests (replacement notices, numeric compare, rename) by @mattcasters in #8274
• Issue #2632 : Document scheduling options for workflows and pipelines by @mattcasters in #8273
• Issue #2916 : Run a project without adding it to hop-config.json by @mattcasters in #8265
• Issue #8277 : Harden the Database perspective, also fixes #8278 by @mattcasters in #8279
• Issue #2728 : Create mapping from selected sequential transforms by @mattcasters in #8272
• Issue #8280 : Harden Neo4j execution information for Neo4j 5 by @mattcasters in #8282
• Issue #8286 : Attach Hop Web canvas overlay to the RAP widget, not a size guess by @mattcasters in #8290
• Issue #8292 : Rename in-memory short option from -im to -ime by @mattcasters in #8293
• General Hop software development guidelines for AI agents. by @mattcasters in #8296
• Fix Hidden additional file field using path instead of isHidden() by @leehaut in #8289
• Issue #8284 : Set PROJECT_HOME when hop-server enables a project by @mattcasters in #8291
• Add browser-native file operations to Hop Web by @michaaels in #8276
• Issue #8298 : Put Parquet Output options on four tabs so the dialog fits 1080p by @mattcasters in #8300
• Fix AI-reported bugs against current main type rules by @mattcasters in #8244
• Issue #8294 : Fix the Select Values checks and make the default lint … by @bamaer in #8307
• Issue #8295 : Do not report a failed connection lookup as a missing c… by @bamaer in #8301
• Issue #8285 : Add Hadoop-free HDFS VFS plugin (WebHDFS/HttpFS/Knox) by @mattcasters in #8287
• Issue #8302 : Add Kubernetes authentication to the HashiCorp Vault variable resolver by @mattcasters in #8305
• Fix#8308 Add a Group By option to exclude rows from aggregation based on a boolean field by @leehaut in #8309
• Issue #2727 : Align Kettle import connection names to a case-sensitive scheme by @mattcasters in #8317
• Issue #2865 : Keep PROJECT_HOME when importing Kettle into a folder by @mattcasters in #8313
• Add an icon representing the database type in the “Database” perspective #8318 by @nadment in #8319
• Add more Calcite SQL format options #8337 by @nadment in #8338
• Fixes #8336 : Upgrade the Language Model Chat transform to langchain4… by @bamaer in #8341
• fixes #8314 : Add Git Input transform and Git connection metadata type by @bamaer in #8331
• Issue #8315 : Offer a field dropdown for filenames accepted from the … by @bamaer in #8323
• Issue #8299 : Word-split HOP_CONFIG_OPTIONS when invoking hop-conf by @mattcasters in #8312
• Fix LoadScriptFromTab swallowing exceptions in the JavaScript transform by @leehaut in #8322
• Issue #2641 : Fail hops into transforms that do not consume input by @mattcasters in #8329
• Issue #8330 : Add a pluggable AI Advisor and named AI Provider metadata by @mattcasters in #8342
• additional fields for git input transform. fixes #8347 by @bamaer in #8348
• Fixes #8327: Keep ServerPushSession active in Hop Web so logging refresh does not stall by @abhiramaab in #8344
• Issue #8297 : Serve explorer HTML and PDF with a document base on Hop Web by @mattcasters in #8306
• Issue #8334 : Allow plugin Hop Server servlets to register endpoint permissions by @mattcasters in #8335
• Fixes #8340: Suppress excessive HTTP wire logging from notification polling by @abhiramaab in #8343
• Issue 8350 by @mattcasters in #8351
• Issue #8346 : Add an extensible diagram exporter plugin architecture by @mattcasters in #8349
• [#8324][build] setup ECJ compilation by @rmannibucau in #8325
• Add incremental builder and bump github action versions, fixes #8355 by @hansva in #8356
• Add a documentation check to the github actions, fixes #8358 by @hansva in #8359
• Improve error feedback from failing documentation builds by @hansva in #8363
• cleanup documentation warnings by @hansva in #8364
• Invoke GnuPG with an argument list instead of a shell command string,… by @bamaer in #8316
• [IT] fix broken selenium integration tests by @hansva in #8372
• spark performance improvements, fixes #8369 by @hansva in #8370
• Issue #8326 : Render ContextDialog content as vector SVG in Hop Web by @mattcasters in #8352
• [IT] figure out why selenium is failing by @hansva in #8383
• [IT] fix selenium tests by @hansva in #8384
• Issue #8251: Multi-user session isolation and hardening for Git plugin by @mattcasters in #8365
• Force-build unpublished P2 wrappers in incremental PR builds, fixes #8387 by @mattcasters in #8388
• [IT] test hardening by @hansva in #8395
• fix classloader issue, fixes #8369 by @hansva in #8382
• Translations update from Weblate by @hop-weblate in #8397
• [IT] fix selenium tests by @hansva in #8399
• [Bug] Database perspective keeps old metadata around, fixes #8375 by @mattcasters in #8376
• Polishing the database exploration dialog #5376 by @nadment in #8353
• Issue #8361 : Link RDBMS metadata editor with the Database perspective by @mattcasters in #8405
• Issue #8406 : Make ECJ compilation work with Debian/Ubuntu Maven by @mattcasters in #8407
• Reject cross-site requests to the Hop Server servlets, fixes #8371 by @bamaer in #8390
• Verify TLS certificates by default in the Vault and OpenBao resolvers… by @bamaer in #8396
• Scope stored marketplace credentials to their own repository, fixes #… by @bamaer in #8398
• Add TLS and authentication options to the Arrow Flight server, fixes … by @bamaer in #8401
• issue #8377 - File Explorer Perspective: pipeline disappears from tre… by @mattcasters in #8400
• Issue #8321 : Use the real Log4j2 SLF4J binding with a default config and publish Hop context as MDC by @rmannibucau in #8374
• [IT] fix selenium tests by @hansva in #8416
• remove the committed jar and trigger les builds, fixes #8412 by @hansva in #8413
• Cube in/output module merge and code hardening, fixes #8380 by @hansva in #8381
• [build] drop os maven plugin which is no more used and enable to support maven 4 by @rmannibucau in #8425
• Fix Sorted Merge when row comparison throws instead of treating rows as equal by @leehaut in #8354
• SEC-002, SEC-003 linter rule hardening. fixes #8420 by @bamaer in #8421
• Fix#8328 Get mails (POP3/IMAP) IMAP Retrieve persistence and 2.13 XML load by @leehaut in #8379
• Issue #8426 : Register ECJ on Debian/Ubuntu Maven without a committed jar by @mattcasters in #8427
• Issue #8366 : Do not ask to save restored Database SQL editors by @mattcasters in #8423
• Keep connection details when the connection type changes by @fskorgen in #8424
• Translations update from Weblate by @hop-weblate in #8418
• Issue #8367 : Disable external entity resolution by default in XSD va… by @bamaer in #8368
• Fixes #8403 : Add a Plugin Catalog transform that exposes the plugin … by @bamaer in #8408
• Fixes #8409 : Add a Vector value type for embeddings by @bamaer in #8414
• Enhance DatabaseJoin with SQL parameter support by @beatum in https://github.com/apache/hop/pull/8339
• set correct width and height so resize works correctly, fixes #8437 by @hansva in https://github.com/apache/hop/pull/8438
• crispy treeview images in hop web, fixes #8434 by @hansva in https://github.com/apache/hop/pull/8436
• Issue #8432 : Give each Hop Web graph canvas its own SVG renderer remote by @mattcasters in https://github.com/apache/hop/pull/8439
• Fixes #8422 : Add pgvector upsert and search transforms by @bamaer in https://github.com/apache/hop/pull/8428
• Fix Do not mark a pipeline or workflow dirty when a dialog is OK without edits by @leehaut in https://github.com/apache/hop/pull/8247
• Fixe#8283 Combination Lookup SQL button NPE when parent pipeline is null by @leehaut in https://github.com/apache/hop/pull/8431
• Improve Hop Web performance, fixes #8435 by @hansva in https://github.com/apache/hop/pull/8442
• IT fixes by @hansva in https://github.com/apache/hop/pull/8451
• fix deadlock at high concurrency, fixes #8455 by @hansva in https://github.com/apache/hop/pull/8456
• Enable tab "Move to right" in Hop Web, fixes #8458 by @mattcasters in https://github.com/apache/hop/pull/8459
• Tighten Hop Web UI spacing and margins, fixes #8461 by @mattcasters in https://github.com/apache/hop/pull/8462
• Remove the redundant NEW button in the metadata view #8466 by @nadment in https://github.com/apache/hop/pull/8467
• Move the lint error/warning icons to the bottom left #8345 by @nadment in https://github.com/apache/hop/pull/8460
• limit context dialog when sidebar is open, cleanup, right mouseclick … by @hansva in https://github.com/apache/hop/pull/8450
• structure and content updates for Getting Started guide. fixes #8447 by @bamaer in https://github.com/apache/hop/pull/8452
• [IT] fix pgp tests by @hansva in https://github.com/apache/hop/pull/8469
• Fixes #8411 : Emit native vector column types from database dialects … by @bamaer in https://github.com/apache/hop/pull/8463
• fix Hop Gui startup after Hop Web updates. fixes #8479 by @bamaer in https://github.com/apache/hop/pull/8481
• Show column definition in Database perspective, fixes #8464 by @mattcasters in https://github.com/apache/hop/pull/8468
• [DOCS] missing pages and marketplace references by @hansva in https://github.com/apache/hop/pull/8483
• update terminal and execution panel toolbar to use consistent toolbar… by @bamaer in https://github.com/apache/hop/pull/8482
• Hop Web security follow-ups: mode NONE docs, threat model, EXTERNAL w… by @bamaer in https://github.com/apache/hop/pull/8402
• Fixes #8415 : Add a Text chunker transform to split documents for emb… by @bamaer in https://github.com/apache/hop/pull/8419
• Fixes #8441 : Add an Embed text transform to turn text into embedding… by @bamaer in https://github.com/apache/hop/pull/8454
• Issue #8440 : Do not stall parallel HDFS VFS writes under Kerberos by @mattcasters in https://github.com/apache/hop/pull/8487
• fix db commit, fixes #8288 by @hansva in https://github.com/apache/hop/pull/8480
• Dimension Lookup: Move ScrolledComposite Inside CTabItem #8470 by @nadment in https://github.com/apache/hop/pull/8471
• Add TabFolder to Combination lookup/update transform #8472 by @nadment in https://github.com/apache/hop/pull/8473
• The check result is inconsistent for the workflow #8465 by @nadment in https://github.com/apache/hop/pull/8476
• Clear filter in database perspective when switching projects, fixes #8453 by @mattcasters in https://github.com/apache/hop/pull/8485
• Switch the JavaScript transform dialog to the TM4E content editor #8488 by @nadment in https://github.com/apache/hop/pull/8490
• Fixes #7057 : bind Oracle national character and LOB columns with the… by @bamaer in https://github.com/apache/hop/pull/8446
• Fixes a few layout issues in the Ldap Input transformation #8474 by @nadment in https://github.com/apache/hop/pull/8475
• Issue #8477 : Do not crash Hop Web project activation before perspectives exist by @mattcasters in https://github.com/apache/hop/pull/8484
• Support for adding extra tabs to the pipeline/workflow graph may return the value null #8491 by @nadment in https://github.com/apache/hop/pull/8492
• Translations update from Weblate by @hop-weblate in https://github.com/apache/hop/pull/8493
• Translations update from Weblate by @hop-weblate in https://github.com/apache/hop/pull/8504
• add option to use menus, fixes #8478 by @hansva in https://github.com/apache/hop/pull/8494
• updated replacement for HTTP client step to transform. fixes #8496 by @bamaer in https://github.com/apache/hop/pull/8506
• Fixes #3360 : add context about using Group By in distributed environ… by @bamaer in https://github.com/apache/hop/pull/8510
• Add DnD effects to hop web, fixes #8499 by @hansva in https://github.com/apache/hop/pull/8512
• clipboard hardening, fixes #8498 by @hansva in https://github.com/apache/hop/pull/8513
• [build] another try to make ecj frictionless by @rmannibucau in https://github.com/apache/hop/pull/8430
• Switch the JavaScript action dialog to the TM4E content editor #8515 by @nadment in https://github.com/apache/hop/pull/8517
• Issue #8508 : Add a maximum consume duration to the Kafka Consumer by @mattcasters in https://github.com/apache/hop/pull/8518
• Issue #8417 : Use the unit test database replacement in Database Lookup by @mattcasters in https://github.com/apache/hop/pull/8520
• Add support for sequences in DuckDb #8522 by @nadment in https://github.com/apache/hop/pull/8523
• Fix#8500 Align CSV Input Verify with filename-from-field and static filename modes by @leehaut in https://github.com/apache/hop/pull/8502
• Issue #8404 : Return sampled field metadata from Get Fields by @mattcasters in https://github.com/apache/hop/pull/8524
• Fixes #8531 : Two integration tests assert behaviour the product neve… by @bamaer in https://github.com/apache/hop/pull/8535
• parquet output code hardening and cleanup, fixes #2338 by @hansva in https://github.com/apache/hop/pull/8537
• [CI] fix floating test numbers by @hansva in https://github.com/apache/hop/pull/8547
• [IT] minor beam fix by @hansva in https://github.com/apache/hop/pull/8550
• fix results for remote engine, fixes #4826 by @hansva in https://github.com/apache/hop/pull/8529
• fix csv lazy conversion on Beam, fixes #3724 by @hansva in https://github.com/apache/hop/pull/8551
• harden normalizer with mixed field types, fixes #3636 by @hansva in https://github.com/apache/hop/pull/8549
• JSON Output: keep input fields on the last partial block, fixes #2958 by @hansva in https://github.com/apache/hop/pull/8538
• Add missing font for correct CJK rendering, fixes #8528 by @hansva in https://github.com/apache/hop/pull/8533
• Translations update from Weblate by @hop-weblate in https://github.com/apache/hop/pull/8556
• Add config options for all tooltips on the canvas, fixes #8478 by @hansva in https://github.com/apache/hop/pull/8532
• clear cache button code hardening, fixes #3312 by @hansva in https://github.com/apache/hop/pull/8541
• fix wdsl file load, fixes #4813 by @hansva in https://github.com/apache/hop/pull/8552
• File Metadata: keep the enclosure with quotes inside fields and keep … by @hansva in https://github.com/apache/hop/pull/8555
• Issue #8503 : Add a VFS File Explorer by @mattcasters in https://github.com/apache/hop/pull/8527
• Move Google plugin to the Technology marketplace category by @nadment in https://github.com/apache/hop/pull/8562
• Upgrade libphonenumber to 9.0.40 in Standardize Phone Number transform #8565 by @nadment in https://github.com/apache/hop/pull/8566
• [CI] harden gib by @hansva in https://github.com/apache/hop/pull/8571
• Add format mask support to boolean fields and update documentation, f… by @hansva in https://github.com/apache/hop/pull/8557
• Improve metadata item naming consistency, fixes #5597 by @hansva in https://github.com/apache/hop/pull/8554
• cleanup some dead code around environment filtering, fixes #5382 by @hansva in https://github.com/apache/hop/pull/8553
• HttpPost, HTTPClient, HTTPAction cleanup and hardening, fixes #2962, … by @hansva in https://github.com/apache/hop/pull/8540
• sqlite type hardening ,fixes #3633 by @hansva in https://github.com/apache/hop/pull/8548
• move to environment so it's applied everywhere, fixes #7297 by @hansva in https://github.com/apache/hop/pull/8572
• Add support for sequences in H2 #8526 by @nadment in https://github.com/apache/hop/pull/8542
• Issue #8539 : Get Avro Decode fields from JSON by @mattcasters in https://github.com/apache/hop/pull/8567
• Issue #8568 : Do not keep writing execution info through a closed database connection by @mattcasters in https://github.com/apache/hop/pull/8570
• Issue #8362 : Keep word movement and line copy in text fields by @mattcasters in https://github.com/apache/hop/pull/8576
• Fix#8545 Http/HttpPost/Rest check reports error for successful URL/method field validation by @leehaut in https://github.com/apache/hop/pull/8558
• joinrows hardening and block on beam/spark, fixes #2353 by @hansva in https://github.com/apache/hop/pull/8574
• Fixes #8511 : Add a Structured extract transform to read typed fields… by @bamaer in https://github.com/apache/hop/pull/8514
• Harden avro code, confirm working engines, fixes #3901 by @hansva in https://github.com/apache/hop/pull/8577
• minor logging fix, fixes #4045 by @hansva in https://github.com/apache/hop/pull/8581
• Issue #8486 : Harmonize the bottom panel and add an option to disable the embedded terminal by @mattcasters in https://github.com/apache/hop/pull/8575
• Issue #8507 : Do not send a charset on the REST Client Content-Type by @mattcasters in https://github.com/apache/hop/pull/8569
• Issue #7906 : Add a description to environment configuration files by @mattcasters in https://github.com/apache/hop/pull/8579
• Issue apache#2362 Evaluate JsonPath functions in the JSON Input transform by @sramazzina in https://github.com/apache/hop/pull/8198
• Fixes #8589 : Lay out the dbt action dialog on tabs by @bamaer in https://github.com/apache/hop/pull/8594
• fix simple mapping import, fixes #4119 by @hansva in https://github.com/apache/hop/pull/8582
• use a large format mask to not lose decimal digits, fixes #3970 by @hansva in https://github.com/apache/hop/pull/8580
• UDJC test pipeline should have info and output transforms, fixes #4584 by @hansva in https://github.com/apache/hop/pull/8586
• clear results when pipeline has copy rows to restult, fixes #4581 by @hansva in https://github.com/apache/hop/pull/8585
• harden the filter value, fixes #8596 by @hansva in https://github.com/apache/hop/pull/8598
• [CI] fix beam tests by @hansva in https://github.com/apache/hop/pull/8615
• Issue #8606 : Select all text in text widgets by @mattcasters in https://github.com/apache/hop/pull/8612
• fix incorrect log level store, fixes #8603 by @hansva in https://github.com/apache/hop/pull/8611
• fix modl role position. fixes #8543 by @bamaer in https://github.com/apache/hop/pull/8578
• Issue #8595 : Don't show data when moving transforms by @mattcasters in https://github.com/apache/hop/pull/8616
• DatabaseMeta was not correctly loaded in Dynamic SQL, fixes #4471 by @hansva in https://github.com/apache/hop/pull/8584
• Fix hop-conf variable option handling by @gvdutra in https://github.com/apache/hop/pull/7856
• Issue #8501 : Show the finished check only when every copy is done by @mattcasters in https://github.com/apache/hop/pull/8573
• harden project delete/rename, fixes #4275 by @hansva in https://github.com/apache/hop/pull/8583
• Fixes #8536 : Let the linter address Hop's own verify checks individu… by @bamaer in https://github.com/apache/hop/pull/8590
• Fixes #8516: inconsistencies in PDI import dialog and CLI by @bamaer in https://github.com/apache/hop/pull/8587
• Issue #8614 : Preview a Parquet file in the Hop GUI by @mattcasters in https://github.com/apache/hop/pull/8619
• Fix#8620 Inconsistency when saving workflow 'name' tag of the file saved as "new workflow" by @leehaut in https://github.com/apache/hop/pull/8627
• Issue #8564 : Do not warn when closing an unchanged JavaScript dialog by @mattcasters in https://github.com/apache/hop/pull/8633
• Issue #8561 : Do not warn about a missing connection when Add Sequence uses a counter by @mattcasters in https://github.com/apache/hop/pull/8634
• Fix#8593 Parse an ASCII minus when converting strings to numbers by @leehaut in https://github.com/apache/hop/pull/8639
• Issue #8117 : Lay out annotated widget groups as boxes by @mattcasters in https://github.com/apache/hop/pull/8636
• Issue #8617 : Limit large String, JSON, Binary, and Avro values in data profiles by @mattcasters in https://github.com/apache/hop/pull/8632
• Issue #8521 : Honor a disabled linter and file or script action sources by @mattcasters in https://github.com/apache/hop/pull/8635
• Fix memory leak in caching execution information location, fixes #8623 by @mattcasters in https://github.com/apache/hop/pull/8625
• Issue #8621 : Find a value in a table view by @mattcasters in https://github.com/apache/hop/pull/8622
• Issue #8605 : Add shortcuts to open a running execution by @mattcasters in https://github.com/apache/hop/pull/8610
• Issue #8509 : Add an optional project id for shared execution information by @mattcasters in https://github.com/apache/hop/pull/8559
• Fixes #8646: Update and expand the SDK documentation by @mattcasters in https://github.com/apache/hop/pull/8647
• Fixes #8640 : Explain pipelines and workflows by @mattcasters in https://github.com/apache/hop/pull/8645
• Issue #8601 : Do not crash when opening a workflow execution viewer by @mattcasters in https://github.com/apache/hop/pull/8602
• Issue #8600 : Save Avro Record values in an execution information location by @mattcasters in https://github.com/apache/hop/pull/8607
• Issue #8546 : Keep pipeline metrics updating after a Kafka consumer restart by @mattcasters in https://github.com/apache/hop/pull/8560
• Fix#8650 Adding a project fails with a false circular parent reference when the parent has an empty parentProjectName by @leehaut in https://github.com/apache/hop/pull/8651
• Fixes #8624 : Fix scrolling on pipeline run configuration screen by @mattcasters in https://github.com/apache/hop/pull/8656
• Fixes #8642 : Make the terminal cursor follow the Hop theme colours by @bamaer in https://github.com/apache/hop/pull/8643
• Fixes #3814: set a run configuration on imported Pipeline and Workflo… by @bamaer in https://github.com/apache/hop/pull/8641
• Fix#8700 drop deleted projects from the project toolbar menu by @leehaut in https://github.com/apache/hop/pull/8703
• [CI] replace minio with seaweedFS by @hansva in https://github.com/apache/hop/pull/8707
• [SONAR] fix security hotspots by @hansva in https://github.com/apache/hop/pull/8705
• Issue #4107 : Add .hpl to imported Kafka consumer pipeline paths by @mattcasters in https://github.com/apache/hop/pull/8687
• Issue #3478 : Document that copies and partitioning only run on the local engine by @mattcasters in https://github.com/apache/hop/pull/8682
• Issue #2368 : Document User Defined Java Class execution, fields, and options by @mattcasters in https://github.com/apache/hop/pull/8673
• Issue #2408 : Add an Apache Hop sizing guide by @mattcasters in https://github.com/apache/hop/pull/8675
• Issue #2420 : Allow custom pipeline unit test types by @mattcasters in https://github.com/apache/hop/pull/8676
• Issue #2703 : Group projects by topic in the project menu by @mattcasters in https://github.com/apache/hop/pull/8677
• Issue #3123 : Add option to exclude the field to split from output by @mattcasters in https://github.com/apache/hop/pull/8678
• Issue #3460 : Add hash-code checksum and read it in Combination lookup by @mattcasters in https://github.com/apache/hop/pull/8681
• Issue #3745 : Raise the JSON string limit used to open execution data by @mattcasters in https://github.com/apache/hop/pull/8683
• Issue #4248 : Ask where to save an inherited metadata duplicate by @mattcasters in https://github.com/apache/hop/pull/8688
• Issue #4296 : Add hop-run option to append to the log file by @mattcasters in https://github.com/apache/hop/pull/8689
• Issue #4500 : Report skipped files in the Kettle import summary by @mattcasters in https://github.com/apache/hop/pull/8692
• Issue #4940 : Add Ctrl+Z and Ctrl+Y undo and redo in script editors by @mattcasters in https://github.com/apache/hop/pull/8695
• Issue #5275 : Add an Open button to dialogs that reference a pipeline or workflow by @mattcasters in https://github.com/apache/hop/pull/8697
• Issue #2286 : Add a GUI annotation for data grids by @mattcasters in https://github.com/apache/hop/pull/8652
• Issue #4106 : Map imported KafkaConsumerInput steps to KafkaConsumer by @mattcasters in https://github.com/apache/hop/pull/8686
• Issue #3131 : Expose the submitted Flink job id on the pipeline engine by @mattcasters in https://github.com/apache/hop/pull/8679
• Fixes #8629 : Let pgvector search skip filters whose stream value is … by @bamaer in https://github.com/apache/hop/pull/8630
• Make the explorer perspective git buttons work again #8669 by @bamaer in https://github.com/apache/hop/pull/8672
• Issue #5370 : Pre-fill new data set name, folder, and file by @mattcasters in https://github.com/apache/hop/pull/8698
• Issue #4373 : Keep JSON null distinct from an empty string by @mattcasters in https://github.com/apache/hop/pull/8691
• Issue #4010 : Refuse target-stream hops and splits onto multiple copies by @mattcasters in https://github.com/apache/hop/pull/8685
• Issue #4881 : Add environment configuration files from a folder and wildcard by @mattcasters in https://github.com/apache/hop/pull/8694
• Issue #5371 : Add bulk remove and bypass for a transform selection by @mattcasters in https://github.com/apache/hop/pull/8699
• Issue #5193 : Accept sequence start, end, and increment from one info row by @mattcasters in https://github.com/apache/hop/pull/8696
• Fixes #6205 : Update perspectives docs for the merged File Explorer p… by @bamaer in https://github.com/apache/hop/pull/8714
• Fixes #8659 : Choose the PGP signing key per row by @bamaer in https://github.com/apache/hop/pull/8661
• Fixes #8124 : Populate the info fields of pipelines and workflows by @bamaer in https://github.com/apache/hop/pull/8631
• Fixes #5687 : Generate the configuration perspective option tables fr… by @bamaer in https://github.com/apache/hop/pull/8706
• Issue #2406 : Flush text file output every few seconds by default by @mattcasters in https://github.com/apache/hop/pull/8674
• issue #8662 - Exception when switching projects by @mattcasters in https://github.com/apache/hop/pull/8666
• Issue #8663 : Read a git repository through a named VFS connection by @mattcasters in https://github.com/apache/hop/pull/8680
• Issue #3864 : Select logical types on Parquet output fields by @mattcasters in https://github.com/apache/hop/pull/8684
• Bump com.fasterxml.jackson.core:jackson-core from 2.21.5 to 2.21.7 in /lib by @dependabot[bot] in https://github.com/apache/hop/pull/8721
• Bump com.fasterxml.jackson.core:jackson-databind from 2.21.5 to 2.21.7 in /lib by @dependabot[bot] in https://github.com/apache/hop/pull/8720
• Issue #4303 : Add a Do not right-pad fields option to Text File Output by @mattcasters in https://github.com/apache/hop/pull/8690
• Issue #4858 : Output stored procedure result rows from Call DB Procedure by @mattcasters in https://github.com/apache/hop/pull/8693
• Issue #6146 : Search all configured projects from the project menu by @mattcasters in https://github.com/apache/hop/pull/8702
• Issue #8599 : Revert the rewrite of project home folder to ${PROJECT_HOME} when using browse in ProjectDialog by @williamWEWEevan in https://github.com/apache/hop/pull/8664
• Fixes #8731 : Fix hop lint version, quiet, severity and stdout output… by @bamaer in https://github.com/apache/hop/pull/8739
• Fixes #8734 : Save only the changed rule from the Lint Rules Manager … by @bamaer in https://github.com/apache/hop/pull/8738
• Fixes #8732 : Lint in the project context: -j and -e for hop lint, an… by @bamaer in https://github.com/apache/hop/pull/8742
• Issue #2582 : Mask field values with reusable masking patterns by @mattcasters in https://github.com/apache/hop/pull/8748
• Issue #8752 : Clear the Hop namespace when no project is active by @mattcasters in https://github.com/apache/hop/pull/8753
• Issue #8755 : Fix the integration test failures from build 2331 by @mattcasters in https://github.com/apache/hop/pull/8759
• Fixes #8704 : Error and execution lineage with Neo4j logging and exec… by @bamaer in https://github.com/apache/hop/pull/8718
• Fixes #8736 : Keep the Problems tab on detach, list whole-file remark… by @bamaer in https://github.com/apache/hop/pull/8741
• Allow a custom paragraph separator for the Text Chunker transform by @bamaer in https://github.com/apache/hop/pull/8744
• Align auto layout positions with the canvas grid. fixes #7569 by @bamaer in https://github.com/apache/hop/pull/8747
• Fix REST client behavior with disabled input hop by @gvdutra in https://github.com/apache/hop/pull/8749
• #8726: Fix incorrect check validation logic in ClosureGenerator and ActionEvalTableContent by @samuelwillyanto1 in https://github.com/apache/hop/pull/8727
• Fix doc icons and keyboard shortcuts by @nadment in https://github.com/apache/hop/pull/8763
• Issue #8768 : Stop the Arrow Flight server from mutating the shared data stream by @mattcasters in https://github.com/apache/hop/pull/8769
• Issue #8671 : Read and write Windows shares through an SMB VFS connection by @mattcasters in https://github.com/apache/hop/pull/8717
• Fixes #2929 : Stream Enhanced JSON Output to the file by @bamaer in https://github.com/apache/hop/pull/8713
• Issue #8722 : Docker options to install marketplace plugins by @mattcasters in https://github.com/apache/hop/pull/8723
• Bump net.snowflake:snowflake-jdbc from 4.3.0 to 4.3.4 in /lib-jdbc by @dependabot[bot] in https://github.com/apache/hop/pull/8772
• Bump org.jsoup:jsoup from 1.23.1 to 1.23.2 in /lib by @dependabot[bot] in https://github.com/apache/hop/pull/8771
• Issue #8755 : Keep extension points registered after the Hop environment is reset by @mattcasters in https://github.com/apache/hop/pull/8773
• Translations update from Weblate by @hop-weblate in https://github.com/apache/hop/pull/8776
• fix matching for transforms, fixes #8756 by @hansva in https://github.com/apache/hop/pull/8765
• Issue #8755 : Let the mail tests call James WebAdmin without a password by @mattcasters in https://github.com/apache/hop/pull/8789
• Issue #8758 : Do not mark loaded run configurations as changed by @mattcasters in https://github.com/apache/hop/pull/8762
• issue #8655 - dialogs of db join and write to logs by @mattcasters in https://github.com/apache/hop/pull/8665
• AI Assistant hardening #8757 by @bamaer in https://github.com/apache/hop/pull/8784
• Bump at.yawk.lz4:lz4-java from 1.11.2 to 1.11.4 in /lib by @dependabot[bot] in https://github.com/apache/hop/pull/8806
• Add a “Revisions” tab, which lists all revisions of a workflow or pipeline #8754 by @nadment in https://github.com/apache/hop/pull/8761
• Fixes #8733 : Recognise Hop Gui's default names, fix SQL-002, add IS_… by @bamaer in https://github.com/apache/hop/pull/8743
• Issue #8708 : Add Beam MQTT, Debezium, Elasticsearch, Splunk and Snowflake IO by @mattcasters in https://github.com/apache/hop/pull/8716
• Fix ZIP entry size variable metadata by @gvdutra in https://github.com/apache/hop/pull/8796
• Issue #8701 : Run a Join once when parallel branches reach it at the same time by @Givo29 in https://github.com/apache/hop/pull/8797
• Issue #5524 : Read Iceberg tables with Lake table input on the local engine by @kotwal-itpro in https://github.com/apache/hop/pull/8802
• Issue #8760 : Release the mouse capture before opening the context dialog on right click by @nadment in https://github.com/apache/hop/pull/8818
• About dialog is slow to open on Windows #8816 by @nadment in https://github.com/apache/hop/pull/8817
• fix(metainject): decode lazy binary-string values when injecting list items by @rmannibucau in https://github.com/apache/hop/pull/8813
• Issue #8808 : Do not hold the pipeline engine lock while saving execu… by @bamaer in https://github.com/apache/hop/pull/8810
• Issue #8800 : Do not copy files while Copy files is still walking the… by @bamaer in https://github.com/apache/hop/pull/8809
• Create the parent folder of the target file in Change file encoding, fixes #8779 by @bamaer in https://github.com/apache/hop/pull/8781
• Fix timestamp-to-date conversion by @gvdutra in https://github.com/apache/hop/pull/7820
• Add samples for all transforms to the samples project, fixes #2237 by @bamaer in https://github.com/apache/hop/pull/8786
• fix(tableinput): don't bind incoming rows when the SQL has no placeholders by @rmannibucau in https://github.com/apache/hop/pull/8787
• Fixes #8730 : Keep the values of password fields out of lint findings by @bamaer in https://github.com/apache/hop/pull/8737
• Fixes #2547 : Add a sample env file and document cloud storage creden… by @bamaer in https://github.com/apache/hop/pull/8746
• Issue #8785 : Document parallel reading on Table Input by @mattcasters in https://github.com/apache/hop/pull/8801
• Issue #8803 : Document high-volume insert-heavy SCD2 loads by @mattcasters in https://github.com/apache/hop/pull/8807
• Add Watch Files source with persistent state and optional runtime by @michaaels in https://github.com/apache/hop/pull/8788
• Issue #4189 : SQL File Output, option to skip INSERT statements and select fields by @jbs-atolcd in https://github.com/apache/hop/pull/8782
• Issue #8653 : Indent selected lines in multi-line text fields by @mattcasters in https://github.com/apache/hop/pull/8799
• Issue #8755 : Keep the PostgreSQL driver off the shared classpath by @mattcasters in https://github.com/apache/hop/pull/8828
• Fixes #3032 : Pluggable graph database connections for Bolt, FalkorDB… by @bamaer in https://github.com/apache/hop/pull/8811
• Feat #8767 : CreditCardValidator: Add support for custom BIN validation via CSV file by @figonugroho in https://github.com/apache/hop/pull/8783
• Issue #8791 : Harden the Mask fields database mapping store by @bamaer in https://github.com/apache/hop/pull/8793
• Issue #8777: Fix false positive result on error and populate schema in Action Truncate tables by @samuelwillyanto1 in https://github.com/apache/hop/pull/8778
• Fixes #8735 : Sort lint results, default the Ignore dialog to the rep… by @bamaer in https://github.com/apache/hop/pull/8745
• Issue #8820 : Delete several executions and schedule removal of old execution information by @mattcasters in https://github.com/apache/hop/pull/8827
• Fixes #8750 : Embed text: skip whitespace-only text instead of failin… by @bamaer in https://github.com/apache/hop/pull/8831
• Fixes #8751 : Text chunker: don't emit whitespace-only chunks by @bamaer in https://github.com/apache/hop/pull/8832
• Issue #8711 : Correct JSON Input and Enhanced JSON Output by @mattcasters in https://github.com/apache/hop/pull/8715
• Fixes #8826 : Add a Run Linter workflow action by @bamaer in https://github.com/apache/hop/pull/8829
• GCS, add watchdog to monitor hanging transfer, fixes #8821 by @hansva in https://github.com/apache/hop/pull/8822
• Issue #8794 : Write Iceberg PATH tables at their path on the Spark engine by @kotwal-itpro in https://github.com/apache/hop/pull/8795
• Issue #5524 : Write Iceberg tables with Lake table output on the local engine by @kotwal-itpro in https://github.com/apache/hop/pull/8819
• Issue #8833 : Add a markdown editing toolbar by @mattcasters in https://github.com/apache/hop/pull/8834
• Fixes #8815 : Lint: resolve every field offered for connection, trans… by @bamaer in https://github.com/apache/hop/pull/8825
• Issue #8592 : Read and write cube files in parallel by @mattcasters in https://github.com/apache/hop/pull/8830
• Issue #8755 : Allow FalkorDB vector scores within 1e-3 of the exact similarity by @mattcasters in https://github.com/apache/hop/pull/8837
• Fixes #8814 : Lint: let rules carry tags, and write them to SARIF and… by @bamaer in https://github.com/apache/hop/pull/8824
• samples for all actions, stubs for actions that need infrastructure i… by @bamaer in https://github.com/apache/hop/pull/8790
• fix azure blob storage read position tracking, fixes #8838 by @hansva in https://github.com/apache/hop/pull/8839
• Remove duplicate fileSets from plugin assembly descriptors by @mattcasters in https://github.com/apache/hop/pull/8848
• GCS: support % in file name cleanup error message, fixes #8844 by @hansva in https://github.com/apache/hop/pull/8845
• Issue #8728 : Report VFS explorer driver failures and stop the status line by @mattcasters in https://github.com/apache/hop/pull/8842
• Add Retry Mechanism for Failed Pipeline Executor Executions by @beatum in https://github.com/apache/hop/pull/8544
• Fixes #8835 : Add a Thinking option to the AI provider to switch reas… by @bamaer in https://github.com/apache/hop/pull/8840
• minor s3 issues in file/folder names, fixes #8841 by @hansva in https://github.com/apache/hop/pull/8843
• Fixes #8670: Fix execution details and parent links in execution information by @mattcasters in https://github.com/apache/hop/pull/8850
• Issue #8755 : Fix the integration test failures from build 2337 by @mattcasters in https://github.com/apache/hop/pull/8854
• Issue #8755 : Keep the PostgreSQL driver out of the Beam plugin lib by @mattcasters in https://github.com/apache/hop/pull/8864
• Fixes #8855 : Scroll the File Explorer tree while dragging a file near its edges by @nadment in https://github.com/apache/hop/pull/8856
• Issue #8629 : Document max tokens and context size in AI Provider pre… by @bamaer in https://github.com/apache/hop/pull/8853
• Fixes #8591 : Lint: correct the TRANS-002 description, check nested s… by @bamaer in https://github.com/apache/hop/pull/8852
• Fixes #8857 : Add GraphRAG samples, integration tests and how-to by @bamaer in https://github.com/apache/hop/pull/8858
• Issue #8861 : TableView no longer opens the multi-line context editor for COLUMN_TYPE_TEXT_BUTTON by @nadment in https://github.com/apache/hop/pull/8862
• Fixes #8836 : Graph index and Graph constraint: resolve variables in … by @bamaer in https://github.com/apache/hop/pull/8849
• Fixes #8860 : AI Assistant hardening: unlinked sessions, window handl… by @bamaer in https://github.com/apache/hop/pull/8870
• Issue #8880 : Skip GraphRAG samples in the samples integration test by @mattcasters in https://github.com/apache/hop/pull/8881
• Fixes #8874 : Reselect the execution results tab by title on detach a… by @bamaer in https://github.com/apache/hop/pull/8879
• Fix#8866 Evaluate files metrics workflow Check validating wrong property and skipping rows by @leehaut in https://github.com/apache/hop/pull/8867
• Issue #8882 : Restore the 1 ms rowset back-off in BaseTransform on JD… by @hansva in https://github.com/apache/hop/pull/8883
• formula optimization by @rmannibucau in https://github.com/apache/hop/pull/8304
• Issue #5524 : Document the lake table transforms on the Hop engine by @kotwal-itpro in https://github.com/apache/hop/pull/8859
• Issue #8724 : Keep the input value of a replaced field the JavaScript… by @bamaer in https://github.com/apache/hop/pull/8823
• Issue #8873 : VFS File Explorer: hardening and release gaps by @bamaer in https://github.com/apache/hop/pull/8876
• Fixes #8871 : Lint rule editor and Rules Manager: clause validation, … by @bamaer in https://github.com/apache/hop/pull/8877
• issue #8756: add helper showing the match by @hansva in https://github.com/apache/hop/pull/8884
• harden CI build edge cases, fixes #8890 by @hansva in https://github.com/apache/hop/pull/8892
• allow // as valid path for SFTP targets, fixes #7930 by @hansva in https://github.com/apache/hop/pull/8886
• Issue #8885 : Pin cross-manual xrefs and check them in the docs PR build by @bamaer in https://github.com/apache/hop/pull/8891
• Fix missing transform icons in the docs: CrateDB Bulk Loader, XML output (Advanced), Mask fields. #8893 by @Adalennis in https://github.com/apache/hop/pull/8894
• Translations update from Weblate by @hop-weblate in https://github.com/apache/hop/pull/8899
• Fixes #8872 : Remove the lint results listener when Show Lint Results… by @bamaer in https://github.com/apache/hop/pull/8878
• Fix typos in the user manual and remove a unit test log message Hop no longer writes. #8902 by @Adalennis in https://github.com/apache/hop/pull/8903
• Issue #8888 : Authorize Hop Web server calls on the mapped path by @mattcasters in https://github.com/apache/hop/pull/8889
• [CI] Fix the Hop Web selenium failures in the transform dialog sweep by @hansva in https://github.com/apache/hop/pull/8900
• Add missing pages to the docs navigation, fix the Snowflake ID and Avro pages, remove the obsolete FAQ and duplicate Hop Search pages. #8895 by @Adalennis in https://github.com/apache/hop/pull/8898
• Update the Hop Gui overview in Getting Started to the current window layout. #7948 by @Adalennis in https://github.com/apache/hop/pull/8912
• Fix Create folder validation to check folderName and reject a blank name by @leehaut in https://github.com/apache/hop/pull/8908
• Issue 8774: Clear Lint results after switching projects by @bamaer in https://github.com/apache/hop/pull/8896
• Document how to build and preview the manuals locally. #2605 by @Adalennis in https://github.com/apache/hop/pull/8905
• Bug #8897 : CONST_IS_NOT_NULL defined as IS NULL produces invalid SQL by @figonugroho in https://github.com/apache/hop/pull/8906
• Fix #8360: read-only grid selects the row on click and keeps its context menu by @fskorgen in https://github.com/apache/hop/pull/8530
• Issue #8909 : Ship the lakehouse metadata jar with the Spark engine by @mattcasters in https://github.com/apache/hop/pull/8910
• Issue #8863 : Write the parent execution link when a child starts by @mattcasters in https://github.com/apache/hop/pull/8865
• [CI ]Fix the Hop Web smoke test reading a hidden tab's graph by @hansva in https://github.com/apache/hop/pull/8920
• Add pages for the Git and Git commit perspectives and bring the git pages up to date with the current Hop Gui. #7120 by @Adalennis in https://github.com/apache/hop/pull/8919
• Issue #8804 : Stop context action filters from logging a null GUI plugin by @mattcasters in https://github.com/apache/hop/pull/8805
• Issue #8923 : Run MongoDB without AVX and keep JCraft JSch off the classpath by @mattcasters in https://github.com/apache/hop/pull/8924
• Issue #8907 : Add an OpenFormula transform for Kettle/PDI formulas by @mattcasters in https://github.com/apache/hop/pull/8913
• fix performance regression in combination lookup/update , fixes #8922 by @hansva in https://github.com/apache/hop/pull/8925
• Issue #8904: Fix false positive result on error in Action Columns Exist by @samuelwillyanto1 in https://github.com/apache/hop/pull/8911
• Fix Delete files Check treating the file path as a bean property name by @leehaut in https://github.com/apache/hop/pull/8933
• Translations update from Weblate by @hop-weblate in https://github.com/apache/hop/pull/8932
• Issue #8667 : Cancel Table Input and Database Join queries when a pipeline stops by @mattcasters in https://github.com/apache/hop/pull/8846
• Fix Check for Delete and Copy/Move result filenames by @leehaut in https://github.com/apache/hop/pull/8939
• Issue #8942 : Don't mark generated SQL as changed by @mattcasters in https://github.com/apache/hop/pull/8944
• Add the missing page descriptions to the user and developer manuals. #2606 by @Adalennis in https://github.com/apache/hop/pull/8949
• Issue #8936 : Fix attribute element types, DOCTYPE, XSLT includes and… by @bamaer in https://github.com/apache/hop/pull/8947
• Fail the docs PR build when a page has no description. #2606 by @Adalennis in https://github.com/apache/hop/pull/8957
• Fix DTD validator Check treating file paths as bean property names by @leehaut in https://github.com/apache/hop/pull/8954
• Add the supported engines section to the transform pages that had none, and drop Beam Direct. #8958 by @Adalennis in https://github.com/apache/hop/pull/8961
• Fix typos in the user and developer manuals. #8964 by @Adalennis in https://github.com/apache/hop/pull/8967
• data format mask is not inherited correctly, fixes #8956 by @hansva in https://github.com/apache/hop/pull/8959
• fix empty field/null value regressions, fixes #8960 by @hansva in https://github.com/apache/hop/pull/8962
• performance improvements, fixes #8965 by @hansva in https://github.com/apache/hop/pull/8968
• add support for parallel read in text file input, fixes #8943 by @hansva in https://github.com/apache/hop/pull/8948
• Document the results of workflow actions and how they are passed on. #2591 by @Adalennis in https://github.com/apache/hop/pull/8969
• Issue #8952 : Fix the mail, lineage, OpenSearch, and samples integration failures by @mattcasters in https://github.com/apache/hop/pull/8953
• Issue #8941 : Filter TableView rows when browsing data by @mattcasters in https://github.com/apache/hop/pull/8983
• Add Beam Hive Catalog Input to the navigation and replace the hand-maintained list on the transforms page. #8977 by @Adalennis in https://github.com/apache/hop/pull/8978
• Turn the plugin page template into a template that matches the transform and action pages. #8979 by @Adalennis in https://github.com/apache/hop/pull/8980
• Fix the bug of buttons that point to invalid plugin documentation URLs by @mohitjoshi-hey in https://github.com/apache/hop/pull/8982
• Issue #8986 : Fix the connection toolbar on a Neo4j execution location by @mattcasters in https://github.com/apache/hop/pull/8987
• Document the result of the Pipeline, Workflow, Copy files, Mail, Simple evaluation and SFTP actions. #8970 by @Adalennis in https://github.com/apache/hop/pull/9000
• Issue #8998 : Keep a single version of each library in the client assembly by @mattcasters in https://github.com/apache/hop/pull/8999
• Issue #8995 : Upgrade UCanAccess to 5.2.0 in the Access database plugin by @spannm in https://github.com/apache/hop/pull/8996
• Add a Working with parameters page and link it from the related pages fixes. #2517 by @Adalennis in https://github.com/apache/hop/pull/9002
• Reorganize the hop-conf page, fixes #4335 by @Adalennis in https://github.com/apache/hop/pull/9006
• Fill empty and copied page descriptions, move the Salesforce fragments to snippets, fail the description check on empty descriptions. #8976 by @Adalennis in https://github.com/apache/hop/pull/8991
• Issue #8955: Zip File transform and Zip file action fail to update an existing zip on a VFS file system by @bamaer in https://github.com/apache/hop/pull/8971
• Issue #8988 : Document running native Spark pipelines on a local Spar… by @bamaer in https://github.com/apache/hop/pull/8989
• Fixes #8993 : Run CALL { } IN TRANSACTIONS in auto-commit on Neo4j by @bamaer in https://github.com/apache/hop/pull/8994
• Translations update from Weblate by @hop-weblate in https://github.com/apache/hop/pull/9014
• Issue #8495 : Optionally resolve OS environment variables as Hop variables by @vbhanuchander-lang in https://github.com/apache/hop/pull/8638
• Issue #8657 : Force refresh the Problems tab after clearing the database cache by @mattcasters in https://github.com/apache/hop/pull/8940
• correctly release the namespace when switching projects, fixes #8972 by @hansva in https://github.com/apache/hop/pull/8973
• Issue #9001 : Fail the Mail action when the Mail server connection does not exist by @SAY-5 in https://github.com/apache/hop/pull/9009
• Issue #8937 : Merging a tag with conflicts no longer shows an error dialog or fails on an annotated tag by @SAY-5 in https://github.com/apache/hop/pull/9010
• Fix#9012 Wait for SQL verification reading the missing property WaitForSQL by @leehaut in https://github.com/apache/hop/pull/9013
• Fix image notepad rendering issue #8869 by @williamWEWEevan in https://github.com/apache/hop/pull/8945
• Translations update from Weblate by @hop-weblate in https://github.com/apache/hop/pull/9018
• fix folder check button, fixes #8252 by @hansva in https://github.com/apache/hop/pull/9015
• Dependency upgrades and minor fixes, fixes #8966 by @hansva in https://github.com/apache/hop/pull/8997
• Issue #9022 : Show the sampler options in the Execution Data Profile editor by @mattcasters in https://github.com/apache/hop/pull/9023
• Explain how to save the log of the command line tools to a file, and link to the SLF4J and Log4j2 setup. #2651 by @Adalennis in https://github.com/apache/hop/pull/9026
• Issue #8907 : Replace the OpenFormula tests with spec cases by @mattcasters in https://github.com/apache/hop/pull/8927
• Fix#9019 the child pipeline load error so the log names the file by @leehaut in https://github.com/apache/hop/pull/9027
• Define the regular expressions that select files in Text file input, and fix the examples. #2366 by @Adalennis in https://github.com/apache/hop/pull/9028
• Document the result of the File exists, Create file, Delete files, Shell, Move files and Zip file actions. #8970 by @Adalennis in https://github.com/apache/hop/pull/9024
• Fix#8985 Delete folders workflow check results by @leehaut in https://github.com/apache/hop/pull/8984
• Issue #9016 : Run native Spark pipelines on YARN from Hop GUI, hop-ru… by @bamaer in https://github.com/apache/hop/pull/9021
• Fixes #8887 : Git integration no longer runs whole-repository git sta… by @bamaer in https://github.com/apache/hop/pull/8990
• List the commonly used methods of the transform variable in the Script transform, and fix pipeline_status and the bindings. #4790 by @Adalennis in https://github.com/apache/hop/pull/9029
• Document all the File Explorer right-click options and update the toolbar screenshots. #9011 by @Adalennis in https://github.com/apache/hop/pull/9031
• Explain how the YAML Input transform forms rows, the JsonPath paths and every option. #2367 by @Adalennis in https://github.com/apache/hop/pull/9040
• Fix outdated hop-conf options and variable details in the variables, Azure VFS and Set Variables pages, fixes #9008 by @Adalennis in https://github.com/apache/hop/pull/9025
• Issue #9039 : Read Neo4j execution dates stored by graph logging by @mattcasters in https://github.com/apache/hop/pull/9044
• Update the Git info and visual diff screenshots of the File Explorer page. #9011 by @Adalennis in https://github.com/apache/hop/pull/9046
• Translations update from Weblate by @hop-weblate in https://github.com/apache/hop/pull/9053
• #9037 Calculator: restore -1 default for value_length/value_precision on legacy loads by @rmannibucau in https://github.com/apache/hop/pull/9038
• Expose the pipeline hop graph on lineage events, fixes #9004 by @bamaer in https://github.com/apache/hop/pull/9042
• add missing translation files, fixes #9066 by @hansva in https://github.com/apache/hop/pull/9067
• [RELEASSE] update licenses by @hansva in https://github.com/apache/hop/pull/9068
• Fix#9032 Text File Output writing a byte order mark on every UTF-16 fragment by @leehaut in https://github.com/apache/hop/pull/9054
• Issue #9050 : Keep database SQL editors in the database perspective by @mattcasters in https://github.com/apache/hop/pull/9051
• Document the result of the Delete file, Create folder, Delete folders, Add filenames to result, Delete filenames from result and Unzip actions. #8970 by @Adalennis in https://github.com/apache/hop/pull/9047
• Lint: check the staged files in the pre-commit hook, resolve relative… by @bamaer in https://github.com/apache/hop/pull/9076
• Issue #9079 : Update graph database client libraries, test images and… by @bamaer in https://github.com/apache/hop/pull/9080
• Fix#9083 workflow action check() to read the real bean properties by @leehaut in https://github.com/apache/hop/pull/9085
• show menu images on MacOS 27, fixes #9074 by @hansva in https://github.com/apache/hop/pull/9075
• Add timeout option for ssh commands, fixes #9072 by @hansva in https://github.com/apache/hop/pull/9073
• Escape variable references in the docs that Asciidoctor reads as attributes #9069 by @AnKiT-GaRG2 in https://github.com/apache/hop/pull/9087
• Fix#9041 YAML input list-of-maps reading and null-path failures by @leehaut in https://github.com/apache/hop/pull/9082
• Issue #9091 : Add a Start action to workflows created from the file explorer by @mattcasters in https://github.com/apache/hop/pull/9092
• Issue #9089 : Add local run configurations to new Hop setups by @mattcasters in https://github.com/apache/hop/pull/9090
• Make the Monaco download URL configurable, document building behind a… by @bamaer in https://github.com/apache/hop/pull/9094
• Document the File Explorer file types and text editor features #9070 by @AnKiT-GaRG2 in https://github.com/apache/hop/pull/9088
• Fixes #9084 : Imported PDI step types get the Hop transform id case, … by @bamaer in https://github.com/apache/hop/pull/9086
• SFTP slashes for z/Os, improved error messages #9033 by @bamaer in https://github.com/apache/hop/pull/9043
• Run PipelineCompleted before releasing waitUntilFinished(), fixes #9005 by @bamaer in https://github.com/apache/hop/pull/9035
• Issue #8946 : Write local Spark files on Windows without winutils by @mattcasters in https://github.com/apache/hop/pull/8951
• Fix:stale parameter handling in the Pipeline Executor when retries are enabled and variables are inherited from parent scopes by @beatum in https://github.com/apache/hop/pull/9059
• Allow MetaInject to run when all input streams are empty by @rmannibucau in https://github.com/apache/hop/pull/9078
• Issue #9049 : Fix the result of Add filenames to result, Unzip, Delete file, Create folder and Delete filenames from result by @vbhanuchander-lang in https://github.com/apache/hop/pull/9101
• Brazilian portuguese translation by @jefersonminatozaki in https://github.com/apache/hop/pull/9103

New Contributors

• @nprimaux made their first contribution in #7954
• @kotwal-itpro made their first contribution in #7993
• @budaykiran94 made their first contribution in #8025
• @zanarellidev made their first contribution in #8027
• @waterWang made their first contribution in #8110
• @abhiramaab made their first contribution in #8344
• @beatum made their first contribution in https://github.com/apache/hop/pull/8339
• @williamWEWEevan made their first contribution in https://github.com/apache/hop/pull/8664
• @samuelwillyanto1 made their first contribution in https://github.com/apache/hop/pull/8727
• @figonugroho made their first contribution in https://github.com/apache/hop/pull/8783
• @mohitjoshi-hey made their first contribution in https://github.com/apache/hop/pull/8982
• @spannm made their first contribution in https://github.com/apache/hop/pull/8996
• @SAY-5 made their first contribution in https://github.com/apache/hop/pull/9009
• @AnKiT-GaRG2 made their first contribution in https://github.com/apache/hop/pull/9087

Full Changelog: 2.19.0-rc1...2.20.0-rc1