github wgzhao/Addax 6.0.0

latest releases: 6.0.4, 6.0.3, 6.0.2...
3 months ago

Addax 6.0.0 has released! 🎉

We are pleased to announce version 6.0.0. This update includes significant improvements, most notably the transition from JDK 1.8 to JDK 17. Below is a summary of key changes and enhancements in this release:

Key Highlights

  1. Migration to JDK 17
    • Improved Performance: With JDK 17's performance optimizations, users will experience faster execution and reduced resource consumption.
    • Enhanced Security: JDK 17 introduces stronger security mechanisms, offering additional protection against potential vulnerabilities.
    • Expanded Language Features: Developers can now utilize the latest Java language features such as:
      • Switch Expressions: Simplify switch logic for better code readability.
      • Text Blocks: Streamline the handling of multi-line strings.
      • Records: Create immutable data structures with minimal boilerplate code.
  2. Compatibility Updates
    • Refactored the application codebase to remove deprecated APIs and ensure full compatibility with JDK 17.
    • Updated dependency libraries to their JDK 17-compatible versions.
  3. Optimizations
    • Improved memory management and garbage collection efficiency with JDK 17's G1 GC enhancements.

Upgrade Notes

  1. Java Runtime Environment Requirement:

    • This version requires JDK 17 or newer to run. Users currently running JDK 1.8 will need to upgrade their Java runtime environment before deploying this version.
  2. Breaking Changes:

    • Some deprecated features and APIs from JDK 1.8 may no longer function. Ensure custom integrations or extensions are updated accordingly.
  3. Backward Compatibility:

    • Older versions of the software and configurations may require minor adjustments due to the upgraded platform. Refer to the compatibility guide in our documentation for detailed instructions.

📜 Changes

da81f0f (tag: 6.0.0) [maven-release-plugin] prepare release 6.0.0
f0e5114 (origin/master, origin/HEAD) [refactor][github][action] remove create-release to avoid creating duplicate label
0c6d619 [chore][github][action] Update maven-publish.yml to trigger on version tags and refine upload condition
0982b26 [chore][core] Refactor comments and logging statements for clarity
0b1ee2c [bugfix][plugin][streamwriter] Fixed issue where stdout resource being closed prevented the logger from writing to the console.
13bc07a [chore][docs] change jdk to 17
70b6b1c [chore][docs] Add iceberg logo
7ac68c2 [chore][core] Add reserved keyword system
e0c2555 [improve][plugin][s3writer] refine pom to reduce the target size
9749d3d [improve][plugin][s3writer] Rename formatwriter package to writer for consistency
8400e24 [add][writer][s3writer] Add support for orc and parquet storage format (#1275)
cb1964d [chore][plugin][icebergwriter] satisfy code style: Improve code formatting and consistency in IcebergHelper and IcebergWriter classes
67a1f0a [chore][plugin][icebergwriter] Add Apache License header to IcebergHelper and IcebergWriter classes
fbbd0ea [add][plugin][icebergwriter] add write plugin icebergwriter (#1208)
330b2fd [feature][core] Optimize garbage collection settings for JDK 17
17843b5 [chore][doc] Update runtime requirements in README files to specify JDK 17
ea54c93 Optimzie for jdk17 (#1273)
afbf8b8 [feature][plugin][s3reader] Add support for path-style access configuration in S3 client
e4c4bed [feature][docker] Add Docker Build and Push steps to CI workflow
381951d [maven-release-plugin] prepare for next development iteration

Known bugs:

hdfsreader and hdfswriter plugins

if you encounter the following errors:

2025-06-04 13:56:02.341 [       job-0] ERROR Engine               - java.lang.NoClassDefFoundError: org/apache/hadoop/shaded/com/ctc/wstx/io/InputBootstrapper
        at com.wgzhao.addax.plugin.writer.hdfswriter.HdfsHelper.getFileSystem(HdfsHelper.java:68)
        at com.wgzhao.addax.plugin.writer.hdfswriter.HdfsWriter$Job.init(HdfsWriter.java:90)
        at com.wgzhao.addax.core.job.JobContainer.initJobWriter(JobContainer.java:642)
        at com.wgzhao.addax.core.job.JobContainer.init(JobContainer.java:280)
        at com.wgzhao.addax.core.job.JobContainer.start(JobContainer.java:126)
        at com.wgzhao.addax.core.Engine.start(Engine.java:62)
        at com.wgzhao.addax.core.Engine.entry(Engine.java:116)
        at com.wgzhao.addax.core.Engine.main(Engine.java:145)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.shaded.com.ctc.wstx.io.InputBootstrapper
        at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:445)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:592)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
        ... 8 more

you can delete the $ADDAX_HOME/plugin/reader/hdfsreader/libs/hadoop-client-api-3.2.4.jar and $ADDAX_HOME/plugin/writer/hdfswriter/libs/hadoop-client-api-3.2.4.jar

Don't miss a new Addax release

NewReleases is sending notifications on new releases.