jppf-grid/JPPF v_6_0

JPPF 6.0 Generally Available

on GitHub

JPPF makes it easy to parallelize computationally intensive tasks and execute them on a Grid

JPPF 6.0 new features and enhancements summary

Major new features:

• Web administration console

  • same functionality as the desktop console, except for the topology graph and the charts
  • role-based authentication and authorization
  • tested on major web servers: Tomcat, Jetty, JBoss, Open Liberty, Weblogic, Glassfish

• Database Services

  • easily create JDBC datasource definitions and propagate them throughout the grid
  • reuse datasource definitions accross job submissions

• Jobs Persistence

  • automatic job recovery in case of grid crashes
  • "submit and forget" jobs, then check their completion state and retrieve their results from a separate client later on
  • retrieve jobs on demand from a persistent store and resubmit them to completion if needed
  • pluggable persistence mechanism
  • built-in implementations: database persistence, file-based persistence, asynchronous (write-behind) wrapper and caching wrapper

• NIO-based JMX remote connector

  • a fast, scalable, NIO-based JMX remote connector that uses less system resources
  • can be used as a standalone connector
  • perfectly integrated with JPPF (no additional port required in the JPPF server)

• Pluggable monitoring data providers

  • plugins for any source of data for JVM/Process/SYstem health monitoring
  • provided data is automatically and immediately available in the desktop and web administration consoles
  • out-of-the-box health monitoring data is implemnted as a built-in monitoring data provider

• Persistence and reuse of load-balancers states

  • the state of the adaptive load-balancers can now be persisted, allowing the reuse of optimal parameters without the long convergence phase
  • state persistence is available to client-side and server-side load-balancing
  • pluggable persistence mechanism
  • built-in implementations: database persistence, file-based persistence and asynchronous (write-behind) wrapper

• Server configuration now requires a single port for everything, including management and heartbeating

Major enhancements:

• Complex expressions as arguments of execution policies

  • all arguments of execution policies can include scipts and properties substitutions
  • comparisons are no longer limited to available properties and their value, complex expressions can be used instead

• Revamping of the heartbeat mechanism for connection failure detection

  • heartbeat mechanism is now available for client-to-server and server-to-server connections
  • configuration simplification: heartbeat only needs to be enabled on the remote peers

Desktop administration console enhancements

• pick lists are now used in the desktop console to select the visible columns of all tree views
• added a "select all nodes" button in the topology views and a "select all jobs" buttons in the jobs view
• load-balancing settings tab was moved to a popup dialog in the topology views
• master/slave nodes relationships are now visible in the graph view of the topology

Multi-server topologies improvements

• Full-fledged NIO implementation

  • single I/O thread as per the non-blocking NIO model
  • common thread pool is now used for data processing, improving scalability and decreasing system resources usage

• Server to server connection pooling

  • scalability is greatly increased, as servers can offload a lot more of their worload to other servers
  • applies to all peer servers discovery mechanisms

• Load-balancing vs. failover threshold

  • server-to-server connectivity can now specify a maximum number of nodes for load-balancing to occur
  • addresses the use case where other servers are used for failover only

Configuration API improvements

• localization support for the documentation of properties
• parametrized configuration properties
• deprecation support
• new sample "JPPF properties documentation generator"

Various enhancements

• server statistics snapshots now have a last updated timestamp
• the new MavenCentralLocation class allows downloading artifacts from Maven Central
• a new built-in node connection strategy allows configuration with a single configuration property
• port of the J2EE connector to Open Liberty
• the JPPF client code handling the connections state was simplified, resulting in improved robustness and performance
• JPPF tasks can now access the node they execute on
• significant performance improvements, based on numerous profiling sessions and stress tests
• all APIs deprecated in 5.x were removed
• wherever applicable, setter and modifier methods were refactored to enable method call chaining, allowing a more fluent code style
• use ScriptDefinition objects wherever JSR 223 compliant scripts are used
• improvements to the handling of jobs classpath

JPPF Links:  Web Site - Downloads - Documentation - User forums - Issue tracker