This is an ALPHA pre-release based on 351cb13.
Pull requests and commits included in this pre-release has not been reviewed, merged, nor tested well yet. This is published just to show how v0.11.0 would impact existing plugins earlier -- we expect most of the existing plugins would stop working. Yes, that is expected.
Users:
See https://www.embulk.org/articles/2021/04/27/changes-in-v0.11.html for v0.11.
(Japanese: https://zenn.dev/dmikurube/articles/what-changes-in-embulk-v0-11)
Plugin developers:
To catch up with the expected v0.11.0, please follow the article below. The plugin should keep working with v0.9.23 even after catching up in this way.
See: https://dev.embulk.org/topics/get-ready-for-v0.11-and-v1.0.html
(Japanese: https://zenn.dev/dmikurube/articles/get-ready-for-embulk-v0-11-and-v1-0)
So far, we have confirmed that embulk-input-s3:0.5.2 (that has already caught-up) works with an appropriate setup.
$ ./embulk-0.11.0-ALPHA.1.jar run s3.yml
2021-04-23 18:13:23.024 +0900 [INFO] (main): embulk_home is set by the location of embulk.properties found in: /home/user/.embulk
2021-04-23 18:13:23.316 +0900 [INFO] (main): Started Embulk v0.11.0-ALPHA.1
2021-04-23 18:13:25.423 +0900 [INFO] (0001:transaction): Gem's home and path are set by system configs "gem_home": "/home/user/.embulk/lib/gems", "gem_path": ""
2021-04-23 18:13:26.113 +0900 [INFO] (0001:transaction): Loaded plugin embulk-input-s3 (0.5.2)
2021-04-23 18:13:26.595 +0900 [INFO] (0001:transaction): Start listing file with prefix [...]
2021-04-23 18:13:27.563 +0900 [INFO] (0001:transaction): Found total [1] files
2021-04-23 18:13:27.734 +0900 [INFO] (0001:transaction): Using local thread executor with max_threads=16 / output tasks 8 = input tasks 1 * 8
2021-04-23 18:13:27.822 +0900 [INFO] (0001:transaction): {done: 0 / 1, running: 0}
2021-04-23 18:13:28.888 +0900 [INFO] (0015:task-0000): Open S3Object with bucket [***], key [...], with size [...]
23,Ida
23,Ida
23,Ida
23,Ida
2021-04-23 18:13:28.897 +0900 [INFO] (0001:transaction): {done: 1 / 1, running: 0}
2021-04-23 18:13:28.899 +0900 [INFO] (0001:transaction): Incremental job, setting last_path to [...]
2021-04-23 18:13:28.914 +0900 [INFO] (main): Committed.
2021-04-23 18:13:28.915 +0900 [INFO] (main): Next config diff: {"in":{"last_path":"..."},"out":{}}