localstack/localstack v3.3.0 on GitHub

Summary

LocalStack 3.3 is here with a host of new features and enhancements. This release includes support for running ECS tasks on Kubernetes, improved performance for DynamoDB Streams and Kinesis, and a new experimental web server implementation for high-throughput scenarios.

AWS Features

ECS tasks now can be run when LocalStack is deployed on Kubernetes. To enable this feature, set ECS_TASK_EXECUTOR=kubernetes. Tasks can be added to ELB load balancer target groups. (🌟 enterprise)
Lambda now supports the new Dotnet8 runtime.
Multi-label support is now available for Neptune service. (🌟 pro)
Filters for list operations and parameters for discover operations is now available in ECS service discovery. (🌟 pro)
GraphQL APIs created locally by CloudFormation can now be created with tags. (🌟 pro)
Support for routing of CloudFront aliases to the correct CloudFront distribution is now available. (🌟 pro)
Support for wildcards in CORS config (eg: http://*.example.com ) is now available in the S3 service.
Support for ECS Optimised Service Integration, state size quota limits, MaxItem, MaxItemPath , handling of States.DataLimitExceeded errors, and StepFunctions Activities in the Step Functions service.
Support for using external SAML providers (e.g., Auth0) as an identity pool IdP in the Cognito service. (🌟 pro)

Enhancements

LocalStack now stops and removes underlying EC2 containers while shutting down. You can opt to skip the removal by setting the EC2_REMOVE_CONTAINERS flag. (🌟 pro)
IoT Device Shadow Service now supports DeleteThingShadow API. (🌟 pro)
MWAA Airflow runners now come with Java Corretto pre-installed. (🌟 pro)
ARM-based Lambda functions now feature improved test coverage covering all AWS-supported Lambda runtimes.
Significant performance improvements when DynamoDB Streams or Kinesis destinations are configured for a table (over 15x more throughput for BatchWriteItem API).
Significant performance improvements when sending large INSERT or COPY queries for PostgreSQL database in the RDS service. (🌟 pro)
Default endpoint returned by ECR has been changed to include the Account ID and region for better parity. This can be configured using the new configuration variable ECR_ENDPOINT_STRATEGY . (🌟 pro)
Several enhancements for the Step Functions service, including API Actions validation, Map states, JsonPath extraction, and much more!

LocalStack Features

Support for a new experimental web server implementation that has improved performance for high-throughput scenarios. You can activate it using GATEWAY_SERVER=twisted .
New Resource Browser for the CodeCommit service. (🌟 pro)

Deprecations

Deprecated six Lambda runtimes including :
- python3.7
- nodejs14.x
- ruby2.7
- provided
- go1.x
- java8
LocalStack prints a deprecation warning but you can still use deprecated runtimes

What's Changed

Exciting New Features 🎉

Remove legacy CFn models by @dominikschubert in #10304
fix functhread daemon status and tmp_thread cleanup by @thrau in #10404
add twisted gateway server by @thrau in #9834
implement SQS DLQ redrive to original source queue by @thrau in #10414
remove contrib package by @thrau in #10424
make SQS dynamic endpoint strategy guess the endpoint strategy used by @thrau in #10416
fix SQS DLQ message attributes and redrive into multiple source queues by @thrau in #10425
use rolo twisted gateway integration by @thrau in #10428
Support XML responses in api gateway templating by @shucoshuco in #10381
Feat/firehose add redshift destination by @maxhoheiser in #10375
KMS: Fixup ImportKeyMaterial for non-symmetric keys by @uubk in #10116
Update lambda runtime deprecations and fix Lambda ARM builds by @joe4dev in #10441
Support custom key material when creating KMS keys by @jalaziz in #10379
add resource provider for Iam Server Certificate by @pinzon in #10455
Move version single source outside of __init__.py by @silv-io in #10497

Other Changes

fix typo in FAQ link description, closes #10343 by @AnthonyMazzie in #10344
Fix attributes, create and delete for AWS::Redshift::Cluster by @dominikschubert in #10341
Fix CircleCI workflow tracking by @silv-io in #10346
Update readme for v3.2.0 release by @viren-nadkarni in #10228
fix S3 copy-source format validation by @bentsku in #10338
add support for Array type in resource provider Scaffolding by @pinzon in #10326
Fix UserData regression from provider migration in AWS::EC2::Instance by @dominikschubert in #10355
Added update for "AWS::EC2::Instance" CFn Resource Provider by @Morijarti in #10352
add timestream to the list of composite apis by @giograno in #10361
Update kinesis-mock to 0.4.6 by @etspaceman in #10363
fix workflow execution for PRs coming from forks by @alexrashed in #10366
[SFN] Base Support for ECS Optimised Service Integration by @MEPalma in #10321
Added CFn Resource Provider for AWS::SNS::Subscription and AWS::SNS::TopicPolicy by @Morijarti in #10359
Add remaining migrations that we missed in the initial check by @dominikschubert in #10368
Improve delete reliability for kinesis streams by @dominikschubert in #10371
[SFN] Enhancements for Map State by @MEPalma in #10204
Fix parsing of StepFunction timestamps by @dominikschubert in #9813
add rolo to dev script by @bentsku in #10384
Bump moto-ext to 5.0.2.post2 by @viren-nadkarni in #10389
Disable legacy CFn model execution by @dominikschubert in #10353
Enhance parity for API Gateway deletion of wildcard method settings by @whummer in #10399
refactor s3 storage to use context manager to avoid race condition by @bentsku in #10387
Update CODEOWNERS by @localstack-bot in #10401
Remove unused CFN_RESOURCE_PROVIDER_OVERRIDES option by @dominikschubert in #10402
Adding support for partial wildcards for S3 CORS by @cloutierMat in #10365
add docstring for cw test and assertion by @pinzon in #10394
fix DDB performance when Streams are enabled by @bentsku in #10415
update s3 lambdas to node20 by @bentsku in #10417
fix S3 GLACIER_IR not being an archive type by @bentsku in #10395
[SFN] Reduce Flakiness of Timeout and Heartbeat Tests by @MEPalma in #10427
[SFN] Enhancements to api actions validations: InvalidArn, StateMachineDoesNotExist, ExecutionDoesNotExist by @MEPalma in #10421
fix SNS Publish exception when using empty topic by @bentsku in #10430
Cfn: Fix bug preventing reuse of stack names by @viren-nadkarni in #10403
Support new common string functions in velocity templating by @shucoshuco in #10391
add fix for cfn-response code for nodejs custome resource by @pinzon in #10408
Move to only using pyproject.toml by @silv-io in #10432
Set package data key to localstack by @silv-io in #10444
Fix DynamoDB Table and Global Table Creation with SSESpecification and TTL by @Morijarti in #10433
Update runtime init, add dynamic configuration for folders to run chmod on in Lambda by @dfangl in #10438
Add ARM test selection marker by @joe4dev in #10275
Introduce test selection for CI tests on PRs by @dominikschubert in #10301
fix disk space issues in GitHub workflow again by @alexrashed in #10443
fix test selection for community contributions by @alexrashed in #10459
Add experimental option to distribute services across multiple localstack instances by @dfangl in #10462
Implement basic status filter for StepFunctions list-executions by @matt-mercer in #9833
Fix secretsmanager secret rotation failing because RotateImmediately is unset by @cowlingj in #10091
use ThreadPoolExecutor to forward DDB Streams events by @bentsku in #10463
Adapt dynamodbstreams clients in the provider as well by @dfangl in #10466
scheduled run for non-default credentials by @sannya-singal in #10367
fix: remove AWSPREVIOUS only when duplicated by @vimiomori in #10083
[SFN] Base Support for Activities by @MEPalma in #10383
fix and enable several ruff linting rules by @thrau in #10471
fix lambda event source mapping FilterCriteria by @sannya-singal in #10418
fix: broken pipeline after merging #10418 by @sannya-singal in #10476
optimise config.yml by @sannya-singal in #10470
Update CODEOWNERS by @localstack-bot in #10475
improve ddb TransactWriteItems performance + small refactor by @bentsku in #10464
add opt. service deps, opt-in services to test selection by @alexrashed in #10458
Fixed issue where TEST_DISABLE_RETRIES_AND_TIMEOUTS would get always evaluated to True by @Morijarti in #10480
fix invalidating S3 CORS cache after resetting state or loading by @bentsku in #10469
Fix skip_teardown and force_synth usage in CDK tests by @dominikschubert in #10445
SFN: Allow ProgramError without details by @bblommers in #10400
refactor DDB streaming, event creation and forwarding by @bentsku in #10468
make twisted default HTTP server in S3 image by @bentsku in #10491
fix S3 copy in place in versioned bucket by @bentsku in #10495
fix CircleCI Tinybird reporting on reruns by @alexrashed in #10492
fix: standardise the TEST_AWS_REGION_NAME usage by @sannya-singal in #10478
fix Tinybird workflow datasource for multi-account tests by @alexrashed in #10498
test: aws validated test cases in the rgsa by @macnev2013 in #10496
added support for resource based policies in secretsmanager by @macnev2013 in #10457
fix query string parser with non encoded http url in parameters by @bentsku in #10483
fix capitalization of Authorization header for AWS_PROXY integration by @bentsku in #10500
fix: add transformer to region attribute in failing s3 for 'eu-west-1' by @sannya-singal in #10508
fix payload and logging for CI analytics data by @alexrashed in #10503
Fix Lambda common build caching by @joe4dev in #10510
switch from black to ruff format by @alexrashed in #10509
add limited number of regions to random creds by @sannya-singal in #10515
support for arn based retrivals in secretsmanager by @macnev2013 in #10501
fix release helper by @alexrashed in #10519
fix 'test_import_swagger_api' for 'eu-west-1' by @sannya-singal in #10516
Api gateway integration proxy only accepts post method by @cloutierMat in #10512
add support for getAtt string parameter in dependency by @pinzon in #10514
Add Dotnet 8 Lambda runtime by @yongliu-mdsol in #10300
[SFN] Fix SecondsPath Retrieval and Raise Runtime Errors on Invalid Inputs by @MEPalma in #10521
Bump moto-ext to 5.0.3.post1 by @viren-nadkarni in #10488
Update CODEOWNERS by @localstack-bot in #10525
fix ASF update action to fix unused imports by @alexrashed in #10527
Adding missing parameter for authorization scopes by @giograno in #10524
Reduce the range of dependencies to speed up pinning by @silv-io in #10530
Fix parameter validation for self-managed Kafka event source mapping by @janario in #9007
fix test_different_location_constraint for us-east-2 by @sannya-singal in #10534
fix apigw tests for eu-west-1 by @sannya-singal in #10538
Add version.py file to list of added git files in release helper by @silv-io in #10542
Refactor: Events: Clean up tests by @maxhoheiser in #10160
[SFN] Base Support for States.DataLimitExceeded by @MEPalma in #10511
Fix: Events: Refactor tests fix string formatting errors by @maxhoheiser in #10544
remove ap-southeast-1 from random regions by @sannya-singal in #10540
[SFN] ASL Grammars Enhancements by @MEPalma in #10372
[SFN] Add Support for MaxItem and MaxItemPath by @MEPalma in #10531
Fix handling reuse of stack names for describe stack events / delete stack operations by @dfangl in #10551
[SFN] Fix MaxAttempts with Zero Values by @MEPalma in #10548
fix test_function_arns for eu-central-1 by @sannya-singal in #10549
Validation lambda function name pattern on invoke by @dominikschubert in #10323
fix test_dashboard_lifecycle for eu-central-1 by @sannya-singal in #10550

New Contributors

@AnthonyMazzie made their first contribution in #10344
@cloutierMat made their first contribution in #10365
@shucoshuco made their first contribution in #10391
@cowlingj made their first contribution in #10091
@vimiomori made their first contribution in #10083
@bblommers made their first contribution in #10400
@uubk made their first contribution in #10116
@jalaziz made their first contribution in #10379
@janario made their first contribution in #9007

Full Changelog: v3.2.0...v3.3.0