gitlab-org/quality/performance 2.8.0

on GitLab

GPT v2.8.0 has been released!

• GPT can now run natively on ARM based machines (Linux and Mac)! !344
• A new Web test, web_project_repository_compare, has been added, which tests the endpoints for the web compare page when comparing two branches. In addition, the Repository Compare API test has been renamed to api_v4_projects_repository_compare and also now compares branches instead of commits to be more realistic. !330
  • This includes a breaking change when using custom large projects. Refer to the next section for details.
• The Releases API test has had it's threshold reduced notably to reflect the endpoints large performance improvement !343
• GPT will now check if the target projects are public-ally accessible as required for Web tests !352
• Web tests for the MR pages have been updated to reflect the pages latest behavior !349
• Default MR targets in the standard test data have been adjusted to be more realistic !341
• Several Web tests have been adjusted to always test the main tab !338
• Some error messages have been updated to be clearer !333
• k6 has been updated to v0.32.0 !344
• Various small fixes and enhancements

GPT v2.8.0 Breaking Changes:

• The Repository Compare tests now compare branches instead of commits. As such the compare_commits_sha setting has been replaced with compare_branches. When testing a custom project you should replace the setting with the new one containing two branches with enough differences that are representative for your environment.

GPT Data Generator v1.0.22 has also been released!

• Horizontal data generation has been improved in several ways including multithreading tweaks, handling environment changes more gracefully and better project number handling !342
• Vertical data generation has been made more flexible to allow different parent groups for large projects. Large project validation can also now be diabled in advanced cases !340
• A timestamp will now show at the beginning of a large project import !337
• Error messages for missing options have been made clearer !337
• The many project created as part of "horizontal" data will now be created with READMEs !335