Skip to content

perf: Parallelize multi-tenant integration tests#433

Open
vibhutikumar07 wants to merge 8 commits intodevelopfrom
feature/parallelize-mt-integration-tests
Open

perf: Parallelize multi-tenant integration tests#433
vibhutikumar07 wants to merge 8 commits intodevelopfrom
feature/parallelize-mt-integration-tests

Conversation

@vibhutikumar07
Copy link
Collaborator

Summary

Parallelizes the integration test jobs in multi-tenant workflows to reduce execution time from ~2 hours to ~24 minutes.

Changes

  • Added matrix strategy with 12 parallel jobs (tokenFlow × tenant × testClass)
  • Added Maven dependency caching via setup-java
  • Added CF CLI caching via actions/cache@v4
  • Applied to all 3 multi-tenant workflows:
    • multi tenancy_Integration.yml
    • multiTenant_deploy_and_Integration_test.yml
    • multiTenant_deploy_and_Integration_test_LatestVersion.yml

Testing

Tested on multi tenancy_Integration.yml - completed in 24 minutes (previously ~2 hours)

- Split workflow into setup + parallel test jobs using matrix strategy
- Run 4 test combinations (tokenFlow x tenant) in parallel instead of sequentially
- Reduces execution time from ~2 hours to ~30 minutes
- Added test artifact uploads for each matrix job
- Added test-summary job to aggregate results
- Updated deprecated ::set-output syntax to GITHUB_OUTPUT
GitHub Actions blocks passing secrets via job outputs for security.
Each parallel job now does its own CF login and fetches credentials
within the same job using step outputs instead of job outputs.
- Add testClass dimension to matrix (3 classes × 2 tokenFlows × 2 tenants = 12 parallel jobs)
- Each job runs only one test class instead of all 3
- Add Maven dependency caching via setup-java
- Add CF CLI caching
- Expected time: ~15-20 mins (down from ~50 mins)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Comments