Compare `matlab.pe​rftest.Tim​eResult` over time as part of CI

Are there any examples or suggestions of how one might generate test artifacts from matlab.perftest.TimeResult outputs, and then compare performance over time, ideally as part of CI on GitHub (like you can with code coverage using Codecov)?

I know how to this locally if I manually save the results, then reload them later and use tools like comparisonPlot. However, I'm looking for something a bit more seamless, and integrated with CI tests.

Answer 1

[Dheeraj]

Hi,

I understand that you want to generate test artifacts from matlab.perftest.TimeResult outputs and compare performance overtime as part of his CI/CD pipeline on GitHub. But there are no tools similar to CodeCov but you include the step in your current CI/CD pipeline on GitHub using CI services like GitHub actions.

1. Generate the artifacts from matlab.perftest.TimeResult like you stated and store them in a CSV, JSON or any custom format and commit them to your version control. You could create a MATLAB script to do this for you.
2. You can also incorporate this step as part of your pipeline step, i.e., to execute performance tests, collect results and save them as artifacts to your GitHub repository if you don’t want to do this locally.
3. To compare performance, you could use CI tools like Grafana or Prometheus, to visualize and analyse the performance metrics from the test artifacts.
4. Reports of the tests to summarize the performance results over time can be automatically generated as part of the CI workflow.

Hope this helps!

[Bradley Treeby]

Thanks, that's helpful, especially the pointer to the CI tools. Is there an automated way to generate artefacts from matlab.perftest.TimeResult?

[Dheeraj]

Hi Bradley,

There is automated way to generate the artifacts but you could write a script to get the artifacts