Add --start-from option for tests

[kahmed10]

Motivation

long tests like test_verify may fail somewhere in the middle. There already exists -c to continue running, but for slower systems, it's better to fix the test then resume from there rather than starting all over again.

Technical Details

Adds a --start-from or -s flag to test executables.

Changelog Category

Add a CHANGELOG.md entry for any option other than Not Applicable

• • Added: New functionality.
• • Changed: Changes to existing functionality.
• • Removed: Functionality or support that has been removed. (Compared to a previous release)
• • Optimized: Component performance that has been optimized or improved.
• • Resolved Issues: Known issues from a previous version that have been resolved.
• • Not Applicable: This PR is not to be included in the changelog.

Follow the LLVM AI Tool Use Policy for contributions using AI.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #5072      +/-   ##
===========================================
+ Coverage    92.89%   92.90%   +0.01%     
===========================================
  Files          603      603              
  Lines        32448    32526      +78     
===========================================
+ Hits         30140    30217      +77     
- Misses        2308     2309       +1     

see 6 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[gh-app-migraphx-bot-pr-write]

Test	Batch	New Rate (7ff83e)	Old Rate (939a41)*	Diff	Status
torchvision-resnet50	64	1,543.27	3,137.65	-50.81%	🔴
torchvision-resnet50_fp16	64	6,522.48	6,664.17	-2.13%	✅
torchvision-densenet121	32	2,650.37	2,696.53	-1.71%	✅
torchvision-densenet121_fp16	32	4,566.97	4,546.91	0.44%	✅
torchvision-inceptionv3	32	1,800.70	1,789.44	0.63%	✅
torchvision-inceptionv3_fp16	32	2,848.65	2,837.26	0.40%	✅
cadene-inceptionv4	16	370.26	820.89	-54.89%	🔴
cadene-resnext64x4	16	782.16	584.90	33.73%	🔆
slim-mobilenet	64	8,428.45	7,391.43	14.03%	🔆
slim-nasnetalarge	64	224.89	208.95	7.63%	🔆
slim-resnet50v2	64	3,177.28	2,401.77	32.29%	🔆
bert-mrpc-onnx	8	1,170.00	888.28	31.72%	🔆
bert-mrpc-tf	1	486.31	369.82	31.50%	🔆
pytorch-examples-wlang-gru	1	600.39	482.91	24.33%	🔆
pytorch-examples-wlang-lstm	1	480.86	436.18	10.24%	🔆
torchvision-resnet50_1	1	755.68	699.41	8.04%	🔆
cadene-dpn92_1	1	440.38	442.31	-0.44%	✅
cadene-resnext101_1	1	365.45	364.07	0.38%	✅
onnx-taau-downsample	1	402.59	401.79	0.20%	✅
dlrm-criteoterabyte	1	32.65	31.86	2.46%	✅
dlrm-criteoterabyte_fp16	1	33.16	51.73	-35.91%	🔴
agentmodel	1	12,011.88	12,642.67	-4.99%	✅
unet_fp16	2	57.37	57.08	0.50%	✅
resnet50v1_fp16	1	930.80	943.42	-1.34%	✅
resnet50v1_int8	1	923.55	935.85	-1.31%	✅
bert_base_cased_fp16	64	1,102.47	1,072.35	2.81%	✅
bert_large_uncased_fp16	32	346.78	342.15	1.35%	✅
bert_large_fp16	1	104.62	80.24	30.38%	🔆
distilgpt2_fp16	16	2,097.71	859.88	143.95%	🔆
yolov5s	1	561.90	526.66	6.69%	🔆
tinyllama	1	26.83	45.81	-41.44%	🔴
vicuna-fastchat	1	43.94	44.09	-0.34%	✅
whisper-tiny-encoder	1	414.58	412.40	0.53%	✅
whisper-tiny-decoder	1	411.10	410.21	0.22%	✅
llama2_7b	1	4.99	20.70	-75.88%	🔴
qwen1.5-7b	1	23.54	23.58	-0.16%	✅
phi3-3.8b	1	26.77	26.47	1.13%	✅
llama3-8b	1	21.80	21.78	0.06%	✅
whisper-large-encoder	1	10.21	10.16	0.50%	✅
whisper-large-decoder	1	30.00	105.84	-71.65%	🔴
mistral-7b	1	23.77	23.72	0.21%	✅
FLUX.1-schnell	1	758.24	771.10	-1.67%	✅

Regressions detected 🔴

* No develop baseline was found for this PR's branch point; compared against the latest available develop run instead.

[gh-app-migraphx-bot-pr-write]

Test	Status	Result
bert-mrpc-onnx	✅	PASSED: MIGraphX meets tolerance
bert-mrpc-tf	✅	PASSED: MIGraphX meets tolerance
pytorch-examples-wlang-gru	✅	PASSED: MIGraphX meets tolerance
pytorch-examples-wlang-lstm	✅	PASSED: MIGraphX meets tolerance
dlrm-criteoterabyte	✅	PASSED: MIGraphX meets tolerance
agentmodel	✅	PASSED: MIGraphX meets tolerance
unet	✅	PASSED: MIGraphX meets tolerance
resnet50v1	✅	PASSED: MIGraphX meets tolerance
bert_base_cased_fp16	✅	PASSED: MIGraphX meets tolerance
bert_large_uncased_fp16	🔴	FAILED: MIGraphX is not within tolerance - check verbose output
bert_large	✅	PASSED: MIGraphX meets tolerance
yolov5s	✅	PASSED: MIGraphX meets tolerance
tinyllama	✅	PASSED: MIGraphX meets tolerance
vicuna-fastchat	✅	PASSED: MIGraphX meets tolerance
whisper-tiny-encoder	✅	PASSED: MIGraphX meets tolerance
whisper-tiny-decoder	✅	PASSED: MIGraphX meets tolerance
distilgpt2_fp16	✅	PASSED: MIGraphX meets tolerance
llama2_7b	✅	PASSED: MIGraphX meets tolerance
qwen1.5-7b	✅	PASSED: MIGraphX meets tolerance
phi3-3.8b	✅	PASSED: MIGraphX meets tolerance
llama3-8b	✅	PASSED: MIGraphX meets tolerance
whisper-large-encoder	✅	PASSED: MIGraphX meets tolerance
whisper-large-decoder	✅	PASSED: MIGraphX meets tolerance
mistral-7b	✅	PASSED: MIGraphX meets tolerance
FLUX.1-schnell	✅	PASSED: MIGraphX meets tolerance