Adding a step broke test execution steps results
under review
Junya Hayashi
When I add a step, on top of the steps, existing steps results changed.
step1 aaa : passed
step2 bbb : failed
step3 ccc : <not yet>
then added ddd as step1, and results changed.
step1 ddd : passed
step2 aaa : failed
step3 bbb : <not yet>
step4 ccc : <not yet>
This is very troublesome.
Manjunatha Reddy
under review
Manjunatha Reddy
Hi Junya Hayashi,
Thank you for pointing this out. This behavior stems from an issue where edits made to test cases in the Repository are reflected in the Test Run, even when the test cases in the run already have results.
I completely agree that this is problematic because, in such cases, the test case step results cannot be considered reliable.
This issue is already on our backlog, and we will be reviewing it. I’ll link our internal ticket to this post, so you’ll receive a notification when the issue is resolved.
Junya Hayashi
Manjunatha Reddy thanks!!