MirLabs / The lab / The same test, 20 times
Planned
The same test, 20 times
If we replay exactly the same test, does the agent always do the same thing?
Result
No result yet.
Protocol
One model goes through the same trap 20 times, with nothing changed. We count how many times it makes the fault. This tells what a test played only once is worth.
- Runs
- 20
Limits
One model and one trap: the stability measured will hold for them, not for every test.