MirLabs / The lab / The same test, 20 times

Planned

The same test, 20 times

If we replay exactly the same test, does the agent always do the same thing?

Result

No result yet.

Protocol

One model goes through the same trap 20 times, with nothing changed. We count how many times it makes the fault. This tells what a test played only once is worth.

Runs
20

Limits

One model and one trap: the stability measured will hold for them, not for every test.

← Back to the experiments in progress and planned