How test length can impact your results
There is no limit to the number of steps you can include in a test, but the best Rainforest tests are between 10 and 25 steps long.
There are always exceptions, but generally, testing for long processes should take the form of multiple, smaller tests against each individual part of the full process. These shorter, more targeted tests are your secret to success.
There are a few key reasons why shorter, tightly focused tests perform better:
1. Short tests are faster
All tests in a single run will be performed by our pool of testers in parallel. This means 3 5-step tests and 20 5-step tests will take the same amount of time to run. Conversely, a less focused, 25-step test will take much longer for testers to complete. From a time perspective, it's to your advantage to keep each individual test as short and focused as possible.
2. Pinpoint accurate error reporting
If a large test fails part-way through, you'll be alerted to the failure where it occurred, but you may lose visibility to issues that arise later down the line. Splitting longer processes down to the most granular component parts will ensure that you identify problems anywhere they might arise.
3. Easier test-case management
Focused tests against component parts allow you easily update your test suite whenever you make a change to a process. Imagine you have a 5-part signup process and you make a change in part 3. It will be much simpler for the team to quickly update the test for only part 3, while the other tests can keep running in their current form.
Questions? We're here to help!
Not sure how to trim down your tests? Looking for suggestions, tips or tricks? Reach out to us at firstname.lastname@example.org with any questions!