Tracking accessibility over time with Exports
An important part about creating a reliable cadence for accessibility testing, is ensuring that you are testing early and often. Whether you’re launching a net-new product or feature, or evaluating key flows over time – consistency is key. With Compatibility Tests and exports, you can easily track your progress (or regressions) over time. Take feedback from Fable and implement it directly into your product development cycles, using whatever project management tools work best for you. Check out these tips below to help you get started.
Amber Knabl, Customer Success @ Fable
“With every new release or update, there’s an increased possibility of a broken or inaccessible experience for a user.”
Benchmarking and maintenance
Evaluate if/how your product’s accessibility experience has changed over time.
Establish a baseline for accessibility
- Identify 2-5 key flows for your product
- Submit a Compatibility Test for each, to get your baseline accessibility results
- Export and analyze your results. When tracking over time, pay particular attention to data like:
- Total # of issues
- Accessibility rating
- Ease of use rating
- Completion rate
- Remediate, if necessary
- Transition to benchmarking and maintenance
Benchmarking and maintenance
- Resubmit Compatibility Test(s) quarterly, or after any major release (Tip: you can quickly and easily use the “copy” feature to do this!)
- Analyze your results, cross-referencing with baseline results to ensure no regressions
- Remediate, if necessary
- Repeat steps 1-3 at your desired frequency
Product and Feature Releases
Don’t wait for your users to tell you there are accessibility issues with your new product or feature. Test for accessibility both pre, and post, release.
Pre-release
- Identify key flow(s) for your product/feature
- Submit Compatibility Test(s)
- Analyze your results. When tracking over time, pay particular attention to data like:
- Total # of issues
- Accessibility rating
- Ease of use rating
- Completion rate
- Remediate, remediate, remediate. (Pre-release, there will be issues!)
- Resubmit Compatibility Test(s) for validation (Tip: use the “copy” feature for this)
- Analyze your results, cross-referencing with previous results to ensure fixes
- Remediate, if necessary.
- Repeat steps 5-7 as necessary, until ready for release.
Post-release
- Use the “copy” request feature to resubmit your Compatibility Test
- Analyze your results, cross-referencing with previous results to ensure no regressions or new issues.
- Remediate and repeat steps 1 and 2, if necessary.
- Introduce regular maintenance testing (see above)
Proactive > Reactive
Don’t wait for your users to tell you there are accessibility issues with your new product or feature. Remember:
- With every new release or update, there’s an increased possibility of a broken or inaccessible experience for a user.
- Accessibility should be a requirement, not an afterthought.
- Accessibility is a journey – there will always be ways you can improve an experience for assistive technology users.