2. Benchmarking usability for people with disabilities versus usability for all users
Approach #2 requires that you already have or can set up a general usability metric. If you use the System Usability Scale (SUS) to measure usability, data is usually collected via a survey that pops-up at random on your website.
You can use Fable’s new Accessible Usability Scale (AUS) to evaluate key tasks and compare the results to your SUS scores. Of course, your SUS scores will likely include some users with assistive technology, but it’s a qualitative metric so statistical accuracy is not the goal. To learn more about this methodology, you can learn more about how we built the AUS.
Another usability metric to look at, which is more quantitative, is task completion. This data is also typically collected via a survey, that pops up after a key task is completed. Fable’s Compatibility Tests include task completion data for 5 users. You can count the number of successful task completions, average those numbers and compare them to overall task completion scores for all users.
This is a good approach for evaluating if you are truly being inclusive as an organization. If you have significantly worse usability for users of assistive technology compared to all users, that’s a sign that you need to make sure that accessibility is prioritized equally to general user experience within your organization.