Questions
How much of accessibility can be tested automatically?
A minority — the figure most commonly cited in published analyses is around a third of WCAG success criteria, and it varies with the content. Automated checks are excellent at the mechanical failures: a missing alternative text attribute, an unlabelled form field, an invalid ARIA reference. They cannot judge whether alternative text is accurate, whether the reading order makes sense, or whether a custom control behaves the way its role claims.
What automates reliably
Missing attributes: an image with no `alt`, a form control with no associated label, an iframe with no title.
Contrast ratios for plain text against a solid background, computed from the rendered colours.
Invalid ARIA: a role that does not exist, an attribute that is not permitted on that role, a reference pointing at an identifier that is absent.
Structural rules: duplicate identifiers, heading levels that skip, a missing `lang` attribute, `aria-hidden` on a focusable element.
These are true failures whenever they are reported. A tool flagging them is not guessing.
What does not automate at all
Whether alternative text describes the image. `alt="image"` passes the presence check and conveys nothing.
Whether an image marked decorative actually is, which requires knowing what the page is trying to say.
Whether the reading and focus order makes sense, which depends on the meaning of the content rather than on the markup.
Whether a custom widget behaves as its role promises — a `role="tablist"` that does not respond to arrow keys is valid markup and a broken control.
Whether an error message explains anything, whether a label is comprehensible, whether a colour is the only thing distinguishing two states.
Why a clean report is a starting point
A page with no automated findings has cleared the mechanical checks. That is a genuine achievement and it covers roughly a third of the criteria.
The remaining two thirds have not been assessed at all, and nothing in the report says otherwise.
It is entirely possible for a page to pass every automated check and be unusable with a keyboard or a screen reader.
Treating a clean automated report as conformance is the single most common misreading of accessibility tooling.
What closes most of the gap cheaply
A keyboard pass. Put the mouse away and complete a real task using Tab, Shift+Tab, Enter, Space, the arrow keys and Escape. This finds a large share of operable failures in minutes and needs no tooling.
Watching the focus indicator throughout that pass, since an invisible one makes the whole interface unusable for sighted keyboard users.
A screen reader pass on the journeys that matter, which is what reveals whether names and roles are correct.
Reading the alternative text out loud in context and asking whether it says what the image contributes.
Testing at a narrow viewport, where a menu becomes a different widget with a different keyboard contract.
What a scan reports, stated plainly
VeriFixScan reports the mechanical checks: `accessibility.image_alt`, `accessibility.contrast`, `accessibility.aria_validity`, `accessibility.aria_references`, `accessibility.tabindex` and the landmark and skip-link structure.
It reports what it observed in the served HTML, so a control constructed entirely by scripts is outside what it sees.
It does not operate the page, does not use a keyboard, and does not run a screen reader — which is the boundary of every crawl-based accessibility check, not a limitation of one tool.
The findings it produces are real. The absence of findings is not a conformance claim, and no report should be read as one.
Frequently asked questions
- What percentage of accessibility issues do automated tools find?
- Published analyses commonly cite around a third of the success criteria, varying with the content. The rest require a person to judge accuracy, order and behaviour.
- Does passing an automated scan mean my site is WCAG compliant?
- No. It means the mechanical checks passed. Conformance requires evaluating criteria that no tool can assess.
- What is the cheapest manual test worth doing?
- A keyboard pass through a real task. It needs no tooling, takes minutes, and finds a large share of operable failures.
Sources
Related
VeriFixScan crawls a site and applies its checks to every page it reaches, keeping the evidence behind each finding. Scanning one website is free.
Scan a website