What our resume scanner can—and cannot—recognise
An openly documented test using fictional CVs. It shows how wording, missing evidence and keyword lists affect our basic and AI-assisted checks.
The useful finding
In these tests, the AI recognised equivalent work descriptions that the basic keyword check missed. A list of relevant terms without work evidence matched every basic-check topic, while the AI rejected that list as evidence. This is why a topic count should never be read as a verified qualification, an employer’s ATS score or a prediction of getting hired.
This is an internal functional test of our own scanner. It is not independent research, a representative study of applicants, or a test of an employer’s recruitment system. All names, employers and work histories below are fictional.
All eight results
The numbers count recognised review topics, out of the topics for that role. They do not measure writing quality or suitability for a particular vacancy. Each model column is a separate request using the same input.
| Fictional input | Basic check | AI run 1 | AI run 2 |
|---|---|---|---|
| Complete diesel-fitter CV | 7/7 | 7/7 | 7/7 |
| Equivalent wording | 3/7 | 7/7 | 7/7 |
| Trade qualification explicitly not held | 6/7 | 6/7 | 6/7 |
| Important details removed | 1/7 | 1/7 | 1/7 |
| Keywords without work evidence | 7/7 | 0/7 | 0/7 |
| Keywords repeated 30 times | 7/7 | 7/7 | 7/7 |
| Extra spaces and line breaks | 7/7 | 7/7 | 7/7 |
| Hospitality experience for camp work | 6/6 | 6/6 (basic fallback) | 6/6 (basic fallback) |
How to interpret the cases
- Equivalent wording: the basic check matched three of seven diesel-fitter topics; both AI runs matched seven. Exact keywords alone miss some descriptions of the same work.
- Qualification not held: both checks withheld the trade-qualification topic after an explicit denial. Recognising this phrase does not establish reliable handling of every possible qualification statement.
- Keyword list without evidence: the basic check matched seven topics and the AI matched none. The basic check looks for wording and can be misleading when terms are listed without real experience.
- Repeated keywords: repetition did not increase the topic count above the original complete CV. This does not prove resistance to every kind of keyword stuffing.
- Hospitality transfer: both model requests fell back to the basic six-topic check. These runs cannot show that the AI successfully assessed transferable camp-services experience.
- Missing details: a short, vague work history left most topics unrecognised. A missing match means evidence was unclear or absent from this text; it does not prove the person lacks the skill.
Word and PDF extraction
We placed the baseline text into Word and a text-based PDF using our document exporters, then read each file with the production parser. Both formats retained all seven basic-check topic matches. These two files do not represent scanned PDFs, unusual layouts or every Word document.
Download the test Word file · Download the test PDF
Read the actual inputs
Complete diesel-fitter CV
Explicit relevant wording in a complete fictional CV
Alex Morgan — fictional test applicant Perth WA · alex@example.com Target role: HD diesel fitter Professional summary Trade qualified diesel fitter with a completed apprenticeship and workshop maintenance experience. Carries out fault finding, repairs and planned servicing on Caterpillar and Komatsu equipment. Works on hydraulic systems, engines and transmissions, following isolation and permit to work procedures. Records completed tasks in SAP work orders and communicates remaining faults at shift handover. Employment history Diesel fitter, Example Engineering, March 2022 to present. Inspect equipment, identify defects and explain repair requirements to the supervisor. Use maintenance instructions to plan servicing, replace worn components and check the completed work. Follow workshop safety procedures and report hazards. Discuss task changes with the crew before restarting work. Keep tools and work areas organised and record parts used against each job. Education and qualifications Certificate III in Engineering Mechanical Trade, Example Institute, 2021. Completed apprenticeship. Availability Based in Perth. Available after two weeks notice and willing to discuss FIFO rosters.
Basic matches: Trade qualification; Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability. AI matches: Run 1: Trade qualification; Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability / Run 2: Trade qualification; Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability.
Equivalent wording
Similar work described without several exact topic keywords
Alex Morgan — fictional test applicant Perth WA · alex@example.com Target role: HD diesel fitter Professional summary Mechanic who completed formal training in the trade and workshop upkeep experience. Carries out investigating breakdowns, repairs and planned servicing on Caterpillar and Komatsu equipment. Works on fluid-power systems, engines and transmissions, following disconnecting energy sources and authorised work controls procedures. Records completed tasks in electronic job records and communicates remaining faults at shift handover. Employment history Diesel fitter, Example Engineering, March 2022 to present. Inspect equipment, identify defects and explain repair requirements to the supervisor. Use upkeep instructions to plan servicing, replace worn components and check the completed work. Follow workshop safety procedures and report hazards. Discuss task changes with the crew before restarting work. Keep tools and work areas organised and record parts used against each job. Education and qualifications Mechanical trade programme completed at Example Institute in 2021. Availability Based in Perth. Available after two weeks notice and willing to discuss FIFO rosters.
Basic matches: Maintenance and fault finding; Equipment operated or maintained; Location and work availability. AI matches: Run 1: Trade qualification; Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability / Run 2: Trade qualification; Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability.
Trade qualification explicitly not held
Explicit denial of the trade qualification
Alex Morgan — fictional test applicant Perth WA · alex@example.com Target role: HD diesel fitter Professional summary Workshop assistant without a completed trade qualification or apprenticeship and workshop maintenance experience. Carries out fault finding, repairs and planned servicing on Caterpillar and Komatsu equipment. Works on hydraulic systems, engines and transmissions, following isolation and permit to work procedures. Records completed tasks in SAP work orders and communicates remaining faults at shift handover. Employment history Diesel fitter, Example Engineering, March 2022 to present. Inspect equipment, identify defects and explain repair requirements to the supervisor. Use maintenance instructions to plan servicing, replace worn components and check the completed work. Follow workshop safety procedures and report hazards. Discuss task changes with the crew before restarting work. Keep tools and work areas organised and record parts used against each job. Education and qualifications I do not hold a Certificate III, trade certificate or completed apprenticeship. I assist qualified mechanics and do not claim to be trade qualified. Availability Based in Perth. Available after two weeks notice and willing to discuss FIFO rosters.
Basic matches: Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability. AI matches: Run 1: Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability / Run 2: Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability.
Important details removed
Qualifications, equipment, systems and procedures omitted
Alex Morgan — fictional test applicant Perth WA · alex@example.com Employment history Workshop worker, Example Engineering, March 2022 to present. Complete assigned workshop tasks, work with colleagues and report issues to the supervisor. Keep the work area organised and follow instructions. Seeking a new role. Available after two weeks notice.
Basic matches: Location and work availability. AI matches: Run 1: Location and work availability / Run 2: Location and work availability.
Keywords without work evidence
Relevant terms listed without evidence of personal experience
Alex Morgan — fictional test applicant Perth WA · alex@example.com Job-search notes, not a claim of experience These are words from jobs I have read: trade qualified, Certificate III, completed apprenticeship, maintenance, fault finding, Caterpillar, hydraulic systems, isolation, permit to work, SAP work orders, FIFO. Employment history and qualifications have not been supplied.
Basic matches: Trade qualification; Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability. AI matches: Run 1: none / Run 2: none.
Keywords repeated 30 times
Same baseline with relevant terms repeated 30 times
Alex Morgan — fictional test applicant Perth WA · alex@example.com Target role: HD diesel fitter Professional summary Trade qualified diesel fitter with a completed apprenticeship and workshop maintenance experience. Carries out fault finding, repairs and planned servicing on Caterpillar and Komatsu equipment. Works on hydraulic systems, engines and transmissions, following isolation and permit to work procedures. Records completed tasks in SAP work orders and communicates remaining faults at shift handover. Employment history Diesel fitter, Example Engineering, March 2022 to present. Inspect equipment, identify defects and explain repair requirements to the supervisor. Use maintenance instructions to plan servicing, replace worn components and check the completed work. Follow workshop safety procedures and report hazards. Discuss task changes with the crew before restarting work. Keep tools and work areas organised and record parts used against each job. Education and qualifications Certificate III in Engineering Mechanical Trade, Example Institute, 2021. Completed apprenticeship. Availability Based in Perth. Available after two weeks notice and willing to discuss FIFO rosters. maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth maintenance hydraulic Caterpillar SAP isolation trade qualified Perth
Basic matches: Trade qualification; Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability. AI matches: Run 1: Trade qualification; Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability / Run 2: Trade qualification; Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability.
Extra spaces and line breaks
Same words with extra line breaks and spaces
Alex Morgan — fictional test applicant Perth WA · alex@example.com Target role: HD diesel fitter Professional summary Trade qualified diesel fitter with a completed apprenticeship and workshop maintenance experience. Carries out fault finding, repairs and planned servicing on Caterpillar and Komatsu equipment. Works on hydraulic systems, engines and transmissions, following isolation and permit to work procedures. Records completed tasks in SAP work orders and communicates remaining faults at shift handover. Employment history Diesel fitter, Example Engineering, March 2022 to present. Inspect equipment, identify defects and explain repair requirements to the supervisor. Use maintenance instructions to plan servicing, replace worn components and check the completed work. Follow workshop safety procedures and report hazards. Discuss task changes with the crew before restarting work. Keep tools and work areas organised and record parts used against each job. Education and qualifications Certificate III in Engineering Mechanical Trade, Example Institute, 2021. Completed apprenticeship. Availability Based in Perth. Available after two weeks notice and willing to discuss FIFO rosters.
Basic matches: Trade qualification; Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability. AI matches: Run 1: Trade qualification; Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability / Run 2: Trade qualification; Maintenance and fault finding; Equipment operated or maintained; Hydraulics and mechanical systems; Isolation and permit procedures; Work records and maintenance systems; Location and work availability.
Hospitality experience for camp work
Transferable hospitality experience without mining experience
Taylor Sample — fictional test applicant Perth WA · taylor@example.com Professional summary Hospitality worker seeking entry-level camp utility work. No mining experience claimed. Employment history Housekeeping attendant, Example Hotel, January 2022 to present. Clean guest rooms, bathrooms and shared areas using workplace checklists. Replenish linen, complete laundry tasks and report maintenance defects. Follow cleaning chemical instructions and food safety practices in shared kitchen areas. Communicate with guests and colleagues during busy shifts. Cafe assistant, Example Cafe, February 2020 to December 2021. Wash dishes, clean benches and help with food preparation under direction. Receive supplies, check storage areas and keep walkways clear. Report hazards to a supervisor and use the protective equipment required for cleaning tasks. Help customers and maintain clear handovers with the next shift. Training Workplace cleaning and food handling induction. Availability Perth based, two weeks notice, willing to discuss FIFO rosters and camp accommodation.
Basic matches: Housekeeping or hospitality experience; Cleaning and hygiene; Kitchen or food handling experience; Customer or guest service; Safe work practices; Location and work availability. AI matches: Run 1: Housekeeping or hospitality experience; Cleaning and hygiene; Kitchen or food handling experience; Customer or guest service; Safe work practices; Location and work availability / Run 2: Housekeeping or hospitality experience; Cleaning and hygiene; Kitchen or food handling experience; Customer or guest service; Safe work practices; Location and work availability.
Method and reproducibility
We ran the production role rules, AI request, evidence-merge and file-parser functions in a local Node 22 harness on 6 September 2026. The AI calls used Claude Sonnet 4.6. Seven cases select the diesel-fitter role; the hospitality case selects camp services. The published JSON records every input, its hash, raw model response, recognised topics and execution time.
The published dataset contains the completed two-run set. An earlier run stopped at the harness time limit; we then increased the limit and added checkpoints. The completed run was resumed from its saved results after correcting the last case’s role identifier. No completed result in the published set was removed because of its score. Two runs are too few to estimate model reliability or generalise to other CVs.
The harness exercises the production functions directly. It does not exercise browser upload controls, authentication, rate limiting or the live HTTP route. Some deliberately short inputs would not qualify as a full uploaded resume. Model behaviour and the service can change after this dated test.
Download all inputs and raw results as JSON · Download the runnable harness and method notes
Use the feedback as a prompt to review your CV
Make real experience easier to understand. Do not add a ticket, machine, safety record or employer just to increase a match count. Read the scanner methodology, use the free Word template, or check your own CV.
Corrections and reproducibility questions: support@fifoready.ai. FIFO Ready also sells optional writing services; this commercial interest is why we disclose the test method, raw results and limitations.