FIFA Offside Technology Quality Programme Test Manual Summary
1. Introduction
FIFA Offside Technology (OT) aims to assist match officials in making accurate and consistent offside decisions, enhancing game fairness. The programme establishes a globally recognized framework for evaluating and certifying OT systems through independent on-field testing. This manual outlines the certification process, test requirements, methods, and data analysis for systems seeking FIFA Quality Programme certification.
2. Certification Process
- Companies must fulfill all outlined requirements to certify their OT systems.
- Product testing occurs during FIFA test events, coordinated by an approved test institute.
- Two FIFA marks are available:
- FIFA Quality: Suitable for broader competitions, balancing performance and cost.
- FIFA Quality Pro: Targeted for top-level competitions, focusing on skeletal tracking accuracy and automation.
- Providers must inform FIFA of the desired certification mark and submit the final product in the intended configuration.
- Certification is awarded upon passing all tests; failure results in no certification but allows for re-testing.
- The programme is open to various technologies, including Virtual Offside Line (VOL), Semi-Automated Offside Technology (SAOT), and Advanced SAOT.
3. Test Requirements
- The manual details requirements to assess accuracy, functionality, and robustness of OT systems.
- Absence of required features or failure to meet thresholds results in a fail.
- Tests are divided into offside tests (FIFA OT Tests 01-03) and tracking tests (FIFA EPTS Tests).
3.1 Offside Tests (FIFA OT Tests 01-03)
- Objective: Evaluate accuracy and consistency of 2D and 3D line placement under controlled conditions.
- Scenarios: Systems must identify offside situations and submit VOL images to FIFA.
- Pass/Fail Criteria:
- 95% scenario pass rate with a submission rate of 95%.
- Alternatively, all scenarios must be submitted with a total of no more than 10 points from all images, and no individual zone score of three points.
- Test Methods:
- 2D Line Placement Test (FIFA OT Test 01): Providers draw two VOLs (attacker and defender) and submit images. Tolerance channels are created using markers.
- 3D Line Placement Using Equipment Test (FIFA OT Test 02): Providers use equipment (e.g., tripods with boots) to simulate body parts and manually place VOLs.
- 3D Line Placement Using Players Test (FIFA OT Test 03): Specifically for FIFA Quality Pro certification, systems must automatically identify 3D body parts for offside detection.
3.2 Tracking Tests (FIFA EPTS Tests)
- Objective: Evaluate skeletal and ball tracking accuracy, required for FIFA Quality Pro certification.
- Player Tracking Test (FIFA EPTS Test): Systems must track skeletal points on players using motion capture data.
- Method: Players wear markers and perform dynamic exercises. Data is compared to Vicon motion capture references.
- Pass Criteria: Achieve FIFA Quality Pro thresholds for spatial and temporal accuracy.
- Ball Tracking Test (FIFA EPTS Test): Systems must automatically identify the ball's location.
- Method: Ball wears markers, and data is compared to Vicon references during football-specific drills.
- Pass Criteria: Achieve FIFA Quality Pro thresholds for ball trajectory and event detection.
3.3 Logic and Match Test (FIFA OT Test 04)
- Objective: Assess system logic and integration for complex offside scenarios.
- Method: Conducted during a controlled 11-a-side match with pre-defined test scenarios.
- Requirements:
- Correctly determine onside/offside outcomes.
- Generate alerts within 3 seconds of attacker confirmation.
- Produce accurate visualizations reflecting game events.
- Data Submission: Screen recordings, video outputs, and offside visualizations.
4. Data Analysis
- All collected data undergoes verification and quantitative analysis by FIFA and the test institute.
- Results are compiled into a final report detailing system performance against FIFA thresholds.
4.1 Offside Testing Analysis
- 2D Line Placement Test: Images are scored based on VOL position relative to reference markers in predefined zones.
- 3D Line Placement Using Equipment Test: Similar scoring system but with tighter tolerances.
- 3D Line Placement Using Players Test: Analyzes 3D coordinates and visualizes VOL placement.
- Methodology: Overlays images to compare VOL with tolerance channels, ensuring alignment and accuracy.
4.2 Tracking Tests Analysis
- Player Tracking Test: Evaluates RMSD and MAD for spatial and temporal accuracy.
- Ball Tracking Test: Similar analysis for ball trajectory and event detection.
4.3 Logic and Match Test Analysis
- Successful completion results in a passed test report detailing outcomes and observations.
- Report includes test setup details, including alert distance thresholds.
