§8.7 · BUILDING · 4 MIN READ · EDITION 1.0
Evaluating consistency across suppliers and sites
A capability that performs well on one supplier's documentation style or one site's evidence format may not generalise; test across the actual diversity of sources it will face in production.
Document formatting, language, terminology and completeness vary meaningfully across suppliers and sites; a reference set built from a single source overstates how the tool will perform organisation-wide.
Where performance varies materially by source, either scope the intended use accordingly or invest in normalising the input before evaluation is repeated.
PUT THIS INTO PRACTICE
- 01Include multiple suppliers or sites in the reference set.
- 02Report performance variation by source, not only in aggregate.
- 03Scope intended use to the sources actually evaluated.
RELATED INSTRUMENTS
CITE THIS SECTION
§8.7 · Edition 1.0 · Evaluating consistency across suppliers and sites