Baselines Without Over-Testing: How to Measure Change in a School Pilot

The word 'baseline' can make a school pilot sound like a research study with a new battery of tests. Most early programmes do not need that. They need enough starting evidence to avoid making claims from memory.

Begin with the decision the baseline will support

If the pilot is about project completion, record what students currently produce and how consistently. If it is about career exploration, ask what pathways students can name, how they explain their interests and what decisions are approaching. If it is about communication, collect a short common task and use a simple rubric.

Use existing evidence whenever possible

Schools already hold artefacts, teacher observations, attendance, project work and student reflections. Reusing relevant information reduces testing burden. The baseline should not collect personal data merely because it might be useful someday.

Match the endline to the baseline

A common measurement mistake is changing the task halfway through. If the school wants to discuss change, the evidence at the end should be comparable enough to the beginning to make that discussion credible.

Document implementation alongside outcomes

A weak result may reflect poor attendance, timetable disruption or incomplete delivery rather than the underlying idea. Record what actually happened. This keeps the pilot review useful instead of turning every outcome into a marketing claim.

"Measure only what you are prepared to interpret responsibly."

Choose the smallest baseline that can answer the question

If a pilot aims to improve portfolio quality, the baseline might be a review of two existing student artefacts rather than a new 60-minute test. If the aim is career exploration, a short structured reflection and pathway-mapping task may be sufficient. The baseline should resemble the thing the programme is trying to change.

This principle protects students from assessment fatigue and protects the school from collecting data it will never interpret. Every baseline field should have an intended use in the final review.

Plan for missing data before the pilot begins

Real school pilots have absences, timetable changes and incomplete artefacts. Decide how those cases will be treated before results are discussed. Do not silently exclude difficult cases to make a chart look cleaner. Report how many students had comparable evidence and why others did not.

• Define the cohort and expected sample.
• Record attendance and completion.
• Use the same or equivalent task where comparison is intended.
• Keep a note of material changes in delivery.
• Report missing evidence rather than filling gaps with assumptions.

Tell students why the baseline exists

If learners think a baseline is another exam, anxiety and performance behaviour can distort the exercise. Explain that the school is trying to understand a starting point so it can judge whether the programme is useful. Where appropriate, show students the same evidence again at the end and let them reflect on change.

Transparency can also improve parent trust. A short pilot note can explain what data is collected, why it is needed, who reviews it and when it will be deleted or retained under the agreed school process. Measurement feels less extractive when the purpose is understandable.