Read response patterns without labelling people

Treat each pattern as a question

Read a response pattern as a question to ask the person, not a conclusion about them. Patterns in a scenario assessment show what someone chose and which priorities came up again and again. They cannot show whether the person was honest, used AI or is a certain kind of person. Write nothing down as a conclusion until you have asked.

This matters most for the people who read other people's reports: a line manager, a coach, a deputy head with a team of eight. A report arrives, a pattern jumps out, and a story forms within seconds. That story is usually a guess.

What scenario choices can tell you

A scenario assessment asks people how they would act in realistic situations they are not living through at that moment. Their choices are evidence of preference. They show what a person tends to put first when the situation is described on a screen and nobody is waiting for an answer.

That is useful, within limits. Here is what they can reasonably show.

• Priorities that recur across several scenarios, such as consulting before deciding or acting quickly to protect time.
• Areas where choices vary, which often point to situations the person finds genuinely hard.
• A contrast with what you see day to day, which is worth a conversation in either direction.
• Starting points for reflection questions and for choosing one development priority.

What they cannot tell you

Choices on a screen do not show what someone does at the end of a long day with a parent at the door. They do not reveal character, predict performance or say whether someone is ready for promotion.

Watch for consistency being read as something it is not. A teacher who always picks the collaborative option may hold that value deeply. She may also have guessed what her school wants to hear. The data cannot separate the two. Only she can, and only if she is asked without suspicion.

Why timing and completion prove nothing about honesty

Some managers notice that a colleague finished in twenty minutes, or came back to it over several days. It is tempting to read speed as carelessness, or a long gap as time spent asking a chatbot.

Take a teacher in her second year who finished well within the suggested hour. She may have rushed. She may also have recognised most situations from her own classroom and decided quickly. A head of science who took two days may have been called away to a fire drill, then lost her connection.

Completion patterns are no different. Where answers save as people go, someone can stop after a dropped connection or a sign-out and pick up later. Finishing over three sittings usually means a full timetable, not a plan to look things up.

Dedicated detection tools have far more to work with than a clock, and they still fall short. In 2023, Jisc's National Centre for AI said no AI detection software can conclusively prove text was written by AI. It added that all such software gives false positives. If tools built for the job cannot prove AI use from the writing itself, a completion time cannot prove it either.

Describe choices in plain terms

Once a manager has decided that someone gamed an assessment, every later observation gets read through that idea. The simplest protection is to write down what the person chose, in plain terms, and leave the interpretation open.

Compare these pairs. The first of each is a label; the second is a description you could share with the person.

• "She is controlling" becomes "she chose to decide herself in most scenarios about team decisions".
• "He did not take it seriously" becomes "he told me he finished quickly; I do not yet know why".
• "She told us what we wanted to hear" becomes "her choices match our policy closely; worth asking how it feels in practice".
• "He is weak on behaviour" becomes "his choices varied most in scenarios about low-level disruption".

Let the coaching conversation add the context

A coaching conversation is where a pattern meets the person's real work. Start with their reading of the report before you offer yours. Ask what surprised them and what they recognised. Then take one pattern and ask for a recent example.

A deputy head meets an early career teacher whose choices leaned towards moving on quickly in lessons. He asks, "When did you last move on before everyone had it, and how did you know?" She describes a Year 8 lesson where she skipped a check because the bell was close. Now there is a real example, chosen by her, and a priority they can test together.

Short, open questions work best. These are worth keeping to hand.

• "Talk me through why you chose this one."
• "Is that what you usually do, or what you would like to do?"
• "What would make it hard to act that way on a busy day?"
• "Who else sees this part of your work?"

If a concern remains, handle it fairly

Sometimes a reader still has a doubt after the conversation. That is fine. What is not fair is acting on a pattern as though it were proof. Ask the person directly and kindly whether the assessment reflected them. Offer to set the report aside and work from observation and practice instead. Do not record the doubt in an appraisal or a file on the strength of a pattern alone. A genuine conduct concern belongs in your organisation's normal process, built on evidence from real work.

OTO Assess reports describe the evidence from a person's selected responses, with strengths, reflection questions and development priorities. They do not rank staff or diagnose personality, so they work best as the opening of the conversation described here. Guidance for organisations and participants is at https://assess.otovios.com/assess/faq.