📝
Scenario Grades

What happens after you press Complete, what the score measures, and why a self correction counts in your favor.

Every voice scenario is graded once you finish it, and the grade reads the whole conversation and names what you said, turn by turn.

What the grade is built from

Four passes run over the transcript, and each one is given only what it needs.

Repairing the transcript

The first pass repairs the transcript, because a word you pronounced correctly can still arrive in text as nonsense, and a grader reading that nonsense would invent a mistake you never made. This pass marks the turns it doubts before anything judges them.

Measuring what you produced

The second pass marks every one of your turns as clean, an error, a self correction, a transcription artifact, or a request for a translation. A turn can be more than one of those at once, so an error you then caught yourself is both an error and a self correction, which is exactly what it was.

Resolving it to modules

The third pass takes the concepts you missed and resolves them to modules in the textbook, and the fourth writes the feedback you read.

Why a self correction is good news

An outright error is the only mark that counts as a failure. Catching yourself mid sentence is the clearest sign in a transcript that you are monitoring your own speech, and monitoring your own speech is the habit the whole app is trying to build, so scoring your first attempt and ignoring the fix would teach you to stop trying.

The score

The score is an average of the traits the second pass measured, including how varied your language was and where you slipped back into your own language, and nothing asks a model for a percentage. A score of 75 completes a scenario and a score of 90 finishes it outright.

The level on the grade

The grade also reports a CEFR level for that one conversation, picking the highest level that enough of the conversation reached and reporting how sure it is based on how much you said. Under three graded turns no level is given at all and the page says so, because two turns can only be none, half or all of a conversation, so a share drawn from them says nothing. This is one conversation's reading, and your level across the whole course is a separate estimate built from everything you have done.

Reading the page

The grade reads in order: the premise first, then what the conversation was worth, then what to do about it, then what happened, then How to Complete and the full transcript. The level, the effort and the gems are separate facts and read as separate facts, and what you should work on, what to try next, and what went well are lists where each entry is one thing to do.

What is left off

A turn marked clean is never drawn, because it counted toward your level and your effort and printing it would bury the one line worth reading under a list of turns that went fine. How to Complete survives the grade with every beat shown as landed, because a grade outranks that board: if a grade exists, the scenario was completed.

What a grade is worth

A completed scenario pays gems from a base, plus a bonus for every point above the completion threshold, multiplied by the CEFR level and by how much language you produced, with a floor of sixty gems and a ceiling of three hundred. A retry is compared against your own best previous attempt at that scenario rather than against zero, so a worse retry pays nothing and a retry at the same score carrying twice as much language pays the difference.

What to do with a grade

The linking is the part worth exploiting, because it turns a vague sense that your past tense is bad into a page about the past tense, opened for you, at your level. Read the grade, open one of those modules, and put the same scenario back on your list for a couple of days later, because the second attempt at a situation you have already failed is where most of the learning lands.

Grading again

A grade stays attached to the conversation it read, so carrying on after a grade starts a new session that keeps the previous messages, because a grade of a conversation that has since grown is a grade of nothing.