--- title: "Known Issue: Transcription Artifacts Causing Unexpected Low Statement Scores in AI Role Play" description: Some AI role play users may see low statement scores caused by transcription artifacts from degraded audio. Learn what to look for, how to avoid it, and what we're doing to fix it. --- [Skip to content](https://support.brevitypitch.com/en-us/knowledgebase/known-issue-transcription-artifacts-causing-unexpected-low-statement-scores-in-ai-role-play#main-content) ![](https://support.brevitypitch.com/hs-fs/hubfs/Brevlogo.png?width=200&height=51&name=Brevlogo.png) Open main navigation Close main navigation - [Contact us](mailto:support@brevitypitch.com) [Contact us](mailto:support@brevitypitch.com) How can we help you? - There are no suggestions because the search field is empty. 1. [Brevity Knowledge Base](https://support.brevitypitch.com/en-us/knowledgebase?hsLang=en-us) 2. [Known Issues & Status](https://support.brevitypitch.com/en-us/knowledgebase/known-issues-status?hsLang=en-us) 3. [Active Known Issues](https://support.brevitypitch.com/en-us/knowledgebase/known-issues-status?hsLang=en-us#active-known-issues) # Known Issue: Transcription Artifacts Causing Unexpected Low Statement Scores in AI Role Play ## Unexpected phrases in transcripts may cause low statement scores — here's what's happening, what we're doing to reduce occurrances, and how to avoid it. ⚠️ **Monitoring** — Mitigation deployed March 3, 2026. Known artifact patterns are now filtered. We are continuing to monitor for additional hallucination patterns and decreased impact of Whisper hallucinations on role play statement scoring. ### **Summary** Some users may see unexpected low statement scores in their AI role play sessions caused by transcription artifacts — not by anything they actually said. We've deployed a mitigation for the most commonly seen artifact and will continue to monitor for additional patterns. ### **Who Is Affected** - Learners using the AI-powered practice (OpenAI Realtime) feature - More likely to occur when users are in a noisy environment, using device speakers instead of headphones, or experiencing audio feedback or echo during their session - Not affected: users on the Deepgram STT path ### **What You Might Notice** - A statement score of 40 or lower appears with feedback indicating the response was "completely irrelevant to the conversation context" - The flagged statement does not match anything the user said - Unusual characters or phrases appear in the transcript, such as Korean characters or short out-of-context phrases - The user's actual speech is transcribed correctly — only the artifact statement appears out of place, often as a separate "statement" in Brevity with its own feedback. - The rest of the session score and feedback looks normal ### **What's Happening (High-Level)** The AI role play feature uses OpenAI's Realtime API, which is powered by a Whisper-based speech-to-text model. Whisper is designed to be highly confident in its transcriptions — but as a side effect, when it receives brief, degraded, or ambiguous audio (such as echo from device speakers, mic feedback, or background noise), it can generate a short, plausible-sounding phrase rather than returning silence. This is a known characteristic of Whisper-based models and is not unique to our platform. These phantom phrases were being treated as real user statements and scored, which could result in an unfairly low score for that turn. ### **What We've Done** We've implemented a hallucination denylist that filters known artifact phrases before they reach the transcript, scoring, or backend. The most commonly seen artifact — a Korean news anchor phrase introduced by the Whisper model — is now filtered automatically. We are actively monitoring session data for new patterns and will expand the denylist as needed. ### **What To Do** To reduce the likelihood of audio quality issues during sessions: - Use headphones or earbuds whenever possible — this is the most effective way to prevent the AI's audio from bleeding into your microphone - Use the mute button when not speaking, particularly in shared or noisy spaces - Avoid using device speakers during a session If a session has been affected and scores appear unfairly low, please contact your administrator or support so the session can be reviewed manually. ### **Current Status** ⚠️ Monitoring — Mitigation deployed March 3, 2026. Known artifact patterns are now filtered. We are continuing to monitor for additional hallucination patterns. ### **When to Contact Support** If you or a learner receives a flagged low score that does not match what was said during the session, please reach out to support with the session details so it can be reviewed manually. **Last Updated***: March 3, 2026* - [New Features and Updates](https://support.brevitypitch.com/en-us/knowledgebase/new-features-and-updates?hsLang=en-us#main-content) - [Training Plans](https://support.brevitypitch.com/en-us/knowledgebase/new-features-and-updates?hsLang=en-us#training-plans) - [Meeting Analyzer](https://support.brevitypitch.com/en-us/knowledgebase/new-features-and-updates?hsLang=en-us#meeting-analyzer) - [Role Play](https://support.brevitypitch.com/en-us/knowledgebase/new-features-and-updates?hsLang=en-us#role-play) - [Administration](https://support.brevitypitch.com/en-us/knowledgebase/new-features-and-updates?hsLang=en-us#administration) - [Overview & Getting Started](https://support.brevitypitch.com/en-us/knowledgebase/overview-getting-started?hsLang=en-us#main-content) - [What is Brevity?](https://support.brevitypitch.com/en-us/knowledgebase/overview-getting-started?hsLang=en-us#what-is-brevity) - [Getting Started](https://support.brevitypitch.com/en-us/knowledgebase/overview-getting-started?hsLang=en-us#getting-started) - [Admin & Enablement](https://support.brevitypitch.com/en-us/knowledgebase/admin-enablement?hsLang=en-us#main-content) - [Managing Users, Teams, & User Groups](https://support.brevitypitch.com/en-us/knowledgebase/admin-enablement?hsLang=en-us#managing-users-teams-user-groups) - [Admin Settings](https://support.brevitypitch.com/en-us/knowledgebase/admin-enablement?hsLang=en-us#admin-settings) - [Enablement Best Practices](https://support.brevitypitch.com/en-us/knowledgebase/admin-enablement?hsLang=en-us#enablement-best-practices) - [User Logs](https://support.brevitypitch.com/en-us/knowledgebase/admin-enablement?hsLang=en-us#user-logs) - [Integrations](https://support.brevitypitch.com/en-us/knowledgebase/admin-enablement?hsLang=en-us#integrations) - [Managing Users & Teams](https://support.brevitypitch.com/en-us/knowledgebase/admin-enablement?hsLang=en-us#managing-users-teams) - [Using Brevity](https://support.brevitypitch.com/en-us/knowledgebase/using-brevity?hsLang=en-us#main-content) - [Agent Hub](https://support.brevitypitch.com/en-us/knowledgebase/using-brevity?hsLang=en-us#agent-hub) - [Creating Role Plays](https://support.brevitypitch.com/en-us/knowledgebase/using-brevity?hsLang=en-us#creating-role-plays) - [Creating & Managing Assignments](https://support.brevitypitch.com/en-us/knowledgebase/using-brevity?hsLang=en-us#creating-managing-assignments) - [Creating Training Plans](https://support.brevitypitch.com/en-us/knowledgebase/using-brevity?hsLang=en-us#creating-training-plans) - [Repository](https://support.brevitypitch.com/en-us/knowledgebase/using-brevity?hsLang=en-us#repository) - [Practicing Role Plays](https://support.brevitypitch.com/en-us/knowledgebase/using-brevity?hsLang=en-us#practicing-role-plays) - [Working Through Your Training Plan](https://support.brevitypitch.com/en-us/knowledgebase/using-brevity?hsLang=en-us#working-through-your-training-plan) - [Meetings](https://support.brevitypitch.com/en-us/knowledgebase/using-brevity?hsLang=en-us#meetings) - [Playbook](https://support.brevitypitch.com/en-us/knowledgebase/using-brevity?hsLang=en-us#playbook) - [Scores, Feedback, & Analytics](https://support.brevitypitch.com/en-us/knowledgebase/scores-feedback-analytics?hsLang=en-us#main-content) - [Viewing Feedback](https://support.brevitypitch.com/en-us/knowledgebase/scores-feedback-analytics?hsLang=en-us#viewing-feedback) - [Interpreting Results](https://support.brevitypitch.com/en-us/knowledgebase/scores-feedback-analytics?hsLang=en-us#interpreting-results) - [Reporting & Analytics](https://support.brevitypitch.com/en-us/knowledgebase/scores-feedback-analytics?hsLang=en-us#reporting-analytics) - [Training Plans](https://support.brevitypitch.com/en-us/knowledgebase/scores-feedback-analytics?hsLang=en-us#training-plans) - [IT, Security, & Compliance](https://support.brevitypitch.com/en-us/knowledgebase/it-security-compliance?hsLang=en-us#main-content) - [Network & Access](https://support.brevitypitch.com/en-us/knowledgebase/it-security-compliance?hsLang=en-us#network-access) - [Troubleshooting](https://support.brevitypitch.com/en-us/knowledgebase/troubleshooting?hsLang=en-us#main-content) - [Account & Access Issues](https://support.brevitypitch.com/en-us/knowledgebase/troubleshooting?hsLang=en-us#account-access-issues) - [Audio & Role Play Issues](https://support.brevitypitch.com/en-us/knowledgebase/troubleshooting?hsLang=en-us#audio-role-play-issues) - [Assignments & Scoring](https://support.brevitypitch.com/en-us/knowledgebase/troubleshooting?hsLang=en-us#assignments-scoring) - [Integrations](https://support.brevitypitch.com/en-us/knowledgebase/troubleshooting?hsLang=en-us#integrations) - [Known Issues & Status](https://support.brevitypitch.com/en-us/knowledgebase/known-issues-status?hsLang=en-us#main-content) - [Active Known Issues](https://support.brevitypitch.com/en-us/knowledgebase/known-issues-status?hsLang=en-us#active-known-issues) - [Resolved Known Issues](https://support.brevitypitch.com/en-us/knowledgebase/known-issues-status?hsLang=en-us#resolved-known-issues) [![](https://support.brevitypitch.com/hs-fs/hubfs/Brevlogo.png?width=200&height=51&name=Brevlogo.png)](http://brevitypitch.com) The Revenue Performance Platform [mailto:support@brevitypitch.com](mailto:support@brevitypitch.com) Copyright © 2025, Brevity Technologies, Inc.