AI Hallucinations

Product Feedback
1

I’m dealing with a lot of AI hallucinations while talking to the Coach. I started by asking how I could change a custom strength trainer exercise from measuring in reps to measuring in seconds and also how to duplicate an existing superset so that I can do multiple circuits. The AI gave me detailed instructions for doing both, but the options it told me to select did not exist. After sending a screenshot of what my screen looked like for each, the AI told me that it had been wrong and that this feature was not available in my version of the app. I then asked what it meant by “my version” and if there was another version where the features were available. AI again said that it had been wrong and that my version was the same version everyone on the app has, and that it had pulled the assumption of this feature being available from patterns in other fitness apps on which is gets data.
I then asked if information or feedback is sent back to the developers when the AI realizes it’s wrong, to which the AI said “Yes–this kind of miss does get surfaced back to Whoop”. However, when I prodded further, the AI backtracked saying that it is not automatically flagged and that feedback would need to be sent to the developers directly.
The AI really needs some guardrails in place to make sure it’s not assuming that Whoop has UI features that it actually doesn’t.
It would also be cool if I could toggle exercises from reps to time as well as duplicate supersets.

1 Like
2

Hi @daraxobarbie , thanks for reaching out! Thanks so much for flagging this; the behavior you described from WHOOP Coach isn’t the experience we want, and we understand how frustrating it is to be guided through steps that don’t actually exist in the app.

While Coach responses aren’t automatically flagged in real time, we do have auditing, and additionally, reports like yours are reviewed and shared with the appropriate teams to help improve accuracy and prevent this kind of confusion going forward.

I’ve documented both parts of your feedback:

  • The need for stronger guardrails so Coach doesn’t reference unsupported features.

  • Your feature requests for time-based strength exercises and easier superset duplication.

While we can’t promise timelines or outcomes, this type of input is very helpful to shape improvements.