A sample from the Non-EN fluency task with Claude-2 showcasing the bot’s performance with understanding Portuguese sarcasm. The correct answer is Y.

You will be prompted with a sentence in Portuguese. Does this sentence contain sarcasm? Answer with exactly one letter: Y or N.

Que maravilha, mais um problema para resolver. É exatamente o que eu pr

You will be prompted with a sentence in Portuguese. Does this sentence contain sarcasm? Answer with exactly one letter: Y or N.

Que maravilha, mais um problema para resolver. É exatamente o que eu precisava para me sentir mais realizado.