Yet Another Example of ChatGPT’s Evasive Tactics During Long Conversations: Japanese Rock Song Lyrics Case

Abstract

Much attention has been devoted to the ChatGPT and other Large Language Models’ (LLM) capability assessment regarding syntax correctness, factual accuracy, adequate world representation, ethical alignment, common sense and formal logic reasoning. However, most of the research focused on "statically" generated texts, when the result of only a single iteration between a human and LLMs was recorded. More advanced techniques of open-ended discussions or debates between a human and LLMs produce much more interesting results, demonstrating such faulty rhetorical behaviours as circular arguments, self-contradictions, evasion, change of topic, lack of consistent position, and the mix of passive aggression with attempts to please human disputant. We present an original observation of such behaviour during the ChatGPT dialogue session discussing the translation of Japanese song lyrics.

Ähnliche Arbeiten