According to God of Prompt on Twitter, researchers have identified a 0.32 correlation between an AI model's ability to reproduce GSM8k test examples and its performance gap. This finding suggests that models which can recite test questions tend to perform worse when faced with new, unseen questions. As reported by God of Prompt, the implication is that these models may be memorizing answers rather than demonstrating true problem-solving capabilities, raising concerns about the validity of current AI evaluation benchmarks.