Musk Shares AI Comparison Image, Comments on AI Development Changes

Musk shared an image titled "AI then / AI now" and commented with just one word: "Accurate?" The image shows that past machine learning research required designing core methods, proving model effectiveness, and building probabilistic models. In the era of large models, the research process has been simplified to three steps: scaling up the Transformer, providing more data, and adding more GPUs, which in turn enhances model performance. This reflects the current predicament in the large model industry: previously, principles were studied first before designing models, but now it often involves scaling up first and then researching the sources of capabilities.