Borji A. (2023). A categorical archive of ChatGPT failures. arXiv preprint arXiv:2302.03494.

Brown T., Mann B., Ryder N., Subbiah M., Kaplan J. D., Dhariwal P., et al. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33:1877–1901.

Bubeck S., Chandrasekaran V., Eldan R., Gehrke J., Horvitz E., Kamar E., et al. (2023). Sparks of artificial general intelligence: Early experiments with GPT-4. arXiv preprint arXiv:2303.12712.

Chen M., Tworek J., Jun H., Yuan Q., Pinto H. P. d. O., Kaplan J., et al. (2021). Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374.

Chowdhery A., Narang S., Devlin J., Bosma M., Mishra G., Roberts A., et al. (2022). PaLM: Scaling language modeling with pathways. arXiv preprint arXiv:2204.02311.

Fu, Yao; Peng, Hao and Khot, Tushar. (2022). How does GPT Obtain its Ability? Tracing Emergent Abilities of Language Models to their Sources. Yao Fu's Notion. https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tracing-Emergent-Abilities-of-Language-Models-to-their-Sources-b9a57ac0fcf74f30a1ab9e3e36fa1dc1https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tracing-Emergent-Abilities-of-Language-Models-to-their-Sources-b9a57ac0fcf74f30a1ab9e3e36fa1dc1

Goodfellow I., Bengio Y., and Courville A. (2016). Deep Learning. MIT Press.

Jiang A. Q., Li W., Tworkowski S., Czechowski K., Odrzygóźdź T., Miłoś P., et al. (2022). Thor: Wielding hammers to integrate language models and automated theorem provers. Advances in Neural Information Processing Systems, 35:8360–8373.

Kıcıman E., Ness R., Sharma A., and Tan C. (2023). Causal reasoning and large language models: Opening a new frontier for causality. arXiv preprint arXiv:2305.00050.

Kojima T., Gu S. S., Reid M., Matsuo Y., and Iwasawa Y. (2023). Large language models are zero-shot reasoners. arXiv preprint arXiv:2205.11916.

LeCun Y., Bengio Y., and Hinton G. (2015). Deep learning. Nature, 521(7553):436–444.

Li H. (2017). Deep learning for natural language processing: Advantages and challenges. National Science Review, 5(1):24–26.

OpenAI. (2023). GPT-4 technical report.

Radford A., Wu J., Child R., Luan D., Amodei D., Sutskever I., et al. (2019). Language models are unsupervised multitask learners. OpenAI Blog.

Saba W. S. (2018). A simple machine learning method for commonsense reasoning? A short commentary on Trinh & Le (2018). arXiv preprint arXiv:1810.00521.

Sun Y., Wang S., Feng S., Ding S., Pang C., Shang J., et al. (2021). ERNIE 3.0: Large-scale knowledge enhanced pre-training for language understanding and generation. arXiv preprint arXiv:2107.02137.

Tu S., Li C., Yu J., Wang X., Hou L., and Li J. (2023). ChatLog: Recording and analyzing chatgpt across time. arXiv preprint arXiv:2304.14106.

Wang S., Sun Y., Xiang Y., Wu Z., Ding S., Gong W., et al. (2021). ERNIE 3.0 Titan: Exploring larger-scale knowledge enhanced pre-training for language understanding and generation. arXiv preprint arXiv:2112.12731.

Wei J., Tay Y., Bommasani R., Raffel C., Zoph B., Borgeaud S., et al. (2022). Emergent abilities of large language models. arXiv preprint arXiv:2206.07682.

Wei J., Wang X., Schuurmans D., Bosma M., Chi E., Le Q., and Zhou D. (2023). Chain of thought prompting elicits reasoning in large language models. arXiv preprint arXiv:2201.11903.

Wu Y., Jiang A. Q., Li W., Rabe M., Staats C., Jamnik M., and Szegedy C. (2022). Autoformalization with large language models. Advances in Neural Information Processing Systems, 35:32353–32368.

Zhang C., Zhang C., Li C., Qiao Y., Zheng S., Dam S. K., et al. (2023). One small step for generative AI, one giant leap for AGI: A complete survey on ChatGPT in AIGC era. arXiv preprint arXiv:2304.06488.

Zheng K., Han J. M., and Polu S. (2022). miniF2F: A cross-system benchmark for formal olympiad-level mathematics. In Proceedings of the International Conference on Learning Representations.

林田,任晓明. (2023). 对话机器、深度学习与人工智能"新经验主义革命"的功与过. 认知科学.

徐超. (2023). 基于认知的自然语言自动形式化研究. 中国社会科学出版社.