Application of large language models in government affairs

Tao Fu; Bin Lv

doi:10.47297/wspciWSP2516-252720.20240805

PDF
导出
分享
收藏
专辑

Application of large language models in government affairs

8卷第5期

浏览量: 0 Downloads: 0

Application of large language models in government affairs
Application of large language models in government affairs
1.Information Management Center, Yunnan University of Finance and Economics, Kunming;650221, China
2.School of Logistics and Engineering Management, Yunnan University of Finance and Economics, Kunming650221, China
2024年8卷第5期页码：115-125
纸质出版日期： 2024-10-31 ，
DOI：10.47297/wspciWSP2516-252720.20240805
Accepted：

Scan QR Code

(2024). Application of large language models in government affairs. 创意与创新（英文版）, 8(5), 115-125.

Fu Tao,Lv Bin.Application of large language models in government affairs[J].Creativity and Innovation,2024,08(05):115-125.
(2024). Application of large language models in government affairs. 创意与创新（英文版）, 8(5), 115-125. DOI： 10.47297/wspciWSP2516-252720.20240805.

Fu Tao,Lv Bin.Application of large language models in government affairs[J].Creativity and Innovation,2024,08(05):115-125. DOI： 10.47297/wspciWSP2516-252720.20240805.

摘要

Abstract

In recent years

with the rapid development of artificial intelligence technology

large language models (LLMs) have been widely used in the field of natural language processing. This paper discusses the application of LLMS in the field of government affairs. These models show significant advantages in policy management and intelligent question and answer with their powerful language understanding and generation ability. Studies have shown that large language models can significantly improve the efficiency of policy document interpretation and analysis

and improve the public's access to policy information. At the same time

the paper also discusses practical application challenges

including data privacy and technology dependence

and proposes corresponding countermeasures. This paper aims to provide theoretical support and practical guidance for government departments to use artificial intelligence technology to improve work efficiency and service quality

and open up a new perspective for technological development in the field of government administration.

关键词

Keywords

Artificial intelligenceGovernment administrationIntelligent question and answer

references

Radford A , Narasimhan K .Improving Language Understanding by Generative Pre-Training[J]. 2018.

Hochreiter S , Schmidhuber J .Long Short-Term Memory[J].Neural Computation, 1997,9(8):1735-1780.DOI:10.1162/neco.1997.9.8.1735.

Gers Felix A , Schmidhuber J .Long Short-Term Memory Learns Context Free Languages[J].Neural Computation, 2000, 9(8):

1735 - 1780.DOI:10.1162/neco.1997.9.8.1735.

Tianyang L ,Yuxin W ,Xiangyang L , et al.A survey of transformers[J].AI Open,2022,3111- 132.

Devlin J , Chang M W , Lee K ,et al.BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding[J]. 2018.

Brown T B , Mann B , Ryder N ,et al.Language Models are Few-Shot Learners[J]. 2020.DOI:10.48550/arXiv.2005.14165.

Chowdhery A , Narang S , Devlin J ,et al.PaLM: Scaling Language Modeling with Pathways[J].2022.

Subramanyam K K . A survey of GPT-3 family large language models including ChatGPT and GPT-4 [J]. Natural Language Processing Journal, 2024, 6 100048-.

WEI J, TAY Y, BOMMASANI R, et al. Emergent abilities of large language models[J/OL]. arXiv:2206.07682, 2022. [2023- 11- 20]

Maynez J , Narayan S , Bohnet B ,et al.On Faithfulness and Factuality in Abstractive Summarization[J].2020.DOI:10.18653/v1/2020.acl-main.173.

GUU K, LEE K, TUNG Z, et al. Retrieval augmented language model pre- training[C]//Proceedings ofthe 37th International Conference on Machine Learning, Vienna. New York:PMLR, 2020: 3929-3938.

DETTMERS T, PAGNONI A, HOLTZMAN A, et al.Qlora: Efficient finetuning of quantized llms[J/OL].arXiv preprint arXiv:2305.14314, 2023. [2023- 11-20] .

Hu E J ,Shen Y ,Wallis P ,et al.LoRA: Low-Rank Adaptation of Large Language Models[J].2021.