Analysis of Core Technology Stacks for Big Data Engineers Based on Recruitment Data Mining

Minjia Zhou

doi:10.47297/wspeiWSP2516-253513.20250906

PDF
Export
Share
Collection
Album

Analysis of Core Technology Stacks for Big Data Engineers Based on Recruitment Data Mining

Volume 9, Issue 6

Views: 0 Downloads: 0

Analysis of Core Technology Stacks for Big Data Engineers Based on Recruitment Data Mining
Analysis of Core Technology Stacks for Big Data Engineers Based on Recruitment Data Mining
Faculty of Science, Civil Aviation Flight University of China, Chengdu, Sichuan, 641419, China
Vol. 9, Issue 6, Pages: 67-71(2025)
Published：30 December 2025
DOI：10.47297/wspeiWSP2516-253513.20250906
Accepted：

Scan QR Code

Zhou Minjia.Analysis of Core Technology Stacks for Big Data Engineers Based on Recruitment Data Mining[J].Entrepreneurship and Innovation,2025,09(06):67-71.
DOI：

Zhou Minjia.Analysis of Core Technology Stacks for Big Data Engineers Based on Recruitment Data Mining[J].Entrepreneurship and Innovation,2025,09(06):67-71. DOI： 10.47297/wspeiWSP2516-253513.20250906.

摘要

Abstract

During the job-seeking process

many students face information asymmetry due to a lack of clarity regarding specific technical requirements for various positions. To address this issue

this study examines recruitment data for Big Data Engineers sourced from a Chinese campus recruitment platform. Utilizing Selenium-based automated web scraping

raw data were collected and subsequently processed through data cleaning

text mining

and word frequency analysis to extract core technology stacks. The findings were visually represented using word cloud visualizations.Research results demonstrate that the core technology stacks for Big Data Engineers are concentrated in several key domains—programming languages

data storage

big data frameworks

artificial intelligence technologies

Network Technology and utility tools. This study provides graduates with a data-driven reference for technical requirements based on real-world recruitment trends and offers a reproducible methodology for data mining research involving Chinese-language recruitment information.

关键词

Keywords

references

Zhang X. , & Zheng Y . ( 2024 ). Employment challenges and countermeasures for undergraduate students under the new economic normal . Henan Economic News , p. 011 .

Guo J . ( 2024 ). Research on recruitment data crawling and data visualization analysis based on Python . Light Industry Science and Technology , 40 ( 02 ), 94 – 96+99 .

Zeng J. , Liao S. Z. , & Chen Y . X . ( 2025 ). Analysis and visualization research of AI job recruitment data based on Python. Modern Information Technology , 9 ( 13 ), 90 – 94 .

Zhang S . Q . ( 2024 ). Python-based data crawling and visualization analysis of big data recruitment posts on a direct recruitment platform. Computer Knowledge and Technology , 20 ( 36 ), 63 – 66 .

Tong F. , & Xu J . N . ( 2024 ). Analysis of professional talent positions and skill requirements based on text mining: A case study of the accounting profession. Commercial Accounting , ( 09 ), 126 – 129 .

Xu Z. L. , Wen B. X. , Xie M. Y. , et al . ( 2021 ). Research on AI job demand analysis based on big data technology . Guangxi Sciences , 28 ( 03 ), 321 – 329 .

Alert me when the article has been cited

Submit

No data

Related Author

No data

Related Institution

No data

⁰