Issue Identification of Overseas Construction Markets from News Articles Based on BERTopic

Joonwoo Baik; Sehwan Chung; Seokho Chi

doi:10.55785/JCAR.2.2.21

All Issue

2023 Vol.2, Issue 2 Preview Page

Issue Identification of Overseas Construction Markets from News Articles Based on BERTopic BERTopic 기반 뉴스기사 토픽 모델링을 활용한 해외건설 시장 이슈 도출

30 June 2023. pp. 21-26

PDF XML

Abstract

Understanding the issues of overseas construction markets is crucial for the successful delivery of the construction projects. News articles cover various local issues and thus can be used for an analysis of the issues of the construction market. Topic modeling is the method to extract major topics from text data by grouping the text automatically, and it can be used to extract the major issues from the text data in news articles. This study applied BERTopic, a representative topic modeling method, to the extraction of issues in an overseas construction market. A total of 6,273 BBC news articles were collected for the experimental and validation purpose of the proposed BERTopic method. The results show BERTopic can effectively extract major issues from the news text and represent the issues in an easy-to-understand manner. It is expected that risks of an overseas construction project are identified in advance and mitigated by the support from BERTopic modeling.

Keywords

Overseas Construction

News Article

Topic Modeling

BERTopic

해외건설 시장의 최신 이슈를 파악하는 것은 성공적인 사업 수행을 위해 매우 중요하다. 해외 뉴스기사는 현지에서 발생하는 다양한 사건을 다루기에 이를 분석한다면 효과적으로 해외건설 시장의 이슈를 파악할 수 있다. 토픽 모델링은 텍스트 데이터를 자동으로 군집화함으로써 데이터로부터 주요 토픽을 추출하는 기법이며, 뉴스기사로부터 현지의 주요 이슈를 도출하는 데 활용될 수 있다. 본 연구에서는 대표적인 토픽 모델링 기법인 BERTopic을 뉴스기사 텍스트에 적용하여 해외건설 시장의 이슈를 자동으로 파악하고자 하였다. 실험 및 검증을 위해 BBC 뉴스기사 6,273건을 수집하여 BERTopic 기법을 적용하고 도출된 토픽을 해석하였다. 적용 결과, BERTopic 기법은 뉴스기사 텍스트로부터 주요 이슈들을 이해하기 쉬운 형태로 효과적으로 도출할 수 있음을 확인하였다. 이는 해외건설 사업 수행 시 시시각각 변하는 시장의 이슈를 즉각 파악하여 리스크를 줄이는데 도움을 줄 것이다.

키워드

해외건설

뉴스기사

토픽 모델링

BERTopic

References

Abuzayed, A., and Al-Khalifa, H. (2021). BERT for Arabic topic modeling: An experimental study on BERTopic technique. Procedia Computer Science, 189, pp. 191-194. 10.1016/j.procs.2021.05.096

Blei, D. M. (2012). Probabilistic topic models. Communications of the ACM, 55(4), pp. 77-84. 10.1145/2133806.2133826

Choo, S., Park, H., Kim, T., and Seo, J. (2019). Analysis of trends in Korean BIM research and technologies using text mining. Applied Sciences 2019, 9(20), 4424. 10.3390/app9204424

Egger, R., and Yu, J. (2022). A topic modeling comparison between LDA, NMF, Top2Vec, and BERTopic to demystify twitter posts. Frontiers in Sociology, 7. 10.3389/fsoc.2022.88649835602001PMC9120935

Goldszmidt, R. G. B., Brito, L. A. L., and de Vasconcelos, F. C. (2011). Country effect on firm performance: A multilevel approach. Journal of Business Research, 64(3), pp. 273-279. 10.1016/j.jbusres.2009.11.012

Grootendorst, M. (2020). BERTopic: Leveraging BERT and c-TF-IDF to create easily interpretable topics. Zenodo. 10.5281/zenodo.4381785 (Accessed March 15, 2023).

Grootendorst, M. (2022). BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv:2203.05794v0571, https://arxiv.org/pdf/2203.05794.pdf (Accessed March 15, 2023).

Hendry, D., Darari, F., Nurfadillah, R., Khanna, G., Sun, M., Condylis, P. C., and Taufik, N. (2021). Topic modeling for customer service chats. 2021 International Conference on Advanced Computer Science and Information Systems, IEEE, Depok, Indonesia, pp. 1-6. 10.1109/ICACSIS53237.2021.9631322

Hou, S., Zhang, X., Yi, B., and Tang, Y. (2022). Public attitudes on open source communities in China: A text mining analysis. Technology in Society, 71, 102112. 10.1016/j.techsoc.2022.102112

Jallan, Y., Brogan, E., Ashuri, B., and Clevenger, C. M. (2019). Application of natural language processing and text mining to identify patterns in construction-defect litigation cases. Journal of Legal Affairs and Dispute Resolution in Engineering and Construction, 11(4), 04519024. 10.1061/(ASCE)LA.1943-4170.0000308

Javernick-Will, A. N., and Scott, W. R. (2010). Who needs to know what? Institutional knowledge and global projects. Journal of Construction Engineering and Management, 136(5), pp. 546-557. 10.1061/(ASCE)CO.1943-7862.0000035

Jiang, H. C., Qiang, M. S., and Lin, P. (2016). Finding academic concerns of the Three Gorges Project based on a topic modeling approach. Ecological Indicators, 60, pp. 693-701. 10.1016/j.ecolind.2015.08.007

Jung, N., and Lee, G. (2019). Automated classification of building information modeling (BIM) case studies by BIM use based on natural language processing (NLP) and unsupervised learning. Advanced Engineering Informatics, 41, 100917. 10.1016/j.aei.2019.04.007

Lee, S.-G. (2018). A study on the trends of construction safety accident in unstructured text using topic modeling. Journal of the Korea Academia-Industrial Cooperation Society, 19(10), pp. 176-182.

Lin, J. R., Hu, Z. Z., Li, J. L., and Chen, L. M. (2020). Understanding on-site inspection of construction projects based on keyword extraction and topic modeling. IEEE Access, 8, pp. 198503-198517. 10.1109/ACCESS.2020.3035214

Moon, Chung, S., and Chi, S. (2018). Topic Modeling of News Article about International Construction Market Using Latent Dirichlet Allocation. KSCE Journal of Civil and Environmental Engineering Research, 38(4), pp. 595-599.

Wallach, H. M. (2006). Topic modeling: Beyond bag-of-words. Proc. of the 23rd International Conference on Machine Learning, Association for Computing Machinery, New York, USA, pp. 977-984. 10.1145/1143844.1143967

Information

Publisher :Korean Society of Automation and Robotics in Construction
Publisher(Ko) :(사)한국건설자동화·로보틱스학회
Journal Title :Journal of Construction Automation and Robotics
Journal Title(Ko) :건설자동화·로보틱스 논문집
Volume : 2
No :2
Pages :21-26
Received Date : 2023-06-14
Revised Date : 2023-06-19
Accepted Date : 2023-06-21
A Corrigendum to this article was published on 29 December 2023.

This article has been updated.
DOI :https://doi.org/10.55785/JCAR.2.2.21

Journal of Construction Automation and Robotics ISSN:2800-0552(Print) 2951-116X(Online) 건설자동화·로보틱스 논문집

All Issue