欢迎访问《图学学报》 分享到：
图学学报

图学学报 ›› 2022, Vol. 43 ›› Issue (3): 530-536.DOI: 10.11996/JG.j.2095-302X.2022030530

• 建筑与城市信息模型 • 上一篇    下一篇

基于 BERT 预训练模型的灾害推文分类方法

  

  1. 清华大学土木工程系，北京 100084
  • 出版日期:2022-06-30 发布日期:2022-06-28
  • 基金资助:
    国家自然科学基金项目(72091512，51908323)

Disaster tweets classification method based on pretrained BERT model

  1. Department of Civil Engineering, Tsinghua University, Beijing 100084, China
  • Online:2022-06-30 Published:2022-06-28
  • Supported by:
    National Natural Science Foundation of China (72091512, 51908323)

PDF (PC)

124

摘要：

社交媒体已成为当前发布和传播突发灾害信息的重要媒介，有效识别并利用其中的真实信息对灾害应急管理具有重要意义。针对传统文本分类模型的不足，提出一种基于 BERT 预训练模型的灾害推文分类方法。经数据清洗、预处理及算法对比分析，在 BERT 预训练模型基础上，研究构建了基于长短期记忆-卷积神经网络(LSTM-CNN)的文本分类模型。在 Kaggle 竞赛平台的推文数据集上的实验表明，相比传统的朴素贝叶斯分类模型和常见的微调模型，该分类模型性能表现优异，识别率可达 85%，可以更好地应对小样本分类问题。有关工作对精准识别真实灾害信息、提高灾害应急响应与沟通效率具有重要意义。

关键词: 文本分类, 深度学习, BERT, 预训练模型, 微调, 灾害, 应急管理

Abstract:

Social media has become an important medium for the release and dissemination of disaster information, the effective identification and utilization of which is of great significance to disaster emergency management. Given the shortcomings of the traditional text classification model, a disaster tweet classification method was proposed based on the pre-trained model of bidirectional encoder representations from transformers (BERT). After data cleaning and preprocessing, this study constructed a text classification model based on long short-term memory-convolutional neural network (LSTM-CNN) through comparative analysis, based on BERT. Experiments on the tweet datasets of the Kaggle competition platform showed that the proposed classification model outperforms the traditional Naive Bayesian classification model and the common fine-tuning model, with the recognition rate up to 85%. This study could shed significant light on enhancing the identification accuracy of real disaster information and the efficiency of disaster emergency response.

Key words: text classification, deep learning, BERT, pre-trained model, fine-tuning, disaster, emergency management

中图分类号: