HeartBERT : A language model pre-trained on anopen source dataset for cardiac text mining
crossref(2024)
摘要
Abstract The advent of the Transformer has significantly altered the course of research in Natural Language Processing (NLP) within thedomain of deep learning, making Transformer-based studies the mainstream in subsequent NLP research. There has alsobeen considerable advancement in domain-specific NLP research, including the development of specialized language modelsfor medical. These medical-specific language models were trained on medical data and demonstrated high performance. Whilethese studies have treated the medical field as a single domain, in reality, medical is divided into multiple departments, eachrequiring a high level of expertise and treated as a unique domain. Recognizing this, our research focuses on constructinga model specialized for cardiology within the medical sector. Our study encompasses the creation of open-source datasets,training, and model evaluation in this nuanced domain.
更多查看译文
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要