Towards applying a time-aware Bert model to structured EHR records to generate contextualized concept embeddings

The aim of this study was to combine the time-aware concept embedding model with the state of the art language model BERT to generate both time-aware and context aware concept embeddings. The preliminary results show promise that the two attention mechanisms can be incorporated. Research Category (please highlight or circle which category best describes your research) Methodological research