Automatic keyword retrieval from clinical texts: an application of natural language processing to massive data of Chilean suspected diagnosis

Villena, F; Dunstan, J

Keywords: natural language processing, data mining, machine learning, medical informatics, information storage and retrieval

Abstract

Background: Free-text imposes a challenge in health data analysis since the lack of structure makes the extraction and integration of information difficult, particularly in the case of massive data. An appropriate machine-interpretation of electronic health records in Chile can unleash knowledge contained in large volumes of clinical texts, expanding clinical management and national research capabilities. Aim: To illustrate the use of a weighted frequency algorithm to find keywords. This finding was carried out in the diagnostic suspicion field of the Chilean specialty consultation waiting list, for diseases not covered by the Chilean Explicit Health Guarantees plan. Material and Methods: The waiting lists for a first specialty consultation for the period 2008-2018 were obtained from 17 out of 29 Chilean health services, and total of 2,592,925 diagnostic suspicions were identified. A natural language processing technique called Term Frequency- Inverse Document Frequency was used for the retrieval of diagnostic suspicion keywords. Results: For each specialty, four key words with the highest weighted frequency were determined. Word clouds showing words weighted by their importance were created to obtain a visual representation. These are available at cimt.uchile.cl/lechile/. Conclusions: The algorithm allowed to summarize unstructured clinical free-text data, improving its usefulness and accessibility.

Más información

Título según WOS: Automatic keyword retrieval from clinical texts: an application of natural language processing to massive data of Chilean suspected diagnosis
Título de la Revista: REVISTA MEDICA DE CHILE
Volumen: 147
Número: 10
Editorial: Sociedad Médica de Santiago
Fecha de publicación: 2019
Página de inicio: 1229
Página final: 1238
Idioma: Spanish
Notas: ISI