Challenges of Deep Learning in Natural Language Processing: A Healthcare-Oriented Perspective

  • Authors

    • Madhurima Kommuru Senior System Analyst at UST Global Inc., USA. Author
    • Swathi Thatraju QA Analyst at ZumeIT, USA. Author
    • Appala Nooka Kumar Doodala QA Analyst, Infosys, USA. Author

    DOI:

    https://doi.org/10.67228/3142788X/IJMLPA-2020PII4WV3

    Published 09-05-2020

  • Deep Learning, Natural Language Processing, Healthcare Analytics, Clinical Text Mining, Electronic Health Records (EHR), Explainable Artificial Intelligence (XAI), Medical Language Processing, Data Privacy And Security, Domain Adaptation, Transformer Models

    Issue

    Section

    Articles

    How to Cite

    [1]
    M. Kommuru, S. Thatraju, and A. N. K. Doodala, “Challenges of Deep Learning in Natural Language Processing: A Healthcare-Oriented Perspective”, IJMLPA, vol. 3, no. 2, pp. 01–19, Sep. 2020, doi: 10.67228/3142788X/IJMLPA-2020PII4WV3.
  • Abstract

    In recent years, natural language processing has become an important tool in healthcare for extracting useful information from unstructured clinical text such as electronic health records, physician notes, and medical literature. Deep learning has significantly improved the performance of NLP systems, enabling stronger results in tasks such as disease prediction, clinical decision support, and patient risk assessment. However, healthcare NLP still faces major challenges in real-world deployment. Clinical text is often noisy, fragmented, and inconsistent, which can reduce model reliability. In addition, deep learning models lack transparency, which limits their adoption by clinicians who require explainable outputs for clinical decision-making. Privacy and security also remain major barriers because patient data is highly sensitive and subject to strict legal and ethical requirements. Bias in training data can further lead to uneven performance across patient populations. This paper combines a literature review with a healthcare-oriented case study to examine these issues in real-world settings. The findings show that although deep learning offers strong potential for healthcare analytics, progress depends on solving problems related to data quality, interpretability, privacy, and domain adaptation.

  • References

    [1] Devlin, Jacob, et al. "Bert: Pre-training of deep bidirectional transformers for language understanding." Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (long and short papers). 2019.

    [2] Lee, Jinhyuk, et al. "BioBERT: a pre-trained biomedical language representation model for biomedical text mining." Bioinformatics 36.4 (2020): 1234-1240.

    [3] Alsentzer, Emily, et al. "Publicly available clinical BERT embeddings." Proceedings of the 2nd clinical natural language processing workshop. 2019.

    [4] Huang, Kexin, Jaan Altosaar, and Rajesh Ranganath. "Clinicalbert: Modeling clinical notes and predicting hospital readmission." arXiv preprint arXiv:1904.05342 (2019).

    [5] Johnson, Alistair EW, et al. "MIMIC-III, a freely accessible critical care database." Scientific data 3.1 (2016): 1-9.

    [6] Ashish, Vaswani. "Attention is all you need." Advances in neural information processing systems 30 (2017): I.

    [7] Jagannatha, Abhyuday, and Hong Yu. "Bidirectional RNN for medical event detection in electronic health records." Proceedings of the 2016 conference of the north American chapter of the association for computational linguistics: Human language technologies. 2016.

    [8] Habibi, Maryam, et al. "Deep learning with word embeddings improves biomedical named entity recognition." Bioinformatics 33.14 (2017): i37-i48.

    [9] Dernoncourt, Franck, Ji-Young Lee, and Peter Szolovits. "Neural networks for joint sentence classification in medical paper abstracts." Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers. 2017.

    [10] Rajkomar, Alvin, et al. "Scalable and accurate deep learning with electronic health records." NPJ digital medicine 1.1 (2018): 18.

    [11] Cabitza, Federico, and Carlo Batini. "Information quality in healthcare." Data and information quality: Dimensions, principles and techniques. Cham: Springer International Publishing, 2016. 403-419.

    [12] Al-Muhtadi, Jalal, et al. "Cybersecurity and privacy issues for socially integrated mobile healthcare applications operating in a multi-cloud environment." Health informatics journal 25.2 (2019): 315-329.

    [13] Mavropoulos, Thanassis, et al. "A smart dialogue-competent monitoring framework supporting people in rehabilitation." Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments. 2019.

    [14] Willis, Matt. "National digital infrastructures for healthcare: A comparative case of Estonian and British healthcare infrastructure." (2018).

    [15] Alam, Mansaf, Shuchi Sethi, and Kashish A. Shakil. "Distributed machine learning based biocloud prototype." International Journal of Applied Engineering Research 10.17 (2015): 37578-37583.

  • Downloads