Custom Named Entity Recognition NER Disease in clinical text with spaCy 2.0 in Python

Опубликовано: 04 Февраль 2025
на канале: Rithesh Sreenivasan

18,237

401

Custom Named Entity (Disease) Recognition in clinical text with spaCy in Python| Natural Language Processing Tutorial | #NLProc

In this video I will be explaining how we perform Custom Named Entity (Disease) Recognition in clinical text with spaCy in Python|.

Here I will be creating a clinical named entity recognition model which can recognize the disease names from clinical text.

For this I have extracted annotated clinical text from the following github repo: https://github.com/dmis-lab/biobert

They provide annotated clinical text here:
Named Entity Recognition: (17.3 MB), 8 datasets on biomedical named entity recognition(https://drive.google.com/open?id=1Ole...)

This custom name entity(disease) recognition model achieves around 90% f1-score on test dataset with close to 20 iterations of training.

The code is present here: https://github.com/rsreetech/CustomNE...

If you are new here and like such content please subscribe to the channel here:
https://www.youtube.com/c/RitheshSree...

If you like to support me financially, It is totally optional and voluntary.
Buy me a coffee here: https://www.buymeacoffee.com/rithesh

Chapters/Timestamps :
00:00 Custom Named Entity (Disease) Recognition in clinical text with spaCy in Python
00:30 Named Entity Recognition
01:41 spaCY
02:19 Custom Named Entity (Disease) Recognition
02:54 Dataset and Pre-processing Steps
08:21 Training a Custom Named Entity (Disease) Recognition in clinical text with spaCy
19:47 Results on Test data

spaCy
https://spacy.io/