[FEATURE REQUEST] Option for label ranking in outputs #156

New issue

Open

opened 2025-10-14 16:28:13 -06:00 by navan · 0 comments

navan commented

2025-10-14 16:28:13 -06:00

Owner

Originally created by @AndriyMulyar on 12/22/2018

Description
A CRF produces label probability outputs. Currently, we are simply using the highest probability label as the predicted entity label. It would be useful to allow for an option to output a label ranking for a given token.

Uses
Multi-label prediction, hierarchical label prediction. Capable of handling nested entities.

Where to get started
A contributor would simply have to interface the correct attributes set by the sklearn-crfsuite wrapper into the Annotation class. Some discussion would have to be had to insure compatibility with other parts of the package.

*Originally created by @AndriyMulyar on 12/22/2018* **Description** A CRF produces label probability outputs. Currently, we are simply using the highest probability label as the predicted entity label. It would be useful to allow for an option to output a label ranking for a given token. **Uses** Multi-label prediction, hierarchical label prediction. Capable of handling nested entities. **Where to get started** A contributor would simply have to interface the correct attributes set by the [sklearn-crfsuite](https://sklearn-crfsuite.readthedocs.io/en/latest/) wrapper into the Annotation class. Some discussion would have to be had to insure compatibility with other parts of the package.