KnowledgeExtractionToolEval
From STLab
(→A landscape analysis of some knowledge extraction tools) |
(→A landscape analysis of some knowledge extraction tools) |
||
| Line 3: | Line 3: | ||
This page includes the complete results for a landscape analysis of Knowledge Extraction (KE) tools. | This page includes the complete results for a landscape analysis of Knowledge Extraction (KE) tools. | ||
| - | A technical report about the analysis can be downloaded [http://stlab.istc.cnr.it/documents/papers/ketoolstudy.pdf here]. | + | A technical report about the analysis (including only some of the results) can be downloaded [http://stlab.istc.cnr.it/documents/papers/ketoolstudy.pdf here]. |
The table shows, for each ''basic NLP task'' corresponding to a ''basic knowledge engineering task'' (e.g. '''sense tagging''' in NLP roughly maps to '''entity typing''' in KE), the absolute and normalized results (in terms of precision, recall, and F-measure) obtained by each KE tool. | The table shows, for each ''basic NLP task'' corresponding to a ''basic knowledge engineering task'' (e.g. '''sense tagging''' in NLP roughly maps to '''entity typing''' in KE), the absolute and normalized results (in terms of precision, recall, and F-measure) obtained by each KE tool. | ||
| Line 11: | Line 11: | ||
Values in red are better than the merged ones; values in green are within a .2 slot below the merged ones. | Values in red are better than the merged ones; values in green are within a .2 slot below the merged ones. | ||
| - | [[Image: | + | [[Image:Results2.png|800px]] |
Revision as of 14:50, 24 January 2013
A landscape analysis of some knowledge extraction tools
This page includes the complete results for a landscape analysis of Knowledge Extraction (KE) tools.
A technical report about the analysis (including only some of the results) can be downloaded here.
The table shows, for each basic NLP task corresponding to a basic knowledge engineering task (e.g. sense tagging in NLP roughly maps to entity typing in KE), the absolute and normalized results (in terms of precision, recall, and F-measure) obtained by each KE tool.
The Merging column contains the results when all outputs are merged. The merged results are also used as the upper limit for evaluating the recall and f-measure of the individual tools.
Values in red are better than the merged ones; values in green are within a .2 slot below the merged ones.
