Annotation Lab offer testing features for projects that reuse existing models/rules. In other words, if a project’s configuration references one or several (pre)trained models/rules it is possible to check how efficient those are when applied on custom data.
Test Configuration feature is available on the
Train page, accessible from the Project Menu. During the training, a progress bar is shown on the top of the train page to show the status of the testing.
Note This feature is available for Project Owners or Managers.
Test Configuration feature applies to project tasks with status submitted or reviewed, and which are tagged as Test.
After the evaluaton is completed, the resulting logs can be downloaded to view the performance metrics.
Note: Model evaluation can only be triggered in the presence of a valid Healthcare, Finance or/and Legal NLP license.