Best Practices Using Pretrained Models Together

Entity Resolver Models and Features

In the table below, all Entity Resolver models, their features, appropriate embeddings, and AUX info are illustrated.

For instance, features of sbertresolve_ner_model_finder are under FEATURES column and it is trained using sbert_jsl_medium_uncased embeddings. Auxiliary info can be found under the AUX column if it is present.

NOTE: This table is shared just to give you a rough idea about which pretrained models can be used together. You can get better or worse performance by playing out with different models.

NO	MODEL NAME	FEATURES	EMBEDDINGS	LANGUAGE	AUX
1	sbertresolve_ner_model_finder	• Maps clinical entities (NER) to the most appropriate NER model • sbert_jsl_medium_uncased embeddings • Returns a list of pretrained NER models	sbert_jsl_medium_uncased	EN
2	sbiobertresolve_clinical_abbreviation_acronym	• Maps clinical abbreviations and acronyms to their meanings • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
3	sbiobertresolve_cpt	• CPT Codes • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
4	sbiobertresolve_cpt_augmented	• Augmented version of sbiobertresolve_cpt model • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
5	sbiobertresolve_cpt_procedures_augmented	• Procedures to CPT Codes • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
6	sbiobertresolve_cpt_procedures_measurements_augmented	• Procedure and Measurements to CPT Codes • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
7	sbiobertresolve_hcc_augmented	• HCC Codes • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
8	sbiobertresolve_icd10cm	• ICD-10-CM codes • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
9	sbertresolve_icd10gm	• German ICD10-GM Codes • sent_bert_base_cased (DE)	sent_bert_base_cased (DE)	DE
10	sbiobertresolve_icd10cm_augmented	• ICD-10-CM codes • sbiobert_base_cased_mli embeddings • Augmented version of sbiobertresolve_icd10cm model with synonyms, four times richer.	sbiobert_base_cased_mli	EN
11	sbiobertresolve_icd10cm_augmented_billable_hcc	• ICD-10-CM codes • sbiobert_base_cased_mli embeddings • Provides HCC information of the codes in all_k_aux_labels column • This column can be divided to get further details: billable status - hcc status - hcc score.	sbiobert_base_cased_mli	EN	HCC and Billable Information
12	sbiobertresolve_icd10cm_generalised	• ICD-10-CM codes up to 3 Characters (general type of injury or disease) • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
13	sbiobertresolve_icd10cm_slim_billable_hcc	• ICD-10-CM codes • sbiobert_base_cased_mli embeddings • Slim version (synonyms having low cosine similarity to unnormalized terms are dropped) • Provides the official resolution text within the brackets • Provides HCC information of the codes in all_k_aux_labels column. • This column can be divided to get further details: billable status - hcc status - hcc score.	sbiobert_base_cased_mli	EN	HCC and Billable Information
14	sbertresolve_icd10cm_slim_billable_hcc_med	• ICD-10-CM codes • sbert_jsl_medium_uncased embeddings • Slim version (synonyms having low cosine similarity to unnormalized terms are dropped) • Provides the official resolution text within the brackets inside the metadata. • Provides HCC information of the codes in all_k_aux_labels column • This column can be divided to get further details: billable status - hcc status - hcc score.	sbert_jsl_medium_uncased	EN	HCC and Billable Information
15	sbiobertresolve_icd10cm_slim_normalized	• ICD-10-CM codes • sbiobert_base_cased_mli embeddings • Slim version (synonyms having low cosine similarity to unnormalized terms are dropped) • Provides the official resolution text within the brackets inside the metadata.	sbiobert_base_cased_mli	EN
16	sbiobertresolve_icd10pcs	• ICD-10-PCS codes • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
17	sbiobertresolve_icdo	• ICD-O Codes (International Classification of Diseases for Oncology code) • Provides topography codes and morphology codes comprising of Histology and Behavior codes in all_k_aux_labels columns • sbiobert_base_cased_mli embeddings • More granularity with respect to body parts	sbiobert_base_cased_mli	EN	Topography codes, Morphology codes comprising of Histology and Behavior codes
18	sbiobertresolve_icdo_base	• ICD-O Codes (International Classification of Diseases for Oncology code) • Provides topography codes and morphology codes comprising of Histology and Behavior codes in all_k_aux_labels columns • sbiobert_base_cased_mli embeddings • More granularity with respect to body parts	sbiobert_base_cased_mli	EN	Topography codes, Morphology codes comprising of Histology and Behavior codes
19	sbiobertresolve_icdo_augmented	• ICD-O Codes (International Classification of Diseases for Oncology code) • Provides topography codes and morphology codes comprising of Histology and Behavior codes in all_k_aux_labels columns • sbiobert_base_cased_mli embeddings • More granularity with respect to body parts • Augmented using the site information coming from ICD10 and synonyms coming from SNOMED vocabularies.	sbiobert_base_cased_mli	EN	Topography codes, Morphology codes comprising of Histology and Behavior codes
20	sbiobertresolve_rxnorm	• RxNorm Codes for Drugs/ Ingredients • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
21	sbiobertresolve_rxnorm_augmented	• RxNorm Codes for Drugs/ Ingredients • sbiobert_base_cased_mli embeddings • Provides concept classes of the drugs in all_k_aux_labels column. • Augmented version of sbiobertresolve_rxnorm model	sbiobert_base_cased_mli	EN	Concept classes of the drugs
22	sbiobertresolve_rxnorm_augmented_cased	• RxNorm Codes for Drugs/ Ingredients • sbiobert_base_cased_mli embeddings • Provides concept classes of the drugs in all_k_aux_labels column. • Cased (unlowered) concept names • Augmented version of sbiobertresolve_rxnorm model	sbiobert_base_cased_mli	EN	Concept classes of the drugs
23	sbiobertresolve_rxnorm_disposition	• RxNorm Codes for Drugs/ Ingredients • sbiobert_base_cased_mli embeddings • Provides dispositions of the RxNorm codes in all_k_aux_labels column.	sbiobert_base_cased_mli	EN	Provides dispositions of the RxNorm codes in all_k_aux_labels column.
24	sbertresolve_rxnorm_disposition	• Medication entities (like drugs/ingredients) to RxNorm codes • Provides the dispositions of the codes in all_k_aux_labels column • sbert_jsl_medium_uncased embeddings (light)	sbert_jsl_medium_uncased	EN	Disposition Information
25	sbiobertresolve_jsl_rxnorm_augmented	• RxNorm Codes for Drugs/ Ingredients • sbiobert_jsl_rxnorm_cased embeddings • Provides concept classes of the drugs in all_k_aux_labels column. • Augmented version of sbiobertresolve_rxnorm model	sbiobert_jsl_rxnorm_cased	EN	Concept classes of the drugs
26	sbluebertresolve_rxnorm_augmented_uncased	• RxNorm Codes for Drugs/ Ingredients • sbluebert_base_uncased_mli embeddings • Provides concept classes of the drugs in all_k_aux_labels column. • Augmented version of sbiobertresolve_rxnorm model	sbluebert_base_uncased_mli	EN	Concept classes of the drugs
27	sbertresolve_jsl_rxnorm_augmented_med	• RxNorm Codes for Drugs/ Ingredients • sbert_jsl_medium_rxnorm_uncased embeddings • Provides concept classes of the drugs in all_k_aux_labels column. • Augmented version of sbiobertresolve_rxnorm model	sbert_jsl_medium_rxnorm_uncased	EN	Concept classes of the drugs
28	sbiobertresolve_rxcui	• RxCUI Codes • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
29	sbluebertresolve_loinc	• LOINC Codes • sbluebert_base_uncased_mli embeddings	sbluebert_base_uncased_mli	EN
30	sbiobertresolve_loinc	• LOINC Codes • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
31	sbiobertresolve_loinc_augmented	• LOINC Codes • sbiobert_base_cased_mli embeddings • Augmented version of sbiobertresolve_loinc	sbiobert_base_cased_mli	EN
32	sbiobertresolve_loinc_cased	• LOINC Codes • sbiobert_base_cased_mli embeddings • Cased (unlowered) concept names • Augmented version of sbiobertresolve_loinc	sbiobert_base_cased_mli	EN
33	sbluebertresolve_loinc_uncased	• LOINC Codes • sbluebert_base_uncased_mli embeddings • Uncased (lowercased) concept names • Augmented version of sbiobertresolve_loinc	sbluebert_base_uncased_mli	EN
34	sbiobertresolve_mesh	• MeSH Codes • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
35	sbiobertresolve_ndc	• NDC Codes • sbiobert_base_cased_mli embeddings • If a drug has more than one NDC code, it returns all other codes in the all_k_aux_label column	sbiobert_base_cased_mli	EN	If drugs have multiple NDC code, it returns all other codes in the all_k_aux_label column
36	sbiobertresolve_hcpcs	• HCPCS Codes • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN	Domain Information
37	sbiobertresolve_HPO	• Maps phenotypic abnormalities encountered in human diseases to Human Phenotype Ontology (HPO) • Provides associated codes from the following vocabularies for each HPO code: - MeSH (Medical Subject Headings)- SNOMED- UMLS (Unified Medical Language System ) - ORPHA (international reference resource for information on rare diseases and orphan drugs) - OMIM (Online Mendelian Inheritance in Man) in all_k_aux_labels column	sbiobert_base_cased_mli	EN	SNOMED, MeSH, UMLS, ORPHA, OMIM Codes
38	sbiobertresolve_snomed_auxConcepts	• SNOMED Codes • sbiobert_base_cased_mli embeddings • Capable of extracting Morph Abnormality, Procedure, Substance, Physical Object, and Body Structure concepts of Snomed codes	sbiobert_base_cased_mli	EN
39	sbiobertresolve_snomed_auxConcepts_int	• SNOMED Codes (INT Version) • sbiobert_base_cased_mli embeddings • Capable of extracting Morph Abnormality, Procedure, Substance, Physical Object, and Body Structure concepts of Snomed codes	sbiobert_base_cased_mli	EN
40	sbiobertresolve_snomed_bodyStructure	• SNOMED Codes for body structure • sbiobert_base_cased_mli embeddings • Anatomical structures to body structure SNOMED codes	sbiobert_base_cased_mli	EN
41	sbertresolve_snomed_bodyStructure_med	• SNOMED Codes for body structure • sbert_jsl_medium_uncased embeddings • Anatomical structures to body structure SNOMED codes	sbert_jsl_medium_uncased	EN
42	sbiobertresolve_snomed_drug	• SNOMED Codes (drug version) • sbiobert_base_cased_mli embeddings • Drug entities to SNOMED codes	sbiobert_base_cased_mli	EN
43	sbiobertresolve_snomed_findings	• SNOMED Codes (CT version) • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
44	sbiobertresolve_snomed_findings_int	• SNOMED Codes (INT version) • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
45	sbiobertresolve_snomed_findings_aux_concepts	• SNOMED Codes • sbiobert_base_cased_mli embeddings • Capable of extracting Morph Abnormality, Procedure, Substance, Physical Object, and Body Structure concepts of Snomed codes • Both Aux and CT versions together	sbiobert_base_cased_mli	EN
46	sbiobertresolve_snomed_procedures_measurements	• SNOMED Codes for procedure and measurements • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
47	sbiobertresolve_clinical_snomed_procedures_measurements	• SNOMED Codes for procedure and measurements • sbiobert_base_cased_mli embeddings	sent_biobert_clinical_base_cased	EN
48	sbertresolve_snomed_conditions	• Conditions to SNOMED Codes • sbert_jsl_medium_uncased embeddings	sbert_jsl_medium_uncased	EN
49	robertaresolve_snomed	• Spanish SNOMED Codes • Roberta Clinical Word Embeddings (roberta_base_biomedical_es) • averaged with SentenceEmbeddings.	roberta_base_biomedical_es	ES
50	sbertresolve_snomed	• German SNOMED Codes • sent_bert_base_cased (DE)	sent_bert_base_cased (DE)	DE
51	sbiobertresolve_umls_clinical_drugs	• UMLS CUI Codes for Clinical Drugs • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
52	sbiobertresolve_umls_disease_syndrome	• UMLS CUI Codes for Disease and Syndrom entities • sbiobert_base_cased_mli embeddings	sbiobert_base_cased_mli	EN
53	sbiobertresolve_umls_drug_substance	• UMLS CUI Codes for Drug and Substance entities • sbiobert_base_cased_mli embeddings • Clinical Drugs, Pharmacologic Substance, Antibiotic, Hazardous or Poisonous Substance to UMLS CUI Codes	sbiobert_base_cased_mli	EN
54	sbiobertresolve_umls_findings	• UMLS CUI Codes for clinical entities and concepts • sbiobert_base_cased_mli embeddings • 4 major categories of UMLS CUI codes	sbiobert_base_cased_mli	EN
55	sbiobertresolve_umls_major_concepts	• UMLS CUI Codes for clinical entities and concepts • sbiobert_base_cased_mli embeddings • 4 major categories (Clinical Findings, Medical Devices, Anatomical Structures, and Injuries & Poisoning terms) of UMLS CUI codes	sbiobert_base_cased_mli	EN

Entity Resolver Model and NER Model Pairs

In the table below, you can find Entity Resolver models as well as its appropriate NER models and labels, that can return optimal results.

For instance, sbiobertresolve_hcc_augmented resolver model must be used with sbiobert_base_cased_mli as embeddings, ner_clinical as NER model, PROBLEM set in setWhiteList().

NOTE: This table is shared just to give you a rough idea about which pretrained models can be used together. You can get better or worse performance by playing out with different models.

ENTITY RESOLVER MODEL	SENTENCE EMBEDDINGS	NER MODEL	NER MODEL WHITELIST LABEL	MERGE CHUNKS (ChunkMergeApproach)
sbiobertresolve_HPO	sbiobert_base_cased_mli	ner_human_phenotype_gene_clinical	No need to set whiteList
sbiobertresolve_cpt_procedures_measurements_augmented	sbiobert_base_cased_mli	ner_jsl	Procedure	Merge ner_jsl and ner_measurements_clinical model chunks
sbiobertresolve_cpt_procedures_measurements_augmented	sbiobert_base_cased_mli	ner_measurements_clinical	Measurements	Merge ner_jsl and ner_measurements_clinical model chunks
sbiobertresolve_hcc_augmented	sbiobert_base_cased_mli	ner_clinical	PROBLEM
sbiobertresolve_hcpcs	sbiobert_base_cased_mli	ner_jsl	Procedure
sbiobertresolve_icd10cm_augmented_billable_hcc	sbiobert_base_cased_mli	ner_clinical	PROBLEM
sbiobertresolve_icd10cm_generalised	sbiobert_base_cased_mli	ner_clinical	PROBLEM
sbiobertresolve_icd10pcs	sbiobert_base_cased_mli	ner_jsl	Procedure
sbiobertresolve_icdo_base	sbiobert_base_cased_mli	ner_jsl	Oncological
sbiobertresolve_loinc_augmented	sbiobert_base_cased_mli	ner_jsl	Test BMI HDL LDL Medical_Device Temperature Total_Cholesterol Triglycerides Blood_Pressure
sbiobertresolve_mesh	sbiobert_base_cased_mli	ner_clinical	No need to set whiteList
sbiobertresolve_rxcui	sbiobert_base_cased_mli	ner_posology	DRUG
sbiobertresolve_rxnorm_augmented	sbiobert_base_cased_mli	ner_posology	DRUG
sbiobertresolve_rxnorm_disposition	sbiobert_base_cased_mli	ner_posology	DRUG
sbiobertresolve_snomed_bodyStructure	sbiobert_base_cased_mli	ner_jsl	Disease_Syndrome_Disorder External_body_part_or_region	Merge ner_jsl and ner_anatomy_coarse model chunks
sbiobertresolve_snomed_bodyStructure	sbiobert_base_cased_mli	ner_anatomy_coarse	No need to set whiteList	Merge ner_jsl and ner_anatomy_coarse model chunks
sbiobertresolve_snomed_procedures_measurements	sbiobert_base_cased_mli	ner_jsl	Procedure Test BMI HDL LDL Temperature Total_Cholesterol Triglycerides Blood_Pressure	Merge ner_jsl and ner_measurements_clinical model chunks
sbiobertresolve_snomed_procedures_measurements	sbiobert_base_cased_mli	ner_measurements_clinical	Measurements	Merge ner_jsl and ner_measurements_clinical model chunks
sbiobertresolve_snomed_findings	sbiobert_base_cased_mli	ner_clinical	No need to set whiteList
sbiobertresolve_umls_disease_syndrome	sbiobert_base_cased_mli	ner_jsl	Cerebrovascular_Disease Communicable_Disease Diabetes Disease_Syndrome_Disorder Heart_Disease Hyperlipidemia Hypertension Injury_or_Poisoning Kidney_Disease Obesity Oncological Overweight Psychological_Condition Symptom VS_Finding ImagingFindings EKG_Findings
sbiobertresolve_umls_clinical_drugs	sbiobert_base_cased_mli	ner_posology	DRUG
sbiobertresolve_umls_major_concepts	sbiobert_base_cased_mli	ner_jsl	Cerebrovascular_Disease Communicable_Disease Diabetes Disease_Syndrome_Disorder Heart_Disease Hyperlipidemia Hypertension Injury_or_Poisoning Kidney_Disease Medical-Device Obesity Oncological Overweight Psychological_Condition Symptom VS_Finding ImagingFindings EKG_Findings
sbiobertresolve_ndc	sbiobert_base_cased_mli	ner_posology_greedy	DRUG

Relation Extraction Models and Relation Pairs Table

In the table below, available Relation Extraction models, its labels, optimal NER model, and meaningful relation pairs are illustrated.

For instance, re_bodypart_proceduretest RE model returns (0,1) labels (binary), works optimally with ner_jsl NER model, and outputs relation pairs under the RE PAIRS column.

NOTE: This table is shared just to give you a rough idea about which pretrained models can be used together. You can get better or worse performance by playing out with different models.

NO	RE MODEL	RE MODEL LABELS	NER MODEL	RE PAIRS
1	re_bodypart_proceduretest	0,1	ner_jsl	[“external_body_part_or_region-test”, ”test-external_body_part_or_region”, “internal_organ_or_component-test”, “test-internal_organ_or_component”, “external_body_part_or_region-procedure”, “procedure-external_body_part_or_region”, “procedure-internal_organ_or_component”, “internal_organ_or_component-procedure”]
2	re_ade_clinical	0,1	ner_ade_clinical	[“ade-drug”, ”drug-ade”]
3	redl_chemprot_biobert	CPR:1, CPR:2, CPR:3, CPR:4, CPR:5, CPR:6, CPR:7, CPR:8, CPR:9, CPR:10	ner_chemprot_clinical	[“No need to set pairs.”]
4	re_human_phenotype_gene_clinical	0,1	ner_human_phenotype_gene_clinical	[“No need to set pairs.”]
5	re_bodypart_directions	0,1	ner_jsl	[“direction-external_body_part_or_region”, “external_body_part_or_region-direction”, “direction-internal_organ_or_component”, “internal_organ_or_component-direction”]
6	re_bodypart_problem	0,1	ner_jsl	[“internal_organ_or_component-cerebrovascular_disease”, “cerebrovascular_disease-internal_organ_or_component”, “internal_organ_or_component-communicable_disease”, “communicable_disease-internal_organ_or_component”, “internal_organ_or_component-diabetes”, “diabetes-internal_organ_or_component”, “internal_organ_or_component-disease_syndrome_disorder”, “disease_syndrome_disorder-internal_organ_or_component”, “internal_organ_or_component-ekg_findings”, “ekg_findings-internal_organ_or_component”, “internal_organ_or_component-heart_disease”, “heart_disease-internal_organ_or_component”, “internal_organ_or_component-hyperlipidemia”, “hyperlipidemia-internal_organ_or_component”, “internal_organ_or_component-hypertension”, “hypertension-internal_organ_or_component”, “internal_organ_or_component-imagingfindings”, “imagingfindings-internal_organ_or_component”, “internal_organ_or_component-injury_or_poisoning”, “injury_or_poisoning-internal_organ_or_component”, “internal_organ_or_component-kidney_disease”, “kidney_disease-internal_organ_or_component”, “internal_organ_or_component-oncological”, “oncological-internal_organ_or_component”, “internal_organ_or_component-psychological_condition”, “psychological_condition-internal_organ_or_component”, “internal_organ_or_component-symptom”, “symptom-internal_organ_or_component”, “internal_organ_or_component-vs_finding”, “vs_finding-internal_organ_or_component”, “external_body_part_or_region-communicable_disease”, “communicable_disease-external_body_part_or_region”, “external_body_part_or_region-diabetes”, “diabetes-external_body_part_or_region”, “external_body_part_or_region-disease_syndrome_disorder”, “disease_syndrome_disorder-external_body_part_or_region”, “external_body_part_or_region-hypertension”, “hypertension-external_body_part_or_region”, “external_body_part_or_region-imagingfindings”, “imagingfindings-external_body_part_or_region”, “external_body_part_or_region-injury_or_poisoning”, “injury_or_poisoning-external_body_part_or_region”, “external_body_part_or_region-obesity”, “obesity-external_body_part_or_region”, “external_body_part_or_region-oncological”, “oncological-external_body_part_or_region”, “external_body_part_or_region-overweight”, “overweight-external_body_part_or_region”, “external_body_part_or_region-symptom”, “symptom-external_body_part_or_region”, “external_body_part_or_region-vs_finding”, “vs_finding-external_body_part_or_region”]
7	re_drug_drug_interaction_clinical	DDI-advise, DDI-effect, DDI-mechanism, DDI-int, DDI-false	ner_posology	[“drug-drug”]
8	re_clinical	TrIP, TrWP, TrCP, TrAP, TrAP, TeRP, TeCP, PIP	ner_clinical	[“No need to set pairs.”]
9	re_temporal_events_clinical	AFTER, BEFORE, OVERLAP	ner_events_clinical	[“No need to set pairs.”]
10	re_temporal_events_enriched_clinical	BEFORE, AFTER, SIMULTANEOUS, BEGUN_BY, ENDED_BY, DURING, BEFORE_OVERLAP	ner_events_clinical	[“No need to set pairs.”]
11	re_test_problem_finding	0,1	ner_jsl	[“test-cerebrovascular_disease”, “cerebrovascular_disease-test”, “test-communicable_disease”, “communicable_disease-test”, “test-diabetes”, “diabetes-test”, “test-disease_syndrome_disorder”, “disease_syndrome_disorder-test”, “test-heart_disease”, “heart_disease-test”, “test-hyperlipidemia”, “hyperlipidemia-test”, “test-hypertension”, “hypertension-test”, “test-injury_or_poisoning”, “injury_or_poisoning-test”, “test-kidney_disease”, “kidney_disease-test”, “test-obesity”, “obesity-test”, “test-oncological”, “oncological-test”, “test-psychological_condition”, “psychological_condition-test”, “test-symptom”, “symptom-test”, “ekg_findings-disease_syndrome_disorder”, “disease_syndrome_disorder-ekg_findings”, “ekg_findings-heart_disease”, “heart_disease-ekg_findings”, “ekg_findings-symptom”, “symptom-ekg_findings”, “imagingfindings-cerebrovascular_disease”, “cerebrovascular_disease-imagingfindings”, “imagingfindings-communicable_disease”, “communicable_disease-imagingfindings”, “imagingfindings-disease_syndrome_disorder”, “disease_syndrome_disorder-imagingfindings”, “imagingfindings-heart_disease”, “heart_disease-imagingfindings”, “imagingfindings-hyperlipidemia”, “hyperlipidemia-imagingfindings”, “imagingfindings-hypertension”, “hypertension-imagingfindings”, “imagingfindings-injury_or_poisoning”, “injury_or_poisoning-imagingfindings”, “imagingfindings-kidney_disease”, “kidney_disease-imagingfindings”, “imagingfindings-oncological”, “oncological-imagingfindings”, “imagingfindings-psychological_condition”, “psychological_condition-imagingfindings”, “imagingfindings-symptom”, “symptom-imagingfindings”, “vs_finding-cerebrovascular_disease”, “cerebrovascular_disease-vs_finding”, “vs_finding-communicable_disease”, “communicable_disease-vs_finding”, “vs_finding-diabetes”, “diabetes-vs_finding”, “vs_finding-disease_syndrome_disorder”, “disease_syndrome_disorder-vs_finding”, “vs_finding-heart_disease”, “heart_disease-vs_finding”, “vs_finding-hyperlipidemia”, “hyperlipidemia-vs_finding”, “vs_finding-hypertension”, “hypertension-vs_finding”, “vs_finding-injury_or_poisoning”, “injury_or_poisoning-vs_finding”, “vs_finding-kidney_disease”, “kidney_disease-vs_finding”, “vs_finding-obesity”, “obesity-vs_finding”, “vs_finding-oncological”, “oncological-vs_finding”, “vs_finding-overweight”, “overweight-vs_finding”, “vs_finding-psychological_condition”, “psychological_condition-vs_finding”, “vs_finding-symptom”, “symptom-vs_finding”]
12	re_test_result_date	is_finding_of, is_result_of, is_date_of, O	ner_jsl	[‘test-test_result’, ‘test_result-test’, ‘date-admission_discharge’, ‘admission_discharge-date’, ‘date-alcohol’, ‘alcohol-date’, ‘date-bmi’, ‘bmi-date’, ‘date-birth_entity’, ‘birth_entity-date’, ‘date-blood_pressure’, ‘blood_pressure-date’, ‘date-cerebrovascular_disease’, ‘cerebrovascular_disease-date’, ‘date-communicable_disease’, ‘communicable_disease-date’, ‘date-death_entity’, ‘death_entity-date’, ‘date-diabetes’, ‘diabetes-date’, ‘date-diet’, ‘diet-date’, ‘date-disease_syndrome_disorder’, ‘disease_syndrome_disorder-date’, ‘date-drug_brandname’, ‘drug_brandname-date’, ‘date-drug_ingredient’, ‘drug_ingredient-date’, ‘date-ekg_findings’, ‘ekg_findings-date’, ‘date-employment’, ‘employment-date’, ‘date-fetus_newborn’, ‘fetus_newborn-date’, ‘date-hdl’, ‘hdl-date’, ‘date-heart_disease’, ‘heart_disease-date’, ‘date-height’, ‘height-date’, ‘date-hyperlipidemia’, ‘hyperlipidemia-date’, ‘date-hypertension’, ‘hypertension-date’, ‘date-imagingfindings’, ‘imagingfindings-date’, ‘date-imaging_technique’, ‘imaging_technique-date’, ‘date-injury_or_poisoning’, ‘injury_or_poisoning-date’, ‘date-internal_organ_or_component’, ‘internal_organ_or_component-date’, ‘date-kidney_disease’, ‘kidney_disease-date’, ‘date-ldl’, ‘ldl-date’, ‘date-labour_delivery’, ‘labour_delivery-date’, ‘date-o2_saturation’, ‘o2_saturation-date’, ‘date-obesity’, ‘obesity-date’, ‘date-oncological’, ‘oncological-date’, ‘date-overweight’, ‘overweight-date’, ‘date-oxygen_therapy’, ‘oxygen_therapy-date’, ‘date-pregnancy’, ‘pregnancy-date’, ‘date-procedure’, ‘procedure-date’, ‘date-psychological_condition’, ‘psychological_condition-date’, ‘date-pulse’, ‘pulse-date’, ‘date-relationship_status’, ‘relationship_status-date’, ‘date-relativedate’, ‘relativedate-date’, ‘date-relativetime’, ‘relativetime-date’, ‘date-respiration’, ‘respiration-date’, ‘date-route’, ‘route-date’, ‘date-sexually_active_or_sexual_orientation’,’sexually_active_or_sexual_orientation-date’, ‘date-smoking’, ‘smoking-date’, ‘date-substance’, ‘substance-date’, ‘date-substance_quantity’, ‘substance_quantity-date’, ‘date-symptom’, ‘symptom-date’, ‘date-temperature’, ‘temperature-date’, ‘date-test’, ‘test-date’, ‘date-test_result’, ‘test_result-date’, ‘date-total_cholesterol’, ‘total_cholesterol-date’, ‘date-treatment’, ‘treatment-date’, ‘date-triglycerides’, ‘triglycerides-date’, ‘date-vs_finding’, ‘vs_finding-date’, ‘date-vaccine’, ‘vaccine-date’, ‘date-weight’, ‘weight-date’, ‘relativedate-admission_discharge’,’admission_discharge-relativedate’, ‘relativedate-alcohol’, ‘alcohol-relativedate’, ‘relativedate-bmi’, ‘bmi-relativedate’, ‘relativedate-birth_entity’, ‘birth_entity-relativedate’, ‘relativedate-blood_pressure’, ‘blood_pressure-relativedate’, ‘relativedate-cerebrovascular_disease’, ‘cerebrovascular_disease-relativedate’, ‘relativedate-communicable_disease’, ‘communicable_disease-relativedate’, ‘relativedate-death_entity’, ‘death_entity-relativedate’, ‘relativedate-diabetes’, ‘diabetes-relativedate’, ‘relativedate-diet’, ‘diet-relativedate’, ‘relativedate-disease_syndrome_disorder’, ‘disease_syndrome_disorder-relativedate’, ‘relativedate-drug_brandname’, ‘drug_brandname-relativedate’, ‘relativedate-drug_ingredient’, ‘drug_ingredient-relativedate’, ‘relativedate-ekg_findings’, ‘ekg_findings-relativedate’, ‘relativedate-employment’, ‘employment-relativedate’, ‘relativedate-fetus_newborn’, ‘fetus_newborn-relativedate’, ‘relativedate-hdl’, ‘hdl-relativedate’, ‘relativedate-heart_disease’, ‘heart_disease-relativedate’, ‘relativedate-height’, ‘height-relativedate’, ‘relativedate-hyperlipidemia’, ‘hyperlipidemia-relativedate’, ‘relativedate-hypertension’, ‘hypertension-relativedate’, ‘relativedate-imagingfindings’, ‘imagingfindings-relativedate’, ‘relativedate-imaging_technique’, ‘imaging_technique-relativedate’, ‘relativedate-injury_or_poisoning’, ‘injury_or_poisoning-relativedate’, ‘relativedate-internal_organ_or_component’, ‘internal_organ_or_component-relativedate’, ‘relativedate-kidney_disease’, ‘kidney_disease-relativedate’, ‘relativedate-ldl’, ‘ldl-relativedate’, ‘relativedate-labour_delivery’, ‘labour_delivery-relativedate’, ‘relativedate-o2_saturation’, ‘o2_saturation-relativedate’, ‘relativedate-obesity’, ‘obesity-relativedate’, ‘relativedate-oncological’, ‘oncological-relativedate’, ‘relativedate-overweight’, ‘overweight-relativedate’, ‘relativedate-oxygen_therapy’, ‘oxygen_therapy-relativedate’, ‘relativedate-pregnancy’, ‘pregnancy-relativedate’, ‘relativedate-procedure’, ‘procedure-relativedate’, ‘relativedate-psychological_condition’, ‘psychological_condition-relativedate’, ‘relativedate-pulse’, ‘pulse-relativedate’, ‘relativedate-relationship_status’, ‘relationship_status-relativedate’, ‘relativedate-relativedate’, ‘relativedate-relativetime’, ‘relativedate-relativetime’, ‘relativetime-relativedate’, ‘relativedate-respiration’, ‘respiration-relativedate’, ‘relativedate-route’, ‘route-relativedate’, ‘relativedate-sexually_active_or_sexual_orientation’,’sexually_active_or_sexual_orientation-relativedate’, ‘relativedate-smoking’, ‘smoking-relativedate’, ‘relativedate-substance’, ‘substance-relativedate’, ‘relativedate-substance_quantity’, ‘substance_quantity-relativedate’, ‘relativedate-symptom’, ‘symptom-relativedate’, ‘relativedate-temperature’, ‘temperature-relativedate’, ‘relativedate-test’, ‘test-relativedate’, ‘relativedate-test_result’, ‘test_result-relativedate’, ‘relativedate-total_cholesterol’, ‘total_cholesterol-relativedate’, ‘relativedate-treatment’, ‘treatment-relativedate’, ‘relativedate-triglycerides’, ‘triglycerides-relativedate’, ‘relativedate-vs_finding’, ‘vs_finding-relativedate’, ‘relativedate-vaccine’, ‘vaccine-relativedate’, ‘relativedate-weight’, ‘weight-relativedate’, ‘test-cerebrovascular_disease’, ‘cerebrovascular_disease-test’, ‘test-communicable_disease’, ‘communicable_disease-test’, ‘test-diabetes’, ‘diabetes-test’, ‘test-disease_syndrome_disorder’, ‘disease_syndrome_disorder-test’, ‘test-ekg_findings’, ‘ekg_findings-test’, ‘test-heart_disease’, ‘heart_disease-test’, ‘test-hyperlipidemia’, ‘hyperlipidemia-test’, ‘test-hypertension’, ‘hypertension-test’, ‘test-imagingfindings’, ‘imagingfindings-test’, ‘test-injury_or_poisoning’, ‘injury_or_poisoning-test’, ‘test-kidney_disease’, ‘kidney_disease-test’, ‘test-oncological’, ‘oncological-test’, ‘test-vs_finding’, ‘vs_finding-test’, ‘weight-overweight’, ‘overweight-weight’, ‘weight-obesity’, ‘obesity-weight’, ‘bmi-obesity’, ‘obesity-bmi’, ‘bmi-overweight’, ‘overweight-bmi’, ‘ekg_findings-heart_disease’, ‘heart_disease-ekg_findings’, ‘imaging_technique-imagingfindings’, ‘imagingfindings-imaging_technique’]

13	re_date_clinical	0,1	ner_jsl	[“date-admission_discharge”, “admission_discharge-date”, “date-alcohol”, “alcohol-date”, “date-allergen”, “allergen-date”, “date-bmi”, “bmi-date”, “date-birth_entity”, “birth_entity-date”, “date-blood_pressure”, “blood_pressure-date”, “date-cerebrovascular_disease”, “cerebrovascular_disease-date”, “date-clinical_dept”, “clinical_dept-date”, “date-communicable_disease”, “communicable_disease-date”, “date-death_entity”, “death_entity-date”, “date-diabetes”, “diabetes-date”, “date-diet”, “diet-date”, “date-disease_syndrome_disorder”, “disease_syndrome_disorder-date”, “date-drug_brandname”, “drug_brandname-date”, “date-drug_ingredient”, “drug_ingredient-date”, “date-ekg_findings”, “ekg_findings-date”, “date-external_body_part_or_region”, “external_body_part_or_region-date”, “date-fetus_newborn”, “fetus_newborn-date”, “date-hdl”, “hdl-date”, “date-heart_disease”, “heart_disease-date”, “date-height”, “height-date”, “date-hyperlipidemia”, “hyperlipidemia-date”, “date-hypertension”, “hypertension-date”, “date-imagingfindings”, “imagingfindings-date”, “date-imaging_technique”, “imaging_technique-date”, “date-injury_or_poisoning”, “injury_or_poisoning-date”, “date-internal_organ_or_component”, “internal_organ_or_component-date”, “date-kidney_disease”, “kidney_disease-date”, “date-ldl”, “ldl-date”, “date-modifier”, “modifier-date”, “date-o2_saturation”, “o2_saturation-date”, “date-obesity”, “obesity-date”, “date-oncological”, “oncological-date”, “date-overweight”, “overweight-date”, “date-oxygen_therapy”, “oxygen_therapy-date”, “date-pregnancy”, “pregnancy-date”, “date-procedure”, “procedure-date”, “date-psychological_condition”, “psychological_condition-date”, “date-pulse”, “pulse-date”, “date-respiration”, “respiration-date”, “date-smoking”, “smoking-date”, “date-substance”, “substance-date”, “date-substance_quantity”, “substance_quantity-date”, “date-symptom”, “symptom-date”, “date-temperature”, “temperature-date”, “date-test”, “test-date”, “date-test_result”, “test_result-date”, “date-total_cholesterol”, “total_cholesterol-date”, “date-treatment”, “treatment-date”, “date-triglycerides”, “triglycerides-date”, “date-vs_finding”, “vs_finding-date”, “date-vaccine”, “vaccine-date”, “date-vital_signs_header”, “vital_signs_header-date”, “date-weight”, “weight-date”, “time-admission_discharge”, “admission_discharge-time”, “time-alcohol”, “alcohol-time”, “time-allergen”, “allergen-time”, “time-bmi”, “bmi-time”, “time-birth_entity”, “birth_entity-time”, “time-blood_pressure”, “blood_pressure-time”, “time-cerebrovascular_disease”, “cerebrovascular_disease-time”, “time-clinical_dept”, “clinical_dept-time”, “time-communicable_disease”, “communicable_disease-time”, “time-death_entity”, “death_entity-time”, “time-diabetes”, “diabetes-time”, “time-diet”, “diet-time”, “time-disease_syndrome_disorder”, “disease_syndrome_disorder-time”, “time-drug_brandname”, “drug_brandname-time”, “time-drug_ingredient”, “drug_ingredient-time”, “time-ekg_findings”, “ekg_findings-time”, “time-external_body_part_or_region”, “external_body_part_or_region-time”, “time-fetus_newborn”, “fetus_newborn-time”, “time-hdl”, “hdl-time”, “time-heart_disease”, “heart_disease-time”, “time-height”, “height-time”, “time-hyperlipidemia”, “hyperlipidemia-time”, “time-hypertension”, “hypertension-time”, “time-imagingfindings”, “imagingfindings-time”, “time-imaging_technique”, “imaging_technique-time”, “time-injury_or_poisoning”, “injury_or_poisoning-time”, “time-internal_organ_or_component”, “internal_organ_or_component-time”, “time-kidney_disease”, “kidney_disease-time”, “time-ldl”, “ldl-time”, “time-modifier”, “modifier-time”, “time-o2_saturation”, “o2_saturation-time”, “time-obesity”, “obesity-time”, “time-oncological”, “oncological-time”, “time-overweight”, “overweight-time”, “time-oxygen_therapy”, “oxygen_therapy-time”, “time-pregnancy”, “pregnancy-time”, “time-procedure”, “procedure-time”, “time-psychological_condition”, “psychological_condition-time”, “time-pulse”, “pulse-time”, “time-respiration”, “respiration-time”, “time-smoking”, “smoking-time”, “time-substance”, “substance-time”, “time-substance_quantity”, “substance_quantity-time”, “time-symptom”, “symptom-time”, “time-temperature”, “temperature-time”, “time-test”, “test-time”, “time-test_result”, “test_result-time”, “time-total_cholesterol”, “total_cholesterol-time”, “time-treatment”, “treatment-time”, “time-triglycerides”, “triglycerides-time”, “time-vs_finding”, “vs_finding-time”, “time-vaccine”, “vaccine-time”, “time-vital_signs_header”, “vital_signs_header-time”, “time-weight”, “weight-time”, “relativedate-admission_discharge”, “admission_discharge-relativedate”, “relativedate-alcohol”, “alcohol-relativedate”, “relativedate-allergen”, “allergen-relativedate”, “relativedate-bmi”, “bmi-relativedate”, “relativedate-birth_entity”, “birth_entity-relativedate”, “relativedate-blood_pressure”, “blood_pressure-relativedate”, “relativedate-cerebrovascular_disease”, “cerebrovascular_disease-relativedate”, “relativedate-clinical_dept”, “clinical_dept-relativedate”, “relativedate-communicable_disease”, “communicable_disease-relativedate”, “relativedate-death_entity”, “death_entity-relativedate”, “relativedate-diabetes”, “diabetes-relativedate”, “relativedate-diet”, “diet-relativedate”, “relativedate-disease_syndrome_disorder”, “disease_syndrome_disorder-relativedate”, “relativedate-drug_brandname”, “drug_brandname-relativedate”, “relativedate-drug_ingredient”, “drug_ingredient-relativedate”, “relativedate-ekg_findings”, “ekg_findings-relativedate”, “relativedate-external_body_part_or_region”, “external_body_part_or_region-relativedate”, “relativedate-fetus_newborn”, “fetus_newborn-relativedate”, “relativedate-hdl”, “hdl-relativedate”, “relativedate-heart_disease”, “heart_disease-relativedate”, “relativedate-height”, “height-relativedate”, “relativedate-hyperlipidemia”, “hyperlipidemia-relativedate”, “relativedate-hypertension”, “hypertension-relativedate”, “relativedate-imagingfindings”, “imagingfindings-relativedate”, “relativedate-imaging_technique”, “imaging_technique-relativedate”, “relativedate-injury_or_poisoning”, “injury_or_poisoning-relativedate”, “relativedate-internal_organ_or_component”, “internal_organ_or_component-relativedate”, “relativedate-kidney_disease”, “kidney_disease-relativedate”, “relativedate-ldl”, “ldl-relativedate”, “relativedate-modifier”, “modifier-relativedate”, “relativedate-o2_saturation”, “o2_saturation-relativedate”, “relativedate-obesity”, “obesity-relativedate”, “relativedate-oncological”, “oncological-relativedate”, “relativedate-overweight”, “overweight-relativedate”, “relativedate-oxygen_therapy”, “oxygen_therapy-relativedate”, “relativedate-pregnancy”, “pregnancy-relativedate”, “relativedate-procedure”, “procedure-relativedate”, “relativedate-psychological_condition”, “psychological_condition-relativedate”, “relativedate-pulse”, “pulse-relativedate”, “relativedate-respiration”, “respiration-relativedate”, “relativedate-smoking”, “smoking-relativedate”, “relativedate-substance”, “substance-relativedate”, “relativedate-substance_quantity”, “substance_quantity-relativedate”, “relativedate-symptom”, “symptom-relativedate”, “relativedate-temperature”, “temperature-relativedate”, “relativedate-test”, “test-relativedate”, “relativedate-test_result”, “test_result-relativedate”, “relativedate-total_cholesterol”, “total_cholesterol-relativedate”, “relativedate-treatment”, “treatment-relativedate”, “relativedate-triglycerides”, “triglycerides-relativedate”, “relativedate-vs_finding”, “vs_finding-relativedate”, “relativedate-vaccine”, “vaccine-relativedate”, “relativedate-vital_signs_header”, “vital_signs_header-relativedate”, “relativedate-weight”, “weight-relativedate”, “relativetime-admission_discharge”, “admission_discharge-relativetime”, “relativetime-alcohol”, “alcohol-relativetime”, “relativetime-allergen”, “allergen-relativetime”, “relativetime-bmi”, “bmi-relativetime”, “relativetime-birth_entity”, “birth_entity-relativetime”, “relativetime-blood_pressure”, “blood_pressure-relativetime”, “relativetime-cerebrovascular_disease”, “cerebrovascular_disease-relativetime”, “relativetime-clinical_dept”, “clinical_dept-relativetime”, “relativetime-communicable_disease”, “communicable_disease-relativetime”, “relativetime-death_entity”, “death_entity-relativetime”, “relativetime-diabetes”, “diabetes-relativetime”, “relativetime-diet”, “diet-relativetime”, “relativetime-disease_syndrome_disorder”, “disease_syndrome_disorder-relativetime”, “relativetime-drug_brandname”, “drug_brandname-relativetime”, “relativetime-drug_ingredient”, “drug_ingredient-relativetime”, “relativetime-ekg_findings”, “ekg_findings-relativetime”, “relativetime-external_body_part_or_region”, “external_body_part_or_region-relativetime”, “relativetime-fetus_newborn”, “fetus_newborn-relativetime”, “relativetime-hdl”, “hdl-relativetime”, “relativetime-heart_disease”, “heart_disease-relativetime”, “relativetime-height”, “height-relativetime”, “relativetime-hyperlipidemia”, “hyperlipidemia-relativetime”, “relativetime-hypertension”, “hypertension-relativetime”, “relativetime-imagingfindings”, “imagingfindings-relativetime”, “relativetime-imaging_technique”, “imaging_technique-relativetime”, “relativetime-injury_or_poisoning”, “injury_or_poisoning-relativetime”, “relativetime-internal_organ_or_component”, “internal_organ_or_component-relativetime”, “relativetime-kidney_disease”, “kidney_disease-relativetime”, “relativetime-ldl”, “ldl-relativetime”, “relativetime-modifier”, “modifier-relativetime”, “relativetime-o2_saturation”, “o2_saturation-relativetime”, “relativetime-obesity”, “obesity-relativetime”, “relativetime-oncological”, “oncological-relativetime”, “relativetime-overweight”, “overweight-relativetime”, “relativetime-oxygen_therapy”, “oxygen_therapy-relativetime”, “relativetime-pregnancy”, “pregnancy-relativetime”, “relativetime-procedure”, “procedure-relativetime”, “relativetime-psychological_condition”, “psychological_condition-relativetime”, “relativetime-pulse”, “pulse-relativetime”, “relativetime-respiration”, “respiration-relativetime”, “relativetime-smoking”, “smoking-relativetime”, “relativetime-substance”, “substance-relativetime”, “relativetime-substance_quantity”, “substance_quantity-relativetime”, “relativetime-symptom”, “symptom-relativetime”, “relativetime-temperature”, “temperature-relativetime”, “relativetime-test”, “test-relativetime”, “relativetime-test_result”, “test_result-relativetime”, “relativetime-total_cholesterol”, “total_cholesterol-relativetime”, “relativetime-treatment”, “treatment-relativetime”, “relativetime-triglycerides”, “triglycerides-relativetime”, “relativetime-vs_finding”, “vs_finding-relativetime”, “relativetime-vaccine”, “vaccine-relativetime”, “relativetime-vital_signs_header”, “vital_signs_header-relativetime”, “relativetime-weight”, “weight-relativetime”]
14	redl_drugprot_biobert	INHIBITOR, DIRECT-REGULATOR, SUBSTRATE, ACTIVATOR, INDIRECT-UPREGULATOR, INDIRECT-DOWNREGULATOR, ANTAGONIST, PRODUCT-OF, PART-OF, AGONIST	ner_drugprot_clinical	[“checmical-gene”, “chemical-gene_and_chemical”, “gene_and_chemical-gene”]
15	re_drugprot_clinical	INHIBITOR, DIRECT-REGULATOR, SUBSTRATE, ACTIVATOR, INDIRECT-UPREGULATOR, INDIRECT-DOWNREGULATOR, ANTAGONIST, PRODUCT-OF, PART-OF, AGONIST	ner_drugprot_clinical	[“checmical-gene”, “chemical-gene_and_chemical”, “gene_and_chemical-gene”]
16	redl_nihss_biobert	Has_Value, 0	ner_nihss	[“No need to set pairs.”]

PREVIOUSBenchmarks

NEXTRelease Notes