PHI Guard 3m v0.6 Raw - PHI Presence

Description

PHI Guard 3m v0.6 scores original clinical text for PHI presence, before de-identification. It returns one document-level category per input document. It does not find or remove PHI, and a negative result does not certify privacy safety. Rounded size: about 3 million parameters.

Predicted Entities

PHI_PRESENT, NO_PHI_PRESENT, UNKNOWN, REVIEW_REQUIRED

Copy S3 URI

How to use

Load DecisionModel.pretrained(“phi_guard_3m_v0.6_raw”, “en”, “clinical/models”). Pass this name explicitly. Do not call setMode. Score the original note. The sample contrasts a masked note with Pt Maria Delgado, DOB 03/14/1956. Inspect result and metadata.status. A negative label is not a privacy certificate. The lookup name is lowercase.

from pyspark.ml import Pipeline
from sparknlp.base import DocumentAssembler
import sparknlp_jsl
from sparknlp_jsl.annotator.classification import DecisionModel
spark = sparknlp_jsl.start()
notes = spark.createDataFrame([
 ("masked", "[NAME] visited [HOSPITAL] on [DATE]."), ("leaked", "Pt Maria Delgado, DOB 03/14/1956.")], ["case_id", "text"])
doc = DocumentAssembler().setInputCol("text").setOutputCol("document")
guard = DecisionModel.pretrained("phi_guard_3m_v0.6_raw", "en", "clinical/models")\
 .setInputCols("document").setOutputCol("phi_present")
Pipeline(stages=[doc, guard]).fit(notes).transform(notes).selectExpr(
 "case_id", "phi_present[0].result AS label", "phi_present[0].metadata.status AS status"
).show(truncate=False)

import com.johnsnowlabs.nlp.DocumentAssembler
import com.johnsnowlabs.nlp.annotators.classification.DecisionModel
import org.apache.spark.ml.Pipeline
import org.apache.spark.sql.SparkSession
val spark = SparkSession.builder().getOrCreate()
import spark.implicits._
val notes = Seq(("masked", "[NAME] visited [HOSPITAL] on [DATE]."), ("leaked", "Pt Maria Delgado, DOB 03/14/1956.")).toDF("case_id", "text")
val doc = new DocumentAssembler().setInputCol("text").setOutputCol("document")
val guard = DecisionModel.pretrained("phi_guard_3m_v0.6_raw", "en", "clinical/models")
 .setInputCols("document").setOutputCol("phi_present")
new Pipeline().setStages(Array(doc, guard)).fit(notes).transform(notes).selectExpr(
 "case_id", "phi_present[0].result AS label", "phi_present[0].metadata.status AS status").show(false)

Results

+---------+----------------+--------+
| case_id | label          | status |
+---------+----------------+--------+
| masked  | NO_PHI_PRESENT | scored |
| leaked  | PHI_PRESENT    | scored |
+---------+----------------+--------+

Model Information

Model Name: phi_guard_3m_v0.6_raw
Compatibility: Healthcare NLP 7.0.1+
License: Licensed
Edition: Official
Input Labels: [document]
Output Labels: [phi_present]
Language: en
Size: 12.0 MB
Dependencies: DocumentAssembler