Class/Object

com.johnsnowlabs.nlp.annotators.deid

DeIdentificationModel

Related Docs: object DeIdentificationModel | package deid

Permalink

class DeIdentificationModel extends AnnotatorModel[DeIdentificationModel] with DeIdentificationParams with Licensed

Contains all the parameters to transform a dataset with three Input Annotations of types DOCUMENT, TOKEN and CHUNK, into its DeIdentified version of by either masking or obfuscating the given CHUNKS

Linear Supertypes
Licensed, DeIdentificationParams, AnnotatorModel[DeIdentificationModel], CanBeLazy, RawAnnotator[DeIdentificationModel], HasOutputAnnotationCol, HasInputAnnotationCols, HasOutputAnnotatorType, ParamsAndFeaturesWritable, HasFeatures, DefaultParamsWritable, MLWritable, Model[DeIdentificationModel], Transformer, PipelineStage, Logging, Params, Serializable, Serializable, Identifiable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DeIdentificationModel
  2. Licensed
  3. DeIdentificationParams
  4. AnnotatorModel
  5. CanBeLazy
  6. RawAnnotator
  7. HasOutputAnnotationCol
  8. HasInputAnnotationCols
  9. HasOutputAnnotatorType
  10. ParamsAndFeaturesWritable
  11. HasFeatures
  12. DefaultParamsWritable
  13. MLWritable
  14. Model
  15. Transformer
  16. PipelineStage
  17. Logging
  18. Params
  19. Serializable
  20. Serializable
  21. Identifiable
  22. AnyRef
  23. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new DeIdentificationModel()

    Permalink
  2. new DeIdentificationModel(uid: String)

    Permalink

    uid

    a unique identifier for the instanced AnnotatorModel

Type Members

  1. type AnnotationContent = Seq[Row]

    Permalink
    Attributes
    protected
    Definition Classes
    AnnotatorModel
  2. type AnnotatorType = String

    Permalink
    Definition Classes
    HasOutputAnnotatorType
  3. implicit class StringReplacement extends AnyRef

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def $[T](param: Param[T]): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  4. def $$[T](feature: StructFeature[T]): T

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  5. def $$[K, V](feature: MapFeature[K, V]): Map[K, V]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  6. def $$[T](feature: SetFeature[T]): Set[T]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  7. def $$[T](feature: ArrayFeature[T]): Array[T]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  8. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  9. def _transform(dataset: Dataset[_], recursivePipeline: Option[PipelineModel]): DataFrame

    Permalink
    Attributes
    protected
    Definition Classes
    AnnotatorModel
  10. def afterAnnotate(dataset: DataFrame): DataFrame

    Permalink
    Attributes
    protected
    Definition Classes
    AnnotatorModel
  11. val allTerms: MapFeature[String, List[String]]

    Permalink

    dictionary, which contains all terms for using later in anonimization function

  12. def annotate(annotations: Seq[Annotation]): Seq[Annotation]

    Permalink

    This method represents the pipeline method which calls each method one by one It utilizes the main point of interest which is getAnonymizeSentence() and calls it for each sentence

    This method represents the pipeline method which calls each method one by one It utilizes the main point of interest which is getAnonymizeSentence() and calls it for each sentence

    annotations

    a Sequence of Annotations to anonymize

    returns

    a Sequence of Anonimized Annotations

    Definition Classes
    DeIdentificationModel → AnnotatorModel
  13. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  14. def beforeAnnotate(dataset: Dataset[_]): Dataset[_]

    Permalink
    Attributes
    protected
    Definition Classes
    AnnotatorModel
  15. final def checkSchema(schema: StructType, inputAnnotatorType: String): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    HasInputAnnotationCols
  16. def chunkFlexibleEquals(chunkA: Annotation, chunkB: Annotation): Boolean

    Permalink
  17. def chunkSameEntity(chunkA: Annotation, chunkB: Annotation): Boolean

    Permalink
  18. final def clear(param: Param[_]): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    Params
  19. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. val consistentObfuscation: BooleanParam

    Permalink

    Whether to replace very similar entities in a document with the same randomized term (default: true)

    Whether to replace very similar entities in a document with the same randomized term (default: true)

    Definition Classes
    DeIdentificationParams
  21. def copy(extra: ParamMap): DeIdentificationModel

    Permalink
    Definition Classes
    RawAnnotator → Model → Transformer → PipelineStage → Params
  22. def copyValues[T <: Params](to: T, extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  23. def createAnonymizeAnnotation(anonymizeSentence: String, offset: Int, idx: Int): Annotation

    Permalink

    The method that takes anonymized sentence to create proper Annotation

    The method that takes anonymized sentence to create proper Annotation

    anonymizeSentence

    a sentence, which is anonymized

    idx

    a index of the sentence

    returns

    a proper Annotation instance

  24. val dateFormats: StringArrayParam

    Permalink

    Format of dates to displace

    Format of dates to displace

    Definition Classes
    DeIdentificationParams
  25. val dateTag: Param[String]

    Permalink

    Tag representing dates in the obfuscate reference file (default: DATE)

    Tag representing dates in the obfuscate reference file (default: DATE)

    Definition Classes
    DeIdentificationParams
  26. val dateToYear: BooleanParam

    Permalink

    true if dates must be converted to years, false otherwise

    true if dates must be converted to years, false otherwise

    Definition Classes
    DeIdentificationParams
  27. val days: IntParam

    Permalink

    Number of days to obfuscate the dates by displacement.

    Number of days to obfuscate the dates by displacement. If not provided a random integer between 1 and 60 will be used

    Definition Classes
    DeIdentificationParams
  28. final def defaultCopy[T <: Params](extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  29. def dfAnnotate: UserDefinedFunction

    Permalink
    Attributes
    protected
    Definition Classes
    AnnotatorModel
  30. def duplicateClean(entities: Seq[Annotation], entitiesToCompare: Seq[Annotation]): Seq[Annotation]

    Permalink
  31. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  32. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  33. def explainParam(param: Param[_]): String

    Permalink
    Definition Classes
    Params
  34. def explainParams(): String

    Permalink
    Definition Classes
    Params
  35. def extraValidate(structType: StructType): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    RawAnnotator
  36. def extraValidateMsg: String

    Permalink
    Attributes
    protected
    Definition Classes
    RawAnnotator
  37. final def extractParamMap(): ParamMap

    Permalink
    Definition Classes
    Params
  38. final def extractParamMap(extra: ParamMap): ParamMap

    Permalink
    Definition Classes
    Params
  39. val features: ArrayBuffer[Feature[_, _, _]]

    Permalink
    Definition Classes
    HasFeatures
  40. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  41. def get[T](feature: StructFeature[T]): Option[T]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  42. def get[K, V](feature: MapFeature[K, V]): Option[Map[K, V]]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  43. def get[T](feature: SetFeature[T]): Option[Set[T]]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  44. def get[T](feature: ArrayFeature[T]): Option[Array[T]]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  45. final def get[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  46. def getAllTerms: Map[String, List[String]]

    Permalink
  47. def getAnonymizeSentence(sentence: String, protectedEntities: Seq[Annotation], dateTag: String = "DATE", days: Int = 0, dateToYear: Boolean = false, minYear: Int = 1929): String

    Permalink

    Main point of interest.

    Main point of interest. This method projects the sentence into the anonymized form This method is called for each sentence in the input collection of Annotations

    sentence

    a sentence, which we want to anonymize

    protectedEntities

    a sequence of Entities which we want to anonymize

    dateTag

    a String which represents the value with which we replace dates

    days

    a Int which represents how many days back we look at

    dateToYear

    a flag whether we use displaceDate() or apply dateToYear() method

    minYear

    a minimum date from which all obfuscated date start, default is 1929

    returns

    a String, which represents an anonymized sentence

  48. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  49. final def getDefault[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  50. def getFakerEntity(entity: String): String

    Permalink
  51. def getInputCols: Array[String]

    Permalink
    Definition Classes
    HasInputAnnotationCols
  52. def getLazyAnnotator: Boolean

    Permalink
    Definition Classes
    CanBeLazy
  53. def getNerEntitiesBySentence(annotations: Seq[Annotation], sentenceCount: Int): Seq[Seq[Annotation]]

    Permalink

    Returns the NER Annotations for each Annotation instance in the input Sequence

    Returns the NER Annotations for each Annotation instance in the input Sequence

    annotations

    a Sequence of Annotation instances

    returns

    a Sequence of Sequence[IndexedToken], each Sequence represents tokens from each input Annotation

  54. final def getOrDefault[T](param: Param[T]): T

    Permalink
    Definition Classes
    Params
  55. final def getOutputCol: String

    Permalink
    Definition Classes
    HasOutputAnnotationCol
  56. def getParam(paramName: String): Param[Any]

    Permalink
    Definition Classes
    Params
  57. def getRegexEntities(tokensSentence: Seq[IndexedToken], idx: Int): Seq[Annotation]

    Permalink

    Returns the Regex Annotations for each IndexedToken in the input Sequence

    Returns the Regex Annotations for each IndexedToken in the input Sequence

    tokensSentence

    a Sequence of IndexedToken instances

    returns

    a Sequence of Annotation, each Annotation represents Regex Entity

  58. def getRegexPatternsDictionary: Map[String, Array[String]]

    Permalink
  59. def getSentences(annotations: Seq[Annotation]): Seq[String]

    Permalink

    Returns the content of each sentence inside the input sequence

    Returns the content of each sentence inside the input sequence

    annotations

    a Sequence of Annotation instances, to return content from

    returns

    a Sequence of String, each string represents the content of the Annotation

  60. def getTokensBySentence(annotations: Seq[Annotation]): Seq[Seq[IndexedToken]]

    Permalink

    Returns the tokens for each Annotation instance in the input Sequence

    Returns the tokens for each Annotation instance in the input Sequence

    annotations

    a Sequence of Annotation instances

    returns

    a Sequence of Sequence[IndexedToken], each Sequence represents tokens from each input Annotation

  61. def handleEntitiesDifferences(AEntities: Seq[Annotation], BEntities: Seq[Annotation]): Seq[Annotation]

    Permalink

    Returns a complement of A entities against B entities

    Returns a complement of A entities against B entities

    AEntities

    a sequence of Entities to combine

    BEntities

    an sequence of Entities to combine

    returns

    a Sequence of Annotation, which is difference between NER and RegEx

  62. final def hasDefault[T](param: Param[T]): Boolean

    Permalink
    Definition Classes
    Params
  63. def hasParam(paramName: String): Boolean

    Permalink
    Definition Classes
    Params
  64. def hasParent: Boolean

    Permalink
    Definition Classes
    Model
  65. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  66. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  67. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  68. val inputAnnotatorTypes: Array[AnnotatorType]

    Permalink
    Definition Classes
    DeIdentificationModel → HasInputAnnotationCols
  69. final val inputCols: StringArrayParam

    Permalink
    Attributes
    protected
    Definition Classes
    HasInputAnnotationCols
  70. final def isDefined(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  71. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  72. def isRegexMatch(token: String, regexPatterns: Array[String]): Boolean

    Permalink

    Returns Boolean flag, which says if the token matches at least one pattern from array

    Returns Boolean flag, which says if the token matches at least one pattern from array

    token

    a token of interest to check for the match

    regexPatterns

    an Array of String to check against the token

    returns

    a Boolean flag, representing if the token matches at least pattern one of regexPatterns

  73. final def isSet(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  74. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  75. val lazyAnnotator: BooleanParam

    Permalink
    Definition Classes
    CanBeLazy
  76. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  77. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  78. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  79. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  80. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  81. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  82. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  83. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  84. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  85. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  86. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  87. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  88. def mergeEntities(nerEntities: Seq[Annotation], regexEntities: Seq[Annotation], regexOverride: Boolean = false): Seq[Annotation]

    Permalink

    Returns a combined Sequence of Annotations, cleaned from duplicates

    Returns a combined Sequence of Annotations, cleaned from duplicates

    nerEntities

    a sequence of NER Entities to combine

    regexEntities

    an sequence of Regex Entities to combine

    returns

    a Sequence of Annotation, which is result of a merge without duplicates

  89. val minYear: IntParam

    Permalink

    Minimum year to use when converting date to year

    Minimum year to use when converting date to year

    Definition Classes
    DeIdentificationParams
  90. val mode: Param[String]

    Permalink

    Mode for Anonymizer ['mask'|'obfuscate']

    Mode for Anonymizer ['mask'|'obfuscate']

    Definition Classes
    DeIdentificationParams
  91. def msgHelper(schema: StructType): String

    Permalink
    Attributes
    protected
    Definition Classes
    HasInputAnnotationCols
  92. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  93. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  94. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  95. val obfuscateDate: BooleanParam

    Permalink

    When mode=="obfuscate" whether to obfuscate dates or not.

    When mode=="obfuscate" whether to obfuscate dates or not. This param helps in consistency to make dateFormats more visible. When setting to true, make sure dateFormats param fits the needs (default: false)

    Definition Classes
    DeIdentificationParams
  96. val obfuscateRefSource: Param[String]

    Permalink
    Definition Classes
    DeIdentificationParams
  97. def onWrite(path: String, spark: SparkSession): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    ParamsAndFeaturesWritable
  98. val outputAnnotatorType: AnnotatorType

    Permalink
    Definition Classes
    DeIdentificationModel → HasOutputAnnotatorType
  99. final val outputCol: Param[String]

    Permalink
    Attributes
    protected
    Definition Classes
    HasOutputAnnotationCol
  100. lazy val params: Array[Param[_]]

    Permalink
    Definition Classes
    Params
  101. var parent: Estimator[DeIdentificationModel]

    Permalink
    Definition Classes
    Model
  102. val random: Random

    Permalink
  103. val regexOverride: BooleanParam

    Permalink
    Definition Classes
    DeIdentificationParams
  104. val regexPatternsDictionary: MapFeature[String, Array[String]]

    Permalink

    dictionary with regular expression patterns that match some protected entity

  105. def replaceRegExFlavors(word: String): String

    Permalink

    This is simple RegEx replace which removes some punctuation tokens from input

    This is simple RegEx replace which removes some punctuation tokens from input

    word

    a String, inside which we want to replace flavors

    returns

    a String, which represents a cleaned version

  106. val sameEntityThreshold: DoubleParam

    Permalink

    Similarity threshold [0.0-1.0] to consider two appearances of an entity as the same (default: 0.9)

    Similarity threshold [0.0-1.0] to consider two appearances of an entity as the same (default: 0.9)

    Definition Classes
    DeIdentificationParams
  107. def save(path: String): Unit

    Permalink
    Definition Classes
    MLWritable
    Annotations
    @Since( "1.6.0" ) @throws( ... )
  108. def set[T](feature: StructFeature[T], value: T): DeIdentificationModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  109. def set[K, V](feature: MapFeature[K, V], value: Map[K, V]): DeIdentificationModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  110. def set[T](feature: SetFeature[T], value: Set[T]): DeIdentificationModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  111. def set[T](feature: ArrayFeature[T], value: Array[T]): DeIdentificationModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  112. final def set(paramPair: ParamPair[_]): DeIdentificationModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  113. final def set(param: String, value: Any): DeIdentificationModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  114. final def set[T](param: Param[T], value: T): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    Params
  115. def setAllTerms(value: Map[String, List[String]]): DeIdentificationModel.this.type

    Permalink
  116. def setConsistentObfuscation(s: Boolean): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    DeIdentificationParams
  117. def setDateFormats(s: Array[String]): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    DeIdentificationParams
  118. def setDateTag(s: String): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    DeIdentificationParams
  119. def setDateToYear(s: Boolean): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    DeIdentificationParams
  120. def setDays(k: Int): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    DeIdentificationParams
  121. def setDefault[T](feature: StructFeature[T], value: () ⇒ T): DeIdentificationModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  122. def setDefault[K, V](feature: MapFeature[K, V], value: () ⇒ Map[K, V]): DeIdentificationModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  123. def setDefault[T](feature: SetFeature[T], value: () ⇒ Set[T]): DeIdentificationModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  124. def setDefault[T](feature: ArrayFeature[T], value: () ⇒ Array[T]): DeIdentificationModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  125. final def setDefault(paramPairs: ParamPair[_]*): DeIdentificationModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  126. final def setDefault[T](param: Param[T], value: T): DeIdentificationModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  127. final def setInputCols(value: String*): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    HasInputAnnotationCols
  128. final def setInputCols(value: Array[String]): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    HasInputAnnotationCols
  129. def setLazyAnnotator(value: Boolean): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    CanBeLazy
  130. def setMinYear(s: Int): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    DeIdentificationParams
  131. def setMode(m: String): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    DeIdentificationParams
  132. def setObfuscateDate(s: Boolean): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    DeIdentificationParams
  133. def setObfuscateRefSource(s: String): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    DeIdentificationParams
  134. final def setOutputCol(value: String): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    HasOutputAnnotationCol
  135. def setParent(parent: Estimator[DeIdentificationModel]): DeIdentificationModel

    Permalink
    Definition Classes
    Model
  136. def setRegexOverride(s: Boolean): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    DeIdentificationParams
  137. def setRegexPatternsDictionary(value: Map[String, Array[String]]): DeIdentificationModel.this.type

    Permalink
  138. def setSameEntityThreshold(s: Double): DeIdentificationModel.this.type

    Permalink
    Definition Classes
    DeIdentificationParams
  139. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  140. def toString(): String

    Permalink
    Definition Classes
    Identifiable → AnyRef → Any
  141. final def transform(dataset: Dataset[_]): DataFrame

    Permalink
    Definition Classes
    AnnotatorModel → Transformer
  142. def transform(dataset: Dataset[_], paramMap: ParamMap): DataFrame

    Permalink
    Definition Classes
    Transformer
    Annotations
    @Since( "2.0.0" )
  143. def transform(dataset: Dataset[_], firstParamPair: ParamPair[_], otherParamPairs: ParamPair[_]*): DataFrame

    Permalink
    Definition Classes
    Transformer
    Annotations
    @Since( "2.0.0" ) @varargs()
  144. final def transformSchema(schema: StructType): StructType

    Permalink
    Definition Classes
    RawAnnotator → PipelineStage
  145. def transformSchema(schema: StructType, logging: Boolean): StructType

    Permalink
    Attributes
    protected
    Definition Classes
    PipelineStage
    Annotations
    @DeveloperApi()
  146. val uid: String

    Permalink

    a unique identifier for the instanced AnnotatorModel

    a unique identifier for the instanced AnnotatorModel

    Definition Classes
    DeIdentificationModel → Identifiable
  147. def validate(schema: StructType): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    RawAnnotator
  148. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  149. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  150. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  151. def wrapColumnMetadata(col: Column): Column

    Permalink
    Attributes
    protected
    Definition Classes
    RawAnnotator
  152. def write: MLWriter

    Permalink
    Definition Classes
    ParamsAndFeaturesWritable → DefaultParamsWritable → MLWritable

Inherited from Licensed

Inherited from DeIdentificationParams

Inherited from AnnotatorModel[DeIdentificationModel]

Inherited from CanBeLazy

Inherited from RawAnnotator[DeIdentificationModel]

Inherited from HasOutputAnnotationCol

Inherited from HasInputAnnotationCols

Inherited from HasOutputAnnotatorType

Inherited from ParamsAndFeaturesWritable

Inherited from HasFeatures

Inherited from DefaultParamsWritable

Inherited from MLWritable

Inherited from Model[DeIdentificationModel]

Inherited from Transformer

Inherited from PipelineStage

Inherited from Logging

Inherited from Params

Inherited from Serializable

Inherited from Serializable

Inherited from Identifiable

Inherited from AnyRef

Inherited from Any

Ungrouped