Class/Object

com.johnsnowlabs.nlp.annotators.resolution

BigChunkEntityResolverModel

Related Docs: object BigChunkEntityResolverModel | package resolution

Permalink

class BigChunkEntityResolverModel extends AnnotatorModel[BigChunkEntityResolverModel] with HasStorageModel with HasEmbeddingsProperties with Licensed

Linear Supertypes
Licensed, HasEmbeddingsProperties, HasStorageModel, HasExcludableStorage, HasStorageReader, HasCaseSensitiveProperties, HasStorageRef, AnnotatorModel[BigChunkEntityResolverModel], CanBeLazy, RawAnnotator[BigChunkEntityResolverModel], HasOutputAnnotationCol, HasInputAnnotationCols, HasOutputAnnotatorType, ParamsAndFeaturesWritable, HasFeatures, DefaultParamsWritable, MLWritable, Model[BigChunkEntityResolverModel], Transformer, PipelineStage, Logging, Params, Serializable, Serializable, Identifiable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. BigChunkEntityResolverModel
  2. Licensed
  3. HasEmbeddingsProperties
  4. HasStorageModel
  5. HasExcludableStorage
  6. HasStorageReader
  7. HasCaseSensitiveProperties
  8. HasStorageRef
  9. AnnotatorModel
  10. CanBeLazy
  11. RawAnnotator
  12. HasOutputAnnotationCol
  13. HasInputAnnotationCols
  14. HasOutputAnnotatorType
  15. ParamsAndFeaturesWritable
  16. HasFeatures
  17. DefaultParamsWritable
  18. MLWritable
  19. Model
  20. Transformer
  21. PipelineStage
  22. Logging
  23. Params
  24. Serializable
  25. Serializable
  26. Identifiable
  27. AnyRef
  28. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new BigChunkEntityResolverModel()

    Permalink
  2. new BigChunkEntityResolverModel(uid: String)

    Permalink

Type Members

  1. type AnnotationContent = Seq[Row]

    Permalink
    Attributes
    protected
    Definition Classes
    AnnotatorModel
  2. type AnnotatorType = String

    Permalink
    Definition Classes
    HasOutputAnnotatorType

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def $[T](param: Param[T]): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  4. def $$[T](feature: StructFeature[T]): T

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  5. def $$[K, V](feature: MapFeature[K, V]): Map[K, V]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  6. def $$[T](feature: SetFeature[T]): Set[T]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  7. def $$[T](feature: ArrayFeature[T]): Array[T]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  8. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  9. def _transform(dataset: Dataset[_], recursivePipeline: Option[PipelineModel]): DataFrame

    Permalink
    Attributes
    protected
    Definition Classes
    AnnotatorModel
  10. def afterAnnotate(dataset: DataFrame): DataFrame

    Permalink
    Attributes
    protected
    Definition Classes
    AnnotatorModel
  11. def annotate(annotations: Seq[Annotation]): Seq[Annotation]

    Permalink

    takes a document and annotations and produces new annotations of this annotator's annotation type

    takes a document and annotations and produces new annotations of this annotator's annotation type

    annotations

    Annotations that correspond to inputAnnotationCols generated by previous annotators if any

    returns

    any number of annotations processed for every input annotation. Not necessary one to one relationship

    Definition Classes
    BigChunkEntityResolverModel → AnnotatorModel
  12. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  13. def beforeAnnotate(dataset: Dataset[_]): Dataset[_]

    Permalink
    Attributes
    protected
    Definition Classes
    BigChunkEntityResolverModel → AnnotatorModel
  14. val caseSensitive: BooleanParam

    Permalink
    Definition Classes
    HasCaseSensitiveProperties
  15. final def checkSchema(schema: StructType, inputAnnotatorType: String): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    HasInputAnnotationCols
  16. final def clear(param: Param[_]): BigChunkEntityResolverModel.this.type

    Permalink
    Definition Classes
    Params
  17. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  18. def copy(extra: ParamMap): BigChunkEntityResolverModel

    Permalink
    Definition Classes
    RawAnnotator → Model → Transformer → PipelineStage → Params
  19. def copyValues[T <: Params](to: T, extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  20. def createDatabaseConnection(database: Name): RocksDBConnection

    Permalink
    Definition Classes
    HasStorageRef
  21. def createReader(database: Name, connection: RocksDBConnection): StorageReader[_]

    Permalink
    Attributes
    protected
    Definition Classes
    BigChunkEntityResolverModel → HasStorageReader
  22. val databases: Array[Name]

    Permalink
    Attributes
    protected
    Definition Classes
    BigChunkEntityResolverModel → HasStorageModel
  23. final def defaultCopy[T <: Params](extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  24. def deserializeStorage(path: String, spark: SparkSession): Unit

    Permalink
    Definition Classes
    HasStorageModel
  25. def dfAnnotate: UserDefinedFunction

    Permalink
    Attributes
    protected
    Definition Classes
    AnnotatorModel
  26. val dimension: IntParam

    Permalink
    Definition Classes
    HasEmbeddingsProperties
  27. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  28. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  29. def explainParam(param: Param[_]): String

    Permalink
    Definition Classes
    Params
  30. def explainParams(): String

    Permalink
    Definition Classes
    Params
  31. def extraValidate(structType: StructType): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    RawAnnotator
  32. def extraValidateMsg: String

    Permalink
    Attributes
    protected
    Definition Classes
    RawAnnotator
  33. final def extractParamMap(): ParamMap

    Permalink
    Definition Classes
    Params
  34. final def extractParamMap(extra: ParamMap): ParamMap

    Permalink
    Definition Classes
    Params
  35. val features: ArrayBuffer[Feature[_, _, _]]

    Permalink
    Definition Classes
    HasFeatures
  36. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  37. def findMatches(chunkEmbeddings: Array[Float], tokens: Array[String], wm: WordMovers): Option[Array[BigFoundData]]

    Permalink
  38. def get[T](feature: StructFeature[T]): Option[T]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  39. def get[K, V](feature: MapFeature[K, V]): Option[Map[K, V]]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  40. def get[T](feature: SetFeature[T]): Option[Set[T]]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  41. def get[T](feature: ArrayFeature[T]): Option[Array[T]]

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  42. final def get[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  43. def getCaseSensitive: Boolean

    Permalink
    Definition Classes
    HasCaseSensitiveProperties
  44. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  45. final def getDefault[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  46. def getDimension: Int

    Permalink
    Definition Classes
    HasEmbeddingsProperties
  47. def getIncludeStorage: Boolean

    Permalink
    Definition Classes
    HasExcludableStorage
  48. def getInputCols: Array[String]

    Permalink
    Definition Classes
    HasInputAnnotationCols
  49. def getLazyAnnotator: Boolean

    Permalink
    Definition Classes
    CanBeLazy
  50. final def getOrDefault[T](param: Param[T]): T

    Permalink
    Definition Classes
    Params
  51. final def getOutputCol: String

    Permalink
    Definition Classes
    HasOutputAnnotationCol
  52. def getParam(paramName: String): Param[Any]

    Permalink
    Definition Classes
    Params
  53. def getReader[A](database: Name): StorageReader[A]

    Permalink
    Attributes
    protected
    Definition Classes
    HasStorageReader
  54. def getStorageRef: String

    Permalink
    Definition Classes
    HasStorageRef
  55. final def hasDefault[T](param: Param[T]): Boolean

    Permalink
    Definition Classes
    Params
  56. def hasParam(paramName: String): Boolean

    Permalink
    Definition Classes
    Params
  57. def hasParent: Boolean

    Permalink
    Definition Classes
    Model
  58. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  59. val includeStorage: BooleanParam

    Permalink
    Definition Classes
    HasExcludableStorage
  60. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  61. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  62. val inputAnnotatorTypes: Array[String]

    Permalink

    Annotator reference id.

    Annotator reference id. Used to identify elements in metadata or to refer to this annotator type

    Definition Classes
    BigChunkEntityResolverModel → HasInputAnnotationCols
  63. final val inputCols: StringArrayParam

    Permalink
    Attributes
    protected
    Definition Classes
    HasInputAnnotationCols
  64. final def isDefined(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  65. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  66. final def isSet(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  67. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  68. val lazyAnnotator: BooleanParam

    Permalink
    Definition Classes
    CanBeLazy
  69. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  70. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  71. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  72. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  73. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  74. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  75. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  76. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  77. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  78. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  79. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  80. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  81. val missAsEmpty: BooleanParam

    Permalink
  82. def msgHelper(schema: StructType): String

    Permalink
    Attributes
    protected
    Definition Classes
    HasInputAnnotationCols
  83. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  84. val neighbours: IntParam

    Permalink
  85. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  86. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  87. def onWrite(path: String, spark: SparkSession): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    HasStorageModel → ParamsAndFeaturesWritable
  88. val outputAnnotatorType: AnnotatorType

    Permalink
    Definition Classes
    BigChunkEntityResolverModel → HasOutputAnnotatorType
  89. final val outputCol: Param[String]

    Permalink
    Attributes
    protected
    Definition Classes
    HasOutputAnnotationCol
  90. lazy val params: Array[Param[_]]

    Permalink
    Definition Classes
    Params
  91. var parent: Estimator[BigChunkEntityResolverModel]

    Permalink
    Definition Classes
    Model
  92. var readers: Map[Name, StorageReader[_]]

    Permalink
    Attributes
    protected
    Definition Classes
    HasStorageReader
  93. def save(path: String): Unit

    Permalink
    Definition Classes
    MLWritable
    Annotations
    @Since( "1.6.0" ) @throws( ... )
  94. def saveStorage(path: String, spark: SparkSession, withinStorage: Boolean): Unit

    Permalink
    Definition Classes
    HasStorageModel
  95. val searchTree: StructFeature[JSerializableKDTree]

    Permalink
  96. def serializeStorage(path: String, spark: SparkSession): Unit

    Permalink
    Definition Classes
    HasStorageModel
  97. def set[T](feature: StructFeature[T], value: T): BigChunkEntityResolverModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  98. def set[K, V](feature: MapFeature[K, V], value: Map[K, V]): BigChunkEntityResolverModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  99. def set[T](feature: SetFeature[T], value: Set[T]): BigChunkEntityResolverModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  100. def set[T](feature: ArrayFeature[T], value: Array[T]): BigChunkEntityResolverModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  101. final def set(paramPair: ParamPair[_]): BigChunkEntityResolverModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  102. final def set(param: String, value: Any): BigChunkEntityResolverModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  103. final def set[T](param: Param[T], value: T): BigChunkEntityResolverModel.this.type

    Permalink
    Definition Classes
    Params
  104. def setCaseSensitive(value: Boolean): BigChunkEntityResolverModel.this.type

    Permalink
    Definition Classes
    HasCaseSensitiveProperties
  105. def setDefault[T](feature: StructFeature[T], value: () ⇒ T): BigChunkEntityResolverModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  106. def setDefault[K, V](feature: MapFeature[K, V], value: () ⇒ Map[K, V]): BigChunkEntityResolverModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  107. def setDefault[T](feature: SetFeature[T], value: () ⇒ Set[T]): BigChunkEntityResolverModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  108. def setDefault[T](feature: ArrayFeature[T], value: () ⇒ Array[T]): BigChunkEntityResolverModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    HasFeatures
  109. final def setDefault(paramPairs: ParamPair[_]*): BigChunkEntityResolverModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  110. final def setDefault[T](param: Param[T], value: T): BigChunkEntityResolverModel.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  111. def setDimension(value: Int): BigChunkEntityResolverModel.this.type

    Permalink
    Definition Classes
    HasEmbeddingsProperties
  112. def setIncludeStorage(value: Boolean): BigChunkEntityResolverModel.this.type

    Permalink
    Definition Classes
    HasExcludableStorage
  113. final def setInputCols(value: String*): BigChunkEntityResolverModel.this.type

    Permalink
    Definition Classes
    HasInputAnnotationCols
  114. final def setInputCols(value: Array[String]): BigChunkEntityResolverModel.this.type

    Permalink
    Definition Classes
    HasInputAnnotationCols
  115. def setLazyAnnotator(value: Boolean): BigChunkEntityResolverModel.this.type

    Permalink
    Definition Classes
    CanBeLazy
  116. def setMissAsEmpty(v: Boolean): BigChunkEntityResolverModel.this.type

    Permalink
  117. def setNeighbours(k: Int): BigChunkEntityResolverModel.this.type

    Permalink
  118. final def setOutputCol(value: String): BigChunkEntityResolverModel.this.type

    Permalink
    Definition Classes
    HasOutputAnnotationCol
  119. def setParent(parent: Estimator[BigChunkEntityResolverModel]): BigChunkEntityResolverModel

    Permalink
    Definition Classes
    Model
  120. def setSearchTree(tree: JSerializableKDTree): BigChunkEntityResolverModel.this.type

    Permalink
  121. def setStorageRef(value: String): BigChunkEntityResolverModel.this.type

    Permalink
    Definition Classes
    HasStorageRef
  122. def setThreshold(dist: Double): BigChunkEntityResolverModel.this.type

    Permalink
  123. val storageRef: Param[String]

    Permalink
    Definition Classes
    HasStorageRef
  124. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  125. val threshold: DoubleParam

    Permalink
  126. def toString(): String

    Permalink
    Definition Classes
    Identifiable → AnyRef → Any
  127. final def transform(dataset: Dataset[_]): DataFrame

    Permalink
    Definition Classes
    AnnotatorModel → Transformer
  128. def transform(dataset: Dataset[_], paramMap: ParamMap): DataFrame

    Permalink
    Definition Classes
    Transformer
    Annotations
    @Since( "2.0.0" )
  129. def transform(dataset: Dataset[_], firstParamPair: ParamPair[_], otherParamPairs: ParamPair[_]*): DataFrame

    Permalink
    Definition Classes
    Transformer
    Annotations
    @Since( "2.0.0" ) @varargs()
  130. final def transformSchema(schema: StructType): StructType

    Permalink
    Definition Classes
    RawAnnotator → PipelineStage
  131. def transformSchema(schema: StructType, logging: Boolean): StructType

    Permalink
    Attributes
    protected
    Definition Classes
    PipelineStage
    Annotations
    @DeveloperApi()
  132. val uid: String

    Permalink
    Definition Classes
    BigChunkEntityResolverModel → Identifiable
  133. def validate(schema: StructType): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    RawAnnotator
  134. def validateStorageRef(dataset: Dataset[_], inputCols: Array[String], annotatorType: String): Unit

    Permalink
    Definition Classes
    HasStorageRef
  135. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  136. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  137. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  138. def wrapColumnMetadata(col: Column): Column

    Permalink
    Attributes
    protected
    Definition Classes
    RawAnnotator
  139. def wrapEmbeddingsMetadata(col: Column, embeddingsDim: Int, embeddingsRef: Option[String]): Column

    Permalink
    Attributes
    protected
    Definition Classes
    HasEmbeddingsProperties
  140. def wrapSentenceEmbeddingsMetadata(col: Column, embeddingsDim: Int, embeddingsRef: Option[String]): Column

    Permalink
    Attributes
    protected
    Definition Classes
    HasEmbeddingsProperties
  141. def write: MLWriter

    Permalink
    Definition Classes
    ParamsAndFeaturesWritable → DefaultParamsWritable → MLWritable

Inherited from Licensed

Inherited from HasEmbeddingsProperties

Inherited from HasStorageModel

Inherited from HasExcludableStorage

Inherited from HasStorageReader

Inherited from HasCaseSensitiveProperties

Inherited from HasStorageRef

Inherited from AnnotatorModel[BigChunkEntityResolverModel]

Inherited from CanBeLazy

Inherited from RawAnnotator[BigChunkEntityResolverModel]

Inherited from HasOutputAnnotationCol

Inherited from HasInputAnnotationCols

Inherited from HasOutputAnnotatorType

Inherited from ParamsAndFeaturesWritable

Inherited from HasFeatures

Inherited from DefaultParamsWritable

Inherited from MLWritable

Inherited from Model[BigChunkEntityResolverModel]

Inherited from Transformer

Inherited from PipelineStage

Inherited from Logging

Inherited from Params

Inherited from Serializable

Inherited from Serializable

Inherited from Identifiable

Inherited from AnyRef

Inherited from Any

Ungrouped