trait AuxEncryptionParams extends Params
Adds the aux (mappings) column encryption key to an annotator.
The de-identification annotators use it to encrypt the mappings column they produce, and ReIdentification uses it to decrypt that column back. The same key must be set on both sides.
When the key is left empty (the default) nothing is encrypted and the mappings column keeps the plain behavior it has always had.
The key is never stored in clear text: setAuxEncryptionKey wraps it with a key embedded in the jar before putting it into the param, so a saved pipeline only contains the wrapped form. The wrapping is transparent to the user, who always sets and thinks in terms of their own key.
- Grouped
- Alphabetic
- By Inheritance
- AuxEncryptionParams
- Params
- Serializable
- Serializable
- Identifiable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Abstract Value Members
Concrete Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
$[T](param: Param[T]): T
- Attributes
- protected
- Definition Classes
- Params
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
val
auxEncryptionKey: Param[String]
The key used to encrypt and decrypt the mappings (aux) column.
The key used to encrypt and decrypt the mappings (aux) column. Empty means no encryption.
-
final
def
clear(param: Param[_]): AuxEncryptionParams.this.type
- Definition Classes
- Params
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
copyValues[T <: Params](to: T, extra: ParamMap): T
- Attributes
- protected
- Definition Classes
- Params
-
def
decryptMappingAnnotation(annotation: Annotation, key: String): Annotation
Decrypts a mappings chunk annotation produced with encryptMappingAnnotation.
Decrypts a mappings chunk annotation produced with encryptMappingAnnotation.
- Attributes
- protected
-
final
def
defaultCopy[T <: Params](extra: ParamMap): T
- Attributes
- protected
- Definition Classes
- Params
-
def
encryptMappingAnnotation(annotation: Annotation, key: String): Annotation
Encrypts the sensitive fields of a mappings chunk annotation.
Encrypts the sensitive fields of a mappings chunk annotation.
- Attributes
- protected
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
explainParam(param: Param[_]): String
- Definition Classes
- Params
-
def
explainParams(): String
- Definition Classes
- Params
-
final
def
extractParamMap(): ParamMap
- Definition Classes
- Params
-
final
def
extractParamMap(extra: ParamMap): ParamMap
- Definition Classes
- Params
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
get[T](param: Param[T]): Option[T]
- Definition Classes
- Params
-
def
getAuxEncryptionKey: String
Gets auxEncryptionKey as stored, that is in its wrapped form.
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
getDefault[T](param: Param[T]): Option[T]
- Definition Classes
- Params
-
final
def
getOrDefault[T](param: Param[T]): T
- Definition Classes
- Params
-
def
getParam(paramName: String): Param[Any]
- Definition Classes
- Params
-
final
def
hasDefault[T](param: Param[T]): Boolean
- Definition Classes
- Params
-
def
hasParam(paramName: String): Boolean
- Definition Classes
- Params
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
isAuxEncryptionEnabled: Boolean
Whether a key was provided, which is what turns aux encryption on.
Whether a key was provided, which is what turns aux encryption on.
- Attributes
- protected
-
final
def
isDefined(param: Param[_]): Boolean
- Definition Classes
- Params
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
isSet(param: Param[_]): Boolean
- Definition Classes
- Params
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
lazy val
params: Array[Param[_]]
- Definition Classes
- Params
-
def
resolvedAuxKey: String
The usable key, unwrapped from its stored form.
The usable key, unwrapped from its stored form. Empty when encryption is disabled.
- Attributes
- protected
-
final
def
set(paramPair: ParamPair[_]): AuxEncryptionParams.this.type
- Attributes
- protected
- Definition Classes
- Params
-
final
def
set(param: String, value: Any): AuxEncryptionParams.this.type
- Attributes
- protected
- Definition Classes
- Params
-
final
def
set[T](param: Param[T], value: T): AuxEncryptionParams.this.type
- Definition Classes
- Params
-
def
setAuxEncryptionKey(value: String): AuxEncryptionParams.this.type
Sets the key used to encrypt and decrypt the mappings (aux) column.
Sets the key used to encrypt and decrypt the mappings (aux) column.
When set on a de-identification annotator, the original values carried by the mappings column are encrypted with AES-256-GCM. ReIdentification needs the very same key to restore the original text. When left unset, the mappings column is produced in clear text as before.
-
final
def
setDefault(paramPairs: ParamPair[_]*): AuxEncryptionParams.this.type
- Attributes
- protected
- Definition Classes
- Params
-
final
def
setDefault[T](param: Param[T], value: T): AuxEncryptionParams.this.type
- Attributes
- protected[org.apache.spark.ml]
- Definition Classes
- Params
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- Identifiable → AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()