Packages

p

com.johnsnowlabs.nlp.annotators

generic_classifier

package generic_classifier

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. class GenericClassifierApproach extends AnnotatorApproach[GenericClassifierModel] with GenericClassifierParams with HandleExceptionParams with CheckLicense

    Trains a TensorFlow model for generic classification of feature vectors.

    Trains a TensorFlow model for generic classification of feature vectors. It takes FEATURE_VECTOR annotations from FeaturesAssembler as input, classifies them and outputs CATEGORY annotations. Please see the Parameters section for required training parameters.

    The Tensorflow graph of the classifier is selected automatically from the graphs embedded in the library, based on the length of the feature vectors and on the number of classes of the training dataset. Set setModelFile to train with a specific graph, or setGraphFolder to let the annotator choose from a folder of custom graphs built with sparknlp_jsl.training.tf_graph.

    For a more extensive example please see the Spark NLP Workshop.

    Example

    val features_asm = new FeaturesAssembler()
  .setInputCols(Array("feature_1", "feature_2", "...", "feature_n"))
  .setOutputCol("features")

val gen_clf = new GenericClassifierApproach()
  .setLabelColumn("target")
  .setInputCols("features")
  .setOutputCol("prediction")
  .setModelFile("/path/to/graph_file.pb")
  .setEpochsNumber(50)
  .setBatchSize(100)
  .setFeatureScaling("zscore")
  .setlearningRate(0.001f)
  .setFixImbalance(true)
  .setOutputLogsPath("logs")
  .setValidationSplit(0.2f) // keep 20% of the data for validation purposes

val pipeline = new Pipeline().setStages(Array(
  features_asm,
  gen_clf
))

val clf_model = pipeline.fit(data)
    See also

    GenericClassifierModel for the trained model

  2. class GenericClassifierDataEncoder extends Serializable
    Annotations
    @SerialVersionUID()
  3. class GenericClassifierModel extends AnnotatorModel[GenericClassifierModel] with GenericClassifierParams with HasStorageRef with ParamsAndFeaturesWritable with WriteTensorflowModel with HasSimpleAnnotate[GenericClassifierModel] with HandleExceptionParams with HasSafeAnnotate[GenericClassifierModel] with CheckLicense

    Creates a generic single-label classifier which uses pre-generated Tensorflow graphs.

    Creates a generic single-label classifier which uses pre-generated Tensorflow graphs. The model operates on FEATURE_VECTOR annotations which can be produced using FeatureAssembler. Requires the FeaturesAssembler to create the input.

    See also

    GenericClassifierApproach for an example and on how to define your own model

  4. trait GenericClassifierParams extends Params
  5. trait ReadablePretrainedGenericClassifier[T <: GenericClassifierModel] extends ParamsAndFeaturesReadable[T] with HasPretrained[T]
  6. trait ReadsGenericClassifierGraph[T <: GenericClassifierModel] extends ParamsAndFeaturesReadable[T] with ReadTensorflowModel

Value Members

  1. object GenericClassifierApproach extends DefaultParamsReadable[GenericClassifierApproach] with Serializable
  2. object GenericClassifierModel extends ReadsGenericClassifierGraph[GenericClassifierModel] with ReadablePretrainedGenericClassifier[GenericClassifierModel] with Serializable

Ungrouped