sparknlp.functions.explode_annotations_col#
- sparknlp.functions.explode_annotations_col(dataframe: pyspark.sql.dataframe.DataFrame, column, output_column)[source]#
Explodes an Annotation column, putting each result onto a separate row.
- Parameters
- dataframeDataFrame
The Spark DataFrame containing output Annotations
- columnstr
Name of the column
- output_columnstr
Name of the output column
- Returns
pyspark.sql.DataFrame
Transformed DataFrame
Examples
>>> from sparknlp.pretrained import PretrainedPipeline >>> from sparknlp.functions import * >>> explain_document_pipeline = PretrainedPipeline("explain_document_dl") >>> data = spark.createDataFrame([["U.N. official Ekeus heads for Baghdad."]]).toDF("text") >>> result = explain_document_pipeline.transform(data) >>> result.select("pos.result").show(truncate=False) +----------------------------------+ |result | +----------------------------------+ |[NNP, ., JJ, NNP, VBZ, IN, NNP, .]| +----------------------------------+ >>> explode_annotations_col(result, "pos", "pos").select("pos.result").show() +------+ |result| +------+ | NNP| | .| | JJ| | NNP| | VBZ| | IN| | NNP| | .| +------+