Explain Document Pipeline for Dutch


The explain_document_md is a pretrained pipeline that we can use to process text with a simple pipeline that performs basic processing steps. It performs most of the common text processing tasks on your dataframe

Open in Colab Download

How to use

from sparknlp.pretrained import PretrainedPipelinein
pipeline = PretrainedPipeline('explain_document_md', lang = 'nl')
annotations =  pipeline.fullAnnotate(""Hallo van John Snow Labs! "")[0]

val pipeline = new PretrainedPipeline("explain_document_md", lang = "nl")
val result = pipeline.fullAnnotate("Hallo van John Snow Labs! ")(0)

import nlu
text = [""Hallo van John Snow Labs! ""]
result_df = nlu.load('nl.explain.md').predict(text)


|    | document                       | sentence                      | token                                     | lemma                                     | pos                                         | embeddings                   | ner                                   | entities            |
|  0 | ['Hallo van John Snow Labs! '] | ['Hallo van John Snow Labs!'] | ['Hallo', 'van', 'John', 'Snow', 'Labs!'] | ['Hallo', 'van', 'John', 'Snow', 'Labs!'] | ['PROPN', 'ADP', 'PROPN', 'PROPN', 'PROPN'] | [[0.5910000205039978,.,...]] | ['O', 'O', 'B-PER', 'I-PER', 'I-PER'] | ['John Snow Labs!'] |

Model Information

Model Name: explain_document_md
Type: pipeline
Compatibility: Spark NLP 3.0.0+
License: Open Source
Edition: Official
Language: nl