Description
Pretrained Lemmatizer model (lemma_esl) trained on Universal Dependencies 2.9 (UD_English-ESL) in English language.
Open in Colab Download Copy S3 URICopied!
How to use
document = DocumentAssembler()\
.setInputCol("text")\
.setOutputCol("document")
sentence = SentenceDetectorDLModel.pretrained("sentence_detector_dl", "xx")\
.setInputCols(["document"])\
.setOutputCol("sentence")
tokenizer = Tokenizer()\
.setInputCols(["sentence"])\
.setOutputCol("token")
lemma = LemmatizerModel.pretrained("lemma_esl", "en")\
.setInputCols(["token"])\
.setOutputCol("lemma")
pipeline = Pipeline(stages=[document, sentence, tokenizer, lemma])
data = spark.createDataFrame([["I love Spark NLP"]]).toDF("text")
result = pipeline.fit(data).transform(data)
Model Information
| Model Name: | lemma_esl |
| Compatibility: | Spark NLP 3.4.3+ |
| License: | Open Source |
| Edition: | Official |
| Input Labels: | [form] |
| Output Labels: | [lemma] |
| Language: | en |
| Size: | 38.3 KB |
References
Model is trained on Universal Dependencies (treebank 2.9) UD_English-ESL