Description
Pretrained Part of Speech model (pos_ftb
) trained on Universal Dependencies 2.9 (UD_Finnish-FTB) in Finnish language.
Open in Colab Download Copy S3 URI
How to use
document = DocumentAssembler()\
.setInputCol("text")\
.setOutputCol("document")
sentence = SentenceDetectorDLModel.pretrained("sentence_detector_dl", "xx")\
.setInputCols(["document"])\
.setOutputCol("sentence")
tokenizer = Tokenizer()\
.setInputCols(["sentence"])\
.setOutputCol("token")
pos = PerceptronModel.pretrained("pos_ftb", "fi")\
.setInputCols(["sentence", "token"])\
.setOutputCol("pos")
pipeline = Pipeline(stages=[document, sentence, tokenizer, pos])
data = spark.createDataFrame([["I love Spark NLP"]]).toDF("text")
result = pipeline.fit(data).transform(data)
Model Information
Model Name: | pos_ftb |
Compatibility: | Spark NLP 3.4.3+ |
License: | Open Source |
Edition: | Official |
Input Labels: | [sentence, form] |
Output Labels: | [pos] |
Language: | fi |
Size: | 5.0 MB |
References
Model is trained on Universal Dependencies (treebank 2.9) UD_Finnish-FTB