Description
This pre-trained pipeline identifies whether the two question sentences are semantically repetitive or different.
How to use
- The question pairs should be identified with “q1” and “q2” in the text. The input text format should be as follows :
text = "q1: What is your name? q2: Who are you?".
python pipeline = PretrainedPipeline("classifierdl_electra_questionpair_pipeline", "en")
result1 = pipeline.fullAnnotate("q1: What is your favorite movie? q2: Which movie do you like most?")
result2 = pipeline.fullAnnotate("q1: What is your favorite movie? q2: Which movie genre would you like to watch?")
val pipeline = new PretrainedPipeline("classifierdl_electra_questionpair_pipeline", "en")
val result1 = pipeline.fullAnnotate("q1: What is your favorite movie? q2: Which movie do you like most?")(0)
val result2 = pipeline.fullAnnotate("q1: What is your favorite movie? q2: Which movie genre would you like to watch?")(0)
Results
['almost_same']
['not_same']
Model Information
| Model Name: | classifierdl_electra_questionpair_pipeline |
| Type: | pipeline |
| Compatibility: | Spark NLP 3.2.0+ |
| License: | Open Source |
| Edition: | Official |
| Language: | en |
Included Models
- DocumentAssembler
- BertSentenceEmbeddings
- ClassifierDLModel