Legal Settlement Agreement And Mutual Release Document Classifier (Bert Sentence Embeddings)

Description

The legclf_settlement_agreement_and_mutual_release_bert model is a Bert Sentence Embeddings Document Classifier used to classify if the document belongs to the class settlement-agreement-and-mutual-release or not (Binary Classification).

Unlike the Longformer model, this model is lighter in terms of inference time.

Predicted Entities

settlement-agreement-and-mutual-release, other

Copy S3 URI

How to use


document_assembler = nlp.DocumentAssembler()\
    .setInputCol("text")\
    .setOutputCol("document")
  
embeddings = nlp.BertSentenceEmbeddings.pretrained("sent_bert_base_cased", "en")\
    .setInputCols("document")\
    .setOutputCol("sentence_embeddings")
    
doc_classifier = legal.ClassifierDLModel.pretrained("legclf_settlement_agreement_and_mutual_release_bert", "en", "legal/models")\
    .setInputCols(["sentence_embeddings"])\
    .setOutputCol("category")
    
nlpPipeline = nlp.Pipeline(stages=[
    document_assembler, 
    embeddings,
    doc_classifier])
 
df = spark.createDataFrame([["YOUR TEXT HERE"]]).toDF("text")

model = nlpPipeline.fit(df)

result = model.transform(df)

Results


+-------+
|result|
+-------+
|[settlement-agreement-and-mutual-release]|
|[other]|
|[other]|
|[settlement-agreement-and-mutual-release]|

Model Information

Model Name: legclf_settlement_agreement_and_mutual_release_bert
Compatibility: Legal NLP 1.0.0+
License: Licensed
Edition: Official
Input Labels: [sentence_embeddings]
Output Labels: [class]
Language: en
Size: 22.6 MB

References

Legal documents, scrapped from the Internet, and classified in-house + SEC documents

Benchmarking

                                  label  precision    recall  f1-score   support
                                  other       0.98      1.00      0.99        61
settlement-agreement-and-mutual-release       1.00      0.97      0.99        39
                               accuracy          -         -      0.99       100
                              macro-avg       0.99      0.99      0.99       100
                           weighted-avg       0.99      0.99      0.99       100