Medical Question Answering on Clinical Notes (ONNX)

val document_assembler = new MultiDocumentAssembler()
    .setInputCols("question", "context")
    .setOutputCols("document_question", "document_context")

val med_qa = MedicalQuestionAnswering.pretrained("clinical_notes_qa_base_onnx", "en", "clinical/models")
    .setInputCols(Array("document_question", "document_context"))
    .setOutputCol("answer")
    .setCustomPrompt("Context: {context} \n Question: {question} \n Answer: ")

val pipeline = new Pipeline().setStages(Array(document_assembler, med_qa))

note_text = "Patient with a past medical history of hypertension for 15 years.\n(Medical Transcription Sample Report)\nHISTORY OF PRESENT ILLNESS:\nThe patient is a 74-year-old white woman who has a past medical history of hypertension for 15 years, history of CVA with no residual hemiparesis and uterine cancer with pulmonary metastases, who presented for evaluation of recent worsening of the hypertension. According to the patient, she had stable blood pressure for the past 12-15 years on 10 mg of lisinopril."

question = "What is the primary issue reported by patient?"

val data = Seq( 
    (question, note_text))
    .toDS.toDF("question", "context")

val result = pipeline.fit(data).transform(data)