JSL_MedS_v2 (LLM - q4)

Description

This LLM model is trained to perform Q&A, Summarization, RAG, and Chat.

Predicted Entities

Copy S3 URI

How to use

from sparknlp_jsl.llm import LLMLoader

llm_loader_pretrained = LLMLoader(spark).pretrained("jsl_meds_q4_v2", "en", "clinical/models")

prompt = """
### Question:
who you are, describe yourself
"""

response = llm_loader_pretrained.generate(prompt)

import com.johnsnowlabs.ml.gguf.LLMLoader
import com.johnsnowlabs.nlp.SparkAccessor.spark

val llmLoader = new LLMLoader().setSparkSession(spark).pretrained("jsl_meds_q4_v2", "en", "clinical/models")

val prompt = """
### Question:
who you are, describe yourself
"""

val response = llmLoader.generate(prompt)

Results

"""
Hello! I am JSL Medical LLM, an artificial intelligence language model specialized in medical knowledge. I am here to assist you with any medical inquiries, provide information on health conditions, and help you understand medical terminology. Please feel free to ask me any questions related to health and medicine.
"""

Model Information

Model Name: jsl_meds_q4_v2
Compatibility: Healthcare NLP 5.4.1+
License: Licensed
Edition: Official
Language: en
Size: 2.2 GB