From f0746cd0aa508c310caa1809d8318d5aa8c82530 Mon Sep 17 00:00:00 2001
From: biplob <110578485+bks1984@users.noreply.github.com>
Date: Sat, 8 Nov 2025 23:24:03 +0530
Subject: [PATCH 1/4] Created using Colab
---
medical_assistant_project.ipynb | 7006 +++++++++++++++++++++++++++++++
1 file changed, 7006 insertions(+)
create mode 100644 medical_assistant_project.ipynb
diff --git a/medical_assistant_project.ipynb b/medical_assistant_project.ipynb
new file mode 100644
index 0000000..c0a2612
--- /dev/null
+++ b/medical_assistant_project.ipynb
@@ -0,0 +1,7006 @@
+{
+ "cells": [
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "view-in-github",
+ "colab_type": "text"
+ },
+ "source": [
+ ""
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "3CNz35ia6Bz3"
+ },
+ "source": [
+ "## Problem Statement"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "CkRbhMJH6Bz3"
+ },
+ "source": [
+ "### Business Context"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "3PBm5xaj6Bz3"
+ },
+ "source": [
+ "The healthcare industry is rapidly evolving, with professionals facing increasing challenges in managing vast volumes of medical data while delivering accurate and timely diagnoses. The need for quick access to comprehensive, reliable, and up-to-date medical knowledge is critical for improving patient outcomes and ensuring informed decision-making in a fast-paced environment.\n",
+ "\n",
+ "Healthcare professionals often encounter information overload, struggling to sift through extensive research and data to create accurate diagnoses and treatment plans. This challenge is amplified by the need for efficiency, particularly in emergencies, where time-sensitive decisions are vital. Furthermore, access to trusted, current medical information from renowned manuals and research papers is essential for maintaining high standards of care.\n",
+ "\n",
+ "To address these challenges, healthcare centers can focus on integrating systems that streamline access to medical knowledge, provide tools to support quick decision-making, and enhance efficiency. Leveraging centralized knowledge platforms and ensuring healthcare providers have continuous access to reliable resources can significantly improve patient care and operational effectiveness."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "1xDPsqvO6Bz5"
+ },
+ "source": [
+ "**Common Questions to Answer**\n",
+ "\n",
+ "1. **Critical Care Protocols:** \"What is the protocol for managing sepsis in a critical care unit?\"\n",
+ "\n",
+ "2. **General Surgery:** \"What are the common symptoms for appendicitis, and can it be cured via medicine? If not, what surgical procedure should be followed to treat it?\"\n",
+ "\n",
+ "3. **Dermatology:** \"What are the effective treatments or solutions for addressing sudden patchy hair loss, commonly seen as localized bald spots on the scalp, and what could be the possible causes behind it?\"\n",
+ "\n",
+ "4. **Neurology:** \"What treatments are recommended for a person who has sustained a physical injury to brain tissue, resulting in temporary or permanent impairment of brain function?\"\n"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "CARPKFwm6Bz4"
+ },
+ "source": [
+ "### Objective"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "dOElOEXq6Bz4"
+ },
+ "source": [
+ "As an AI specialist, your task is to develop a RAG-based AI solution using renowned medical manuals to address healthcare challenges. The objective is to **understand** issues like information overload, **apply** AI techniques to streamline decision-making, **analyze** its impact on diagnostics and patient outcomes, **evaluate** its potential to standardize care practices, and **create** a functional prototype demonstrating its feasibility and effectiveness."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "by9EvAnkSpZf"
+ },
+ "source": [
+ "### Data Description"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "Jw5LievCSru2"
+ },
+ "source": [
+ "The **Merck Manuals** are medical references published by the American pharmaceutical company Merck & Co., that cover a wide range of medical topics, including disorders, tests, diagnoses, and drugs. The manuals have been published since 1899, when Merck & Co. was still a subsidiary of the German company Merck.\n",
+ "\n",
+ "The manual is provided as a PDF with over 4,000 pages divided into 23 sections."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "lnwETBOE6Bz5"
+ },
+ "source": [
+ "## Installing and Importing Necessary Libraries and Dependencies"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 3,
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "id": "q4GgLhZhUM4V",
+ "outputId": "81845f22-556a-4a3d-fd43-64c05a16b1de"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "\u001b[?25l \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m0.0/449.8 kB\u001b[0m \u001b[31m?\u001b[0m eta \u001b[36m-:--:--\u001b[0m\r\u001b[2K \u001b[91m━━━━━━━━━━━━━━━━━━━━\u001b[0m\u001b[90m╺\u001b[0m\u001b[90m━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m225.3/449.8 kB\u001b[0m \u001b[31m7.0 MB/s\u001b[0m eta \u001b[36m0:00:01\u001b[0m\r\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m449.8/449.8 kB\u001b[0m \u001b[31m7.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
+ "\u001b[?25h\u001b[31mERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.\n",
+ "langchain-chroma 1.0.0 requires chromadb<2.0.0,>=1.0.20, but you have chromadb 1.0.15 which is incompatible.\n",
+ "langchain-chroma 1.0.0 requires langchain-core<2.0.0,>=1.0.0, but you have langchain-core 0.3.79 which is incompatible.\u001b[0m\u001b[31m\n",
+ "\u001b[0m"
+ ]
+ }
+ ],
+ "source": [
+ "# Install required libraries\n",
+ "!pip install -q langchain_community==0.3.27 \\\n",
+ " langchain==0.3.27 \\\n",
+ " chromadb==1.0.15 \\\n",
+ " pymupdf==1.26.3 \\\n",
+ " tiktoken==0.9.0 \\\n",
+ " datasets==4.0.0 \\\n",
+ " evaluate==0.4.5 \\\n",
+ " langchain_openai==0.3.30"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "mDp-EYZH-69E"
+ },
+ "source": [
+ "**Note**:\n",
+ "- After running the above cell, kindly restart the runtime (for Google Colab) or notebook kernel (for Jupyter Notebook), and run all cells sequentially from the next cell.\n",
+ "- On executing the above line of code, you might see a warning regarding package dependencies. This error message can be ignored as the above code ensures that all necessary libraries and their dependencies are maintained to successfully execute the code in ***this notebook***."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 4,
+ "metadata": {
+ "id": "RTY9GN4oWK3g"
+ },
+ "outputs": [],
+ "source": [
+ "# Import core libraries\n",
+ "import os # Interact with the operating system (e.g., set environment variables)\n",
+ "import json # Read/write JSON data\n",
+ "import requests # Make HTTP requests (e.g., API calls); ignore type checker\n",
+ "\n",
+ "# Import libraries for working with PDFs and OpenAI\n",
+ "from langchain.document_loaders import PyMuPDFLoader # Load and extract text from PDF files\n",
+ "# from langchain_community.document_loaders import PyPDFLoader # Load and extract text from PDF files\n",
+ "from openai import OpenAI # Access OpenAI's models and services\n",
+ "\n",
+ "# Import libraries for processing dataframes and text\n",
+ "import tiktoken # Tokenizer used for counting and splitting text for models\n",
+ "import pandas as pd # Load, manipulate, and analyze tabular data\n",
+ "\n",
+ "# Import LangChain components for data loading, chunking, embedding, and vector DBs\n",
+ "from langchain.text_splitter import RecursiveCharacterTextSplitter # Break text into overlapping chunks for processing\n",
+ "from langchain.embeddings.openai import OpenAIEmbeddings # Create vector embeddings using OpenAI's models # type: ignore\n",
+ "from langchain.vectorstores import Chroma # Store and search vector embeddings using Chroma DB # type: ignore\n",
+ "\n",
+ "from datasets import Dataset # Used to structure the input (questions, answers, contexts etc.) in tabular format\n",
+ "from langchain_openai import ChatOpenAI # This is needed since LLM is used in metric computation"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "TtZWqj0wFTS1"
+ },
+ "source": [
+ "## Question Answering using LLM"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "MfNKCvuzWSI-"
+ },
+ "source": [
+ "### OpenAI API Calling and Downloading and Loading the model\n",
+ "\n"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 5,
+ "metadata": {
+ "id": "eMi5GjvNBrlO"
+ },
+ "outputs": [],
+ "source": [
+ "# Load the JSON file and extract values\n",
+ "file_name = \"config.json\" # Name of the configuration file\n",
+ "with open(file_name, 'r') as file: # Open the config file in read mode\n",
+ " config = json.load(file) # Load the JSON content as a dictionary\n",
+ " OPENAI_API_KEY = config.get(\"OPENAI_API_KEY\") # Extract the API key from the config\n",
+ " OPENAI_API_BASE = config.get(\"OPENAI_API_BASE\") # Extract the OpenAI base URL from the config\n",
+ "\n",
+ "# Store API credentials in environment variables\n",
+ "os.environ['OPENAI_API_KEY'] = OPENAI_API_KEY # Set API key as environment variable\n",
+ "os.environ[\"OPENAI_BASE_URL\"] = OPENAI_API_BASE # Set API base URL as environment variable\n",
+ "\n",
+ "# Initialize OpenAI client\n",
+ "client = OpenAI(api_key=OPENAI_API_KEY, base_url=OPENAI_API_BASE) # Create an instance of the OpenAI client"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 6,
+ "metadata": {
+ "id": "Q9vjnCz0WSJC"
+ },
+ "outputs": [],
+ "source": [
+ "# Define a function to get a response\n",
+ "def ask_llm(user_prompt, max_tokens=512, temperature=0, top_p=0.95): # Complete the code to set default paramenters\n",
+ " # Create a chat completion using the OpenAI client\n",
+ " completion = client.chat.completions.create(\n",
+ " model=\"gpt-4o-mini\", # Complete the code by specifying the model to be used.\n",
+ " messages=[\n",
+ " {\"role\": \"user\", \"content\": user_prompt} # User prompt is the input/query to respond to\n",
+ " ],\n",
+ " max_tokens=max_tokens, # Max number of tokens to generate in the response\n",
+ " temperature=temperature, # Controls randomness in output\n",
+ " top_p=top_p # Controls diversity via nucleus sampling\n",
+ " )\n",
+ " return completion.choices[0].message.content # Return the text content from the model's reply"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "K8YgK91SFjVY"
+ },
+ "source": [
+ "### Question 1: What is the protocol for managing sepsis in a critical care unit?"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 7,
+ "metadata": {
+ "id": "u2Q_QZ4OFjVa",
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 105
+ },
+ "outputId": "3f53c399-5a2e-4a32-d696-14c6634039b6"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ "\"Managing sepsis in a critical care unit involves a systematic approach that includes early recognition, prompt intervention, and ongoing monitoring. The following is a general protocol based on current guidelines, such as those from the Surviving Sepsis Campaign:\\n\\n### 1. **Early Recognition**\\n - **Identify Symptoms**: Look for signs of infection (fever, chills, tachycardia, tachypnea) and organ dysfunction (altered mental status, hypotension, oliguria).\\n - **Use Screening Tools**: Utilize tools like the qSOFA (quick Sequential Organ Failure Assessment) or SIRS (Systemic Inflammatory Response Syndrome) criteria to identify patients at risk.\\n\\n### 2. **Initial Assessment**\\n - **Obtain Vital Signs**: Monitor blood pressure, heart rate, respiratory rate, and temperature.\\n - **Assess Organ Function**: Evaluate renal function (urine output, creatinine), liver function (bilirubin, liver enzymes), and coagulation status (platelets, INR).\\n\\n### 3. **Immediate Interventions**\\n - **Fluid Resuscitation**: Administer intravenous (IV) fluids (crystalloids) promptly, typically 30 mL/kg within the first 3 hours.\\n - **Antibiotic Therapy**: Start broad-spectrum IV antibiotics within 1 hour of recognition of sepsis. Adjust based on culture results and sensitivity.\\n - **Source Control**: Identify and control the source of infection (e.g., drainage of abscess, removal of infected devices).\\n\\n### 4. **Monitoring and Support**\\n - **Hemodynamic Monitoring**: Use invasive monitoring (e.g., arterial line, central venous pressure) if necessary to guide fluid resuscitation and vasopressor therapy.\\n - **Vasopressors**: If hypotension persists despite adequate fluid resuscitation, initiate vasopressors (e.g., norepinephrine) to maintain mean arterial pressure (MAP) ≥ 65 mmHg.\\n - **Oxygenation and Ventilation**: Provide supplemental oxygen and consider mechanical ventilation if respiratory failure occurs.\\n\\n### 5. **Ongoing Management**\\n - **Reassess Fluid Status**: Continuously evaluate the patient's response to fluids and adjust as necessary.\\n - **Monitor Laboratory Values**: Regularly check lactate levels, complete blood counts, and organ function tests to assess the patient's status.\\n - **Nutritional Support**: Initiate enteral nutrition as soon as feasible, typically within 24\""
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "string"
+ }
+ },
+ "metadata": {},
+ "execution_count": 7
+ }
+ ],
+ "source": [
+ "question_1 = \"What is the protocol for managing sepsis in a critical care unit?\"\n",
+ "base_prompt_response_1=ask_llm(question_1)\n",
+ "base_prompt_response_1"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "J6yxICeVFjVc"
+ },
+ "source": [
+ "### Question 2: What are the common symptoms for appendicitis, and can it be cured via medicine? If not, what surgical procedure should be followed to treat it?"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 8,
+ "metadata": {
+ "id": "WO1OTE9CFjVd",
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 105
+ },
+ "outputId": "eeee39fb-3d62-4a5d-e036-08c58622ec45"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ "\"Common symptoms of appendicitis include:\\n\\n1. **Abdominal Pain**: Typically starts around the navel and then moves to the lower right abdomen.\\n2. **Loss of Appetite**: A sudden decrease in appetite is common.\\n3. **Nausea and Vomiting**: Often follows the onset of abdominal pain.\\n4. **Fever**: A low-grade fever may develop.\\n5. **Constipation or Diarrhea**: Changes in bowel habits can occur.\\n6. **Abdominal Swelling**: In some cases, the abdomen may become swollen.\\n\\nAppendicitis cannot be effectively treated with medication alone. The standard treatment is surgical removal of the appendix, known as an **appendectomy**. This can be performed using two main techniques:\\n\\n1. **Open Appendectomy**: A larger incision is made in the lower right abdomen to remove the appendix.\\n2. **Laparoscopic Appendectomy**: This is a minimally invasive procedure where several small incisions are made, and the appendix is removed with the aid of a camera and special instruments.\\n\\nLaparoscopic appendectomy is often preferred due to its benefits, including less postoperative pain, shorter recovery time, and minimal scarring. However, the choice of procedure may depend on the patient's specific situation and the surgeon's expertise.\""
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "string"
+ }
+ },
+ "metadata": {},
+ "execution_count": 8
+ }
+ ],
+ "source": [
+ "question_2 = \"What are the common symptoms for appendicitis, and can it be cured via medicine? If not, what surgical procedure should be followed to treat it?\" #Complete the code to define the question #2\n",
+ "base_prompt_response_2=ask_llm(question_2) #Complete the code to pass the user input\n",
+ "base_prompt_response_2"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "oflaoOGiFjVd"
+ },
+ "source": [
+ "### Question 3: What are the effective treatments or solutions for addressing sudden patchy hair loss, commonly seen as localized bald spots on the scalp, and what could be the possible causes behind it?"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 9,
+ "metadata": {
+ "id": "JFm5Tq7RFjVe",
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 105
+ },
+ "outputId": "fd5f4519-f515-4c51-d2ba-bbffc330456b"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ "'Sudden patchy hair loss, often referred to as alopecia areata, can manifest as localized bald spots on the scalp or other areas of the body. Here are some effective treatments and solutions, as well as potential causes behind this condition:\\n\\n### Possible Causes:\\n1. **Autoimmune Disorders**: The immune system mistakenly attacks hair follicles, leading to hair loss.\\n2. **Genetics**: A family history of alopecia or other autoimmune conditions can increase the risk.\\n3. **Stress**: Physical or emotional stress can trigger hair loss in some individuals.\\n4. **Hormonal Changes**: Changes in hormones, such as those occurring during pregnancy or menopause, can contribute.\\n5. **Nutritional Deficiencies**: Lack of essential nutrients, such as iron, zinc, or vitamins, can affect hair health.\\n6. **Infections**: Fungal infections like tinea capitis can cause patchy hair loss.\\n7. **Other Medical Conditions**: Conditions like thyroid disease or vitiligo can also lead to hair loss.\\n\\n### Effective Treatments:\\n1. **Topical Corticosteroids**: These are often the first line of treatment for alopecia areata. They help reduce inflammation and suppress the immune response.\\n \\n2. **Minoxidil (Rogaine)**: This over-the-counter topical treatment can stimulate hair growth and is sometimes used in conjunction with other therapies.\\n\\n3. **Intralesional Corticosteroid Injections**: For more severe cases, corticosteroids can be injected directly into the bald patches to promote hair regrowth.\\n\\n4. **Immunotherapy**: This involves applying a chemical solution (like diphencyprone) to the scalp to provoke an allergic reaction, which may help stimulate hair growth.\\n\\n5. **Oral Medications**: In some cases, oral corticosteroids or other immunosuppressive drugs may be prescribed for extensive hair loss.\\n\\n6. **Light Therapy (Phototherapy)**: This treatment uses ultraviolet light to stimulate hair follicles and promote regrowth.\\n\\n7. **Nutritional Support**: Ensuring a balanced diet rich in vitamins and minerals can support overall hair health. Supplements may be recommended if deficiencies are identified.\\n\\n8. **Stress Management**: Techniques such as mindfulness, yoga, or therapy can help manage stress, which may contribute to hair loss.\\n\\n9. **Hairpieces or Wigs**: For those who experience significant hair loss, cosmetic solutions like wigs or hairpieces can provide a temporary solution while exploring other treatments.\\n\\n### Consultation with'"
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "string"
+ }
+ },
+ "metadata": {},
+ "execution_count": 9
+ }
+ ],
+ "source": [
+ "question_3 = \"What are the effective treatments or solutions for addressing sudden patchy hair loss, commonly seen as localized bald spots on the scalp, and what could be the possible causes behind it?\" #Complete the code to define the question #3\n",
+ "base_prompt_response_3=ask_llm(question_3) #Complete the code to pass the user input\n",
+ "base_prompt_response_3"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "WUUqY4FbFjVe"
+ },
+ "source": [
+ "### Question 4: What treatments are recommended for a person who has sustained a physical injury to brain tissue, resulting in temporary or permanent impairment of brain function?"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 10,
+ "metadata": {
+ "id": "DGmG9hYzFjVf",
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 105
+ },
+ "outputId": "916a1a9a-95cb-45f3-d6b9-e39f173c25a8"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ "\"The treatment for a person who has sustained a physical injury to brain tissue, such as a traumatic brain injury (TBI), can vary widely depending on the severity of the injury, the specific areas of the brain affected, and the resulting impairments. Here are some common approaches to treatment:\\n\\n1. **Emergency Care**: \\n - Immediate medical attention is crucial. This may involve stabilizing the patient, monitoring vital signs, and performing imaging studies (like CT or MRI scans) to assess the extent of the injury.\\n\\n2. **Surgical Interventions**: \\n - In some cases, surgery may be necessary to relieve pressure on the brain, remove blood clots (hematomas), or repair skull fractures.\\n\\n3. **Medication**: \\n - Medications may be prescribed to manage symptoms such as pain, seizures, or inflammation. Corticosteroids may be used to reduce swelling in the brain.\\n\\n4. **Rehabilitation**: \\n - **Physical Therapy**: To improve mobility and strength.\\n - **Occupational Therapy**: To help with daily living skills and regain independence.\\n - **Speech and Language Therapy**: To address communication difficulties and swallowing issues.\\n - **Neuropsychological Therapy**: To help with cognitive rehabilitation, including memory, attention, and problem-solving skills.\\n\\n5. **Psychological Support**: \\n - Counseling or therapy may be beneficial for coping with emotional and psychological challenges following a brain injury, such as depression, anxiety, or changes in personality.\\n\\n6. **Lifestyle Modifications**: \\n - Patients may need to make adjustments to their daily routines, including rest, nutrition, and avoiding activities that could lead to further injury.\\n\\n7. **Supportive Care**: \\n - Family support and education about the injury and its effects can be crucial for recovery. Support groups may also be helpful.\\n\\n8. **Long-term Management**: \\n - Ongoing follow-up with healthcare providers to monitor recovery and manage any long-term effects or complications.\\n\\n9. **Assistive Devices**: \\n - Depending on the nature of the impairment, assistive devices or technology may be recommended to aid in communication, mobility, or daily activities.\\n\\n10. **Alternative Therapies**: \\n - Some individuals may explore complementary therapies such as acupuncture, yoga, or meditation, although these should be discussed with a healthcare provider.\\n\\nIt's important for treatment plans to be individualized, taking into account the specific needs and circumstances of the person affected. A multidisciplinary team approach is often the most\""
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "string"
+ }
+ },
+ "metadata": {},
+ "execution_count": 10
+ }
+ ],
+ "source": [
+ "question_4 = \"What treatments are recommended for a person who has sustained a physical injury to brain tissue, resulting in temporary or permanent impairment of brain function?\" #Complete the code to define the question #4\n",
+ "base_prompt_response_4=ask_llm(question_4) #Complete the code to pass the user input\n",
+ "base_prompt_response_4"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "AxbCD0S56VSj"
+ },
+ "source": [
+ "### Storing the generated outputs from the base prompt\n"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 11,
+ "metadata": {
+ "id": "MKc_HzFI6eRb",
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 175
+ },
+ "outputId": "61d2f247-0aff-4547-e253-1b75bb3b1b12"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ " questions \\\n",
+ "0 What is the protocol for managing sepsis in a ... \n",
+ "1 What are the common symptoms for appendicitis,... \n",
+ "2 What are the effective treatments or solutions... \n",
+ "3 What treatments are recommended for a person w... \n",
+ "\n",
+ " base_prompt_responses \n",
+ "0 Managing sepsis in a critical care unit involv... \n",
+ "1 Common symptoms of appendicitis include:\\n\\n1.... \n",
+ "2 Sudden patchy hair loss, often referred to as ... \n",
+ "3 The treatment for a person who has sustained a... "
+ ],
+ "text/html": [
+ "\n",
+ "
\n",
+ "
\n",
+ "\n",
+ "
\n",
+ " \n",
+ "
\n",
+ "
\n",
+ "
questions
\n",
+ "
base_prompt_responses
\n",
+ "
\n",
+ " \n",
+ " \n",
+ "
\n",
+ "
0
\n",
+ "
What is the protocol for managing sepsis in a ...
\n",
+ "
Managing sepsis in a critical care unit involv...
\n",
+ "
\n",
+ "
\n",
+ "
1
\n",
+ "
What are the common symptoms for appendicitis,...
\n",
+ "
Common symptoms of appendicitis include:\\n\\n1....
\n"
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "dataframe",
+ "variable_name": "result_df",
+ "summary": "{\n \"name\": \"result_df\",\n \"rows\": 4,\n \"fields\": [\n {\n \"column\": \"questions\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 4,\n \"samples\": [\n \"What are the common symptoms for appendicitis, and can it be cured via medicine? If not, what surgical procedure should be followed to treat it?\",\n \"What treatments are recommended for a person who has sustained a physical injury to brain tissue, resulting in temporary or permanent impairment of brain function?\",\n \"What is the protocol for managing sepsis in a critical care unit?\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"base_prompt_responses\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 4,\n \"samples\": [\n \"Common symptoms of appendicitis include:\\n\\n1. **Abdominal Pain**: Typically starts around the navel and then moves to the lower right abdomen.\\n2. **Loss of Appetite**: A sudden decrease in appetite is common.\\n3. **Nausea and Vomiting**: Often follows the onset of abdominal pain.\\n4. **Fever**: A low-grade fever may develop.\\n5. **Constipation or Diarrhea**: Changes in bowel habits can occur.\\n6. **Abdominal Swelling**: In some cases, the abdomen may become swollen.\\n\\nAppendicitis cannot be effectively treated with medication alone. The standard treatment is surgical removal of the appendix, known as an **appendectomy**. This can be performed using two main techniques:\\n\\n1. **Open Appendectomy**: A larger incision is made in the lower right abdomen to remove the appendix.\\n2. **Laparoscopic Appendectomy**: This is a minimally invasive procedure where several small incisions are made, and the appendix is removed with the aid of a camera and special instruments.\\n\\nLaparoscopic appendectomy is often preferred due to its benefits, including less postoperative pain, shorter recovery time, and minimal scarring. However, the choice of procedure may depend on the patient's specific situation and the surgeon's expertise.\",\n \"The treatment for a person who has sustained a physical injury to brain tissue, such as a traumatic brain injury (TBI), can vary widely depending on the severity of the injury, the specific areas of the brain affected, and the resulting impairments. Here are some common approaches to treatment:\\n\\n1. **Emergency Care**: \\n - Immediate medical attention is crucial. This may involve stabilizing the patient, monitoring vital signs, and performing imaging studies (like CT or MRI scans) to assess the extent of the injury.\\n\\n2. **Surgical Interventions**: \\n - In some cases, surgery may be necessary to relieve pressure on the brain, remove blood clots (hematomas), or repair skull fractures.\\n\\n3. **Medication**: \\n - Medications may be prescribed to manage symptoms such as pain, seizures, or inflammation. Corticosteroids may be used to reduce swelling in the brain.\\n\\n4. **Rehabilitation**: \\n - **Physical Therapy**: To improve mobility and strength.\\n - **Occupational Therapy**: To help with daily living skills and regain independence.\\n - **Speech and Language Therapy**: To address communication difficulties and swallowing issues.\\n - **Neuropsychological Therapy**: To help with cognitive rehabilitation, including memory, attention, and problem-solving skills.\\n\\n5. **Psychological Support**: \\n - Counseling or therapy may be beneficial for coping with emotional and psychological challenges following a brain injury, such as depression, anxiety, or changes in personality.\\n\\n6. **Lifestyle Modifications**: \\n - Patients may need to make adjustments to their daily routines, including rest, nutrition, and avoiding activities that could lead to further injury.\\n\\n7. **Supportive Care**: \\n - Family support and education about the injury and its effects can be crucial for recovery. Support groups may also be helpful.\\n\\n8. **Long-term Management**: \\n - Ongoing follow-up with healthcare providers to monitor recovery and manage any long-term effects or complications.\\n\\n9. **Assistive Devices**: \\n - Depending on the nature of the impairment, assistive devices or technology may be recommended to aid in communication, mobility, or daily activities.\\n\\n10. **Alternative Therapies**: \\n - Some individuals may explore complementary therapies such as acupuncture, yoga, or meditation, although these should be discussed with a healthcare provider.\\n\\nIt's important for treatment plans to be individualized, taking into account the specific needs and circumstances of the person affected. A multidisciplinary team approach is often the most\",\n \"Managing sepsis in a critical care unit involves a systematic approach that includes early recognition, prompt intervention, and ongoing monitoring. The following is a general protocol based on current guidelines, such as those from the Surviving Sepsis Campaign:\\n\\n### 1. **Early Recognition**\\n - **Identify Symptoms**: Look for signs of infection (fever, chills, tachycardia, tachypnea) and organ dysfunction (altered mental status, hypotension, oliguria).\\n - **Use Screening Tools**: Utilize tools like the qSOFA (quick Sequential Organ Failure Assessment) or SIRS (Systemic Inflammatory Response Syndrome) criteria to identify patients at risk.\\n\\n### 2. **Initial Assessment**\\n - **Obtain Vital Signs**: Monitor blood pressure, heart rate, respiratory rate, and temperature.\\n - **Assess Organ Function**: Evaluate renal function (urine output, creatinine), liver function (bilirubin, liver enzymes), and coagulation status (platelets, INR).\\n\\n### 3. **Immediate Interventions**\\n - **Fluid Resuscitation**: Administer intravenous (IV) fluids (crystalloids) promptly, typically 30 mL/kg within the first 3 hours.\\n - **Antibiotic Therapy**: Start broad-spectrum IV antibiotics within 1 hour of recognition of sepsis. Adjust based on culture results and sensitivity.\\n - **Source Control**: Identify and control the source of infection (e.g., drainage of abscess, removal of infected devices).\\n\\n### 4. **Monitoring and Support**\\n - **Hemodynamic Monitoring**: Use invasive monitoring (e.g., arterial line, central venous pressure) if necessary to guide fluid resuscitation and vasopressor therapy.\\n - **Vasopressors**: If hypotension persists despite adequate fluid resuscitation, initiate vasopressors (e.g., norepinephrine) to maintain mean arterial pressure (MAP) \\u2265 65 mmHg.\\n - **Oxygenation and Ventilation**: Provide supplemental oxygen and consider mechanical ventilation if respiratory failure occurs.\\n\\n### 5. **Ongoing Management**\\n - **Reassess Fluid Status**: Continuously evaluate the patient's response to fluids and adjust as necessary.\\n - **Monitor Laboratory Values**: Regularly check lactate levels, complete blood counts, and organ function tests to assess the patient's status.\\n - **Nutritional Support**: Initiate enteral nutrition as soon as feasible, typically within 24\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n }\n ]\n}"
+ }
+ },
+ "metadata": {},
+ "execution_count": 11
+ }
+ ],
+ "source": [
+ "# Create the DataFrame\n",
+ "result_df = pd.DataFrame({\n",
+ " \"questions\": [question_1, question_2, question_3, question_4],\n",
+ " \"base_prompt_responses\": [base_prompt_response_1, base_prompt_response_2, base_prompt_response_3, base_prompt_response_4]})\n",
+ "\n",
+ "# Display the DataFrame\n",
+ "result_df.head()"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "KQcOiXwSybZy"
+ },
+ "source": [
+ "**Observations:**\n",
+ "\n",
+ "1.The base LLM responses are clinically reasonable across critical care, surgery,dermatology, and neurology but lack citations, making them unsuitable for medical decision‑making without RAG.\n",
+ "\n",
+ "2.Generated answers are concise and structured but omit protocol depth such as dosage, contraindications, and clinical caveats typically found in medical manuals.\n",
+ "\n",
+ "3.The outputs demonstrate general medical knowledge rather than manual‑grounded evidence, confirming the need for retrieval from trusted clinical guidelines."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "g5myZ5dOOefc"
+ },
+ "source": [
+ "## Question Answering using LLM with Prompt Engineering"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "dHbFv8hO7Rjv"
+ },
+ "source": [
+ "In the next step, we will use prompt engineering to check the effect of a more detailed and well-engineered prompt on the output of the model."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 122,
+ "metadata": {
+ "id": "VMZqTudYBCWv"
+ },
+ "outputs": [],
+ "source": [
+ "system_prompt = \"\"\"\n",
+ "You are a helpful medical research assistant. Provide concise and accurate answers based on medical knowledge.\n",
+ "\"\"\" #system prompt"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "X69OhTHAX9xO"
+ },
+ "source": [
+ "### Defining the function to Generate a Response From the LLM"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 123,
+ "metadata": {
+ "id": "x5Wi_VwNkipi"
+ },
+ "outputs": [],
+ "source": [
+ "# Define a function to get a response from the OpenAI chat model\n",
+ "def response(system_prompt, user_prompt, max_tokens=512, temperature=0, top_p=0.95): # set default paramenters\n",
+ " # Create a chat completion using the OpenAI client\n",
+ " completion = client.chat.completions.create(\n",
+ " model=\"gpt-4o-mini\", # specifying the model to be used.\n",
+ " messages=[\n",
+ " {\"role\": \"system\", \"content\": system_prompt}, # System prompt sets the assistant's behavior\n",
+ " {\"role\": \"user\", \"content\": user_prompt} # User prompt is the input/query to respond to\n",
+ " ],\n",
+ " max_tokens=max_tokens, # Max number of tokens to generate in the response\n",
+ " temperature=temperature, # Controls randomness in output (0 = deterministic)\n",
+ " top_p=top_p # Controls diversity via nucleus sampling\n",
+ " )\n",
+ " return completion.choices[0].message.content # Return the text content from the model's reply"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "9Jg3r_LWOeff"
+ },
+ "source": [
+ "### Question 1: What is the protocol for managing sepsis in a critical care unit?"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 124,
+ "metadata": {
+ "id": "O5zh3HQoOeff",
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 105
+ },
+ "outputId": "6f1b0eef-dfaa-4bb0-e590-83b53e3bab22"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ "'The management of sepsis in a critical care unit typically follows the Surviving Sepsis Campaign guidelines. Here’s a concise protocol:\\n\\n1. **Early Recognition**: Identify sepsis using clinical criteria (e.g., suspected infection plus organ dysfunction).\\n\\n2. **Immediate Resuscitation**:\\n - **Fluid Resuscitation**: Administer intravenous fluids (30 mL/kg of crystalloids within the first 3 hours).\\n - **Vasopressors**: If hypotension persists after fluid resuscitation, initiate norepinephrine to maintain mean arterial pressure (MAP) ≥ 65 mmHg.\\n\\n3. **Antibiotic Therapy**:\\n - Administer broad-spectrum antibiotics within 1 hour of sepsis recognition. Adjust based on culture results and local antibiograms.\\n\\n4. **Source Control**:\\n - Identify and manage the source of infection (e.g., drainage of abscess, removal of infected devices).\\n\\n5. **Monitoring**:\\n - Continuously monitor vital signs, urine output, and laboratory parameters (e.g., lactate levels, complete blood count, renal function).\\n\\n6. **Supportive Care**:\\n - Provide supportive care, including oxygen therapy, mechanical ventilation if needed, and renal replacement therapy for acute kidney injury.\\n\\n7. **Reassessment**:\\n - Reassess hemodynamic status and organ function frequently, adjusting treatment as necessary.\\n\\n8. **Consideration of Corticosteroids**:\\n - In cases of septic shock, consider low-dose corticosteroids (e.g., hydrocortisone) if there is no response to fluid resuscitation and vasopressors.\\n\\n9. **Glucose Control**:\\n - Maintain blood glucose levels between 140-180 mg/dL.\\n\\n10. **Communication and Team Approach**:\\n - Ensure effective communication among the healthcare team and involve specialists as needed.\\n\\nThis protocol should be tailored to individual patient needs and institutional protocols. Regular training and updates on sepsis management are essential for critical care staff.'"
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "string"
+ }
+ },
+ "metadata": {},
+ "execution_count": 124
+ }
+ ],
+ "source": [
+ "response_with_prompt_eng_1=response(system_prompt,question_1)\n",
+ "response_with_prompt_eng_1"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "iYpyw4HjOeff"
+ },
+ "source": [
+ "### Question 2: What are the common symptoms for appendicitis, and can it be cured via medicine? If not, what surgical procedure should be followed to treat it?"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 125,
+ "metadata": {
+ "id": "WPPpDM6cOeff",
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 70
+ },
+ "outputId": "e152969a-5fc6-4f54-cffc-108a9fccf818"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ "\"Common symptoms of appendicitis include:\\n\\n1. Abdominal pain, often starting near the belly button and then moving to the lower right abdomen.\\n2. Loss of appetite.\\n3. Nausea and vomiting.\\n4. Fever.\\n5. Constipation or diarrhea.\\n6. Abdominal swelling.\\n\\nAppendicitis cannot be effectively treated with medication alone; it typically requires surgical intervention. The standard surgical procedure for treating appendicitis is an appendectomy, which involves the removal of the inflamed appendix. This can be performed as an open surgery or laparoscopically, depending on the case and the surgeon's preference.\""
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "string"
+ }
+ },
+ "metadata": {},
+ "execution_count": 125
+ }
+ ],
+ "source": [
+ "response_with_prompt_eng_2=response(system_prompt,question_2)\n",
+ "response_with_prompt_eng_2"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "dRp92JQZOeff"
+ },
+ "source": [
+ "### Question 3: What are the effective treatments or solutions for addressing sudden patchy hair loss, commonly seen as localized bald spots on the scalp, and what could be the possible causes behind it?"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 126,
+ "metadata": {
+ "id": "sC6rrtblOefg",
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 105
+ },
+ "outputId": "c3eb7703-3724-414e-c717-e4753b0fc0f7"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ "'Sudden patchy hair loss, often referred to as alopecia areata, can manifest as localized bald spots on the scalp. Here are effective treatments and potential causes:\\n\\n### Treatments:\\n1. **Corticosteroids**: Topical or intralesional corticosteroids can reduce inflammation and promote hair regrowth.\\n2. **Minoxidil (Rogaine)**: Over-the-counter topical solution that may stimulate hair growth.\\n3. **Immunotherapy**: Treatments like diphencyprone (DPCP) can provoke an allergic reaction to stimulate hair regrowth.\\n4. **Anthralin**: A topical medication that can help in some cases by irritating the skin.\\n5. **JAK Inhibitors**: Oral medications like tofacitinib and ruxolitinib have shown promise in clinical trials for alopecia areata.\\n6. **Light Therapy**: Phototherapy can be beneficial for some patients.\\n7. **Supportive Care**: Counseling and support groups can help manage the psychological impact of hair loss.\\n\\n### Possible Causes:\\n1. **Autoimmune Response**: The immune system mistakenly attacks hair follicles.\\n2. **Genetics**: Family history of alopecia or other autoimmune diseases may increase risk.\\n3. **Stress**: Physical or emotional stress can trigger hair loss.\\n4. **Hormonal Changes**: Changes in hormones, such as those during pregnancy or menopause, can contribute.\\n5. **Nutritional Deficiencies**: Lack of certain nutrients (e.g., iron, vitamin D) may play a role.\\n6. **Infections**: Fungal infections like tinea capitis can cause patchy hair loss.\\n\\nIf experiencing sudden hair loss, it is advisable to consult a healthcare professional or dermatologist for an accurate diagnosis and tailored treatment plan.'"
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "string"
+ }
+ },
+ "metadata": {},
+ "execution_count": 126
+ }
+ ],
+ "source": [
+ "response_with_prompt_eng_3=response(system_prompt,question_3)\n",
+ "response_with_prompt_eng_3"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "AA45zwyUOefg"
+ },
+ "source": [
+ "### Question 4: What treatments are recommended for a person who has sustained a physical injury to brain tissue, resulting in temporary or permanent impairment of brain function?"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 127,
+ "metadata": {
+ "id": "Ue8Lk8uXOefg",
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 105
+ },
+ "outputId": "a963bbff-e927-40df-cf52-fe174ba83fd8"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ "'Treatment for a person who has sustained a physical injury to brain tissue, such as a traumatic brain injury (TBI), typically involves a multidisciplinary approach and may include the following:\\n\\n1. **Emergency Care**: Immediate medical attention may involve stabilizing the patient, ensuring adequate oxygenation, and managing intracranial pressure.\\n\\n2. **Surgery**: In some cases, surgical intervention may be necessary to remove hematomas, repair skull fractures, or relieve pressure on the brain.\\n\\n3. **Medications**: \\n - **Analgesics** for pain management.\\n - **Anticonvulsants** to prevent seizures.\\n - **Diuretics** to reduce swelling.\\n - **Corticosteroids** may be used to decrease inflammation.\\n\\n4. **Rehabilitation**: \\n - **Physical therapy** to improve mobility and strength.\\n - **Occupational therapy** to assist with daily living activities.\\n - **Speech therapy** for communication and swallowing difficulties.\\n - **Neuropsychological therapy** to address cognitive and emotional challenges.\\n\\n5. **Supportive Care**: This may include counseling, support groups, and education for patients and families about the injury and recovery process.\\n\\n6. **Long-term Management**: Ongoing assessment and management of cognitive, emotional, and physical impairments may be necessary, including regular follow-ups with healthcare providers.\\n\\nThe specific treatment plan will depend on the severity of the injury, the areas of the brain affected, and the individual needs of the patient.'"
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "string"
+ }
+ },
+ "metadata": {},
+ "execution_count": 127
+ }
+ ],
+ "source": [
+ "response_with_prompt_eng_4=response(system_prompt,question_4)\n",
+ "response_with_prompt_eng_4"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "QgSCW-EIDBlA"
+ },
+ "source": [
+ "### Storing the generated outputs from the structured prompts"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 128,
+ "metadata": {
+ "id": "N1hn6-lxDKy-",
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 175
+ },
+ "outputId": "ce4b9ed8-46da-405f-afbf-5583f64f58ed"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ " questions \\\n",
+ "0 What is the protocol for managing sepsis in a ... \n",
+ "1 What are the common symptoms for appendicitis,... \n",
+ "2 What are the effective treatments or solutions... \n",
+ "3 What treatments are recommended for a person w... \n",
+ "\n",
+ " base_prompt_responses \\\n",
+ "0 Managing sepsis in a critical care unit involv... \n",
+ "1 Common symptoms of appendicitis include:\\n\\n1.... \n",
+ "2 Sudden patchy hair loss, often referred to as ... \n",
+ "3 The treatment for a person who has sustained a... \n",
+ "\n",
+ " responses_with_prompt_eng \\\n",
+ "0 The management of sepsis in a critical care un... \n",
+ "1 Common symptoms of appendicitis include:\\n\\n1.... \n",
+ "2 Sudden patchy hair loss, often referred to as ... \n",
+ "3 Treatment for a person who has sustained a phy... \n",
+ "\n",
+ " responses_with_RAG \n",
+ "0 Answer:\\nThe protocol for managing sepsis in a... \n",
+ "1 Answer:\\nThe common symptoms of appendicitis i... \n",
+ "2 Answer:\\nThe effective treatment for sudden pa... \n",
+ "3 Answer:\\nInitial treatment for a person who ha... "
+ ],
+ "text/html": [
+ "\n",
+ "
\n",
+ "
\n",
+ "\n",
+ "
\n",
+ " \n",
+ "
\n",
+ "
\n",
+ "
questions
\n",
+ "
base_prompt_responses
\n",
+ "
responses_with_prompt_eng
\n",
+ "
responses_with_RAG
\n",
+ "
\n",
+ " \n",
+ " \n",
+ "
\n",
+ "
0
\n",
+ "
What is the protocol for managing sepsis in a ...
\n",
+ "
Managing sepsis in a critical care unit involv...
\n",
+ "
The management of sepsis in a critical care un...
\n",
+ "
Answer:\\nThe protocol for managing sepsis in a...
\n",
+ "
\n",
+ "
\n",
+ "
1
\n",
+ "
What are the common symptoms for appendicitis,...
\n",
+ "
Common symptoms of appendicitis include:\\n\\n1....
\n",
+ "
Common symptoms of appendicitis include:\\n\\n1....
\n",
+ "
Answer:\\nThe common symptoms of appendicitis i...
\n",
+ "
\n",
+ "
\n",
+ "
2
\n",
+ "
What are the effective treatments or solutions...
\n",
+ "
Sudden patchy hair loss, often referred to as ...
\n",
+ "
Sudden patchy hair loss, often referred to as ...
\n",
+ "
Answer:\\nThe effective treatment for sudden pa...
\n",
+ "
\n",
+ "
\n",
+ "
3
\n",
+ "
What treatments are recommended for a person w...
\n",
+ "
The treatment for a person who has sustained a...
\n",
+ "
Treatment for a person who has sustained a phy...
\n",
+ "
Answer:\\nInitial treatment for a person who ha...
\n"
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "dataframe",
+ "variable_name": "result_df",
+ "summary": "{\n \"name\": \"result_df\",\n \"rows\": 4,\n \"fields\": [\n {\n \"column\": \"questions\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 4,\n \"samples\": [\n \"What are the common symptoms for appendicitis, and can it be cured via medicine? If not, what surgical procedure should be followed to treat it?\",\n \"What treatments are recommended for a person who has sustained a physical injury to brain tissue, resulting in temporary or permanent impairment of brain function?\",\n \"What is the protocol for managing sepsis in a critical care unit?\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"base_prompt_responses\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 4,\n \"samples\": [\n \"Common symptoms of appendicitis include:\\n\\n1. **Abdominal Pain**: Typically starts around the navel and then moves to the lower right abdomen.\\n2. **Loss of Appetite**: A sudden decrease in appetite is common.\\n3. **Nausea and Vomiting**: Often follows the onset of abdominal pain.\\n4. **Fever**: A low-grade fever may develop.\\n5. **Constipation or Diarrhea**: Changes in bowel habits can occur.\\n6. **Abdominal Swelling**: In some cases, the abdomen may become swollen.\\n\\nAppendicitis cannot be effectively treated with medication alone. The standard treatment is surgical removal of the appendix, known as an **appendectomy**. This can be performed using two main techniques:\\n\\n1. **Open Appendectomy**: A larger incision is made in the lower right abdomen to remove the appendix.\\n2. **Laparoscopic Appendectomy**: This is a minimally invasive procedure where several small incisions are made, and the appendix is removed with the aid of a camera and special instruments.\\n\\nLaparoscopic appendectomy is often preferred due to its benefits, including less postoperative pain, shorter recovery time, and minimal scarring. However, the choice of procedure may depend on the patient's specific situation and the surgeon's expertise.\",\n \"The treatment for a person who has sustained a physical injury to brain tissue, such as a traumatic brain injury (TBI), can vary widely depending on the severity of the injury, the specific areas of the brain affected, and the resulting impairments. Here are some common approaches to treatment:\\n\\n1. **Emergency Care**: \\n - Immediate medical attention is crucial. This may involve stabilizing the patient, monitoring vital signs, and performing imaging studies (like CT or MRI scans) to assess the extent of the injury.\\n\\n2. **Surgical Interventions**: \\n - In some cases, surgery may be necessary to relieve pressure on the brain, remove blood clots (hematomas), or repair skull fractures.\\n\\n3. **Medication**: \\n - Medications may be prescribed to manage symptoms such as pain, seizures, or inflammation. Corticosteroids may be used to reduce swelling in the brain.\\n\\n4. **Rehabilitation**: \\n - **Physical Therapy**: To improve mobility and strength.\\n - **Occupational Therapy**: To help with daily living skills and regain independence.\\n - **Speech and Language Therapy**: To address communication difficulties and swallowing issues.\\n - **Neuropsychological Therapy**: To help with cognitive rehabilitation, including memory, attention, and problem-solving skills.\\n\\n5. **Psychological Support**: \\n - Counseling or therapy may be beneficial for coping with emotional and psychological challenges following a brain injury, such as depression, anxiety, or changes in personality.\\n\\n6. **Lifestyle Modifications**: \\n - Patients may need to make adjustments to their daily routines, including rest, nutrition, and avoiding activities that could lead to further injury.\\n\\n7. **Supportive Care**: \\n - Family support and education about the injury and its effects can be crucial for recovery. Support groups may also be helpful.\\n\\n8. **Long-term Management**: \\n - Ongoing follow-up with healthcare providers to monitor recovery and manage any long-term effects or complications.\\n\\n9. **Assistive Devices**: \\n - Depending on the nature of the impairment, assistive devices or technology may be recommended to aid in communication, mobility, or daily activities.\\n\\n10. **Alternative Therapies**: \\n - Some individuals may explore complementary therapies such as acupuncture, yoga, or meditation, although these should be discussed with a healthcare provider.\\n\\nIt's important for treatment plans to be individualized, taking into account the specific needs and circumstances of the person affected. A multidisciplinary team approach is often the most\",\n \"Managing sepsis in a critical care unit involves a systematic approach that includes early recognition, prompt intervention, and ongoing monitoring. The following is a general protocol based on current guidelines, such as those from the Surviving Sepsis Campaign:\\n\\n### 1. **Early Recognition**\\n - **Identify Symptoms**: Look for signs of infection (fever, chills, tachycardia, tachypnea) and organ dysfunction (altered mental status, hypotension, oliguria).\\n - **Use Screening Tools**: Utilize tools like the qSOFA (quick Sequential Organ Failure Assessment) or SIRS (Systemic Inflammatory Response Syndrome) criteria to identify patients at risk.\\n\\n### 2. **Initial Assessment**\\n - **Obtain Vital Signs**: Monitor blood pressure, heart rate, respiratory rate, and temperature.\\n - **Assess Organ Function**: Evaluate renal function (urine output, creatinine), liver function (bilirubin, liver enzymes), and coagulation status (platelets, INR).\\n\\n### 3. **Immediate Interventions**\\n - **Fluid Resuscitation**: Administer intravenous (IV) fluids (crystalloids) promptly, typically 30 mL/kg within the first 3 hours.\\n - **Antibiotic Therapy**: Start broad-spectrum IV antibiotics within 1 hour of recognition of sepsis. Adjust based on culture results and sensitivity.\\n - **Source Control**: Identify and control the source of infection (e.g., drainage of abscess, removal of infected devices).\\n\\n### 4. **Monitoring and Support**\\n - **Hemodynamic Monitoring**: Use invasive monitoring (e.g., arterial line, central venous pressure) if necessary to guide fluid resuscitation and vasopressor therapy.\\n - **Vasopressors**: If hypotension persists despite adequate fluid resuscitation, initiate vasopressors (e.g., norepinephrine) to maintain mean arterial pressure (MAP) \\u2265 65 mmHg.\\n - **Oxygenation and Ventilation**: Provide supplemental oxygen and consider mechanical ventilation if respiratory failure occurs.\\n\\n### 5. **Ongoing Management**\\n - **Reassess Fluid Status**: Continuously evaluate the patient's response to fluids and adjust as necessary.\\n - **Monitor Laboratory Values**: Regularly check lactate levels, complete blood counts, and organ function tests to assess the patient's status.\\n - **Nutritional Support**: Initiate enteral nutrition as soon as feasible, typically within 24\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"responses_with_prompt_eng\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 4,\n \"samples\": [\n \"Common symptoms of appendicitis include:\\n\\n1. Abdominal pain, often starting near the belly button and then moving to the lower right abdomen.\\n2. Loss of appetite.\\n3. Nausea and vomiting.\\n4. Fever.\\n5. Constipation or diarrhea.\\n6. Abdominal swelling.\\n\\nAppendicitis cannot be effectively treated with medication alone; it typically requires surgical intervention. The standard surgical procedure for treating appendicitis is an **appendectomy**, which involves the removal of the inflamed appendix. This can be performed as an open surgery or laparoscopically, depending on the case and the surgeon's preference.\",\n \"Treatment for a person who has sustained a physical injury to brain tissue, such as a traumatic brain injury (TBI), may include the following approaches:\\n\\n1. **Immediate Medical Care**: \\n - Stabilization of the patient, including airway management, breathing support, and circulation.\\n - Imaging studies (CT or MRI) to assess the extent of the injury.\\n\\n2. **Surgical Interventions**: \\n - Surgery may be required to relieve pressure on the brain, remove blood clots (hematomas), or repair skull fractures.\\n\\n3. **Medications**: \\n - Anti-inflammatory drugs to reduce swelling.\\n - Anticonvulsants to prevent seizures.\\n - Pain management medications.\\n\\n4. **Rehabilitation**: \\n - Physical therapy to improve mobility and strength.\\n - Occupational therapy to assist with daily living activities.\\n - Speech therapy for communication and swallowing difficulties.\\n - Neuropsychological therapy to address cognitive and emotional challenges.\\n\\n5. **Supportive Care**: \\n - Psychological support and counseling for emotional and behavioral issues.\\n - Family education and support to help caregivers understand the injury and its effects.\\n\\n6. **Long-term Management**: \\n - Regular follow-up with healthcare providers to monitor recovery and manage any ongoing symptoms or complications.\\n\\nThe specific treatment plan will depend on the severity of the injury, the areas of the brain affected, and the individual patient's needs. Early intervention and a multidisciplinary approach are crucial for optimal recovery.\",\n \"The management of sepsis in a critical care unit typically follows the Surviving Sepsis Campaign guidelines. Here\\u2019s a concise protocol:\\n\\n1. **Early Recognition**: Identify sepsis using clinical criteria (e.g., suspected infection plus organ dysfunction).\\n\\n2. **Immediate Resuscitation**:\\n - **Fluid Resuscitation**: Administer IV fluids (30 mL/kg of crystalloids within the first 3 hours).\\n - **Vasopressors**: If hypotension persists after fluid resuscitation, initiate norepinephrine to maintain mean arterial pressure (MAP) \\u2265 65 mmHg.\\n\\n3. **Antibiotic Therapy**:\\n - Administer broad-spectrum antibiotics within 1 hour of recognition of sepsis.\\n - Adjust based on culture results and clinical response.\\n\\n4. **Source Control**:\\n - Identify and manage the source of infection (e.g., drainage of abscess, removal of infected devices).\\n\\n5. **Monitoring**:\\n - Monitor vital signs, urine output, and laboratory parameters closely.\\n - Use lactate levels to guide resuscitation efforts.\\n\\n6. **Supportive Care**:\\n - Provide organ support as needed (e.g., mechanical ventilation, renal replacement therapy).\\n - Consider corticosteroids in cases of septic shock.\\n\\n7. **Reassessment**:\\n - Reassess hemodynamic status and organ function frequently.\\n - Adjust treatment based on response.\\n\\n8. **Follow-Up**:\\n - Continue monitoring for complications and adjust care plans accordingly.\\n\\nThis protocol emphasizes timely intervention and continuous assessment to improve outcomes in patients with sepsis.\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"responses_with_RAG\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 4,\n \"samples\": [\n \"Answer:\\nThe common symptoms of appendicitis include epigastric or periumbilical pain followed by nausea, vomiting, and anorexia, with pain shifting to the right lower quadrant. Classic signs include right lower quadrant tenderness at McBurney's point, Rovsing sign, psoas sign, and obturator sign. Appendicitis cannot be cured via medicine; the treatment is surgical removal, specifically an open or laparoscopic appendectomy.\\n\\nSource:\\nThe Merck Manual of Diagnosis & Therapy, 19th Edition, Chapter 11. Acute Abdomen & Surgical Gastroenterology, pages 163.\",\n \"Answer:\\nInitial treatment for a person who has sustained a physical injury to brain tissue includes ensuring a reliable airway and maintaining adequate ventilation, oxygenation, and blood pressure. Surgery may be needed for severe injuries to monitor and treat intracranial pressure, decompress the brain, or remove hematomas. Subsequently, many patients require rehabilitation, which should be planned early and may involve a team approach including physical, occupational, and speech therapy, as well as cognitive therapy for those with severe cognitive dysfunction.\\n\\nSource:\\nThe Merck Manual of Diagnosis & Therapy, 19th Edition, Chapter 324. Traumatic Brain Injury, and Chapter 350. Rehabilitation.\",\n \"Answer:\\nThe protocol for managing sepsis in a critical care unit includes the following steps: \\n1. Obtain specimens of blood, body fluids, and wound sites for Gram stain and culture before starting parenteral antibiotics.\\n2. Initiate very prompt empiric antibiotic therapy immediately after suspecting sepsis, which may include gentamicin or tobramycin plus a 3rd-generation cephalosporin (e.g., cefotaxime or ceftriaxone), or ceftazidime plus a fluoroquinolone if Pseudomonas is suspected. Vancomycin should be added if resistant staphylococci or enterococci are suspected, and if there is an abdominal source, include a drug effective against anaerobes (e.g., metronidazole).\\n3. Change the antibiotic regimen based on culture and sensitivity results when available, continuing antibiotics for at least 5 days after shock resolves and evidence of infection subsides.\\n4. Drain abscesses and surgically excise necrotic tissues as necessary.\\n5. Monitor and manage blood glucose levels with a continuous IV insulin infusion to maintain glucose between 80 to 110 mg/dL.\\n6. Provide supportive care, including adequate nutrition and prevention of infections and complications.\\n\\nSource:\\nCritical Care Medicine, Chapter 222. Approach to the Critically Ill Patient.\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n }\n ]\n}"
+ }
+ },
+ "metadata": {},
+ "execution_count": 61
+ }
+ ],
+ "source": [
+ "# Add the results to a new column in the DataFrame\n",
+ "result_df['responses_with_RAG'] = [response_with_rag_1, response_with_rag_2, response_with_rag_3, response_with_rag_4]\n",
+ "\n",
+ "# Display the DataFrame\n",
+ "result_df.head()"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "yyQrTipNfuBN"
+ },
+ "source": [
+ "## Output Evaluation"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "tY9j1MVei5eI"
+ },
+ "source": [
+ "#### **Defining required System Prompts**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 93,
+ "metadata": {
+ "id": "2dDxkZdyKSnh",
+ "tags": []
+ },
+ "outputs": [],
+ "source": [
+ "groundedness_rater_system_message = \"\"\"\n",
+ "You are tasked with rating AI generated answers to questions posed by users.\n",
+ "You will be presented a question, context used by the AI system to generate the answer and an AI generated answer to the question.\n",
+ "In the input, the question will begin with ###Question, the context will begin with ###Context while the AI generated answer will begin with ###Answer.\n",
+ "\n",
+ "Evaluation criteria:\n",
+ "The task is to judge the extent to which the metric is followed by the answer.\n",
+ "1 - The metric is not followed at all\n",
+ "2 - The metric is followed only to a limited extent\n",
+ "3 - The metric is followed to a good extent\n",
+ "4 - The metric is followed mostly\n",
+ "5 - The metric is followed completely\n",
+ "\n",
+ "Metric:\n",
+ "The answer should be derived only from the information presented in the context\n",
+ "\n",
+ "Instructions:\n",
+ "1. First write down the steps that are needed to evaluate the answer as per the metric.\n",
+ "2. Give a step-by-step explanation if the answer adheres to the metric considering the question and context as the input.\n",
+ "3. Next, evaluate the extent to which the metric is followed.\n",
+ "4. Use the previous information to rate the answer using the evaluaton criteria and assign a score.\n",
+ "\n",
+ "Return only the Score in last in a dictionary format not json and score should be in the range of 1 to 5.\n",
+ "Example {groundedness_score:4}\n",
+ "\"\"\""
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 63,
+ "metadata": {
+ "id": "NIosu2Wk7OVs",
+ "tags": []
+ },
+ "outputs": [],
+ "source": [
+ "relevance_rater_system_message = \"\"\"\n",
+ "You are tasked with rating AI generated answers to questions posed by users.\n",
+ "You will be presented a question, context used by the AI system to generate the answer and an AI generated answer to the question.\n",
+ "In the input, the question will begin with ###Question, the context will begin with ###Context while the AI generated answer will begin with ###Answer.\n",
+ "\n",
+ "Evaluation criteria:\n",
+ "The task is to judge the extent to which the metric is followed by the answer.\n",
+ "1 - The metric is not followed at all\n",
+ "2 - The metric is followed only to a limited extent\n",
+ "3 - The metric is followed to a good extent\n",
+ "4 - The metric is followed mostly\n",
+ "5 - The metric is followed completely\n",
+ "\n",
+ "Metric:\n",
+ "Relevance measures how well the answer addresses the main aspects of the question, based on the context.\n",
+ "Consider whether all and only the important aspects are contained in the answer when evaluating relevance.\n",
+ "\n",
+ "Instructions:\n",
+ "1. First write down the steps that are needed to evaluate the context as per the metric.\n",
+ "2. Give a step-by-step explanation if the context adheres to the metric considering the question as the input.\n",
+ "3. Next, evaluate the extent to which the metric is followed.\n",
+ "4. Use the previous information to rate the context using the evaluaton criteria and assign a score.\n",
+ "Return only the Score in last in a dictionary format not json and score should be in the range of 1 to 5.\n",
+ "Example {relevance_score:4}\n",
+ "\"\"\""
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 64,
+ "metadata": {
+ "id": "7boMupgh_Gux",
+ "tags": []
+ },
+ "outputs": [],
+ "source": [
+ "user_message_template = \"\"\"\n",
+ "###Question\n",
+ "{question}\n",
+ "\n",
+ "###Context\n",
+ "{context}\n",
+ "\n",
+ "###Answer\n",
+ "{answer}\n",
+ "\"\"\""
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "7QPs3ApgzB_D"
+ },
+ "source": [
+ "#### **Definig the LLM-as-a-Judge Evaluation function**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 80,
+ "metadata": {
+ "id": "dXxdhhEDxatr"
+ },
+ "outputs": [],
+ "source": [
+ "def generate_ground_relevance_response(user_input,response, max_tokens=500, temperature=0, top_p=0.95): # Complete the code to set default paramenters\n",
+ " global qna_user_message_template\n",
+ "\n",
+ " context_for_query = [doc.page_content for doc in retriever.invoke(input=user_input)]\n",
+ "\n",
+ " # Combine user_prompt and system_message to create the prompt\n",
+ " groundedness_prompt = f\"\"\"[INST]{groundedness_rater_system_message}\\n\n",
+ " {'user'}: {user_message_template.format(context=context_for_query, question=user_input, answer=response)}\n",
+ " [/INST]\"\"\"\n",
+ "\n",
+ " # Combine user_prompt and system_message to create the prompt\n",
+ " relevance_prompt = f\"\"\"[INST]{relevance_rater_system_message}\\n\n",
+ " {'user'}: {user_message_template.format(context=context_for_query, question=user_input, answer=response)}\n",
+ " [/INST]\"\"\"\n",
+ "\n",
+ " response_1 = client.chat.completions.create(\n",
+ " model=\"gpt-3.5-turbo\", # Complete the code by specifying the model to be used.\n",
+ " messages=[\n",
+ " {\"role\": \"user\", \"content\": groundedness_prompt}\n",
+ " ],\n",
+ " max_tokens=max_tokens,\n",
+ " temperature=temperature,\n",
+ " top_p=top_p\n",
+ " )\n",
+ "\n",
+ " response_2 = client.chat.completions.create(\n",
+ " model=\"gpt-3.5-turbo\", # Complete the code by specifying the model to be used.\n",
+ " messages=[\n",
+ " {\"role\": \"user\", \"content\": relevance_prompt}\n",
+ " ],\n",
+ " max_tokens=max_tokens,\n",
+ " temperature=temperature,\n",
+ " top_p=top_p\n",
+ " )\n",
+ "\n",
+ " return response_1.choices[0].message.content,response_2.choices[0].message.content"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "h_kKHCe2mqpE"
+ },
+ "source": [
+ "#### **Evaluation 1: Base Prompt Response Evaluation**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 135,
+ "metadata": {
+ "id": "iJ-lchv-sVJ6",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "6b74cd9a-5843-4df3-f6e5-4248f6823caa"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "To evaluate the answer as per the metric, the following steps need to be taken:\n",
+ "1. Identify if the information provided in the answer is directly derived from the context given.\n",
+ "2. Check if there are any additional details or information in the answer that is not present in the context.\n",
+ "3. Ensure that the answer does not include any information that is not mentioned in the context.\n",
+ "\n",
+ "Explanation:\n",
+ "The AI-generated answer provides a detailed protocol for managing sepsis in a critical care unit. It includes steps for early recognition, initial assessment, immediate interventions, monitoring and support, and ongoing management. The information provided in the answer aligns with the context given, which outlines the protocol for managing sepsis in a critical care unit. The answer does not introduce any new information that is not present in the context.\n",
+ "\n",
+ "Therefore, the answer follows the metric of being derived only from the information presented in the context.\n",
+ "\n",
+ "Based on the evaluation criteria, the score for groundedness would be 5. \n",
+ "\n",
+ "{groundedness_score: 5}\n",
+ "\n",
+ "{relevance_score: 3}\n"
+ ]
+ }
+ ],
+ "source": [
+ "# Question 1\n",
+ "ground_1,rel_1 = generate_ground_relevance_response(user_input=result_df.questions[0], response=result_df.base_prompt_responses[0], max_tokens=516)\n",
+ "print(ground_1,end=\"\\n\\n\")\n",
+ "print(rel_1)"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 136,
+ "metadata": {
+ "id": "mjQHf0DgnNEQ",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "63e679f4-2f79-43d0-8d8a-1558f6cd3fc4"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "To evaluate the answer based on the metric provided, we need to follow these steps:\n",
+ "1. Identify if the information provided in the answer is solely derived from the context given.\n",
+ "2. Check if any additional information not present in the context is included in the answer.\n",
+ "3. Determine if the answer directly addresses the question asked without introducing new information.\n",
+ "\n",
+ "Explanation:\n",
+ "The AI-generated answer provides a list of common symptoms of appendicitis and details the standard treatment procedures for appendicitis, including open appendectomy and laparoscopic appendectomy. The information presented in the answer aligns with the details provided in the context regarding the symptoms, diagnosis, and treatment of appendicitis. The answer does not introduce any new information that is not present in the context.\n",
+ "\n",
+ "Therefore, the answer follows the metric of being derived only from the information presented in the context.\n",
+ "\n",
+ "Based on the evaluation criteria:\n",
+ "The answer demonstrates a complete adherence to the metric by solely utilizing the information provided in the context to address the question about the symptoms and treatment of appendicitis.\n",
+ "\n",
+ "Hence, the groundedness score for this answer is 5. \n",
+ "\n",
+ "{groundedness_score: 5}\n",
+ "\n",
+ "To evaluate the context based on the metric of relevance, the following steps can be followed:\n",
+ "\n",
+ "1. Identify the main aspects of the question: Understand the key components of the question, which in this case are the common symptoms of appendicitis and the treatment options available.\n",
+ "\n",
+ "2. Analyze the context: Review the provided context to see if it contains information related to the common symptoms of appendicitis and the treatment options, specifically focusing on surgical procedures and medication.\n",
+ "\n",
+ "3. Check for completeness: Ensure that all important aspects related to the question are covered in the context, including details about symptoms and treatment options.\n",
+ "\n",
+ "4. Verify accuracy: Confirm that the information provided in the context aligns with medical knowledge and guidelines regarding appendicitis symptoms and treatment.\n",
+ "\n",
+ "Based on the steps outlined above, the context provided contains detailed information about the symptoms of appendicitis, including abdominal pain, loss of appetite, nausea, vomiting, fever, changes in bowel habits, and abdominal swelling. Additionally, it discusses the standard treatment for appendicitis, which is surgical removal of the appendix through open or laparoscopic appendectomy.\n",
+ "\n",
+ "The context also mentions that antibiotics are not curative for appendicitis and that surgical removal is the preferred treatment option. It provides insights into the surgical procedures involved in appendectomy, such as open appendectomy and laparoscopic appendectomy, along with details about antibiotic use before and after surgery.\n",
+ "\n",
+ "Overall, the context aligns well with the main aspects of the question by addressing the common symptoms of appendicitis and the surgical procedures used for its treatment. It provides comprehensive information that is relevant to the question posed.\n",
+ "\n",
+ "Therefore, based on the evaluation, the context adheres to the metric of relevance to a good extent.\n",
+ "\n",
+ "{relevance_score: 3}\n"
+ ]
+ }
+ ],
+ "source": [
+ "# Question 2\n",
+ "ground_2,rel_2 = generate_ground_relevance_response(user_input=result_df.questions[1], response=result_df.base_prompt_responses[1], max_tokens=516) #Complete the code to calculate the groundedness and relevance score\n",
+ "print(ground_2,end=\"\\n\\n\")\n",
+ "print(rel_2)"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 137,
+ "metadata": {
+ "id": "3VmHQIa-nX9W",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "d468d5d3-7436-42ab-bdb9-184922c0f9db"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "To evaluate the answer as per the metric, the following steps need to be followed:\n",
+ "1. Identify if the information provided in the answer is solely derived from the context given.\n",
+ "2. Check if the answer includes any additional information not present in the context.\n",
+ "3. Verify if the treatments and causes mentioned in the answer align with the information provided in the context regarding sudden patchy hair loss and alopecia areata.\n",
+ "\n",
+ "Explanation:\n",
+ "The AI-generated answer provides information on the possible causes and effective treatments for sudden patchy hair loss, specifically focusing on alopecia areata. It mentions autoimmune disorders, genetics, stress, hormonal changes, nutritional deficiencies, infections, and other medical conditions as possible causes. For effective treatments, it lists topical corticosteroids, minoxidil, intralesional corticosteroid injections, immunotherapy, oral medications, light therapy, nutritional support, stress management, and cosmetic solutions like wigs.\n",
+ "\n",
+ "The context also discusses alopecia areata as sudden patchy hair loss, autoimmune disorders affecting hair follicles, and the treatment options including topical corticosteroids, minoxidil, and other therapies. It also mentions possible causes such as autoimmune disorders, genetics, stress, hormonal changes, nutritional deficiencies, infections, and other medical conditions.\n",
+ "\n",
+ "The AI-generated answer aligns well with the information provided in the context regarding the causes and treatments for sudden patchy hair loss, staying grounded in the context.\n",
+ "\n",
+ "Therefore, the answer follows the metric of being derived only from the information presented in the context.\n",
+ "\n",
+ "Based on the evaluation criteria, the score for groundedness would be 5. \n",
+ "\n",
+ "{groundedness_score: 5}\n",
+ "\n",
+ "To evaluate the context based on the metric of relevance, the following steps need to be followed:\n",
+ "\n",
+ "1. Identify the main aspects of the question: The question asks about effective treatments or solutions for sudden patchy hair loss and the possible causes behind it.\n",
+ "2. Determine if the context provides information on the effective treatments or solutions for sudden patchy hair loss, including localized bald spots on the scalp.\n",
+ "3. Check if the context mentions the possible causes behind sudden patchy hair loss, such as autoimmune disorders, genetics, stress, hormonal changes, nutritional deficiencies, infections, and other medical conditions.\n",
+ "4. Evaluate whether all and only the important aspects related to treatments and causes of sudden patchy hair loss are addressed in the context.\n",
+ "\n",
+ "Explanation:\n",
+ "The context provided includes detailed information on the causes and treatments for sudden patchy hair loss, which aligns well with the main aspects of the question. It covers autoimmune disorders, genetics, stress, hormonal changes, nutritional deficiencies, infections, and other medical conditions as possible causes. Additionally, it lists effective treatments such as topical corticosteroids, minoxidil, corticosteroid injections, immunotherapy, oral medications, light therapy, nutritional support, stress management, and cosmetic solutions like wigs.\n",
+ "\n",
+ "Based on the evaluation, the context follows the metric of relevance by addressing all the important aspects related to the question about sudden patchy hair loss, its causes, and effective treatments.\n",
+ "\n",
+ "Therefore, the relevance score for this context is 5. \n",
+ "\n",
+ "{relevance_score: 5}\n"
+ ]
+ }
+ ],
+ "source": [
+ "# Question 3\n",
+ "ground_3,rel_3 = generate_ground_relevance_response(user_input=result_df.questions[2], response=result_df.base_prompt_responses[2], max_tokens=516) #Complete the code to calculate the groundedness and relevance score\n",
+ "print(ground_3,end=\"\\n\\n\")\n",
+ "print(rel_3)"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 138,
+ "metadata": {
+ "id": "ebZtHibwnbe2",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "f672d1ff-f5b2-43d8-e173-ae9b40fef49e"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "To evaluate the answer based on the metric provided, we need to ensure that the information presented in the context is the sole source for generating the answer. Here are the steps to evaluate the answer:\n",
+ "\n",
+ "1. Identify if the information provided in the answer is directly sourced from the context given.\n",
+ "2. Check if the details mentioned in the answer align with the information presented in the context.\n",
+ "3. Verify if there are no additional external sources or information used to formulate the answer.\n",
+ "\n",
+ "Explanation:\n",
+ "The AI-generated answer provides a comprehensive list of treatments recommended for a person who has sustained a physical injury to brain tissue, specifically a traumatic brain injury (TBI). The answer includes emergency care, surgical interventions, medication, rehabilitation, psychological support, lifestyle modifications, supportive care, long-term management, assistive devices, and alternative therapies. Each treatment option is explained in detail, covering various aspects of care and support.\n",
+ "\n",
+ "The answer directly reflects the information provided in the context, mentioning the need for immediate medical attention, surgical interventions to relieve pressure on the brain, rehabilitation through physical, occupational, speech, and neuropsychological therapy, psychological support, lifestyle modifications, family education, long-term management, assistive devices, and alternative therapies. The details align closely with the content presented in the context regarding the recommended treatments for brain injuries.\n",
+ "\n",
+ "Therefore, the answer follows the metric of being derived solely from the information presented in the context.\n",
+ "\n",
+ "Based on the evaluation, the score for groundedness is 5.\n",
+ "\n",
+ "To evaluate the context based on the metric of relevance, the following steps can be followed:\n",
+ "\n",
+ "1. Identify the main aspects of the question:\n",
+ " - The question asks about the recommended treatments for a person who has sustained a physical injury to brain tissue, resulting in temporary or permanent impairment of brain function.\n",
+ "\n",
+ "2. Analyze the context provided:\n",
+ " - The context includes information about traumatic brain injury (TBI), rehabilitation, head injury, spinal cord injury, and the pathology of brain injuries.\n",
+ " - It discusses the importance of rehabilitation, early intervention, cognitive therapy, and family education in the treatment of brain injuries.\n",
+ " - Surgical interventions, medication, rehabilitation therapies, psychological support, lifestyle modifications, supportive care, long-term management, assistive devices, and alternative therapies are also mentioned.\n",
+ "\n",
+ "3. Compare the context with the main aspects of the question:\n",
+ " - The context covers a wide range of treatments and interventions for brain injuries, including emergency care, surgical interventions, medication, rehabilitation, psychological support, lifestyle modifications, supportive care, long-term management, assistive devices, and alternative therapies.\n",
+ " - It specifically addresses the need for rehabilitation, cognitive therapy, and family education, which are important aspects of treating brain injuries.\n",
+ "\n",
+ "Based on the evaluation of the context, it can be seen that the context aligns well with the main aspects of the question by providing detailed information about the recommended treatments for a person with a brain injury. Therefore, the relevance score for the context is 5.\n",
+ "\n",
+ "{\n",
+ "\"relevance_score\": 5\n",
+ "}\n"
+ ]
+ }
+ ],
+ "source": [
+ "# Question 4\n",
+ "ground_4,rel_4 = generate_ground_relevance_response(user_input=result_df.questions[3], response=result_df.base_prompt_responses[3], max_tokens=516) #Complete the code to calculate the groundedness and relevance score\n",
+ "print(ground_4,end=\"\\n\\n\")\n",
+ "print(rel_4)"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "source": [
+ "**Evaluation 1: Base Prompt Response Evaluation**"
+ ],
+ "metadata": {
+ "id": "grgj2iGSRT8a"
+ }
+ },
+ {
+ "cell_type": "code",
+ "source": [
+ "# Create a DataFrame to store the base prompt evaluation results\n",
+ "base_prompt_evaluation_df = pd.DataFrame({\n",
+ " \"question\": [question_1, question_2, question_3,question_4],\n",
+ " \"base_prompt_response\": [result_df.base_prompt_responses[0], result_df.base_prompt_responses[1], result_df.base_prompt_responses[2],result_df.base_prompt_responses[3]],\n",
+ " \"groundedness_score\": [ground_1[-2], ground_2[-2], ground_3[-2],ground_4[-2]],\n",
+ " \"relevance_score\": [rel_1[-2], rel_2[-2], rel_3[-2],rel_4[-2]]\n",
+ "})\n",
+ "\n",
+ "base_prompt_evaluation_df['groundedness_score'] = pd.to_numeric(base_prompt_evaluation_df['groundedness_score'], errors='coerce')\n",
+ "base_prompt_evaluation_df['relevance_score'] = pd.to_numeric(base_prompt_evaluation_df['relevance_score'], errors='coerce')\n",
+ "\n",
+ "# Display the DataFrame\n",
+ "display(base_prompt_evaluation_df)"
+ ],
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 836
+ },
+ "id": "XHg3NGwrOluD",
+ "outputId": "cec27acc-dde5-49cb-8dd0-5cd325c5bc7f"
+ },
+ "execution_count": 139,
+ "outputs": [
+ {
+ "output_type": "display_data",
+ "data": {
+ "text/plain": [
+ " question \\\n",
+ "0 What is the protocol for managing sepsis in a ... \n",
+ "1 What are the common symptoms for appendicitis,... \n",
+ "2 What are the effective treatments or solutions... \n",
+ "3 What treatments are recommended for a person w... \n",
+ "\n",
+ " base_prompt_response groundedness_score \\\n",
+ "0 Managing sepsis in a critical care unit involv... 5 \n",
+ "1 Common symptoms of appendicitis include:\\n\\n1.... 5 \n",
+ "2 Sudden patchy hair loss, often referred to as ... 5 \n",
+ "3 The treatment for a person who has sustained a... 5 \n",
+ "\n",
+ " relevance_score \n",
+ "0 3.0 \n",
+ "1 3.0 \n",
+ "2 5.0 \n",
+ "3 NaN "
+ ],
+ "text/html": [
+ "\n",
+ "
\n",
+ "
\n",
+ "\n",
+ "
\n",
+ " \n",
+ "
\n",
+ "
\n",
+ "
question
\n",
+ "
base_prompt_response
\n",
+ "
groundedness_score
\n",
+ "
relevance_score
\n",
+ "
\n",
+ " \n",
+ " \n",
+ "
\n",
+ "
0
\n",
+ "
What is the protocol for managing sepsis in a ...
\n",
+ "
Managing sepsis in a critical care unit involv...
\n",
+ "
5
\n",
+ "
3.0
\n",
+ "
\n",
+ "
\n",
+ "
1
\n",
+ "
What are the common symptoms for appendicitis,...
\n",
+ "
Common symptoms of appendicitis include:\\n\\n1....
\n"
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "dataframe",
+ "variable_name": "base_prompt_evaluation_df",
+ "summary": "{\n \"name\": \"base_prompt_evaluation_df\",\n \"rows\": 4,\n \"fields\": [\n {\n \"column\": \"question\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 4,\n \"samples\": [\n \"What are the common symptoms for appendicitis, and can it be cured via medicine? If not, what surgical procedure should be followed to treat it?\",\n \"What treatments are recommended for a person who has sustained a physical injury to brain tissue, resulting in temporary or permanent impairment of brain function?\",\n \"What is the protocol for managing sepsis in a critical care unit?\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"base_prompt_response\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 4,\n \"samples\": [\n \"Common symptoms of appendicitis include:\\n\\n1. **Abdominal Pain**: Typically starts around the navel and then moves to the lower right abdomen.\\n2. **Loss of Appetite**: A sudden decrease in appetite is common.\\n3. **Nausea and Vomiting**: Often follows the onset of abdominal pain.\\n4. **Fever**: A low-grade fever may develop.\\n5. **Constipation or Diarrhea**: Changes in bowel habits can occur.\\n6. **Abdominal Swelling**: In some cases, the abdomen may become swollen.\\n\\nAppendicitis cannot be effectively treated with medication alone. The standard treatment is surgical removal of the appendix, known as an **appendectomy**. This can be performed using two main techniques:\\n\\n1. **Open Appendectomy**: A larger incision is made in the lower right abdomen to remove the appendix.\\n2. **Laparoscopic Appendectomy**: This is a minimally invasive procedure where several small incisions are made, and the appendix is removed with the aid of a camera and special instruments.\\n\\nLaparoscopic appendectomy is often preferred due to its benefits, including less postoperative pain, shorter recovery time, and minimal scarring. However, the choice of procedure may depend on the patient's specific situation and the surgeon's expertise.\",\n \"The treatment for a person who has sustained a physical injury to brain tissue, such as a traumatic brain injury (TBI), can vary widely depending on the severity of the injury, the specific areas of the brain affected, and the resulting impairments. Here are some common approaches to treatment:\\n\\n1. **Emergency Care**: \\n - Immediate medical attention is crucial. This may involve stabilizing the patient, monitoring vital signs, and performing imaging studies (like CT or MRI scans) to assess the extent of the injury.\\n\\n2. **Surgical Interventions**: \\n - In some cases, surgery may be necessary to relieve pressure on the brain, remove blood clots (hematomas), or repair skull fractures.\\n\\n3. **Medication**: \\n - Medications may be prescribed to manage symptoms such as pain, seizures, or inflammation. Corticosteroids may be used to reduce swelling in the brain.\\n\\n4. **Rehabilitation**: \\n - **Physical Therapy**: To improve mobility and strength.\\n - **Occupational Therapy**: To help with daily living skills and regain independence.\\n - **Speech and Language Therapy**: To address communication difficulties and swallowing issues.\\n - **Neuropsychological Therapy**: To help with cognitive rehabilitation, including memory, attention, and problem-solving skills.\\n\\n5. **Psychological Support**: \\n - Counseling or therapy may be beneficial for coping with emotional and psychological challenges following a brain injury, such as depression, anxiety, or changes in personality.\\n\\n6. **Lifestyle Modifications**: \\n - Patients may need to make adjustments to their daily routines, including rest, nutrition, and avoiding activities that could lead to further injury.\\n\\n7. **Supportive Care**: \\n - Family support and education about the injury and its effects can be crucial for recovery. Support groups may also be helpful.\\n\\n8. **Long-term Management**: \\n - Ongoing follow-up with healthcare providers to monitor recovery and manage any long-term effects or complications.\\n\\n9. **Assistive Devices**: \\n - Depending on the nature of the impairment, assistive devices or technology may be recommended to aid in communication, mobility, or daily activities.\\n\\n10. **Alternative Therapies**: \\n - Some individuals may explore complementary therapies such as acupuncture, yoga, or meditation, although these should be discussed with a healthcare provider.\\n\\nIt's important for treatment plans to be individualized, taking into account the specific needs and circumstances of the person affected. A multidisciplinary team approach is often the most\",\n \"Managing sepsis in a critical care unit involves a systematic approach that includes early recognition, prompt intervention, and ongoing monitoring. The following is a general protocol based on current guidelines, such as those from the Surviving Sepsis Campaign:\\n\\n### 1. **Early Recognition**\\n - **Identify Symptoms**: Look for signs of infection (fever, chills, tachycardia, tachypnea) and organ dysfunction (altered mental status, hypotension, oliguria).\\n - **Use Screening Tools**: Utilize tools like the qSOFA (quick Sequential Organ Failure Assessment) or SIRS (Systemic Inflammatory Response Syndrome) criteria to identify patients at risk.\\n\\n### 2. **Initial Assessment**\\n - **Obtain Vital Signs**: Monitor blood pressure, heart rate, respiratory rate, and temperature.\\n - **Assess Organ Function**: Evaluate renal function (urine output, creatinine), liver function (bilirubin, liver enzymes), and coagulation status (platelets, INR).\\n\\n### 3. **Immediate Interventions**\\n - **Fluid Resuscitation**: Administer intravenous (IV) fluids (crystalloids) promptly, typically 30 mL/kg within the first 3 hours.\\n - **Antibiotic Therapy**: Start broad-spectrum IV antibiotics within 1 hour of recognition of sepsis. Adjust based on culture results and sensitivity.\\n - **Source Control**: Identify and control the source of infection (e.g., drainage of abscess, removal of infected devices).\\n\\n### 4. **Monitoring and Support**\\n - **Hemodynamic Monitoring**: Use invasive monitoring (e.g., arterial line, central venous pressure) if necessary to guide fluid resuscitation and vasopressor therapy.\\n - **Vasopressors**: If hypotension persists despite adequate fluid resuscitation, initiate vasopressors (e.g., norepinephrine) to maintain mean arterial pressure (MAP) \\u2265 65 mmHg.\\n - **Oxygenation and Ventilation**: Provide supplemental oxygen and consider mechanical ventilation if respiratory failure occurs.\\n\\n### 5. **Ongoing Management**\\n - **Reassess Fluid Status**: Continuously evaluate the patient's response to fluids and adjust as necessary.\\n - **Monitor Laboratory Values**: Regularly check lactate levels, complete blood counts, and organ function tests to assess the patient's status.\\n - **Nutritional Support**: Initiate enteral nutrition as soon as feasible, typically within 24\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"groundedness_score\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 0,\n \"min\": 5,\n \"max\": 5,\n \"num_unique_values\": 1,\n \"samples\": [\n 5\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"relevance_score\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 1.1547005383792515,\n \"min\": 3.0,\n \"max\": 5.0,\n \"num_unique_values\": 2,\n \"samples\": [\n 5.0\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n }\n ]\n}"
+ }
+ },
+ "metadata": {}
+ }
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "2J55TQZTnlYE"
+ },
+ "source": [
+ "#### **Evaluation 2: Prompt Engineering Response Evaluation**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 130,
+ "metadata": {
+ "id": "6yEkbFmHnxpe",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "3cb0547a-3814-4936-9d42-8326d44f356c"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "To evaluate the answer based on the metric provided, which states that the answer should be derived only from the information presented in the context, the following steps need to be followed:\n",
+ "\n",
+ "1. Identify the key points and information provided in the context regarding the protocol for managing sepsis in a critical care unit.\n",
+ "2. Compare the details mentioned in the AI-generated answer with the information presented in the context.\n",
+ "3. Determine if the answer provided by the AI system aligns with the specific details and guidelines outlined in the context.\n",
+ "\n",
+ "Explanation:\n",
+ "The AI-generated answer provides a detailed protocol for managing sepsis in a critical care unit, including steps for early recognition, resuscitation, antibiotic therapy, source control, monitoring, supportive care, reassessment, corticosteroid consideration, glucose control, and communication. These steps are not directly mentioned in the context provided.\n",
+ "\n",
+ "Therefore, the AI-generated answer does not strictly adhere to the metric of deriving the answer solely from the information presented in the context. The answer goes beyond the specific details provided in the context and introduces additional guidelines and recommendations that are not explicitly stated in the context.\n",
+ "\n",
+ "Based on the evaluation criteria:\n",
+ "The answer partially follows the metric, as it includes some relevant information but also introduces additional details not present in the context.\n",
+ "\n",
+ "Hence, the score for groundedness is 2.\n",
+ "\n",
+ "{relevance_score:3}\n"
+ ]
+ }
+ ],
+ "source": [
+ "# Question 1\n",
+ "ground_1,rel_1 = generate_ground_relevance_response(user_input=result_df.questions[0], response=result_df.responses_with_prompt_eng[0], max_tokens=516)\n",
+ "print(ground_1,end=\"\\n\\n\")\n",
+ "print(rel_1)"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 131,
+ "metadata": {
+ "id": "BHZzDnLsnxpf",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "2125425c-d1bf-4f80-99f2-821310bda46c"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "Steps to evaluate the answer:\n",
+ "1. Identify if the information provided in the answer is solely based on the context.\n",
+ "2. Check if the symptoms of appendicitis, treatment options, and surgical procedures mentioned in the answer are supported by the context.\n",
+ "3. Evaluate if any additional information not present in the context is included in the answer.\n",
+ "\n",
+ "Explanation:\n",
+ "The answer provided lists common symptoms of appendicitis and explains that appendicitis cannot be cured with medicine alone, requiring surgical intervention in the form of an appendectomy. It also mentions the two types of surgical procedures for appendicitis treatment - open surgery and laparoscopic surgery. All the information provided in the answer is directly derived from the context given.\n",
+ "\n",
+ "The symptoms mentioned in the answer align with the symptoms described in the context, such as abdominal pain, loss of appetite, nausea, vomiting, fever, constipation or diarrhea, and abdominal swelling. The answer also correctly states that appendicitis cannot be cured with medication alone and requires surgical removal of the inflamed appendix, which is supported by the context mentioning appendectomy as the treatment for acute appendicitis.\n",
+ "\n",
+ "Therefore, the answer follows the metric of being derived only from the information presented in the context.\n",
+ "\n",
+ "Score: {groundedness_score: 5}\n",
+ "\n",
+ "Steps to evaluate the context for relevance:\n",
+ "1. Identify the main aspects of the question, which include common symptoms of appendicitis and the treatment options (medicine or surgical procedure).\n",
+ "2. Check if the context provides information on the common symptoms of appendicitis and the treatment options mentioned in the question.\n",
+ "3. Evaluate whether the context covers all the important aspects related to appendicitis symptoms and treatment options.\n",
+ "4. Consider if the context aligns with the question and provides relevant information that directly addresses the query.\n",
+ "\n",
+ "Explanation:\n",
+ "The context provided includes detailed information about the etiology, symptoms, diagnosis, and treatment of appendicitis. It covers the common symptoms of appendicitis, such as abdominal pain, loss of appetite, nausea, vomiting, fever, constipation or diarrhea, and abdominal swelling. Additionally, it explains that appendicitis cannot be effectively treated with medication alone and typically requires surgical intervention in the form of an appendectomy. The context also describes the surgical procedure for treating appendicitis, including open or laparoscopic appendectomy, IV fluids, and antibiotics.\n",
+ "\n",
+ "Based on the evaluation criteria, the context aligns well with the question by providing comprehensive information on the common symptoms of appendicitis and the surgical procedure required for its treatment. It covers all the important aspects related to the question and directly addresses the query about symptoms and treatment options for appendicitis.\n",
+ "\n",
+ "Therefore, the relevance score for the context is 5. \n",
+ "\n",
+ "{relevance_score: 5}\n"
+ ]
+ }
+ ],
+ "source": [
+ "# Question 2\n",
+ "ground_2,rel_2 = generate_ground_relevance_response(user_input=result_df.questions[1], response=result_df.responses_with_prompt_eng[1], max_tokens=516) #Complete the code to calculate the groundedness and relevance score\n",
+ "print(ground_2,end=\"\\n\\n\")\n",
+ "print(rel_2)"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 132,
+ "metadata": {
+ "id": "v4dCtQMCnxpg",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "0e699b91-e40b-4d8e-e01a-31a2feb93c61"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "To evaluate the answer as per the metric, the following steps need to be followed:\n",
+ "1. Identify if the information provided in the answer is directly derived from the context.\n",
+ "2. Check if any additional information not present in the context is included in the answer.\n",
+ "3. Ensure that the treatments and possible causes mentioned in the answer are supported by the context provided.\n",
+ "\n",
+ "Explanation:\n",
+ "The AI-generated answer provides information on effective treatments and possible causes for sudden patchy hair loss, specifically focusing on alopecia areata. The context mentions various treatments and causes related to hair loss, including corticosteroids, minoxidil, immunotherapy, genetics, stress, hormonal changes, and nutritional deficiencies. The answer aligns with the context by including treatments like corticosteroids, minoxidil, immunotherapy, and JAK inhibitors, which are supported by the context. The possible causes mentioned in the answer, such as autoimmune response, genetics, stress, hormonal changes, nutritional deficiencies, and infections, are also supported by the context.\n",
+ "\n",
+ "Therefore, the answer follows the metric by deriving information solely from the context provided.\n",
+ "\n",
+ "Based on the evaluation, the score for groundedness is 5.\n",
+ "\n",
+ "To evaluate the context based on the metric of relevance, the following steps need to be followed:\n",
+ "\n",
+ "1. Identify the main aspects of the question: The main aspects of the question include effective treatments or solutions for sudden patchy hair loss (alopecia areata) and the possible causes behind it.\n",
+ "\n",
+ "2. Check if the context provides information on effective treatments: Look for details on treatments such as corticosteroids, minoxidil, immunotherapy, anthralin, JAK inhibitors, light therapy, and supportive care.\n",
+ "\n",
+ "3. Check if the context mentions possible causes: Look for information on autoimmune response, genetics, stress, hormonal changes, nutritional deficiencies, and infections as potential causes of sudden patchy hair loss.\n",
+ "\n",
+ "4. Evaluate if all and only the important aspects are contained in the context: Ensure that the context addresses both the effective treatments and possible causes related to sudden patchy hair loss.\n",
+ "\n",
+ "Based on the evaluation steps, the context provided aligns well with the metric of relevance. It covers the effective treatments and possible causes of sudden patchy hair loss as requested in the question. The context includes detailed information on various treatment options and potential causes, providing a comprehensive overview of the topic.\n",
+ "\n",
+ "Therefore, the relevance score for the context is 5. \n",
+ "\n",
+ "{relevance_score: 5}\n"
+ ]
+ }
+ ],
+ "source": [
+ "# Question 3\n",
+ "ground_3,rel_3 = generate_ground_relevance_response(user_input=result_df.questions[2], response=result_df.responses_with_prompt_eng[2], max_tokens=516) #Complete the code to calculate the groundedness and relevance score\n",
+ "print(ground_3,end=\"\\n\\n\")\n",
+ "print(rel_3)"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 133,
+ "metadata": {
+ "id": "jWBc97uynxpg",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "ff7fd2ce-2ede-4136-b8fb-53aa9ad6a711"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "To evaluate the answer as per the metric, the following steps need to be followed:\n",
+ "1. Identify if the information provided in the answer is directly derived from the context.\n",
+ "2. Check if the treatments and possible causes mentioned in the answer are supported by the information given in the context.\n",
+ "3. Ensure that no additional information beyond what is provided in the context is included in the answer.\n",
+ "\n",
+ "Explanation:\n",
+ "The AI-generated answer provides information on effective treatments and possible causes for sudden patchy hair loss, specifically focusing on alopecia areata. The context mentions various treatments for different types of hair loss, including corticosteroids, minoxidil, immunotherapy, anthralin, JAK inhibitors, and light therapy. It also discusses possible causes such as autoimmune response, genetics, stress, hormonal changes, nutritional deficiencies, and infections. The answer aligns with the information presented in the context and does not introduce any new information.\n",
+ "\n",
+ "Therefore, the answer follows the metric by deriving all the information solely from the context.\n",
+ "\n",
+ "Based on the evaluation, the score for groundedness is 5.\n",
+ "\n",
+ "To evaluate the context based on the metric of relevance, the following steps can be followed:\n",
+ "\n",
+ "1. Identify the main aspects of the question:\n",
+ " - Effective treatments for sudden patchy hair loss\n",
+ " - Possible causes behind sudden patchy hair loss\n",
+ "\n",
+ "2. Check if the context provides information related to the effective treatments and possible causes of sudden patchy hair loss.\n",
+ "\n",
+ "3. Ensure that the treatments and causes mentioned in the context align with the information required to address the question.\n",
+ "\n",
+ "Explanation:\n",
+ "The context provided includes detailed information about the different types of hair loss, including sudden patchy hair loss (alopecia areata). It covers various treatments and possible causes related to sudden patchy hair loss, such as corticosteroids, minoxidil, immunotherapy, genetics, stress, hormonal changes, and more. The context also emphasizes the importance of consulting healthcare professionals for accurate diagnosis and treatment plans.\n",
+ "\n",
+ "Based on the evaluation, the context aligns well with the main aspects of the question regarding effective treatments and possible causes of sudden patchy hair loss. It provides comprehensive information that directly addresses the user's query.\n",
+ "\n",
+ "Therefore, the relevance score for the context is 5. \n",
+ "\n",
+ "{relevance_score: 5}\n"
+ ]
+ }
+ ],
+ "source": [
+ "# Question 4\n",
+ "ground_4,rel_4 = generate_ground_relevance_response(user_input=result_df.questions[2], response=result_df.responses_with_prompt_eng[2], max_tokens=516) #Complete the code to calculate the groundedness and relevance score\n",
+ "print(ground_4,end=\"\\n\\n\")\n",
+ "print(rel_4)"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "source": [
+ "# Create a DataFrame to store the prompt engineering evaluation results\n",
+ "prompt_engineering_evaluation_df = pd.DataFrame({\n",
+ " \"question\": [question_1, question_2, question_3,question_4],\n",
+ " \"prompt_engg_response\": [result_df.responses_with_prompt_eng[0], result_df.responses_with_prompt_eng[1], result_df.responses_with_prompt_eng[2],result_df.responses_with_prompt_eng[3]],\n",
+ " \"groundedness_score\": [ground_1[-2], ground_2[-2], ground_3[-2],ground_4[-2]],\n",
+ " \"relevance_score\": [rel_1[-2], rel_2[-2], rel_3[-2],rel_4[-2]]\n",
+ "})\n",
+ "\n",
+ "prompt_engineering_evaluation_df['groundedness_score'] = pd.to_numeric(prompt_engineering_evaluation_df['groundedness_score'], errors='coerce')\n",
+ "prompt_engineering_evaluation_df['relevance_score'] = pd.to_numeric(prompt_engineering_evaluation_df['relevance_score'], errors='coerce')\n",
+ "\n",
+ "# Display the DataFrame\n",
+ "display(prompt_engineering_evaluation_df)"
+ ],
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 637
+ },
+ "id": "YIF50xSFTDD5",
+ "outputId": "4e3c0984-df4f-44e4-c653-e60a1c086d70"
+ },
+ "execution_count": 134,
+ "outputs": [
+ {
+ "output_type": "display_data",
+ "data": {
+ "text/plain": [
+ " question \\\n",
+ "0 What is the protocol for managing sepsis in a ... \n",
+ "1 What are the common symptoms for appendicitis,... \n",
+ "2 What are the effective treatments or solutions... \n",
+ "3 What treatments are recommended for a person w... \n",
+ "\n",
+ " prompt_engg_response groundedness_score \\\n",
+ "0 The management of sepsis in a critical care un... 2 \n",
+ "1 Common symptoms of appendicitis include:\\n\\n1.... 5 \n",
+ "2 Sudden patchy hair loss, often referred to as ... 5 \n",
+ "3 Treatment for a person who has sustained a phy... 5 \n",
+ "\n",
+ " relevance_score \n",
+ "0 3 \n",
+ "1 5 \n",
+ "2 5 \n",
+ "3 5 "
+ ],
+ "text/html": [
+ "\n",
+ "
\n",
+ "
\n",
+ "\n",
+ "
\n",
+ " \n",
+ "
\n",
+ "
\n",
+ "
question
\n",
+ "
prompt_engg_response
\n",
+ "
groundedness_score
\n",
+ "
relevance_score
\n",
+ "
\n",
+ " \n",
+ " \n",
+ "
\n",
+ "
0
\n",
+ "
What is the protocol for managing sepsis in a ...
\n",
+ "
The management of sepsis in a critical care un...
\n",
+ "
2
\n",
+ "
3
\n",
+ "
\n",
+ "
\n",
+ "
1
\n",
+ "
What are the common symptoms for appendicitis,...
\n",
+ "
Common symptoms of appendicitis include:\\n\\n1....
\n"
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "dataframe",
+ "variable_name": "prompt_engineering_evaluation_df",
+ "summary": "{\n \"name\": \"prompt_engineering_evaluation_df\",\n \"rows\": 4,\n \"fields\": [\n {\n \"column\": \"question\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 4,\n \"samples\": [\n \"What are the common symptoms for appendicitis, and can it be cured via medicine? If not, what surgical procedure should be followed to treat it?\",\n \"What treatments are recommended for a person who has sustained a physical injury to brain tissue, resulting in temporary or permanent impairment of brain function?\",\n \"What is the protocol for managing sepsis in a critical care unit?\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"prompt_engg_response\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 4,\n \"samples\": [\n \"Common symptoms of appendicitis include:\\n\\n1. Abdominal pain, often starting near the belly button and then moving to the lower right abdomen.\\n2. Loss of appetite.\\n3. Nausea and vomiting.\\n4. Fever.\\n5. Constipation or diarrhea.\\n6. Abdominal swelling.\\n\\nAppendicitis cannot be effectively treated with medication alone; it typically requires surgical intervention. The standard surgical procedure for treating appendicitis is an appendectomy, which involves the removal of the inflamed appendix. This can be performed as an open surgery or laparoscopically, depending on the case and the surgeon's preference.\",\n \"Treatment for a person who has sustained a physical injury to brain tissue, such as a traumatic brain injury (TBI), typically involves a multidisciplinary approach and may include the following:\\n\\n1. **Emergency Care**: Immediate medical attention may involve stabilizing the patient, ensuring adequate oxygenation, and managing intracranial pressure.\\n\\n2. **Surgery**: In some cases, surgical intervention may be necessary to remove hematomas, repair skull fractures, or relieve pressure on the brain.\\n\\n3. **Medications**: \\n - **Analgesics** for pain management.\\n - **Anticonvulsants** to prevent seizures.\\n - **Diuretics** to reduce swelling.\\n - **Corticosteroids** may be used to decrease inflammation.\\n\\n4. **Rehabilitation**: \\n - **Physical therapy** to improve mobility and strength.\\n - **Occupational therapy** to assist with daily living activities.\\n - **Speech therapy** for communication and swallowing difficulties.\\n - **Neuropsychological therapy** to address cognitive and emotional challenges.\\n\\n5. **Supportive Care**: This may include counseling, support groups, and education for patients and families about the injury and recovery process.\\n\\n6. **Long-term Management**: Ongoing assessment and management of cognitive, emotional, and physical impairments may be necessary, including regular follow-ups with healthcare providers.\\n\\nThe specific treatment plan will depend on the severity of the injury, the areas of the brain affected, and the individual needs of the patient.\",\n \"The management of sepsis in a critical care unit typically follows the Surviving Sepsis Campaign guidelines. Here\\u2019s a concise protocol:\\n\\n1. **Early Recognition**: Identify sepsis using clinical criteria (e.g., suspected infection plus organ dysfunction).\\n\\n2. **Immediate Resuscitation**:\\n - **Fluid Resuscitation**: Administer intravenous fluids (30 mL/kg of crystalloids within the first 3 hours).\\n - **Vasopressors**: If hypotension persists after fluid resuscitation, initiate norepinephrine to maintain mean arterial pressure (MAP) \\u2265 65 mmHg.\\n\\n3. **Antibiotic Therapy**:\\n - Administer broad-spectrum antibiotics within 1 hour of sepsis recognition. Adjust based on culture results and local antibiograms.\\n\\n4. **Source Control**:\\n - Identify and manage the source of infection (e.g., drainage of abscess, removal of infected devices).\\n\\n5. **Monitoring**:\\n - Continuously monitor vital signs, urine output, and laboratory parameters (e.g., lactate levels, complete blood count, renal function).\\n\\n6. **Supportive Care**:\\n - Provide supportive care, including oxygen therapy, mechanical ventilation if needed, and renal replacement therapy for acute kidney injury.\\n\\n7. **Reassessment**:\\n - Reassess hemodynamic status and organ function frequently, adjusting treatment as necessary.\\n\\n8. **Consideration of Corticosteroids**:\\n - In cases of septic shock, consider low-dose corticosteroids (e.g., hydrocortisone) if there is no response to fluid resuscitation and vasopressors.\\n\\n9. **Glucose Control**:\\n - Maintain blood glucose levels between 140-180 mg/dL.\\n\\n10. **Communication and Team Approach**:\\n - Ensure effective communication among the healthcare team and involve specialists as needed.\\n\\nThis protocol should be tailored to individual patient needs and institutional protocols. Regular training and updates on sepsis management are essential for critical care staff.\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"groundedness_score\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 1,\n \"min\": 2,\n \"max\": 5,\n \"num_unique_values\": 2,\n \"samples\": [\n 5,\n 2\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"relevance_score\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 1,\n \"min\": 3,\n \"max\": 5,\n \"num_unique_values\": 2,\n \"samples\": [\n 5,\n 3\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n }\n ]\n}"
+ }
+ },
+ "metadata": {}
+ }
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "y7wXIFmfn4tX"
+ },
+ "source": [
+ "#### **Evaluation 3: RAG Response Evaluation**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 140,
+ "metadata": {
+ "id": "lPGdtRCcoBIi",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "6ffcdced-bc86-49d4-cf13-74bf236ed95a"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "To evaluate the answer as per the metric, the following steps need to be followed:\n",
+ "1. Identify if the information provided in the answer is directly derived from the context.\n",
+ "2. Check if any additional information not present in the context is included in the answer.\n",
+ "3. Verify if the steps mentioned in the answer align with the protocol for managing sepsis in a critical care unit as described in the context.\n",
+ "\n",
+ "Explanation:\n",
+ "The AI-generated answer provides a detailed protocol for managing sepsis in a critical care unit based on the information presented in the context. It includes steps such as obtaining specimens for culture, initiating prompt empiric antibiotic therapy, changing antibiotic regimen based on culture and sensitivity results, draining abscesses, monitoring blood glucose levels, and providing supportive care. All the steps mentioned in the answer are directly derived from the context provided.\n",
+ "\n",
+ "Therefore, the answer follows the metric completely as it only uses the information presented in the context to formulate the protocol for managing sepsis in a critical care unit.\n",
+ "\n",
+ "Score: {groundedness_score: 5}\n",
+ "\n",
+ "{\n",
+ "relevance_score: 5\n",
+ "}\n"
+ ]
+ }
+ ],
+ "source": [
+ "# Question 1\n",
+ "ground_1,rel_1 = generate_ground_relevance_response(user_input=result_df.questions[0], response=result_df.responses_with_RAG[0], max_tokens=516) #Complete the code to calculate the groundedness and relevance\n",
+ "print(ground_1,end=\"\\n\\n\")\n",
+ "print(rel_1)"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 141,
+ "metadata": {
+ "id": "ZrB06dkBoBIj",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "bf5873bb-b903-49fa-80c7-58dc07623b87"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "Steps to evaluate the answer:\n",
+ "1. Identify if the information provided in the answer is directly from the context.\n",
+ "2. Check if the symptoms of appendicitis and the treatment mentioned in the answer are supported by the context.\n",
+ "3. Ensure that no additional information beyond what is provided in the context is included in the answer.\n",
+ "\n",
+ "Explanation:\n",
+ "The answer directly mentions the common symptoms of appendicitis as described in the context, such as epigastric or periumbilical pain, nausea, vomiting, and anorexia, with pain shifting to the right lower quadrant. It also includes classic signs like right lower quadrant tenderness at McBurney's point, Rovsing sign, psoas sign, and obturator sign. The answer correctly states that appendicitis cannot be cured via medicine and requires surgical removal, specifically an open or laparoscopic appendectomy. The source of the information is also mentioned.\n",
+ "\n",
+ "Therefore, the answer strictly adheres to the metric by deriving all the information solely from the context provided.\n",
+ "\n",
+ "Evaluation: \n",
+ "The answer follows the metric completely by providing information solely from the context without introducing any external information. Hence, the answer deserves a score of 5.\n",
+ "\n",
+ "{groundedness_score: 5}\n",
+ "\n",
+ "To evaluate the context based on the metric of relevance, the following steps can be followed:\n",
+ "\n",
+ "1. Identify the main aspects of the question: The question asks about the common symptoms of appendicitis and inquires about the possibility of curing it with medicine or the surgical procedure required for treatment.\n",
+ "\n",
+ "2. Check if the context provides information relevant to the question: Look for details in the context that discuss the symptoms of appendicitis, whether it can be cured with medicine, and the surgical procedure for treatment.\n",
+ "\n",
+ "3. Evaluate if all and only the important aspects are contained in the answer: Ensure that the answer addresses all the key points mentioned in the question and context, without including irrelevant information.\n",
+ "\n",
+ "Explanation:\n",
+ "The context provides detailed information about the etiology, symptoms, signs, diagnosis, and treatment of appendicitis. It mentions that appendicitis is acute inflammation of the vermiform appendix, resulting in abdominal pain, anorexia, and abdominal tenderness. It also states that the treatment for appendicitis is surgical removal through open or laparoscopic appendectomy. Additionally, it specifies the use of IV antibiotics before appendectomy and the continuation of antibiotics in case of perforation.\n",
+ "\n",
+ "The AI-generated answer accurately addresses the common symptoms of appendicitis, the inability to cure it with medicine, and the recommended surgical procedure for treatment, which aligns well with the main aspects of the question and context.\n",
+ "\n",
+ "Therefore, the relevance of the context to the question is high, as it covers all the important aspects related to appendicitis symptoms, treatment, and surgical procedures.\n",
+ "\n",
+ "Based on the evaluation, the relevance score for the context is 5. \n",
+ "\n",
+ "{relevance_score: 5}\n"
+ ]
+ }
+ ],
+ "source": [
+ "# Question 2\n",
+ "ground_2,rel_2 = generate_ground_relevance_response(user_input=result_df.questions[1], response=result_df.responses_with_RAG[1], max_tokens=516) #Complete the code to calculate the groundedness and relevance\n",
+ "print(ground_2,end=\"\\n\\n\")\n",
+ "print(rel_2)"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 142,
+ "metadata": {
+ "id": "pCFMhRGUoBIj",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "e0ea5905-b980-4767-e512-66e23776f685"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "To evaluate the answer based on the metric provided, we need to follow these steps:\n",
+ "1. Identify if the information provided in the answer is solely derived from the context given.\n",
+ "2. Check if the answer directly addresses the question asked.\n",
+ "3. Determine if the answer includes any additional information not present in the context.\n",
+ "\n",
+ "Explanation:\n",
+ "The AI-generated answer correctly identifies that the effective treatment for sudden patchy hair loss, specifically alopecia areata, is not specified in the provided context. It mentions that alopecia areata is thought to be an autoimmune disorder affecting genetically susceptible individuals and lists possible causes such as systemic illnesses, high fever, systemic lupus, endocrine disorders, and nutritional deficiencies. This information is directly derived from the context provided, specifically from the section on alopecia areata and its possible causes.\n",
+ "\n",
+ "Therefore, the answer adheres to the metric by providing information solely based on the context and directly addressing the question asked.\n",
+ "\n",
+ "Based on the evaluation criteria:\n",
+ "The answer demonstrates a good extent of adherence to the metric, as it is derived entirely from the context provided and directly addresses the question asked.\n",
+ "\n",
+ "Hence, the score for groundedness is 3.\n",
+ "\n",
+ "To evaluate the context based on the metric of relevance, the following steps can be followed:\n",
+ "\n",
+ "1. Identify the main aspects of the question:\n",
+ "- Effective treatments or solutions for sudden patchy hair loss (alopecia areata)\n",
+ "- Possible causes behind sudden patchy hair loss\n",
+ "\n",
+ "2. Check if the context addresses these main aspects:\n",
+ "- Look for information on effective treatments for sudden patchy hair loss, such as alopecia areata.\n",
+ "- Check if the context mentions possible causes behind sudden patchy hair loss, including systemic illnesses, autoimmune diseases, and other factors.\n",
+ "\n",
+ "3. Evaluate if all and only the important aspects are contained in the answer:\n",
+ "- Ensure that the context provides relevant information on treatments and causes related to sudden patchy hair loss, specifically alopecia areata.\n",
+ "\n",
+ "Now, considering the question and the context provided, the AI-generated answer does address some important aspects related to the question. It mentions that alopecia areata is thought to be an autoimmune disorder affecting genetically susceptible individuals and lists possible causes such as systemic illnesses, lupus, endocrine disorders, and nutritional deficiencies. However, it does not specify the effective treatments for sudden patchy hair loss, which was a key aspect of the question.\n",
+ "\n",
+ "Based on the evaluation, the relevance of the context can be rated as follows:\n",
+ "- The context is followed only to a limited extent.\n",
+ "\n",
+ "Therefore, the relevance score for the context is 2. \n",
+ "\n",
+ "{\n",
+ "relevance_score: 2\n",
+ "}\n"
+ ]
+ }
+ ],
+ "source": [
+ "# Question 3\n",
+ "ground_3,rel_3 = generate_ground_relevance_response(user_input=result_df.questions[2], response=result_df.responses_with_RAG[2], max_tokens=516) #Complete the code to calculate the groundedness and relevance\n",
+ "print(ground_3,end=\"\\n\\n\")\n",
+ "print(rel_3)"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 143,
+ "metadata": {
+ "id": "Tf-SrQOgoBIj",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "a504b8a5-4d11-4046-b313-239c040dc746"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "To evaluate the answer based on the metric provided, we need to follow these steps:\n",
+ "1. Identify if the information provided in the answer is solely derived from the context given.\n",
+ "2. Check if the answer includes any additional information not present in the context.\n",
+ "3. Ensure that the answer does not introduce any new concepts or details that are not mentioned in the context.\n",
+ "4. Verify that the answer directly relates to the question asked about treatments recommended for a person with a physical injury to brain tissue.\n",
+ "\n",
+ "Explanation:\n",
+ "The AI-generated answer provides information on the initial treatment for a person with a physical injury to brain tissue, which includes ensuring a reliable airway, maintaining ventilation, oxygenation, and blood pressure. It also mentions the possibility of surgery for severe injuries and the need for subsequent rehabilitation involving a team approach. The answer directly relates to the context provided, which discusses rehabilitation and treatment for traumatic brain injury.\n",
+ "\n",
+ "Based on the evaluation criteria, the answer follows the metric of being derived only from the information presented in the context. It does not introduce any new concepts or details that are not mentioned in the context. Therefore, the answer adheres to the metric.\n",
+ "\n",
+ "Therefore, the groundedness score for this answer is 5.\n",
+ "\n",
+ "To evaluate the context based on the metric of relevance, the following steps can be followed:\n",
+ "\n",
+ "1. Identify the main aspects of the question:\n",
+ "- The question asks about the recommended treatments for a person who has sustained a physical injury to brain tissue, resulting in temporary or permanent impairment of brain function.\n",
+ "\n",
+ "2. Analyze the context provided:\n",
+ "- The context includes information about traumatic brain injury (TBI), rehabilitation, and the importance of early intervention and rehabilitation therapy for patients with cognitive dysfunction.\n",
+ "- It also mentions the need for a team approach in rehabilitation, including physical, occupational, and speech therapy, as well as cognitive therapy for severe cognitive dysfunction.\n",
+ "- The context discusses the initial treatment for brain injuries, which involves ensuring a reliable airway, maintaining adequate ventilation, oxygenation, and blood pressure, and the possibility of surgery for severe cases.\n",
+ "\n",
+ "3. Evaluate the AI-generated answer:\n",
+ "- The answer provided includes information about the initial treatment for brain injuries, the possibility of surgery for severe cases, and the importance of rehabilitation for patients with cognitive dysfunction.\n",
+ "- It mentions the team approach in rehabilitation and the different types of therapy involved.\n",
+ "\n",
+ "Based on the evaluation, the AI-generated answer addresses the main aspects of the question by providing information about initial treatment, surgery, and rehabilitation for brain injuries. It includes relevant details from the context that are essential for understanding the recommended treatments for individuals with brain injuries.\n",
+ "\n",
+ "Therefore, the relevance score for this context is 5. \n",
+ "\n",
+ "{relevance_score: 5}\n"
+ ]
+ }
+ ],
+ "source": [
+ "# Question 4\n",
+ "ground_4,rel_4 = generate_ground_relevance_response(user_input=result_df.questions[3], response=result_df.responses_with_RAG[3], max_tokens= 516) #Complete the code to calculate the groundedness and relevance\n",
+ "print(ground_4,end=\"\\n\\n\")\n",
+ "print(rel_4)"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "source": [
+ "# Create a DataFrame to store the Rag evaluation results\n",
+ "Rag_evaluation_df = pd.DataFrame({\n",
+ " \"question\": [question_1, question_2, question_3,question_4],\n",
+ " \"rag_response\": [result_df.responses_with_RAG[0], result_df.responses_with_RAG[1], result_df.responses_with_RAG[2],result_df.responses_with_RAG[3]],\n",
+ " \"groundedness_score\": [ground_1[-2], ground_2[-2], ground_3[-2],ground_4[-2]],\n",
+ " \"relevance_score\": [rel_1[-2], rel_2[-2], rel_3[-2],rel_4[-2]]\n",
+ "})\n",
+ "\n",
+ "Rag_evaluation_df['groundedness_score'] = pd.to_numeric(Rag_evaluation_df['groundedness_score'], errors='coerce')\n",
+ "Rag_evaluation_df['relevance_score'] = pd.to_numeric(Rag_evaluation_df['relevance_score'], errors='coerce')\n",
+ "\n",
+ "# Display the DataFrame\n",
+ "display(Rag_evaluation_df)"
+ ],
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 505
+ },
+ "id": "SQnXolywWm--",
+ "outputId": "520fd586-2969-4969-db78-9d229f7a9e56"
+ },
+ "execution_count": 144,
+ "outputs": [
+ {
+ "output_type": "display_data",
+ "data": {
+ "text/plain": [
+ " question \\\n",
+ "0 What is the protocol for managing sepsis in a ... \n",
+ "1 What are the common symptoms for appendicitis,... \n",
+ "2 What are the effective treatments or solutions... \n",
+ "3 What treatments are recommended for a person w... \n",
+ "\n",
+ " rag_response groundedness_score \\\n",
+ "0 Answer:\\nThe protocol for managing sepsis in a... 5 \n",
+ "1 Answer:\\nThe common symptoms of appendicitis i... 5 \n",
+ "2 Answer:\\nThe effective treatment for sudden pa... 3 \n",
+ "3 Answer:\\nInitial treatment for a person who ha... 5 \n",
+ "\n",
+ " relevance_score \n",
+ "0 NaN \n",
+ "1 5.0 \n",
+ "2 NaN \n",
+ "3 5.0 "
+ ],
+ "text/html": [
+ "\n",
+ "
\n",
+ "
\n",
+ "\n",
+ "
\n",
+ " \n",
+ "
\n",
+ "
\n",
+ "
question
\n",
+ "
rag_response
\n",
+ "
groundedness_score
\n",
+ "
relevance_score
\n",
+ "
\n",
+ " \n",
+ " \n",
+ "
\n",
+ "
0
\n",
+ "
What is the protocol for managing sepsis in a ...
\n",
+ "
Answer:\\nThe protocol for managing sepsis in a...
\n",
+ "
5
\n",
+ "
NaN
\n",
+ "
\n",
+ "
\n",
+ "
1
\n",
+ "
What are the common symptoms for appendicitis,...
\n",
+ "
Answer:\\nThe common symptoms of appendicitis i...
\n",
+ "
5
\n",
+ "
5.0
\n",
+ "
\n",
+ "
\n",
+ "
2
\n",
+ "
What are the effective treatments or solutions...
\n",
+ "
Answer:\\nThe effective treatment for sudden pa...
\n",
+ "
3
\n",
+ "
NaN
\n",
+ "
\n",
+ "
\n",
+ "
3
\n",
+ "
What treatments are recommended for a person w...
\n",
+ "
Answer:\\nInitial treatment for a person who ha...
\n"
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "dataframe",
+ "variable_name": "Rag_evaluation_df",
+ "summary": "{\n \"name\": \"Rag_evaluation_df\",\n \"rows\": 4,\n \"fields\": [\n {\n \"column\": \"question\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 4,\n \"samples\": [\n \"What are the common symptoms for appendicitis, and can it be cured via medicine? If not, what surgical procedure should be followed to treat it?\",\n \"What treatments are recommended for a person who has sustained a physical injury to brain tissue, resulting in temporary or permanent impairment of brain function?\",\n \"What is the protocol for managing sepsis in a critical care unit?\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"rag_response\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 4,\n \"samples\": [\n \"Answer:\\nThe common symptoms of appendicitis include epigastric or periumbilical pain followed by nausea, vomiting, and anorexia, with pain shifting to the right lower quadrant. Classic signs include right lower quadrant tenderness at McBurney's point, Rovsing sign, psoas sign, and obturator sign. Appendicitis cannot be cured via medicine; the treatment is surgical removal, specifically an open or laparoscopic appendectomy.\\n\\nSource:\\nThe Merck Manual of Diagnosis & Therapy, 19th Edition, Chapter 11. Acute Abdomen & Surgical Gastroenterology, pages 163.\",\n \"Answer:\\nInitial treatment for a person who has sustained a physical injury to brain tissue includes ensuring a reliable airway and maintaining adequate ventilation, oxygenation, and blood pressure. Surgery may be needed for severe injuries to monitor and treat intracranial pressure, decompress the brain, or remove hematomas. Subsequently, many patients require rehabilitation, which should be planned early and may involve a team approach including physical, occupational, and speech therapy, as well as cognitive therapy for those with severe cognitive dysfunction.\\n\\nSource:\\nThe Merck Manual of Diagnosis & Therapy, 19th Edition, Chapter 324. Traumatic Brain Injury, and Chapter 350. Rehabilitation.\",\n \"Answer:\\nThe protocol for managing sepsis in a critical care unit includes the following steps: \\n1. Obtain specimens of blood, body fluids, and wound sites for Gram stain and culture before starting parenteral antibiotics.\\n2. Initiate very prompt empiric antibiotic therapy immediately after suspecting sepsis, which may include gentamicin or tobramycin plus a 3rd-generation cephalosporin (e.g., cefotaxime or ceftriaxone), or ceftazidime plus a fluoroquinolone if Pseudomonas is suspected. Vancomycin should be added if resistant staphylococci or enterococci are suspected, and if there is an abdominal source, include a drug effective against anaerobes (e.g., metronidazole).\\n3. Change the antibiotic regimen based on culture and sensitivity results when available, continuing antibiotics for at least 5 days after shock resolves and evidence of infection subsides.\\n4. Drain abscesses and surgically excise necrotic tissues as necessary.\\n5. Monitor and manage blood glucose levels with a continuous IV insulin infusion to maintain glucose between 80 to 110 mg/dL.\\n6. Provide supportive care, including adequate nutrition and prevention of infections and complications.\\n\\nSource:\\nCritical Care Medicine, Chapter 222. Approach to the Critically Ill Patient.\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"groundedness_score\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 1,\n \"min\": 3,\n \"max\": 5,\n \"num_unique_values\": 2,\n \"samples\": [\n 3,\n 5\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"relevance_score\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 0.0,\n \"min\": 5.0,\n \"max\": 5.0,\n \"num_unique_values\": 1,\n \"samples\": [\n 5.0\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n }\n ]\n}"
+ }
+ },
+ "metadata": {}
+ }
+ ]
+ },
+ {
+ "cell_type": "code",
+ "source": [
+ "print(\"Average scores for Base Prompt Evaluation:\")\n",
+ "print(base_prompt_evaluation_df[['groundedness_score', 'relevance_score']].mean(numeric_only=True))\n",
+ "print(\"Average scores for Prompt engg Evaluation:\")\n",
+ "print(prompt_engineering_evaluation_df[['groundedness_score', 'relevance_score']].mean(numeric_only=True))\n",
+ "print(\"\\nAverage scores for RAG Response Evaluation:\")\n",
+ "print(Rag_evaluation_df[['groundedness_score', 'relevance_score']].mean(numeric_only=True))"
+ ],
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "id": "ud7OiP5gaZhj",
+ "outputId": "a4ee9adb-d831-4a45-d2b2-b84395e2c681"
+ },
+ "execution_count": 146,
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "Average scores for Base Prompt Evaluation:\n",
+ "groundedness_score 5.000000\n",
+ "relevance_score 3.666667\n",
+ "dtype: float64\n",
+ "Average scores for Prompt engg Evaluation:\n",
+ "groundedness_score 4.25\n",
+ "relevance_score 4.50\n",
+ "dtype: float64\n",
+ "\n",
+ "Average scores for RAG Response Evaluation:\n",
+ "groundedness_score 4.5\n",
+ "relevance_score 5.0\n",
+ "dtype: float64\n"
+ ]
+ }
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "Y7QICRU-njdj"
+ },
+ "source": [
+ "## Actionable Insights and Business Recommendations"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "ObyXYhOojIaY"
+ },
+ "source": [
+ "1. Implement Retrieval‑Augmented Generation using authoritative medical manuals (e.g., Merck Manual, Harrison’s) to ensure evidence‑based answers.\n",
+ "2. RAG is your best-performing method — with a perfect relevance score of 5.0, confirming that your retrieval pipeline is correctly matching medical queries to the right chunks.\n",
+ "3. Groundedness still needs improvement (4.5 vs 5.0) — meaning the answers are clinically correct but not always fully supported by retrieved evidence. This is now the main improvement area.\n",
+ "4. Base Prompt’s perfect groundedness is misleading — it’s “correct-looking” medical reasoning, not actually evidence-based. we should not rely on this for clinical use.\n",
+ "5. Chunking issues are visible because RAG groundedness is lower than Base Prompt.If RAG was fully optimized:\n",
+ "Groundedness should be higher than Base Prompt.\n",
+ "Instead:\n",
+ "✅ RAG groundedness = 4.5\n",
+ "✅ Base Prompt = 5.0\n",
+ "This confirms our chunk overlap or chunk size is suboptimal.\n",
+ "\n",
+ "5. Chunking strategy needs refinement — increase chunk size to 800–1000 tokens with 150–200 token overlap, however due to limitation of tokens couldn't carried out the higher chunking. But to boost evidence density, we need to use higher chunking strategy with proper overlapping.\n",
+ "\n",
+ "6. we need to add a cross-encoder reranker — to guarantee the most evidence-rich chunk is ranked #1, directly improving groundedness from 4.5 → 5.0.\n",
+ "7. Need to standardize a clinical answer template —\n",
+ "Assessment → Management → Red Flags → Evidence\n",
+ "This ensures the model maps retrieved facts into structured, grounded output.\n",
+ "\n",
+ "\n",
+ "\n",
+ "\n",
+ "\n",
+ "\n"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "source": [
+ "###Here are the business recommendations:\n",
+ "\n",
+ "1. Strengthen the RAG pipeline with hybrid retrieval, re-ranking, and strict evidence-only answer generation to ensure fully grounded medical outputs.\n",
+ "\n",
+ "2. Expand the evaluation dataset to a comprehensive 30–50 question medical benchmark covering multiple specialties for reliable performance validation.\n",
+ "\n",
+ "3. Introduce mandatory citation formatting and full traceability (chunk IDs, page numbers, document metadata) to increase clinical trust and regulatory readiness.\n",
+ "\n",
+ "4. Implement safety guardrails, fallback responses, and PHI-safe logging to meet compliance standards and reduce legal or clinical risks.\n",
+ "\n",
+ "5. Standardize structured outputs (Assessment → Management → Red Flags → Evidence) to align with clinician workflows and enhance usability.\n",
+ "\n",
+ "6. Build monitoring dashboards for groundedness, relevance, retrieval quality, latency, and token cost to support continuous improvement and enterprise scalability."
+ ],
+ "metadata": {
+ "id": "wwwmRGs0icgj"
+ }
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "ybRlzaIhWaM9"
+ },
+ "source": [
+ "Power Ahead\n",
+ "___"
+ ]
+ }
+ ],
+ "metadata": {
+ "accelerator": "GPU",
+ "colab": {
+ "gpuType": "T4",
+ "provenance": [],
+ "include_colab_link": true
+ },
+ "kernel_info": {
+ "name": "python310-sdkv2"
+ },
+ "kernelspec": {
+ "display_name": "Python 3",
+ "name": "python3"
+ },
+ "language_info": {
+ "name": "python"
+ },
+ "microsoft": {
+ "host": {
+ "AzureML": {
+ "notebookHasBeenCompleted": true
+ }
+ },
+ "ms_spell_check": {
+ "ms_spell_check_language": "en"
+ }
+ },
+ "nteract": {
+ "version": "nteract-front-end@1.0.0"
+ }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 0
+}
\ No newline at end of file
From 60769d83a51c4e99848421081d4efa797661923c Mon Sep 17 00:00:00 2001
From: biplob <110578485+bks1984@users.noreply.github.com>
Date: Mon, 10 Nov 2025 08:50:28 +0530
Subject: [PATCH 2/4] Created using Colab
---
stock_market__news_sentiment_analysis.ipynb | 6747 +++++++++++++++++++
1 file changed, 6747 insertions(+)
create mode 100644 stock_market__news_sentiment_analysis.ipynb
diff --git a/stock_market__news_sentiment_analysis.ipynb b/stock_market__news_sentiment_analysis.ipynb
new file mode 100644
index 0000000..d9566e5
--- /dev/null
+++ b/stock_market__news_sentiment_analysis.ipynb
@@ -0,0 +1,6747 @@
+{
+ "cells": [
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "view-in-github",
+ "colab_type": "text"
+ },
+ "source": [
+ ""
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "inNE1fy-ISPj",
+ "metadata": {
+ "id": "inNE1fy-ISPj"
+ },
+ "source": [
+ "
\n",
+ " \n",
+ "
\n",
+ "\n",
+ "
Stock Market News Sentiment Analysis
"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "EvCcfwuSU-fz",
+ "metadata": {
+ "id": "EvCcfwuSU-fz"
+ },
+ "source": [
+ "## **Problem Statement**"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "6QR_RHvIVHT2",
+ "metadata": {
+ "id": "6QR_RHvIVHT2"
+ },
+ "source": [
+ "### Business Context"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "pl3dmH-EnJGl",
+ "metadata": {
+ "id": "pl3dmH-EnJGl"
+ },
+ "source": [
+ "The prices of the stocks of companies listed under a global exchange are influenced by a variety of factors, with the company's financial performance, innovations and collaborations, and market sentiment being factors that play a significant role. News and media reports can rapidly affect investor perceptions and, consequently, stock prices in the highly competitive financial industry. With the sheer volume of news and opinions from a wide variety of sources, investors and financial analysts often struggle to stay updated and accurately interpret its impact on the market. As a result, investment firms need sophisticated tools to analyze market sentiment and integrate this information into their investment strategies."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "Vn6bbxSwVKl3",
+ "metadata": {
+ "id": "Vn6bbxSwVKl3"
+ },
+ "source": [
+ "### Problem Definition"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "jCIswL3zobj6",
+ "metadata": {
+ "id": "jCIswL3zobj6"
+ },
+ "source": [
+ "With an ever-rising number of news articles and opinions, an investment startup aims to leverage artificial intelligence to address the challenge of interpreting stock-related news and its impact on stock prices. They have collected historical daily news for a specific company listed under NASDAQ, along with data on its daily stock price and trade volumes.\n",
+ "\n",
+ "As a member of the Data Science and AI team in the startup, you have been tasked with developing an AI-driven sentiment analysis system that will automatically process and analyze news articles to gauge market sentiment, and summarizing the news at a weekly level to enhance the accuracy of their stock price predictions and optimize investment strategies. This will empower their financial analysts with actionable insights, leading to more informed investment decisions and improved client outcomes."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "ZJOtDHVSF5hu",
+ "metadata": {
+ "id": "ZJOtDHVSF5hu"
+ },
+ "source": [
+ "### Data Dictionary"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "ZlkjI8V5F9RK",
+ "metadata": {
+ "id": "ZlkjI8V5F9RK"
+ },
+ "source": [
+ "* `Date` : The date the news was released\n",
+ "* `News` : The content of news articles that could potentially affect the company's stock price\n",
+ "* `Open` : The stock price (in \\$) at the beginning of the day\n",
+ "* `High` : The highest stock price (in \\$) reached during the day\n",
+ "* `Low` : The lowest stock price (in \\$) reached during the day\n",
+ "* `Close` : The adjusted stock price (in \\$) at the end of the day\n",
+ "* `Volume` : The number of shares traded during the day\n",
+ "* `Label` : The sentiment polarity of the news content\n",
+ " * 1: positive\n",
+ " * 0: neutral\n",
+ " * -1: negative"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "VrFQHcW5mYgv",
+ "metadata": {
+ "id": "VrFQHcW5mYgv"
+ },
+ "source": [
+ "## **Installing and Importing the necessary libraries**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "A-E2-iaumpo8",
+ "metadata": {
+ "id": "A-E2-iaumpo8",
+ "collapsed": true,
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "5f12e599-de14-4e2b-adb4-de180cdd4fba"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "Requirement already satisfied: numpy==1.26.4 in /usr/local/lib/python3.12/dist-packages (1.26.4)\n",
+ "Requirement already satisfied: scikit-learn==1.6.1 in /usr/local/lib/python3.12/dist-packages (1.6.1)\n",
+ "Requirement already satisfied: scipy==1.13.1 in /usr/local/lib/python3.12/dist-packages (1.13.1)\n",
+ "Requirement already satisfied: gensim==4.3.3 in /usr/local/lib/python3.12/dist-packages (4.3.3)\n",
+ "Requirement already satisfied: sentence-transformers==3.4.1 in /usr/local/lib/python3.12/dist-packages (3.4.1)\n",
+ "Requirement already satisfied: pandas==2.2.2 in /usr/local/lib/python3.12/dist-packages (2.2.2)\n",
+ "Requirement already satisfied: joblib>=1.2.0 in /usr/local/lib/python3.12/dist-packages (from scikit-learn==1.6.1) (1.5.2)\n",
+ "Requirement already satisfied: threadpoolctl>=3.1.0 in /usr/local/lib/python3.12/dist-packages (from scikit-learn==1.6.1) (3.6.0)\n",
+ "Requirement already satisfied: smart-open>=1.8.1 in /usr/local/lib/python3.12/dist-packages (from gensim==4.3.3) (7.3.1)\n",
+ "Requirement already satisfied: transformers<5.0.0,>=4.41.0 in /usr/local/lib/python3.12/dist-packages (from sentence-transformers==3.4.1) (4.56.1)\n",
+ "Requirement already satisfied: tqdm in /usr/local/lib/python3.12/dist-packages (from sentence-transformers==3.4.1) (4.67.1)\n",
+ "Requirement already satisfied: torch>=1.11.0 in /usr/local/lib/python3.12/dist-packages (from sentence-transformers==3.4.1) (2.8.0+cu126)\n",
+ "Requirement already satisfied: huggingface-hub>=0.20.0 in /usr/local/lib/python3.12/dist-packages (from sentence-transformers==3.4.1) (0.35.0)\n",
+ "Requirement already satisfied: Pillow in /usr/local/lib/python3.12/dist-packages (from sentence-transformers==3.4.1) (11.3.0)\n",
+ "Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.12/dist-packages (from pandas==2.2.2) (2.9.0.post0)\n",
+ "Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.12/dist-packages (from pandas==2.2.2) (2025.2)\n",
+ "Requirement already satisfied: tzdata>=2022.7 in /usr/local/lib/python3.12/dist-packages (from pandas==2.2.2) (2025.2)\n",
+ "Requirement already satisfied: filelock in /usr/local/lib/python3.12/dist-packages (from huggingface-hub>=0.20.0->sentence-transformers==3.4.1) (3.19.1)\n",
+ "Requirement already satisfied: fsspec>=2023.5.0 in /usr/local/lib/python3.12/dist-packages (from huggingface-hub>=0.20.0->sentence-transformers==3.4.1) (2025.3.0)\n",
+ "Requirement already satisfied: packaging>=20.9 in /usr/local/lib/python3.12/dist-packages (from huggingface-hub>=0.20.0->sentence-transformers==3.4.1) (25.0)\n",
+ "Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.12/dist-packages (from huggingface-hub>=0.20.0->sentence-transformers==3.4.1) (6.0.2)\n",
+ "Requirement already satisfied: requests in /usr/local/lib/python3.12/dist-packages (from huggingface-hub>=0.20.0->sentence-transformers==3.4.1) (2.32.4)\n",
+ "Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.12/dist-packages (from huggingface-hub>=0.20.0->sentence-transformers==3.4.1) (4.15.0)\n",
+ "Requirement already satisfied: hf-xet<2.0.0,>=1.1.3 in /usr/local/lib/python3.12/dist-packages (from huggingface-hub>=0.20.0->sentence-transformers==3.4.1) (1.1.10)\n",
+ "Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.12/dist-packages (from python-dateutil>=2.8.2->pandas==2.2.2) (1.17.0)\n",
+ "Requirement already satisfied: wrapt in /usr/local/lib/python3.12/dist-packages (from smart-open>=1.8.1->gensim==4.3.3) (1.17.3)\n",
+ "Requirement already satisfied: setuptools in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (75.2.0)\n",
+ "Requirement already satisfied: sympy>=1.13.3 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (1.13.3)\n",
+ "Requirement already satisfied: networkx in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (3.5)\n",
+ "Requirement already satisfied: jinja2 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (3.1.6)\n",
+ "Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.6.77 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (12.6.77)\n",
+ "Requirement already satisfied: nvidia-cuda-runtime-cu12==12.6.77 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (12.6.77)\n",
+ "Requirement already satisfied: nvidia-cuda-cupti-cu12==12.6.80 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (12.6.80)\n",
+ "Requirement already satisfied: nvidia-cudnn-cu12==9.10.2.21 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (9.10.2.21)\n",
+ "Requirement already satisfied: nvidia-cublas-cu12==12.6.4.1 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (12.6.4.1)\n",
+ "Requirement already satisfied: nvidia-cufft-cu12==11.3.0.4 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (11.3.0.4)\n",
+ "Requirement already satisfied: nvidia-curand-cu12==10.3.7.77 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (10.3.7.77)\n",
+ "Requirement already satisfied: nvidia-cusolver-cu12==11.7.1.2 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (11.7.1.2)\n",
+ "Requirement already satisfied: nvidia-cusparse-cu12==12.5.4.2 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (12.5.4.2)\n",
+ "Requirement already satisfied: nvidia-cusparselt-cu12==0.7.1 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (0.7.1)\n",
+ "Requirement already satisfied: nvidia-nccl-cu12==2.27.3 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (2.27.3)\n",
+ "Requirement already satisfied: nvidia-nvtx-cu12==12.6.77 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (12.6.77)\n",
+ "Requirement already satisfied: nvidia-nvjitlink-cu12==12.6.85 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (12.6.85)\n",
+ "Requirement already satisfied: nvidia-cufile-cu12==1.11.1.6 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (1.11.1.6)\n",
+ "Requirement already satisfied: triton==3.4.0 in /usr/local/lib/python3.12/dist-packages (from torch>=1.11.0->sentence-transformers==3.4.1) (3.4.0)\n",
+ "Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.12/dist-packages (from transformers<5.0.0,>=4.41.0->sentence-transformers==3.4.1) (2024.11.6)\n",
+ "Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /usr/local/lib/python3.12/dist-packages (from transformers<5.0.0,>=4.41.0->sentence-transformers==3.4.1) (0.22.0)\n",
+ "Requirement already satisfied: safetensors>=0.4.3 in /usr/local/lib/python3.12/dist-packages (from transformers<5.0.0,>=4.41.0->sentence-transformers==3.4.1) (0.6.2)\n",
+ "Requirement already satisfied: mpmath<1.4,>=1.1.0 in /usr/local/lib/python3.12/dist-packages (from sympy>=1.13.3->torch>=1.11.0->sentence-transformers==3.4.1) (1.3.0)\n",
+ "Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.12/dist-packages (from jinja2->torch>=1.11.0->sentence-transformers==3.4.1) (3.0.2)\n",
+ "Requirement already satisfied: charset_normalizer<4,>=2 in /usr/local/lib/python3.12/dist-packages (from requests->huggingface-hub>=0.20.0->sentence-transformers==3.4.1) (3.4.3)\n",
+ "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.12/dist-packages (from requests->huggingface-hub>=0.20.0->sentence-transformers==3.4.1) (3.10)\n",
+ "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.12/dist-packages (from requests->huggingface-hub>=0.20.0->sentence-transformers==3.4.1) (2.5.0)\n",
+ "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.12/dist-packages (from requests->huggingface-hub>=0.20.0->sentence-transformers==3.4.1) (2025.8.3)\n"
+ ]
+ }
+ ],
+ "source": [
+ "# installing the sentence-transformers and gensim libraries for word embeddings\n",
+ "!pip install numpy==1.26.4 \\\n",
+ " scikit-learn==1.6.1 \\\n",
+ " scipy==1.13.1 \\\n",
+ " gensim==4.3.3 \\\n",
+ " sentence-transformers==3.4.1 \\\n",
+ " pandas==2.2.2"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "source": [
+ "Note:\n",
+ "- After running the above cell, kindly restart the runtime (for Google Colab) or notebook kernel (for Jupyter Notebook), and run all cells sequentially from the next cell.\n",
+ "- On executing the above line of code, you might see a warning regarding package dependencies. This error message can be ignored as the above code ensures that all necessary libraries and their dependencies are maintained to successfully execute the code in this notebook."
+ ],
+ "metadata": {
+ "id": "Su4_EiqL5aIZ"
+ },
+ "id": "Su4_EiqL5aIZ"
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "179a2a45",
+ "metadata": {
+ "id": "179a2a45"
+ },
+ "outputs": [],
+ "source": [
+ "# To manipulate and analyze data\n",
+ "import pandas as pd\n",
+ "import numpy as np\n",
+ "\n",
+ "# To visualize data\n",
+ "import matplotlib.pyplot as plt\n",
+ "import seaborn as sns\n",
+ "\n",
+ "# To used time-related functions\n",
+ "import time\n",
+ "\n",
+ "# To build, tune, and evaluate ML models\n",
+ "from sklearn.ensemble import RandomForestClassifier\n",
+ "from sklearn.metrics import confusion_matrix, accuracy_score, f1_score, precision_score, recall_score\n",
+ "\n",
+ "# To load/create word embeddings\n",
+ "from gensim.models import Word2Vec\n",
+ "\n",
+ "# To work with transformer models\n",
+ "import torch\n",
+ "from sentence_transformers import SentenceTransformer\n",
+ "\n",
+ "# Import TensorFlow and Keras for deep learning model building.\n",
+ "import tensorflow as tf\n",
+ "from tensorflow import keras\n",
+ "from tensorflow.keras.models import Sequential\n",
+ "from tensorflow.keras.layers import Dense, Dropout\n",
+ "\n",
+ "# To implement progress bar related functionalities\n",
+ "from tqdm import tqdm\n",
+ "tqdm.pandas()\n",
+ "\n",
+ "# To ignore unnecessary warnings\n",
+ "import warnings\n",
+ "warnings.filterwarnings('ignore')"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "wQ46zPgumfjF",
+ "metadata": {
+ "id": "wQ46zPgumfjF"
+ },
+ "source": [
+ "## **Loading the Dataset**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "yu_7XbWQWma8",
+ "metadata": {
+ "id": "yu_7XbWQWma8"
+ },
+ "outputs": [],
+ "source": [
+ "# # uncomment and run the following code if Google Colab is being used and the dataset is in Google Drive\n",
+ "# from google.colab import drive\n",
+ "# drive.mount('/content/drive')"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "62a33eef",
+ "metadata": {
+ "id": "62a33eef"
+ },
+ "outputs": [],
+ "source": [
+ "# Read the CSV file named 'stock_news' into a pandas DataFrame named 'stock'\n",
+ "stock_news = pd.read_csv(\"/content/02. Dataset - stock_news.csv\")"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "1xFSwCCer1uA",
+ "metadata": {
+ "id": "1xFSwCCer1uA"
+ },
+ "outputs": [],
+ "source": [
+ "#Creating a copy of the dataset\n",
+ "stock = stock_news.copy()"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "EvFNfrvGWthn",
+ "metadata": {
+ "id": "EvFNfrvGWthn"
+ },
+ "source": [
+ "## **Data Overview**"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "GW4rkWI1WzBb",
+ "metadata": {
+ "id": "GW4rkWI1WzBb"
+ },
+ "source": [
+ "#### **Displaying the first few rows of the dataset**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "dd2f105b",
+ "metadata": {
+ "id": "dd2f105b",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "4fce6c84-28cc-4aee-e18c-154c97c9e849"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ " Date News Open \\\n",
+ "0 01-02-2019 The dollar minutes ago tumbled to 106 67 from... 38.72 \n",
+ "1 01-02-2019 By Wayne Cole and Swati Pandey SYDNEY Reuters... 38.72 \n",
+ "2 01-02-2019 By Stephen Culp NEW YORK Reuters Wall Stre... 38.72 \n",
+ "3 01-02-2019 By Wayne Cole SYDNEY Reuters The Australia... 38.72 \n",
+ "4 01-02-2019 Investing com Asian equities fell in morning... 38.72 \n",
+ "\n",
+ " High Low Close Volume Label \n",
+ "0 39.71 38.56 39.48 130672400 1 \n",
+ "1 39.71 38.56 39.48 130672400 -1 \n",
+ "2 39.71 38.56 39.48 130672400 0 \n",
+ "3 39.71 38.56 39.48 130672400 -1 \n",
+ "4 39.71 38.56 39.48 130672400 1 "
+ ],
+ "text/html": [
+ "\n",
+ "
\n"
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "dataframe",
+ "variable_name": "stock",
+ "summary": "{\n \"name\": \"stock\",\n \"rows\": 418,\n \"fields\": [\n {\n \"column\": \"Date\",\n \"properties\": {\n \"dtype\": \"object\",\n \"num_unique_values\": 73,\n \"samples\": [\n \"01-08-2019\",\n \"04-15-2019\",\n \"01-30-2019\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"News\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 418,\n \"samples\": [\n \" Reuters Apple Inc NASDAQ AAPL is expected to unveil a new video streaming service and a news subscription platform at an event on Monday at its California headquarters The iPhone maker is banking on growing its services business to offset a dip in smartphone sales While the Wall Street Journal plans to join Apple s new subscription news service other major publishers including the New York Times and the Washington Post have declined according to a New York Times report Apple has also partnered with Hollywood celebrities to make a streaming debut with a slate of original content taking a page out of Netflix NASDAQ NFLX Inc s playbook Below are some of the shows curated from media reports and Apple s own announcements which are part of the iPhone maker s content library SHOWS CONFIRMED BY APPLE UNTITLED DRAMA SERIES WITH REESE WITHERSPOON AND JENNIFER ANISTON Two seasons of a drama series starring Reese Witherspoon and Jennifer Aniston that looks at the lives of people working on a morning television show REVIVAL OF STEVEN SPIELBERG S 1985 AMAZING STORIES The tech giant has also struck a deal with director Steven Spielberg to make new episodes of Amazing Stories a science fiction and horror anthology series that ran on NBC in the 1980s A NEW THRILLER BY M NIGHT SHYAMALAN Plot of the story has not been disclosed ARE YOU SLEEPING A MYSTERY SERIES A drama featuring Octavia Spencer based on a crime novel by Kathleen Barber AN ANTHOLOGY SERIES CALLED LITTLE AMERICA Focuses on stories of immigrants coming to the United States AN ANIMATED CARTOON MUSICAL CALLED CENTRAL PARK The animated musical comedy is about a family of caretakers who end up saving the park and the world DICKINSON AN EMILY DICKINSON COMEDY A half hour comedy series that is set during American poet Emily Dickinson s era with a modern sensibility and tone OPRAH WINFREY PARTNERSHIP Apple in June last year announced a multi year deal with Oprah Winfrey to create original programming SHOWS REPORTED BY MEDIA TIME BANDITS A FANTASY SERIES The potential series is an adaptation of Terry Gilliam s 1981 fantasy film of the same name about a young boy who joins a group of renegade time traveling dwarves Deadline reported https UNTITLED CAPTAIN MARVEL STAR BRIE LARSON S CIA PROJECT The new series looks at a young woman s journey in the CIA reported Variety https DEFENDING JACOB STARRING CAPTAIN AMERICA CHRIS EVANS This limited series is based on the novel of the same name and is about an assistant district attorney who is investigating the murder of a 14 year old boy according to Deadline https FOR ALL MANKIND A SCI FI SERIES A space drama from producer Ronald Moore according to Deadline https MY GLORY WAS I HAD SUCH FRIENDS A series featuring Jennifer Garner is based on the 2017 memoir of the same name by Amy Silverstein reported Variety https SEE A FANTASY EPIC STARRING JASON MOMOA The show poses the question about the fate of humanity if everyone lost their sight Variety reported https FOUNDATION A SCI FI ADAPTATION An adaptation of the iconic novel series from famed sci fi author Isaac Asimov Deadline reported The book series follows a mathematician who predicts the collapse of humanity A COMEDY SHOW BY ROB MCELHENNEY AND CHARLIE DAY The sitcom comedy based on the lives of a diverse group of people who work together in a video game development studio Variety reported https AN UNSCRIPTED SERIES HOME FROM THE DOCUMENTARY FILMMAKER MATT TYRNAUER The series will offer viewers a never before seen look inside the world s most extraordinary homes and feature interviews with people who built them according to Variety https UNTITLED RICHARD GERE SERIES Based on an Israeli series Nevelot the show is about two elderly Vietnam vets whose lives are changed when a woman they both love is killed in a car accident Deadline reported J J ABRAMS PRODUCED LITTLE VOICE Singer and actress Sara Bareilles is writing the music and could possibly star in the J J Abrams produced half hour show which explores the journey of finding one s authentic voice in early 20s according to Variety THE PEANUTS GANG Apple has acquired the rights to the famous characters and the first series will be a science and math oriented short featuring Snoopy as an astronaut according to Hollywood Reporter ON THE ROCKS A feature film directed by Sofia Coppola starring Bill Murray is about a young mother who reconnects with her larger than life playboy father on an adventure through New York Variety reported https LOSING EARTH Apple has acquired the rights to a TV series based on Nathaniel Rich s 70 page New York Times Magazine story Losing Earth New York Times reported THE ELEPHANT QUEEN Apple has acquired the rights to Victoria Stone and Mark Deeble s documentary The Elephant Queen Deadline reported WOLFWALKERS An Irish animation about a young hunter who comes to Ireland with her father to destroy a pack of evil wolves but instead befriends a wild native girl who runs with them first reported by Bloomberg PACHINKO Apple has secured the rights to develop Min Jin Lee s best selling novel about four generations of a Korean immigrant family into a series reported Variety CALLS Apple has bought the rights to make an English language version of the French original short form series according to Variety SHANTARAM Apple has won the rights to develop the hit novel Shantaram as a drama series reported Variety https SWAGGER A DRAMA SERIES BASED ON KEVIN DURANT A drama series based on the early life and career of NBA superstar Kevin Durant according to Variety https YOU THINK IT I LL SAY IT Apple has ordered a 10 episode half hour run of the comedy show which is an adaptation of Curtis Sittenfeld s short story collection by the same name Variety reported https WHIPLASH DIRECTOR DAMIEN CHAZELLE DRAMA SERIES According to Variety Apple has ordered a whole season of a series without first shooting a pilot but no other details are known about the show \\n Apple may offer cut priced bundles with video offering The Information reported on Thursday \",\n \"Investing com Stocks in focus in premarket trade Monday \\n Viacom NASDAQ VIAB jumped 4 2 by 8 04 AM ET 12 04 GMT as the company announced that it had renewed its contract with AT T NYSE T avoiding a blackout of MTV Nickelodeon and Comedy Central for DirecTV users \\n Nike NYSE NKE fell 0 3 after European Union antitrust regulators fined the company 12 5 million euros 14 14 million for restricting cross border sales of merchandising products \\n Apple NASDAQ AAPL dropped 0 3 while markets geared up for a company presentation that is expected to lift the curtain on Monday on a secretive years long effort to build a video streaming prodduct \\n Boeing NYSE BA gained 0 4 as the company preps to brief more than 200 global airline pilots technical leaders and regulators on Wednesday over software and training updates for its 737 MAX aircraft \\n CalAmp NASDAQ CAMP fell 2 4 after JP Morgan downgraded it to neutral from overweight according to Briefing com \\n Winnebago Industries NYSE WGO stock declined 0 9 after the company s fiscal second quarter revenue was lower than expected although earnings per share beat expectations\\n Thermo Fisher Scientific NYSE TMO stock could see movement in the regular session after the company announced that it would acquire Brammer Bio for approximately 1 7 billion in cash \\n Biogen NASDAQ BIIB bounced 1 5 after announcing a new 5 billion buyback The stock had fallen by nearly one third last week after saying it had halted the development of a drug it had been developing to treat Alzheimer s \",\n \"By Yimou Lee TAIPEI Reuters Terry Gou chairman of Apple NASDAQ AAPL supplier Foxconn said on Wednesday he will contest Taiwan s 2020 presidential election shaking up the political landscape at a time of heightened tension between the self ruled island and Beijing Gou Taiwan s richest person with a net worth of 7 6 billion according to Forbes said he would join the already competitive race and take part in the opposition China friendly Kuomintang KMT primaries His decision capped a flurry of news this week that began when Gou told Reuters on Monday he planned to step down from the world s largest contract manufacturer to pave the way for younger talent to move up the company s ranks He announced on Tuesday he was considering a presidential bid and hinted he was close to a decision when he told more than 100 people packed into a temple he would follow the instruction of a sea goddess who had told him to run in the presidential race Peace stability and Taiwan s economy future are my core values Gou said later at the KMT s headquarters in Taipei He urged the party to rediscover the spirit of the KMT the honor of KMT members and the KMT s lost support of the youth Gou s bid which requires KMT approval comes at a delicate time for cross strait relations and delivers a blow to the ruling pro independence Democratic Progressive NYSE PGR Party which is struggling in opinion polls China Taiwan relations have deteriorated since the island s president Tsai Ing wen of the independence leaning DPP swept to power in 2016 China suspects Tsai is pushing for the island s formal independence That is a red line for China which has never renounced the use of force to bring Taiwan under its control Tsai says she wants to maintain the status quo with China but will defend Taiwan s security and democracy VERY PRO CHINA A senior adviser to Tsai told Reuters he thought Gou s bid could create problems given his extensive business ties with China This is problematic to Taiwan s national security the adviser Yao Chia wen said He s very pro China and he represents the class of the wealthy people Will that gain support from Taiwanese Yao said adding he believed Gou would face a tough battle in the KMT primary Tension between Taipei and Beijing escalated again on Monday as Chinese bombers and warships conducted drills around the island prompting Taiwan to scramble jets and ships to monitor the Chinese forces The KMT which once ruled China before fleeing to Taiwan at the end of a civil war with the Communists in 1949 said in February it could sign a peace treaty with Beijing if it won the hotly contested presidential election Zhang Baohui a regional security analyst at Hong Kong s Lingnan University said Gou s run could mark the start of the most unusual election race in Taiwan history This is something entirely fresh for Taiwan politics here is a candidate who sees everything through the pragmatic angle of a businessman rather than raw politics or ideology Zhang told Reuters He has no baggage and that will be a fascinating scenario Gou s news comes as Tsai is grappling with a series of unpopular domestic reform initiatives from a pension scheme to labour law which have come under intense voter scrutiny The KMT said this week Gou had been a party member for more than 50 years and had given it an interest free loan of T 45 million 1 5 million in 2016 under the name of his mother which had signalled his loyalty to the party Foxconn said on Tuesday Gou would remain chairman of Foxconn though he planned to withdraw from daily operations \"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"Open\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 4.947134201503234,\n \"min\": 35.99,\n \"max\": 51.84,\n \"num_unique_values\": 69,\n \"samples\": [\n 43.22,\n 38.72,\n 48.83\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"High\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 4.947413441172774,\n \"min\": 36.43,\n \"max\": 52.12,\n \"num_unique_values\": 67,\n \"samples\": [\n 43.87,\n 39.08,\n 37.96\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"Low\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 4.967879507972434,\n \"min\": 35.5,\n \"max\": 51.76,\n \"num_unique_values\": 66,\n \"samples\": [\n 49.54,\n 50.97,\n 38.56\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"Close\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 4.999867403609388,\n \"min\": 35.55,\n \"max\": 51.87,\n \"num_unique_values\": 68,\n \"samples\": [\n 48.77,\n 39.08,\n 37.69\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"Volume\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 45745495,\n \"min\": 45448000,\n \"max\": 365248800,\n \"num_unique_values\": 73,\n \"samples\": [\n 216071600,\n 70146400,\n 244439200\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"Label\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 0,\n \"min\": -1,\n \"max\": 1,\n \"num_unique_values\": 3,\n \"samples\": [\n 1,\n -1,\n 0\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n }\n ]\n}"
+ }
+ },
+ "metadata": {},
+ "execution_count": 4
+ }
+ ],
+ "source": [
+ "stock.head(5)"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "y2ewB36LL9Cz",
+ "metadata": {
+ "id": "y2ewB36LL9Cz"
+ },
+ "source": [
+ "#### **Understanding the shape of the dataset**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "wWx6wqN0MTPw",
+ "metadata": {
+ "id": "wWx6wqN0MTPw",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "edd77532-57d5-4ab5-ebc3-b8a4fa737b0a"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ "(418, 8)"
+ ]
+ },
+ "metadata": {},
+ "execution_count": 5
+ }
+ ],
+ "source": [
+ "stock.shape"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "yQjb8QOTivg3",
+ "metadata": {
+ "id": "yQjb8QOTivg3"
+ },
+ "source": [
+ "**Observations:**\n",
+ "* There are a total of 418 records with 8 attributes each."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "fPLJXhFcMA7N",
+ "metadata": {
+ "id": "fPLJXhFcMA7N"
+ },
+ "source": [
+ "#### **Checking the data types of the columns**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "Gc_eAiMdMVe2",
+ "metadata": {
+ "id": "Gc_eAiMdMVe2",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "8c61445b-ef88-4a92-b810-0e15bb3000f5"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "\n",
+ "RangeIndex: 418 entries, 0 to 417\n",
+ "Data columns (total 8 columns):\n",
+ " # Column Non-Null Count Dtype \n",
+ "--- ------ -------------- ----- \n",
+ " 0 Date 418 non-null object \n",
+ " 1 News 418 non-null object \n",
+ " 2 Open 418 non-null float64\n",
+ " 3 High 418 non-null float64\n",
+ " 4 Low 418 non-null float64\n",
+ " 5 Close 418 non-null float64\n",
+ " 6 Volume 418 non-null int64 \n",
+ " 7 Label 418 non-null int64 \n",
+ "dtypes: float64(4), int64(2), object(2)\n",
+ "memory usage: 26.3+ KB\n"
+ ]
+ }
+ ],
+ "source": [
+ "stock.info()"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "i1CgPxT5mxEf",
+ "metadata": {
+ "id": "i1CgPxT5mxEf"
+ },
+ "source": [
+ "Let's convert the Date column to pandas `datetime` type."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "ZD5fstuv6ery",
+ "metadata": {
+ "id": "ZD5fstuv6ery"
+ },
+ "outputs": [],
+ "source": [
+ "# Convert the 'Date' column in the 'stocks' DataFrame to datetime format\n",
+ "stock['Date'] = pd.to_datetime(stock['Date'])"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "8dORemydMDfR",
+ "metadata": {
+ "id": "8dORemydMDfR"
+ },
+ "source": [
+ "#### **Checking the statistical summary**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "gUazWjegMeQl",
+ "metadata": {
+ "id": "gUazWjegMeQl",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "cd88b728-318a-4f67-d74e-71373400a55b"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ " Date Open High Low \\\n",
+ "count 418 418.000000 418.000000 418.000000 \n",
+ "mean 2019-02-14 12:24:06.889952256 42.308852 42.787321 41.923732 \n",
+ "min 2019-01-02 00:00:00 35.990000 36.430000 35.500000 \n",
+ "25% 2019-01-11 00:00:00 38.130000 38.420000 37.720000 \n",
+ "50% 2019-01-31 00:00:00 41.530000 42.250000 41.140000 \n",
+ "75% 2019-03-21 00:00:00 47.190000 47.427500 46.480000 \n",
+ "max 2019-04-29 00:00:00 51.840000 52.120000 51.760000 \n",
+ "std NaN 4.947134 4.947413 4.967880 \n",
+ "\n",
+ " Close Volume Label \n",
+ "count 418.000000 4.180000e+02 418.000000 \n",
+ "mean 42.418517 1.294225e+08 0.308612 \n",
+ "min 35.550000 4.544800e+07 -1.000000 \n",
+ "25% 38.270000 1.029072e+08 -1.000000 \n",
+ "50% 41.610000 1.156272e+08 1.000000 \n",
+ "75% 47.032500 1.511252e+08 1.000000 \n",
+ "max 51.870000 3.652488e+08 1.000000 \n",
+ "std 4.999867 4.574550e+07 0.943473 "
+ ],
+ "text/html": [
+ "\n",
+ "
\n"
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "dataframe",
+ "variable_name": "stock",
+ "summary": "{\n \"name\": \"stock\",\n \"rows\": 418,\n \"fields\": [\n {\n \"column\": \"Date\",\n \"properties\": {\n \"dtype\": \"object\",\n \"num_unique_values\": 73,\n \"samples\": [\n \"01-08-2019\",\n \"04-15-2019\",\n \"01-30-2019\"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"News\",\n \"properties\": {\n \"dtype\": \"string\",\n \"num_unique_values\": 418,\n \"samples\": [\n \" Reuters Apple Inc NASDAQ AAPL is expected to unveil a new video streaming service and a news subscription platform at an event on Monday at its California headquarters The iPhone maker is banking on growing its services business to offset a dip in smartphone sales While the Wall Street Journal plans to join Apple s new subscription news service other major publishers including the New York Times and the Washington Post have declined according to a New York Times report Apple has also partnered with Hollywood celebrities to make a streaming debut with a slate of original content taking a page out of Netflix NASDAQ NFLX Inc s playbook Below are some of the shows curated from media reports and Apple s own announcements which are part of the iPhone maker s content library SHOWS CONFIRMED BY APPLE UNTITLED DRAMA SERIES WITH REESE WITHERSPOON AND JENNIFER ANISTON Two seasons of a drama series starring Reese Witherspoon and Jennifer Aniston that looks at the lives of people working on a morning television show REVIVAL OF STEVEN SPIELBERG S 1985 AMAZING STORIES The tech giant has also struck a deal with director Steven Spielberg to make new episodes of Amazing Stories a science fiction and horror anthology series that ran on NBC in the 1980s A NEW THRILLER BY M NIGHT SHYAMALAN Plot of the story has not been disclosed ARE YOU SLEEPING A MYSTERY SERIES A drama featuring Octavia Spencer based on a crime novel by Kathleen Barber AN ANTHOLOGY SERIES CALLED LITTLE AMERICA Focuses on stories of immigrants coming to the United States AN ANIMATED CARTOON MUSICAL CALLED CENTRAL PARK The animated musical comedy is about a family of caretakers who end up saving the park and the world DICKINSON AN EMILY DICKINSON COMEDY A half hour comedy series that is set during American poet Emily Dickinson s era with a modern sensibility and tone OPRAH WINFREY PARTNERSHIP Apple in June last year announced a multi year deal with Oprah Winfrey to create original programming SHOWS REPORTED BY MEDIA TIME BANDITS A FANTASY SERIES The potential series is an adaptation of Terry Gilliam s 1981 fantasy film of the same name about a young boy who joins a group of renegade time traveling dwarves Deadline reported https UNTITLED CAPTAIN MARVEL STAR BRIE LARSON S CIA PROJECT The new series looks at a young woman s journey in the CIA reported Variety https DEFENDING JACOB STARRING CAPTAIN AMERICA CHRIS EVANS This limited series is based on the novel of the same name and is about an assistant district attorney who is investigating the murder of a 14 year old boy according to Deadline https FOR ALL MANKIND A SCI FI SERIES A space drama from producer Ronald Moore according to Deadline https MY GLORY WAS I HAD SUCH FRIENDS A series featuring Jennifer Garner is based on the 2017 memoir of the same name by Amy Silverstein reported Variety https SEE A FANTASY EPIC STARRING JASON MOMOA The show poses the question about the fate of humanity if everyone lost their sight Variety reported https FOUNDATION A SCI FI ADAPTATION An adaptation of the iconic novel series from famed sci fi author Isaac Asimov Deadline reported The book series follows a mathematician who predicts the collapse of humanity A COMEDY SHOW BY ROB MCELHENNEY AND CHARLIE DAY The sitcom comedy based on the lives of a diverse group of people who work together in a video game development studio Variety reported https AN UNSCRIPTED SERIES HOME FROM THE DOCUMENTARY FILMMAKER MATT TYRNAUER The series will offer viewers a never before seen look inside the world s most extraordinary homes and feature interviews with people who built them according to Variety https UNTITLED RICHARD GERE SERIES Based on an Israeli series Nevelot the show is about two elderly Vietnam vets whose lives are changed when a woman they both love is killed in a car accident Deadline reported J J ABRAMS PRODUCED LITTLE VOICE Singer and actress Sara Bareilles is writing the music and could possibly star in the J J Abrams produced half hour show which explores the journey of finding one s authentic voice in early 20s according to Variety THE PEANUTS GANG Apple has acquired the rights to the famous characters and the first series will be a science and math oriented short featuring Snoopy as an astronaut according to Hollywood Reporter ON THE ROCKS A feature film directed by Sofia Coppola starring Bill Murray is about a young mother who reconnects with her larger than life playboy father on an adventure through New York Variety reported https LOSING EARTH Apple has acquired the rights to a TV series based on Nathaniel Rich s 70 page New York Times Magazine story Losing Earth New York Times reported THE ELEPHANT QUEEN Apple has acquired the rights to Victoria Stone and Mark Deeble s documentary The Elephant Queen Deadline reported WOLFWALKERS An Irish animation about a young hunter who comes to Ireland with her father to destroy a pack of evil wolves but instead befriends a wild native girl who runs with them first reported by Bloomberg PACHINKO Apple has secured the rights to develop Min Jin Lee s best selling novel about four generations of a Korean immigrant family into a series reported Variety CALLS Apple has bought the rights to make an English language version of the French original short form series according to Variety SHANTARAM Apple has won the rights to develop the hit novel Shantaram as a drama series reported Variety https SWAGGER A DRAMA SERIES BASED ON KEVIN DURANT A drama series based on the early life and career of NBA superstar Kevin Durant according to Variety https YOU THINK IT I LL SAY IT Apple has ordered a 10 episode half hour run of the comedy show which is an adaptation of Curtis Sittenfeld s short story collection by the same name Variety reported https WHIPLASH DIRECTOR DAMIEN CHAZELLE DRAMA SERIES According to Variety Apple has ordered a whole season of a series without first shooting a pilot but no other details are known about the show \\n Apple may offer cut priced bundles with video offering The Information reported on Thursday \",\n \"Investing com Stocks in focus in premarket trade Monday \\n Viacom NASDAQ VIAB jumped 4 2 by 8 04 AM ET 12 04 GMT as the company announced that it had renewed its contract with AT T NYSE T avoiding a blackout of MTV Nickelodeon and Comedy Central for DirecTV users \\n Nike NYSE NKE fell 0 3 after European Union antitrust regulators fined the company 12 5 million euros 14 14 million for restricting cross border sales of merchandising products \\n Apple NASDAQ AAPL dropped 0 3 while markets geared up for a company presentation that is expected to lift the curtain on Monday on a secretive years long effort to build a video streaming prodduct \\n Boeing NYSE BA gained 0 4 as the company preps to brief more than 200 global airline pilots technical leaders and regulators on Wednesday over software and training updates for its 737 MAX aircraft \\n CalAmp NASDAQ CAMP fell 2 4 after JP Morgan downgraded it to neutral from overweight according to Briefing com \\n Winnebago Industries NYSE WGO stock declined 0 9 after the company s fiscal second quarter revenue was lower than expected although earnings per share beat expectations\\n Thermo Fisher Scientific NYSE TMO stock could see movement in the regular session after the company announced that it would acquire Brammer Bio for approximately 1 7 billion in cash \\n Biogen NASDAQ BIIB bounced 1 5 after announcing a new 5 billion buyback The stock had fallen by nearly one third last week after saying it had halted the development of a drug it had been developing to treat Alzheimer s \",\n \"By Yimou Lee TAIPEI Reuters Terry Gou chairman of Apple NASDAQ AAPL supplier Foxconn said on Wednesday he will contest Taiwan s 2020 presidential election shaking up the political landscape at a time of heightened tension between the self ruled island and Beijing Gou Taiwan s richest person with a net worth of 7 6 billion according to Forbes said he would join the already competitive race and take part in the opposition China friendly Kuomintang KMT primaries His decision capped a flurry of news this week that began when Gou told Reuters on Monday he planned to step down from the world s largest contract manufacturer to pave the way for younger talent to move up the company s ranks He announced on Tuesday he was considering a presidential bid and hinted he was close to a decision when he told more than 100 people packed into a temple he would follow the instruction of a sea goddess who had told him to run in the presidential race Peace stability and Taiwan s economy future are my core values Gou said later at the KMT s headquarters in Taipei He urged the party to rediscover the spirit of the KMT the honor of KMT members and the KMT s lost support of the youth Gou s bid which requires KMT approval comes at a delicate time for cross strait relations and delivers a blow to the ruling pro independence Democratic Progressive NYSE PGR Party which is struggling in opinion polls China Taiwan relations have deteriorated since the island s president Tsai Ing wen of the independence leaning DPP swept to power in 2016 China suspects Tsai is pushing for the island s formal independence That is a red line for China which has never renounced the use of force to bring Taiwan under its control Tsai says she wants to maintain the status quo with China but will defend Taiwan s security and democracy VERY PRO CHINA A senior adviser to Tsai told Reuters he thought Gou s bid could create problems given his extensive business ties with China This is problematic to Taiwan s national security the adviser Yao Chia wen said He s very pro China and he represents the class of the wealthy people Will that gain support from Taiwanese Yao said adding he believed Gou would face a tough battle in the KMT primary Tension between Taipei and Beijing escalated again on Monday as Chinese bombers and warships conducted drills around the island prompting Taiwan to scramble jets and ships to monitor the Chinese forces The KMT which once ruled China before fleeing to Taiwan at the end of a civil war with the Communists in 1949 said in February it could sign a peace treaty with Beijing if it won the hotly contested presidential election Zhang Baohui a regional security analyst at Hong Kong s Lingnan University said Gou s run could mark the start of the most unusual election race in Taiwan history This is something entirely fresh for Taiwan politics here is a candidate who sees everything through the pragmatic angle of a businessman rather than raw politics or ideology Zhang told Reuters He has no baggage and that will be a fascinating scenario Gou s news comes as Tsai is grappling with a series of unpopular domestic reform initiatives from a pension scheme to labour law which have come under intense voter scrutiny The KMT said this week Gou had been a party member for more than 50 years and had given it an interest free loan of T 45 million 1 5 million in 2016 under the name of his mother which had signalled his loyalty to the party Foxconn said on Tuesday Gou would remain chairman of Foxconn though he planned to withdraw from daily operations \"\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"Open\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 4.947134201503234,\n \"min\": 35.99,\n \"max\": 51.84,\n \"num_unique_values\": 69,\n \"samples\": [\n 43.22,\n 38.72,\n 48.83\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"High\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 4.947413441172774,\n \"min\": 36.43,\n \"max\": 52.12,\n \"num_unique_values\": 67,\n \"samples\": [\n 43.87,\n 39.08,\n 37.96\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"Low\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 4.967879507972434,\n \"min\": 35.5,\n \"max\": 51.76,\n \"num_unique_values\": 66,\n \"samples\": [\n 49.54,\n 50.97,\n 38.56\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"Close\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 4.999867403609388,\n \"min\": 35.55,\n \"max\": 51.87,\n \"num_unique_values\": 68,\n \"samples\": [\n 48.77,\n 39.08,\n 37.69\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"Volume\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 45745495,\n \"min\": 45448000,\n \"max\": 365248800,\n \"num_unique_values\": 73,\n \"samples\": [\n 216071600,\n 70146400,\n 244439200\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"Label\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 0,\n \"min\": -1,\n \"max\": 1,\n \"num_unique_values\": 3,\n \"samples\": [\n 1,\n -1,\n 0\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n }\n ]\n}"
+ }
+ },
+ "metadata": {},
+ "execution_count": 4
+ }
+ ],
+ "source": [
+ "stock.head(5)"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "y2ewB36LL9Cz",
+ "metadata": {
+ "id": "y2ewB36LL9Cz"
+ },
+ "source": [
+ "#### **Understanding the shape of the dataset**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "wWx6wqN0MTPw",
+ "metadata": {
+ "id": "wWx6wqN0MTPw",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "edd77532-57d5-4ab5-ebc3-b8a4fa737b0a"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ "(418, 8)"
+ ]
+ },
+ "metadata": {},
+ "execution_count": 5
+ }
+ ],
+ "source": [
+ "stock.shape"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "yQjb8QOTivg3",
+ "metadata": {
+ "id": "yQjb8QOTivg3"
+ },
+ "source": [
+ "**Observations:**\n",
+ "* There are a total of 418 records with 8 attributes each."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "fPLJXhFcMA7N",
+ "metadata": {
+ "id": "fPLJXhFcMA7N"
+ },
+ "source": [
+ "#### **Checking the data types of the columns**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "Gc_eAiMdMVe2",
+ "metadata": {
+ "id": "Gc_eAiMdMVe2",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "8c61445b-ef88-4a92-b810-0e15bb3000f5"
+ },
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "\n",
+ "RangeIndex: 418 entries, 0 to 417\n",
+ "Data columns (total 8 columns):\n",
+ " # Column Non-Null Count Dtype \n",
+ "--- ------ -------------- ----- \n",
+ " 0 Date 418 non-null object \n",
+ " 1 News 418 non-null object \n",
+ " 2 Open 418 non-null float64\n",
+ " 3 High 418 non-null float64\n",
+ " 4 Low 418 non-null float64\n",
+ " 5 Close 418 non-null float64\n",
+ " 6 Volume 418 non-null int64 \n",
+ " 7 Label 418 non-null int64 \n",
+ "dtypes: float64(4), int64(2), object(2)\n",
+ "memory usage: 26.3+ KB\n"
+ ]
+ }
+ ],
+ "source": [
+ "stock.info()"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "i1CgPxT5mxEf",
+ "metadata": {
+ "id": "i1CgPxT5mxEf"
+ },
+ "source": [
+ "Let's convert the Date column to pandas `datetime` type."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "ZD5fstuv6ery",
+ "metadata": {
+ "id": "ZD5fstuv6ery"
+ },
+ "outputs": [],
+ "source": [
+ "# Convert the 'Date' column in the 'stocks' DataFrame to datetime format\n",
+ "stock['Date'] = pd.to_datetime(stock['Date'])"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "8dORemydMDfR",
+ "metadata": {
+ "id": "8dORemydMDfR"
+ },
+ "source": [
+ "#### **Checking the statistical summary**"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "gUazWjegMeQl",
+ "metadata": {
+ "id": "gUazWjegMeQl",
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "outputId": "cd88b728-318a-4f67-d74e-71373400a55b"
+ },
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ " Date Open High Low \\\n",
+ "count 418 418.000000 418.000000 418.000000 \n",
+ "mean 2019-02-14 12:24:06.889952256 42.308852 42.787321 41.923732 \n",
+ "min 2019-01-02 00:00:00 35.990000 36.430000 35.500000 \n",
+ "25% 2019-01-11 00:00:00 38.130000 38.420000 37.720000 \n",
+ "50% 2019-01-31 00:00:00 41.530000 42.250000 41.140000 \n",
+ "75% 2019-03-21 00:00:00 47.190000 47.427500 46.480000 \n",
+ "max 2019-04-29 00:00:00 51.840000 52.120000 51.760000 \n",
+ "std NaN 4.947134 4.947413 4.967880 \n",
+ "\n",
+ " Close Volume Label \n",
+ "count 418.000000 4.180000e+02 418.000000 \n",
+ "mean 42.418517 1.294225e+08 0.308612 \n",
+ "min 35.550000 4.544800e+07 -1.000000 \n",
+ "25% 38.270000 1.029072e+08 -1.000000 \n",
+ "50% 41.610000 1.156272e+08 1.000000 \n",
+ "75% 47.032500 1.511252e+08 1.000000 \n",
+ "max 51.870000 3.652488e+08 1.000000 \n",
+ "std 4.999867 4.574550e+07 0.943473 "
+ ],
+ "text/html": [
+ "\n",
+ "
\n"
+ ],
+ "application/vnd.google.colaboratory.intrinsic+json": {
+ "type": "dataframe",
+ "variable_name": "models_test_comp_df",
+ "summary": "{\n \"name\": \"models_test_comp_df\",\n \"rows\": 4,\n \"fields\": [\n {\n \"column\": \"Word2Vec (Random Forest)\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 0.03619949158384784,\n \"min\": 0.6801140174379611,\n \"max\": 0.7464788732394366,\n \"num_unique_values\": 3,\n \"samples\": [\n 0.7464788732394366,\n 0.687933571578726,\n 0.6801140174379611\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"Word2Vec (Neural Network)\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 0.05661832323426673,\n \"min\": 0.6699110653078362,\n \"max\": 0.8046277665995976,\n \"num_unique_values\": 3,\n \"samples\": [\n 0.7605633802816901,\n 0.8046277665995976,\n 0.6699110653078362\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"Sentence Transformer (Random Forest)\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 0.08086640854457602,\n \"min\": 0.5517452541334966,\n \"max\": 0.7183098591549296,\n \"num_unique_values\": 3,\n \"samples\": [\n 0.7183098591549296,\n 0.5517452541334966,\n 0.6241052874624798\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n },\n {\n \"column\": \"Sentence Transformer (Neural Network)\",\n \"properties\": {\n \"dtype\": \"number\",\n \"std\": 0.0037559350807984376,\n \"min\": 0.7809076682316118,\n \"max\": 0.7887323943661971,\n \"num_unique_values\": 3,\n \"samples\": [\n 0.7887323943661971,\n 0.7809076682316118,\n 0.7847082494969819\n ],\n \"semantic_type\": \"\",\n \"description\": \"\"\n }\n }\n ]\n}"
+ }
+ },
+ "metadata": {},
+ "execution_count": 73
+ }
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "source": [
+ "#### **Model Performance Summary:**"
+ ],
+ "metadata": {
+ "id": "X0yz_T4j6uJc"
+ },
+ "id": "X0yz_T4j6uJc"
+ },
+ {
+ "cell_type": "markdown",
+ "source": [
+ " **Model Selection: Sentence Transformer + Neural Network**\n",
+ "\n",
+ "**Rationale:**\n",
+ "\n",
+ "1. **Best Generalization**:\n",
+ " The Sentence Transformer + Neural Network model achieves the highest F1 score on the test set (0.788), indicating strong generalization and better handling of both precision and recall on unseen data.\n",
+ "\n",
+ "2. **Balanced Performance**:\n",
+ " Training F1 = 0.87 and testing F1 = 0.78 show a minimal gap, meaning the model learned meaningful representations without significant overfitting.\n",
+ "\n",
+ "3. **Superior Feature Encoding**:\n",
+ " Sentence Transformers capture semantic meaning more effectively than Word2Vec, which explains the performance boost across both Random Forest and Neural Network setups.\n",
+ "\n",
+ "4. **Neural Network Suitability**:\n",
+ " While Word2Vec + NN struggles due to sparse and less informative vectors, combining powerful embeddings (Sentence Transformer) with flexible learning (NN) achieves the best synergy.\n",
+ "\n",
+ "##### **Why Other Models Were Not Chosen?**\n",
+ "\n",
+ "* **Word2Vec + RF**:\n",
+ " Training F1 = 0.730, Test F1 = 0.685. Although the gap is small (shows some stability), the absolute test performance is lower than Sentence Transformer + NN.\n",
+ "\n",
+ "* **Word2Vec + NN**:\n",
+ " Low performance in both training (F1 = 0.516) and testing (F1 = 0.67) indicates underfitting and ineffective learning due to weak input representations.\n",
+ "\n",
+ "* **Sentence Transformer + RF**:\n",
+ " Strong training F1 = 0.775, but test F1 = 0.624 is slightly lower than the NN version, suggesting mild overfitting and less flexibility in modeling complex patterns."
+ ],
+ "metadata": {
+ "id": "wI7woP0xHrwW"
+ },
+ "id": "wI7woP0xHrwW"
+ },
+ {
+ "cell_type": "markdown",
+ "id": "HiOLoD7BO3L-",
+ "metadata": {
+ "id": "HiOLoD7BO3L-"
+ },
+ "source": [
+ "## **Conclusions and Recommendations**"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "source": [
+ "* The daily opening, high, low, and closing prices of the stock exhibit similar distributions individually, when compared across different sentiment polarities, and negative sentiment news resulted in a lower value for each price.\n",
+ "\n",
+ "* The minimum variation also resulted in the prices exhibiting perfect correlation amongst them, while exhibiting a very low negative correlation with volume, which might be due to selling pressure during periods of negative sentiment.\n",
+ "\n",
+ "* The stock price gradually increased over time from ~40 to ~50 in the period for which the data is available while exhibiting a monthly trend.\n",
+ "\n",
+ "* We predicted the sentiment of market news by encoding them via different ML models.\n",
+ "\n",
+ "* The models largely overfit the data, with only **the Sentence Transformer + Neural Network model** yielding comparatively better performance than the others (train F1 = 0.876, test F1 = 0.788).\n",
+ "\n",
+ " * The predominance of neutral news also suggests a cautious market sentiment in this period. As such, a wider period should be considered for data collection to ensure volume and diversity in news sentiment polarities.\n",
+ "\n",
+ "* Integrating real-time sentiment analysis systems can allow financial analysts to make informed decisions and quickly respond to market sentiment changes to optimize investment strategies.\n",
+ "\n",
+ "* One can explore combining news sentiments with technical and fundamental indicators of the stock and introduce data of other similar stocks for a more comprehensive market analysis."
+ ],
+ "metadata": {
+ "id": "NMR7mKugPFme"
+ },
+ "id": "NMR7mKugPFme"
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "mQvaNDqQ3BJa"
+ },
+ "source": [
+ " Power Ahead \n",
+ "___"
+ ],
+ "id": "mQvaNDqQ3BJa"
+ }
+ ],
+ "metadata": {
+ "colab": {
+ "provenance": [],
+ "include_colab_link": true
+ },
+ "kernelspec": {
+ "display_name": "Python 3",
+ "name": "python3"
+ },
+ "language_info": {
+ "codemirror_mode": {
+ "name": "ipython",
+ "version": 3
+ },
+ "file_extension": ".py",
+ "mimetype": "text/x-python",
+ "name": "python",
+ "nbconvert_exporter": "python",
+ "pygments_lexer": "ipython3",
+ "version": "3.11.5"
+ },
+ "widgets": {
+ "application/vnd.jupyter.widget-state+json": {
+ "1230a037e0b9479caa9db62c5f9ecb6a": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "HBoxModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_dom_classes": [],
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "HBoxModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/controls",
+ "_view_module_version": "1.5.0",
+ "_view_name": "HBoxView",
+ "box_style": "",
+ "children": [
+ "IPY_MODEL_ed6c19298c4747a59992a79d99cdaaa7",
+ "IPY_MODEL_e010222da3cf4751995a51ffc82560ef",
+ "IPY_MODEL_9f3e3b616bcf482d9fd91a2b54d8d82a"
+ ],
+ "layout": "IPY_MODEL_6838e428d6d54a3f80d34638812441e6"
+ }
+ },
+ "ed6c19298c4747a59992a79d99cdaaa7": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "HTMLModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_dom_classes": [],
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "HTMLModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/controls",
+ "_view_module_version": "1.5.0",
+ "_view_name": "HTMLView",
+ "description": "",
+ "description_tooltip": null,
+ "layout": "IPY_MODEL_991c2589b56f444486443a31bef569d5",
+ "placeholder": "",
+ "style": "IPY_MODEL_4ed01d32996f47f38fbaba687cee45ae",
+ "value": "Batches: 100%"
+ }
+ },
+ "e010222da3cf4751995a51ffc82560ef": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "FloatProgressModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_dom_classes": [],
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "FloatProgressModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/controls",
+ "_view_module_version": "1.5.0",
+ "_view_name": "ProgressView",
+ "bar_style": "success",
+ "description": "",
+ "description_tooltip": null,
+ "layout": "IPY_MODEL_a0ce999dbcfe427ba08202bc989b1c33",
+ "max": 11,
+ "min": 0,
+ "orientation": "horizontal",
+ "style": "IPY_MODEL_f598184dc72f443ab0ada8de6cf076ad",
+ "value": 11
+ }
+ },
+ "9f3e3b616bcf482d9fd91a2b54d8d82a": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "HTMLModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_dom_classes": [],
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "HTMLModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/controls",
+ "_view_module_version": "1.5.0",
+ "_view_name": "HTMLView",
+ "description": "",
+ "description_tooltip": null,
+ "layout": "IPY_MODEL_96e9e320eec74a2e9094935af065b254",
+ "placeholder": "",
+ "style": "IPY_MODEL_fb854fb10f3e415c9c4c0ac176fb74b4",
+ "value": " 11/11 [00:44<00:00, 3.41s/it]"
+ }
+ },
+ "6838e428d6d54a3f80d34638812441e6": {
+ "model_module": "@jupyter-widgets/base",
+ "model_name": "LayoutModel",
+ "model_module_version": "1.2.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/base",
+ "_model_module_version": "1.2.0",
+ "_model_name": "LayoutModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "LayoutView",
+ "align_content": null,
+ "align_items": null,
+ "align_self": null,
+ "border": null,
+ "bottom": null,
+ "display": null,
+ "flex": null,
+ "flex_flow": null,
+ "grid_area": null,
+ "grid_auto_columns": null,
+ "grid_auto_flow": null,
+ "grid_auto_rows": null,
+ "grid_column": null,
+ "grid_gap": null,
+ "grid_row": null,
+ "grid_template_areas": null,
+ "grid_template_columns": null,
+ "grid_template_rows": null,
+ "height": null,
+ "justify_content": null,
+ "justify_items": null,
+ "left": null,
+ "margin": null,
+ "max_height": null,
+ "max_width": null,
+ "min_height": null,
+ "min_width": null,
+ "object_fit": null,
+ "object_position": null,
+ "order": null,
+ "overflow": null,
+ "overflow_x": null,
+ "overflow_y": null,
+ "padding": null,
+ "right": null,
+ "top": null,
+ "visibility": null,
+ "width": null
+ }
+ },
+ "991c2589b56f444486443a31bef569d5": {
+ "model_module": "@jupyter-widgets/base",
+ "model_name": "LayoutModel",
+ "model_module_version": "1.2.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/base",
+ "_model_module_version": "1.2.0",
+ "_model_name": "LayoutModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "LayoutView",
+ "align_content": null,
+ "align_items": null,
+ "align_self": null,
+ "border": null,
+ "bottom": null,
+ "display": null,
+ "flex": null,
+ "flex_flow": null,
+ "grid_area": null,
+ "grid_auto_columns": null,
+ "grid_auto_flow": null,
+ "grid_auto_rows": null,
+ "grid_column": null,
+ "grid_gap": null,
+ "grid_row": null,
+ "grid_template_areas": null,
+ "grid_template_columns": null,
+ "grid_template_rows": null,
+ "height": null,
+ "justify_content": null,
+ "justify_items": null,
+ "left": null,
+ "margin": null,
+ "max_height": null,
+ "max_width": null,
+ "min_height": null,
+ "min_width": null,
+ "object_fit": null,
+ "object_position": null,
+ "order": null,
+ "overflow": null,
+ "overflow_x": null,
+ "overflow_y": null,
+ "padding": null,
+ "right": null,
+ "top": null,
+ "visibility": null,
+ "width": null
+ }
+ },
+ "4ed01d32996f47f38fbaba687cee45ae": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "DescriptionStyleModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "DescriptionStyleModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "StyleView",
+ "description_width": ""
+ }
+ },
+ "a0ce999dbcfe427ba08202bc989b1c33": {
+ "model_module": "@jupyter-widgets/base",
+ "model_name": "LayoutModel",
+ "model_module_version": "1.2.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/base",
+ "_model_module_version": "1.2.0",
+ "_model_name": "LayoutModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "LayoutView",
+ "align_content": null,
+ "align_items": null,
+ "align_self": null,
+ "border": null,
+ "bottom": null,
+ "display": null,
+ "flex": null,
+ "flex_flow": null,
+ "grid_area": null,
+ "grid_auto_columns": null,
+ "grid_auto_flow": null,
+ "grid_auto_rows": null,
+ "grid_column": null,
+ "grid_gap": null,
+ "grid_row": null,
+ "grid_template_areas": null,
+ "grid_template_columns": null,
+ "grid_template_rows": null,
+ "height": null,
+ "justify_content": null,
+ "justify_items": null,
+ "left": null,
+ "margin": null,
+ "max_height": null,
+ "max_width": null,
+ "min_height": null,
+ "min_width": null,
+ "object_fit": null,
+ "object_position": null,
+ "order": null,
+ "overflow": null,
+ "overflow_x": null,
+ "overflow_y": null,
+ "padding": null,
+ "right": null,
+ "top": null,
+ "visibility": null,
+ "width": null
+ }
+ },
+ "f598184dc72f443ab0ada8de6cf076ad": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "ProgressStyleModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "ProgressStyleModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "StyleView",
+ "bar_color": null,
+ "description_width": ""
+ }
+ },
+ "96e9e320eec74a2e9094935af065b254": {
+ "model_module": "@jupyter-widgets/base",
+ "model_name": "LayoutModel",
+ "model_module_version": "1.2.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/base",
+ "_model_module_version": "1.2.0",
+ "_model_name": "LayoutModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "LayoutView",
+ "align_content": null,
+ "align_items": null,
+ "align_self": null,
+ "border": null,
+ "bottom": null,
+ "display": null,
+ "flex": null,
+ "flex_flow": null,
+ "grid_area": null,
+ "grid_auto_columns": null,
+ "grid_auto_flow": null,
+ "grid_auto_rows": null,
+ "grid_column": null,
+ "grid_gap": null,
+ "grid_row": null,
+ "grid_template_areas": null,
+ "grid_template_columns": null,
+ "grid_template_rows": null,
+ "height": null,
+ "justify_content": null,
+ "justify_items": null,
+ "left": null,
+ "margin": null,
+ "max_height": null,
+ "max_width": null,
+ "min_height": null,
+ "min_width": null,
+ "object_fit": null,
+ "object_position": null,
+ "order": null,
+ "overflow": null,
+ "overflow_x": null,
+ "overflow_y": null,
+ "padding": null,
+ "right": null,
+ "top": null,
+ "visibility": null,
+ "width": null
+ }
+ },
+ "fb854fb10f3e415c9c4c0ac176fb74b4": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "DescriptionStyleModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "DescriptionStyleModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "StyleView",
+ "description_width": ""
+ }
+ },
+ "2fb4071397a049f888159e2cbec3ec99": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "HBoxModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_dom_classes": [],
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "HBoxModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/controls",
+ "_view_module_version": "1.5.0",
+ "_view_name": "HBoxView",
+ "box_style": "",
+ "children": [
+ "IPY_MODEL_280899c6e305423a8d6f20dd395b4e10",
+ "IPY_MODEL_f68b5d3640c54560b38a29f32deb33a8",
+ "IPY_MODEL_115335a31d874aba99efb63fa2830e09"
+ ],
+ "layout": "IPY_MODEL_7b371d0574e04f98bf87a88f722b8477"
+ }
+ },
+ "280899c6e305423a8d6f20dd395b4e10": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "HTMLModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_dom_classes": [],
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "HTMLModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/controls",
+ "_view_module_version": "1.5.0",
+ "_view_name": "HTMLView",
+ "description": "",
+ "description_tooltip": null,
+ "layout": "IPY_MODEL_9095b2b09d4a45928fbc3cf45eb35cbb",
+ "placeholder": "",
+ "style": "IPY_MODEL_971a53d397494d76b8b5c4a2abb954f7",
+ "value": "Batches: 100%"
+ }
+ },
+ "f68b5d3640c54560b38a29f32deb33a8": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "FloatProgressModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_dom_classes": [],
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "FloatProgressModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/controls",
+ "_view_module_version": "1.5.0",
+ "_view_name": "ProgressView",
+ "bar_style": "success",
+ "description": "",
+ "description_tooltip": null,
+ "layout": "IPY_MODEL_54dd267783314434a5389477c97974e5",
+ "max": 3,
+ "min": 0,
+ "orientation": "horizontal",
+ "style": "IPY_MODEL_5bfd23c3586e4615909878610be8e24b",
+ "value": 3
+ }
+ },
+ "115335a31d874aba99efb63fa2830e09": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "HTMLModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_dom_classes": [],
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "HTMLModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/controls",
+ "_view_module_version": "1.5.0",
+ "_view_name": "HTMLView",
+ "description": "",
+ "description_tooltip": null,
+ "layout": "IPY_MODEL_4eda58c3e66e40db98ea40fc40ebb109",
+ "placeholder": "",
+ "style": "IPY_MODEL_99ee6edbe0574c778200ae65b87d7e0f",
+ "value": " 3/3 [00:09<00:00, 2.81s/it]"
+ }
+ },
+ "7b371d0574e04f98bf87a88f722b8477": {
+ "model_module": "@jupyter-widgets/base",
+ "model_name": "LayoutModel",
+ "model_module_version": "1.2.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/base",
+ "_model_module_version": "1.2.0",
+ "_model_name": "LayoutModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "LayoutView",
+ "align_content": null,
+ "align_items": null,
+ "align_self": null,
+ "border": null,
+ "bottom": null,
+ "display": null,
+ "flex": null,
+ "flex_flow": null,
+ "grid_area": null,
+ "grid_auto_columns": null,
+ "grid_auto_flow": null,
+ "grid_auto_rows": null,
+ "grid_column": null,
+ "grid_gap": null,
+ "grid_row": null,
+ "grid_template_areas": null,
+ "grid_template_columns": null,
+ "grid_template_rows": null,
+ "height": null,
+ "justify_content": null,
+ "justify_items": null,
+ "left": null,
+ "margin": null,
+ "max_height": null,
+ "max_width": null,
+ "min_height": null,
+ "min_width": null,
+ "object_fit": null,
+ "object_position": null,
+ "order": null,
+ "overflow": null,
+ "overflow_x": null,
+ "overflow_y": null,
+ "padding": null,
+ "right": null,
+ "top": null,
+ "visibility": null,
+ "width": null
+ }
+ },
+ "9095b2b09d4a45928fbc3cf45eb35cbb": {
+ "model_module": "@jupyter-widgets/base",
+ "model_name": "LayoutModel",
+ "model_module_version": "1.2.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/base",
+ "_model_module_version": "1.2.0",
+ "_model_name": "LayoutModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "LayoutView",
+ "align_content": null,
+ "align_items": null,
+ "align_self": null,
+ "border": null,
+ "bottom": null,
+ "display": null,
+ "flex": null,
+ "flex_flow": null,
+ "grid_area": null,
+ "grid_auto_columns": null,
+ "grid_auto_flow": null,
+ "grid_auto_rows": null,
+ "grid_column": null,
+ "grid_gap": null,
+ "grid_row": null,
+ "grid_template_areas": null,
+ "grid_template_columns": null,
+ "grid_template_rows": null,
+ "height": null,
+ "justify_content": null,
+ "justify_items": null,
+ "left": null,
+ "margin": null,
+ "max_height": null,
+ "max_width": null,
+ "min_height": null,
+ "min_width": null,
+ "object_fit": null,
+ "object_position": null,
+ "order": null,
+ "overflow": null,
+ "overflow_x": null,
+ "overflow_y": null,
+ "padding": null,
+ "right": null,
+ "top": null,
+ "visibility": null,
+ "width": null
+ }
+ },
+ "971a53d397494d76b8b5c4a2abb954f7": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "DescriptionStyleModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "DescriptionStyleModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "StyleView",
+ "description_width": ""
+ }
+ },
+ "54dd267783314434a5389477c97974e5": {
+ "model_module": "@jupyter-widgets/base",
+ "model_name": "LayoutModel",
+ "model_module_version": "1.2.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/base",
+ "_model_module_version": "1.2.0",
+ "_model_name": "LayoutModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "LayoutView",
+ "align_content": null,
+ "align_items": null,
+ "align_self": null,
+ "border": null,
+ "bottom": null,
+ "display": null,
+ "flex": null,
+ "flex_flow": null,
+ "grid_area": null,
+ "grid_auto_columns": null,
+ "grid_auto_flow": null,
+ "grid_auto_rows": null,
+ "grid_column": null,
+ "grid_gap": null,
+ "grid_row": null,
+ "grid_template_areas": null,
+ "grid_template_columns": null,
+ "grid_template_rows": null,
+ "height": null,
+ "justify_content": null,
+ "justify_items": null,
+ "left": null,
+ "margin": null,
+ "max_height": null,
+ "max_width": null,
+ "min_height": null,
+ "min_width": null,
+ "object_fit": null,
+ "object_position": null,
+ "order": null,
+ "overflow": null,
+ "overflow_x": null,
+ "overflow_y": null,
+ "padding": null,
+ "right": null,
+ "top": null,
+ "visibility": null,
+ "width": null
+ }
+ },
+ "5bfd23c3586e4615909878610be8e24b": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "ProgressStyleModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "ProgressStyleModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "StyleView",
+ "bar_color": null,
+ "description_width": ""
+ }
+ },
+ "4eda58c3e66e40db98ea40fc40ebb109": {
+ "model_module": "@jupyter-widgets/base",
+ "model_name": "LayoutModel",
+ "model_module_version": "1.2.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/base",
+ "_model_module_version": "1.2.0",
+ "_model_name": "LayoutModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "LayoutView",
+ "align_content": null,
+ "align_items": null,
+ "align_self": null,
+ "border": null,
+ "bottom": null,
+ "display": null,
+ "flex": null,
+ "flex_flow": null,
+ "grid_area": null,
+ "grid_auto_columns": null,
+ "grid_auto_flow": null,
+ "grid_auto_rows": null,
+ "grid_column": null,
+ "grid_gap": null,
+ "grid_row": null,
+ "grid_template_areas": null,
+ "grid_template_columns": null,
+ "grid_template_rows": null,
+ "height": null,
+ "justify_content": null,
+ "justify_items": null,
+ "left": null,
+ "margin": null,
+ "max_height": null,
+ "max_width": null,
+ "min_height": null,
+ "min_width": null,
+ "object_fit": null,
+ "object_position": null,
+ "order": null,
+ "overflow": null,
+ "overflow_x": null,
+ "overflow_y": null,
+ "padding": null,
+ "right": null,
+ "top": null,
+ "visibility": null,
+ "width": null
+ }
+ },
+ "99ee6edbe0574c778200ae65b87d7e0f": {
+ "model_module": "@jupyter-widgets/controls",
+ "model_name": "DescriptionStyleModel",
+ "model_module_version": "1.5.0",
+ "state": {
+ "_model_module": "@jupyter-widgets/controls",
+ "_model_module_version": "1.5.0",
+ "_model_name": "DescriptionStyleModel",
+ "_view_count": null,
+ "_view_module": "@jupyter-widgets/base",
+ "_view_module_version": "1.2.0",
+ "_view_name": "StyleView",
+ "description_width": ""
+ }
+ }
+ }
+ }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 5
+}
\ No newline at end of file
From c2bb62bc2815133aef7102b5316b0810bf735176 Mon Sep 17 00:00:00 2001
From: biplob <110578485+bks1984@users.noreply.github.com>
Date: Tue, 2 Dec 2025 11:23:34 +0530
Subject: [PATCH 4/4] Created using Colab
---
Copy_of_Logistic_Regression.ipynb | 726 ++++++++++++++++++++++++++++++
1 file changed, 726 insertions(+)
create mode 100644 Copy_of_Logistic_Regression.ipynb
diff --git a/Copy_of_Logistic_Regression.ipynb b/Copy_of_Logistic_Regression.ipynb
new file mode 100644
index 0000000..41ae87a
--- /dev/null
+++ b/Copy_of_Logistic_Regression.ipynb
@@ -0,0 +1,726 @@
+{
+ "nbformat": 4,
+ "nbformat_minor": 0,
+ "metadata": {
+ "colab": {
+ "provenance": [],
+ "include_colab_link": true
+ },
+ "kernelspec": {
+ "name": "python3",
+ "display_name": "Python 3"
+ },
+ "language_info": {
+ "name": "python"
+ }
+ },
+ "cells": [
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "view-in-github",
+ "colab_type": "text"
+ },
+ "source": [
+ ""
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "source": [
+ "# **What is Logistic Regression**\n",
+ "\n",
+ "As depicted in this ML algorithm chart, Logistic Regression is part of [**Supervised Machine Learning**](https://colab.research.google.com/drive/1WHMXFxU8DK-lgTgaHFZ2oLtkpFM25bDm?usp=sharing). Logistic Regression is used for **Classification** problem."
+ ],
+ "metadata": {
+ "id": "qC487XkXHW2R"
+ }
+ },
+ {
+ "cell_type": "markdown",
+ "source": [
+ ""
+ ],
+ "metadata": {
+ "id": "Abdg7AmMHXZJ"
+ }
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "DEkuSfNBY6g3"
+ },
+ "source": [
+ "In Linear Regression, we used to determine the value of a continuous dependent variable. **Logistic Regression** is generally used for **classification** purposes. Unlike Linear Regression, the dependent variable can take a limited number of values only i.e, the **dependent variable is categorical**.\n",
+ "\n",
+ "**Classification techniques** are an essential part of machine learning and data mining applications.\n",
+ "\n",
+ "**Approximately 70% of problems in Data Science are classification problems.**\n",
+ "\n",
+ "There are lots of classification problems that are available, but the **logistics regression is common and is a useful regression method for solving the binary classification problem**.\n",
+ "\n",
+ "\n",
+ "**Types of Logistic Regression:**\n",
+ "\n",
+ "\n",
+ "**Binary Logistic Regression**\n",
+ "When the number of possible outcomes is only two it is called Binary Logistic Regression.The target variable has only two possible outcomes such as Spam or Not Spam, Cancer or No Cancer.\n",
+ "\n",
+ "**Multinomial Logistic Regression**: The target variable has three or more nominal categories such as predicting the type of Wine.\n",
+ "Other example, **IRIS dataset** a very famous example of multi-class classification. Other examples are classifying article/blog/document category.\n",
+ "\n",
+ "**Ordinal Logistic Regression:** the target variable has three or more ordinal categories such as restaurant or product rating from 1 to 5.\n",
+ "\n",
+ "\n",
+ "Logistic Regression is one of the most simple and commonly used Machine Learning algorithms for **two-class classification**. It is easy to implement and can be used as the baseline for any binary classification problem.\n",
+ "\n",
+ "Famous examples :\n",
+ "\n",
+ "**spam detection**.\n",
+ "\n",
+ "**Diabetes prediction**,\n",
+ "\n",
+ "**Churn prediction** etc\n",
+ "\n",
+ "Its basic fundamental concepts are also constructive in deep learning. Logistic regression describes and estimates the relationship between one dependent binary variable and independent variables.\n",
+ "\n",
+ "\n",
+ "Let’s look at how logistic regression can be used for classification tasks.\n",
+ "In Linear Regression, the output is the weighted sum of inputs.\n",
+ "\n",
+ "Logistic Regression is a generalized Linear Regression in the sense that we don’t output the weighted sum of inputs directly, but we pass it through a function that can map any real value between 0 and 1.\n",
+ ""
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "g5M2KZjGY6jX"
+ },
+ "source": [
+ "The activation function that is used is known as the sigmoid function. The plot of the sigmoid function looks like\n",
+ "\n",
+ ""
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "FJ7jd-bPvvQe"
+ },
+ "source": [
+ "##Linear Regression Vs. Logistic Regression\n",
+ "Linear regression gives you a continuous output, but logistic regression provides a constant output. An example of the continuous output is house price and stock price. Example's of the discrete output is predicting whether a patient has cancer or not, predicting whether the customer will churn. Linear regression is estimated using Ordinary Least Squares (OLS) while logistic regression is estimated using Maximum Likelihood Estimation (MLE) approach."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "pA5A5bOhvnVg"
+ },
+ "source": [
+ ""
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "3uP7Itp8y9OK"
+ },
+ "source": [
+ "##Example : Lets build logistic regression model using Scikit-learn for diabetes prediction\n",
+ "\n",
+ "Here, we are going to predict diabetes using Logistic Regression Classifier."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "metadata": {
+ "id": "aTcJK4nUyrJ5"
+ },
+ "source": [
+ "import numpy as np\n",
+ "import matplotlib.pyplot as plt\n",
+ "\n",
+ "import pandas as pd\n",
+ "import seaborn as sns\n",
+ "\n",
+ "%matplotlib inline"
+ ],
+ "execution_count": null,
+ "outputs": []
+ },
+ {
+ "cell_type": "code",
+ "metadata": {
+ "colab": {
+ "resources": {
+ "http://localhost:8080/nbextensions/google.colab/files.js": {
+ "data": "Ly8gQ29weXJpZ2h0IDIwMTcgR29vZ2xlIExMQwovLwovLyBMaWNlbnNlZCB1bmRlciB0aGUgQXBhY2hlIExpY2Vuc2UsIFZlcnNpb24gMi4wICh0aGUgIkxpY2Vuc2UiKTsKLy8geW91IG1heSBub3QgdXNlIHRoaXMgZmlsZSBleGNlcHQgaW4gY29tcGxpYW5jZSB3aXRoIHRoZSBMaWNlbnNlLgovLyBZb3UgbWF5IG9idGFpbiBhIGNvcHkgb2YgdGhlIExpY2Vuc2UgYXQKLy8KLy8gICAgICBodHRwOi8vd3d3LmFwYWNoZS5vcmcvbGljZW5zZXMvTElDRU5TRS0yLjAKLy8KLy8gVW5sZXNzIHJlcXVpcmVkIGJ5IGFwcGxpY2FibGUgbGF3IG9yIGFncmVlZCB0byBpbiB3cml0aW5nLCBzb2Z0d2FyZQovLyBkaXN0cmlidXRlZCB1bmRlciB0aGUgTGljZW5zZSBpcyBkaXN0cmlidXRlZCBvbiBhbiAiQVMgSVMiIEJBU0lTLAovLyBXSVRIT1VUIFdBUlJBTlRJRVMgT1IgQ09ORElUSU9OUyBPRiBBTlkgS0lORCwgZWl0aGVyIGV4cHJlc3Mgb3IgaW1wbGllZC4KLy8gU2VlIHRoZSBMaWNlbnNlIGZvciB0aGUgc3BlY2lmaWMgbGFuZ3VhZ2UgZ292ZXJuaW5nIHBlcm1pc3Npb25zIGFuZAovLyBsaW1pdGF0aW9ucyB1bmRlciB0aGUgTGljZW5zZS4KCi8qKgogKiBAZmlsZW92ZXJ2aWV3IEhlbHBlcnMgZm9yIGdvb2dsZS5jb2xhYiBQeXRob24gbW9kdWxlLgogKi8KKGZ1bmN0aW9uKHNjb3BlKSB7CmZ1bmN0aW9uIHNwYW4odGV4dCwgc3R5bGVBdHRyaWJ1dGVzID0ge30pIHsKICBjb25zdCBlbGVtZW50ID0gZG9jdW1lbnQuY3JlYXRlRWxlbWVudCgnc3BhbicpOwogIGVsZW1lbnQudGV4dENvbnRlbnQgPSB0ZXh0OwogIGZvciAoY29uc3Qga2V5IG9mIE9iamVjdC5rZXlzKHN0eWxlQXR0cmlidXRlcykpIHsKICAgIGVsZW1lbnQuc3R5bGVba2V5XSA9IHN0eWxlQXR0cmlidXRlc1trZXldOwogIH0KICByZXR1cm4gZWxlbWVudDsKfQoKLy8gTWF4IG51bWJlciBvZiBieXRlcyB3aGljaCB3aWxsIGJlIHVwbG9hZGVkIGF0IGEgdGltZS4KY29uc3QgTUFYX1BBWUxPQURfU0laRSA9IDEwMCAqIDEwMjQ7CgpmdW5jdGlvbiBfdXBsb2FkRmlsZXMoaW5wdXRJZCwgb3V0cHV0SWQpIHsKICBjb25zdCBzdGVwcyA9IHVwbG9hZEZpbGVzU3RlcChpbnB1dElkLCBvdXRwdXRJZCk7CiAgY29uc3Qgb3V0cHV0RWxlbWVudCA9IGRvY3VtZW50LmdldEVsZW1lbnRCeUlkKG91dHB1dElkKTsKICAvLyBDYWNoZSBzdGVwcyBvbiB0aGUgb3V0cHV0RWxlbWVudCB0byBtYWtlIGl0IGF2YWlsYWJsZSBmb3IgdGhlIG5leHQgY2FsbAogIC8vIHRvIHVwbG9hZEZpbGVzQ29udGludWUgZnJvbSBQeXRob24uCiAgb3V0cHV0RWxlbWVudC5zdGVwcyA9IHN0ZXBzOwoKICByZXR1cm4gX3VwbG9hZEZpbGVzQ29udGludWUob3V0cHV0SWQpOwp9CgovLyBUaGlzIGlzIHJvdWdobHkgYW4gYXN5bmMgZ2VuZXJhdG9yIChub3Qgc3VwcG9ydGVkIGluIHRoZSBicm93c2VyIHlldCksCi8vIHdoZXJlIHRoZXJlIGFyZSBtdWx0aXBsZSBhc3luY2hyb25vdXMgc3RlcHMgYW5kIHRoZSBQeXRob24gc2lkZSBpcyBnb2luZwovLyB0byBwb2xsIGZvciBjb21wbGV0aW9uIG9mIGVhY2ggc3RlcC4KLy8gVGhpcyB1c2VzIGEgUHJvbWlzZSB0byBibG9jayB0aGUgcHl0aG9uIHNpZGUgb24gY29tcGxldGlvbiBvZiBlYWNoIHN0ZXAsCi8vIHRoZW4gcGFzc2VzIHRoZSByZXN1bHQgb2YgdGhlIHByZXZpb3VzIHN0ZXAgYXMgdGhlIGlucHV0IHRvIHRoZSBuZXh0IHN0ZXAuCmZ1bmN0aW9uIF91cGxvYWRGaWxlc0NvbnRpbnVlKG91dHB1dElkKSB7CiAgY29uc3Qgb3V0cHV0RWxlbWVudCA9IGRvY3VtZW50LmdldEVsZW1lbnRCeUlkKG91dHB1dElkKTsKICBjb25zdCBzdGVwcyA9IG91dHB1dEVsZW1lbnQuc3RlcHM7CgogIGNvbnN0IG5leHQgPSBzdGVwcy5uZXh0KG91dHB1dEVsZW1lbnQubGFzdFByb21pc2VWYWx1ZSk7CiAgcmV0dXJuIFByb21pc2UucmVzb2x2ZShuZXh0LnZhbHVlLnByb21pc2UpLnRoZW4oKHZhbHVlKSA9PiB7CiAgICAvLyBDYWNoZSB0aGUgbGFzdCBwcm9taXNlIHZhbHVlIHRvIG1ha2UgaXQgYXZhaWxhYmxlIHRvIHRoZSBuZXh0CiAgICAvLyBzdGVwIG9mIHRoZSBnZW5lcmF0b3IuCiAgICBvdXRwdXRFbGVtZW50Lmxhc3RQcm9taXNlVmFsdWUgPSB2YWx1ZTsKICAgIHJldHVybiBuZXh0LnZhbHVlLnJlc3BvbnNlOwogIH0pOwp9CgovKioKICogR2VuZXJhdG9yIGZ1bmN0aW9uIHdoaWNoIGlzIGNhbGxlZCBiZXR3ZWVuIGVhY2ggYXN5bmMgc3RlcCBvZiB0aGUgdXBsb2FkCiAqIHByb2Nlc3MuCiAqIEBwYXJhbSB7c3RyaW5nfSBpbnB1dElkIEVsZW1lbnQgSUQgb2YgdGhlIGlucHV0IGZpbGUgcGlja2VyIGVsZW1lbnQuCiAqIEBwYXJhbSB7c3RyaW5nfSBvdXRwdXRJZCBFbGVtZW50IElEIG9mIHRoZSBvdXRwdXQgZGlzcGxheS4KICogQHJldHVybiB7IUl0ZXJhYmxlPCFPYmplY3Q+fSBJdGVyYWJsZSBvZiBuZXh0IHN0ZXBzLgogKi8KZnVuY3Rpb24qIHVwbG9hZEZpbGVzU3RlcChpbnB1dElkLCBvdXRwdXRJZCkgewogIGNvbnN0IGlucHV0RWxlbWVudCA9IGRvY3VtZW50LmdldEVsZW1lbnRCeUlkKGlucHV0SWQpOwogIGlucHV0RWxlbWVudC5kaXNhYmxlZCA9IGZhbHNlOwoKICBjb25zdCBvdXRwdXRFbGVtZW50ID0gZG9jdW1lbnQuZ2V0RWxlbWVudEJ5SWQob3V0cHV0SWQpOwogIG91dHB1dEVsZW1lbnQuaW5uZXJIVE1MID0gJyc7CgogIGNvbnN0IHBpY2tlZFByb21pc2UgPSBuZXcgUHJvbWlzZSgocmVzb2x2ZSkgPT4gewogICAgaW5wdXRFbGVtZW50LmFkZEV2ZW50TGlzdGVuZXIoJ2NoYW5nZScsIChlKSA9PiB7CiAgICAgIHJlc29sdmUoZS50YXJnZXQuZmlsZXMpOwogICAgfSk7CiAgfSk7CgogIGNvbnN0IGNhbmNlbCA9IGRvY3VtZW50LmNyZWF0ZUVsZW1lbnQoJ2J1dHRvbicpOwogIGlucHV0RWxlbWVudC5wYXJlbnRFbGVtZW50LmFwcGVuZENoaWxkKGNhbmNlbCk7CiAgY2FuY2VsLnRleHRDb250ZW50ID0gJ0NhbmNlbCB1cGxvYWQnOwogIGNvbnN0IGNhbmNlbFByb21pc2UgPSBuZXcgUHJvbWlzZSgocmVzb2x2ZSkgPT4gewogICAgY2FuY2VsLm9uY2xpY2sgPSAoKSA9PiB7CiAgICAgIHJlc29sdmUobnVsbCk7CiAgICB9OwogIH0pOwoKICAvLyBXYWl0IGZvciB0aGUgdXNlciB0byBwaWNrIHRoZSBmaWxlcy4KICBjb25zdCBmaWxlcyA9IHlpZWxkIHsKICAgIHByb21pc2U6IFByb21pc2UucmFjZShbcGlja2VkUHJvbWlzZSwgY2FuY2VsUHJvbWlzZV0pLAogICAgcmVzcG9uc2U6IHsKICAgICAgYWN0aW9uOiAnc3RhcnRpbmcnLAogICAgfQogIH07CgogIGNhbmNlbC5yZW1vdmUoKTsKCiAgLy8gRGlzYWJsZSB0aGUgaW5wdXQgZWxlbWVudCBzaW5jZSBmdXJ0aGVyIHBpY2tzIGFyZSBub3QgYWxsb3dlZC4KICBpbnB1dEVsZW1lbnQuZGlzYWJsZWQgPSB0cnVlOwoKICBpZiAoIWZpbGVzKSB7CiAgICByZXR1cm4gewogICAgICByZXNwb25zZTogewogICAgICAgIGFjdGlvbjogJ2NvbXBsZXRlJywKICAgICAgfQogICAgfTsKICB9CgogIGZvciAoY29uc3QgZmlsZSBvZiBmaWxlcykgewogICAgY29uc3QgbGkgPSBkb2N1bWVudC5jcmVhdGVFbGVtZW50KCdsaScpOwogICAgbGkuYXBwZW5kKHNwYW4oZmlsZS5uYW1lLCB7Zm9udFdlaWdodDogJ2JvbGQnfSkpOwogICAgbGkuYXBwZW5kKHNwYW4oCiAgICAgICAgYCgke2ZpbGUudHlwZSB8fCAnbi9hJ30pIC0gJHtmaWxlLnNpemV9IGJ5dGVzLCBgICsKICAgICAgICBgbGFzdCBtb2RpZmllZDogJHsKICAgICAgICAgICAgZmlsZS5sYXN0TW9kaWZpZWREYXRlID8gZmlsZS5sYXN0TW9kaWZpZWREYXRlLnRvTG9jYWxlRGF0ZVN0cmluZygpIDoKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJ24vYSd9IC0gYCkpOwogICAgY29uc3QgcGVyY2VudCA9IHNwYW4oJzAlIGRvbmUnKTsKICAgIGxpLmFwcGVuZENoaWxkKHBlcmNlbnQpOwoKICAgIG91dHB1dEVsZW1lbnQuYXBwZW5kQ2hpbGQobGkpOwoKICAgIGNvbnN0IGZpbGVEYXRhUHJvbWlzZSA9IG5ldyBQcm9taXNlKChyZXNvbHZlKSA9PiB7CiAgICAgIGNvbnN0IHJlYWRlciA9IG5ldyBGaWxlUmVhZGVyKCk7CiAgICAgIHJlYWRlci5vbmxvYWQgPSAoZSkgPT4gewogICAgICAgIHJlc29sdmUoZS50YXJnZXQucmVzdWx0KTsKICAgICAgfTsKICAgICAgcmVhZGVyLnJlYWRBc0FycmF5QnVmZmVyKGZpbGUpOwogICAgfSk7CiAgICAvLyBXYWl0IGZvciB0aGUgZGF0YSB0byBiZSByZWFkeS4KICAgIGxldCBmaWxlRGF0YSA9IHlpZWxkIHsKICAgICAgcHJvbWlzZTogZmlsZURhdGFQcm9taXNlLAogICAgICByZXNwb25zZTogewogICAgICAgIGFjdGlvbjogJ2NvbnRpbnVlJywKICAgICAgfQogICAgfTsKCiAgICAvLyBVc2UgYSBjaHVua2VkIHNlbmRpbmcgdG8gYXZvaWQgbWVzc2FnZSBzaXplIGxpbWl0cy4gU2VlIGIvNjIxMTU2NjAuCiAgICBsZXQgcG9zaXRpb24gPSAwOwogICAgZG8gewogICAgICBjb25zdCBsZW5ndGggPSBNYXRoLm1pbihmaWxlRGF0YS5ieXRlTGVuZ3RoIC0gcG9zaXRpb24sIE1BWF9QQVlMT0FEX1NJWkUpOwogICAgICBjb25zdCBjaHVuayA9IG5ldyBVaW50OEFycmF5KGZpbGVEYXRhLCBwb3NpdGlvbiwgbGVuZ3RoKTsKICAgICAgcG9zaXRpb24gKz0gbGVuZ3RoOwoKICAgICAgY29uc3QgYmFzZTY0ID0gYnRvYShTdHJpbmcuZnJvbUNoYXJDb2RlLmFwcGx5KG51bGwsIGNodW5rKSk7CiAgICAgIHlpZWxkIHsKICAgICAgICByZXNwb25zZTogewogICAgICAgICAgYWN0aW9uOiAnYXBwZW5kJywKICAgICAgICAgIGZpbGU6IGZpbGUubmFtZSwKICAgICAgICAgIGRhdGE6IGJhc2U2NCwKICAgICAgICB9LAogICAgICB9OwoKICAgICAgbGV0IHBlcmNlbnREb25lID0gZmlsZURhdGEuYnl0ZUxlbmd0aCA9PT0gMCA/CiAgICAgICAgICAxMDAgOgogICAgICAgICAgTWF0aC5yb3VuZCgocG9zaXRpb24gLyBmaWxlRGF0YS5ieXRlTGVuZ3RoKSAqIDEwMCk7CiAgICAgIHBlcmNlbnQudGV4dENvbnRlbnQgPSBgJHtwZXJjZW50RG9uZX0lIGRvbmVgOwoKICAgIH0gd2hpbGUgKHBvc2l0aW9uIDwgZmlsZURhdGEuYnl0ZUxlbmd0aCk7CiAgfQoKICAvLyBBbGwgZG9uZS4KICB5aWVsZCB7CiAgICByZXNwb25zZTogewogICAgICBhY3Rpb246ICdjb21wbGV0ZScsCiAgICB9CiAgfTsKfQoKc2NvcGUuZ29vZ2xlID0gc2NvcGUuZ29vZ2xlIHx8IHt9OwpzY29wZS5nb29nbGUuY29sYWIgPSBzY29wZS5nb29nbGUuY29sYWIgfHwge307CnNjb3BlLmdvb2dsZS5jb2xhYi5fZmlsZXMgPSB7CiAgX3VwbG9hZEZpbGVzLAogIF91cGxvYWRGaWxlc0NvbnRpbnVlLAp9Owp9KShzZWxmKTsK",
+ "ok": true,
+ "headers": [
+ [
+ "content-type",
+ "application/javascript"
+ ]
+ ],
+ "status": 200,
+ "status_text": ""
+ }
+ },
+ "base_uri": "https://localhost:8080/",
+ "height": 72
+ },
+ "id": "kTMLmgKeY_mo",
+ "outputId": "8c9898f1-2913-4546-bd10-4460027b1cea"
+ },
+ "source": [
+ "#To upload from your local drive, start with the following code:\n",
+ "from google.colab import files\n",
+ "uploaded = files.upload()"
+ ],
+ "execution_count": null,
+ "outputs": [
+ {
+ "output_type": "display_data",
+ "data": {
+ "text/html": [
+ "\n",
+ " \n",
+ " \n",
+ " "
+ ],
+ "text/plain": [
+ ""
+ ]
+ },
+ "metadata": {}
+ },
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "Saving diabetes.csv to diabetes.csv\n"
+ ]
+ }
+ ]
+ },
+ {
+ "cell_type": "code",
+ "metadata": {
+ "id": "Z1GFG4bMyVwx"
+ },
+ "source": [
+ "#to import it into a dataframe (make sure the filename matches the name of the uploaded file)\n",
+ "import io\n",
+ "import pandas as pd\n",
+ "df = pd.read_csv(io.BytesIO(uploaded['diabetes.csv']))"
+ ],
+ "execution_count": null,
+ "outputs": []
+ },
+ {
+ "cell_type": "code",
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 204
+ },
+ "id": "gdDKwmWza66t",
+ "outputId": "68197960-2482-42d1-ab6e-3f388df710b4"
+ },
+ "source": [
+ "df.head()"
+ ],
+ "execution_count": null,
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/html": [
+ "
\n",
+ "\n",
+ "
\n",
+ " \n",
+ "
\n",
+ "
\n",
+ "
Pregnancies
\n",
+ "
Glucose
\n",
+ "
BloodPressure
\n",
+ "
SkinThickness
\n",
+ "
Insulin
\n",
+ "
BMI
\n",
+ "
DiabetesPedigreeFunction
\n",
+ "
Age
\n",
+ "
Outcome
\n",
+ "
\n",
+ " \n",
+ " \n",
+ "
\n",
+ "
0
\n",
+ "
6
\n",
+ "
148
\n",
+ "
72
\n",
+ "
35
\n",
+ "
0
\n",
+ "
33.6
\n",
+ "
0.627
\n",
+ "
50
\n",
+ "
1
\n",
+ "
\n",
+ "
\n",
+ "
1
\n",
+ "
1
\n",
+ "
85
\n",
+ "
66
\n",
+ "
29
\n",
+ "
0
\n",
+ "
26.6
\n",
+ "
0.351
\n",
+ "
31
\n",
+ "
0
\n",
+ "
\n",
+ "
\n",
+ "
2
\n",
+ "
8
\n",
+ "
183
\n",
+ "
64
\n",
+ "
0
\n",
+ "
0
\n",
+ "
23.3
\n",
+ "
0.672
\n",
+ "
32
\n",
+ "
1
\n",
+ "
\n",
+ "
\n",
+ "
3
\n",
+ "
1
\n",
+ "
89
\n",
+ "
66
\n",
+ "
23
\n",
+ "
94
\n",
+ "
28.1
\n",
+ "
0.167
\n",
+ "
21
\n",
+ "
0
\n",
+ "
\n",
+ "
\n",
+ "
4
\n",
+ "
0
\n",
+ "
137
\n",
+ "
40
\n",
+ "
35
\n",
+ "
168
\n",
+ "
43.1
\n",
+ "
2.288
\n",
+ "
33
\n",
+ "
1
\n",
+ "
\n",
+ " \n",
+ "
\n",
+ "
"
+ ],
+ "text/plain": [
+ " Pregnancies Glucose BloodPressure ... DiabetesPedigreeFunction Age Outcome\n",
+ "0 6 148 72 ... 0.627 50 1\n",
+ "1 1 85 66 ... 0.351 31 0\n",
+ "2 8 183 64 ... 0.672 32 1\n",
+ "3 1 89 66 ... 0.167 21 0\n",
+ "4 0 137 40 ... 2.288 33 1\n",
+ "\n",
+ "[5 rows x 9 columns]"
+ ]
+ },
+ "metadata": {},
+ "execution_count": 12
+ }
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "lum0Cxna1aIJ"
+ },
+ "source": [
+ "Selecting Feature\n",
+ "Here, you need to divide the given columns into two types of variables dependent(or target variable) and independent variable(or feature variables)."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "metadata": {
+ "id": "sj-Renl5zI_j"
+ },
+ "source": [
+ "#split dataset in features and target variable\n",
+ "feature_cols = ['Pregnancies','Glucose','BloodPressure','SkinThickness','Insulin','BMI','DiabetesPedigreeFunction','Age']\n",
+ "X = df[feature_cols] # Features\n",
+ "y = df.Outcome # Target variable"
+ ],
+ "execution_count": null,
+ "outputs": []
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "Vb8siCfQ3Umz"
+ },
+ "source": [
+ "### Splitting Data\n",
+ "To understand model performance, dividing the dataset into a training set and a test set is a good strategy.\n",
+ "\n",
+ "Let's split dataset by using **function train_test_split()**. You need to pass 3 parameters features, target, and test_set size. Additionally, you can use random_state to select records randomly."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "metadata": {
+ "id": "2wJFeZ2M1jOh"
+ },
+ "source": [
+ "# split X and y into training and testing sets\n",
+ "from sklearn.model_selection import train_test_split\n",
+ "X_train,X_test,y_train,y_test=train_test_split(X,y,test_size=0.25,random_state=0)"
+ ],
+ "execution_count": null,
+ "outputs": []
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "nY978WTH38Uv"
+ },
+ "source": [
+ "Here, the Dataset is broken into two parts in a ratio of 75:25. It means 75% data will be used for model training and 25% for model testing."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "PylEEeof3-D5"
+ },
+ "source": [
+ "### Model Development and Prediction\n",
+ "First, import the Logistic Regression module and create a Logistic Regression classifier object using **LogisticRegression()** function.\n",
+ "\n",
+ "Then, fit your model on the train set using fit() and perform prediction on the test set using predict()."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "id": "QCP2RFoa3fML",
+ "outputId": "6e4c9f1f-2f26-4191-bd7a-ad73c8eec17a"
+ },
+ "source": [
+ "# import the class\n",
+ "from sklearn.linear_model import LogisticRegression\n",
+ "\n",
+ "# instantiate the model (using the default parameters)\n",
+ "logreg = LogisticRegression()\n",
+ "\n",
+ "# fit the model with data\n",
+ "logreg.fit(X_train,y_train)\n",
+ "\n",
+ "#\n",
+ "y_pred=logreg.predict(X_test)"
+ ],
+ "execution_count": null,
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stderr",
+ "text": [
+ "/usr/local/lib/python3.7/dist-packages/sklearn/linear_model/_logistic.py:940: ConvergenceWarning: lbfgs failed to converge (status=1):\n",
+ "STOP: TOTAL NO. of ITERATIONS REACHED LIMIT.\n",
+ "\n",
+ "Increase the number of iterations (max_iter) or scale the data as shown in:\n",
+ " https://scikit-learn.org/stable/modules/preprocessing.html\n",
+ "Please also refer to the documentation for alternative solver options:\n",
+ " https://scikit-learn.org/stable/modules/linear_model.html#logistic-regression\n",
+ " extra_warning_msg=_LOGISTIC_SOLVER_CONVERGENCE_MSG)\n"
+ ]
+ }
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "LbT8Y8VL4cDx"
+ },
+ "source": [
+ "# **Model Evaluation using Confusion Matrix**\n",
+ "\n",
+ "A **confusion matrix** is a table that is used to evaluate the performance of a classification model. You can also visualize the performance of an algorithm. The fundamental of a confusion matrix is the number of correct and incorrect predictions are summed up class-wise.\n",
+ "\n",
+ ""
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "source": [
+ "# IMPORTANT\n",
+ "\n",
+ "Confusion matrix accuracy is not meaningful for **unbalanced classification**.\n",
+ "In such cases where class variable is imbalanced it is recommended to measure the accuracy using the Area Under the Precision-Recall Curve (AUPRC).\n",
+ "\n",
+ "❗ Example of **unbalanced classification**\n",
+ "\n",
+ "Suppose we have a dataset of credit card transactions where:\n",
+ "\n",
+ "Total transactions are : 284,807\n",
+ "\n",
+ "Fraud transaction (Class variable) : 492\n",
+ "\n",
+ "This dataset is highly unbalanced, because the positive class (frauds) account only for 0.172% of all transactions.\n"
+ ],
+ "metadata": {
+ "id": "svvPVFGFFanw"
+ }
+ },
+ {
+ "cell_type": "code",
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "id": "zYYrt_Ku4Vhx",
+ "outputId": "a15506a2-d458-42f0-e7ae-aeba519dc930"
+ },
+ "source": [
+ "# import the metrics class\n",
+ "from sklearn import metrics\n",
+ "cnf_matrix = metrics.confusion_matrix(y_test, y_pred)\n",
+ "cnf_matrix"
+ ],
+ "execution_count": null,
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ "array([[115, 15],\n",
+ " [ 25, 37]])"
+ ]
+ },
+ "metadata": {},
+ "execution_count": 20
+ }
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "vCtLXypF4pWd"
+ },
+ "source": [
+ "Here, you can see the confusion matrix in the form of the array object. The dimension of this matrix is 2*2 because this model is binary classification. You have two classes 0 and 1. Diagonal values represent accurate predictions, while non-diagonal elements are inaccurate predictions. In the output, 119 and 36 are actual predictions, and 26 and 11 are incorrect predictions."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "XM9qUNYl4tpk"
+ },
+ "source": [
+ "### Visualizing Confusion Matrix using Heatmap\n",
+ "Let's visualize the results of the model in the form of a confusion matrix using matplotlib and seaborn.\n",
+ "\n",
+ "Here, you will visualize the confusion matrix using Heatmap."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "metadata": {
+ "id": "lXr1xgSJ4j_5"
+ },
+ "source": [
+ "# import required modules\n",
+ "import numpy as np\n",
+ "import matplotlib.pyplot as plt\n",
+ "import seaborn as sns\n",
+ "%matplotlib inline"
+ ],
+ "execution_count": null,
+ "outputs": []
+ },
+ {
+ "cell_type": "code",
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 342
+ },
+ "id": "fR-1Aq9h4y5I",
+ "outputId": "694eb98d-fc22-4d63-832e-20b93795164e"
+ },
+ "source": [
+ "class_names=[0,1] # name of classes\n",
+ "fig, ax = plt.subplots()\n",
+ "tick_marks = np.arange(len(class_names))\n",
+ "plt.xticks(tick_marks, class_names)\n",
+ "plt.yticks(tick_marks, class_names)\n",
+ "# create heatmap\n",
+ "sns.heatmap(pd.DataFrame(cnf_matrix), annot=True, cmap=\"YlGnBu\" ,fmt='g')\n",
+ "ax.xaxis.set_label_position(\"top\")\n",
+ "plt.tight_layout()\n",
+ "plt.title('Confusion matrix', y=1.1)\n",
+ "plt.ylabel('Actual label')\n",
+ "plt.xlabel('Predicted label')\n"
+ ],
+ "execution_count": null,
+ "outputs": [
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ "Text(0.5, 257.44, 'Predicted label')"
+ ]
+ },
+ "metadata": {},
+ "execution_count": 24
+ },
+ {
+ "output_type": "display_data",
+ "data": {
+ "image/png": "iVBORw0KGgoAAAANSUhEUgAAAaIAAAE0CAYAAABuNDcxAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAcyklEQVR4nO3deZwcdZ3/8ddnEoFwSghHCCAgQYysCBuQQ1gE3eVag4hoOAQMxhMUUAKsy+X+FBdXROAnBhCjIALCAgqKwIqIyhGQ+4wgEAiHJJADhByf/aNr4pBNZqZ7pqe6a15PH/VId3V11WdCnPfje9S3IjORJKksHWUXIEka3AwiSVKpDCJJUqkMIklSqQwiSVKpDCJJUqkMIrW0iBgWET+PiFci4rI+nOeAiPh1f9ZWlojYMSIeKbsOqb+E9xGpP0TE/sBRwGbAHOBu4P9l5i19PO9BwOHA9pm5oM+FtriISGB0Zk4ruxZpoNgiUp9FxFHAd4CvA2sDGwD/HxjXD6d/G/DoYAih3oiIoWXXIPU3g0h9EhGrAacAn8/MKzJzXmbOz8yfZ+ZXimOWj4jvRMSzxfadiFi++GzniJgeEUdHxAsRMSMiDi0+Oxk4AfhYRMyNiAkRcVJEXNjl+htGRHb+go6IQyLi8YiYExFPRMQBXfbf0uV720fEHUWX3x0RsX2Xz26KiK9FxO+L8/w6IkYs4+fvrP+YLvXvHRF7RMSjETEzIo7vcvw2EfHHiHi5OPasiFiu+Ozm4rB7ip/3Y13OPykingMu6NxXfOftxTW2Kt6vGxEvRsTOffoPKw0gg0h9tR2wAvDf3Rzzb8C2wHuALYBtgK92+XwdYDVgFDABODsiVs/ME6m1si7JzJUz8/zuComIlYDvArtn5irA9tS6CJc8bjhwTXHsGsC3gWsiYo0uh+0PHAqsBSwHfLmbS69D7e9gFLXgPBc4EPhHYEfg3yNio+LYhcCRwAhqf3e7Ap8DyMydimO2KH7eS7qcfzi11uHErhfOzD8Dk4ALI2JF4AJgSmbe1E29UksxiNRXawB/7aHr7ADglMx8ITNfBE4GDury+fzi8/mZeS0wF3hHg/UsAjaPiGGZOSMzH1jKMXsCj2XmjzNzQWZeDDwM/GuXYy7IzEcz8zXgUmohuizzqY2HzQd+Si1kzsjMOcX1H6QWwGTmnZl5a3HdvwDfB/6pFz/TiZn5elHPm2TmucA04DZgJLXgl9qGQaS+egkY0cPYxbrAk13eP1nsW3yOJYLsVWDlegvJzHnAx4DPADMi4pqI2KwX9XTWNKrL++fqqOelzFxYvO4Miue7fP5a5/cjYtOI+EVEPBcRs6m1+Jba7dfFi5n5tx6OORfYHDgzM1/v4VippRhE6qs/Aq8De3dzzLPUupU6bVDsa8Q8YMUu79fp+mFmXpeZH6TWMniY2i/onurprOmZBmuqx/eo1TU6M1cFjgeih+90O7U1IlamNlnkfOCkoutRahsGkfokM1+hNi5ydjFIv2JEvCUido+I/ywOuxj4akSsWQz6nwBcuKxz9uBuYKeI2KCYKHFc5wcRsXZEjCvGil6n1sW3aCnnuBbYNCL2j4ihEfExYAzwiwZrqscqwGxgbtFa++wSnz8PbFznOc8ApmbmYdTGvs7pc5XSADKI1GeZ+V/U7iH6KvAi8DTwBeDK4pD/AKYC9wL3AXcV+xq51vXAJcW57uTN4dFR1PEsMJPa2MuSv+jJzJeAvYCjqXUtHgPslZl/baSmOn2Z2kSIOdRaa5cs8flJwJRiVt1+PZ0sIsYBu/H3n/MoYKvO2YJSO/CGVklSqWwRSZJKZRBJkkplEEmSSmUQSZJKZRBJkkplEKk0EbEwIu6OiPsj4rJirbRGz/XDiNi3eH1eRIzp5tiduy5yWsc1/rK0xU+XtX+JY+bWea2TIqK79e2kyjCIVKbXMvM9mbk58Aa1pXkWa/SRB5l5WGY+2M0hO1NbEFVSCzCI1Cp+B2xStFZ+FxFXAw9GxJCIOK14VMO9EfFpgKg5KyIeiYgbqK2STfHZTRExtni9W0TcFRH3RMSNEbEhtcA7smiN7Vis+HB5cY07ImKH4rtrFI+AeCAizqPnpXiIiCsj4s7iOxOX+Oz0Yv+NEbFmse/tEfGr4ju/W8baeFKl+ZAtla5o+ewO/KrYtRWweWY+UfwyfyUzt47aM4x+H7VHfm9JbYXuMdQexvcg8IMlzrsmtdULdirONTwzZ0bEOcDczPxWcdxPgNMz85aI2AC4DngncCJwS2aeEhF7UntERU8+WVxjGHBHRFxerOSwErVleI6MiBOKc38BmAx8JjMfi4j3Unug4C4N/DVKbcsgUpmGRUTn84J+R23Rzu2B2zPziWL/PwPv7hz/ofbcotHATsDFxarXz0bE/yzl/NsCN3eeKzNnLqOODwBjIhY3eFYtFhLdCdin+O41ETGrFz/TERHx4eL1+kWtL1Fb865zOZ8LgSuKa2wPXNbl2sv34hpSpRhEKtNrmfmm5/wUv5Dndd0FHJ6Z1y1x3B79WEcHsO2Sj1roEg69ErWnon4A2C4zX42Im6g9MG9psrjuy0v+HUiDjWNEanXXAZ+NiLfA4uf5rATcTO0R4kMiYiTw/qV891ZqK3VvVHy38/EIc6itgt3p18DhnW8iojMYbqa2QCkRsTuweg+1rgbMKkJoM2otsk4dQGerbn9qXX6zgSci4qPFNSIitujhGlLlGERqdedRG/+5KyLup/ZE06HUHk3+WPHZj6g9F+lNiqfBTqTWDXYPf+8a+znw4c7JCsARwNhiMsSD/H323snUguwBal10T/VQ66+AoRHxEHAqtSDsNA/YpvgZdgFOKfYfAEwo6nsAGNeLvxOpUlx9W5JUKltEkqRSGUSSpFK17Ky5YRuMt89QA+q1p04uuwQNSpvWNz2zB/X+7nztqYv79fqNsEUkSSpVy7aIJEn1i2i/9oVBJEkVEm3Y0WUQSVKF2CKSJJXKIJIklareNRJbgUEkSZVii0iSVCK75iRJpTKIJEmlcvq2JKlUtogkSaUyiCRJpTKIJEmlCryPSJJUIltEkqRSdXS036/19qtYktQNW0SSpBLZNSdJKpVBJEkqlSsrSJJKZYtIklQqn0ckSSqVLSJJUqkcI5IklcoWkSSpVAaRJKlUds1Jkspli0iSVCa75iRJpfI+IklSqRwjkiSVyq45SVK57JqTJJWq/RpE7ViyJGmZIurbejxd/CAiXoiI+7vsGx4R10fEY8Wfqxf7IyK+GxHTIuLeiNiqNyUbRJJUJf0cRMAPgd2W2HcscGNmjgZuLN4D7A6MLraJwPd6cwGDSJKqpKPOrQeZeTMwc4nd44ApxespwN5d9v8oa24F3hoRI3tTsiSpIjKiri0iJkbE1C7bxF5cZu3MnFG8fg5Yu3g9Cni6y3HTi33dcrKCJFVJnZPmMnMyMLnRy2VmRkQ2+n0wiCSpWjoGZPr28xExMjNnFF1vLxT7nwHW73LcesW+btk1J0lV0v+TFZbmauDg4vXBwFVd9n+imD23LfBKly68ZbJFJElV0s8Nooi4GNgZGBER04ETgVOBSyNiAvAksF9x+LXAHsA04FXg0N5cwyCSpCrp5665zBy/jI92XcqxCXy+3msYRJJUJS7xI0kqVfvlkEEkSZUyMLPm+pVBJElV0n45ZBBJUpWkY0SSpFLZNSdJKlX75ZBBJEmVYtecJKlUds1JkkrVfjlkEElSpXS031rWBpEkVUn75ZBBJEmV4mQFSVKp2i+HDCJJqpJsw1lzbdibOLidc9qnefKuc5h6/X8u3rfPnu/lzhtOY95fLmKrd2+8eP8G641g5qNTuPWX3+DWX36D7359Qhklq2KOO+4MttvuQPba6++PnTnzzJ+w444HM27cEYwbdwS//e3UEisc5AbmCa39yhZRm/nxZb/lnCnXcd7pn1u874FHnubjE7/NWd847P8c//iTz7Pt7scNZImquH322ZUDD9yTSZNOf9P+Qw4Zx4QJ+5RUlRZrjWypi0HUZn5/+8NssN6IN+17ZNqzJVWjwWjrrTdn+vTnyy5Dy9KGXXNNC6KI2AwYB4wqdj0DXJ2ZDzXrmvq/Nlx/Tf547TeYM/c1Tv7WJfz+9kfKLkkVddFF13Dllb9h88034dhjJ7DaaiuXXdLg1CLdbfVoyhhRREwCfkqtkXh7sQVwcUQc2833JkbE1IiYumDutGaUNqg898LLbLrt4Wy3x3FM+tqP+eF3D2eVlYeVXZYqaPz43bn++slcddUZrLXW6px66vlllzR4RZ1bC2jWZIUJwNaZeWpmXlhspwLbFJ8tVWZOzsyxmTl26MqbNKm0weONNxYw8+W5APzpvid4/MnnGb3xyJKrUhWNGLE6Q4YMoaOjg49+9F+4775Hyy5p8OqI+rYW0KwgWgSsu5T9I4vPNABGDF+FjuIf2oYbrMUmG63DE0/at6/+98ILMxe/vuGGPzJ69NtKrGaQa8MgatYY0ZeAGyPiMeDpYt8GwCbAF5p0zUFhypmHs+N272TE6qsw7baz+Nq3f8asl+fy7VMOYcTwVbnigmO498G/8KGDTuV9730n/370R5k/fwGLFiWHH38+s16ZV/aPoDZ31FGncfvt9zFr1mx22ukQDj98f26//T4efvgJIBg1ai1OOeXzPZ5HzZGtkS11icxszokjOqh1xXWdrHBHZi7szfeHbTC+OYVJy/DaUyeXXYIGpU37NTo2nvizun53Pj5539Kjq2mz5jJzEXBrs84vSVqKNpw1531EklQlLTLuUw+DSJKqpA0XbjOIJKlK7JqTJJXKrjlJUpnSFpEkqVSOEUmSSmXXnCSpVHbNSZJKZYtIklSq9sshg0iSqiRtEUmSSmUQSZJK5WQFSVKpvI9IklSqNmwRtWF2SpKWqQmPCo+IIyPigYi4PyIujogVImKjiLgtIqZFxCURsVzDJTf6RUlSC+rnIIqIUcARwNjM3BwYAnwc+CZwemZuAswCJjRccqNflCS1noyoa+ulocCwiBgKrAjMAHYBflZ8PgXYu9GaDSJJqpKOOrceZOYzwLeAp6gF0CvAncDLmbmgOGw6MKovJUuSqiKiri0iJkbE1C7bxDefLlYHxgEbAesCKwG79WfJzpqTpCqp84bWzJwMTO7mkA8AT2TmiwARcQWwA/DWiBhatIrWA55prGBbRJJULf0/a+4pYNuIWDEiAtgVeBD4DbBvcczBwFUNl9zoFyVJLSjq3HqQmbdRm5RwF3AftdyYDEwCjoqIacAawPmNlmzXnCRVSA7p//ZFZp4InLjE7seBbfrj/AaRJFWJi55KkkrVfjlkEElSlXS04ci/QSRJFdKGa54aRJJUJZUKooiYA2Tn2+LPLF5nZq7a5NokSXWKNkyiZQZRZq4ykIVIkvquDXOodze0RsT7IuLQ4vWIiNiouWVJkhpR51JzLaHHMaKIOBEYC7wDuABYDriQ2lpDkqQWEhWdNfdhYEtqyzuQmc9GhN12ktSCWqWVU4/eBNEbmZkRkQARsVKTa5IkNagNF1bo1RjRpRHxfWpLfn8KuAE4t7llSZIaUckxosz8VkR8EJgNbAqckJnXN70ySVLdWiVc6tHbG1rvA4ZRu4/ovuaVI0nqi3a8j6jHrrmIOAy4HdiH2kOQbo2ITza7MElS/aKjvq0V9KZF9BVgy8x8CSAi1gD+APygmYVJkurXhg2iXgXRS8CcLu/nFPskSS2mUkEUEUcVL6cBt0XEVdTGiMYB9w5AbZKkOlUqiIDOm1b/XGydrmpeOZKkvmjH+4i6W/T05IEsRJLUd1VrEQEQEWsCxwDvAlbo3J+ZuzSxLklSA9oxiHozee8i4GFgI+Bk4C/AHU2sSZLUoOiIurZW0JsgWiMzzwfmZ+ZvM/OTgK0hSWpBlVziB5hf/DkjIvYEngWGN68kSVKjWiVc6tGbIPqPiFgNOBo4E1gVOLKpVUmSGlLJIMrMXxQvXwHe39xyJEl90SLDPnXp7obWM6ndwLpUmXlEUyqSJDWsai2iqQNWhSSpX7TKQqb16O6G1ikDWYgkqe+q1iKSJLWZdnwekUEkSRXShjlkEElSlVQqiMqeNff8n30IrAbWPTMfLbsEDUJbDN+0X89XqSDCWXOS1HYqdR+Rs+Ykqf1UKog6FY+BmASMwcdASFJL64hljqi0rN4+BuIhfAyEJLW8oVHf1gp8DIQkVUhHZF1bK/AxEJJUIZUcI8LHQEhS22jDpeZ8DIQkVUklW0QRcQFLubG1GCuSJLWQaMK4T0S8FTgP2JxaHnwSeAS4BNiQ2iS2/TJzViPn700r7hfANcV2I7WuubmNXEyS1FwdUd/WS2cAv8rMzYAtqM2kPha4MTNHU8uGYxutuTddc5d3fR8RFwO3NHpBSVLz9PcYUTFHYCfgEIDMfAN4IyLGATsXh00BbqJ2z2ndGln0dDSwViMXkyQ1VxOmZG8EvAhcEBFbAHcCXwTWzswZxTHPAWs3eoEewzMi5kTE7M4N+DkNpp4kqbnq7ZqLiIkRMbXLNnGJUw4FtgK+l5lbAvNYohsuM5NuFsnuSW+65lZp9OSSpIFVb9dcZk4GJndzyHRgembeVrz/GbUgej4iRmbmjIgYCbxQf7U1vWkR3dibfZKk8vX3ZIXMfA54OiLeUezaFXgQuBo4uNh3MHBVozV39zyiFYAVgRERsTrQWfKqwKhGLyhJap4mLdtzOHBRRCwHPA4cSq0hc2lETACeBPZr9OTddc19GvgSsC61wanOIJoNnNXoBSVJzdOMG1oz825g7FI+2rU/zt/d84jOAM6IiMMz88z+uJgkqbnacYmf3tS8qLirFoCIWD0iPtfEmiRJDWrH1bd7E0SfysyXO98USzh8qnklSZIa1aSVFZqqNze0DomIKOaJExFDgOWaW5YkqRGtEi716E0Q/Qq4JCK+X7z/dLFPktRi2nGMqDdBNAmYCHy2eH89cG7TKpIkNaxVxn3q0WN4ZuaizDwnM/fNzH2p3cjkLDpJakFVHSMiIrYExlO7YekJ4IpmFiVJakyluuYiYlNq4TMe+Cu1ByBFZvqUVklqUa3SyqlHdy2ih4HfAXtl5jSAiDhyQKqSJDWkGU9obbbuWnH7ADOA30TEuRGxK39f5keS1ILacYxomUGUmVdm5seBzYDfUFt3bq2I+F5E/PNAFShJ6r2OOrdW0JtZc/My8yeZ+a/AesCf8MF4ktSS2nGJn7oeFV4s79PTQ5QkSSVple62etQVRJKk1mYQSZJKNaTsAhpgEElShbTKuE89DCJJqhC75iRJpTKIJEmlGmIQSZLKZItIklQqJytIkkpli0iSVCrvI5IklWpoh11zkqQSOWtOklQqx4gkSaUyiCRJpTKIJEmlGuJ9RJKkMrXK47/rYRBJUoXYNSdJKpVBJEkqlWNEkqRS2SKSJJXKIJIklcogkiSVyrXmJEml8sF4kqRSeUOrBtRzM2Zx0vE/YuZLcyDgw/vuwPiD3s/ks6/hysv/wFtXXxmAz3/xQ+yw07tKrlZV8cbr8znxs2ezYP4CFi5cxLbvfzf7fWo3TvjMWbz26usAzJ41l7ePWZ9jvvnJkqsdfBwj0oAaOrSDL31lHzYbsz7z5v2NT+z3Td67/WYAjD/o/Rx06AdKrlBV9JblhnLiWZ9lhRWXZ8GChZzw6bN4z3bv5JRzvrD4mG8d90O23nHzEqscvJoxRhQRQ4CpwDOZuVdEbAT8FFgDuBM4KDPfaPT87diKU2HEmqux2Zj1AVhppRXYcON1ePH5l0uuSlUXEayw4vIALFywkIULFhJdfvm9Ou9vPHDnNLb+J4OoDB2RdW299EXgoS7vvwmcnpmbALOACX2quS9fVut49pmXeOSh6bzr3RsCcNnFNzP+w1/nlK9eyOxXXi23OFXOooWL+Mon/ovD9jiRf9hmU0a/622LP7vjt/ez+djRrLjSCiVWOHh1RH1bTyJiPWBP4LzifQC7AD8rDpkC7N2nmvvy5UZExKHdfDYxIqZGxNQLzrtmIMtqa6+++jqTjjyPoyZ9hJVXHsZHPrYj//3Lk7jo8mMZseaqfOe0K8ouURXTMaSD0350NOdcdQJ/fvApnvrzjMWf/f76P7HDB7cssbrBrd4g6vp7t9gmLnHK7wDHAIuK92sAL2fmguL9dGBUn2ruy5cbdPKyPsjMyZk5NjPHHnrYngNZU9taMH8hk750LrvtOZZdPvgeANYYsSpDhnTQ0dHB3vvuwAP3P1lylaqqlVYZxru22oS7b30YgNkvz2Xag0+x1fbvLLmywaujzq3r791im9x5rojYC3ghM+9sZs1NmawQEfcu6yNg7WZcczDKTL52wkVsuPE6HHDwrov3//XFVxix5moA3HTjPbx9k5FllagKmj1rLkOGDmGlVYbxxt/mc+8djzLuwF0AuPV/7mWrHcaw3PJvKbnKwSt60d1Whx2AD0XEHsAKwKrAGcBbI2Jo0SpaD3imLxdp1qy5tYF/oTaI1VUAf2jSNQede/70ONf+/HY2Gb0u+3/kG0BtqvZ1107l0UemEwQjRw3n+BPHl1ypqmTWS7M5+5SLWbQoyUy222UL/vF9YwD4ww13s/dBu5Rc4eDWnzmUmccBxwFExM7AlzPzgIi4DNiX2sy5g4Gr+nKdyOz/u3Aj4nzggsy8ZSmf/SQz9+/pHLPnX99+twerrT0x5/WyS9AgtMXwvfq1DTP1r9fU9btz7Ig9e3X9LkG0V0RsTC2EhgN/Ag7MzIb/D9SUFlFmLnMqX29CSJLUmGYN/GfmTcBNxevHgW3669ze0CpJFRKuNSdJKlMbrvBjEElSlfTzrLkBYRBJUoW0YQ4ZRJJUJa6+LUkqVRvmkEEkSVXiGJEkqVRtmEMGkSRViUEkSSqVkxUkSaVqwxwyiCSpSlziR5JUKrvmJEmlKuOx231lEElShXgfkSSpVG2YQwaRJFWJLSJJUqnaMIcMIkmqEmfNSZJK1YY5ZBBJUpV4Q6skqVS2iCRJpXLWnCSpVG2YQwaRJFWJS/xIkkpl15wkqWTtl0QGkSRVSBhEkqQyRbTfKJFBJEmVYotIklQiu+YkSSUziCRJJXKMSJJUMltEkqQSOUYkSSqVQSRJKpljRJKkEkUbLjZnEElSpRhEkqQSOUYkSSpZ+40RtV/FkqRlijr/1+P5ItaPiN9ExIMR8UBEfLHYPzwiro+Ix4o/V2+0ZoNIkiokIuraemEBcHRmjgG2BT4fEWOAY4EbM3M0cGPxviEGkSRVStS5dS8zZ2TmXcXrOcBDwChgHDClOGwKsHejFRtEklQhQUd9W8TEiJjaZZu4zHNHbAhsCdwGrJ2ZM4qPngPWbrRmJytIUqXUN2suMycDk3s8a8TKwOXAlzJzdtduvczMiMg6C13MIJKkCmnGDa0R8RZqIXRRZl5R7H4+IkZm5oyIGAm80Oj57ZqTpErp3zGiqCXb+cBDmfntLh9dDRxcvD4YuKrRim0RSVKFRP+3L3YADgLui4i7i33HA6cCl0bEBOBJYL9GL2AQSVKl9G/XXGbe0s1Jd+2PaxhEklQhHT6hVZJULoNIklQiFz2VJJXMIJIklcgH40mSSuYYkSSpRO04RhSZDS8PpBYVEROL9aOkAeG/OfVF+7Xh1BvLXD1XahL/zalhBpEkqVQGkSSpVAZRNdlXr4Hmvzk1zMkKkqRS2SKSJJXKIJIklcogqpCI2C0iHomIaRFxbNn1qPoi4gcR8UJE3F92LWpfBlFFRMQQ4Gxgd2AMMD4ixpRblQaBHwK7lV2E2ptBVB3bANMy8/HMfAP4KTCu5JpUcZl5MzCz7DrU3gyi6hgFPN3l/fRinyS1NINIklQqg6g6ngHW7/J+vWKfJLU0g6g67gBGR8RGEbEc8HHg6pJrkqQeGUQVkZkLgC8A1wEPAZdm5gPlVqWqi4iLgT8C74iI6RExoeya1H5c4keSVCpbRJKkUhlEkqRSGUSSpFIZRJKkUhlEkqRSGUSSpFIZRJKkUv0vIKJ63+NQVzAAAAAASUVORK5CYII=\n",
+ "text/plain": [
+ ""
+ ]
+ },
+ "metadata": {
+ "needs_background": "light"
+ }
+ }
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "7cc8Gwr65MN1"
+ },
+ "source": [
+ "### Confusion Matrix Evaluation Metrics\n",
+ "Let's evaluate the model using model evaluation metrics such as accuracy, precision, and recall."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "id": "k9p9fJmP46tw",
+ "outputId": "6e7e9c88-2c7a-4d2b-8a10-abcf28c8acfb"
+ },
+ "source": [
+ "print(\"Accuracy:\",metrics.accuracy_score(y_test, y_pred))\n",
+ "print(\"Precision:\",metrics.precision_score(y_test, y_pred))\n",
+ "print(\"Recall:\",metrics.recall_score(y_test, y_pred))"
+ ],
+ "execution_count": null,
+ "outputs": [
+ {
+ "output_type": "stream",
+ "name": "stdout",
+ "text": [
+ "Accuracy: 0.7916666666666666\n",
+ "Precision: 0.7115384615384616\n",
+ "Recall: 0.5967741935483871\n"
+ ]
+ }
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "U-WHC8za5Z5J"
+ },
+ "source": [
+ "**We got a classification rate of 80%, considered as good accuracy.**\n",
+ "\n",
+ "**Precision**: Precision is about being precise, i.e., how accurate your model is. In other words, you can say, when a model makes a prediction, how often it is correct. In your prediction case, when your Logistic Regression model predicted patients are going to suffer from diabetes, that patients have 76% of the time.\n",
+ "\n",
+ "**Recall**: If there are patients who have diabetes in the test set and your Logistic Regression model can identify it 58% of the time."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "6-crRCXI58oG"
+ },
+ "source": [
+ "## ROC Curve\n",
+ "Receiver Operating Characteristic(ROC) curve is a plot of the true positive rate against the false positive rate. It shows the tradeoff between sensitivity and specificity."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 265
+ },
+ "id": "I4C7a8AE5Rfw",
+ "outputId": "950434de-211a-452b-eb7e-f89d56529940"
+ },
+ "source": [
+ "y_pred_proba = logreg.predict_proba(X_test)[::,1]\n",
+ "fpr, tpr, _ = metrics.roc_curve(y_test, y_pred_proba)\n",
+ "auc = metrics.roc_auc_score(y_test, y_pred_proba)\n",
+ "plt.plot(fpr,tpr,label=\"data 1, auc=\"+str(auc))\n",
+ "plt.legend(loc=4)\n",
+ "plt.show()"
+ ],
+ "execution_count": null,
+ "outputs": [
+ {
+ "output_type": "display_data",
+ "data": {
+ "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXQAAAD4CAYAAAD8Zh1EAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAcDElEQVR4nO3de3RU9bn/8ffDRVldclOghkAMEZBcCFFTIFgv1VIRNVQPWlDrpfykHgv+iqdVW1wiHl20YnW1FqlopRZbwGqrUTiyKqC1VjRYo0DQGAE1KUuDIJdCIIHn/DHDnBCSzIRMZpKdz2utrDV772/2fr4zyZNvnv3de5u7IyIi7V+nZAcgIiLxoYQuIhIQSugiIgGhhC4iEhBK6CIiAdElWQfu06ePp6enJ+vwIiLt0ttvv73N3fs2tC1pCT09PZ21a9cm6/AiIu2SmX3c2DaVXEREAkIJXUQkIJTQRUQCQgldRCQglNBFRAIiakI3syfM7HMzW9/IdjOzX5lZuZm9Z2ZnxD9MERGJJpYR+u+AcU1svwgYEv6aCsxveVgiItJcUeehu/vfzCy9iSYTgN976D68a8ysl5mluPvWOMUoIh3EH9/8hOdLKpMdRqvL6t+DWZdmx32/8aihpwKf1lmuCK87iplNNbO1Zra2qqoqDocWkSB5vqSS0q27kh1Gu5XQK0XdfQGwACA/P19P1hCRo2Sl9GDp9wuSHUa7FI+EXgkMrLM8ILxORBrRUUoLzVW6dRdZKT2SHUa7FY+SSxFwbXi2y2hgp+rnIk1TaaFhWSk9mJDXYMVWYhB1hG5mi4HzgD5mVgHMAroCuPtvgOXAeKAc2Avc0FrBigSJSgsSb7HMcpkcZbsDP4hbRCIickySdvtckbYoUbVt1YqlNejSf5E6ElXbVq1YWoNG6CL1qLYt7ZUSurRpiZ7ep1KItGcquUiblujpfSqFSHumEbq0eSqBiMRGCV3apMOlFpVARGKnkou0SXWTuUogIrHRCF3aLJVaRJpHCV0SLpaZKyq1iDSfSi6ScLHMXFGpRaT5NEKXpFA5RST+lNClVTVUXlE5RaR1qOQiraqh8orKKSKtQyN0aXUqr4gkhkboIiIBoYQuIhIQSugiIgGhhC4iEhBK6CIiAaGELiISEEroIiIBoXnoEpNjfRScrgoVSRyN0CUmx/ooOF0VKpI4GqFLzHTFp0jbphG6iEhAKKGLiASEErqISECohi56JJxIQGiELnoknEhAaIQugGawiARBTCN0MxtnZh+YWbmZ3dHA9jQzW21m75jZe2Y2Pv6hiohIU6ImdDPrDMwDLgKygMlmllWv2Z3A0+5+OjAJeCTegYqISNNiGaGPBMrdfZO7HwCWABPqtXHg8BmznsC/4heiiIjEIpaEngp8Wme5IryurruBa8ysAlgOTG9oR2Y21czWmtnaqqqqYwhXREQaE69ZLpOB37n7AGA8sMjMjtq3uy9w93x3z+/bt2+cDi0iIhBbQq8EBtZZHhBeV9cU4GkAd38D6Ab0iUeAIiISm1gSejEwxMwGmdlxhE56FtVr8wlwAYCZZRJK6KqpiIgkUNR56O5ea2bTgBVAZ+AJd99gZvcAa929CPgv4DEzm0HoBOn17u6tGXhHcKz3IG8uXQUqEgwxXVjk7ssJneysu+6uOq9LgbPiG5ocvoKztZOtrgIVCQZdKdrG6QpOEYmVEnob0VB5RaUQEWkO3ZyrjWjoBlkqhYhIc2iE3oaovCIiLaGEngQqr4hIa1DJJQlUXhGR1qARepKovCIi8aYRuohIQCihi4gEhBK6iEhAKKGLiASEToom0OHpipqiKCKtQSP0BKqbzDVFUUTiTSP0BNN0RRFpLRqhi4gEhBK6iEhAKKGLiASEErqISEAooYuIBIQSuohIQCihi4gEhBK6iEhAKKGLiASErhRtJXrMnIgkmkborUSPmRORRNMIvRXpvi0ikkgaoYuIBIQSuohIQCihi4gEhBK6iEhAxHRS1MzGAb8EOgOPu/vPGmhzJXA34MC77n5VHONs8+pPU9QURRFJtKgJ3cw6A/OAsUAFUGxmRe5eWqfNEOAnwFnuvsPM+rVWwG1V/WeFaoqiiCRaLCP0kUC5u28CMLMlwASgtE6bG4F57r4DwN0/j3eg7YGmKYpIMsWS0FOBT+ssVwCj6rUZCmBmrxMqy9zt7i/V35GZTQWmAqSlpR1LvAnT0JWeTVGJRUSSLV4nRbsAQ4DzgMnAY2bWq34jd1/g7vnunt+3b984Hbp1NHSlZ1NUYhGRZItlhF4JDKyzPCC8rq4K4E13rwE2m1kZoQRfHJcok0QlFBFpT2IZoRcDQ8xskJkdB0wCiuq1eY7Q6Bwz60OoBLMpjnGKiEgUURO6u9cC04AVwEbgaXffYGb3mFlhuNkK4AszKwVWAz929y9aK2gRETlaTPPQ3X05sLzeurvqvHbg1vCXiIgkge62iO5dLiLBoEv/0b3LRSQYNEIP04wWEWnvNEIXEQkIJXQRkYBQQhcRCQgldBGRgFBCFxEJCCV0EZGAUEIXEQkIJXQRkYBQQhcRCQgldBGRgFBCFxEJCCV0EZGAUEIXEQkIJXQRkYBQQhcRCQgldBGRgFBCFxEJCCV0EZGAUEIXEQkIJXQRkYDo0A+J/uObn/B8SSWlW3eRldIj2eGIiLRIhx6h103mE/JSkx2OiEiLdOgROkBWSg+Wfr8g2WGIiLRYhx6hi4gEiRK6iEhAKKGLiAREh6yha3aLiARRhxyha3aLiARRTAndzMaZ2QdmVm5mdzTR7j/MzM0sP34hto7Ds1uuGpWW7FBEROIiasnFzDoD84CxQAVQbGZF7l5ar1134P8Db7ZGoC11uMwCqNQiIoEUywh9JFDu7pvc/QCwBJjQQLv/Bn4OVMcxvrg5XGYBVGoRkUCK5aRoKvBpneUKYFTdBmZ2BjDQ3ZeZ2Y8b25GZTQWmAqSlJb7UoYuIRCTIWnxS1Mw6AQ8C/xWtrbsvcPd8d8/v27dvSw8tIiJ1xJLQK4GBdZYHhNcd1h3IAV4xsy3AaKCoPZwYFREJklgSejEwxMwGmdlxwCSg6PBGd9/p7n3cPd3d04E1QKG7r22ViEVEpEFRE7q71wLTgBXARuBpd99gZveYWWFrBygiIrGJ6UpRd18OLK+37q5G2p7X8rDiR1eFikhHEfgrRXVVqIh0FB3iXi6arigiHUFgE7pKLSLS0QS25KJSi4h0NIEdoYNKLSLSsQR2hC4i0tEooYuIBIQSuohIQASqhq57notIRxaoEbrueS4iHVmgRuigmS0i0nEFaoQuItKRKaGLiASEErqISEAooYuIBIQSuohIQCihi4gEhBK6iEhAKKGLiASEErqISEAooYuIBIQSuohIQCihi4gEhBK6iEhAKKGLiASEErqISEAooYuIBIQSuohIQCihi4gEhBK6iEhAxJTQzWycmX1gZuVmdkcD2281s1Ize8/MVprZKfEPVUREmhI1oZtZZ2AecBGQBUw2s6x6zd4B8t09F3gGuD/egYqISNNiGaGPBMrdfZO7HwCWABPqNnD31e6+N7y4BhgQ3zBFRCSaWBJ6KvBpneWK8LrGTAH+p6ENZjbVzNaa2dqqqqrYoxQRkajielLUzK4B8oG5DW139wXunu/u+X379o3noUVEOrwuMbSpBAbWWR4QXncEM/smMBM41933xyc8ERGJVSwj9GJgiJkNMrPjgElAUd0GZnY68ChQ6O6fxz9MERGJJmpCd/daYBqwAtgIPO3uG8zsHjMrDDebC5wA/MnMSsysqJHdiYhIK4ml5IK7LweW11t3V53X34xzXCIi0ky6UlREJCCU0EVEAkIJXUQkIJTQRUQCIqaTom3dH9/8hOdLKinduouslB7JDkdEJCkCMUKvm8wn5DV1VwIRkeAKxAgdICulB0u/X5DsMEREkiYQI3QREVFCFxEJDCV0EZGAUEIXEQkIJXQRkYBQQhcRCQgldBGRgFBCFxEJCCV0EZGAUEIXEQkIJXQRkYBQQhcRCQgldBGRgGjXd1vUfdBFRP5Pu07oug9621RTU0NFRQXV1dXJDkWk3erWrRsDBgyga9euMX9Pu07ooPugt0UVFRV0796d9PR0zCzZ4Yi0O+7OF198QUVFBYMGDYr5+9pdQj9cZgFUammjqqurlcxFWsDMOOmkk6iqqmrW97W7k6KHyyyASi1tmJK5SMscy+9Quxuhg8osIiINaXcjdJHmuvvuu3nggQeabPPcc89RWlrarP2+//77FBQUcPzxx0fdf6K5O7fccguDBw8mNzeXf/7znw22W7x4McOHDyc3N5dx48axbdu2yLaHH36YYcOGkZ2dzW233RZZP2fOHAYPHsxpp53GihUrjtjfwYMHOf3007nkkksi666++mpOO+00cnJy+N73vkdNTQ3Q9Pv30EMPkZ2dTU5ODpMnT46cYJ8yZQojRowgNzeXiRMnsmfPnsj3PP3002RlZZGdnc1VV10FQElJCQUFBWRnZ5Obm8vSpUujxrVz504uvfRSRowYQXZ2NgsXLoy6r5UrV3LGGWeQl5fH17/+dcrLywGYMWMGeXl55OXlMXToUHr16hX5nttuu43s7GwyMzO55ZZbcPeGP8zmcPekfJ155pl+LK78zT/8yt/845i+VxKjtLQ02SEcYdasWT537twm21x33XX+pz/9qVn7/eyzz/ytt97yn/70p1H3n2jLli3zcePG+aFDh/yNN97wkSNHHtWmpqbG+/bt61VVVe7u/uMf/9hnzZrl7u6rVq3yCy64wKurq9091Fd39w0bNnhubq5XV1f7pk2bPCMjw2trayP7/MUvfuGTJ0/2iy+++IhYDh065IcOHfJJkyb5I488EtlnQ+9fRUWFp6en+969e93d/YorrvCFCxe6u/vOnTsj7WbMmOFz5sxxd/eysjLPy8vz7du3HxHvBx984GVlZe7uXllZ6SeffLLv2LGjybjuu+8+v+2229zd/fPPP/fevXv7/v37m9zXkCFDIj/38+bN8+uuu+6o9/tXv/qV33DDDe7u/vrrr/uYMWO8trbWa2trffTo0b569eqjvqeh3yVgrTeSV9tlyUXaj9kvbKD0X7vius+s/j2YdWl2k23uu+8+nnzySfr168fAgQM588wzAXjsscdYsGABBw4cYPDgwSxatIiSkhKKiop49dVXuffee3n22WdZtWrVUe2+8pWvHHGMfv360a9fP5YtWxZz7Pfccw8vvPAC+/btY8yYMTz66KOYGeeddx4PPPAA+fn5bNu2jfz8fLZs2cLBgwe5/fbbeemll+jUqRM33ngj06dPj3qc559/nmuvvRYzY/To0Xz55Zds3bqVlJSUSJvDSeDf//43J510Ert27WLw4MEAzJ8/nzvuuIPjjz8+0tfD+500aRLHH388gwYNYvDgwbz11lsUFBRQUVHBsmXLmDlzJg8++GDkOOPHj4+8HjlyJBUVFVHfv9raWvbt20fXrl3Zu3cv/fv3B6BHjx6R2Pft2xepMz/22GP84Ac/oHfv3kfEO3To0Mg++/fvT79+/aiqqqJXr16NxmVm7N69G3dnz549nHjiiXTp0qXJfZkZu3aFfs537twZibeuxYsXM3v27MgxqqurOXDgAO5OTU0NX/3qVxv+MJtBJRcJnLfffpslS5ZQUlLC8uXLKS4ujmy7/PLLKS4u5t133yUzM5Pf/va3jBkzhsLCQubOnUtJSQmnnnpqg+3iYdq0aRQXF7N+/Xr27dvHiy++2GT7BQsWsGXLFkpKSnjvvfe4+uqrgSP/la/79bOf/QyAyspKBg4cGNnPgAEDqKysPGLfXbt2Zf78+QwfPpz+/ftTWlrKlClTACgrK+O1115j1KhRnHvuuZH3sKn9/vCHP+T++++nU6eG00pNTQ2LFi1i3LhxTfY5NTWVH/3oR6SlpZGSkkLPnj351re+Fdl+ww03cPLJJ/P+++9H/riVlZVRVlbGWWedxejRo3nppZeO2u9bb73FgQMHOPXUU5uMa9q0aWzcuJH+/fszfPhwfvnLXx7Vp/r7evzxxxk/fjwDBgxg0aJF3HHHHUe0//jjj9m8eTPnn38+AAUFBXzjG98gJSWFlJQULrzwQjIzM5t8X2KhEbq0qmgj6dbw2muvcdlll0VG1IWFhZFt69ev58477+TLL79kz549XHjhhQ3uI9Z2zbV69Wruv/9+9u7dy/bt28nOzubSSy9ttP3LL7/MTTfdRJcuoV/VE088EQjVmFuqpqaG+fPn884775CRkcH06dOZM2cOd955J7W1tWzfvp01a9ZQXFzMlVdeyaZNmxrd14svvki/fv0488wzeeWVVxpsc/PNN3POOedw9tlnNxnXjh07eP7559m8eTO9evXiiiuu4KmnnuKaa64BYOHChRw8eJDp06ezdOlSbrjhBmpra/nwww955ZVXqKio4JxzzmHdunWRmvXWrVv57ne/y5NPPnlUcq4f14oVK8jLy2PVqlV89NFHjB07lrPPPjvy30FD+3rooYdYvnw5o0aNYu7cudx66608/vjjkWMsWbKEiRMn0rlzZwDKy8vZuHFj5L+CsWPH8tprr0V9b6KJaYRuZuPM7AMzKzezOxrYfryZLQ1vf9PM0lsUlUgruf766/n1r3/NunXrmDVrVqNXs8barjmqq6u5+eabeeaZZ1i3bh033nhjZL9dunTh0KFDkXbRRBuhp6am8umnn0baV1RUkJp65BTfkpISAE499VTMjCuvvJJ//OMfQGjkffnll2NmjBw5kk6dOrFt27ZG9/v6669TVFREeno6kyZNYtWqVZEEDDB79myqqqqOKMU05uWXX2bQoEH07duXrl27cvnll0fiOqxz585MmjSJZ599NhJvYWEhXbt2ZdCgQQwdOpQPP/wQgF27dnHxxRdz3333MXr06CP201BcCxcujPR98ODBDBo0iPfff7/RfVVVVfHuu+8yatQoAL7zne8cFe+SJUuYPHlyZPkvf/kLo0eP5oQTTuCEE07goosu4o033oj63kQTNaGbWWdgHnARkAVMNrOses2mADvcfTDwEPDzFkcmcozOOeccnnvuOfbt28fu3bt54YUXItt2795NSkoKNTU1/OEPf4is7969O7t3747aLlYXXHDBUSWOw4m6T58+7Nmzh2eeeSayLT09nbfffhvgiPVjx47l0Ucfpba2FoDt27cDoRFhSUnJUV+H/9UvLCzk97//Pe7OmjVr6Nmz5xH1cwgl/dLS0sjFK3/9618j//Z/+9vfZvXq1UConHHgwAH69OlDYWEhS5YsYf/+/WzevJkPP/yQkSNHMmfOHCoqKtiyZQtLlizh/PPP56mnngJC5YgVK1awePHiRssxdaWlpbFmzRr27t2Lu7Ny5UoyMzNx98jsEXenqKiIYcOGReI9/J/Btm3bKCsrIyMjgwMHDnDZZZdx7bXXMnHixCOO01hcaWlprFy5EoDPPvuMDz74oMl99e7dm507d1JWVnbU+wih2Tw7duygoKDgiGO8+uqr1NbWUlNTw6uvvhqXkkvU2ShAAbCizvJPgJ/Ua7MCKAi/7gJsA6yp/WqWS3C1hVku9957rw8ZMsTPOussnzx5cmQWxSOPPOLp6en+ta99zadNmxaZjfD3v//dMzMzPS8vz8vLyxttV9fWrVs9NTXVu3fv7j179vTU1FTfuXOnHzx40NPS0iKzNOqaOXOmZ2Rk+JgxY/z666+PzCrZuHGjDx8+3PPy8nzmzJl+yimnuHtoJsqMGTM8MzPTc3Nz/eGHH46p/4cOHfKbb77ZMzIyPCcnx4uLiyPbRowYEXk9f/58HzZsmA8fPtwvueQS37Ztm7u779+/36+++mrPzs72008/3VeuXHnEe5uRkeFDhw715cuXH3Xs1atXHzHLpXPnzp6RkeEjRozwESNG+OzZs5t8/9zd77rrLj/ttNM8Ozvbr7nmGq+urvaDBw/6mDFjPCcnx7Ozs/2qq66KtD906FDkfcrJyfHFixe7u/uiRYu8S5cukWOPGDHC33nnnSbjqqys9LFjx0aOs2jRoqj7+vOf/+w5OTmem5vr5557rn/00UeR/s+aNctvv/32I96j2tpanzp1qg8bNswzMzN9xowZDX6OzZ3lYh5l7qOZTQTGufv/Cy9/Fxjl7tPqtFkfblMRXv4o3GZbvX1NBaYCpKWlnfnxxx83+w/Q7Bc2AMmpzUpsNm7cGJ/RRju1fv16nnjiiZjKCyJNaeh3yczedvf8hton9KSouy8AFgDk5+cf0yx6JXJp63JycpTMJSliOSlaCQysszwgvK7BNmbWBegJfBGPAEVEJDaxJPRiYIiZDTKz44BJQFG9NkXAdeHXE4FVHq2WI4Gmj1+kZY7ldyhqQnf3WmAaoROfG4Gn3X2Dmd1jZocn+P4WOMnMyoFbgaOmNkrH0a1bN7744gsldZFj5OH7oXfr1q1Z3xf1pGhryc/P97Vr1ybl2NK69MQikZZr7IlFbeakqHQMhy/uEJHE0r1cREQCQgldRCQglNBFRAIiaSdFzawKaP6loiF9CN1eoCNRnzsG9bljaEmfT3H3vg1tSFpCbwkzW9vYWd6gUp87BvW5Y2itPqvkIiISEEroIiIB0V4T+oJkB5AE6nPHoD53DK3S53ZZQxcRkaO11xG6iIjUo4QuIhIQbTqhd8SHU8fQ51vNrNTM3jOzlWZ2SjLijKdofa7T7j/MzM2s3U9xi6XPZnZl+LPeYGZ/THSM8RbDz3aama02s3fCP9/jkxFnvJjZE2b2efiJbg1tNzP7Vfj9eM/MzmjxQRt7Nl2yv4DOwEdABnAc8C6QVa/NzcBvwq8nAUuTHXcC+vwN4Cvh1//ZEfocbtcd+BuwBshPdtwJ+JyHAO8AvcPL/ZIddwL6vAD4z/DrLGBLsuNuYZ/PAc4A1jeyfTzwP4ABo4E3W3rMtjxCHwmUu/smdz8ALAEm1GszAXgy/PoZ4AIzswTGGG9R++zuq919b3hxDaEnSLVnsXzOAP8N/BwIwj15Y+nzjcA8d98B4O6fJzjGeIulzw70CL/uCfwrgfHFnbv/DdjeRJMJwO89ZA3Qy8xSWnLMtpzQU4FP6yxXhNc12MZDD+LYCZyUkOhaRyx9rmsKob/w7VnUPof/FR3o7ssSGVgriuVzHgoMNbPXzWyNmY1LWHStI5Y+3w1cY2YVwHJgemJCS5rm/r5Hpfuht1Nmdg2QD5yb7Fhak5l1Ah4Erk9yKInWhVDZ5TxC/4X9zcyGu/uXSY2qdU0GfufuvzCzAmCRmeW4+6FkB9ZetOURekd8OHUsfcbMvgnMBArdfX+CYmst0frcHcgBXjGzLYRqjUXt/MRoLJ9zBVDk7jXuvhkoI5Tg26tY+jwFeBrA3d8AuhG6iVVQxfT73hxtOaF3xIdTR+2zmZ0OPEoombf3uipE6bO773T3Pu6e7u7phM4bFLp7e35+YSw/288RGp1jZn0IlWA2JTLIOIulz58AFwCYWSahhF6V0CgTqwi4NjzbZTSw0923tmiPyT4THOUs8XhCI5OPgJnhdfcQ+oWG0Af+J6AceAvISHbMCejzy8BnQEn4qyjZMbd2n+u1fYV2Psslxs/ZCJWaSoF1wKRkx5yAPmcBrxOaAVMCfCvZMbewv4uBrUANof+4pgA3ATfV+Yznhd+PdfH4udal/yIiAdGWSy4iItIMSugiIgGhhC4iEhBK6CIiAaGELiISEEroIiIBoYQuIhIQ/wtSfC7mBQB+xAAAAABJRU5ErkJggg==\n",
+ "text/plain": [
+ ""
+ ]
+ },
+ "metadata": {
+ "needs_background": "light"
+ }
+ }
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {
+ "id": "Sm7cDn8V6M1i"
+ },
+ "source": [
+ "AUC score for the case is 0.86. AUC score 1 represents perfect classifier, and 0.5 represents a worthless classifier.\n",
+ "\n",
+ "**Advantages**\n",
+ "Because of its efficient and straightforward nature, doesn't require high computation power, easy to implement, easily interpretable, used widely by data analyst and scientist. Also, it doesn't require scaling of features. Logistic regression provides a probability score for observations.\n",
+ "\n",
+ "**Disadvantages**\n",
+ "Logistic regression is not able to handle a large number of categorical features/variables. It is vulnerable to overfitting. Also, can't solve the non-linear problem with the logistic regression that is why it requires a transformation of non-linear features. Logistic regression will not perform well with independent variables that are not correlated to the target variable and are very similar or correlated to each other."
+ ]
+ }
+ ]
+}
\ No newline at end of file
![\"Open](\"https://colab.research.google.com/assets/colab-badge.svg\"){kind=icon}
![](\"https://images.pexels.com/photos/159888/pexels-photo-159888.jpeg?auto=compress&cs=tinysrgb&w=1260&h=750&dpr=1\")
\n",
+ "