Healthcare Report Gen AI
An AI tool that helps doctors with patient documentation by transcribing audio sessions and generating a report!
Videos
Description
Objective:
The goal of your project is to assist doctors by generating comprehensive reports based on audio recordings of their interactions with patients. This tool aims to reduce manual data entry and improve efficiency in medical documentation.
Key Features:
- Audio Recording and Uploading: Doctors can either record the consultation directly via the browser or upload a pre-recorded audio file. The tool accepts various audio formats and ensures a seamless experience for users.
- Audio Transcription: Once the audio is uploaded or recorded, it’s processed through AssemblyAI, which transcribes the speech into text. This transcription forms the foundation for generating the report.
- AI-Generated Reports: After transcription, the project uses Google Generative AI to analyze the conversation and extract key medical details. The AI focuses on: Patient Symptoms: Identifying symptoms described by the patient. Duration of Symptoms: Estimating how long the patient has experienced the symptoms. Doctor’s Observations: Extracting any physical examinations or notes the doctor makes. Preliminary Diagnosis: Summarizing the diagnosis provided by the doctor.Doctor’s Suggestions: Capturing treatment suggestions or next steps. Patient Data: Including essential details like the patient’s name, age, and gender.
- Supabase Integration for Data Storage: The reports and patient data are stored securely in Supabase, which acts as your backend database. The database handles storing patient information and the AI-generated reports for easy retrieval and future reference.
- User Interface and User Experience: The tool features a clean and intuitive interface built with ShadCN and Tailwind CSS, allowing doctors to interact with it effortlessly.Dropdown menus let doctors select a patient from a list (fetched from Supabase) and assign the generated report to the corresponding patient.Reports can be edited or reviewed before saving them to the database.
- Next.js and TypeScript: Next.js powers the frontend and backend logic, ensuring a fast and scalable architecture. TypeScript adds type safety to your application, reducing potential bugs during development.
Technologies Used:
- Next.js for building the frontend and handling server-side operations.
- TypeScript for robust typing and error prevention.
- ShadCN and Tailwind CSS for UI components and responsive design.
- AssemblyAI for transcribing the recorded or uploaded audio files into text.
- Google Generative AI to generate structured reports from the transcription.
- Supabase for database management, handling user data, and patient reports.