Medical Chatbot Unimedic πŸ€–πŸ’¬

Links & Resources

Motivation

This project was based on the medtorch repository (winner of the 2020 Pytorch hackathon). Both the application and the deployment were very interesting processes, showing us in a challenging way how we could tackle real-world problems with the help of various Deep Learning tools.

Features

  • βš›οΈ Interface created with React-Native.
  • πŸƒ Authentication using Mongo DB.
  • πŸŒ€ Chatbot powered by GiftedChat.
  • πŸ”₯ Powered backend with models built with PyTorch.

Screens

Login

Login Screen Login account

Intro

Welcome uniMedic Let's get started!

Patient interface (chat)

Invalid Image Valid Image Result with segmentation

Doctor interface

Invalid Image Valid Image Result with segmentation

Invalid image Valid Image Result with segmentation

Diagnosis PDF

Invalid image

Installation & Setup

Follow these steps to set up your React Native environment. I also recommend that you follow this tutorial in order to properly configure Android Studio. To successfully connect your mobile phone and/or emulator, you need to install ADB and set your environment variables.

Once you have installed the packages with npm i, you can run the following command:

npm start

This will automatically open Expo in your browser. I recommend you use Expo Go to run the app directly on your phone without using the USB cable.

Next steps

  • 🐼 More PyTorch models for vision tasks (lungs, breasts).