Rohith Perumandla
Data Scientist, AI/ML Engineer
Hey there đ, welcome! Glad you stopped by.
I'm Rohith â Graduated with Masterâs in Data Science from DePaul University, Chicago. I also work as a Graduate Research Assistant - AI/ML Engineer at DePaul.
Before grad school, I worked as a Data Scientist for 2 years at SetuServ, a Text Analytics and Consumer Insights firm based in India. I earned my Bachelor's degree in Electronics and Communication Engineering from RGUKT Basar.
My passion for AI and Data Science sparked during my 12th grade â I was intrigued by how AI and ML work. I began my journey into Machine Learning through various Andrew Ngâs course on Coursera, and was fascinated by how mathematics powers machine learning algorithms. I started as a Data Science intern at SetuServ and transitioned into a full-time role â and that's how my journey in Data Science began.
Currently working on
Vector Referral
Referral Management tools for Dental Practice Specialists and General Practices.
Plan Todo
AI Productivity tool to help stay focused and complete tasks.
Experience
I developed a digital-first referral management platform designed to modernize the dental care ecosystem and am currently testing it with industry advisors. The platform bridges the gap between general practitioners and specialists by using AI to replace fragmented workflows with a seamless, end-to-end digital experience.
Key Responsibilities & Impact
- Greenfield Product Development: Leading full-lifecycle ownership of a platform that reimagines patient discovery, booking, appointment status tracking, and visit management.
- Intuitive UI/UX Design: Designing high-fidelity, interactive components that reduce administrative friction and improve diagnostic clarity.
- Cross-Functional Collaboration: Working closely with dentists, patients, and insurers to align clinical requirements with a modern, user-centric interface.
- Strategic Growth: Using continuous feedback loops and data insights to expand dental care access, increase pricing transparency, and improve long-term oral health outcomes.
- Rapid Iteration: Driving fast cycles of discovery and validation to ensure the roadmap stays ahead of the evolving needs of modern dental practices.
As an AI/ML Research Engineer at DePaul University, my focus revolves around building innovative conversational speech systems designed specifically for dementia care. Through the integration of advanced Large Language Models like Llama3 and Phi3, these systems aim to engage patients in meaningful dialogues while monitoring their cognitive health. I led the cross-functional team in the technical development of the project.
One of the proudest moments was developing a module that tracks cognitive status by analyzing linguistic biomarkers; this work has been crucial in providing healthcare professionals with real-time insights into patient conditions. See Publications
Additionally, I created a Novel Topic Detection feature that personalizes conversations based on individual patient interests. The EMA Conversation Module I implemented allows for immediate cognitive assessments during interactions. My passion lies in pushing the boundaries of technology to create empathetic AI solutions that genuinely enhance lives.
- End-to-End NLP Pipelines: Developed an extensive Data Science pipeline focused on extracting valuable insights from product reviews across numerous e-commerce websites.
- Advanced Sentiment Analysis: Implemented advanced Natural Language Processing models (including pre-trained BERT) that significantly improved our ability to gauge customer sentiment.
- Scraping Automation: Deployed over 100 custom-built web scrapers using Python frameworks like Scrapy and BeautifulSoup, streamlining data collection.
- Efficiency Gains: Reduced manual data collection effort by nearly 50% and achieved a remarkable increase in overall data extraction efficiency by 40%.
- Competitive Intelligence: Collaborated with stakeholders to translate business objectives into actionable insights, directly enhancing competitive intelligence for major e-commerce players.
Research Work
Weâre pushing the boundaries of dementia care using AI. For the past 2 years, our team has been building a Conversational Speech System for robots and various assistive modules to support both dementia patients and their caregivers. You can read our recent publication on arXiv: Enhancing Dementia Care with AI .
Our research began with the development of a conversational AI Speech system using NLP techniques. I fineâtuned openâsource models (Llama 3 and Phi-3 7B ) on the cleaned and preprocessed DementiaBank and Indiana dataset to power natural, contextâaware responses.
To make interactions more engaging and humanâlike, we implemented several specialized modules:
- TopicâShift Awareness & Triggering: Decides when to introduce a new topic or remain on the current one
- TurnâTaking Controller: Manages speaker changes for smooth, natural dialogue
- Conversation Flow Monitor: Tracks and adapts the pacing of exchanges
- Dialogue State Tracker: Maintains context across turns
- Cognitive Status Tracker: Continuously evaluates user cognitive state using 6 different Linguistic Biomarkers
Core goal: Predict the cognitive status of people with dementia based on their speech and text using Linguistics (extracting subtle cues from grammar, syntax etc..).
- Extract features like altered grammar, anomia (fillerâword usage), pragmatic coherence, prosodic cues, and slurred pronunciation
- Train machineâlearning and deepâlearning models to produce a composite cognitiveâstatus score
Technology stack:
- Frameworks & Libraries: Python, PyTorch, Hugging Face Transformers, NLTK, Stanford Parser
- Transformer Models: Llama, Gemma, Phi-3, BERT, MobileBERT
- MachineâLearning Algorithms: Logistic regression, Random Forest, etc.
- Cloud Platforms: Google Cloud Platform (deployment), Azure (auxiliary services)
- Speech Technologies: TTS, STT, ASR integrations
HCI Collaboration: In partnership with Indiana Universityâs HCI lab, we built an Progressive Web APP that:
- Visualizes each participantâs cognitiveâlevel metrics
- Offers interactive memoryâenhancement games
- Includes appointmentâsetting and reminder features
- Is refined through workshops with caregiverâpatient dyads
Next steps: Integrate the complete platform with QT and the Buddy robot for inâhome trials, enabling more natural, autonomous interactions with people living with dementia.
Current Focus this summer 2025
- đ Building my portfolio
- đ ď¸ Working on exciting projects, like an AI productivity tool to help us stay focused and complete tasks in todayâs distracting world
- đ¤ Developing and integrating a conversational speech system into companion robots shown in below video using the Robot Operating System (ROS) communication protocol, enhancing natural interactions through synchronized expressions and hand gesturesâaimed at improving communication and engagement for older adults during Summer 2025
- đ§ Staying up to date with the latest AI trends and sharing insights through my newsletter
Want to connect or collaborate? Feel free to reach out or explore more of my work below.
news
| June 14, 2025 |
â
Graduated with my Masterâs in Data Science
|
|---|---|
| June 17, 2025 |
â
Completed my Thesis Defense meeting and passed
|