AI-Driven App Detects Early Signs of Disease Using Only a Smartphone Camera
“We want to squeeze as much capability as possible out of the smartphones for diagnostic purposes without the need for any additional hardware.” says Remi Koscielny, cofounder and CEO of MX Labs.
Startup Shen.AI is excited to announce its development of vital-signs monitoring using only real-time video from a smartphone camera, making advanced health management available anytime and anywhere to anyone. Using artificial intelligence, the application can recognize subtle signs of illness with mathematical precision, leveraging ubiquitous technology to democratize healthcare.
“Mobile phones with a camera are the most widely available yet least exploited health-analysis tools,” says Remi Koscielny, cofounder and CEO of Shen AI. “We want to squeeze as much capability as possible out of the smartphones for diagnostic purposes without the need for any additional hardware.”
While over five billion people worldwide use mobile phones, the World Bank and the World Health Organization report that at least half of the global population lacks access to essential health services.
“Sixty-three percent of people in the world have mobile phones,” Przemek Jaworski, cofounder and CTO of Shen AI, says, “and 2.87 billion of them have a smartphone equipped with a camera. Imagine turning every smartphone into a health-assessment device. That’s our mission.”
Health monitoring from Shen AI starts with a short video of the subject’s face. The app stabilizes the real-time images and maps them to a customized three-dimensional face-geometry mesh. Computer-vision techniques then extract data patterns from facial skin, eyes, and other features such as tiny movements of the head and muscles. In order to analyze heart activity and extract vital signs, the engine uses remote photoplethysmography (rPPG), a contactless technique of recording blood pulsations in the skin vasculature.
Based on advanced data engineering and the latest research results, Shen.AI’s technology can measure various cardiovascular parameters (blood pressure, heart rate, and heart-rate variability), provide visual biofeedback, assess skin condition, and make a preliminary diagnosis with recommended next steps. The technology, named Shen AI, requires only a smartphone, tablet, or computer with a camera. No other devices are needed. The Shen AI platform will be available as a software development kit (SDK) for app developers and hardware manufacturers.
Shen AI aims to develop a family of mobile apps starting with Heart Monitor, which is already available for free on Apple’s App Store and Google Play. Heart Monitor has been designed as a support solution for monitoring cardiovascular health and detecting hypertension, which could significantly improve access to early diagnosis of hypertension, a leading preventable risk factor for cardiovascular diseases.
More blog posts
Sagittis et eu at elementum, quis in. Proin praesent volutpat egestas sociis sit lorem nunc nunc sit.
How to choose a vendor for vital signs monitoring
Choosing a vital signs monitoring provider can be tricky. This guide breaks down what truly matters — from accuracy and inclusivity to integration, user experience, and long-term scalability — so you can select a solution built for real-world performance.
Multimodal approach by Shen AI using remote photoplethysmography (rPPG) and ballistocardiography (rBCG) for heart rate and heart rate variability prediction
Shen AI’s multimodal rPPG+rBCG system delivers high-accuracy, equitable heart rate and HRV monitoring across 5,000+ participants, improving SDNN by up to 18% in darker skin tones.
Facial video photoplethysmography for measuring average and quasi-instantaneous heart rate
Facial vPPG matched ECG with up to 1-bpm precision - even for 4-second, quasi-instantaneous heart rate readings - showcasing the potential of accurate, contactless monitoring.