AI-based pose detection for physical rehabilitation software

Camera-based markerless motion analysis
for MSK rehab

AI pose detection in digital physical therapy

While the COVID-19 crisis, telehealth adoption has grown from 1% to 80% in highly affected territories – ASPE. During the pandemic, patients switched from offline physical therapy visits to online telehealth solutions.

The digital-physical therapist platform takes this to the next level by using AI-based human motion capture to monitor exercises in real-time.

Physical therapy can improve MSK (musculoskeletal) outcomes but used to only be available in person. Earlier, human movement analysis required markers or sensors placed on the participant, expensive cameras, and trained personnel to assist. Not anymore.

The current developments of built-in cameras (tablets, smartphones) and AI-based pose detectors made it possible to track human motion with high accuracy and in real-time, with markerless motion capture, anywhere.

AI pose detection in digital physical therapy

The business value of telerehabilitation software:

150% ROI

5 hours

saved by therapists per week


faster patients recovery


times more patients

MSK screening with AI

Abto Software delivers the technology for real-time markerless motion capture that ensures skeleton tracking and high-quality human motion recognition that can be applied for a wide range of movements and exercises using just cameras of mobile devices or PC.

AI pose detection, specifically built to facilitate a smooth integration of MSK rehab platforms to empower personal physical therapists.

Check how it works

Abto’s technology is meant to transform virtual physical therapy care by using a live video stream, from a mobile or PC camera and advanced AI motion tracking techniques to replace bulky sensors and accurately perform complex analyses to empower physical therapists. No additional hardware or software is required.

Backed by years of experience, our engineers built a custom real-time AI-based human body motion analysis technology for MSK rehabilitation therapy.

Try out motion analysis technology for MSK rehabilitation therapy


Steps for utilizing AI-powered markerless pose detection in rehab software

High accuracy real-time human motion tracking process for MSK telehealth:
Integrate Abto’s technology into your mobile and web-based rehab software
Add voice and written instructions for better user guidance and optimal performance
The AI pose detection solution will recognize the user’s movement on the fly and provide real-time feedback by voice and text
The solution will automatically store the execution details in a digital format
The user and the therapist will see dashboards with the results online
AI-based pose detection for physical rehabilitation software. Steps for utilizing AI-based 
markerless pose detection. Case study by Abto Software

1. Make sure to have no other people in the background
2. Wear contrasting clothes when exercising in front of the camera to avoid blending with the background
3. Use a mat or tourist pad contrast to your floor to determine the dimensions
4. The user should start the exercise after voice instruction

Benefits of pose estimation technology for MSK rehabilitation by Abto

Using pose detection technology in telerehabilitation, established businesses can achieve:

icon Frame-14025

Business growth

AI-based digital therapeutics, markerless motion capture in particular, allow to automate of therapists’ routine work and can service 1.6 times more patients, multiplying the clinic’s capacity. 
icon Frame-14025-1

Staying ahead of the competition in the MSK rehabilitation market

Digital MSK care is booming, and there is a risk of losing business if not adapting to new demands. Global digital health market for musculoskeletal conditions to hit USD 20.5bn by 2026, with CAGR of 18.2% – Fortune Business Insights.
icon Frame-14025-2

Own technology

The development of its own custom camera-based motion detection software for MSK rehab takes time, but Abto’s help will minimize it. With us, the customer gets all benefits of keeping IP: the unlimited possibility to scale it for different exercises and avoid paying any usage fees.
Value for physical therapists and medical workers: 

Value for physical therapists and medical workers: 

  • Time-saving – the therapist has no need to attend every patient training
  • Automatic data collection & analysis – all patient data is stored, structured, analyzed and visualized on the online dashboards
  • Data-driven care – using precise motion detection data from MSK screening means more accurate prescriptions and recovery/treatment plans
  • Custom-configured alerts – can be set up to automatically notify you of important events, such as a patient missing two training sessions in a row or a dramatic decrease in performance

For MSK patients, AI pose estimation technology offers: 

  • No hardware or sensors – a smartphone or laptop with a camera is your only tool for accurate measurement of the accuracy and progress
  • Flexibility in exercise timing – exercise anytime without the need to synchronize your time with the therapist
  • Precise video guidance – real-time human motion recognition & guidance during MSK therapy exercising identifies errors and leads patients with audio and video cues
  • Progress tracking and visualization – performance data dashboards allow you and your therapist to compare stats from recent sessions and previous weeks or months
  • Storage and access to recorded training videos
For MSK patients, AI pose estimation technology offers: 

Abto Software’s sensorless tech detects movement and gives real-time feedback sans clinician support.

  • 32 joints monitored
  • Hardware independent
  • Markerless
Human pose estimation and analysis software by Abto:

Human pose estimation and analysis software by Abto:

  • Has no usage fee
  • Runs on iOS, Android, edge devices, and high-load servers – compatible with smartphones, tablets, and computers
  • Provides extended key points skeletons
  • Works without markers or sensors
  • Shows custom analysis for single and multiple persons
  • Supports a wide range of different movements/exercises
  • Provides motion detection & tracking in real-time
  • HIPAA-compliant, FDA
  • Shows high accuracy: different accuracy metrics can be supported

Areas of use

We develop the next generation of affordable markerless motion capture for integrated care for MSK patients aimed at improving clinical outcomes and shortening recovery times.

Computer vision technology that provides accurate skeleton measurements in real-time can be used in:

  • Clinical assessment
  • Sport performance
  • Animation

In Healthtech, real-time motion analysis software can improve:

  • Digital therapeutics
  • Digital rehabilitation
  • Elderly care/geriatric physical therapy
  • Orthopedics and sports medicine
  • Prosthetic design and fitting
  • Surgical planning
  • Spinal rehab

CV-based movement analysis software benefits:

  • Patients undergoing physical therapy for rehabilitation
  • Patients with chronic conditions
  • Elderly people at risk of falls
  • Disabled people
  • Medical professionals and geriatric physical therapists
In Healthtech, real-time motion analysis software can improve:

Empower your digital physical therapy platform with camera-based motion analysis technology

As a part of the telerehabilitation platform, physical rehabilitation computer vision assessment can:

Empower the physical therapist

Empower the physical therapist

The physical therapy AI platform stores, digitalizes and visualizes the execution of the exercises in real-time. Users’ movements are tracked and rated while receiving tips on how to speed up recovery and reach health and wellness goals.

By working out in front of the phone camera, patients can receive real-time feedback on movements and prevent injuries.

Afterward, the patient and physical therapist can review all results offline and see the progress for the target period.

Release the physical therapist from the most routine and time-consuming tasks

Release the physical therapist from the most routine and time-consuming tasks

The AI physical therapy platform provides real-time guidance and motivation for patients during exercise execution via voice and visualization on-screen.

The physical therapist receives a notification once the exercises are completed, and results are available for review and approval.

Such an approach increases the number of patients one physical therapist can service on daily basis. Also, using data-driven solutions MSK screening optimizes physical therapy outcomes, resulting in more efficient patient management and shorter recovery times.

Early MSK problems detection 

Early MSK problems detection 

With automatic skeletal recognition, accurate and instant analysis allows proactive detection of musculoskeletal problems, risks, and various pathologies, enabling timely treatment and prevention.

This way, human body motion analysis, powered by AL and ML allows for assessing, predicting, preventing, and managing MSK injuries.

Will AI replace physical therapists?

The answer is no. Research shows that the patient-doctor relationship is crucial and influences the entire treatment experience and cannot be eliminated e.g. AI brings MSK benefits like more accurate results and faster rehabilitation.

As stated by NCBI in their cross-sectional study about physical therapists’ attitude toward using AI:

  • 72,8% of surveyed participants agreed that PT AI significantly minimized the workload of therapists
  • 82,7% agreed that AI can facilitate patient care
  • 53,9% agreed that AI can help prevent disease

We at Abto Software can assure you that AI (and AI-based markerless motion capture) isn’t going to replace but will positively complement in-person services, providing enhanced patient outcomes.


Depending on your business needs, our human pose estimation technology can be expanded with the following functionality.

  • Adding age and gender normative analysis
  • Automatic day-to-day progress comparison
  • ML-generated exercises’ recommendation, e.g. actionable plans to improve joints’ functional status
  • Asymmetries collecting with visual alerts
  • Skeleton graph and measurement

Let us help you building your physical rehabilitation software!

Contact us

Tell your idea, request a quote or ask us a question