Smartwatch Tracks Full-Body Movement With Sound

Cornell researchers' EchoMotion system uses a watch's speaker and microphone to estimate joint positions without added hardware.

Updated on Nov. 12, 2026 in Fitness

Smartwatch Tracks Full-Body Movement With Sound

Cornell researchers developed EchoMotion, a system that tracks whole-body movement using a smartwatch's speaker and microphone. On an unmodified Samsung Galaxy Watch 6, it estimated joint locations with an average error of less than four inches for people new to the system.

Why it matters

Commercial smartwatches carry only one speaker-and-microphone pair, and the work shows that existing sensors may support full-body motion tracking. A brief calibration reduced the error further, suggesting wearable fitness and health tracking could be done without cameras or extra hardware.

Testing used 10 volunteers during development and 15 new volunteers on an unmodified Galaxy Watch 6, with joint positions checked against camera data. A 30-minute session drained 5% to 6% of the watch battery, but the report does not state performance across a broader population.

The players

Cornell University

A private Ivy League research university in Ithaca, New York, whose researchers developed the EchoMotion system.

SciFi Lab

A research group at Cornell University, directed by Cheng Zhang, that produced the EchoMotion work.

The details

The researchers built a 3D-printed watch replica with two speaker-and-microphone pairs, then had volunteers wear it while performing 18 exercises. EchoMotion sends out ultrasonic sound and uses a small AI model to interpret echoes from moving limbs, and the same model worked on a Galaxy Watch 7 and a Google Pixel Watch 3 without retraining.

Timeline

  1. Oct. 13: Research paper presented at a conference in Shanghai.

  2. Nov. 11: Cornell released a report on EchoMotion.

Big Picture

EchoMotion extends the wearable sensing work of Cornell's SciFi Lab by applying acoustic sensing to whole-body tracking on commercial smartwatches. It points toward fitness tracking that relies on hardware already in wrists rather than added cameras or sensors.

If EchoMotion reaches consumer devices, owners of existing smartwatches could gain full-body movement tracking through a software update rather than buying new hardware. Workout logging and form feedback would depend on whether manufacturers adopt the approach.

The takeaway

Wearables may gain new capabilities from software alone, so check whether your current watch receives updates before buying new fitness hardware.

Further reading

Explore more fitness coverage on Wisevoter for context on wearable movement tracking.