Piano Playing Robot: From Pianolas to ABB Arms

A piano playing robot sounds like a recent idea, but machines have pressed piano keys for more than a century. Paper rolls, electromagnets and humanoid hands each took a turn. This post follows that line from the pianola parlour to the Disklavier, then to the robot pianists in the news this month. It also asks where ABB robots fit, starting with the YuMi that conducted an orchestra in 2017, and what still blocks a robot pianist in the home.

A pianola with a paper roll in place on its tracker bar. Photo: Thomas Quine / Wikimedia Commons (CC BY 2.0)

How pianolas taught machines to play

The pianola was the first mass-market piano player. Aeolian's trademark dates to 1897, and a company catalogue followed in 1898. The owner pumped the pedals, a punched paper roll unwound across a tracker bar, and air drawn through the holes moved the hammers. According to a Spectator Australia piece of 14 October 2026, pianolas made up more than half of American piano production by the early 1920s. Stravinsky wrote a piece for the instrument, though he found its rigid mechanics limiting. Anyone who could pump the pedals could play a piece they had never learned, which was the whole appeal.

A hand fitting a punched music roll into a pianola. Photo: Steve Bowbrick / Wikimedia Commons (CC BY 2.0)

Reproducing pianos tried to capture one pianist rather than just the notes. The Welte-Mignon, introduced in 1904, recorded how a performer played and could replay it on a piano in another room, keeping the timing and the loud and soft passages of the original. Much of the machinery sat inside the piano case. Listeners could hear famous players of the day without leaving home, which is close to what people now expect from recorded music. The limit was the same as with the pianola: the machine repeated only what had been punched or recorded.

A Steinway grand fitted with Welte reproducing equipment at the Technisches Museum Wien. Photo: KarlKunde / Wikimedia Commons (CC BY-SA 3.0)

Two later machines moved the idea toward robots. In 1984 Waseda University introduced WABOT-2, a humanoid that read sheet music with a camera and played an electronic organ with both hands and both feet. In 1987 Yamaha launched the Disklavier, an ordinary acoustic piano with sensors and electromagnets inside, so it could record a performance and play it back with the keys moving on their own. WABOT-2 showed that a robot could read and play. The Disklavier showed that a real piano could play without a pianist.

The inside of a Yamaha Disklavier upright, with its sensor and solenoid electronics. Photo: Tjako / Wikimedia Commons (CC BY-SA 3.0)

Robot pianists on stage and in labs now

Today's robot pianists come in two kinds. One is a rig mounted over a keyboard, with a finger for each key or a few fingers on a sliding carriage, used for testing and sampling instruments. The other is a humanoid hand that tries to play like a person. The Spectator piece lists robot pianists shown at the World Robot Conference in Beijing, at Gulangyu Piano Art Week in China and in a Swiss project called Robotic Piano Maestro. Its author says China, the US and Japan lead, and argues the machines give accuracy, not feeling.

A mechanical finger pressing a piano key in a robot rig at the Vienna Symphonic Library. Photo: Vienna Symphonic Library / Wikimedia Commons (CC BY-SA 4.0)

ABB has a real link to music. In September 2017, in Pisa, its dual-arm YuMi IRB 14000 conducted the Lucca Philharmonic Orchestra while Andrea Bocelli sang. Conductor Andrea Colombini taught it by guiding its arms through his movements during rehearsal, and engineers then refined the motion in RobotStudio to match the music. The whole process took about two days, according to ABB's press coverage of the concert. YuMi played no notes, but the job needed what piano playing needs: repeatable motion, tight timing and a robot that is safe near people.

ABB's YuMi conducts the Lucca Philharmonic with Andrea Bocelli in Pisa, 2017. Photo: ABB

No source says ABB has built a piano playing robot, so what follows is a possibility, not a product. A key press needs a gentle, well timed touch and a repeatable path, which suits a small cobot such as the GoFa CRB 15000 or a YuMi, both built to work close to people. A team would plan and test such a cell in RobotStudio before touching a real keyboard. The harder question is musical. The arm must decide how hard to press each key, and no robot controller does that out of the box. ABB's robot use cases show the jobs it does handle today.

YuMi rehearsing with a violinist at the Teatro Verdi in Pisa. Photo: ABB

Where robot pianos could go next

For homes, the likeliest product is a piano that plays itself, as the Disklavier already does, perhaps with a teaching mode that lights keys and plays duets with a student. A full humanoid pianist is a different matter. Hands that match a human's speed and touch are expensive, and nobody has shown that a household buyer wants one, so cost is the first open problem. Safety is the second. An arm near a child or a pet needs force limits and a clear way to stop.

A humanoid robot seated at a grand piano at the Shanghai Science and Technology Museum, 2009. Photo: Jakub Hałun / Wikimedia Commons (CC BY-SA 4.0)

Factories offer a more practical market than parlours. Instrument makers already use robots for sanding, finishing and testing, as the post on musical instrument manufacturing describes. A robot that plays every key of a new piano at a fixed force could check the action and the tuning before it ships. The job is repeatable and measurable, and tedious for a person, which is where cobots tend to take over first. It would also suit a compact ABB arm such as the IRB 1300 or IRB 1200, though no source says it has happened.

A Yamaha Disklavier grand with a screen showing a score, at the 2017 NAMM Show. Photo: Jim J / Wikimedia Commons (public domain)

Skills may matter most of all, and they are the hardest gap to close. Teaching a robot to play music well takes someone who understands both phrasing and motion programming. Lead-through teaching, as used on the YuMi conductor, lowers the bar: a musician moves the arm by hand and an engineer polishes the result. If that approach spreads, the first useful piano playing robots will probably come from musicians who learned a little robotics. The Spectator's point about accuracy without feeling still holds, since the machine replays only what a person decided.

Moving an ABB GoFa arm by hand to teach it a motion. Photo: ABB

Innovation

AI solutions for effortless ABB robot control.

Automation

Robotics

ceojohntran@chatwithrobot.net

+84905311611

© 2025. All rights reserved.

qtran1215@gmail.com