Hyundai patents a control method that understands pointing
Your finger, combined with voice commands, could become a powerful tool.
As cars get more complex, automakers continue to find new ways for us to interact with them. Some, like voice commands and virtual assistants, have proven helpful, while others — BMW’s and VW’s attempts at gesture control, for example — haven’t quite caught on.
Hyundai and Kia have a potential solution that combines those two modes to accept voice commands that are less specific — and more pointy.
Point but don’t click
U.S. patent application 2026/0260654 A1, Method and Apparatus for Performing Voice Command Based on Gesture Recognition, describes a system that can combine a verbal command with what you’re pointing at to control your target. It would use cameras, other sensors, or a combination to monitor hand gestures in the cabin and decipher them when a voice command lacks necessary information like location.
The filing also mentions that the system could determine which seat the uttered voice command came from and use that to look specifically at the hand gestures of that occupant, untangling them from any other nearby or overlapping hand movements. The system could include additional microphones and sensors for passengers in rear rows, as well as push-to-talk buttons at each seat location, but that’s less fun.
Controlling physical systems
These interactions could control physical vehicle systems as well as answer questions about controls. Perhaps you want to open a window — just point at it and say “open” (we’ll assume the “sesame” part is optional). Or you could touch a button — the description uses the somewhat cryptic Auto Hold as an example — and ask what its function is.
There’s no mention of custom command names, but we can see a market for a Harry Potter command pack—lumos, nox, silencio, engorgio! Perhaps the deep-learning models baked into the system would be able to understand your meaning.
The filing notes that an application for the same technology was submitted to South Korea’s patent office last year. Like any potential patent, this doesn’t necessarily portend that a system like this will go into production. It’s simply the manufacturer’s request that a patent be granted. So you can point and shout all you want for now, but your car won’t understand.
