ARM demos OpenCL gesture recognition for XBMC with new Mali GPUs at CES 2014
#1
ARM Mali GPU Demos at CES 2014 – 4K 3D UI and Games, ASTC Texture Compression, XBMC + Gesture Recognition, and HEVC Video Decoding
http://www.cnx-software.com/2014/01/23/a...-decoding/
Quote:Phill Smith, Demo Manager at ARM, has filmed and uploaded four very interesting demos of what new features will be possible thanks to new generation ARM Mali-450 and Mali-T6xx GPUs including 4K 3D user interfaces and games, ASTC texture compression, and OpenCL accelerated gesture recognition and HEVC / H.265 video decoding.

The next demo show OpenCL accelerated Eyesight gesture recognition in Arndale board powered by Exynos 5250 SoC with ARM Mali-T604. The board runs Linux and is connected to a standard (and crappy) Logitech webcam. It can follow hand gestures with OpenGL acceleration, something that is not possible with the dual core Cortex A15 CPU only. They’ve also integrated the demo with XBMC, and showed how to navigate XBMC user interface with your hand only, no remote needed.
Gesture Recognition with XBMC
Guess they used Eyesight gesture recognition software for input and feed it to XBMC via JSON-RPC or EventServer? http://eyesight-tech.com
Reply
#2
I'm surprised they used XBMC and a mouse type gesture for control. Imo that's XBMC control at it's worst.
Looks like moving the hand was moving the mouse cursor, close hand was Return or Left Click and wave hand is Escape.
Reply
#3
You could expand this to allow for better and more sensical gesture, OpenCV to detect the hand using convex hull detection and other properties. OpenCV even has openCL support too. All do able if with a bit of a challenge.
Reply
#4
The point was they use accelerated openCl for the gesture recognition while also doing openGL ES for Xbmc.

They just want to show their chip can do both at the same time!

Anyway, cool they chose XBMC as demo app.
Reply

Logout Mark Read Team Forum Stats Members Help
ARM demos OpenCL gesture recognition for XBMC with new Mali GPUs at CES 20140