Project Gameface now allows you to operate your gaming ‘mouse’ using your face. It has also become open source on Android.
Google revealed that Project Gameface, a hands-free gaming ‘mouse’ controlled by facial movements, is now open-source. Android developers can access the code starting Tuesday.
Developers can now incorporate this accessibility feature into their applications. It enables users to control the cursor through facial movements or head motions.
For instance, opening their mouth can move the cursor, and lifting their eyebrows can perform click and drag actions.
Revealed at last year’s Google I/O for desktops, Project Gameface controls the cursor using the device’s camera and a facial expressions database from MediaPipe’s Face Landmarks Detection API.
“Through the device’s camera, it seamlessly tracks facial expressions and head movements, translating them into intuitive and personalized control,” Google explained in its announcement. “Developers can now build applications where their users can configure their experience by customizing facial expressions, gesture sizes, cursor speed, and more.”
Originally designed for gamers, Google has now teamed up with Incluzza — an Indian social enterprise focused on accessibility. They are exploring ways to use Gameface in different environments such as work, school, and social settings.
Project Gameface drew inspiration from Lance Carr, a quadriplegic video game streamer with muscular dystrophy. Carr worked with Google on the project to develop a cheaper and more accessible option compared to costly head-tracking systems.
What we think?
I think the new Project Gameface will be great for many people. Now, anyone can control a game or app just by moving their face. It’s cool that it’s free for developers to use and improve.
This could really help people who can’t use their hands well. I believe it will change gaming and maybe even how we use computers at work or school. Very exciting stuff!
