Effectiveness of Classifiers to Identify Hand Gestures with Motion Capture Coordinate Markers

Authors: Arifur Rahman, Michael Whitlock, Eman Abdelfattah

Abstract—In a world where technology is increasingly moving towards less wires, less devices, and more portability, the ability of a system to accurately interpret hand gestures is extremely valuable. The innovation of small, inexpensive cameras only makes this even more practical. The practicality of such a system rests on the assumption that hand gestures can be recognized from participants based solely on the shape of their hand. The dataset used for this research, while captured with node markers on a special glove, is formatted independent of a marker indexing system and could be applied in conjunction with a marker identification system for real world application of hand gesture classification. This paper presents an analysis and comparison of the effectiveness classifiers have when trying to determine hand gestures using motion capture coordinate markers provided by a Viacon camera. Stochastic Gradient Descent, Decision Trees, Logistic Regression, Random Forests, and Bagging are applied in this study. Overall, the Random Forests classifier performed the best with respect to performance measures such as recall, F1 score, and precision.

Santa Slay

Santa Slay was my first video game in Java and with LibGDX. It is a little gratuitous with the cartoon blood, and the controls are notoriously awkward. It was my first attempt at a one-size-fits-all input system to work across desktop, mobile, and browser. I have since decided to specialize in games that are either for computer or for mobile -- but not both.

SpacedOut

SpacedOut is a fully complete but is no longer available for play. It is an action packed online multiplayer experience for PC, Mac, or Linux. It featured multiple game modes: Deathmatch, Team Deathmatch, CTF and featured programmable loadouts with different armor classes and weapons.

Discontinuum

Discontinuum was a large scale single player RPG game I was working on for 7 months. The scope proved to be too large for a single person. Its graphical assets occupied over a gigabyte in video memory. It featured complex modular sprites thanks to the Liberated Pixel Cup set of art. The project was the first time I experimented with particle effects, GLSL, 2D lighting, masking, and many more. Additionally I contributed some to the LPC art set. Those contributions are available at OpenGameArt.

Odyssey Beta

Odyssey Beta is currently in development by my studio, Bearable Games. It is a remake of the 1997 online computer game written in Visual Basic 6 that turned me on to game design. The Bearable Games website is currently under development as well. This project is not currently open source.

Detective Morpheus

Detective Morpheus was a submission to the LibGDX Winter Game Jam 2020. It was the first project I collaborated with multiple people on. We produced a playable and fun murder mystery game in a few days. We used freely available graphical assets but featured original content for sound and music.

Martian Trail

Martian Trail was to be an idle Android game about a long term mission to Mars. The game was to feature managing a crew, power allocations, life support, and asteroid defense. The project was abandoned to focus on other projects. It was the birthplace of many of the custom GUI classes that I now use in all of my games. The appearance of them can be seen in SpacedOut but it was not until this project that I decided to make them reusable classes.

Earthwind Inspire: Planetarium

The Earthwind Inspire: Planetarium was an art installation at a music festival. It was powered by the Arduino R3 Uno and featured 25 programmable RGB LEDs inside of wire frame planets wrapped with paper. Some of the planets also had electroluminescent wire to form rings and a laser from a space ship.