Full body and hands gesture tracking
by Abhishek Kumar Singh (speaking)
Objective
-
It helps people to develop motion and gestures tracking multiplayer applications.
-
This talk presents a brief introduction on OpenNI, Tango server and blender game engine
Description
This is my GSoC project that deals with integration of whole body motion and hand gesture tracking of astronauts to ERAS(European MaRs Analogue Station for Advanced Technologies Integration) virtual station. Skeleton tracking based feature extraction methods will be used for tracking whole body movements and hand gestures, which will have a visible representation in terms of the astronaut avatar moving in the virtual ERAS Station environment.
It will help astronauts in getting familiar with the their habitat/station, the procedures to enter/leave it, the communication with other astronauts and rovers, etc. Thus preparing themselves by getting a before hand training in the Virtual environment will boost their confidence and will reduce chances of failures to great extent, ultimately resulting in increase in the success rate of the mission.
This talk will focuses on developing motion tracking applications. Also demo of work done will be shown.
Benifits :
- Audience will learn how to use OpenNI+NITE python bindings to track a Skeleton.
- How to publish Skeleton data on Tango server(a cross platform distributed system) so that other client applicatoin can use that data
- How to write a blender client which uses these data to map them to a model(here astronaut's avatar)
- Eventually avatar in virtual environment will be controlled by the user body gestures in real world.
Requirements
Nothing apart from presence of active listeners.
Speaker bio
Speaker is passionate about open source technologies and an active open source contributor. A Graduate in Computer Science and Engineering major from Amrita university and also a 2014 GSoCer.
He has been working on this project with IMS (Italian Mars Society) as a part of my GSoC(Google Summer of Code) project. He has experience with computer vision and Kinect technology as his final year project was also a part of it.
Links
- https://wiki.mozilla.org/Abhishek/IMS_Gsoc2014Proposal
- Link to PyTango (Python bindings for Tango server)
- http://www.tango-controls.org/static/PyTango/latest/doc/html/index.html
- Link to blender python bindings :
- http://wiki.blender.org/index.php/Doc:2.4/Manual/Extensions/Python
- http://www.blender.org/documentation/blender_python_api_2_70_release/contents.html
1
▼
Hi Abhishek,
Request you to share more details, and link to python libraries that you will be discussing.
1
▼
Hi Konark,
I have added links to some python library I will be using and also added benifit section describing what audience will gain from this talk.
1
▼
I'd really like to see this through - it's an unconventional talk, definitely makes for an interesting half an hour. Good luck!