you are not logged in: Join Now | Log In
Software

Software: Utilities

Templates allow novices to create their own floor or Web based exhibits. Universal Modules allow more advanced developers to combine, branch, and write their own modules that can act as building blocks for new Exhibits.

Open Exhibits TUIO Kinect

Open Exhibits TUIO Kinect

First Posted: November 14, 2011
v1.0.2-stable Updated: July 26, 2011

This version has been superceded. Click here to view the latest version of TUIO Kinect.
Project Summary

Open Exhibits TUIO Kinect is a simplified standalone installation that captures and tracks Microsoft Kinect depth information and publishes them as TUIO cursor events. For easier installation we highly recommend that you use: TUIO Kinect Complete

ABOUT THIS CONTRIBUTOR

Profile picture for David DeBonis

David DeBonis

Owner / Principal Engineer

Total Activity:  7
Downloads:  2
Article Views:  0
Shared:  0
Tweets:  0

Uploads:  3
Comments:  2
Favorites:  0
Likes:  0
Emails:  0

Profile picture for Ben Kuper
Ben Kuper commented
8 months ago
Hi, first of all thanks for contributing to this wonderful community ! But i really don't understand why do you rely on the libfreenect driver since it's more and more deprecated in favor of the more powerful OpenNI and Microsoft SDK ones. I think if the aim is to replace MT-Kinect (and maybe become a standard tool for quick & easy tuio-kinect interaction), it would really be a good choice to switch to OpenNI or MS. That way not only more people would be able to contribute and offer improvements, but more people would simply use it, as most people that are currently working on the Kinect only have the 2 drivers installed. Thanks again, Ben
Profile picture for David DeBonis
David DeBonis commented
8 months ago

Thanks for the input Ben.

The key feature of this is to enable TUIO interactions which really only needs depth information from the Kinect device and not all of the controls exposed in any of the APIs. My primary goal is for the utility to be as lightweight as possible.

That being said, my plan is to migrate to the Microsoft SDK in a future iteration.

David

Profile picture for Omar Juarez
Omar Juarez commented
7 months ago

Please add MacOSX support.

I have a big project comming using Open Exhibits and TUIO with Kinect.

I have tried this utility in Windows and works quite well, would be better to add some settings support for min/max distance as well as blob size.

But is there any way you could make a binary for MACOSX ???

 

Thanks

Profile picture for Charles Veasey
Charles Veasey commented
Open Exhibits Staff
7 months ago
Hi Omar,

I'm afraid we won't be coming out with a Mac version anytime soon. Thank you for your comment.

Profile picture for Thanavee Paungpairoj
6 months ago

Hi, 

 

Thanks for making this utility tool. I have a problem with it though. It can detect touch motions just fine in the Contour, but it seems like it does not transfer the data to my Multitouch application. I also tried it with modules and it does not work either. Can you help me or explain what I did wrong? Many thanks.

 

Profile picture for David DeBonis
David DeBonis commented
6 months ago

Hi Thanavee,

It would be useful to have information about how you are using the utility (i.e. from Flash using a Flosc bridge into the client application).  Remember, this is a pure TUIO UDP socket on port 3333 and not a Flosc socket which is on port 3000.

A few things to try to see if you are getting TUIO cursor traffic:

- use the TUIO dump program that is installed with the TUIO kinect installer

- if you are seeing the point data show up in the console display then the TUIO stream is fine

- be sure to close TUIO dump since you can only have one connection to the service at any time

Also, see the installation notes to be sure that you are setup correctly.

Once you have checked these items, provide me with a brief description of your setup and I will try to help you some more.

Thanks,

David

Profile picture for Thanavee Paungpairoj
6 months ago

Hi David,

 Thanks for replying in such short notice. I have found the root of the problem, is that I forgot to change the InputProvider in the Application.xml in the module to "Flosc". However, I am in need of extra help. I built a simple flash multitouch application and export it. However, it does not come with Application.xml. If you could help me regarding this topic, I will be very grateful.

Thanks,

Thanavee 

Profile picture for Charles Veasey
Charles Veasey commented
Open Exhibits Staff
5 months ago

Hi Thanavee,

I'm not sure why you are missing the Application.xml, but you can snag one from any module on our site. Most are pretty standard.

thanks,
Charles

 

Profile picture for Ligia Gonçalves
5 months ago

I really can't figure it out what I'm doing wrong.
I'd followed all steps described in http://openexhibits.org/documentation/tuiokinect to get kinect working and everything seems to be working just fine.
But I cannot communicate with other flash applications ! I'd checked the xml file and everything else I found here and it still doesn't work, with the mouse it works perfect but kinect does not make anything!

I really need help, I'm frustrated!
Thank you.

Profile picture for Charles Veasey
Charles Veasey commented
Open Exhibits Staff
4 months ago

Hi Ligia,

 

I'm sorry you are having trouble. We are currently working on streamlining the setup procedure. Please stay tuned.

 

best,

Charles



Summary

 
OpenExhibits TUIO Kinect
 
Last Updated: 2011/07/18
Most Recent Version: 1.0.0
 
TUIO bridge application for the Xbox NUI drivers using Kinect.
 
This bridge provides an interface to Kinect depth interface for
the ability to build and use multitouch applications across a
broader range of Windows operating systems, including Windows
Vista and Windows XP.
 
This README describes how to install, configure, and use the
OpenExhibits TUIO Kinect.
 
_____________________________________________________________
INSTALLING THE TUIO KINECT
_____________________________________________________________
 
BEFORE YOU BEGIN TUIO KINECT INSTALLATION
 
Before beginning the TUIO Kinect installation, you should already
have installed the Kinect Xbox NUI Drivers (see FAQ below).
Also, you should remove any previous installations of the TUIO
Kinect from your system.
 
INTRODUCTION TO THE TUIO KINECT INSTALLER
 
Contents:
readme_kinect.txt
setup_kinect.exe
TuioDriverKinect.msi
 
Be sure that you run the setup_kinect.exe file and not the MSI package.
Follow the steps indicated in the installer sequence.  Once you
have completed the installation, you will need to either start
the driver manually or restart you computer.
 
Once you have successfully run the installer you will have
shortcuts to this README file, as well as the TUIO Tray and
TUIO Dump application.  The TUIO Tray is configured to start
at system startup but is provided in the case that you want
to manually start it.  The TUIO Dump is a utility program and
is explained in a following section of this README.
 
_____________________________________________________________
CONFIGURING THE TUIO KINECT
_____________________________________________________________
 
The TUIO Kinect is a service that runs in the background.  To
configure the service click on the Open Exhibits icon in the Windows
Desktop Tray.
 
A simple dialog box will allow you to change the port
at which the service is broadcasting on.  It also allows you
to change whether the server comes up running or stopped following
a system reboot.
 
The control interface allows you to start/stop/restart the server
and gives you status on the current state it is in.
 
Closing or minimizing the dialog simply places the control
interface back in the tray.  It is always available even when
the service is not running so that you can easily restart TUIO
as necessary.
 
_____________________________________________________________
MONITORING THE TUIO KINECT
_____________________________________________________________
 
A TUIO dump program is provider for listening for TUIO server
cursor notification messages in the same way that any application
would receive the TUIO events.  Be advised, only one TUIO client
is supported at any given time so be sure that no other application
has an open handle to the TUIO server else you will get a socket
error "Unable to open port 3333".
 
The TUIO dump program defaults to listening on port 3333 but
accepts as an argument an alternate port assignment.  This is
useful in the case that you have configured the server to broadcast
on a different port that the default.
 
_____________________________________________________________
CONTACTING US
_____________________________________________________________
 
OpenExhibits
http://www.openexhibits/support
 
_____________________________________________________________
FURTHER RESOURCES
_____________________________________________________________
 
OpenExhibits
http://www.openexhibits.org
 
TUIO
http://www.tuio.org
 
OSC
http://www.opensoundcontrol.org
 
_____________________________________________________________
FREQUENTLY ASKED QUESTIONS
_____________________________________________________________
 
Q: How do I install the Xbox NUI drivers?
A: Do the following:
(1) Go to OpenKinect / libfreenect @ github 
(https://github.com/OpenKinect/libfreenect)
(2) Download .zip for OpenKinect-libfreenect 
(https://github.com/OpenKinect/libfreenect/zipball/master)
(3) Plug in Kinect, Windows will install drivers.
(4) Go to Device Manager
(a) Under CL Devices you will find
NUI Audio
NUI Camera
NUI Motor
(b) Right Click "NUI Audio"
(c) Update Driver Software
(d) Browse my computer for driver software
(e) Let me pick from a list of device drivers on my computer
(f) Have Disk...
(g) Browse to the "OpenKinect-libfreenect / platform / windows 
/ inf / xbox nui audio / Xbox_NUI_Audio.inf"
(h) Install device software
(i) Repeat for "NUI Camera" and "NUI Motor"
(inf / xbox nui camera / Xbox_NUI_Camera.inf)
(inf / xbox nui motor / Xbox_NUI_Motor.inf) 
 
Q: How do I configure the TUIO kinect bridge?
A: By double-clicking on the Open Exhibits tray icon and adjusting
the server parameters.
 
Q: Why am I getting an registry access error message?  I am
still able to start the service but none of my configuration
changes are being saved.
A: The TUIO service has to be run with Administrative rights.
Right click on the tuio_tray_kinect.exe file and select Run As
 
Q: How do I run an Open Exhibits Module with the "Open Exhibits TUIO Kinect"?
A: In order to use the "Open Exhibits TUIO Kinect" with a Open Exhibits Module, you must utilize Flosc. Do the following:
(1) Go to NUI Group (http://nuigroup.com/forums/viewthread/1495/)
(2) Download the attached file and extract to your desktop. (http://nuigroup.com/?ACT=28&fid=33&aid=757_wrPg5kw4kqI7jfjXv1sI)
(3) Open Flosc.jar (then click start).
(4) The "InputProvider" located in the Application.xml for the module must be set to "Flosc".
(5) Launch the .swf
 
 

Features

There are no features for this project yet.

Example Code

Using this

There is no example code for this project yet.

Properties and Customization

Included XML tags and functions:

Name Description Notes

Included AS3 Classes and customization:

Name Superclass Notes

This material is based upon work supported by the National Science Foundation under Grant Number Division of Research on Learning in formal and informal settings #1010028. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.


Open Exhibits was developed by Ideum, makers of GestureWorks. Open Exhibits SDK is free for non-commercial use.

Connect
YouTube Twitter Flickr