Kinect driver for PlayStation 3

Well last weekend i bought a Microsoft Kinect device, today i had free time to make things happens...

First PlayStation 3 only see a NUIMOTOR device. After NUIMOTOR is correctly initialized, NUICAMERA and NUIAUDIO are shown and i can detect and control them, OpenKinect documentation about devices and protocols was very helpfull.

NUICAMERA has 2 isoc endpoints one for rgb and other for depth. Stuff is similar to my old eyetoy driver isoc frames and then parsing them to get real frames for user process and i believe that i can use my old eyetoy code with this.

Now i need only TIME to play with the new toy.....

Output from ugly and unfinished kinect sample driver:


PS3Load v0.1
Waiting for connection...
Receiving data... (0x0000cd83/0x0003da11)
Receiving arguments... 0x0000000d
Launching...
Sample Kinect Driver for PlayStation 3 Antonio José Ramos Márquez aka bigboss
Registering kinect driver return 0
kinect_probe:: dev_id=11
USB device probe for kinect getting device descriptor
Usb device found has idVendor 5e04
New usb device found has NUI_MOTOR idProduct b002
kinect_attach:: dev_id=11
Getting device descriptor
nuimotor_attach:: dev_id=11
Kinect NUI_MOTOR detected
Getting configuration descriptor
Number of interfaces 1
Getting interface descriptor
Verifying number of endpoints
Getting control endpoint descriptor for NUI_MOTOR 0
tryng to open control endpoint 0
nuimotor_control_transfer:: param0=0 param1=1
Set Configuration (bConfigurationValue=1)
nuimotor_control_done:: result=0x0 count=0 arg=0
nuimotor_control_transfer:: param0=1 param1=0
Set Interface (bInterfaceNumber=0, bAlternateSetting=0)
nuimotor_control_done:: result=0x50 count=0 arg=1
result=0x50 count=0 arg=1
nuimotor_control_transfer:: param0=2 param1=0
Sending event NUIMOTOR_READY
Received event NUIMOTOR_READY now it's time to angle and led settings
nuimotor_control_transfer:: param0=3 param1=0
init motor
nuimotor_control_done:: result=0x0 count=1 arg=3
nuimotor_control_transfer:: param0=4 param1=0
set angle
nuimotor_control_done:: result=0x0 count=0 arg=4
nuimotor_control_transfer:: param0=5 param1=0
set led
nuimotor_control_done:: result=0x0 count=0 arg=5
nuimotor_control_transfer:: param0=6 param1=0
motor ready time to camera and audio sending NUIMOTOR_ENABLED
Nuimotor initialized set angle and led to red done tryng to see if other devices are already availables
kinect_probe:: dev_id=12
USB device probe for kinect getting device descriptor
Usb device found has idVendor 5e04
New usb device found has NUI_AUDIO idProduct ad02
kinect_attach:: dev_id=12
Getting device descriptor
nuiaudio_attach:: dev_id=12
Kinect NUI_AUDIO detected
Getting configuration descriptor
Verifying number of endpoints 4
Getting control endpoint descriptor for NUI_AUDIO 1
nuiaudio_control_transfer:: param0=0 param1=1
Set Configuration (bConfigurationValue=1)
nuiaudio_control_done:: result=0x0 count=0 arg=0
nuiaudio_control_transfer:: param0=1 param1=0
Set Interface (bInterfaceNumber=0, bAlternateSetting=0)
nuiaudio_control_done:: result=0x50 count=0 arg=1
result=0x50 count=0 arg=1
nuiaudio_control_transfer:: param0=2 param1=0
Sending event NUIAUDIO_READY
Received event NUIAUDIO_READY TODO audio initialization and isoc stuff
kinect_probe:: dev_id=13
USB device probe for kinect getting device descriptor
Usb device found has idVendor 5e04
New usb device found has NUI_CAMERA idProduct ae02
kinect_attach:: dev_id=13
Getting device descriptor
nuicamera_attach:: dev_id=13
Kinect NUI_CAMERA detected
Getting configuration descriptor
Verifying number of endpoints 2
Getting control endpoint descriptor for NUI_CAMERA 2
nuicamera_control_transfer:: param0=0 param1=1
Set Configuration (bConfigurationValue=1)
nuicamera_control_done:: result=0x0 count=0 arg=0
nuicamera_control_transfer:: param0=1 param1=0
Set Interface (bInterfaceNumber=0, bAlternateSetting=0)
nuicamera_control_done:: result=0x50 count=0 arg=1
result=0x50 count=0 arg=1
nuicamera_control_transfer:: param0=2 param1=0
Sending event NUICAMERA_READY
Received event NUICAMERA_READY TODO camera initialization and isoc stuff
kinect_detach:: dev_id=12
nuiaudio_detach:: dev_id=12
Sending event NUIAUDIO_DETACH
kinect_detach:: dev_id=11
nuimotor_detach:: dev_id=11
Sending event NUIMOTOR_DETACH
kinect_detach:: dev_id=13
nuicamera_detach:: dev_id=13
Sending event NUICAMERA_DETACH
Event received NUIAUDIO_DETACH
Event received NUIMOTOR_DETACH
Event received NUICAMERA_DETACH
time to go to XMB and unregister kinect driver...

PSL1GHT with Eye and EyeToy support

Matthew Parlane(Thank you for your explanation about nfid :P) made the real job, i only add EyeToy support in camera sample.


In the other hand, marcan made kinect open source driver (GRANDE marcan!!!!), ummm a port for PSL1GHT? perhaps i need more free time

you can get my changes at https://github.com/bigboss-ps3dev/PSL1GHT

EyePet tracking with EyeToy and PlayStation2

I bought EyePet last weekend. I have been playing with EyePet magic card and my own tracking code for PlayStation 2.

These are the result:



Next to come, mark detection and augmented reality stuff :P.

Tracking balls

I have uploaded a little video showing a tracking ball demo using:
- eyetoy driver
- libeye
- libipu
- libgsclassic




A pdf with some history about the driver is available here
bigboss_eyetoy

New update about EyeToy driver

Well, i have updated the driver to compile under the last ps2sdk available on svn.ps2dev.org. I wait to release some stuff soon :). The original and not public version of this driver was always compiled under ps2lib enviroment since 2004, now all is ps2sdk friendly iop side and ee side.

The sample will be included with the public release, it will show in the tv screen ipu frames captured with EyeToy and saves an ipu frame and a few seconds of pcm audio also.

The main problem was to get the toolchain run fine under leopard, don't compile fine on it, so i had to install toolchain from my powermac and all is fine by now...

You have a snapshot from ps2client session here:

My birthday is almost here...

Perhaps it's time to release cool stuff for PlayStation 2...