Microsoft Discontinues Kinect, Again https://hackaday.com/2023/08/26/microsoft-discontinues-kinect-again/ #discontinued #Kinecthacks #depthcamera #microsoft #Kinect #azure #News

Your Vacuum Cleaner Follows You

There are several projects you can imagine where it would be useful to have a robot follow you. For example, we've always wanted luggage that would trail us at the airport and we've seen several coolers that will follow you. [Madmax95] apparently dream of having a medical cart following a patient, though, and that's good too. But how do you do it? [Max's] method was to strip down a Roomba and build a work table and electronics on it. An Arduino controls the motor and communicates with a PC. The PC reads video from a Kinect camera on the robot and uses special tracking software to follow the patient.

We could easily imagine all of this project except the tracking. That depended on a service called Nuitrack. There is a free version that only works for 3 minutes, but it costs if you want to use it practically. However, it would still be cheaper than rolling your own if your time has value.

Nuitrack can do body tracking, face tracking, and also gesture recognition. So it would be easy to imagine commanding the robot using some sort of Jedi-style gesture. It looks like using this makes the project significantly easier than you'd imagine.

The project also uses Thingsboard to create a simple control panel. This is another solution that requires a subscription, but there is a free community edition you can host locally.

Overall, we probably won't duplicate this robot ourselves, but we were interested in learning how we could pull off something similar for other projects. We've seen variations of this done with things like OpenCV. Our suitcase idea, by the way, isn't original, but we wonder about how much packing volume you lose for batteries, electronics, and we imagine the airlines will be unhappy stowing one.

#arduinohacks #kinecthacks #robotshacks #kinect #robot

Make this Halloween a Spider-Stomping Good Time

We can count on one hand the number of times that we haven't needed a coat on Halloween night around here. Even if it was fair and sunny the day before, you can count on Halloween being appropriately windy, cold, and spooky. Trick-or-treating only keeps a kid so warm, and we would have loved to happen upon a house with a spider-stomping sugar-burning good time of a game going on in the driveway.

[Kyle Maas] built this game a few years ago, and it has proved quite popular ever since. It's so popular, in fact, that they have to have someone on duty with a vaudeville hook to yank spectators off the playing field. The point is to stomp as many spiders as you can in a set amount of time, though you only need to stomp one to win. It can handle one to four players, depending on the size of the projection, but [Kyle] says it's kind of hard to track more than two at a time.

The setup is fairly simple, provided you can reliably affix your projector to something sturdy. [Kyle] used a Structure sensor for the 3D scanner, but you could easily use a Kinect instead. Conversely, the calibration was challenging. [Kyle] ended up using a DSP math trick known as the inverse bilinear transform to be able to calibrate the system using the 3D scanner itself.

If you're more into scaring the children, just rig up a coffin bell. Either way, don't forget about our Halloween Hackfest contest, running now through Monday, October 11th. There are more details over on IO. While you're there, why not check out the list of entries?

#holidayhacks #kinecthacks #3dscanner #halloween #kinect #projector

Automated Sentry Turret For Your Secret Lab

There are few things as frustrating when you're trying to get some serious hacking done than intruders repeatedly showing up without permission. [All Parts Combined] has the solution for you, with a Kinect-based robotic sentry turret to keep them at bay.

The system consists of a Microsoft Kinect V2 connected to a PC, which runs an app to do all the processing, and outputs the targeting information to an Arduino over serial. The Arduino controls a simple 2-axis servo mount with an electric airsoft gun zip-tied to it. The trigger switch is replaced with a relay, also connected to the Arduino.

The Kinect V2 comes with SDKs that really simplify tracking human movement, and outputs the data in an easy-to-use format. [All Parts Combined] used the SDK in Unity, which allows him to choose which body parts to track. He added scripts that detect a few basic gestures, issues voice commands, and generates the serial commands for the Arduino. The servo angles are calculated with simple geometry, using XY coordinates of the target received from the SDK, and the known distance between the Kinect and turret. When an intruder enters the Kinect's field of view it immediately starts aiming at the intruder's heart, issues a "Hands Up!" command, and tells the intruder to leave. If the intruder doesn't comply, it starts an audible countdown before firing. [All Parts Combined] also added a secret disarming gesture (double hand pistols), which turns the turret into an apologetic comrade. All it needs is a Portal-inspired enclosure.

It's a fun project that illustrates how the Kinect can make complex computer vision tasks relatively simple. Unfortunately the V2 is no longer in production, having been replaced by the more expensive, developer focused Azure Kinect. We've covered several Kinect-based projects, including a 3D room scanner and a robotic basketball hoop.

#kinecthacks #weaponshacks #arduino #kinect #servos #turret #unity

Leap Motion Controls Hands with No Glove

It isn't uncommon to see a robot hand-controlled with a glove to mimic a user's motion. [All Parts Combined] has a different method. Using a Leap Motion controller, he can record hand motions with no glove and then play them back to the robot hand at will. You can see the project in the video, below.

The project seems straightforward enough, but apparently, the Leap documentation isn't the best. Since he worked it out, though, you might find the code useful.

An 8266 runs everything, although you could probably get by with less. The Leap provides more data than the hand has servos, so there was a bit of algorithm development.

We picked up a few tips about building flexible fingers using heated vinyl tubing. Never know when that's going to come in handy -- no pun intended. The cardboard construction isn't going to be pretty, but a glove cover works well. You could probably 3D print something, too.

The Unity app will drive the hand live or can playback one of the five recorded routines. You can see how the record and playback work on the video.

This reminded us of another robot hand project, this one 3D printed. We've seen more traditional robot arms moving with a Leap before, too.

#arduinohacks #kinecthacks #robotshacks #animatronic #animatronichand #hand #leapmotion #leapmotioncontroller #robothand #servo