Get started for free with Stream's Video SDK: https://getstream.io/video/docs/
Link to the repository (⭐️):
https://github.com/GetStream/tensorflowjs-gesture-recognition
In this video we explore building a gesture detection system using Tensorflow.js. With the help of the handpose and the fingerpose packages we build up a web application using vanilla JavaScript and HTML for maximum capability.
Also, we share an example of integrating gesture detection into a React video calling application powered by Stream.
Stream on X: https://x.com/getstream_io
Stefan on X: https://x.com/stefanjblos
🔗 Links
Tensorflow.js
https://www.tensorflow.org/js
Stream React Video SDK
https://getstream.io/video/docs/react/
Stream Video
https://getstream.io/video/
Fingerpose package
https://www.npmjs.com/package/fingerpose
Handpose package
https://www.npmjs.com/package/@tensorflow-models/handpose
⏱️ Timestamps
0:00 Cold-open
0:24 Introduction
1:37 Project Setup
4:43 HTML Structure
7:58 Webcam Integration
13:08 Handpose Visualization
18:57 Gesture Detection
22:52 Custom Gesture
28:19 Video Calling Integration
30:21 Outro
#html #javascript #tensorflow #machinelearning #ai #videocall
