Cookie Consent by Free Privacy Policy Generator ๐Ÿ“Œ ML Kit Pose Detection Makes Staying Active at Home Easier

๐Ÿ  Team IT Security News

TSecurity.de ist eine Online-Plattform, die sich auf die Bereitstellung von Informationen,alle 15 Minuten neuste Nachrichten, Bildungsressourcen und Dienstleistungen rund um das Thema IT-Sicherheit spezialisiert hat.
Ob es sich um aktuelle Nachrichten, Fachartikel, Blogbeitrรคge, Webinare, Tutorials, oder Tipps & Tricks handelt, TSecurity.de bietet seinen Nutzern einen umfassenden รœberblick รผber die wichtigsten Aspekte der IT-Sicherheit in einer sich stรคndig verรคndernden digitalen Welt.

16.12.2023 - TIP: Wer den Cookie Consent Banner akzeptiert, kann z.B. von Englisch nach Deutsch รผbersetzen, erst Englisch auswรคhlen dann wieder Deutsch!

Google Android Playstore Download Button fรผr Team IT Security



๐Ÿ“š ML Kit Pose Detection Makes Staying Active at Home Easier


๐Ÿ’ก Newskategorie: Programmierung
๐Ÿ”— Quelle: feedproxy.google.com

Posted by Kenny Sulaimon, Product Manager, ML Kit; Chengji Yan and Areeba Abid, Software Engineers, ML Kit

ML Kit logo

Two months ago we introduced the standalone version of the ML Kit SDK, making it even easier to integrate on-device machine learning into mobile apps. Since then weโ€™ve launched the Digital Ink Recognition API, and also introduced the ML Kit early access program. Our first two early access APIs were Pose Detection and Entity Extraction. Weโ€™ve received an overwhelming amount of interest in these new APIs and today, we are thrilled to officially add Pose Detection to the ML Kit lineup.

ML Kit Overview

A New ML Kit API, Pose Detection


Examples of ML Kit Pose Detection

ML Kit Pose Detection is an on-device, cross platform (Android and iOS), lightweight solution that tracks a subject's physical actions in real time. With this technology, building a one-of-a-kind experience for your users is easier than ever.

The API produces a full body 33 point skeletal match that includes facial landmarks (ears, eyes, mouth, and nose), along with hands and feet tracking. The API was also trained on a variety of complex athletic poses, such as Yoga positions.

Skeleton image detailing all 33 landmark points

Skeleton image detailing all 33 landmark points

Under The Hood

Diagram of the ML Kit Pose Detection Pipeline

The power of the ML Kit Pose Detection API is in its ease of use. The API builds on the cutting edge BlazePose pipeline and allows developers to build great experiences on Android and iOS, with little effort. We offer a full body model, support for both video and static image use cases, and have added multiple pre and post processing improvements to help developers get started with only a few lines of code.

The ML Kit Pose Detection API utilizes a two step process for detecting poses. First, the API combines an ultra-fast face detector with a prominent person detection algorithm, in order to detect when a person has entered the scene. The API is capable of detecting a single (highest confidence) person in the scene and requires the face of the user to be present in order to ensure optimal results.

Next, the API applies a full body, 33 landmark point skeleton to the detected person. These points are rendered in 2D space and do not account for depth. The API also contains a streaming mode option for further performance and latency optimization. When enabled, instead of running person detection on every frame, the API only runs this detector when the previous frame no longer detects a pose.

The ML Kit Pose Detection API also features two operating modes, โ€œFastโ€ and โ€œAccurateโ€. With the โ€œFastโ€ mode enabled, you can expect a frame rate of around 30+ FPS on a modern Android device, such as a Pixel 4 and 45+ FPS on a modern iOS device, such as an iPhone X. With the โ€œAccurateโ€ mode enabled, you can expect more stable x,y coordinates on both types of devices, but a slower frame rate overall.

Lastly, weโ€™ve also added a per point โ€œInFrameLikelihoodโ€ score to help app developers ensure their users are in the right position and filter out extraneous points. This score is calculated during the landmark detection phase and a low likelihood score suggests that a landmark is outside the image frame.

Real World Applications


Examples of a pushup and squat counter using ML Kit Pose Detection

Keeping up with regular physical activity is one of the hardest things to do while at home. We often rely on gym buddies or physical trainers to help us with our workouts, but this has become increasingly difficult. Apps and technology can often help with this, but with existing solutions, many app developers are still struggling to understand and provide feedback on a userโ€™s movement in real time. ML Kit Pose Detection aims to make this problem a whole lot easier.

The most common applications for Pose detection are fitness and yoga trackers. Itโ€™s possible to use our API to track pushups, squats and a variety of other physical activities in real time. These complex use cases can be achieved by using the output of the API, either with angle heuristics, tracking the distance between joints, or with your own proprietary classifier model.

To get you jump started with classifying poses, we are sharing additional tips on how to use angle heuristics to classify popular yoga poses. Check it out here.

Learning to Dance Without Leaving Home

Learning a new skill is always tough, but learning to dance without the aid of a real time instructor is even tougher. One of our early access partners, Groovetime, has set out to solve this problem.

With the power of ML Kit Pose Detection, Groovetime allows users to learn their favorite dance moves from popular short-form dance videos, while giving users automated real time feedback on their technique. You can join their early access beta here.

Groovetime App using ML Kit Pose Detection

Staying Active Wherever You Are

Our Pose Detection API is also helping adidas Training, another one of our early access partners, build a virtual workout experience that will help you stay active no matter where you are. This one-of-a-kind innovation will help analyze and give feedback on the userโ€™s movements, using nothing more than just your phone. Integration into the adidas Training app is still in the early phases of the development cycle, but stay tuned for more updates in the future.

How to get started?

If you would like to start using the Pose Detection API in your mobile app, head over to the developer documentation or check out the sample apps for Android and iOS to see the API in action. For questions or feedback, please reach out to us through one of our community channels.

...



๐Ÿ“Œ ML Kit Pose Detection Makes Staying Active at Home Easier


๐Ÿ“ˆ 88.81 Punkte

๐Ÿ“Œ Xbox Game Studios 'The Initiative' talks 'staying small, staying agile'


๐Ÿ“ˆ 35.75 Punkte

๐Ÿ“Œ Instant Motion Tracking with MediaPipe, MySQL 8, ML Kit Pose Detection, and more!


๐Ÿ“ˆ 35.19 Punkte

๐Ÿ“Œ The Future of Staying Healthy: 10 Ways IOT Make Care Easier!


๐Ÿ“ˆ 29.73 Punkte

๐Ÿ“Œ Your Active DAD (Active Domain Active Defense) Primer


๐Ÿ“ˆ 27.09 Punkte

๐Ÿ“Œ WEBCAST: Active Domain Active Defense (Active DAD) Primer with John Strand


๐Ÿ“ˆ 27.09 Punkte

๐Ÿ“Œ How Google Drive's new 'Home' page makes it easier to find what you're looking for


๐Ÿ“ˆ 26.71 Punkte

๐Ÿ“Œ Scammers Pose as Meal-Kit Services to Steal Customer Data


๐Ÿ“ˆ 26.11 Punkte

๐Ÿ“Œ Next-Generation Pose Detection with MoveNet and TensorFlow.js


๐Ÿ“ˆ 25.28 Punkte

๐Ÿ“Œ 9 new skills to learn while you're staying at home


๐Ÿ“ˆ 23.62 Punkte

๐Ÿ“Œ Naked Security Live โ€“ Staying safe online at home (especially if youโ€™re homeschooling!)


๐Ÿ“ˆ 23.62 Punkte

๐Ÿ“Œ 'Staying Longer At Home' Was Key To Stone Age Technology Change 60,000 Years Ago


๐Ÿ“ˆ 23.62 Punkte

๐Ÿ“Œ People staying at home get double XP in World of Warcraft for a month


๐Ÿ“ˆ 23.62 Punkte

๐Ÿ“Œ This Service Can Help Your Boss Be Sure You're Working When Staying Home


๐Ÿ“ˆ 23.62 Punkte

๐Ÿ“Œ Amazon Asks Workers Staying At Home To Return Or Seek Leave


๐Ÿ“ˆ 23.62 Punkte

๐Ÿ“Œ San Francisco Faces 'Doom Loop' from Office Workers Staying Home, Gutting Tax Base


๐Ÿ“ˆ 23.62 Punkte

๐Ÿ“Œ On-device machine learning solutions with ML Kit, now even easier to use


๐Ÿ“ˆ 21.77 Punkte

๐Ÿ“Œ Avira Password Manager: Makes your digital life easier


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ Google Makes It Easier to Create Virtual Reality Videos


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ Mozilla Makes It Easier to Hide Tabs in Firefox and Unclutter Your Tab Bar


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ New Google Account Update Makes It Easier to Manage Your Data


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ Google's update makes privacy easier video


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ LinkedIn's Sales Navigator 'Deals' Makes Updating Client Info Easier


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ funky: Funky makes Linux Shell Functions more Powerful and Easier to Manage.


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ funky: Funky makes Linux Shell Functions more Powerful and Easier to Manage.


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ Funky makes Linux Shell Functions more Powerful and Easier to Manage.


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ Google makes 2-Factor Authentication a lot Easier and Faster


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ Fedora 25 Now Available -- Makes It Easier To Switch From Windows 10 Or Mac


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ Google Makes It Easier to Switch from iOS to Android via Google Drive App


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ Facebook Makes Privacy Features Easier to Understand


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ Firefox makes it easier for users to dodge ad-trackers


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ Intel Makes Managing Drivers on Windows 10 Easier with New Control Panel App


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ Intel Makes Managing Drivers on Windows 10 Easier with New Control Panel App


๐Ÿ“ˆ 20.96 Punkte

๐Ÿ“Œ How to educate developers to makes life easier for package maintainers?


๐Ÿ“ˆ 20.96 Punkte











matomo