Cookie Consent by Free Privacy Policy Generator ๐Ÿ“Œ ML Kit is now in GA & Introducing Selfie Segmentation

๐Ÿ  Team IT Security News ist eine Online-Plattform, die sich auf die Bereitstellung von Informationen,alle 15 Minuten neuste Nachrichten, Bildungsressourcen und Dienstleistungen rund um das Thema IT-Sicherheit spezialisiert hat.
Ob es sich um aktuelle Nachrichten, Fachartikel, Blogbeitrรคge, Webinare, Tutorials, oder Tipps & Tricks handelt, bietet seinen Nutzern einen umfassenden รœberblick รผber die wichtigsten Aspekte der IT-Sicherheit in einer sich stรคndig verรคndernden digitalen Welt.

16.12.2023 - TIP: Wer den Cookie Consent Banner akzeptiert, kann z.B. von Englisch nach Deutsch รผbersetzen, erst Englisch auswรคhlen dann wieder Deutsch!

Google Android Playstore Download Button fรผr Team IT Security

๐Ÿ“š ML Kit is now in GA & Introducing Selfie Segmentation

๐Ÿ’ก Newskategorie: Programmierung
๐Ÿ”— Quelle:

Posted by Kenny Sulaimon, Product Manager, ML Kit Chengji Yan, Suril Shah, Buck Bourdon, Software Engineers, ML Kit, Shiyu Hu, Technical Lead, ML Kit Dong Chen, Technical Lead, ML Kit

At the end of 2020, we introduced the Entity Extraction API to our ML Kit SDK, making it even easier to detect and perform actions on text within mobile apps. Since then, weโ€™ve been hard at work updating our existing APIs with new functionality and also fine tuning Selfie Segmentation with the help of our partners in the ML Kit early access program.

Today we are excited to officially add Selfie Segmentation to the ML Kit lineup, introduce a few enhancements weโ€™ve made to our popular Pose Detection API and announce that ML Kit has graduated to general availability!

Natural language graphic

General Availability

ML Kit image

(ML Kit is now in General Availability)

We launched ML Kit back in 2018 in order to make it easy for developers on Android and iOS to use machine learning within their apps. Over the last two years we have rapidly expanded our set of APIs to help with both vision and natural language processing based use cases.

Thanks to the overwhelmingly positive response, developer feedback and a ton of adoption across both Android and iOS, we are ready to drop the beta label and officially announce the general availability of ML Kitโ€™s APIs. All of our APIs (except Selfie Segmentation, Pose Detection, and Entity Extraction) are now in general availability!

Selfie Segmentation

Selfie Segmentation photo

(Example of ML Kit Selfie Segmentation)

With the increased usage of selfie cameras and webcams in today's world, being able to quickly and easily add effects to camera experiences has become a necessity for many app developers.

ML Kit's Selfie Segmentation API allows developers to easily separate the background from users within a scene and focus on what matters. Adding cool effects to selfies or inserting your users into interesting background environments has never been easier. The model works on live and still images, and both half and full body subjects.

Under The Hood

Under the hood graph

(Diagram of Selfie Segmentation API)

The Selfie Segmentation API takes an input image and produces an output mask. Each pixel of the mask is assigned a float number that has a range between [0.0, 1.0]. The closer the number is to 1.0, the higher the confidence that the pixel represents a person, and vice versa.

The API works with static images and live video use cases. During live video (stream_mode), the API will leverage output from previous frames to return smoother segmentation results.

Weโ€™ve also implemented a โ€œRAW_SIZE_MASKโ€ option to give developers more options for mask output. By default, the mask produced will be the same size as the input image. If the RAW_SIZE_MASK option is enabled, then the mask will be the size of the model output (256x256). This option makes it easier to apply customized rescaling logic or reduces latency if rescaling to the input image size is not needed for your use case.

Pose Detection Update

Example of Pose Detection API

(Example of updated Pose Detection API; colors represent the Z value)

Last month, we updated our state-of-the-art Pose Detection API with a new model and new features. A quick summary of the enhancements is listed below:

  • More poses added The API now recognizes more poses, targeting fitness and yoga use cases, especially when a user is directly facing the camera.
  • 50% size reduction The base and accurate pose models are now significantly smaller. This change does not impact the quality of the models.
  • Z Coordinate for depth analysis The API now outputs a depth coordinate Z to help determine whether parts of the user's body are in front or behind the userโ€™s hips.

Z Coordinate

The Z Coordinate is an experimental feature that is calculated for every point (excluding the face). The estimate is provided using synthetic data, obtained via the GHUM model (articulated 3D human shape model).

It is measured in "image pixels" like the X and Y coordinates. The Z axis is perpendicular to the camera and passes between a subject's hips. The origin of the Z axis is approximately the center point between the hips (left/right and front/back relative to the camera). Negative Z values are towards the camera; positive values are away from it. The Z coordinate does not have an upper or lower bound.

For more information on the Pose Detection changes, please see our API documentation.

Pose Classification

After the release of Pose Detection, weโ€™ve received quite a bit of requests from developers to help with classifying specific poses within their apps. To help tackle this problem, we partnered with the MediaPipe team to release a pose classification tutorial and Google Colab. In the classification tutorial, we demonstrate how to build and run a custom pose classifier within the ML Kit Android sample app and also demo a simple push-up and squat rep counter using the classifier.

Example of Pose classification and repetition counting with MLKit Pose

(Example of Pose classification and repetition counting with MLKit Pose)

For a deep dive into building your own pose classifier with different camera angles, environment conditions, body shapes etc, please see the pose classification tutorial.

For more general classification tips, please see our Pose Classification Options page on the ML Kit website.

Beyond General Availability

It has been an exciting two years getting ML Kit to general availability and we couldnโ€™t have gotten here without your help and feedback. As we continue to introduce new APIs such as Selfie Segmentation and Pose Detection, your feedback is more important than ever. Please continue to share your enhancement requests and questions with our development team or reach out through our community channels. Letโ€™s build a smarter future together.


๐Ÿ“Œ ML Kit is now in GA & Introducing Selfie Segmentation

๐Ÿ“ˆ 56.27 Punkte

๐Ÿ“Œ What is Network Segmentation? Virtual & Physical Segmentation | UpGuard

๐Ÿ“ˆ 33.06 Punkte

๐Ÿ“Œ t3n Daily: Adobe & Figma, Ethereum & NFT, Steuer & Homeoffice, KI & Gruselfrau

๐Ÿ“ˆ 29.62 Punkte

๐Ÿ“Œ Google Art Selfie: Neue generative KI verwandelt euer Selfie in ein Kunstwerk โ€“ so funktioniert es (Video)

๐Ÿ“ˆ 26.99 Punkte


๐Ÿ“ˆ 22.21 Punkte


๐Ÿ“ˆ 22.21 Punkte

๐Ÿ“Œ Introducing Windows Dev Kit 2023 (Project Volterra)

๐Ÿ“ˆ 20.49 Punkte

๐Ÿ“Œ Introducing Android Native Development Kit r14

๐Ÿ“ˆ 20.49 Punkte

๐Ÿ“Œ Introducing Windows Dev Kit 2023 (Project Volterra)

๐Ÿ“ˆ 20.49 Punkte

๐Ÿ“Œ Introducing Android Native Development Kit r16

๐Ÿ“ˆ 20.49 Punkte

๐Ÿ“Œ Introducing the Android Game Development Kit

๐Ÿ“ˆ 20.49 Punkte

๐Ÿ“Œ Introducing the Versal AI Edge VEK280 Evaluation Kit

๐Ÿ“ˆ 20.49 Punkte

๐Ÿ“Œ An introduction to Kit Hunter, a phishing kit detector | Salted Hash Ep 40

๐Ÿ“ˆ 19.83 Punkte


๐Ÿ“ˆ 19.83 Punkte

๐Ÿ“Œ Elements Kit Lite Plugin/Elements Kit Pro Plugin up to 2.1.x on WordPress Widget cross site scripting

๐Ÿ“ˆ 19.83 Punkte

๐Ÿ“Œ Script Kit 1.40.62 - An open-source kit to optimize your developer workflow.

๐Ÿ“ˆ 19.83 Punkte

๐Ÿ“Œ I updated my webcam background replacement tool to use Google's Mediapipe as image segmentation backend. It is now so much faster!

๐Ÿ“ˆ 19.82 Punkte

๐Ÿ“Œ #0daytoday #Ruby < 2.2.8 / < 2.3.5 / < 2.4.2 / < 2.5.0- [#0day #Exploit]

๐Ÿ“ˆ 19.74 Punkte

๐Ÿ“Œ #0daytoday #Drupal < 7.58 / < 8.3.9 / < 8.4.6 / < 8.5.1 [#0day #Exploit]

๐Ÿ“ˆ 19.74 Punkte

๐Ÿ“Œ #0daytoday #Linux/ARM - execve("/bin/sh", ["/bin/sh& [#0day #Exploit]

๐Ÿ“ˆ 19.74 Punkte

๐Ÿ“Œ Neu bei Amazon Prime Video im April: "Bibi & Tina" "Tales from the Loop" und "Falling Snow" starten

๐Ÿ“ˆ 19.74 Punkte

๐Ÿ“Œ Neu im TV und bei Sky: "Suits", "Das Boot", "Better Call Saul" und "What We Do in the Shadows"

๐Ÿ“ˆ 19.74 Punkte

๐Ÿ“Œ "The Batman", "Avatar", "The Witcher" & Co.: Die Dreharbeiten gehen nach Corona-Pause wieder weiter!

๐Ÿ“ˆ 19.74 Punkte

๐Ÿ“Œ Samsung-Geheimsprache geknackt: Das bedeuten "Water", "Merlot", "Wise" und "Fresh"

๐Ÿ“ˆ 19.74 Punkte

๐Ÿ“Œ Super Bowl 2024: "Deadpool & Wolverine", "Planet der Affen", "Wicked" und mehr - alle neuen Film-Trailer

๐Ÿ“ˆ 19.74 Punkte

๐Ÿ“Œ Selfie mit "Gesundheitscheck": Google Pixel-Handys messen Atemfrequenz per Frontkamera

๐Ÿ“ˆ 18.43 Punkte

๐Ÿ“Œ Want the selfie stick that does it all? Itโ€™s $9 off right now.

๐Ÿ“ˆ 18.01 Punkte

๐Ÿ“Œ #0daytoday #Nutanix AOS & Prism < 5.5.5 (LTS) / < 5.8.1 (STS) - S [#0day #Exploit]

๐Ÿ“ˆ 17.28 Punkte

๐Ÿ“Œ Die Kino-Flaute geht weiter: "Top Gun", "Avatar", Mulan" und "Spider-Man" werden verschoben

๐Ÿ“ˆ 17.28 Punkte

๐Ÿ“Œ Brie Larson aus "Captain Marvel": Wird sie in "Fast & Furious 10" zur Schwester von Brian O'Conner?

๐Ÿ“ˆ 17.28 Punkte

๐Ÿ“Œ 1899 - Kritik: Spannender Mix aus "Dark", "Lost" und "Westworld" - So gut ist Netflix' neue Mystery-Serie

๐Ÿ“ˆ 17.28 Punkte