Cookie Consent by Free Privacy Policy Generator 📌 On-device machine learning solutions with ML Kit, now even easier to use

🏠 Team IT Security News ist eine Online-Plattform, die sich auf die Bereitstellung von Informationen,alle 15 Minuten neuste Nachrichten, Bildungsressourcen und Dienstleistungen rund um das Thema IT-Sicherheit spezialisiert hat.
Ob es sich um aktuelle Nachrichten, Fachartikel, Blogbeiträge, Webinare, Tutorials, oder Tipps & Tricks handelt, bietet seinen Nutzern einen umfassenden Überblick über die wichtigsten Aspekte der IT-Sicherheit in einer sich ständig verändernden digitalen Welt.

16.12.2023 - TIP: Wer den Cookie Consent Banner akzeptiert, kann z.B. von Englisch nach Deutsch übersetzen, erst Englisch auswählen dann wieder Deutsch!

Google Android Playstore Download Button für Team IT Security

📚 On-device machine learning solutions with ML Kit, now even easier to use

💡 Newskategorie: Programmierung
🔗 Quelle:

Posted by Christiaan Prins, Product Manager, ML Kit and Shiyu Hu, Tech Lead Manager, ML Kit

ML Kit logo

Two years ago at I/O 2018 we introduced ML Kit, making it easier for mobile developers to integrate machine learning into your apps. Today, more than 25,000 applications on Android and iOS make use of ML Kit’s features. Now, we are introducing some changes that will make it even easier to use ML Kit. In addition, we have a new feature and a set of improvements we’d like to discuss.

A new ML Kit SDK, fully focused on on-device ML

ML Kit API Overview

ML Kit's APIs are built to help you tackle common challenges in the Vision and Natural Language domains. We make it easy to recognize text, scan barcodes, track and classify objects in real-time, do translation of text, and more.

The original version of ML Kit was tightly integrated with Firebase, and we heard from many of you that you wanted more flexibility when implementing it in your apps. As a result, we are now making all the on-device APIs available in a new standalone ML Kit SDK that no longer requires a Firebase project. You can still use both ML Kit and Firebase to get the best of both products if you choose to.

With this change, ML Kit is now fully focused on on-device machine learning, giving you access to the unique benefits that on-device versus cloud ML offers:

  • It’s fast, unlocking real-time use cases- since processing happens on the device, there is no network latency. This means, we can do inference on a stream of images / video or multiple times a second on text strings.
  • Works offline - you can rely on our APIs even when the network is spotty or your app’s end-user is in an area without connectivity.
  • Privacy is retained: since all processing is performed locally, there is no need to send sensitive user data over the network to a server.

Naturally, you still get access to Google’s on-device models and processing pipelines, all accessible through easy-to-use APIs, and offered at no cost.

All ML Kit resources can now be found on our new website where we made it a lot easier to access sample apps, API reference docs and our community channels that are there to help you if you have questions.

Object detection & tracking gif Text recognition + Language ID + Translate gif

What does this mean if I already use ML Kit today?

If you are using ML Kit for Firebase’s on-device APIs in your app today, we recommend you to migrate to the new standalone ML Kit SDK to benefit from new features and updates. For more information and step-by-step instructions to update your app, please follow our Migration guide. The cloud-based APIs, model deployment and AutoML Vision Edge remain available through Firebase Machine Learning.

Shrink your app footprint with Google Play Services

Apart from making ML Kit easier to use, developers also asked if we can ship ML Kit through Google Play Services resulting in a smaller app footprint and the model can be reused between apps. Apart from Barcode scanning and Text recognition, we have now added Face detection / contour (model size: 20MB) to the list of APIs that support this functionality.

// Face detection / Face contour model
// Delivered via Google Play Services outside your app's APK…
implementation ''

// …or bundled with your app's APK
implementation ''

Jetpack Lifecycle / CameraX support

Android Jetpack Lifecycle support has been added to all APIs. Developers can use addObserver to automatically manage teardown of ML Kit APIs as the app goes through screen rotation or closure by the user / system. This makes CameraX integration easier. With this release, we are also recommending that developers adopt CameraX in their apps due to the ease of integration and image quality improvements (compared to Camera1) on a wide range of devices.

// ML Kit now supports Lifecycle
val recognizer = TextRecognizer.newInstance()

// ...

// Just like CameraX
val camera = cameraProvider.bindToLifecycle( /* lifecycleOwner= */this,
    cameraSelector, previewUseCase, analysisUseCase)

For an overview of all recent changes, check out the release notes for the new SDK.

Codelab of the day - ML Kit x CameraX

To help you get started with the new ML Kit and its support for CameraX, we have created this code lab to Recognize, Identify Language and Translate text. If you have any questions regarding this code lab, please raise them at StackOverflow and tag it with [google-mlkit]. Our team will monitor this.

screenshot of app running

Early access program

Through our early access program, developers have an opportunity to partner with the ML Kit team and get access to upcoming features. Two new APIs are now available as part of this program:

  • Entity Extraction - Detect entities in text & make them actionable. We have support for phone numbers, addresses, payment numbers, tracking numbers, date/time and more.
  • Pose Detection - Low-latency pose detection supporting 33 skeletal points, including hands and feet tracking.

If you are interested, head over to our early access page for details.

pose detection on man jumping rope

Tomorrow - Support for custom models

ML Kit's turn-key solutions are built to help you take common challenges. However, if you needed to have a more tailored solution, one that required custom models, you typically needed to build an implementation from scratch. To help, we are now providing the option to swap out the default Google models with a custom TensorFlow Lite model. We’re starting with the Image Labeling and Object Detection and Tracking APIs, that now support custom image classification models.

Tomorrow, we will dive a bit deeper into how to find or train a TensorFlow Lite model and use it either with ML Kit, or with Android Studio’s new ML binding functionality.


📌 Let's use DevOps thinking to make machine learning fit easier into your it environment

📈 30.77 Punkte

📌 TorBox v.0.3.0 released — now even easier to use

📈 30.32 Punkte

📌 Automated machine learning and MLOps with Azure Machine Learning

📈 29 Punkte

📌 Use Amazon DocumentDB to build no-code machine learning solutions in Amazon SageMaker Canvas

📈 28.07 Punkte

📌 Guided Transfer Learning: How to use ‘the power of scouts’ to boost machine learning performance

📈 26.18 Punkte

📌 New machine learning algorithm breaks text CAPTCHAs easier than ever

📈 26.12 Punkte

📌 Machine Learning Is Even Disrupting the Process of Reverse Phone Lookups

📈 24.19 Punkte

📌 Machine Learning Is Making Pesto Even More Delicious

📈 24.19 Punkte

📌 Googles ML Kit: Machine Learning für alle!

📈 24.18 Punkte

📌 Googles ML Kit: Machine Learning für alle!

📈 24.18 Punkte

📌 Machine Learning: ML Kit kann offline übersetzen

📈 24.18 Punkte

📌 Machine Learning: ML Kit kann offline übersetzen

📈 24.18 Punkte

📌 Machine Learning: ML Kit erkennt E-Mail-Adressen, IBANs, Datumsangaben und mehr

📈 24.18 Punkte

📌 Machine Learning: ML Kit kümmert sich zum offiziellen Release um Selfies

📈 24.18 Punkte

📌 New ML Kit features easily bring Machine Learning to your apps

📈 24.18 Punkte

📌 Get inspired in 2023 with new machine learning solutions for web developers with MediaPipe

📈 23.41 Punkte

📌 Firms Increasingly Turn to Machine Learning for Security Solutions

📈 23.41 Punkte

📌 Teachable Machine: Googles Beispielprogramm erklärt Machine Learning im Browser

📈 21.98 Punkte

📌 Google Teachable Machine 2.0 – Google bringt euch Machine Learning näher

📈 21.98 Punkte

📌 Machine Learning und Deep Learning erklärt

📈 21.53 Punkte

📌 What is Machine Learning? What is Deep Learning? What Is the Difference Between Them?

📈 21.53 Punkte

📌 Sophos: Deep Learning statt Machine Learning

📈 21.53 Punkte

📌 Deep Learning vs. Machine Learning | AI Show

📈 21.53 Punkte

📌 Get started with Reinforcement Learning on Azure Machine Learning

📈 21.53 Punkte

📌 DeepMind x UCL | Deep Learning Lectures | 1/12 | Intro to Machine Learning & AI

📈 21.53 Punkte

📌 DeepMind x UCL | Deep Learning Lectures | 5/12 | Optimization for Machine Learning

📈 21.53 Punkte

📌 Amazon AWS Machine Learning Summit keynote kicks off with ‘few-shot learning’

📈 21.53 Punkte

📌 Machine Learning - Learning Cybersecurity

📈 21.53 Punkte

📌 DEF CON 26 WIRELESS VILLAGE - Dunlap - Learning to Listen Machine Learning for Adaptive Wireless

📈 21.53 Punkte