Cookie Consent by Free Privacy Policy Generator ๐Ÿ“Œ Combine the Power of Video Indexer and Computer Vision

๐Ÿ  Team IT Security News

TSecurity.de ist eine Online-Plattform, die sich auf die Bereitstellung von Informationen,alle 15 Minuten neuste Nachrichten, Bildungsressourcen und Dienstleistungen rund um das Thema IT-Sicherheit spezialisiert hat.
Ob es sich um aktuelle Nachrichten, Fachartikel, Blogbeitrรคge, Webinare, Tutorials, oder Tipps & Tricks handelt, TSecurity.de bietet seinen Nutzern einen umfassenden รœberblick รผber die wichtigsten Aspekte der IT-Sicherheit in einer sich stรคndig verรคndernden digitalen Welt.

16.12.2023 - TIP: Wer den Cookie Consent Banner akzeptiert, kann z.B. von Englisch nach Deutsch รผbersetzen, erst Englisch auswรคhlen dann wieder Deutsch!

Google Android Playstore Download Button fรผr Team IT Security



๐Ÿ“š Combine the Power of Video Indexer and Computer Vision


๐Ÿ’ก Newskategorie: Programmierung
๐Ÿ”— Quelle: azure.microsoft.com

We are pleased to introduce the ability to export high-resolution keyframes from Azure Media Serviceโ€™s Video Indexer. Whereas keyframes were previously exported in reduced resolution compared to the source video, high resolution keyframes extraction gives you original quality images and allows you to make use of the image-based artificial intelligence models provided by the Microsoft Computer Vision and Custom Vision services to gain even more insights from your video. This unlocks a wealth of pre-trained and custom model capabilities. You can use the keyframes extracted from Video Indexer, for example, to identify logos for monetization and brand safety needs, to add scene description for accessibility needs or to accurately identify very specific objects relevant for your organization, like identifying a type of car or a place.

Letโ€™s look at some of the use cases we can enable with this new introduction.

Using keyframes to get image description automatically

You can automate the process of โ€œcaptioningโ€ different visual shots of your video through the image description model within Computer Vision, in order to make the content more accessible to people with visual impairments. This model provides multiple description suggestions along with confidence values for an image. You can take the descriptions of each high-resolution keyframe and stitch them together to create an audio description track for your video.

Image description within Computer Vision

Using Keyframes to get logo detection

While Video Indexer detects brands in speech and visual text, it does not support brands detection from logos yet. Instead, you can run your keyframes through Computer Visionโ€™s logo-based brands detection model to detect instances of logos in your content.

This can also help you with brand safety as you now know and can control the brands showing up in your content. For example, you might not want to showcase the logo of a company directly competing with yours. Also, you can now monetize on the brands showing up in your content through sponsorship agreements or contextual ads.

Furthermore, you can cross-reference the results of this model for you keyframe with the timestamp of your keyframe to determine when exactly a logo is shown in your video and for how long. For example, if you have a sponsorship agreement with a content creator to show your logo for a certain period of time in their video, this can help determine if the terms of the agreement have been upheld.

Computer Visionโ€™s logo detection model can detect and recognize thousands of different brands out of the box. However, if you are working with logos that are specific to your use case or otherwise might not be a part of the out of the box logos database, you can also use Custom Vision to build a custom object detector and essentially train your own database of logos by uploading and correctly labeling instances of the logos relevant to you.

Computer Vision's logo detector, detecting the Microsoft logo.

Using keyframes with other Computer Vision and Custom Vision offerings

The Computer Vision APIs provide different insights in addition to image description and logo detection, such as object detection, image categorization, and more. The possibilities are endless when you use high-resolution keyframes in conjunction with these offerings.

For example, the object detection model in Computer Vision gives bounding boxes for common out of the box objects that are already detected as part of Video Indexer today. You can use these bounding boxes to blur out certain objects that donโ€™t meet your standards.

Object detection model

High-resolution keyframes in conjunction with Custom Vision can be leveraged to achieve many different custom use cases. For example, you can train a model to determine what type of car (or even what breed of cat) is showing in a shot. Maybe you want to identify the location or the set where a scene was filmed for editing purposes. If you have objects of interest that may be unique to your use case, use Custom Vision to build a custom classifier to tag visuals or a custom object detector to tag and provide bounding boxes for visual objects.

Try it for yourself

These are just a few of the new opportunities enabled by the availability of high-resolution keyframes in Video Indexer. Now, it is up to you to get additional insights from your video by taking the keyframes from Video Indexer and running additional image processing using any of the Vision models we have just discussed. You can start doing this by first uploading your video to Video Indexer and taking the high-resolution keyframes after the indexing job is complete and second creating an account and getting started with the Computer Vision API and Custom Vision.

Have questions or feedback? We would love to hear from you. Use our UserVoice page to help us prioritize features, leave a comment below or email [email protected] for any questions.

...



๐Ÿ“Œ Combine the Power of Video Indexer and Computer Vision


๐Ÿ“ˆ 67.47 Punkte

๐Ÿ“Œ Video Indexer - Unlock Insights from your video


๐Ÿ“ˆ 30.36 Punkte

๐Ÿ“Œ Inside the Microsoft Power Platform | Power Apps, Power Automate, Power BI and more


๐Ÿ“ˆ 28.87 Punkte

๐Ÿ“Œ Multi-language identification and transcription in Video Indexer


๐Ÿ“ˆ 27.68 Punkte

๐Ÿ“Œ Six things to consider when using Video Indexer at scale


๐Ÿ“ˆ 25.88 Punkte

๐Ÿ“Œ AI Show Live - Episode 68 - The Latest from Azure Video Indexer


๐Ÿ“ˆ 25.88 Punkte

๐Ÿ“Œ AI Show Live - Episode 68 - The Latest from Azure Video Indexer


๐Ÿ“ˆ 25.88 Punkte

๐Ÿ“Œ The Latest from Azure Video Indexer


๐Ÿ“ˆ 25.88 Punkte

๐Ÿ“Œ How to combine audio and video on Windows 10


๐Ÿ“ˆ 24.05 Punkte

๐Ÿ“Œ How to combine audio and video on Windows 10


๐Ÿ“ˆ 24.05 Punkte

๐Ÿ“Œ The Vision of Computer Vision (2018 Demos)


๐Ÿ“ˆ 23.37 Punkte

๐Ÿ“Œ Combine thousands of images into time-lapse video with GlueMotion


๐Ÿ“ˆ 22.25 Punkte

๐Ÿ“Œ How do I combine spliced video files from a torrent?


๐Ÿ“ˆ 22.25 Punkte

๐Ÿ“Œ Windows 10 Build 18267 Released With a New Enhanced Mode for Search Indexer


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Indexer class.http_indexer_phpcms.php PHPCMS_INCLUDEPATH privilege escalation


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Post Indexer Plugin 3.0.6.1 on WordPress cron.postindexerrebuild.php sql injection


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Post Indexer Plugin 3.0.6.1 on WordPress classes/class.model.php sql injection


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Post Indexer Plugin 3.0.6.1 auf WordPress classes/class.model.php SQL Injection


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Windows 10 Build 19025 With Throttled Search Indexer Out for Insiders


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Microsoft startet Indexer-Diagnose-App (Beta) fรผr die Windows-Suche


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Indexer Diagnostics 1912.19.1 Englisch


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Microsoft Indexer Diagnostics hilft bei Analyse der Windows-Suche


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Post Indexer Plugin 3.0.6.1 auf WordPress cron.postindexerrebuild.php SQL Injection


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Microsoft's Indexer Diagnostics Helps Troubleshoot Windows Search


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Dovecot up to 2.2.36.2/2.3.5.0 Indexer-Worker Process memory corruption


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Post Indexer Plugin up to 3.0.6.1 on WordPress unserialize privilege escalation


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Post Indexer Plugin up to 3.0.6.1 on WordPress period sql injection


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ SceneNzb.com: Usenet-Indexer mit Bezahlmodell wieder weg vom Fenster


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Post Indexer Plugin 3.0.6.1 auf WordPress classes/class.model.php SQL Injection


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ BitTorrent-Indexer & P2P-Suchmaschinen im Dezember 2020


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Usenet-Indexer NZBgeek gehackt: Nutzerdaten offengelegt


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Backdoor.Win32.Indexer.a Denial Of Service


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Backdoor.Win32.Indexer.a Hardcoded Credentials


๐Ÿ“ˆ 21.41 Punkte

๐Ÿ“Œ Scenenzbs.com: neuer Usenet-Indexer in Kooperation mit HoU geรถffnet


๐Ÿ“ˆ 21.41 Punkte











matomo