Detecting harm content in text and images using Azure AI Content Safety

Introduction

Social media platforms have become double-edged swords in the last years. They provide us with worldwide connections, but they can also act as havens for dangerous content. Tech companies have resorted to artificial intelligence to protect online communities from this escalating problem. Azure AI Content Safety, a service made to recognize and flag hazardous content, is a potent tool.

Development

We created a demo application to demonstrate the capabilities of Azure AI Content Safety. An Angular frontend serves as the user interface in this demo, while a.NET backend API manages the laborious task of content analysis.

For this demo we will use this GitHub and create the Content Safety resource.

Once the resource is created, go to Keys and Endpoint under Resource Management and copy the key and endpoint.

These credentails must be pasted in the appsettings.Development.json file in the AzureAIContentSafety.API project.

{

   "AzureAIContentSafety":{

      "Endpoint":"https://<SERVICE_NAME>.cognitiveservices.azure.com/",

      "ApiKey":"",

      "TextSeverityThreshold":{

         "Blur":3,

         "Reject":5

      },

      "ImageSeverityThreshold":{

         "Blur":2,

         "Reject":4

      }

   }

}

Now, create the Storage Account. Follow this configuration in the Basics tab.

Then, go to Containers under Data storage and create the container images and chose the Anonymous access level to Blob.

Now, you must copy the connection string to your Storage account. So, go to Access keys under Security + networking. Click on Show for the connection string key1.

Conclusion

Even though AI-powered solutions like Azure AI Content Safety are a big improvement, it's crucial to keep in mind that they are not panacea. To ensure accurate and moral content control, human oversight remains required. We can make the internet a safer and more welcoming place by combining human knowledge with AI's ability. We might expect even more advanced tools to appear as technology develops further, assisting us in managing the challenges of the digital age.

Thanks for reading

Thank you very much for reading. I hope you found this article interesting and may be useful in the future. If you have any questions or ideas you need to discuss, it will be a pleasure to collaborate and exchange knowledge.