Automatic alt-text in Pictures

Office 365 utilises Azure Intelligent Services for a number of features including dictation, designer and smart lookup.  One of the features we love is the automatic alt-text generation when you insert a picture into an Office document.

We are strong advocates that accessibility is not just important to users who need these features; everyone who creates content should be making it accessible.

A picture tells a thousand words but when a screen reader is parsing a document it will read out the alt-text for an image.  If there’s no alt-text then you’ll just hear something along the lines of ‘picture’.  Not very helpful.  It’s been possible to manually enter the alt-text of course and this is very helpful in online content for search engine optimisation.

Intelligent services can automatically generate the alt-text for you based on the image contents.  If you are dealing with sensitive images, this feature can be turned off in options as it does require information being sent to Microsoft.

Let’s insert an online image into a document to see how it performs.

Button to insert pictures in Office

 

For blatant blog-promotion SEO purposes I’m going to search for an online image of the royal wedding.  Megan Markle Prince Harry Royal Wedding Windsor Castle.  That should raise us at least one place in search results.

Search results for online pictures

 

When I insert the fourth image, intelligent services analyses it and generates an alt-text tag for me.  In this case, it’s accurate but not quite hitting the spot of wedding dress and it certainly doesn’t even try to achieve facial recognition; we know that’s a minefield.  This result is far better than leaving alt-text empty though.

alt text for an image

 

So you’ll get mixed results.  Insert the third image and you’ll get an amusing result of “A picture containing dancer, indoor, sport, red” when clearly the image is all about the military and boys in culottes.

Alt text in a picture

 

Now, we’ll try a business image and search for Donald Trump.  I can feel our SEO going up.

alt text in a picture

 

The alt-text is accurate but again, no face recognition.  Last example to see if there’s some Microsoft bias.  I inserted the Microsoft logo.

Microsoft logo

 

No alt-text was generated but there’s a button in the image option alt-text panel which you can click to generate some.  If you need to use this button, the image was typically not obvious enough for intelligent services to work out straight away so the confidence level will be lower.

Office generating alt-text for a picture

 

Our result?  A drawing of a face.  Perhaps Bill Gates’ face is in the logo subliminally.

 

Alt-text result for the Microsoft logo