The results of Loop ventures smart speaker IQ test have been published. Google home was certainly the winner but the surprise part was that Apple’s HomePod and Siri came to the top of Alexa and Cortana.
The virtual assistants were asked about 800 questions in total from the firm and they were graded on the basis of whether the question was understood and whether they provided a correct response. There were five content categories in which these questions were organized:
This IQ test was conducted between a 2nd generation Amazon Echo, Google Home Mini, Apple HomePod and Harman Kardon Invoke. The table below shows the results comparison. Google Home was able to correctly answer 88 percent of them and understood all the queries. Cortana was only able to answer 63 percent of questions correctly.
Google Overpowers Amazon in Commerce Category: The virtual assistants were shown improvements from past tests conducted by Loup. According to the firm the most noticeable improvement was shown by Alexa. When terms of specific area, Cortana did best in the information category and also Alexa did the same where it nearly matched Google’s score. In the category of best in Local and Navigation Siri performed the best. Siri also did well in the command category. All the other rivals were outperformed in the commerce category by Google, the worst performer in this category was Alexa despite it is connected with Amazon.
Google’s overall win was partly to featured snippets as it was credited by Loup.
“Google Assistant’s outperformance stems largely from the search function featured snippets… where others may answer with, ‘here’s what came back from a search and a list of links, Google is able to read you the answer.”
The thing with smart speakers and voice search is that it is more rapidly adopted than any preceding technology. They provide significant potential as search, content discovery and commerce platforms. The improvement in accuracy and capabilities reflect above will likely lead consumers to do more and it will ultimately help them in realizing their innate potential as a marketing channel.