vocalize.ai Information

vocalize.ai – a test suite for advancing conversations between humans and computers How well do AI powered virtual assistants hear us when exposed to real-world operating conditions? We have already started and preliminary results are shared in our report. How do we ensure that the next wave of conversational computing is inclusive across gender, race, age, dialect and accent? This work will leverage initial procedures and algorithms, but with diversified datasets and additional procedures. We introduce the concept of an “inclusivity index” for AI platforms. vocalize.ai is developing test suites, software and the associated data sets to perform black-box evaluations of ASR systems. We will help highlight gaps in performance with measurable, repeatable and shared benchmarks. This approach closely aligns with recent recommendations published on April 16, 2018 by the upper House of the UK parliament: AI in the UK, “to incentivize the development of technologies that can audit and interrogate AIs.”