Skip to main content

Data Collection

Transcription

Video Annotation

Elevating Voice Assistant Performance with Benchmarking and Data Annotation

 

The Challenge

A leading technology company sought to enhance the performance of its voice assistants across various ecosystems, including mobile devices, home assistants, and desktop platforms. The project required extensive annotation and transcription to measure and refine voice recognition accuracy. To achieve its strategic goals, the client needed a partner capable of conducting high-quality benchmarking studies and delivering actionable data with precision.

• • • •The Solution• • • •

DataForce provided a comprehensive benchmarking solution encompassing data collection, transcription, and annotation. Leveraging its state-of-the-art facilities, DataForce designed a customized approach to meet the client’s rigorous standards:

  • Custom UI Development: A tailored interface was created to process recordings, which were measured and sent to the DataForce platform for annotation, grading, transcription, and time-stamping.
  • Benchmarking Studies: In-person moderated studies were conducted every 3–4 months in controlled environments, targeting all three ecosystems. Measurement data was collected from demographically diverse participant groups ranging from 50 to 500 individuals across the United States, ensuring a broad and unbiased dataset for accurate evaluation.
  • Quality Assurance: DataForce upheld a rigorous quality standard of 99% accuracy for annotation, with timestamping measurements precise to within 1/10th of a second. This ensured the data met the highest industry standards and was reliable for strategic decision-making.

The Results:

By leveraging DataForce’s expertise, the client consistently met its quality standards and maintained a competitive edge in the voice assistant market. The high-quality data allowed the organization to optimize functionality and inform strategic decisions across ecosystems, ultimately refining its voice assistant technology.

DataForce has a global community of over 1,000,000 members from around the globe and linguistic experts in over 250 languages. DataForce is its own platform but can also use client or third-party tools. This way, your data is always under control.

Request a consultation.