Publication

Back to overview

A Shared Task for Spoken CALL?

Type of publication Peer-reviewed
Publikationsform Proceedings (peer-reviewed)
Author Baur Claudia, Gerlach Johanna, Rayner Manny, Russell Martin, Strik Helmer,
Project Designing and evaluating spoken dialogue based CALL systems
Show all

Proceedings (peer-reviewed)

Title of proceedings Proc. LREC
Place Portorož, Slovenia

Open Access

URL https://archive-ouverte.unige.ch/unige:84103
Type of Open Access Website

Abstract

We argue that the field of spoken CALL needs a shared task in order to facilitate comparisons between different groups and methodologies, and describe a concrete example of such a task, based on data collected from a speech-enabled online tool which has been used to help young Swiss German teens practise skills in English conversation. Items are prompt-response pairs, where the prompt is a piece of German text and the response is a recorded English audio file. The task is to label pairs as “accept” or “reject”, accepting responses which are grammatically and linguistically correct to match a set of hidden gold standard answers as closely as possible. Initial resources are provided so that a scratch system can be constructed with a minimal investment of effort, and in particular without necessarily using a speech recogniser. Training data for the task will be released in June 2016, and test data in January 2017.
-