MoSES - Multimodal mobile event-search

The video shows a joint technology demonstrator of SemVox GmbH and Telenet GmbH. It is an application for a mobile and multimodal event search. All requests can be made either via speech, keyboard, gesture or touch screen or in a combination thereof. Thanks to a flexible, context-dependent dialogue controlling, the user is not bound to strict menu specifications. On the contrary, the application allows for complex input such as “Which events take place in Munich next week?” and reacts with the according answers or clarifying questions. The possibility to include external services such as Google Maps, YouTube or Google Calendar makes it possible to not only present the results of the search but to also display videos and further information. The system core is language independent so that any target language can be implemented. Speech input and output supports foreign-language utterances like for example “Enter the event 'Keith Caputo’ into my calendar”. All input is interpreted within its context; ambiguous results are resolved via clarifying questions.