Showmaster

time to show off

Vision

roboy loves to entertain you!

https://youtu.be/074fSgJWvhY

Roboy wishes to be more entertaining and impressive. With his new skills he is reliably able to attract people to its presence independent to their relation to him.

He appeals as well to an audience as to a group of developers, satisfying both of their preferences.

Our Goal

this semester we want…

teach Roboy some games
give Roboy more facial expressions
improve Roboy’s vision system
improve Roboy’s talking skills

Abstract

combining cognitive forces

  • We are combining cognitive forces. 
  • On a high level, the architecture looks like this:
    Classify Object, vision for Snapchat, new generative model and more faces that enrich the interaction with Roboy have been implemented by us.
  • The new personality has two main modes, which iterate based on information from vision
  • In info talk, only Roboy is talking, trying to get people’s attention.

In interactive talk, Roboy starts talking to a person which seems to be interested.

  • In detail, dialog starts from idle with an informative talk about himself.
  • While talking, vision is checking if and how many people are listening to Roboy.
  • In case that is true, it switches to interactive talk, where Roboy tries to get to know it’s interlocutor.
  • The user might also be asked to play games such as Akinator and Snapchat or do wild talk to a generative model.
  • Snapchat can add filters to a users face. Results from object detection trigger the dialog system as shown before to switch between states.
  • To make interaction appear more natural, Roboy is now able display a wide range of emotions, which are triggered from dialog.

Results

roboy can now…

https://youtu.be/6UfJRDNbUq0
show more facial expressions

show more facial expressions

implement an interactive personality consisting of additional faces

Play games

Play games

such as Akinator & Roboy Snapchat Filters

Chit Chat with you

Chit Chat with you

improved the Chit Chat generative model and environmental interpretation

FacialExpressionsRoboy

The Team

get to know the showmaster team

Team members SS2018

Alona Kharchenko (Team Lead)
Daniel Lorencic (Agile Coach)
Christoph Killing
Julian Eyrich
Nina Fischer
Sebastian Riegelbauer

Links

      codes, documentations & presentations

Where to go next

an entertainer as good as the human gottschalk

  • The plan for next semester already is to make Roboy a DJ.
  • We see Roboy to go above and beyond it with having its own TV series.
  • As a true showmaster, entertaining the crowds will come to him naturally.