Presentedy by: Dr. Stephan Steglich, Louay Bassbouss, Fraunhofer FOKUS
Multi-Screen applications are entering the market with force. TV sets and – so-called – companion devices (smartphones and tablets) have outgrown their original purpose and are now playing together an important role in multi-screen context.
Almost every modern connected TV can be controlled with a smartphone app provided by the manufacturer. These apps range from simple remote control replacements, to fully featured media centers including PVR programming, interactive EPGs and video streaming from the TV to the smartphone. Also new generation of companion devices provide connectivity to large displays and give mobile applications the ability to mirror or extend the small screen of the mobile device.
Today’s standard application models are however focused on single devices and screens. Multi-Screen applications face new challenges such as discovery of devices and services, launch of applications on remote devices, synchronization of application state across devices as well as timeline synchronization of multiple media streams, application to application communication, etc. New application development paradigms, concepts, protocols and technologies addressing these challenges are getting mature and will be presented in this tutorial.
In this tutorial we will introduce the concepts of Multi-Screen with a survey on application scenarios and brief the participants about technical implications and requirements that each use case implies. Furthermore, we will explain the underlying technical and design challenges for building multi-screen applications. We will also discuss existing technologies and standards that offer solutions for specific challenges we identified.
Challenges for Multi-Screen Applications
Multi-screen applications face challenges that go beyond traditional applications and require developers to think about additional challenges. In this part of the tutorial we will examine different aspects of Multi-Screen applications from a more technical perspective and cover several relevant topics ranging from distribution of apps across devices, discovery and synchronization to performance, security and alignment of user preferences issues. Participant will also learn how to design multi-screen applications and what are the challenges and best practices from UX perspective.
Multi-Screen Technologies & Standards
We will continue the tutorial by presenting latest technical solutions and protocols in the industry such as UPnP and Bonjour for device and service discovery in local networks, DLNA, Miracast and Airplay for media and screen sharing (mirroring and extension), DIAL for remote application launch, iBeacon for wake-up and local notification, WebSockets and WebRTC for communication between applications and many others. We will also discuss in this part of the tutorial relevant standardization activities in different bodies and organizations such as HbbTV, Hybridcast, W3C (NSD and Webscreens) as well as existing and up-coming multi-screen frameworks such as Samsung MultiScreen SDK, LG PARS Framework, IRT Second Screen Framework, Fraunhofer FOKUS FAMIUM Framework, etc. Participants will learn what solutions these technologies bring and which gaps still remain with respect to Multi-screen application development.