NUBOMEDIA: the cloud for future communication services

News from Mar. 05, 2014

The European project NUBOMEDIA researches how new technologies such as computer vision, augmented reality, 3D video or multisensory data can be used for creating novel communication paradigms going beyond phone calls and video conferences. NUBOMEDIA is coordinated by Rey Juan Carlos University and has distinguished research and industrial partners including the Fraunhofer Institute FOKUS, the Technical University of Berlin, the Stefan cel Mare Suceava University, the VTT Institute, Telecom Italia, ZED Worldwide, LiveU, Visual Tools and Naevatec.

NUBOMEDIA: the cloud for future communication services

The European project NUBOMEDIA researches how new technologies such as computer vision, augmented reality, 3D video or multisensory data can be used for creating novel communication paradigms going beyond phone calls and video conferences.

 

Traditional communication services act just as mere information transport systems. For example, when we perform a phone call, we just receive the speech signal coming from the person at the other end of the line. However, new techniques such as computer vision, augmented reality and the advanced processing of audio-visual flows allow creating novel communication paradigms useful in diverse areas such as e-Health, security, defence, video games or smart TV.

 

Prof. Luis Lopez, form URJC, presents it in this way: “We can imagine, for example, WebRTC video conferences for telemedicine where the own network infrastructure offers biometric information extracted from the computational analysis of patients’ video and speech. We may also think about social video games where users connect through smartphones and tablets to interact with virtual objects and characters embedded into their exchanged streams. When looking to advertising, we envision personalized commercials where the end-user is embedded as the main character of the spot. Applications for security and defence are also numerous when considering person-to-machine communication models combined with computer vision techniques for people or object detection and tracking.”

 

These types of services are not currently mainstream due to the traditional lack of capability on networks. However, in the last few years, the emergence of high bandwidth access technologies, such as fiber or 4G, is making possible their mass adoption. Nevertheless, the creation of such services still requires very important infrastructure investments and development efforts that are not compatible with reasonable business models, and this is why they are not popular. NUBOMEDIA has the objective of addressing this problem by creating a cloud platform allowing small enterprises and individual programmers to develop their very own interactive multimedia communication services without significant investments or efforts and in a secure, efficient and scalable way. NUBOMEDIA plans to expose a number of Application Programming Interfaces (APIs) to end developers suitable for creating a next generation of multimedia services where the information exchange is enriched through processing capabilities such as face detection and recognition, interaction with virtual objects, 3D scenario reconstruction, advanced video mixing, video recording and recovery, etc. From the perspective of programmers, the NUBOMEDIA infrastructure just behaves as an infinite supercomputer where the processing capabilities can elastically increase to adapt to the load offered by end users.

 

To foster innovation and catalyse the emergence of a whole ecosystem of applications and users around NUBOMEDIA, all research results of the project will be released as open source software following flexible licenses such as LGPL or Apache.

 

NUBOMEDIA is coordinated by Rey Juan Carlos University and has distinguished research and industrial partners including the Fraunhofer Institute FOKUS, the Technical University of Berlin, the Stefan cel Mare Suceava University, the VTT Institute, Telecom Italia, ZED Worldwide, LiveU, Visual Tools and Naevatec.

 

NUBOMEDIA has been funded by the European Commission under 7th Framework Programme objective ICT-2013.1.6: Connected and social media.