2nd Workshop on Model-based Testing in Practice

23 June 2009, Enschede (NL)

Workshop Goal

The objective of the workshop is to bring together industry and academy by providing a platform for interaction and collaboration. Industrial papers should either describe challenges of system or software testing that could be addressed by model-based testing or present their approach to apply model-based testing in practise. Research papers are expected to present promising ideas or possible solutions in the field of model-based testing that have the potential to be utilized in industrial testing scenarios. Submitted papers should cover at least one of the following topics:

• Model-based test design and specifications
• Test languages and methodologies (e.g. TTCN-3, UML testing profile)
• Guidelines for model-based testing
• Model-based test approaches for emerging technologies like SOA
• Executable test models and simulation
• Derivation of test models from system models
• Architecture-driven testing
• Quality and validation of test models
• Test models for non-functional quality properties (e.g. reliability, safety, performance)
• Optimization and prioritization of test case suites
• Risk-based testing with model-based technologies
• Cost and economic impact of model-based testing
• Model-based test processes and standard compliance
• Combination of model-based testing, model-based inspections, and formal model checking
• Tool automation and tool support
• Experience reports from case studies in various domains

top

Workshop Description

The continuous industrial trend to rise software complexity by increasing functionality and accessibility of software and electronic components leads to an ever-growing demand for techniques to ensure software quality. At the same time software companies are shortening development cycles to respond the customers demand for fast and flexible solutions. In order to remain competitive an early and continuous consideration and assurance of system quality becomes an asset of ever-increasing importance in industrial software development. Model-based approaches are not only able to provide effective quality assurance, but also help to evaluate and control the coverage, costs, and risks related to the testing efforts. Both – the effectiveness and the efficiency of testing – can be handled by model-based approaches within integrated system and test development for software-intense systems.

While the software industry starts to adopt model-based testing techniques on a large scale promising research ideas emerge that have the potential to answer many of today’s industrial challenges. The workshop will bring together practitioners and researchers to initiate a dialog that is much needed for both sides.

The ECMDA seeks to foster industrialization of MDA methodology. Model-based testing is dependent on modelled information as provided by MDA and offers many ways to improve efficiency and effectiveness of industrial software testing. Additionally it supports the dialogue between research and industry and therefore perfectly supplements the ECMDA main conference.

Keynote speech

The workshop keynote speech will be given by Prof. Lionel Briand, Simula Research Laboratory, http://simula.no/people/briand.

The work presented in this talk takes place in the context of model-driven development with the UML, which is now a de-facto industry standard. I will report on a body of work, done in collaboration with my Ph.D. students, that focuses on exploiting UML models or extensions (profiles) for the purpose of supporting the analysis and testing of nonfunctional properties. The main technical underpinning of our approach is to rely on evolutionary search techniques for identifying property violations and generating stress test cases. Our goal is to devise scalable, applicable approaches to model-based verification, that are not based on exhaustive search of the state space and formal, temporal logic expressions, but rather on search heuristics and standard extensions of UML models. The presentation will focus on real-time deadlines and concurrency properties but the general approach is believed to be applicable to other areas as well.

top

Program

9:00 Opening & Invited Talk

Model-based Testing and Analysis of Non-functional Properties in the context of UML Development: An Evolutionary Testing Approach
Lionel Briand

10:00 Morning coffee break

10:30 Session 1: MBT for Embedded Systems

Combining Combinatorial and Model-based Test Approaches for Highly Configurable Safety-critical Systems
Thomas Bauer, Robert Eschbach, Martin Größl, Tanvir Hussain, Detlef Streitferdt and Florian Kantz

An Approach for Test Derivation from System Architecture Models applied to Embedded Systems
George Din and Klaus-Dietrich Engel

Model Based Statistical Testing and Time
Frank Böhr

Test Case Generation for Embedded Automotive Systems: A Semantics Preserving Model Transformation
Valentin Chimisliu, Christian Schwarzl and Bernhard Peischl

12:30 Lunch break

14:00 Session 2: UML-based MBT Approaches

Transformational Support for Model-Based Testing - from UML to QML
Fredrik Abbors, Tuomas Pääjärvi, Risto Teittinen, Dragos Truscan and Johan Lilius

Combining Sequences and State Machines to Build Complex Test Cases
Dehla Sokenou and Stephan Weißleder

Model Based Testing of Web Service Composition Using UML Profile
Irum Rauf, Muhammad Zohaib Z. Iqbal and Zafar I. Malik

15:30 Afternoon coffee break

16:00 Session 3: Tool Support for MBT

Case Study-Based Performance Evaluation of Reactive Planning Tester
Andres Kull, Kullo Raiend, Jüri Vain and Marko Kääramees

Compliance Test Framework
Leon Bouwmeester, Guy Broadfoot and Philippa Hopcroft

Emerging Patterns for Testing Model Management Tools
Louis M. Rose, Dimitrios S. Kolovos, Richard F. Paige, Tara Gilliam and Fiona A.C. Polack

17:30 Closing

top

Important Dates

Submission deadline: 13th April 2009 (Note: please use EasyChair for this step)
Notification of acceptance for participation & presentation: 5th May 2009
Final papers: 20th May 2009
Workshop: 23rd June 2009

top

Organisation

Thomas Bauer, Fraunhofer IESE, Germany (thomas [dot] bauer [at] iese [dot] fraunhofer [dot] de)
Hajo Eichler, IKV++, Germany (eichler [at] ikv [dot] de)
Axel Rennoch, Fraunhofer FOKUS, Germany (axel [dot] rennoch [at] fokus [dot] fraunhofer [dot] de)
Sebastian Wieczorek, SAP, Germany (sebastian [dot] wieczorek [at] sap [dot] com)

Workshop e-mail address: motip09 [at] fokus [dot] fraunhofer [dot] de
Workshop homepage: http://www.fokus.fraunhofer.de/go/motip09

top

Submission details

Papers or position statements should have maximum 10 pages. Both long and short papers will be considered. Submissions should be made electronically, in PDF format (MS Word and LaTeX need to be printed by any PDF writer) or Postscript via EasyChair (instruction details and templates should be according to formats given at http://www.springer.com/computer/lncs?SGWID=0-164-7-72-3760, e.g. download word.zip if using Office2007 Word). Please clearly indicate whether the paper is a research paper, an experience report, or a position paper. All papers will be independently reviewed by two members of the Program Committee and ranked according to their appropriateness.

top

Publication and dissemination

Authors may be asked to make a short presentation during the workshop. Accepted workshop contributions will be published on the workshop website and through the workshop proceedings in the CTIT Proceedings Series as in relationship with the ECMDA.

top

Registration

Registration should be made following the guidelines provided at ECMDA 2009:
http://www.utwente.nl/projecten/ecmda2009/register/

top

Program Committee

• Fevzi Belli, Uni Paderborn, Germany
• Michael Ebert, Robert Bosch GmbH, Germany
• Juhan Ernits, University of Birmingham, UK
• Robert Eschbach, Fraunhofer IESE, Germany
• Andreas Hoffmann, Fraunhofer FOKUS, Germany
• Jacques Kamga, Daimler AG, Germany
• Andrei Kirshin, IBM Haifa, Israel
• Andres Kull, Elvior, Estonia
• Raluca Lefticaru, Universitatea din Pitesti, Romania
• Bruno Legeard, Smartesting, France
• Jesse Poore, University of Tennessee, USA
• Alexander Pretschner, TU Kaiserslautern, Germany
• Christopher Robinson-Mallett, Berner & Mattner, Germany
• Ina Schieferdecker, TU Berlin, Germany
• Alin Stefanescu, SAP Research, Germany
• Detlef Streitferdt, ABB Corporate Research Center, Germany
• Dragos Truscan, Abo Akademi University, Finland
• Colin Willcock, Nokia Siemens Networks, Germany

top

Proceedings

Download the Proceedings of The 2nd Workshop on Model-based Testing in Practice here.