In system engineering, testing is a generally accepted approach to validate systems and system components. Assured quality of system and system components is particularly important as the time-to-market become ever shorter and the requirements on system features, reliability, availability, integrity and performance further increase. A systematic approach to testing distributed systems is essential, so that the requirements of the market can be fulfilled.
The Testing and Test Control Notation TTCN-3, being the third edition of TTCN, has been developed by ETSI to address testing needs of modern Telco, IT and embedded system technologies and to widen the scope of applicability. This introductory tutorial will discuss the basic concepts of TTCN-3 and demonstrate its use for a voice over IP call.
The tutorial will be on introductory and intermediate level. Audience: Anyone interested in automated testing
To present basic principles of automated testing with TTCN-3.
TTCN-3 is a language to define test procedures to be used for black-box testing of distributed systems. Stimuli are given to the system under test (SUT), its reactions are observed and compared with the expected ones. On the basis of this comparison, the subsequent test behaviour is determined or the test verdict is assigned. If expected and observed responses differ, then a fault has been discovered which is indicated by a test verdict fail. A successful test is indicated by a test verdict pass.
TTCN-3 allows an easy and efficient description of complex distributed test behaviour in terms of sequences, alternatives, loops and parallel stimuli and responses. Stimuli and responses are exchanged at the interfaces of the system under test, which are defined as a collection of ports. The test system can use a number of test components to perform test procedures in parallel. Likewise to the interfaces of the system under test, the interfaces of the test components are described as ports.
TTCN-3 is a modular language and has a similar look and feel to a typical programming language. However, in addition to the typical programming constructs, it contains all the important features necessary to specify test procedures and campaigns for functional, conformance, interoperability, load and scalability tests like test verdicts, matching mechanisms to compare the reactions of the SUT with the expected range of values, timer handling, distributed test components, ability to specify encoding information, synchronous and asynchronous communication, and monitoring.
A TTCN-3 test specification consists of four main parts:
The tutorial will give an introduction to TTCN-3 and discuss its main new features like:
Theofanis Vassiliou-Gioles email: firstname.lastname@example.org phone: +49 30 726 1919 12 fax: +49 30 726 1919 20 web: www.testingtech.de Address: Testing Technologies IST GmbH Rosenthaler Straße 13 10119 Berlin, Germany
J. Zander, Z.R. Dai, I. Schieferdecker, G. Din: From U2TP Models to Executable Tests with TTCN-3 - An Approach to Model Driven Testing, IFIP 17th Intern. Conf. on Testing Communicating Systems - TestCom 2005, Montreal, Canada, March 2005.
I. Schieferdecker, A. Rennoch: Industrial use of TTCN-3 - Scope and Limits, International Conference on Software Tests, ICSTEST 2005, Düsseldorf, April 2005.
S. Burton, A. Baresel, I. Schieferdecker, Automated testing of automotive telematics systems using TTCN-3, 3rd Workshop on System Testing and Validation (SV04), Paris, December 2, 2004, Fraunhofer IRB Verlag, Stuttgart.
I. Schieferdecker, G. Din, D. Apostolidis: Distributed Functional and Load tests for Web services, International Journal on Software Tools for Technology Transfer (STTT), Springer 2004
I. Schieferdecker, G. Din: A Metamodel for TTCN-3, 1st International Workshop on Integration of Testing Methodologies ITM 2004, October 2004, Toledo, Spain, Springer, Lecture Notes in Computer Science 3236.
T. Vassiliou-Gioles, G. Din, I. Schieferdecker: Execution of External Applications using TTCN-3. IFIP 16th Intern. Conf. on Testing Communicating Systems - TestCom 2004, St Anne's College, Oxford, United Kingdom, March 2004, Springer, Lecture Notes in Computer Science 2978.
I. Schieferdecker , T. Vassiliou-Gioles: Tool Supported Test Frameworks in TTCN-3. – 8th Intern. Workshop in Formal Methods in Industrial Critical Systems, Røros, Norway, June 2003, ENTCS (80), Elsevier Science.
I. Schieferdecker, T. Vassiliou-Gioles: Realizing distributed TTCN-3 test systems with TCI, IFIP 15th Intern. Conf. on Testing Communicating Systems - TestCom 2003, Sophia-Antipolis, France, May 2003, Springer, Lecture Notes in Computer Science 2644.
I. Schieferdecker, S. Pietsch, T. Vassiliou-Gioles: Systematic Testing of Internet Protocols - First Experiences in Using TTCN-3 for SIP. 5th IFIP Africom Conference on Communication Systems, Cape Town, South Africa, May 2001.
S. Schulz, T. Vassiliou-Gioles: Implementation of TTCN-3 Test Systems using the TRI. 14th IFIP International Workshop on Testing Communicating Systems' (Testcom 2002), Kluwer Academic Publishers, Berlin, March 2002.
M. Ebner, A. Yin, M.Li: A Definition and Utilization of OMG IDL to TTCN-3 Mappings. 14th IFIP International Workshop on Testing Communicating Systems' (Testcom 2002), Kluwer Academic Publishers, Berlin, March 2002.
J. Grabowski, Anthony Wiles, Colin Willcock, Dieter Hogrefe. On the Design of the new Testing Language TTCN-3. 13th IFIP International Workshop on Testing Communicating Systems' (Testcom 2000), Ottawa, 29.8.2000-1.9.2000, Kluwer Academic Publishers, August 2000.
J. Grabowski. TTCN-3 - A new Test Specification Language for Black-Box Testing of Distributed Systems.17th International Conference and Exposition on Testing Computer Software (TCS'2000), Theme: Testing Technology vs.Testers' Requirements, Washington D.C., June 2000.
TTCN-3 Homepage http://www.ttcn-3.org
TTCN-3 Tools http://www.testingtech.de/products