TTCN-3 (Testing and Test Control Notation version 3) is a strongly typed testing language used in conformance testing of communicating systems. TTCN-3 is written by ETSI in the ES 201 873 series,[1] and standardized by ITU-T in the Z.160 Series.[2] TTCN-3 has its own data types and can be combined with ASN.1, IDL and XML type definitions.
Standard organization
editITU-T TTCN-3 standard is part of the Z Series and is organized in several parts:
- Z.161 - Core Language defining the core textual notation
- Z.162 - Tabular presentation format (TFT) - a way to present the tests in a tabular presentation
- Z.163 - Graphical presentation format (GFT) - a way to present the tests graphically with a representation that is similar to the MSC
- Z.164 - Operational Semantics - Defines how TTCN-3 is executed
- Z.165 - TRI - Defines the API provided and required with a tester
- Z.166 - TCI - Defines the API provided and required with a test controller
- Z.167 - ASN.1 - Defines how to use ASN.1 data types in a TTCN-3 test suite
- Z.168 - IDL to TTCN-3 mapping
- Z.169 - Using XML schema with TTCN-3
Language organization
edit- Module
- The top level container in a test suite is a module. It is usually a file.
- Component
- component is an execution entity. A test case or a function is executed on a component.
- Port
- Components communicate with each other or with the SUT through ports that are mapped to each other.
- Test case
- A test case is a sequence of sends and receives. When a message is sent to the SUT (System Under Test) several possibles replies can be received.
- Alternative
- Since a test case is a sequence of stimuli followed by a set of possible responses, the notation includes alternatives. It is a compact way to list all the possible alternatives in a scenario.
- Template
- When sending or receiving information the value of the parameters are of paramount importance. They must be defined when sent and they must be verified when received. The template construct aims at defining the parameters values when sent or verifying the parameter values when received. Since parameters can be quite complex, defining and verifying the values is not a matter of a single line. The template allow complex verification in a single statement so that the test case stays legible.
- Verdict
- The verdict is the result of a test case execution. It has 5 possible values: none, pass, inconc, fail, error.
Applications
editTTCN-3 has been used to define conformance test suites to SIP, WiMAX, and DSRC standard protocols.
The Open Mobile Alliance adopted in 2008 a strategy of using TTCN-3 for translating some of the test cases in an enabler test specification into an executable representation.[3]
The AUTOSAR project promoted (2008) the use of TTCN-3 within the automotive industry.[4]
The 3GPP project promoted the use of TTCN-3 within the mobile industry.[5]
Architecture
editWhen executing the architecture is organized as follow:
- TE: TTCN-3 Executable is the executable form of the test suite.
- TRI: TTCN-3 Runtime Interface is the interface between the TE and the SUT. It is divided in 2 parts:
- SA: System Adaptor
- PA: Platform Adaptor
- TCI: TTCN-3 Control Interfaces is the interface to control the test execution. It is divided in:
- TM: Test Management
- TL: Test Logging
- CD: Coding and Decoding
- CH: Component Handling
Example code
editThis is a TTCN-3 example with its graphical equivalent in MSC (Message Sequence Chart).
module TestSystem {
// Define a subtype of integer
type integer myNewType (0..50)
// Declare Request struct type with 2 fields
type record Request {
myNewType param1,
charstring param2
}
// Declare Answer struct type with one field
type record Answer {
myNewType param1
}
// Declare a message based communication port
type port cEnv_type message {
out Request;
in Answer;
}
// Declare the component on which the test case will run
type component sSystem {
port cEnv_type cEnv;
}
// The templates define the outgoing parameter values
// and verify the incoming parameter values
template Request Good_Req := {param1 := 42, param2 := "hello !" };
template Answer All_is_OK := {param1 := 0};
// Define testcase1 that will run on sSystem component
testcase testcase1() runs on sSystem
{
// Send Request message with (42, "hello !") as parmeters
cEnv.send(Good_Req);
// An alternative for the 2 possible answers
alt
{
// Do we receive Answer with 0 as parameter
[]cEnv.receive(All_is_OK)
{
// Pass verdict !
setverdict(pass)
}
// Or do we receive something else
[]cEnv.receive
{
// Fail verdict
setverdict(fail)
}
}
}
// Control part chains test cases execution automatically
control {
var verdicttype verdict1;
verdict1 := execute(testcase1());
}
}
See also
editReferences
edit- ^ ETSI TTCN-3 page
- ^ Z series
- ^ OMA Interoperability Working Group
- ^ TTCN-3 application areas, ETSI official TTCN-3 web site, retrieved on Nov 17, 2015
- ^ 3GPP RAN5 Mobile Competence Centre