an approach to atml using the ssai rai standard ssai proprietary information: any distribution or...
TRANSCRIPT
An Approach to ATMLusing the SSAI RAI Standard
SSAI Proprietary Information: Any distribution or disclosure of this information is subject to prior SSAI approval.
Dr. Ronald C. Salley (321) 724-5566 x274 [email protected] Pritchett 321-724-5566 x260 [email protected]
RAI Visualization
Test PlatformRAI
Test Requirement Object
Test Program(test-platform independent)
The SSAI RAI Standard
The only model that completely supports
• complete platform independence and• parallel testing
RAI Visualization
RAI
Test Requirement Object
Test PlatformTest Program(test-platform independent)
The Test Requirement - the primary unit of currency for testing
The SSAI RAI Standard
Test Requirement vs. Test
Space = what Time = how data objects events
data-definition languages, eg., XML
programming languages, e.g., ATLAS
test platforms tests
test requirements test descriptions
test definitions
Test Requirement vs. Test
Space = what Time = how data objects events
data-definition languages, eg., XML
programming languages, e.g., ATLAS
test platforms tests
test requirements test descriptions
test definitions
Traditional Modeling
Test Requirement vs. Test
Space = what Time = how data objects events
data-definition languages, eg., XML
programming languages, e.g., ATLAS
test platforms tests
test requirements test descriptions
test definitions
RAI Modeling
Test Requirement vs. Test
Space = what Time = how data objects events
data-definition languages, eg., XML
programming languages, e.g., ATLAS
test platforms tests
test requirements test descriptions
test definitions
RAI Modeling
Test Requirement vs. Test
Space = what Time = how data objects events
data-definition languages, eg., XML
programming languages, e.g., ATLAS
test platforms tests
test requirements test descriptions
test definitions
RAI Modeling
Test Requirement vs. Test
TEST PLATFORM UUT
A, WFGB, WFG
C, DMM
E, DMM
D, DMM
F, DMM
G, DMM
ITA
H, WFG
1
2
3
4
5
6
7
8
9
10
16
15
14
13
12
11
Test Requirement vs. Test
TEST PLATFORM
SqW
A, WFG
2 µsec
RMSAvg
SnW
B, WFG
C, DMM
E, DMM
D, DMM
F, DMM
G, DMM
0 µsec5 µsec
3 µsec
ITA
H, WFG
1
2
3
4
5
6
7
8
9
10
16
15
14
13
12
11
UUT
Test Requirement vs. Test
TEST PLATFORM
SqW
A, WFG
2 µsec
RMSAvg
SnW
B, WFG
E, DMMF, DMM
0 µsec5 µsec
3 µsec
ITA
2
6
9
13
UUT
test requirement
Test Requirement vs. Test
TEST PLATFORM UUT
ITAA, WFG
B, WFG
SqW
5 µsec
E, DMM
2 µsec
RMS
F, DMM
Avg
3 µsec
SnW
0 µsec 2
6
9
13
UUT
test requirement
Test Requirement vs. Test
ITAA, WFG
B, WFG
SqW
5 µsec
E, DMM
2 µsec
RMS
F, DMM
Avg
3 µsec
SnW
0 µsec
TEST PLATFORM
2
6
9
13
UUT
test requirement
Test Requirement vs. Test
ITAA, WFG
B, WFG
SqW
5 µsec
E, DMM
2 µsec
RMS
F, DMM
Avg
3 µsec
SnW
0 µsec
TEST PLATFORM
2
6
9
13
UUT
test requirement
Test Requirement vs. Test
ITAA, WFG
B, WFG
SqW
5 µsec
E, DMM
2 µsec
RMS
F, DMM
Avg
3 µsec
SnW
0 µsec
TEST PLATFORM
2
6
9
13
UUT
test requirement
Test Requirement vs. Test
ITAA, WFG
B, WFG
SqW
5 µsec
E, DMM
2 µsec
RMS
F, DMM
Avg
3 µsec
SnW
0 µsec
TEST PLATFORM
2
6
9
13
UUT
test requirement
Test Requirement vs. Test
TEST PLATFORM UUT
ITAA, WFG
B, WFG
SqW
5 µsec
E, DMM
2 µsec
RMS
F, DMM
Avg
3 µsec
SnW
0 µsec 2
6
9
13
UUT
test result
Test Requirement vs. Test
During the test… the state of the test platform is the test requirement
Immediately after the test… the state of the test platform is the test result
Test Requirement vs. Test
A test requirement and its result are states of the same object, viz., the test platform.
Test Requirement vs. Test
A test requirement and its result are states of the same object, viz., the test platform.
A test requirement and its result are structurally identical trees whose nodes may have slightly different states.
Test Requirement vs. Test
ITA
TEST PLATFORM
A, WFG
B, WFG
E, DMM
F, DMM SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec
UUT
2
6
9
13
UUT
test platform state
Test Requirement vs. Test
B, WFG
E, DMM
F, DMM
TEST PLATFORMTEST PLATFORM
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec
UUT
2
6
9
13
UUT
ITA
test platform state
Test Requirement vs. Test
TEST PLATFORM
E, DMM
F, DMM
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec
UUT
2
6
9
13
ITA
test platform state
Test Requirement vs. Test
TEST PLATFORM
E, DMM
UUT
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
ITA
test platform state
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec
TEST PLATFORM
UUT
2
6
9
13
ITA
test platform state
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec
TEST PLATFORM
2
6
9
13
UUT
ITA
test platform state
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
UUT
ITA
test platform state
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
UUT
ITA
test platform state
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
UUT
test platform state
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13UUT
test platform state
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
test platform state
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
test platform state
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
Test-platform Independent
test platform state
Test Requirement vs. Test
SqW
5 µsecpin 6
Avg
3 µsecpin 9
SnW
0 µsecpin 2
2 µsec
RMSpin 13
test platform state test requirementtest result{
Test-platform Independent
Test Requirement vs. Test
So what?
Resource Adapter Interface (RAI)
RAI Visualization
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
RAI
Test Result
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
RAI
Test Result
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
`
Resource Manager
RAI
Test Result Object
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
`
Resource Manager
RAI
Test Result Object
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
RAI
Test Result Object
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
RAI
Test Result Object
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
RAI
Test Requirement Object
Test Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
RAI
Test Requirement Object
Test Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
RAI
Test Result Object
Test Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Test requirements can be mapped to test results• dynamically using a test platform or
• statically using pre-collected data.
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
RAI
Test Requirement Object
Test Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
RAI
Test Requirement Object
Test Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
RAI
Test Result Object
Test Program(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Test requirements can be mapped to test results• dynamically using a test platform or
• statically using pre-collected data.
Test requirements can be mapped to test results• dynamically using a test platform or
• statically using pre-collected data.
RAI test programs are independent of• the type of test platform mapping test
requirements to test results.
Test requirements can be mapped to test results• dynamically using a test platform or
• statically using pre-collected data.
RAI test programs are independent of• the type of test platform mapping test
requirements to test results.
RAI test programs are independent of• whether test platforms are mapping test
requirements to test results.
Test-platform State, Test Requirement, Test Result
struct TTiming{
Double m_Begin;Double m_End;
};
struct TCapability{
//signal with range, resolution, and accuracyT1641Signal m_T1641Signal;TTiming m_TTiming;string m_PinID;
};
struct TTestPlatformState: TCapability{
TTestPlatformState* m_pTTestPlatformState[ ];};
typedef TTestPlatformState TTestRequirement;typedef TTestPlatformState TTestResult;
SqW
5 µsecpin 6
Avg
3 µsecpin 9
SnW
0 µsecpin 2
2 µsec
RMSpin 13
Capability A
Capability B Capability C
Capability D
Test Requirement #1
SqW
5 µsecpin 6
Avg
3 µsecpin 9
SnW
0 µsecpin 2
2 µsec
RMSpin 13
SnW
7 µsecpin 12
Avg
10 µsecpin 7
SnW
0 µsecpin 6
Test Requirement #2 Test Requirement #3
RMS
1 µsecpin 4
SqW
0 µsecpin 2
Platform-independent Testing
#include "RAI.h"#include "TestRequirements.h"
void main(){
TTestPlatformState TestResult1, TestResult2, TestResult3;//Map test requirement #1 to test result #1TestResult1 = TestRequirement1;
if (TestResult1.Signal("UUTPin13") > 12.3)cout << "UUT passed" << endl;
else{
//Map test requirement #2 to test result #2TestResult2 = TestRequirement2;//Map test requirement #3 to test result #3TestResult3 = TestRequirement3;
if (TestResult2.Signal("UUTPin4") < TestResult3.Signal("UUTPin7"))cout << "Replace UUT's patudy" << endl;
elsecout << "Failure unknown" << endl;
}}
Platform-independent Testing
Test Requirement #1
SqW
5 µsecpin 6
Avg
3 µsecpin 9
SnW
0 µsecpin 2
2 µsec
RMSpin 13
Test Requirement #4
RMS
1 µsecpin 4
SqW
0 µsecpin 2
SnW
7 µsecpin 12
Avg
10 µsecpin 7
SnW
0 µsecpin 6
Test #2 and test #3 can be parallel
Test Requirement #1
SqW
5 µsecpin 6
Avg
3 µsecpin 9
SnW
0 µsecpin 2
2 µsec
RMSpin 13
SnW
7 µsecpin 12
Avg
10 µsecpin 7
SnW
0 µsecpin 6
Test Requirement #2 Test Requirement #3
RMS
1 µsecpin 4
SqW
0 µsecpin 2
Tests #1, #2, and #3 are necessarily sequential
Platform-independent Parallel Testing
#include "RAI.h"#include "TestRequirements.h"
void main(){
TTestPlatformState TestResult1, TestResult4;//Map test requirement #1 to test result #1TestResult1 = TestRequirement1;
if (TestResult1.Signal("UUTPin13") > 12.3)cout << "UUT passed" << endl;
else{
//Map test requirement #4 to test result #4TestResult4 = TestRequirement4;
if (TestResult4.Signal("UUTPin4") < TestResult4.Signal("UUTPin7"))cout << "Replace UUT's patudy" << endl;
elsecout << "Failure unknown" << endl;
}}
Platform-independent Parallel Testing
RAI Visualization
Test Result Object
RAI
Test Requirement Object
mapstest requirements
totest results
diagnoses,sequences, andcontrols
Test Program(test-platform independent)
The SSAI RAI Standard
ATML Capability and ATML Instrument
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Test requirements… trees of capabilities that must be satisfied
Instruments… lists of capabilities that can be satisfied
Test Requirement Instrument
Capabilitity A
Capabilitity B Capabilitity C
Capabilitity D
SqW
5 µsecpin 6
Avg
3 µsecpin 9
SnW
0 µsecpin 2
2 µsec
RMSpin 13
Capabilitity #1
Capabilitity #6
Capabilitity #2
Capabilitity #3 Capabilitity #4
Capabilitity #5
ATML Capability and ATML Instrument
struct TTiming{
Double m_Begin;Double m_End;
};
struct TCapability{
T1641Signal m_T1641Signal;TTiming m_TTiming;string m_PinID;
};
Test Requirement Instrument TCapability T16141Signal m_T1641Signal a 1641 signal a 1641 signal TTiming m_TTiming
m_Begin required delay in beginning signal
maximum possible delay in beginning signal
m_End required maximum life of signal
maximum possible life of signal
string m_PinID ID of UUT pin ID of instrument pin
ATML Capability and ATML Instrument
Legacy Testing Software
The test requirement is the key that unlocked the solution to the problem of porting legacy testing software across test platforms.
Legacy tests cannot be ported.Legacy test requirements can be ported.
The SSAI RAI Standard
• is extremely simple,• is founded in system theory, viz., the Theory of Real Systems,• is based on the (rigorously defined) test requirement,• addresses no testing events, services, or executables,• addresses only data objects, which are directly definable in XML,• completely supports complete test-platform independence,• completely supports parallelism,• allows test programs in most any programming language, and• resolves the problem of porting legacy testing software.
For the ATML to fully support the RAI element of the Framework IPT and thus fully support
• complete platform independence and• parallel testing,
the ATML must define an XML schema that supports the
• the test requirement object.
ATML support for the Framework IPT