spice conference 2018: a ‘calibration’ process model...calibration process model © 3s knowledge...
TRANSCRIPT
© 3S Knowledge & Jaguar Land Rover
Paul Darnell, Chief Engineer, 3S Knowledge Limited
Joe Walsh, Technical Specialist, Jaguar Land Rover
SPICE Conference 2018: A ‘Calibration’ Process Model
Calibration process model
© 3S Knowledge & Jaguar Land Rover Calibration process model
Introduction
System / Software Process Models Engineering Lifecycle
1990
1995
2000
2005
2010
2015
2020
System Req.
System Design
Software Creation
Software Req.
Software Unit Test
Software Int. & Test
System Integration
Calibration
System Test & Sign-off
122071995
122072017
152882002
152882015
CMMI2002
CMMI2018
155041998
SPICE
330012015
ASPICE2005
V3.12017
262622011
262622018
© 3S Knowledge & Jaguar Land Rover
What is Calibration?
Calibration process model
Torq
ue
Accelerator Pedal
Torq
ue
SPORT MODE
SAND MODE
© 3S Knowledge & Jaguar Land Rover
Emissions targets Advanced driver assist systems
Engine technology Electrification Performance expectation
Calibration Complexity
Calibration Process Model
60 000 Parameters in one ECU
One vehicle may have > 24 variants of the
Parameters
© 3S Knowledge & Jaguar Land Rover
Calibration Requirements
Work PackagePlanning
Work Package
Calibration
Work Package
Calibration
Work Package
Calibration
Work Package
Verification
Work Package
Verification
Work Package
Verification
Work Package
Integration
CalibrationQualification
Typical Calibration ProcessInformal Approach
Calibration Process Model
© 3S Knowledge & Jaguar Land Rover
Genuine usage:Avoid engine stall at extreme steering angle with hydraulic power steering
Alleged Defeat Device usage:Identify when steering away from centre indicating that vehicle not on chassis dynamometer
Calibration Defects“Diesel Gate”
Calibration Process Model
Genuine usage:Adjustments to account for air density at altitude
Alleged Defeat Device usage:Identification of changes in altitude indicating that vehicle not on chassis dynamometer
the
© 3S Knowledge & Jaguar Land Rover
Calibration DefectsUber
Calibration Process Model
© 3S Knowledge & Jaguar Land Rover Calibration Process Model
Common Organisational Structure
Calibration Team
Software Team
Tier 1 SupplierVehicle
Manufacturer
System Team
Strong Process Models
Weak Process Models
Requirements
SoftwareCustomer
Product Release
Work Product
Organisation
The final step in the flow has the weakest process!
© 3S Knowledge & Jaguar Land Rover
Calibration Process Reference Model Proposed Model
Calibration Engineering Process Group (CAL)
CAL.1Calibration Requirements
Analysis
CAL.2Architectural Design for
Calibration
CAL.3Work Package Design and
Calibration
CAL.4Work Package Verification
CAL.5Work Package Integration
and Integration Test
CAL.6Calibration Qualification
Test
• Transform the calibration related parts of the system requirements into a set of calibration requirements.
Calibration Process Model
© 3S Knowledge & Jaguar Land Rover
Calibration Process Reference Model Proposed Model
Calibration Engineering Process Group (CAL)
CAL.1Calibration Requirements
Analysis
CAL.2Architectural Design for
Calibration
CAL.3Work Package Design and
Calibration
CAL.4Work Package Verification
CAL.5Work Package Integration
and Integration Test
CAL.6Calibration Qualification
Test
• Establish a Calibration Work Package architecture
• Identify which calibration requirements are to be allocated to which elements of the architecture
Calibration Process Model
© 3S Knowledge & Jaguar Land Rover
Calibration Process Reference Model Proposed Model
Calibration Engineering Process Group (CAL)
CAL.1Calibration Requirements
Analysis
CAL.2Architectural Design for
Calibration
CAL.3Work Package Design and
Calibration
CAL.4Work Package Verification
CAL.5Work Package Integration
and Integration Test
CAL.6Calibration Qualification
Test
• Define the application parameter content of a Work Package
• Establish and apply suitable calibration methodologies to derive the values of the application parameters.
Calibration Process Model
© 3S Knowledge & Jaguar Land Rover
Calibration Process Reference Model Proposed Model
Calibration Engineering Process Group (CAL)
CAL.1Calibration Requirements
Analysis
CAL.2Architectural Design for
Calibration
CAL.3Work Package Design and
Calibration
CAL.4Work Package Verification
CAL.5Work Package Integration
and Integration Test
CAL.6Calibration Qualification
Test
• Verify calibration Work Packages
• Provide evidence for compliance with the calibration Work Package requirements
Calibration Process Model
© 3S Knowledge & Jaguar Land Rover
Calibration Process Reference Model Proposed Model
Calibration Engineering Process Group (CAL)
CAL.1Calibration Requirements
Analysis
CAL.2Architectural Design for
Calibration
CAL.3Work Package Design and
Calibration
CAL.4Work Package Verification
CAL.5Work Package Integration
and Integration Test
CAL.6Calibration Qualification
Test
• Integrate the Work Package units to create a complete integrated calibration consistent with the calibration architectural design
• Ensure the calibration work packages are tested for compliance with the calibration architecture.
Calibration Process Model
© 3S Knowledge & Jaguar Land Rover
Calibration Process Reference Model Proposed Model
Calibration Engineering Process Group (CAL)
CAL.1Calibration Requirements
Analysis
CAL.2Architectural Design for
Calibration
CAL.3Work Package Design and
Calibration
CAL.4Work Package Verification
CAL.5Work Package Integration
and Integration Test
CAL.6Calibration Qualification
Test
• Ensure that the integrated calibration is tested to provide evidence for compliance with the calibration requirements in the context of the whole system.
Calibration Process Model
© 3S Knowledge & Jaguar Land Rover
Calibration Process Reference Model Proposed Model
Calibration Engineering Process Group (CAL)
CAL.1Calibration Requirements
Analysis
CAL.2Architectural Design for
Calibration
CAL.3Work Package Design and
Calibration
CAL.4Work Package Verification
CAL.5Work Package Integration
and Integration Test
CAL.6Calibration Qualification
Test
© 3S Knowledge & Jaguar Land Rover
Process Reference Model and Process Performance Indicators are defined. Example:
Calibration Process Reference Model Reference Model & Process Indicators
Calibration Process Model
© 3S Knowledge & Jaguar Land Rover Calibration Process Model
Automotive SPICEPlug-In Concept
Do
mai
n L
eve
lSy
stem
Lev
el
CAL.1
CAL.2
CAL.4CAL.3
CAL.5
CAL.6
© 3S Knowledge & Jaguar Land Rover Calibration Process Model
Automotive SPICEPlug-In Concept
Do
mai
n L
eve
lSy
stem
Lev
el
CAL.1
CAL.2
CAL.4CAL.3
CAL.5
CAL.6
Parameterisation in the context of the hardware
and/or mechanical environment
© 3S Knowledge & Jaguar Land Rover Calibration Process Model
Automotive SPICEPlug-In Concept
Do
mai
n L
eve
lSy
stem
Lev
el
CAL.1
CAL.2
CAL.4CAL.3
CAL.5
CAL.6
Parameterisation in the context of the system
© 3S Knowledge & Jaguar Land Rover Calibration Process Model
Automotive SPICEPlug-In Concept
Do
mai
n L
eve
lSy
stem
Lev
el
CAL.1
CAL.2
CAL.4CAL.3
CAL.5
CAL.6
© 3S Knowledge & Jaguar Land Rover Calibration Process Model
Summary & Next StepsReference Model & Process Indicators
• The landscape of ‘process models’ is well established for System and Software
• The ‘Calibration process’ is not defined as a formal process in any recognised standard
• A strong process could prevent issues / defects occurring
• A proposed formal ‘calibration process’ is defined
• The authors seek collaboration to review and contribute to development of the ‘calibration process’ – please contact either author
• The aspiration is to formalise this process
• Consideration of integration with, or reference to, Automotive SPICE would be seen as advantageous
© 3S Knowledge & Jaguar Land Rover Calibration Process Model
THANK YOU
Paul Darnell, Chief Engineer,
3S Knowledge
www.3sk.co.uk
Joe Walsh, Technical Specialist,
Jaguar Land Rover