collaboration with ltsi testing · 2020. 3. 21. · ltsi workshop / embedded linux conference 2014...
TRANSCRIPT
Copyright 2014, Toshiba Corporation.
Collaboration with LTSI Testing
Yoshitake Kobayashi
Corporate Software Engineering CenterToshiba Corporation
2LTSI Workshop / Embedded Linux Conference 2014
3LTSI Workshop / Embedded Linux Conference 2014
4LTSI Workshop / Embedded Linux Conference 2014
5LTSI Workshop / Embedded Linux Conference 2014
6LTSI Workshop / Embedded Linux Conference 2014
Patches available
on upstream
Patches available
on Xilinx’s repository
LTSI-3.10
backport
backport
7LTSI Workshop / Embedded Linux Conference 2014
8LTSI Workshop / Embedded Linux Conference 2014
9LTSI Workshop / Embedded Linux Conference 2014
10LTSI Workshop / Embedded Linux Conference 2014
Target filesWriter processes (N procs)
Target Host
write() system call
Log Host
Logger
Each writer process
• writes to text files (ex. 100 files)
• sends progress log to logger
This test case available at the following URL:
https://github.com/ystk/fs-test
Reset at
random timing
11LTSI Workshop / Embedded Linux Conference 2014
Checker
Target
file
LOG
file
AAAAABBBBBCCCCCDDDDDEEEEE
OK
FFFFF
AAAAABBBBBCCCCCDDDDDEEEEE
OKAAAAABBBBBCCCCCDDDDDAAAAA
NGAAAAABBBBBCCCCCDDDDD
NG
?
size mismatchdata mismatch
Verify the following metrics
• file size
• file contents Estimated file
contents
Estimated file size
12LTSI Workshop / Embedded Linux Conference 2014
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
* * * JFS XFS
Err
or
rate
[%]
45.9%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-ORDERED
EXT3-JOURNAL
EXT4-JOURNAL
EXT4-ORDERED
EXT4-WRITEBACK
* XFS BTRFS
82.4%84.7%43.4% 41.4%
43.2%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
EXT4-
JOURNAL
EXT4-
ORDERED
* JFS XFS
13.3%
kernel
2.6.18
kernel
2.6.31
kernel
2.6.33
File size mismatchData mismatch
13LTSI Workshop / Embedded Linux Conference 2014
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
* * * JFS XFS
Err
or
rate
[%]
45.9%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-ORDERED
EXT3-JOURNAL
EXT4-JOURNAL
EXT4-ORDERED
EXT4-WRITEBACK
* XFS BTRFS
82.4%84.7%43.4% 41.4%
43.2%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
EXT4-
JOURNAL
EXT4-
ORDERED
* JFS XFS
13.3%
kernel
2.6.18
kernel
2.6.31
kernel
2.6.33
File size mismatchData mismatch
Point 1:A file system has
different characteristicsof data reliability
14LTSI Workshop / Embedded Linux Conference 2014
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
* * * JFS XFS
Err
or
rate
[%]
45.9%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-ORDERED
EXT3-JOURNAL
EXT4-JOURNAL
EXT4-ORDERED
EXT4-WRITEBACK
* XFS BTRFS
82.4%84.7%43.4% 41.4%
43.2%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
EXT4-
JOURNAL
EXT4-
ORDERED
* JFS XFS
13.3%
kernel
2.6.18
kernel
2.6.31
kernel
2.6.33
File size mismatchData mismatch
Point 1:A file system has
different characteristicsof data reliability
Point 2:Some Results depends
on kernel version
15LTSI Workshop / Embedded Linux Conference 2014
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
* * * JFS XFS
Err
or
rate
[%]
45.9%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-ORDERED
EXT3-JOURNAL
EXT4-JOURNAL
EXT4-ORDERED
EXT4-WRITEBACK
* XFS BTRFS
82.4%84.7%43.4% 41.4%
43.2%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
EXT4-
JOURNAL
EXT4-
ORDERED
* JFS XFS
13.3%
kernel
2.6.18
kernel
2.6.31
kernel
2.6.33
File size mismatchData mismatch
Point 1:A file system has
different characteristicsof data reliability
Point 2:Some Results depends
on kernel version
Point 3:EXT4-Journal and BTRFS
has a nice result
16LTSI Workshop / Embedded Linux Conference 2014
START GOAL
Accelerate
Things that cannot be accelerated
• CPU clock
• I/O access speed (ex. SSD)
• Network bandwidth
• etc.Try to detect errors that caused
by clock
Focus to accelerate clock
Issues
• Long-term testing takes really long time→ We want results as fast as possible
17LTSI Workshop / Embedded Linux Conference 2014
Xdaliclock works as a stopwatch
Returned an incorrect value
after about 450 days.
(It takes about 6 hours in 1000
times acceleration)
18LTSI Workshop / Embedded Linux Conference 2014
19LTSI Workshop / Embedded Linux Conference 2014
20LTSI Workshop / Embedded Linux Conference 2014
21LTSI Workshop / Embedded Linux Conference 2014
22LTSI Workshop / Embedded Linux Conference 2014