online spectral imaging applied to food process control · 2010-10-07 · – nir, vis, spectral...
Post on 17-Jun-2020
2 Views
Preview:
TRANSCRIPT
Online spectral imaging applied to food process control
Jens Petter WoldNorwegian Food Research Institute
IFPAC Cortona 2010
08.10.2008 Online Measurements of Quality - Siena 2
Background: Nofima• Peak competence in applied
biospectroscopy for food analysis
• On-line– NIR, VIS, spectral imaging
• At-line– Fluorescence, VIS, NIR,
Raman, FT-IR, spectral imaging
• Microscopy of tissues and cells– Raman, FT-IR
• Chemometrics, multivariate calibration
• Food quality, food safety, process optimization
700 800 900 1000 1100 1200 1300 1400 15001000
2000
3000
4000
5000
6000
7000
08.10.2008 Online Measurements of Quality - Siena 3
Food industry today: Under pressure!
• Consumers demand low prices and high quality• Increasing focus on nutrition and health• Increasing demands for product documentation and traceability • Food production is more and more industrialised
• Strong need for advanced quality measurements for process and product control
• The ideal measurements is– rapid and preferably on-line • non-destructive– accurate • robust– etc.
08.10.2008 Online Measurements of Quality - Siena 4
Rapid spectroscopic techniques:An effective tool within food process control
• Enables efficient monitoring and control of complex products andprocesses
• multispectral images (chemical imaging) improves sampling and precision
• Genotype ↔ Phenotype measured by e.g. Raman, NIR, FT-IR• By-products based on novel bioprocesses
Food
waste
Bio-Process
Valueadded bio-product
Measurem
ents
08.10.2008 Online Measurements of Quality - Siena 5
Challenges with non-destructive measurements
• Foods/ are very complex from a measurement point of view!• Large variations in chemical composition, texture, shape and size• Main challenge: Representative sampling!• Often need to characterise every single product in the production
• Different products needs different solutions: Tailor made systems
08.10.2008 Online Measurements of Quality - Siena 6
Examples of analytical challengesBacalao
Salmon
Beef Crabs
08.10.2008 Online Measurements of Quality - Siena 7
NIR Reflection: Measures the surface
Detector
08.10.2008 Online Measurements of Quality - Siena 8
Interactance: Forces light into product
Spec.
08.10.2008 Online Measurements of Quality - Siena 9
Instrumental solution (patented):Scanning interactance measurement
Conveyor
12 x 50 W, 12°, halogen lamps
Cylinder optic
Adjustable slit
Illuminated field Scanned field
Imaging spectrometer
Focusing Al mirror
BlackenedAl plates
08.10.2008 Online Measurements of Quality - Siena 10
NIR/VIS interactance imaging scanner
• Developed by Nofima, Sintef and QVision AS• Produces a 2D multispectral image of the conveyor belt• 15 wavelengths in VIS/ 15 in NIR• Handles a conveyor belt speed of 3 m/s• Does about 10.000 measurements/sec
08.10.2008 Online Measurements of Quality - Siena 11
NIR image of salmon fillet: An image for each wavelength / a spectrum in each pixel
• Water• Fat• Protein• Temperature
08.10.2008 Online Measurements of Quality - Siena 12
Commercial implementation
08.10.2008 Online Measurements of Quality - Siena 13
Quantitative chemical imaging• Every application requires careful consideration of
– Sampling– Calibration regime (how to match spectroscopy and
reference values)– Image segmentation, image processing– Spectral pre-processing at pixel level
• to avoid effects of variation in sample height, temperature, colour, etc.
– Multivariate modelling (regression, curve resolution)– How to apply model on new data
08.10.2008 Online Measurements of Quality - Siena 14
Application: Water content in clipfish
Challenges:• Water is unevenly distributed• Dry on the outside, wet inside• Covered with salt• Varying size and shape
Alternatives:• Manual grading is expensive
and inaccurate• Lab measurements of water
are tedious and destructive
08.10.2008 Online Measurements of Quality - Siena 15
Chemical imaging: Water content in each pixel
15
20
25
30
35
40
45
50
55
% w
ater
37.0 41.7 44.7Average water content (%)
08.10.2008 Online Measurements of Quality - Siena 16
On-line predicted water content in whole clipfish
R=0.97
Pred. error =±0.65 %
Meas
50
46
44
42
40
38
36
Pre
dict
ed w
ater
con t
ent [
%]
36 38 40 42 44 46 50 % water
08.10.2008 Online Measurements of Quality - Siena 17
A shift in paradigm:
From random sampling10 out of 2000
Full profiling ofeach product
08.10.2008 Online Measurements of Quality - Siena 18
Industrial installation• Sorting according to water content• Producer gets correct price• Avoids reclamations• Enables optimization of drying process
08.10.2008 Online Measurements of Quality - Siena 19
Chemical images of salmon fillets: Fat content in each pixel
Fisk: 20 FettFisk: 19.8969% Share: 23.6285
10 20 30 40 50 60
50
100
150
200
250
3000
5
10
15
20
25
30
35
40
45
50Fisk: 16 FettFisk: 17.2034% Share: 20.2078
10 20 30 40 50 60
50
100
150
200
250
0
5
10
15
20
25
30
35
40
45
50
17.2 % 19.9 %
• Calculates average fat content• Fat distribution guides
– Automatic trimming/cutting– Selection of phenotypes for breeding (genetic selection)
17.2% 21.4%
08.10.2008 Online Measurements of Quality - Siena 20
Measuring fat and pigment in whole/live fish
• To be used within breeding and genetics
• Continuous evaluation of feeding regimes
• Measurements in production:– sorting to different
retail– different markets– product labelling
08.10.2008 Online Measurements of Quality - Siena 21
Effective breeding and selection• Measurement of fat and pigment in
4500 live salmon• Heritability factor for fat/pigment can
be calculated• Selection of the best families for
production• Saves one generation of fish + a lot of
costly wet chemistry
0,0
5,0
10,0
15,0
20,0
25,0
30,0
1 500 999 1498 1997 2496 2995 3494 3993 4492
Estimated fat%Estimated fat%Fa
t %
Salmon no.
08.10.2008 Online Measurements of Quality - Siena 22
• 40 tons per day• Manual grading is difficult• Capacity need: 2 crabs per sec.• Need to optimize production
line
Industrial system to separate between full or empty crabs
08.10.2008 Online Measurements of Quality - Siena 23
Four qualities:
1. Superior quality– Much liver and roe– Boiled whole, sent to France/Italy
2. Acceptable quality – Well filled– Boiled whole, distributed in Norway
3. Little food– Shell opened, liver is taken out and boiled separately– Used for different crab products
4. Empty crab– Claws are used, rest of crab is waste
• 3-4 processing lines• Problem: Very difficult to grade!
08.10.2008 Online Measurements of Quality - Siena 2407.10.2010 24
Interactance: Forces light into the crab
Spec.
08.10.2008 Online Measurements of Quality - Siena 2507.10.2010 25
How and what do we measure?
• Crabs are scanned on-line on a conveyor with the shell up and exposed to the scanner
• The crab is measured from above• Mainly the upper 15 mm is probed • Multispectral NIR images are captured• 15 NIR channels in each image
A B
08.10.2008 Online Measurements of Quality - Siena 2607.10.2010 26
Determination of food content in crabs: The meat quality index
07.10.2010 26
Meat Q Index, MQI:
(L+R)*100MQI =
(W/10)^2
• L = liver content• R = Roe content• W = Width of the
crab shell
08.10.2008 Online Measurements of Quality - Siena 27
08.10.2008 Online Measurements of Quality - Siena 28
1. Segmentation:
1 0 2 0 3 0
1 0
2 0
3 0
4 0
1 0 2 0 3 0
1 0
2 0
3 0
4 0
10 20 30
10
20
30
40
10 20 30
10
20
30
40
50
Raw image Segmented image Region for spectral extraction
1 0 2 0 3 0
1 0
2 0
3 0
4 0
1 0 2 0 3 0
1 0
2 0
3 0
4 0
10 20 30
10
20
30
40
10 20 30
10
20
30
40
50
1 0 2 0 3 0
1 0
2 0
3 0
4 0
1 0 2 0 3 0
1 0
2 0
3 0
4 0
10 20 30
10
20
30
40
10 20 30
10
20
30
40
50
08.10.2008 Online Measurements of Quality - Siena 29
2. Extraction of NIR spectra:
Little food(much water)Much food
08.10.2008 Online Measurements of Quality - Siena 30
3. Calibration model for food index
08.10.2008 Online Measurements of Quality - Siena 3107.10.2010 31
Possible challenges
• Seasonal variations– Food mass vary in
composition (roe+liver)
• Can obtain a good estimate of the amount of both liver and roe separately
JuneSeptember
0
10
20
30
40
50
60
70
11 15 18 21 22 25 13 19 24 31 34 41
June September
MQI
% R
oe o
fmea
twei
ght
% roe in meat mass
08.10.2008 Online Measurements of Quality - Siena 3207.10.2010 32
NIR scanner at HitraMat, Norway
08.10.2008 Online Measurements of Quality - Siena 3307.10.2010 33
Practical results• The crabs are sorted on-line into 3 - 4 quality classes, 1-2 crabs /sec.• Quicker and much more reliable than manual grading• Yield in process has increased, less waste• Can guarantee high quality of superior crabs, which is extremely
important to keep the crab market alive• Systemized data gives overview of seasonal and regional variations • Will be used to adjust payments to the fisherman
08.10.2008 Online Measurements of Quality - Siena 3407.10.2010 34
Next step: System for the fishermen
07.10.2010 34
It is possible to do similar measurements with simpler system more suited for e.g. boatsEvery crab can then be measured, and only the medium and full crabs can be collected.Empty crabs can be returned to the sea:
High quality capturesSustainable harvestingSatisfied customers
08.10.2008 Online Measurements of Quality - Siena 35
Beef processing• 60% of the carcass ends up as beef trimmings
– for meat products• Batches of beef trimmings are priced according
to fat content– Low fat gives higher price– Batch sizes vary from 20 – 400 kg– Very important for the company
to optimize in order to make profit• No good way to measure fat content in intact trimmings
– The cutters try to reach target fat content, but difficult• Fat can be measured in ground meat, but most customers prefer intact
trimmings• Reliable measurements on trimmings would be very valuable for
– Getting the correct price– Optimised use of raw-materials– Optimised logistics
08.10.2008 Online Measurements of Quality - Siena 36
NIR-spectra from beef
63 % fat
3% fat30% fat
08.10.2008 Online Measurements of Quality - Siena 37
• Trimmings are heterogeneous!• Vary in type of meat/muscle, colour, structure, size,
shape
08.10.2008 Online Measurements of Quality - Siena 38
Calibration
• Need to record NIR spectra from meat samples that span fat content from 2 – 90%
• Under different conditions• “Big pixel” strategy: need to
calibrate for every situation a pixel can encounter
08.10.2008 Online Measurements of Quality - Siena 39
Calibration strategy
– The model can be used on average spectra from meat trimmings
– And pixel wise in the multispectral images (to show fat distribution in single trimmings)
10 20 30 40 50
50
100
150
200
10 20 30 40 50
50
100
150
200
Wavelength (nm)
spectra
=fa
t val
ues
Spectral image
Prediction model
08.10.2008 Online Measurements of Quality - Siena 40
Applying model on single trimmings
• Large prediction errors, especially on fat samples• As expected…
NMR measured fat (%)
NIR
estimated
fat (%)
10 20 30 40 50
10
20
30
40
50
60
70
800
5
10
15
20
25
30
08.10.2008 Online Measurements of Quality - Siena 41
Prediction error vs. batch size• Prediction error decreases rapidly with increasing batch size• Depends on fat content of trimmings / heterogeneity
Lean trimmings (<30%)
Fat trimmings (> 8%)
All trimmings0 20 40 60 80 100
0.5
1
1.5
2
2.5
3
3.5
Batch size (kg)
RM
SE
P (%
)P
redi
ctio
ner
ror%
08.10.2008 Online Measurements of Quality - Siena 42
On-line estimation of fat in batch
• Gives good opportunity to control batch against desired fat content
05
101520253035404550
1 11 20 30 38 48 56 66 75 84 93 105
115
125
135
145
153
162
170
Accumulated weight (kg)
Fat (
%)
Fat
Accumulated average fat
08.10.2008 Online Measurements of Quality - Siena 43
9.6 % 16.8% 27.9 %
Flow weight
Laser height measure
08.10.2008 Online Measurements of Quality - Siena 4444
Installation in Norwegian beef cutting line
• Average fat content in batches of intact trimmings is continuously monitored and controlled
• Cutters can adjust the amount of fat going into the batch
• Much better control of end product quality
• Better utilization of raw materials
• More motivating for the workers
08.10.2008 Online Measurements of Quality - Siena 45
Automatic detection of connective tissue
• Can detect surface connective tissue (CT)
• Can be used to produce batches of different qualities
Sample: CT3BSample: CT3B
Fat prediction: 3.5 % mean fat
5 10 15 20
20
40
60
80
100
120
140
160
180
200
0
5
10
15
20
25
30
35
40
45
50
Sample: CT3BConnective tissue
5 10 15 20
20
40
60
80
100
120
140
160
180
200
Sample: CT2BSample: CT2B
Fat prediction: 25.2 % mean fat
10 20 30 40
50
100
150
200
250
300
350 0
5
10
15
20
25
30
35
40
45
50
Sample: CT2BConnective tissue
5 10 15 20 25 30 35 40
50
100
150
200
250
300
350
Fat image CT image
08.10.2008 Online Measurements of Quality - Siena 46
Summary meat1. From manual, subjective sorting: imprecise fat levels, difficult to control2. To measurement on intact beef trimmings, which enables simple control of the
cutting line (implemented today)3. To automatic sorting of intact trimmings into batches of pre-defined fat content.
14%
21%+ CT
18%
26%
Automatic fat and CT determination
scanner
18.3% scan
ner
Automatic sorting into batches of specified quality
Today Next year
5%
5%
14 % & 21 % requires grinding and standardization
14 % / 21%
26%
Fat
Cutters
Yesterday
08.10.2008 Online Measurements of Quality - Siena 47
Summary• Imaging will replace spot sampling for most heterogeneous discrete
samples• Distributional information through NIR imaging is and will be beneficial in
process optimisation
• The success of an application relies on adequate setup for spectral sampling and reference sampling (which needs careful consideration!)
• New technology is sophisticated, while competence in the food industry is limited (challenge!)
• New technology requires changes in traditional processes and craftsmanship (challenge)
• New technology is adapted only when it increases profit notably– Only when “need to have”, never when only “nice to have”
08.10.2008 Online Measurements of Quality - Siena 48
Acknowledgements• Nofima
– Martin Høy– Vegard Segtnan
• Sintef ICT– Jon Tschudi– Marion O’Farrel
• QVision– Martin Kermit– Geir Hauge
top related