Visual and Instrumental Assessments of Color Differences in Automotive Coatings
Visual and Instrumental Assessments of Color Differences in Automotive Coatings
Visual and Instrumental Assessments of Color Differences in Automotive Coatings
This is a previous version of the article published in Color Research & Application. 2016, 41(4): 384-391. doi:10.1002/col.21964
2
Center for Sensors, Instruments and Systems Development (Cd6), Technical University of Catalonia (UPC), Rambla De Sant Nebridi, 10, Terrassa
08222, Spain
Abstract: The interest in gonioapparent pigments (metal- correlation being worse. In particular, it was checked
lic, pearlescent, interference, or diffractive) has increased that observers accepted a larger number of color pairs,
in the last few years, especially for applications in the that is, the visual color difference was smaller than the
automotive industry. To assure a proper characterization tolerance demanded by the industry (derived from
of colors with gonioapparent pigments, commercial devi- AUDI2000). VC 2015 Wiley Periodicals, Inc. Col Res Appl, 00, 000–
ces have appeared to characterize the color in different 000, 2015; Published Online 00 Month 2015 in Wiley Online Library
geometries, which are called multiangle spectrophotome- (wileyonlinelibrary.com). DOI 10.1002/col.21964
ters. As the gonioapparent pigments and multiangle
instruments are relatively new, no studies exist regarding Key words: vision; color; color measurement; perception
the instrumental-based procedure followed in the indus- psychology; psychophysics; industrial inspection
try, and if the results provided are in agreement with the
observer perception.
Consequently, the main objective of this study was to INTRODUCTION
examine the correlation of the instrumental color differ-
ences with visual assessments. The instrumental color dif- The interest in gonioapparent pigments applied in many
ference was calculated with the color difference formula industries (cosmetics, inks, etc.) continues increasing day
AUDI2000 (specific for this sector) between the pairs of by day, especially in the automotive sector. This sector
similar samples of three types of coated panels (solid, has undergone many changes and updates in the last
metallic, and pearlescent). The values measured by a tel- years1,2 from employing only paints without visual effect
espectroradiometer in a directional lighting booth and to use many of them containing gonioapparent pigments
the colorimetric values obtained by means of a multian- providing new and attractive visual effects by combining
gle spectrophotometer BYK-mac were considered for this variable color and texture according to irradiation and
purpose. Additionally, a visual experiment was conducted viewing directions.
to quantify the color difference by using the gray-scale Goniochromatism is a change in any or all attributes of
method. color of a specimen on change in angular illuminating–
The results revealed that an acceptable instrumental cor- viewing conditions but without change in light source or
relation existed despite the visual and the instrumental observer.3 This happens when the material that is under
evaluation includes gonioapparent pigments. Therefore, it
is possible to classify the materials into three types
*Correspondence to: Omar Gomez(e-mail:[email protected])
Contract grant sponsors: EMRP, EMRP participating countries within EUR-
according to the pigment recipe and its colorimetric
AMET, the European Union. behavior4–6: solid, metallic, and pearlescent or interfer-
ence coatings (Fig. 1, right). The solid color includes F1
C 2015 Wiley Periodicals, Inc.
V only scattering pigments, and hence, the perceived color
C
O
L
O
R
Fig. 1. Left: Color appearance of the 60 assessed color pairs. Right: Colorimetric behavior according to the pigment
recipe.
does not show significant changes owing to the variation lighting booths.15–17 In other words, there are no studies
of the direction of lighting and/or detection. The metallic to check if the procedure followed in the industry, mainly
coating includes metallic pigments that provide a color based on the instrumental measures of a multiangle spec-
shift mainly in lightness. The pearlescent coating includes trophotometer, would match the decision that an observer
in its recipe pearlescent pigments (even solid pigments) would give.18 Therefore, the conventional approach using
that provide a color shift mainly owing to a hue and a a diffuse lighting booth and an integrating sphere spec-
chroma change. troradiometer is not valid for gonioapparent colors, and
Currently, in the automotive sector, color quality of auto- hence it is necessary to use a commercial directional
motive coatings with gonioapparent pigments is performed lighting booth such as the gonio-vision box from Merck
by characterizing the color under different measurement or the byko-spectra effect cabinet from BYK-Gardner.
geometries.5,7–10 For this, commercial devices, called mul- The purpose of this study is to study the correlation of
tiangle spectrophotometers, are able to characterize the the visual and instrumental assessment of the color differ-
color in different geometries, such as BYK-mac, or X-Rite ences between pairs of similar samples. The instrumental
MA98, which satisfy ASTM and DIN standards.11–14 measurements were made with two different measurement
Although multiangle spectrophotometers are commonly devices: BYK-mac multiangle spectrophotometer and PR-
used in the automotive industry, there are few studies 650 telespectroradiometer. In addition, a psychophysical
focused on the correlation between instrumental measure- experiment that included a directional lighting booth was
ments and visual assessments by using rightly directional designed to obtain the visual assessments to quantify the
color difference by the comparison with a standard gray ci 僆 {15 ,. . .,110 }. To obtain a weighting for the mea-
scale for color differences. surement angle of 110 , we use half the value of the flop
term from the angle, 75 . For the negative effect angle
215 , we specified to use the weighting for the 15 angle
MATERIALS AND METHODS multiplied by a factor 1.2..20
A total set of 60 pairs of different samples from solid, In this study, the instrumental evaluation is carried out
metallic, and pearlescent pigments were selected (Fig. 1, using two different strategies. On the one hand, the color
left). For this study, knowing previously the pigment for- difference was calculated by using the measurement data
mulation of this panels was not important though it could performed by the commercial multiangle spectrophotome-
be interested in other future studies, because we only ter BYK-mac. This is a device that measures the samples
focused in the optical and colorimetric behavior, not by contact in six different geometries. This methodology
structural (pigments type, size, shape, etc.). Figure 1(a) is called “direct measurement,” and it is the usual proce-
(left) shows the a*b* and L*C* chromatic diagrams with dure in the automotive sector.
the representation of the 20 solid color pairs. The differ- On the other hand, a system consisting of the telespec-
ent colors indicate the different measurement geometries, troradiometer PR-650, and the directional lighting booth,
and the different symbol, circle, and square, the two color the byko-effect spectra cabinet (from BYK-Gardner)21
samples of one color pairs. Figure 1(b) (left) shows the was used to obtain the real spectral color stimulus and
representation at both chromatic diagrams for the metallic the corresponding colorimetric values of all samples with-
color pairs. Finally, Fig. 1(c) (left) shows the pearlescent out contact, never used in the automotive sector, in spite
color pairs. In this figure, it can be seen that the color of having directional lighting booths in this sector. The
gamut associated with the selected color samples and the main advantage of this indirect system is that it collects
behavior of each kind of pigment, solid, metallic, and exactly what the observer would perceive, the PR-650 has
pearlescent. a telecentric lens, with a measuring area of 1 and the
The color differences between pairs of samples were distance to the spot area was about 55 cm. For this rea-
calculated by the color difference Formula (1) son, this methodology was called “(true) visual simu-
AUDI2000,19,20 based on the CIELAB color space. This lation.” In addition, a reference white placed at the same
color difference formula was developed by and is used by position as the samples was measured with the spectrora-
AUDI, without being endorsed by any standardization diometer to allow transformations to CIELAB color space
body till now, with the main purpose to manage the color by means of the absolute XYZ values (in cd/m2), ena-
tolerances varying depending on the specific application, bling us to apply absolute colorimetry into relative color-
paint batch acceptance, color matching for add-on parts imetry as it is usual in color appearance models.22 The
in the car body, refinish, and so forth. byko-effect cabinet was selected owing to the fact that it
AUDI2000 color difference formula was especially allowed measuring the same geometries of illumination/
designed for materials with gonioapparent pigments; then, observation that the BYK-mac. It is important to mention
it considers the changes that these materials show depend- that the luminaire of the byko-effect spectra cabinet is a
ing on the angle of illumination and observation (flop) as not a good D65 simulator if not it is closer to a D50 sim-
follows: ulator.23,24 We referred to both methodologies as direct
s ffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi measurement and visual simulation; however, it is impor-
2 2 2 tant to point out that both arise from different instru-
DLc DCc DHc
DEc ¼ 1 1 (1) ments. But, obviously, the method described above can
sDL;c gDL sDC;c gDC sDH;c gDH
be applied to other directional lighting booths, with or not
2=3 the same nominal geometries common with other multi-
jLci 2Lci11 j
sDLci ¼ 10:002C45 10:33 (2) angle spectrophotometers.
ci11 2ci
The measurement geometries used were fixed by the
¼ sDLci ;Flop 1sDLci ;Solid 10:33 (3) multiangle spectrophotometer and the lighting booth:
45as-15, 45as15, 45as25, 45as45, 45as75, and 45as110,
jCci 2Cci11 j written by following ASTM standards (Fig. 2). These F2
sDCci ¼ 1:478 10:014C45 10:27 (4)
ci11 2ci measurement geometries can be rewritten by following
the CIE nomenclature25 as: 45 x:260 , 45 x:230 ,
¼ sDCci ;Flop 1sDCci ;Solid 10:27 (5) 45 x:220 , 45 x:0 , 45 x:30 , and 45 x:65 , respectively.
The illumination angle was constant for all the measure-
jCci 2Cci11 j
sDHci ¼ 0:800 10:004C45 10:30 (6) ment geometries.
ci11 2ci For the visual evaluation, a psychophysical experiment
¼ sDHci ;Flop 1sDHci ;Solid 10:30 (7) was conducted by using a gray chart of the Society of
Dyers and Colourists26 for qualifying the color difference
Where “s” are the weighting functions and “g” are the perceived in the byko-spectra effect cabinet (Fig. 3, left). F3
parametric factors for each term, lightness, chroma, and The gray chart used consisted of nine neutral gray chips
hue, and c is referred to the measurement geometry, with pairs, which are ordered in increasing color difference.
C
O
L
O
R
Fig. 3. Left: Which gray pair is closer to the color difference seen in the color pair? Right: CIELAB color differences for
each one of the nine color pairs in the SDC gray scale. Fourth degree polynomial fit, R2 (215) 5 0.9849, R2 (15) 5 0.9938,
R2 (25) 5 0.9975, R2 (45) 5 0.9998, R2 (75) 5 1, and R2 (110) 5 1.
C
O
L
O
R
Fig. 4. Instrumental correlation obtained from the color differences of the instruments for the geometries 45as-15,
45as15, 45as25, 45as45, 45as75, and 45as110. Different colors are used to identify the sample type (blue, solid; red,
metallic; and green, pearlescent pigment).
Instrumental Correlation erated with both measuring instruments for each of the
measurement geometries. In these conditions, a pair of
Before analyzing the visual and instrumental correla-
panels would exhibit similar color differences by using
tion, an instrumental correlation between the two mea-
the BYK-mac multiangle spectrophotometer (DEBYK-mac)
surement methodologies (direct measurement and visual
and by using the PR-650 telespectroradiometer and the
simulation) was done. The AUDI2000 color difference
cabinet (DEPR650) although they were analyzed with the
(DEAUDI2000) was calculated by considering the measure-
BYK-mac and the telespectroradiometer PR-650 plus the
ments from the BYK-mac multiangle spectrophotometer,
lightning booth, respectively. In addition, the correlation
fixating the D65 illuminant, and the measurement from
would be linear in spite the fact that the method that
the PR-650 telespectroradiometer from the true spectral
involves the telespectroradimeter and the lightning booth
stimuli, that is, the combination of the true lamp into the
contains higher variability in the position/direction of the
booth and the spectral reflectance of the panel for this
instrument, orientation of panels, and the spectral quality
measurement geometry. Next, a correlation of these
of the daylight D65 simulation installed into the lighting
instrumental data (BYK-mac and PR-650) was performed
booth.
by using a graphical analysis in which the values of
Plots in Fig. 4 show the correlations in terms of the F4
DEAUDI2000 obtained in the different conditions were
color differences (DEPR-650 and DEBYC-mac) for the 60
compared.
color pairs classified by measurement geometry. There
Ideally, a linear correlation of slope close to 1 in
was a good correlation between both instruments and
DEAUDI2000 values was expected. These values were gen-
C
O
L
O
R
Fig. 6. Color differences for all the measurement geometries for (a) solid sample, (b) pearlescent sample, and (c) metallic
sample following the criterion Passes/Not Passed. The green region means almost indistinguishable color differences, the
red zone means rejected color pairs, and the yellow zone means critical color differences; samples need to be visually
assessed by expert colorists.
zone, where samples should be studied with other visual AUDI2000 color difference with the visual assessments
tests to establish if they pass or not; finally, the green done by observers was evaluated by the STRESS index.
area would contain samples with DE < 1.4, which could The results revealed that it would be possible to obtain a
be considered almost indistinguishable. better performance by improving the color difference for-
Once the most troubled samples were identified and mula as the observer variability was lower than the per-
analyzed, three pairs of characteristic samples were formance of the color difference. A detailed analysis was
selected as shown in Fig. 6. In this case, measurement done for each color pair. A number of color pairs were
data from the BYK-mac were used as it is the most com- identified to have instrumentally color differences far
mon instrument used in the automotive industry. away from visual color differences. It was determined
Figure 6(a) shows the color differences for all the mea- that the general tendency was that observers gave lower
surement geometries for a solid sample. As it can be color difference values than those provided by the devi-
noticed, there was a good correlation between visual and ces. This implies that observers accepted a larger number
instrumental assessments, which means that for both meth- of valid color pairs compared with those accepted by the
odologies the color difference of the color pair was indis- devices, despite being “experts” in color although not
tinguishable (green region). This situation should be the color automotive engineers. Therefore, it could be con-
real one, where the information provided by the instrumen- cluded that there was not a perfect correlation between
tal analysis and visual evaluation would be equivalent. instrumental and visual evaluation and that it would be
Figures 6(b) and 6(c) show an opposite situation. These interesting to analyze which parameters can influence,
examples correspond to pearlescent and metallic samples, and how, in this correlation failure related with commer-
respectively. In the pearlescent sample, the color pair was cial color devices typically used in the automotive sector.
accepted by the BYK-mac (for all the measurement geome- One approach would be to improve the AUDI2000 color
tries) but rejected by the average observer. On the contrary, difference formula or to propose a new one to obtain a
for the metallic sample the average observer accepted the better performance. Taking into account that the observer
color pair as a good color matching or approval, whereas variability was lower than the performance of the color
the color difference calculated from the BYK-mac meas- difference, it would be possible to improve the
urements was big enough to consider the color pair as not AUDI2000 color difference formula to find a better corre-
good or fail. Therefore, it would be interesting for car mak- lation with visual evaluations. Other strategies, even com-
ers and coating providers to know what type of automotive bining with the first approach, would be to use a better
colors or recipes (by hues, flops, etc.) are prone to be asso- D65 simulator, a more powerful lamp for a higher level
ciated with the cases shown in these figures. of illumination, better lighting uniformity, or even use a
It is important to mention that with the PR-650 data, the specified gray card with smaller steps to compare direc-
results were similar to those obtained using the BYK-mac as tional level colors. This experiment should also be done
in the majority of samples, pairs were accepted by observ- with professional colorists of the automotive industry and
ers, but rejected by the instrument, as for the BYK-mac. with normal observers (with no experience in colorime-
try), to see whether the level of experience affects DV.
Therefore, this justifies that it is necessary to apply both
methodologies, visual and instrumental evaluation, to
CONCLUSIONS
avoid this kind of discrepancies. Otherwise, working
The correlation between visual and instrumental evalua- hardly in the improvement of directional lighting booths,
tion was performed with a set of automotive samples. using better D65 simulators and high illuminance levels,
Two instrumental evaluations were conducted, a direct either based on current fluorescent lamps or based on new
measurement with the BYK-mac multiangle spectropho- solid-state lighting sources as LEDs, OLEDs, and so
tometer, and a visual simulation with the PR-650 tele- forth.
spectroradiometer and the byko-effect lighting cabinet, In conclusion, the new main contributions of this arti-
with the same measurement geometries setup than in the cle is the use of telespectroradiometry for testing the vis-
BYK-mac. The visual evaluation was conducted by a ual and instrumental correlation in automotive coatings at
conventional psychophysical experiment where observers the realistic way, showing that this instrumental technique
quantified the color difference in color pairs by using the for measuring the true spectral stimuli is necessary to
gray-scale method. The observer variability showed that understand and manage doubtful color pairs for the final
the observer responses were consistent enough. color matching/approval. It can be applied to new experi-
First, a comparison between both instrumental evalua- ments and studies crossing structural (formulation, pig-
tions was done. The results exhibited an acceptable corre- ment size, etc.) and colorimetric data.
spondence between both methodologies. Nevertheless, a
slight measurement mismatch that could be owing to the
illuminant–light source differences or different geometries ACKNOWLEDGMENTS
configurations was found. The authors thank the Ministry of Economy and Competi-
Second, the study of the visual and instrumental corre- tiveness for the coordinated project “New developments in
lation was carried out. The performance of the visual optics, vision and color technology” (DPI2011-
30090-C02). Francisco Javier Burgos also thanks the 17. Burgos FJ, Perales E, G omez O, Chorro E, Viqueira V, Martınez-
Autonomous Government of Catalonia for his predoctoral Verd u FM, Pujol J. Instrumental and visual correlation between a
multiangle spectrophotometer and a directional lighting booth, in
fellowship grant and Omar Gomez to the Ministry of Econ- Proceedings AIC Colour 2013, Vol. 4. Newcastle, UK; 2013. p 1373–
omy and Competitiveness for his predoctoral fellowship 1376.
(FPI BES-2012-053080). 18. Longley WV. Automotive color certification. Color Res Appl 1995;20:
50–54.
1. Brock T, Groteklaes M, Mischke P. European Coatings Handbook. 19. Melgosa M, Martınez-Garcıa J, G omez-Robledo L, Perales E,
Hannover: Vincentz Network; 2010. Martınez-Verd u FM, Dauser T. Measuring color differences in automo-
2. Streitberger HJ, D€ossel KF. Automotive Paints and Coatings, 2nd edi- tive samples with lightness flop: A test of the audi2000 color-difference
tion. Wienheim: Wiley-VCH; 2008. formula. Opt Express 2014;22:3458–3467.
3. ASTM E284-13b. Standard Terminology of Appearance. Consho- 20. Dauser T. Audi Color Tolerance Formulas (Private communication).
AQ3 hocken: American Society for Testing Materials. 2012.
4. Maile FJ, Pfaff G, Reynders P. Effect pigments—Past, present and 21. Experience the byko-spectra effect. Available at: https://www.youtube.
future. Prog Org Coat 2005;54:150–163. com/watch?v=7j6oBkDKnjE.
5. Klein GA. Industrial Color Physics. New York: Springer; 2010. 22. Fairchild MD. Color Appearance Models, Published Online: 18 June
6. Pfaff G. Special Effect Pigments, 2nd edition. Hannover: Vincentz Net- 2013. DOI: 10.1002/9781118653128.ch20.
work; 2008. 23. Perales E, Chorro E, Werner C, Viqueira V, G omez O, Martınez-Verd u
7. Chorro E, Martınez-Verd u F, campos J, Pons A. Colorimetric and spec- FM. Influence of spectral power distribution of light sources on the
tral evaluation of the optical anisotropy of metallic and pearlescent color appearance of goniochromatic colours. CIE Centenary Confer-
samples. J Mod Opt 2009;56:1457–1465. ence, Paris; 2013.
8. Schanda J. Colorimetry: Understanding the CIE System. New York: 24. Martınez-Verd u F, Perales E, Viqueira V, Chorro E, Burgos FJ, Pujol
John Wiley & Sons; 2007. J. Comparison of colorimetric features of some current lighting booths
9. Baba G, Suzuki K. Gonio-spectrophotometric analysis of white and for obtaining a right visual and instrumental correlation for gonio-
chromatic reference materials. Anal Chim Acta 1999;380:173–182. apparent coatings and plastics. Proceedings of CIE 2012 Lighting Qual-
10. Kirchner EJJ, Ravi J. Setting tolerances on color and texture for auto- ity and Energy Efficiency. 2012. p 692–705.
motive coatings. Color Res Appl 2012;39:88–98.
25. 25. Commission Internationale de l’Eclairage (CIE), Colorimetry, 3rd
11. DIN-6175-2. Tolerances for Automotive Paint. Part 2: Goniochromatic edition. CIE Publication 15:2004, Vienna: CIE Central Bureau, 2004.
Paints. Berlin, Germany: Deutsches Institut f€
ur Normung; 2001. 26. http://www.sdcenterprises.co.uk/products/sdc-assessment-aids/grey-scale/
12. ASTM E2194-12. Standard Practice for Multiangle Color Measurement See also ISO 105–A02:1993. Test for colour fastness—Part A02: Gray
of Metal Flake Pigmented Materials. Conshohocken: American Society scale for assessing change in colour. Geneva, Switzerland: International
for Testing Materials. Organization for Standardization.
13. ASTM E2539-12. Standard Practice for Multiangle Color Measurement 27. Guan SS, Luo MR. Investigation of parametric effects using small col-
of Interference Pigments. Conshohocken: American Society for Testing our differences. Color Res Appl 1999;24:331–343.
Materials. 28. Garcıa PA, Huertas R, Melgosa M, Cui G. Measurement of the rela-
14. Perales E, Chorro E, Viqueira V, Martınez-Verdu FM. Reproducibility tionship between perceived and computed color differences. J Opt Soc
comparison among multiangle spectrophotometers. Color Res Appl Am A 2007;24:1823–1829.
2013;38:160–167. 29. Kirchner E, Dekker N. Performance measures of color-difference equa-
15. Huang M, Chen G, Liu H, Cui G, Luo MR, Liao N, Melgosa M, tions: Correlation coefficient versus standardized residual sum of
Zhang Y, Zheng C.A comparison of different psychophysical methods squares. J Opt Soc Am A 2011;28:1841–1848.
for color-difference evaluation, in Proceedings AIC Colour 2013, New- 30. Melgosa M, Garcıa PA, G omez-Robledo L, Shamey R, Hinks D, Cui
castle, UK; 2013. G, Luo MR. Notes on the application of the standardized residual sum
16. Gomez O, Burgos FJ, Perales E, Chorro E, Viqueira V, Martınez- of squares index for the assessment of intra- and inter-observer variabil-
Verdu FM, Pujol J. Preliminary comparative performance of the ity in color difference experiments. J Opt Soc Am A 2011;28:949–953.
AUDI2000 and CIEDE2000 color difference formulas by visual assess- 31. Huang M, Liu H, Cui G, Luo MR, Melgosa M. Evaluation of threshold
ments in directional lighting booth, in Proceedings AIC Colour 2013, color differences using printed samples. J Opt Soc Am A 2012;29:
Vol. 4. Newcastle, UK; 2013. p 1545–1548. 883–891.
AQ1: Please confirm that all author names are OK and are set with first name first, surname last.
AQ3: Please provide the year of publication for Refs. 3, 12, 13.
AQ4: Please confirm that given names (red) and surnames/family names (green) have been identified correctly.