  Standard methods, standard test conditions and the use of good sensory
practices are key elements of sensory testing. However, while compliance
assessment by trained and expert assessors is well developed, few information
is available on testing consumer consistency. Therefore, we aim to answer the
following research questions: What type of metrics can be used to characterise
(in)consistent evaluation? How to rank assessors and attributes' evaluations
based on (in)consistency? Who can be considered an (in)consistent assessor?
What is the difference between consistent and inconsistent assessors'
evaluations and use of scale? What is the impact of consistent and inconsistent
assessors' evaluations on the overall liking estimate? The proposed detection
of (in)consistency requires evaluations on two connected scales. We reveal how
assessors and attributes can be ranked according to the level of inconsistency,
as well as how inconsistent assessors can be identified. The suggested approach
is illustrated by data from sensory tests of biscuits enriched with three
pollens at different levels. Future consumer tests are recommended to account
for possible inconsistent evaluations.
