CN110570129A - Evaluation method, system and device for sequencing ability of sensory evaluation personnel - Google Patents

Evaluation method, system and device for sequencing ability of sensory evaluation personnel Download PDF

Info

Publication number
CN110570129A
CN110570129A CN201910868484.4A CN201910868484A CN110570129A CN 110570129 A CN110570129 A CN 110570129A CN 201910868484 A CN201910868484 A CN 201910868484A CN 110570129 A CN110570129 A CN 110570129A
Authority
CN
China
Prior art keywords
evaluator
sequencing
evaluation
sensory
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910868484.4A
Other languages
Chinese (zh)
Inventor
史波林
汪厚银
陈桂龙
钟葵
赵镭
刘龙云
谢苒
张璐璐
何天鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China National Institute of Standardization
Original Assignee
China National Institute of Standardization
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China National Institute of Standardization filed Critical China National Institute of Standardization
Priority to CN201910868484.4A priority Critical patent/CN110570129A/en
Priority to PCT/CN2019/110236 priority patent/WO2021046954A1/en
Publication of CN110570129A publication Critical patent/CN110570129A/en
Priority to AU2020100134A priority patent/AU2020100134A4/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063—Operations research, analysis or management
    • G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G06Q10/06395—Quality analysis or management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063—Operations research, analysis or management
    • G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G06Q10/06398—Performance of employee with respect to a job function

Landscapes

  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Engineering & Computer Science (AREA)
  • Strategic Management (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Educational Administration (AREA)
  • Operations Research (AREA)
  • Marketing (AREA)
  • Game Theory and Decision Science (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses a method, a system and a device for evaluating sequencing ability of sensory evaluators, wherein the method can quickly determine the excellent, good and poor attributions of the sequencing ability of the evaluators under repeated sequencing for many times, realizes the function of quick classification of the ability and improves the evaluation efficiency; the system and the device realize the evaluation method and the result display mode of the correct sequencing capability and the repeated sequencing capability among the evaluators in the same type of sequencing capability, and play the roles of scientific quantitative characterization and comparison of the correct sequencing capability and the repeated sequencing capability.

Description

Evaluation method, system and device for sequencing ability of sensory evaluation personnel
Technical Field
The invention relates to the technical field of sensory analysis, in particular to a method, a system and a device for evaluating sequencing ability of sensory evaluators.
Background
Sensory evaluation is a technique for evaluating sensory characteristics of products in terms of appearance, taste, smell, texture state, etc. through sensory organs. The product can reflect the direct feeling of people to the product to the maximum extent, thereby reflecting the sensory quality of the product. Therefore, the sensory evaluation technology is an indispensable technology in the aspects of new product development, product improvement, raw material replacement, quality control, market prediction and the like in the industries of food, cosmetics, flavors and fragrances, textiles, tobacco and the like.
Sensory evaluation itself is a measurement technique. In order to ensure the reliability, objectivity and correctness of sensory evaluation results, samples (samples) required by reasonable preparation and evaluation are scientifically presented to qualified evaluation crowds (machines) through screening, training and assessment in a controllable experimental environment (ring), the scientific sensory analysis method (method) selected by a sensory analyst (human) with abundant experience is adopted to evaluate the sensory samples to obtain the original evaluation data of each evaluator, and the sensory analyst performs statistical analysis on the data to obtain the sensory quality of the product.
Sensory evaluation is a technique for comparing relative differences between samples. According to the three accuracies of the difference, the difference sequence and the difference, the sensory evaluation is divided into three objective sensory evaluation methods of difference inspection, scale and category and descriptive analysis.
The sensory evaluation ranking method is a ranking method in a scale and category method, and is a classification method which requires an evaluator to rank a series of samples according to the strength of certain sensory characteristics of the samples. Can be used for determining the influence of different raw materials, processing, packaging, storage conditions, etc. on the intensity level of one or more sensory indexes of the product, or pre-screening before fine sensory evaluation (such as descriptive analysis), or screening and training evaluators.
The ranking method is a bridge of difference testing and descriptive analysis. That is, if the evaluator does not perceive the sequence of intensity of the differences between the samples, they are only eligible to perform a differential testing activity; and the appraisers with good sequencing ability can become descriptive analysts through further training.
Any measurement is performed by a corresponding detection instrument, and the performance of the instrument directly determines the reliability, objectivity and correctness of the produced result. The sensory evaluation instrument is an evaluation group consisting of a plurality of evaluators, and sensory sequencing raw data are directly derived from evaluation results of the sensory evaluators. Ideally, it is desirable that each evaluator give a complete answer to the true quality sequence or the theoretical optimal sequence each time. If the sequencing capability of the sensory evaluators is poor or unstable, the sensory evaluation experimental data of the sensory evaluators cannot reflect the real strength difference sequence of the sensory quality of different samples, so that the experimental result and conclusion are unreliable, and the application and guidance of the conclusion in the aspects of new product development, product improvement, raw material replacement, quality control, market prediction and the like are influenced. Therefore, sensory evaluator ranking ability is a prerequisite to obtain reliable and stable sensory ranking results.
The sensory evaluator sequencing ability performance evaluation technology is a technical guarantee for embodying the usability characteristic of a sequencing instrument, can guide an evaluator to calibrate before being put into use and achieve the required accuracy, can also help the evaluator to carry out regular verification after being used for a certain period so as to meet the standard requirement of detection, and ensures the validity or the correctness of a sequencing result. The technology is a key guarantee for realizing the value of sensory sequencing data, is an important means for reflecting the sequencing detection capability level of a sensory analysis laboratory, and is a main content for constructing and recognizing the sequencing capability of the sensory analysis laboratory. Therefore, the ranking capability performance evaluation technology of the evaluators in the sensory analysis laboratory can effectively manage the 'ranking instrument' to keep a good state, achieve the reliability of ranking data obtained by the instrument detection, ensure the requirements of sensory analysis scientific research, experiments and production, and powerfully boost the wide application of the sensory ranking method. Therefore, the sense evaluator ranking ability performance evaluation technology is of no great significance. And no system for rapidly analyzing the data by using computer software exists in the prior art.
Disclosure of Invention
The invention aims to provide an evaluation method for sequencing ability of sensory evaluators, which is used for solving the problem of lack of guidance in the prior art.
in order to achieve the purpose, the technical scheme of the invention is as follows:
A sensory evaluator sequencing ability assessment method comprises the following steps:
S1, inputting the first data information in the data input unit and storing the first data information in the storage unit;
s2, calculating and evaluating the first data information by using a data analysis unit;
And S3, displaying the ranking ability evaluation result of the evaluator on a result display unit.
the first data information is the ranking information obtained after the evaluator performs m rounds of repeated ranking of the sensory quality on n samples with different concentrations, preferably, n is 6, and m is 12.
The data analysis unit comprises a sorting capability classification module which calculates a Spearman rank correlation coefficient r of each round of sorting of each evaluator according to the sorting informationsthe value, then the Spearman rank correlation coefficient r after m rounds of sequencing experiments for each evaluator was countedsMedian and mode of the values; the Spearman rank correlation coefficient rsThe calculation formula of the value is:
In the formula rsIs a rank correlation coefficient; n is the number of sequencing experimental samples; di is the difference between rank ranked and true rank ranked by the evaluator for the ith sample in the round of ordering.
Wherein n is 6, and when the evaluators with the mode of 1.00 are the first type of evaluators, the result display unit displays that the result display unit is excellent; the evaluator with the median of 0.943 is the second evaluator crowd, and the result display unit displays that the evaluator is good; the remaining evaluators were the third type of evaluator population, and the result display unit showed a difference.
Preferably, the data analysis unit further comprises a correct sequencing ability module, and the correct sequencing ability module evaluates the correct sequencing ability of the sensory evaluator: eliminating each evaluator in m rounds of sortingsRun results with a value less than 0.60; passing fee house ZrThe conversion method sorts the remaining sequence data r of each roundsConversion of values into corresponding equidistant data ZrValue, then calculating the number of rounds Z left after each evaluator rejectsrArithmetic mean of valuesThen give up the fee ZrBy reverse conversion methodis converted intoValue according toValue evaluation evaluator's ability to correctly sort, fee house ZrConversion method the evaluator ranked r for each experimentsConversion of value to ZrThe calculation of the values is as follows:
In the formula rsIs a rank correlation coefficient; n is the number of hyperbolic tangent expansion terms;
The calculation of the values is as follows:
In the formula: m is the number of evaluation repetitions, here after exception test rejectionThe number of repetitions of (a); n isjnumber of samples for j-th repeated evaluation, njis 6; zrjcorrelation coefficient r with j-th repeated evaluationsValue fee house conversion ZrThe value is obtained.
The above-mentionedThe value range is-1, the closer to 1, the higher the correct sequencing capability is, and the darker the color display is in the relevant area of the result display unit.
Further, the data analysis unit further comprises a repeat ranking ability module, and the repeat ranking ability module further evaluates the repeat ranking ability of the sensory evaluator: calculating Z of each evaluator under multiple repeated sequencingrstandard deviation SZr(ii) a Reflecting the repeated sequencing capability of each evaluator according to the standard deviation, wherein SZrThe calculation formula of (2) is as follows:
In the formula: m is the evaluation repetition number, and the evaluation repetition number is the repetition number after the exception experiment is eliminated; n isjNumber of samples for j-th repeated evaluation, njIs 6; zrjCorrelation coefficient r with j-th repeated evaluationsValue fee house conversion ZrA value;The number of rounds r left after eliminating abnormal experiments for some evaluatorsafter the value and expense house is converted ZrAverage value of (a).
The repeated sequencing capability of each evaluator is embodied according to the standard deviation, SZrThe smaller the size, the stronger the ability to repeat the sorting, and the darker the color display in the relevant area of the result display unit.
The invention also discloses a sensory evaluator sequencing ability evaluation system, which is used in the evaluation method, and the system comprises: a data input unit for inputting first data information; the storage unit is used for storing the first data information; the data analysis unit is used for calculating and evaluating the first data information; and the result display unit is used for displaying the sequencing ability evaluation result of the personnel.
An apparatus comprising the sensory evaluator ranking capability assessment system described above also falls within the scope of the present invention. The invention has the following advantages:
(1) The system and the device can input and store each sequencing result of each evaluator at any time, so that the sequencing result of each evaluator can be called at any time, and the dynamic sequencing capability of each evaluator can be tracked at any time.
(2) the system and the device can quickly determine one of the excellent, good and poor attributions of the ranking ability of the appraisers under repeated ranking for many times and a result display mode, realize the function of quick classification of the ability and improve the assessment efficiency.
(3) The system and the device also realize the evaluation method and the result display mode of the correct sequencing capability and the repeated sequencing capability among the evaluators in the same type of sequencing capability, particularly through a fee house ZrThe conversion method is used for converting the statistical data r which has sequence characteristics and embodies the sequencing result of each roundsvalue, to Z with equidistant characteristicsrValue, thereby realizing the average value calculation statistics of representing the correct ability under the repeated sequencingAnd standard deviation calculation statistics (S) representing the repeat abilityZr) The method plays a role in scientific quantitative characterization and comparison of correct sequencing capability and repeated sequencing capability.
The method has the advantages that the accuracy of calibration and meeting the requirement of an evaluator before the evaluator is put into use can be assessed, and the evaluator can be helped to carry out regular verification in the use process so as to meet the standard requirement of detection, so that the sequencing capability of the laboratory evaluator can be mastered at any time, and the credibility and the validity of the sequencing result of the evaluator can be ensured.
Drawings
FIG. 1 is a schematic diagram of a sensory evaluator ranking ability assessment system;
FIG. 2 is a block diagram of a data analysis unit according to an embodiment.
Detailed Description
The invention will be further explained by means of specific embodiments, however, it should be understood that the invention may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
In the following description and in the claims, the terms "include" and "comprise" are used in an open-ended fashion, and thus should be interpreted to mean "include, but not limited to. The description which follows is a preferred embodiment of the invention, but is made for the purpose of illustrating the general principles of the invention and not for the purpose of limiting the scope of the invention. The scope of the present invention is defined by the appended claims.
Unless otherwise specified, the present invention is carried out by conventional methods, and various materials and reagents are commercially available.
example 1
A sensory evaluator ranking capability classification evaluation method comprises the following steps:
s1, inputting the first data information in the data input unit and storing the first data information in the storage unit;
S2, calculating and evaluating the first data information by using a data analysis unit;
And S3, displaying the ranking ability evaluation result of the evaluator on a result display unit.
The first data information is sequencing information obtained after an evaluator performs m-round repeated sequencing on n samples with different concentrations.
The data analysis unit comprises a sorting capability classification module which comprises a Spearman rank correlation coefficient r for calculating each round of sorting of each evaluator according to the sorting informationsvalues, then Spe after m rounds of sequencing experiments for each evaluator were countedarman rank correlation coefficient rsMedian and mode of the values; the Spearman rank correlation coefficient rsthe calculation formula of the value is:
In the formula rsIs a rank correlation coefficient; n is the number of sequencing experimental samples; di is the difference between rank ranked and true rank ranked by the evaluator for the ith sample in the round of ordering.
Wherein n is 6, and when the evaluators with the mode of 1.00 are the first type of evaluators, the result display unit displays that the result display unit is excellent; the evaluator with the median of 0.943 is the second evaluator crowd, and the result display unit displays that the evaluator is good; the remaining evaluators were the third type of evaluator population, and the result display unit showed a difference.
In order to further explain the acquisition method of the first data information input by the data input unit and the calculation and evaluation process of the first data information, a detailed description is given below by using a specific example. The actual data is adjusted according to the actual situation.
The first data information acquisition method comprises the following steps:
1. Evaluator screening
33 evaluators who were normal and relatively sensitive to the sensory taste of the basic tastes (sour, sweet, bitter, salty) were screened according to GB/T12312-2012 method for measuring sensory sensitivity to taste. According to the experimental requirements of GB/T12315-2008 sensory analysis methodology ordering method, the evaluation method and the technical points of the skilled taste ordering experiment are trained.
2. Sequencing sample preparation
The sucrose solution was selected here as the sweet taste sample ranking object for the assessment of the ranker ability performance. Considering the negative emotion brought by sense fatigue and repeated sequencing, the whole concentration of the sweet taste sample is moderate (the sweet taste cannot be too sweet and cannot be sweet). Concentration differences between samples of the ranked experimental series were set with reference to the average sweetness difference threshold of the panel of 33 evaluators. The concentration difference cannot be too small, so that the sweetness is close to the order of the sweetness, which is difficult to distinguish, and the sequencing result of most evaluators is disordered and incorrect, thereby losing the significance of sequencing capability performance evaluation. On the contrary, the concentration difference cannot be too large, otherwise, almost most evaluators can easily rank the sweet intensity of all samples in order, and the ranking ability performance evaluation cannot be performed. The basic principle of the preparation of the concentration of a series of samples is as follows: the 1/4 evaluators can be ensured to be accurately sequenced, the 1/4 evaluators feel great difficulty, and the remaining 1/2 evaluators are only inaccurate in sequencing among individual samples. In addition, double factors of index improvement of sorting difficulty caused by increase of the number of samples and lack of statistical significance caused by too few samples are balanced and considered, and 6 sweet taste solutions with different concentrations are specially selected. The specific concentrations are shown in Table 1.
TABLE 1 sweet taste sample correct order and corresponding concentration
3. Sensory ranking experiments
Each round of experiment provides 6 sweet taste solutions with different concentrations for each evaluator, the evaluators are required to follow sensory evaluation skills and sort the sweet taste intensity from weak to strong, the arrangement serial number (order) with the weakest intensity is 1, and the arrangement serial number with the strongest intensity is 6; different orders must be given to samples with difficult resolution, and the same order cannot be given, i.e. the operation mode is forced to be selected. Each evaluator needs to perform 12 rounds of repeated sequencing experiments in total, all experimental samples adopt different 3-bit random number codes, and the sample supply sequence of each round of experiments adopts a random complete block design.
Example 2
A sensory evaluator correct sequencing ability assessment method comprises the following steps:
S1, inputting the first data information in the data input unit and storing the first data information in the storage unit;
S2, calculating and evaluating the first data information by using a data analysis unit;
and S3, displaying the ranking ability evaluation result of the evaluator on a result display unit.
the first data information is sequencing information obtained after an evaluator performs m-round repeated sequencing on the sensory quality of n different concentrations. N is 6, and m is 12.
The data analysis unit comprises a sorting capability classification module and a correct sorting capability module, wherein the sorting capability classification module comprises a Spearman rank correlation coefficient r for calculating each round of sorting of each evaluator according to the sorting informationsThe value, then the Spearman rank correlation coefficient r after m rounds of sequencing experiments for each evaluator was countedsMedian and mode of the values; the Spearman rank correlation coefficient rsThe calculation formula of the value is:
In the formula rsis a rank correlation coefficient; n is the number of sequencing experimental samples; di is the difference between rank ranked and true rank ranked by the evaluator for the ith sample in the round of ordering.
The correct sequencing ability module evaluates the correct sequencing ability of sensory evaluators: eliminating each evaluator in m rounds of sortingsRun results with a value less than 0.60; passing fee house ZrThe conversion method sorts the remaining sequence data r of each roundsConversion of values into corresponding equidistant data ZrValue, then calculating the number of rounds Z left after each evaluator rejectsrArithmetic mean of valuesThen give up the fee ZrBy reverse conversion methodIs converted intoValue according toValue evaluation evaluator's ability to correctly sort, fee house Zrconversion method the evaluator ranked r for each experimentsConversion of value to ZrThe calculation of the values is as follows:
In the formula rsIs a rank correlation coefficient; n is the number of hyperbolic tangent expansion terms;
the calculation of the values is as follows:
In the formula: m is the evaluation repetition number, and the evaluation repetition number is the repetition number after the exception experiment is eliminated; n isjNumber of samples for j-th repeated evaluation, njIs 6; zrjCorrelation coefficient r with j-th repeated evaluationsvalue fee house conversion ZrThe value is obtained. And m is 12.
the above-mentionedThe value range is-1, the closer to 1, the higher the correct sequencing capability is, and the darker the color display is in the relevant area of the result display unit.
Example 3
A sensory evaluator repeated sequencing ability assessment method comprises the following steps:
S1, inputting the first data information in the data input unit and storing the first data information in the storage unit;
S2, calculating and evaluating the first data information by using a data analysis unit;
And S3, displaying the ranking ability evaluation result of the evaluator on a result display unit.
the first data information is sequencing information obtained after an evaluator performs m-round repeated sequencing on n samples with different concentrations. N is 6, and m is 12.
the data analysis unit comprises a sorting capability classification module, a correct sorting capability module and a repeated sorting capability module, wherein the sorting capability classification module comprises a Spearman rank correlation coefficient r for calculating each round of sorting of each evaluator according to the sorting informationsThe value, then the Spearman rank correlation coefficient r after m rounds of sequencing experiments for each evaluator was countedsMedian and mode of the values; the Spearman rank correlation coefficient rsThe calculation formula of the value is:
In the formula rsIs a rank correlation coefficient; n is the number of sequencing experimental samples; di is the difference between rank ranked and true rank ranked by the evaluator for the ith sample in the round of ordering.
The correct sequencing ability module evaluates the correct sequencing ability of sensory evaluators: eliminating each evaluator in m rounds of sortingsRun results with a value less than 0.60; passing fee house ZrThe conversion method sorts the remaining sequence data r of each roundsConversion of values into corresponding equidistant data Zrvalue, then calculating the number of rounds Z left after each evaluator rejectsrArithmetic mean of valuesThen give up the fee ZrBy reverse conversion methodIs converted intoValue according toValue evaluation evaluator's ability to correctly sort, fee house ZrConversion method the evaluator ranked r for each experimentsConversion of value to ZrThe calculation of the values is as follows:
In the formula rsIs a rank correlation coefficient; n is the number of hyperbolic tangent expansion terms;
The calculation of the values is as follows:
In the formula: m is the evaluation repetition number, and the evaluation repetition number is the repetition number after the exception experiment is eliminated; n isjNumber of samples for j-th repeated evaluation, njIs 6; zrjCorrelation coefficient r with j-th repeated evaluationsValue fee house conversion ZrThe value is obtained.
The repeated sequencing ability module evaluates the repeated sequencing ability of a sensory evaluator: calculating Z of each evaluator under multiple repeated sequencingrStandard deviation SZr(ii) a Reflecting the repeated sequencing capability of each evaluator according to the standard deviation, wherein SZrThe calculation formula of (2) is as follows:
In the formula: m is the evaluation repetition number, and the evaluation repetition number is the repetition number after the exception experiment is eliminated; n isjnumber of samples for j-th repeated evaluation, njIs 6; zrjCorrelation coefficient r with j-th repeated evaluationsvalue fee house conversion ZrA value;The number of rounds r left after eliminating abnormal experiments for some evaluatorsAfter the value and expense house is converted ZrAverage value of (a).
The repeated sequencing capability of each evaluator is embodied according to the standard deviation, SZrThe smaller the size, the stronger the ability to repeat the sorting, and the darker the color display in the relevant area of the result display unit.
Example 4
A sensory evaluator ranking capability assessment system, as shown in fig. 1, the system comprising: a data input unit for inputting first data information; the storage unit is used for storing the first data information; the data analysis unit is used for calculating and evaluating the first data information; and the result display unit is used for displaying the sequencing ability evaluation result of the personnel.
Wherein the data analysis unit comprises a sorting capability classification module used for calculating a Spearman rank correlation coefficient r of each round of sorting of each evaluator according to the sorting informationsThe value, then the Spearman rank correlation coefficient r after m rounds of sequencing experiments for each evaluator was countedsmedian and mode of the value.
Example 5
A sensory evaluator ranking capability assessment system, the system comprising: a data input unit for inputting first data information; the storage unit is used for storing the first data information; the data analysis unit is used for calculating and evaluating the first data information; and the result display unit is used for displaying the sequencing ability evaluation result of the personnel.
the data analysis unit comprises a sorting capability classification module and a correct sorting capability module;
The sorting capability classification module is used for calculating a Spearman rank correlation coefficient r of each round of sorting of each evaluator according to the sorting informationsThe value, then the Spearman rank correlation coefficient r after m rounds of sequencing experiments for each evaluator was countedsMedian and mode of the values;
the correct sequencing ability module is used for evaluating the correct sequencing ability of the sensory evaluator: eliminating each evaluator in m rounds of sortingsRun results with a value less than 0.60; passing fee house ZrThe conversion method sorts the remaining sequence data r of each roundsConversion of values into corresponding equidistant data ZrValue, then calculating the number of rounds Z left after each evaluator rejectsrArithmetic mean of valuesThen give up the fee ZrBy reverse conversion methodIs converted intoValue according toThe values assess the correct ranking ability of the evaluators.
Example 6
A sensory evaluator ranking capability assessment system, the system comprising: a data input unit for inputting first data information; the storage unit is used for storing the first data information; the data analysis unit is used for calculating and evaluating the first data information; and the result display unit is used for displaying the sequencing ability evaluation result of the personnel.
Wherein the data analysis unit comprises a sorting capability classification module, a correct sorting capability module and a repeated sorting capability module (as shown in FIG. 2);
The sorting capability classification module is used for calculating a Spearman rank correlation coefficient r of each round of sorting of each evaluator according to the sorting informationsThe value, then the Spearman rank correlation coefficient r after m rounds of sequencing experiments for each evaluator was countedsMedian and mode of the values;
The correct sequencing ability module is used for evaluating the correct sequencing ability of the sensory evaluator: eliminating each evaluator in m rounds of sortingsRun results with a value less than 0.60; passing fee house ZrThe conversion method sorts the remaining sequence data r of each roundsValue conversion to pairCorresponding equidistant data ZrValue, then calculating the number of rounds Z left after each evaluator rejectsrArithmetic mean of valuesthen give up the fee Zrby reverse conversion methodIs converted intoValue according toThe values assess the correct ranking ability of the evaluators.
The repeated sequencing ability module is used for evaluating the repeated sequencing ability of a sensory evaluator: calculating Z of each evaluator under multiple repeated sequencingrStandard deviation SZr(ii) a And the repeated sequencing capability of each evaluator is embodied according to the standard deviation.
Although the invention has been described in detail above with reference to a general description and specific examples, it will be apparent to one skilled in the art that modifications or improvements may be made thereto based on the invention. Accordingly, such modifications and improvements are intended to be within the scope of the invention as claimed.

Claims (10)

1. a sensory evaluator sequencing ability assessment method is characterized by comprising the following steps:
s1, inputting the first data information in the data input unit and storing the first data information in the storage unit;
s2, calculating and evaluating the first data information by using a data analysis unit;
And S3, displaying the ranking ability evaluation result of the evaluator on a result display unit.
2. A sensory evaluator ranking capability assessment method according to claim 1, wherein the first data information is ranking information obtained by an evaluator after performing m rounds of repeated ranking of sensory quality on n samples of different concentrations, where n is 6 and m is 12.
3. A sensory evaluator sequencing ability assessment method according to claim 1, wherein the data analysis unit comprises a sequencing ability classification module which calculates a Spearman rank correlation coefficient r for each round of sequencing of each evaluator from the sequencing informationsThe value, then the Spearman rank correlation coefficient r after m rounds of sequencing experiments for each evaluator was countedsMedian and mode of the values; the Spearman rank correlation coefficient rsThe calculation formula of the value is:
In the formula rsIs a rank correlation coefficient; n is the number of sequencing experimental samples; di is the difference between rank ranked and true rank ranked by the evaluator for the ith sample in the round of ordering.
4. A sensory evaluator ranking capability assessment method according to claim 3, wherein said n is 6, and when an evaluator with a mode of 1.00 is a first evaluator crowd, the result display unit displays a good; the evaluator with the median of 0.943 is the second evaluator crowd, and the result display unit displays that the evaluator is good; the remaining evaluators were the third type of evaluator population, and the result display unit showed a difference.
5. a sensory evaluator ranking capability assessment method according to claim 3, wherein the data analysis unit further comprises a correct ranking capability module that assesses a sensory evaluator correct ranking capability: eliminating each evaluator in m rounds of sortingsRun results with a value less than 0.60; passing fee house ZrThe conversion method sorts the remaining sequence data r of each roundsconversion of values into corresponding equidistant data ZrValue, then calculating the number of rounds Z left after each evaluator rejectsrArithmetic mean of valuesThen give up the fee ZrBy reverse conversion methodIs converted intoValue according toValue evaluation evaluator's ability to correctly sort, fee house Zrconversion method the evaluator ranked r for each experimentsConversion of value to ZrThe calculation of the values is as follows:
In the formula rsIs a rank correlation coefficient; n is the number of hyperbolic tangent expansion terms;
The calculation of the values is as follows:
In the formula: m is the evaluation repetition number, and the evaluation repetition number is the repetition number after the exception experiment is eliminated; n isjnumber of samples for j-th repeated evaluation, njis 6; zrjCorrelation coefficient r with j-th repeated evaluationsValue fee house conversion Zrthe value is obtained.
6. Sensory evaluator ranking according to claim 5A method for assessing ability, characterized in thatThe value range is-1, the closer to 1, the higher the correct sequencing capability is, and the darker the color display is in the relevant area of the result display unit.
7. A sensory evaluator ranking capability assessment method according to claim 5, wherein the data analysis unit further comprises a repeat ranking capability module which assesses the repeat ranking capability of a sensory evaluator: calculating Z of each evaluator under multiple repeated sequencingrStandard deviation SZr(ii) a Reflecting the repeated sequencing capability of each evaluator according to the standard deviation, wherein SZrThe calculation formula of (2) is as follows:
In the formula: m is the evaluation repetition number, and the evaluation repetition number is the repetition number after the exception experiment is eliminated; n isjNumber of samples for j-th repeated evaluation, njIs 6; zrjCorrelation coefficient r with j-th repeated evaluationsValue fee house conversion Zra value;The number of rounds r left after eliminating abnormal experiments for some evaluatorsAfter the value and expense house is converted ZrAverage value of (a).
8. A sensory-evaluator ranking capability assessment method according to claim 7, wherein the repeat ranking capability of each evaluator is reflected according to standard deviation magnitude, SZrThe smaller the size, the stronger the ability to repeat the sorting, and the darker the color display in the relevant area of the result display unit.
9. A sensory evaluator ranking ability evaluation system for use in the evaluation method according to any one of claims 1 to 8, the system comprising: a data input unit for inputting first data information; the storage unit is used for storing the first data information; the data analysis unit is used for calculating and evaluating the first data information; and the result display unit is used for displaying the sequencing ability evaluation result of the personnel.
10. An apparatus comprising the sensory evaluator ranking ability assessment system of claim 9.
CN201910868484.4A 2019-09-12 2019-09-12 Evaluation method, system and device for sequencing ability of sensory evaluation personnel Pending CN110570129A (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201910868484.4A CN110570129A (en) 2019-09-12 2019-09-12 Evaluation method, system and device for sequencing ability of sensory evaluation personnel
PCT/CN2019/110236 WO2021046954A1 (en) 2019-09-12 2019-10-10 Method and system for evaluating ranking capability of sensory evaluator, and device
AU2020100134A AU2020100134A4 (en) 2019-09-12 2020-01-24 Method, system and apparatus for evaluating sensory assessors’ ability in ranking

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910868484.4A CN110570129A (en) 2019-09-12 2019-09-12 Evaluation method, system and device for sequencing ability of sensory evaluation personnel

Publications (1)

Publication Number Publication Date
CN110570129A true CN110570129A (en) 2019-12-13

Family

ID=68780066

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910868484.4A Pending CN110570129A (en) 2019-09-12 2019-09-12 Evaluation method, system and device for sequencing ability of sensory evaluation personnel

Country Status (3)

Country Link
CN (1) CN110570129A (en)
AU (1) AU2020100134A4 (en)
WO (1) WO2021046954A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111579724A (en) * 2020-06-01 2020-08-25 中国标准化研究院 Rapid classification method and device for sensory sensitivity of tingling and peppery suprathreshold and application
CN115699068A (en) * 2020-06-19 2023-02-03 松下知识产权经营株式会社 Information providing method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102222164A (en) * 2011-05-30 2011-10-19 中国标准化研究院 Food sensory quality evaluation method and system thereof

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
史波林 等: "基于秩相关与聚类分析的评价员排序能力评估", 《食品与机械》 *
周宗奎 等: "《2008年全国硕士研究生入学统一考试心理学专业基础综合考试大纲要点解析》", 30 September 2007, 华中师范大学出版社 *
查尔斯•N.等: "《微生物定量风险评估》", 30 April 2017, 中国环境科学出版社 *
覃义 等: "《R语言与应用统计分析实验指导》", 31 October 2017, 中国统计出版社 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111579724A (en) * 2020-06-01 2020-08-25 中国标准化研究院 Rapid classification method and device for sensory sensitivity of tingling and peppery suprathreshold and application
CN115699068A (en) * 2020-06-19 2023-02-03 松下知识产权经营株式会社 Information providing method

Also Published As

Publication number Publication date
WO2021046954A1 (en) 2021-03-18
AU2020100134A4 (en) 2020-03-12

Similar Documents

Publication Publication Date Title
Piggott et al. Sensory analysis
Finch Comparison of distance measures in cluster analysis with dichotomous data
Kankaraš et al. Measurement equivalence of ordinal items: A comparison of factor analytic, item response theory, and latent class approaches
Bolt A Monte Carlo comparison of parametric and nonparametric polytomous DIF detection methods
Taub et al. A Confirmatory Factor Analysis of Cattell-Horn-Carroll Theory and Cross-Age Invariance of the Woodcock-Johnson Tests of Cognitive Abilities III.
Fidalgo et al. Generalized Mantel-Haenszel methods for differential item functioning detection
Williams et al. DIF identification using HGLM for polytomous items
Losó et al. Comparison of the performance of a trained and an untrained sensory panel on sweetcorn varieties with the panelcheck software
CN110570129A (en) Evaluation method, system and device for sequencing ability of sensory evaluation personnel
CN110522461B (en) Method, system and device for judging special concentration of sensory evaluation personnel
Reynolds et al. Can students’ attitudes towards mathematics and science be compared across countries? Evidence from measurement invariance modeling in TIMSS 2019
CN113239669B (en) Test Question Difficulty Prediction Method
Costantini et al. Mining performance data through nonlinear PCA with optimal scaling
Seybert A new item response theory model for estimating person ability and item parameters for multidimensional rank order responses
Gomide et al. Study of the influence of line scale length (9 and 15 cm) on the sensory evaluations of two descriptive methods
Alawiyah et al. Analysis of misconception on solubility and solubility product constant (ksp) using three-tier multiple choice test
Mahieu Sensory analysis with consumers using Free-Comment: analyses, performances and extensions
Muñoz et al. Comparison of descriptive analysis methods
Brown et al. Modification indices for diagnostic classification models
JPH06249810A (en) Gas discrimination device
Cyr et al. Item response theory and latent variable modeling for surveys with complex sampling design: The case of the national longitudinal survey of children and youth in Canada
Adelia et al. Innovation Orientation, Self-Motivation, and Marketing Communication: Their Role in Supporting the Marketing Performance of Women Entrepreneurs in Micro, Small, and Medium Enterprises
Raithatha et al. Panel quality management: Performance, monitoring and proficiency
Meldrum Structural equation modelling: tips for getting started with your research
Brown et al. Modification indices for diagnostic classification models

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination