CN106651159A - Barrier-free detection system-based user evaluation method - Google Patents
Barrier-free detection system-based user evaluation method Download PDFInfo
- Publication number
- CN106651159A CN106651159A CN201611120283.9A CN201611120283A CN106651159A CN 106651159 A CN106651159 A CN 106651159A CN 201611120283 A CN201611120283 A CN 201611120283A CN 106651159 A CN106651159 A CN 106651159A
- Authority
- CN
- China
- Prior art keywords
- user
- task
- tasks
- points
- professionalism
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000011156 evaluation Methods 0.000 title claims abstract description 27
- 238000001514 detection method Methods 0.000 title claims abstract description 20
- 230000000875 corresponding effect Effects 0.000 claims abstract description 14
- 230000002596 correlated effect Effects 0.000 claims abstract description 4
- 230000007423 decrease Effects 0.000 claims description 6
- 238000000034 method Methods 0.000 abstract description 5
- 238000007689 inspection Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/01—Social networking
Landscapes
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Engineering & Computer Science (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- General Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Educational Administration (AREA)
- Marketing (AREA)
- Entrepreneurship & Innovation (AREA)
- Development Economics (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Game Theory and Decision Science (AREA)
- Computing Systems (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Information Transfer Between Computers (AREA)
Abstract
一种基于无障碍检测系统的用户评价方法，包括：首先计算用户的积分，用户每做对一个任务就会增加任务对应的积分，完成正确任务的数量越多，积分就越多，专业度也会随着积分的增多而增长；其次计算完成任务的准确率，用户的专业度和完成任务的准确率呈正相关，用户的专业度评分将以准确率为主要元素；同时计算完成任务的放弃率，用户放弃任务的比例越高，将会对评价有负面影响，因此也将根据放弃率相应降低专业度评分；最后综合上述因素对用户的专业度进行计算。本方法的优点在于：用户积分和专业度的评分是任务分配策略的基础，此方法的专业度评价能使任务分配给更合适的用户并提高任务结果的准确率。
A user evaluation method based on the barrier-free detection system, including: firstly calculate the user's points, every time the user completes a task correctly, the points corresponding to the task will be increased, the more correct tasks are completed, the more points, and the degree of professionalism It will increase with the increase of points; secondly, calculate the accuracy rate of completing the task, the user's professionalism and the accuracy rate of completing the task are positively correlated, and the user's professionalism score will be based on the accuracy rate as the main element; at the same time, calculate the abandonment rate of completing the task , the higher the proportion of users abandoning tasks, it will have a negative impact on the evaluation, so the professionalism score will be correspondingly reduced according to the abandonment rate; finally, the user's professionalism will be calculated based on the above factors. The advantage of this method is that user points and professional ratings are the basis of task assignment strategies, and the professional evaluation of this method can assign tasks to more appropriate users and improve the accuracy of task results.
Description
技术领域technical field
本发明涉及众包系统中的用户评价与任务分配技术领域，特别是基于无障碍检测系统的用户评价方法。The invention relates to the technical field of user evaluation and task assignment in a crowdsourcing system, in particular to a user evaluation method based on an obstacle-free detection system.
背景技术Background technique
截至2014年底，我国60岁及以上老年人口约2.12亿，残疾人数量约有8502万。随着互联网的高度普及和互联网在日常生活中重要性的不断上升，对于数量众多的老年人、残疾人等特殊人群而言，视觉和听觉上的缺失直接妨碍他们正常获取互联网上的信息。因此如何使这部分人群没有障碍地获取互联网信息显得尤为重要。As of the end of 2014, my country's elderly population aged 60 and above was about 212 million, and the number of disabled people was about 85.02 million. With the high popularity of the Internet and the increasing importance of the Internet in daily life, for a large number of special groups such as the elderly and the disabled, the lack of vision and hearing directly prevents them from obtaining information on the Internet normally. Therefore, how to make this part of the population access to Internet information without obstacles is particularly important.
为了使有障碍人士更有效地获取和利用互联网上的信息，提供信息的网站需要符合网页无障碍设计指南(WCAG,Web Content Accessibility Guidelines)的标准。不幸的是，只有少部分的网站符合无障碍的标准。而为了验证一个网站的设计是否符合无障碍标准，我们需要对其中的页面按照标准的规则来进行检测。因此设计出了无障碍检测系统。由于中国目前的网站数量庞大，人工检测的人员不足，那么高效的任务分配方案将是系统的主要目标。而任务分配又是以用户评价体系为基础。In order to enable people with disabilities to obtain and use information on the Internet more effectively, websites providing information must comply with the standards of Web Content Accessibility Guidelines (WCAG, Web Content Accessibility Guidelines). Unfortunately, only a small number of websites meet accessibility standards. In order to verify whether the design of a website meets the accessibility standards, we need to test the pages in it according to the standard rules. Therefore, a barrier-free detection system is designed. Due to the large number of websites in China and the lack of personnel for manual inspection, an efficient task allocation plan will be the main goal of the system. The assignment of tasks is based on the user evaluation system.
目前世界上的无障碍检测系统屈指可数，相应的用户评价体系并不适用于本系统，因此提出的用户评价方法将结合本系统的特征和用户的任务申请行为和完成情况，对用户在每个任务类别上的专业度进行评分，并将每个任务分配给在此任务类别上专业度高的人群，从而有效地提高任务分配效率和任务结果的准确率。At present, there are only a handful of barrier-free detection systems in the world, and the corresponding user evaluation system is not suitable for this system. Therefore, the proposed user evaluation method will combine the characteristics of this system with the user's task application behavior and completion status, and evaluate the user's performance in each task. The professional degree of each task category is scored, and each task is assigned to a group of people with high professionalism in this task category, so as to effectively improve the efficiency of task assignment and the accuracy of task results.
发明内容Contents of the invention
本发明要克服现有技术的上述确定啊，提供一种基于无障碍检测系统的用户评价方法，以提高无障碍检测系统分配任务的效率并且提高最后任务结果的准确率。The present invention overcomes the above determinations in the prior art, and provides a user evaluation method based on the barrier-free detection system, so as to improve the efficiency of task assignment by the barrier-free detection system and improve the accuracy of the final task results.
本发明提出了一种基于无障碍检测系统的用户评价方法，包括以下步骤：The present invention proposes a user evaluation method based on the barrier-free detection system, comprising the following steps:
1)计算用户的积分，用户每做对一个任务就会增加任务对应的积分，完成正确任务的数量越多，积分就越多，专业度也将随着任务数和积分的增多而增长；1) Calculate the user's points. Every time the user completes a task correctly, the points corresponding to the task will be increased. The more correct tasks are completed, the more points will be added, and the professionalism will also increase with the increase in the number of tasks and points;
2)计算完成任务的准确率，用户的专业度和完成任务的准确率呈正相关，准确率是用户专业度评分的主要组成部分；2) Calculate the accuracy rate of completing the task, the professionalism of the user is positively correlated with the accuracy rate of completing the task, and the accuracy rate is the main component of the professionalism score of the user;
3)计算完成任务的放弃率，用户放弃任务的比例越高，将会对评价有负面影响，因此也将根据放弃率相应降低专业度评分；3) Calculate the abandonment rate of the completed task. The higher the proportion of users abandoning the task, it will have a negative impact on the evaluation, so the professionalism score will be correspondingly reduced according to the abandonment rate;
4)综合上述因素对用户的专业度进行计算。4) Computing the professional degree of the user based on the above factors.
步骤1)中所述的任务积分与任务数具体是：The task points and the number of tasks described in step 1) are specifically:
11)对于检测任务，将根据其检测难度大小进行等级划分，并分配相应的积分，难度越大则积分越高；11) For the detection task, it will be graded according to the difficulty of detection, and the corresponding points will be allocated. The greater the difficulty, the higher the points;
12)专业度评价主要针对不同的任务类别进行计算，某个类别的任务完成数量越多(结果正确的任务数)，专业度也将越高，最后任务数将按着一定的权重加到专业度评分中。12) The professional degree evaluation is mainly calculated for different task categories. The more tasks of a certain category are completed (the number of tasks with correct results), the higher the professional degree will be. The final task number will be added to the professional according to a certain weight degree rating.
步骤2)中所述的准确率具体是：The accuracy rate described in step 2) is specifically:
21)用户申请的任务数为apply_num,最后这些任务中正确的任务数为correct_num(同个任务分配给多人完成，最后结果按一定规则仲裁得到，与最后结果相同的人说明结果正确否则视为错误结果)，那么对应的准确率为 21) The number of tasks applied by the user is apply_num, and the number of correct tasks among these tasks is correct_num (the same task is assigned to multiple people to complete, and the final result is obtained by arbitration according to certain rules. The person with the same final result indicates that the result is correct, otherwise it will be considered erroneous results), then the corresponding accuracy is
22)准确率越高，说明用户在该类任务上有较高的权威性，因此准确率作为其专业度评分的主要组成部分。22) The higher the accuracy rate, it means that the user has higher authority on this type of task, so the accuracy rate is the main component of its professionalism score.
步骤3)中所述的放弃率具体是：The abandonment rate described in step 3) is specifically:
31)用户申请的任务数为apply_num,最后这些任务中用户选择放弃的任务数为giveup_num(放弃的任务即原本分配给用户的任务，用户选择放弃完成该任务，这些任务将被重新回收再分配给其他用户)，那么对应的放弃率为 31) The number of tasks applied by the user is apply_num, and the number of tasks that the user chooses to give up among these tasks is giveup_num (the abandoned tasks are the tasks originally assigned to the user. If the user chooses to give up completing the task, these tasks will be recycled and reassigned to other users), then the corresponding abandonment rate
32)放弃任务增多将造成系统任务分配的效率下降，因此放弃率是专业度评价的重要指标，随着放弃率增高用户专业度则会相应降低。32) The increase of abandoned tasks will lead to a decline in the efficiency of system task allocation, so the abandonment rate is an important indicator of professional degree evaluation, and the user's professional degree will decrease accordingly with the increase of the abandonment rate.
步骤4)中所述的专业度评分，将对上述因子采用不同的权重进行计算后得到。The professional degree score described in step 4) will be obtained after calculating the above factors with different weights.
本发明的优点在于：用户积分和专业度的评分是任务分配策略的基础，本发明的专业度评价能使任务分配给更合适的用户并提高任务结果的准确率。The advantages of the present invention are that user points and professional ratings are the basis of task assignment strategies, and the professional evaluation of the present invention can assign tasks to more appropriate users and improve the accuracy of task results.
附图说明Description of drawings
图1是本发明的方法流程图。Fig. 1 is a flow chart of the method of the present invention.
具体实施方式detailed description
参照附图，进一步说明本发明：With reference to accompanying drawing, further illustrate the present invention:
一种基于无障碍检测系统的用户评价方法，该方法包括以下步骤：A user evaluation method based on a barrier-free detection system, the method includes the following steps:
1)计算用户的积分，用户每做对一个任务就会增加任务对应的积分，完成正确任务的数量越多，积分就越多，专业度也将随着任务数和积分的增多而增长；1) Calculate the user's points. Every time the user completes a task correctly, the points corresponding to the task will be increased. The more correct tasks are completed, the more points will be added, and the professionalism will also increase with the increase in the number of tasks and points;
2)计算完成任务的准确率，用户的专业度和完成任务的准确率呈正相关，准确率是用户专业度评分的主要组成部分；2) Calculate the accuracy rate of completing the task, the professionalism of the user is positively correlated with the accuracy rate of completing the task, and the accuracy rate is the main component of the professionalism score of the user;
3)计算完成任务的放弃率，用户放弃任务的比例越高，将会对评价有负面影响，因此也将根据放弃率相应降低专业度评分；3) Calculate the abandonment rate of the completed task. The higher the proportion of users abandoning the task, it will have a negative impact on the evaluation, so the professionalism score will be correspondingly reduced according to the abandonment rate;
4)综合上述因素对用户的专业度进行计算。4) Computing the professional degree of the user based on the above factors.
步骤1)中所述的任务积分与任务数具体是：The task points and the number of tasks described in step 1) are specifically:
11)对于检测任务，将根据其检测难度大小进行等级划分，并分配相应的积分，难度越大则积分越高；11) For the detection task, it will be graded according to the difficulty of detection, and the corresponding points will be allocated. The greater the difficulty, the higher the points;
12)专业度评价主要针对不同的任务类别进行计算，某个类别的任务完成数量越多(结果正确的任务数)，专业度也将越高，最后任务数将按着一定的权重加到专业度评分中。12) The professional degree evaluation is mainly calculated for different task categories. The more tasks of a certain category are completed (the number of tasks with correct results), the higher the professional degree will be. The final task number will be added to the professional according to a certain weight degree rating.
步骤2)中所述的准确率具体是：The accuracy rate described in step 2) is specifically:
21)用户申请的任务数为apply_num,最后这些任务中正确的任务数为correct_num(同个任务分配给多人完成，最后结果按一定规则仲裁得到，与最后结果相同的人说明结果正确否则视为错误结果)，那么对应的准确率为 21) The number of tasks applied by the user is apply_num, and the number of correct tasks among these tasks is correct_num (the same task is assigned to multiple people to complete, and the final result is obtained by arbitration according to certain rules. The person with the same final result indicates that the result is correct, otherwise it will be considered erroneous results), then the corresponding accuracy is
22)准确率越高，说明用户在该类任务上有较高的权威性，因此计算专业度时，准确率所占的权重较大。22) The higher the accuracy rate, it means that the user has higher authority in this type of task, so when calculating the professional degree, the accuracy rate takes a larger weight.
步骤3)中所述的放弃率具体是：The abandonment rate described in step 3) is specifically:
31)用户申请的任务数为apply_num,最后这些任务中用户选择放弃的任务数为giveup_num(放弃的任务即原本分配给用户的任务，用户选择放弃完成该任务，这些任务将被重新回收再分配给其他用户)，那么对应的放弃率为 31) The number of tasks applied by the user is apply_num, and the number of tasks that the user chooses to give up among these tasks is giveup_num (the abandoned tasks are the tasks originally assigned to the user. If the user chooses to give up completing the task, these tasks will be recycled and reassigned to other users), then the corresponding abandonment rate
32)放弃任务增多将造成系统任务分配的效率下降，因此放弃率是专业度评价的重要指标，随着放弃率增高用户专业度则会相应降低。32) The increase of abandoned tasks will lead to a decline in the efficiency of system task allocation, so the abandonment rate is an important indicator of professional degree evaluation, and the user's professional degree will decrease accordingly with the increase of the abandonment rate.
步骤4)中所述的专业度评分，将对上述因子采用不同的权重进行计算后得到。每天会对这些数据进行一次更新以供任务分配时使用。The professional degree score described in step 4) will be obtained after calculating the above factors with different weights. These data are updated once a day for use in task assignments.
本说明书实施例所述的内容仅仅是对发明构思的实现形式的列举，本发明的保护范围的不应当被视为仅限于实施例所陈述的具体形式，本发明的保护范围也及于本领域技术人员根据本发明构思所能够想到的等同技术手段。The content described in the embodiments of this specification is only an enumeration of the implementation forms of the inventive concept. The protection scope of the present invention should not be regarded as limited to the specific forms stated in the embodiments. The protection scope of the present invention also extends to the field Equivalent technical means that the skilled person can think of based on the concept of the present invention.
Claims (5)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611120283.9A CN106651159A (en) | 2016-12-08 | 2016-12-08 | Barrier-free detection system-based user evaluation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611120283.9A CN106651159A (en) | 2016-12-08 | 2016-12-08 | Barrier-free detection system-based user evaluation method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106651159A true CN106651159A (en) | 2017-05-10 |
Family
ID=58819961
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611120283.9A Withdrawn CN106651159A (en) | 2016-12-08 | 2016-12-08 | Barrier-free detection system-based user evaluation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106651159A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107316156A (en) * | 2017-06-30 | 2017-11-03 | 北京金山安全软件有限公司 | Data processing method, device, server and storage medium |
| CN108595562A (en) * | 2018-04-12 | 2018-09-28 | 西安邮电大学 | User's evaluation data analysing method based on accurate sex determination |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101989303A (en) * | 2010-11-02 | 2011-03-23 | 浙江大学 | Automatic barrier-free network detection method |
| CN103279548A (en) * | 2013-06-06 | 2013-09-04 | 浙江大学 | Method for performing barrier-free detection on websites |
| CN103955782A (en) * | 2014-03-27 | 2014-07-30 | 广州市集智信息科技有限公司 | Operational capability measuring and evaluating system |
| US20140244572A1 (en) * | 2006-11-27 | 2014-08-28 | Alex T. Hill | Qualification of website data and analysis using anomalies relative to historic patterns |
-
2016
- 2016-12-08 CN CN201611120283.9A patent/CN106651159A/en not_active Withdrawn
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140244572A1 (en) * | 2006-11-27 | 2014-08-28 | Alex T. Hill | Qualification of website data and analysis using anomalies relative to historic patterns |
| CN101989303A (en) * | 2010-11-02 | 2011-03-23 | 浙江大学 | Automatic barrier-free network detection method |
| CN103279548A (en) * | 2013-06-06 | 2013-09-04 | 浙江大学 | Method for performing barrier-free detection on websites |
| CN103955782A (en) * | 2014-03-27 | 2014-07-30 | 广州市集智信息科技有限公司 | Operational capability measuring and evaluating system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107316156A (en) * | 2017-06-30 | 2017-11-03 | 北京金山安全软件有限公司 | Data processing method, device, server and storage medium |
| CN107316156B (en) * | 2017-06-30 | 2020-10-09 | 北京金山安全软件有限公司 | Data processing method, device, server and storage medium |
| CN108595562A (en) * | 2018-04-12 | 2018-09-28 | 西安邮电大学 | User's evaluation data analysing method based on accurate sex determination |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8903787B2 (en) | Intelligent resoluton of codes in a classification system | |
| CN105824805B (en) | Identification method and device | |
| CN103929330A (en) | Domain name service quality evaluation method and system | |
| TW201409252A (en) | Method and system for setting information of natural person, corresponding method and system for recommending friend and machine-readable medium | |
| Keeney et al. | High‐need phenotypes in medicare beneficiaries: drivers of variation in utilization and outcomes | |
| CN106651159A (en) | Barrier-free detection system-based user evaluation method | |
| CN107622197A (en) | Device identification method and device, weighing computation method and device for equipment identification | |
| CN101226614A (en) | A Method for Assessing the Importance of Network Assets | |
| CN103839105B (en) | Stroke recommends method and apparatus | |
| JP2021068448A5 (en) | ||
| CN111881365A (en) | Content recommendation method and device | |
| JP6113560B2 (en) | Social network information processing apparatus, processing method, and processing program | |
| Peng et al. | Estimating the transmissibility of mumps: a modelling study in Wuhan City, China | |
| US20150227581A1 (en) | Systems and methods for analyzing registrar and hosting provider relationships | |
| CN117726311B (en) | Intelligent matching method, device, equipment and storage medium for employment positions of regulated objects | |
| CN106469163A (en) | A kind of public number recommends method and system | |
| CN104376064B (en) | A kind of method and apparatus for excavating age of user sample | |
| JP5581743B2 (en) | Document evaluation assigning method, program and apparatus | |
| CN109447684A (en) | A kind of electronic scoring method, computer readable storage medium and server | |
| US20180011856A1 (en) | Systems and methods for data and information source reliability estimation | |
| CN108549992A (en) | A kind of evaluation method of recruitment class website user experience | |
| CN103605763B (en) | Advertising media quality evaluation method and device | |
| Lemessa et al. | Factors affecting the intention of women to limit childbearing in rural Ethiopia | |
| JPWO2022269926A5 (en) | ||
| CN109637672B (en) | Prescription similarity calculation method based on medicine availability |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20170510 |