CN106557891B - Crowdsourcing task allocation method based on user reliability - Google Patents

Crowdsourcing task allocation method based on user reliability Download PDF

Info

Publication number
CN106557891B
CN106557891B CN201611105342.5A CN201611105342A CN106557891B CN 106557891 B CN106557891 B CN 106557891B CN 201611105342 A CN201611105342 A CN 201611105342A CN 106557891 B CN106557891 B CN 106557891B
Authority
CN
China
Prior art keywords
task
user
users
jumping
distributed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611105342.5A
Other languages
Chinese (zh)
Other versions
CN106557891A (en
Inventor
施战
黄河
孙玉娥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou University
Original Assignee
Suzhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou University filed Critical Suzhou University
Priority to CN201611105342.5A priority Critical patent/CN106557891B/en
Publication of CN106557891A publication Critical patent/CN106557891A/en
Application granted granted Critical
Publication of CN106557891B publication Critical patent/CN106557891B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0631Resource planning, allocation, distributing or scheduling for enterprises or organisations
    • G06Q10/06311Scheduling, planning or task assignment for a person or group
    • G06Q10/063112Skill-based matching of a person or a group to a task
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G06Q10/06395Quality analysis or management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • G06Q10/101Collaborative creation, e.g. joint development of products or services

Landscapes

  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Engineering & Computer Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • Educational Administration (AREA)
  • Quality & Reliability (AREA)
  • Development Economics (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Game Theory and Decision Science (AREA)
  • Data Mining & Analysis (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses a crowdsourcing task allocation method based on user reliability, which comprises the following steps: s1, inputting a user set W and a task set T; s2, starting task allocation, and initializing a relevant task and a user set; s3, for each task T in the task set T to be distributediSelecting users meeting the conditions to join the task tiSet of users Wr,iPerforming the following steps; s4, starting the first round of user allocation, and traversing each task in the task set T to be allocated; s5, continuing the user distribution from the second round to the first round, and traversing each task T in the task set T to be distributedi(ii) a S6, finishing task distribution according to the set WrAnd the quality of the task completed by the user is updated according to the reputation value of the user. The invention can not only ensure the reliability of users, the heterogeneity of users and the heterogeneity of tasks, but also improve the actual benefit of tasks and stimulate more users to finish the tasks with high quality.

Description

Crowdsourcing task allocation method based on user reliability
Technical Field
The invention relates to the technical field of computer networks and communication, in particular to a crowdsourcing task allocation method based on user reliability.
Background
Crowdsourcing refers to the practice of a company or organization outsourcing work tasks performed by employees in the past to an unspecified (and often large) mass network in a free-voluntary manner. People on crowdsourcing platforms fall into two categories: the person who publishes the task on the platform is called the task publisher and the person who completes the task is called the user. The task publisher publishes the task on the platform, and the user obtains a certain reward by completing the task. Typical tasks that are crowd-sourced are designing graphics, soliciting marketing solutions, image tagging, and data collection.
Crowd-sourced work can help task publishers get a large number of free users to solve practical problems by exploiting the intelligence of these users. However, since the users and task publishers have selfish characteristics and strive to maximize their own benefits, such situations result in the results submitted by the users containing a large number of arbitrary or even false answers, eventually leaving the task publishers with no high quality answers. Therefore, how to stimulate the user to complete the task with high quality is an important link for optimizing the crowdsourcing service, so that the quality of result data obtained by a task publisher is guaranteed.
However, the existing discussion of the user service quality difference only exists in a simple task allocation method, and no reasonable incentive mechanism is provided to attract the user to participate in the task. Moreover, most of the existing researches are focused on a single-user single-task model, namely, each task is only distributed to one user to be completed, and the problems of reliability of the users, heterogeneity of the tasks and the like are not fully considered, namely, for the same task, the completion quality of different users is different; the quality of different tasks performed by the same user is also different. Therefore, the design aspects of the mode of operation and the incentive mechanism of the crowdsourcing have defects, and the actual requirements of the crowdsourcing system cannot be met.
Therefore, in order to solve the above technical problems, it is necessary to establish a complete user reliability-based crowd-sourced task allocation method, which can not only ensure the reliability of users, the heterogeneity of users and the heterogeneity of tasks, but also improve the actual benefit of tasks and encourage more users to complete tasks with high quality.
Disclosure of Invention
In view of this, the present invention provides a method for distributing crowdsourcing tasks based on user reliability, so as to encourage users to complete tasks with high quality and improve task efficiency.
In order to achieve the above purpose, the technical solutions provided by the embodiments of the present invention are as follows:
a method of crowd-sourced task allocation based on user reliability, the method comprising:
s1, the task publisher publishes n heterogeneous tasks on the crowdsourcing platform, and the set T is ═ T1,t2,...,tnIndicates that there are m heterogeneous users on the crowdsourcing platform, and the set W ═ W1,w2,...,wmRepresents;
s2, starting task allocation, initializing related tasks and user sets, and allocating the completed task sets
Figure BDA0001171311930000021
Set of users assigned to tasks
Figure BDA0001171311930000022
Is in accordance with task tiConditional set of users to be allocated
Figure BDA0001171311930000023
Is assigned to task tiUser set of
Figure BDA0001171311930000024
S3, for each task T in the task set T to be distributediSelecting users meeting the conditions to join the task tiSet of users Wr,iPerforming the following steps;
s4, according to the number | W of users participating in all tasks to be distributed in the set Tr,iI is arranged in ascending order, and then each task t to be distributed isiSet of users Wr,iThe users in the system are arranged in descending order according to the user reputation values;
s5, continuing the user allocation from the second round to the first round, and in the allocation process of each round, firstly arranging the tasks in the task set T to be allocated according to the ascending order of the user credit values to be allocated, and then traversing each task in the task set T to be allocated;
s6, finishing task distribution and finishing the distributed task set Ts=TsU.T. according to the set W of users assigned to the taskrAnd (4) the answers submitted by the users, and the task publisher evaluates the users.
As a further improvement of the present invention, the step S3 specifically includes:
s301, traversing ith task T in task set T to be distributedi
S302, if i < ═ T |, namely task TiIn the task set T to be distributed, jumping to step S303, otherwise jumping to step S4;
s303, traversing jth user W in user set Wj
S304, if j < ═ W |, i.e. user WjIn the user set W, jumping to step S305, otherwise jumping to step S308;
s305, if the user wjAt task tiAnd satisfies task tiIf so, jumping to step S306, otherwise, jumping to step S307;
s306, conforming to the task tiRequested user wjJoining to a user set Wr,iPerforming the following steps;
s307, continuously traversing the j +1 th user in the user set W, and jumping to the step S304;
s308, conforming to the task tiAnd (4) all the required users are traversed, the (i + 1) th task in the task set T to be distributed is continuously traversed, and the step S302 is skipped.
As a further improvement of the present invention, the step S4 further includes:
and starting the first round of user allocation from the task with the minimum number of users in the task set T to be allocated.
As a further improvement of the present invention, the step S4 specifically includes:
s401, for each task in the task set to be distributed, if the task requirement is met, the user set W to be distributedr,iIf the number of the tasks is null, that is, no user meets the requirement of the task, the distribution is finished, and the step is skipped to step S6, otherwise, the step is skipped to step S402;
s402, tasks to be distributedAll tasks in the set T are according to the number of participating users | Wr,iI is arranged in ascending order;
s403, for each task t to be distributediSet of users Wr,iThe users in (1) are arranged in descending order according to the reputation value;
s404, traversing the ith task T in the task set T to be distributediInitiating task tiAssigned subscriber identity flagiThis flag is used to determine task tiWhether it has been assigned to a user;
s405, if i < | T |, namely task TiIn the task set T to be distributed, jumping to step S406, otherwise jumping to step S5;
s406, traversing task tiSet of users Wr,iJ (th) user w in (1)j
S407, if j < ═ Wr,iI.e. user wjIn a user set Wr,iIf yes, go to step S408, otherwise go to step S412;
s408, if the user wjIf the task is not allocated in the stage, jumping to step S409, otherwise jumping to step S410;
s409, processing the task tiIs assigned to user wjFlag, flagi=true,x i,j1 denotes the task tiIs assigned to user wjHold user wjJoining a set of users W assigned to a taskrAnd assigned to task tiSet of users WiAnd user wjFrom task tiTo be allocated user set Wr,iDeleting, and jumping to step S412;
s410, user wjHas been assigned to a task, user wjFrom task tiTo be allocated user set Wr,iDeleting;
s411, continuously traversing the user set Wr,iThe (j + 1) th user jumps to step S407;
s412, continuously traversing the (i + 1) th task in the task set T to be distributed, and jumping to the step S405.
As a further improvement of the present invention, the step S5 specifically includes:
s501, starting the h-th round of user allocation, wherein the initial value of h is 2;
s502, for each task in the task set T to be distributed, if the task requirement is met, the user set W to be distributedr,iIf the data are all null, that is, no user meets the requirement of the task, the distribution is finished, and the step is skipped to step S6, otherwise, the step is skipped to step S503;
s503, if h < ═ l, that is, task allocation in this stage has not ended yet, jumping to step S504, otherwise jumping to S6;
s504, for all tasks in the task set T to be distributed, arranging the tasks according to the distributed user reputation values in an ascending order, and traversing the ith task T in the task set T to be distributedi
S505, if i < | T |, namely task TiIn the task set T to be distributed, jumping to step S506, otherwise jumping to step S515;
s506, traversing task tiSet of users Wr,iJ (th) user w in (1)j
S507, if j < ═ Wr,iI.e. user wjIn a user set Wr,iIf yes, jumping to step S508, otherwise jumping to step S511;
s508, if the user omegajIf no task is allocated in this stage, go to step S509, otherwise go to step S510;
s509, task tiIs assigned to user wjx i,j1 denotes the task tiTo a user omegajLet user ωjJoining a set of users W assigned to a taskrAnd assigned to task tiUser W ofiAnd user wjFrom task tiTo be allocated user set Wr,iDeleting, and jumping to step S514;
s510, user wjHas been assigned to a task, user wjFrom task tiTo be allocated user set Wr,iDeleting and continuously traversing the taskSet W of users to be allocated of tir,iThe (j + 1) th user, and simultaneously jumping to the step S507;
s511, if the task tiAssigned subscriber identity flagiTrue, i.e. task tiIf the user is already allocated, but no user is next allocated, jumping to step S512, otherwise jumping to step 513;
s512, task tiAssigned to users, and assign task tiJoining to a set T of task assignment completionssAnd the task tiDeleting the task from the set T, continuously traversing the (i + 1) th task in the task set T, and simultaneously jumping to the step S505;
s513, task tiDirectly assigning task t to user without distributing task t to useriDeleting the task set T to be distributed;
s514, continuously traversing the (i + 1) th task in the task set T to be distributed, and jumping to the step S505;
and S515, continuing the h +1 th round of user allocation, and jumping to the step S502.
As a further improvement of the present invention, the step S6 further includes:
traverse set WrAccording to user ωjCompletion of task tiEvaluation obtained thereafter ei,jBy the formula repr,j=αrepr-1,j+(1-α)2ei,jrepr-1,jUpdating user omegajThe reputation value of.
As a further improvement of the present invention, the step S6 specifically includes:
s601, traversing a user set WrJ (th) user w in (1)j
S602, if j < | WrI.e. user wjIn a user set WrIf yes, jumping to step S603, otherwise ending the updating;
s603, the crowdsourcing platform updates the formula rep according to the creditr,j=αrepr-1,j+(1-α)2ei,jrepr-1,jAnd user wjEvaluation obtained ei,jTo user wjUpdating the reputation value of the database;
s604, continuously traversing the user set WrThe j +1 th user, jumps to step S602.
The invention has the beneficial effects that:
the invention can not only ensure the reliability of users, the heterogeneity of users and the heterogeneity of tasks, but also improve the actual benefit of tasks and stimulate more users to finish the tasks with high quality.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flowchart of a method for distributing crowdsourcing tasks based on user reliability in an embodiment of the invention;
FIG. 2 is a flowchart of user screening in an embodiment of the present invention;
FIG. 3 is a flow chart of a first round of allocating users in accordance with one embodiment of the present invention;
FIG. 4 is a flow chart of allocating users from the second round to the first round in accordance with an embodiment of the present invention;
FIG. 5 is a flowchart of updating a user reputation value in accordance with an embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention aims to provide a crowdsourcing task allocation method based on user reliability, which punishs partial selfish users by using a reward mechanism of a credit value aiming at the condition that the task quality of a user is too low, meanwhile awards are given to the users who finish high-quality tasks, and the users who finish the tasks with high quality are preferentially considered in the task allocation of the next stage. In order to make the best effort to ensure that each task can be finished with high quality, each task is distributed to l users to do so, and then the task publisher obtains the maximum benefit. In each distribution stage, the users are distributed in l rounds, each task can be distributed to only one user in each round, and each user is distributed to at most one task in each stage. The method not only considers the previous task completion condition of the user, but also considers the number of the participators of each task, and the first round distributes the users from the task with the least participators, so as to ensure that each task can be distributed to the users as far as possible. In the process of allocating users from the second round to the first round, users are allocated from the task with the lowest user credit value in each round, so that the purpose of balancing the users allocated to each task is to ensure that each task can be completed with high quality as much as possible.
The problem model adopted in the invention is specifically as follows:
assuming that a task publisher publishes n heterogeneous tasks on a crowdsourcing platform, that is, the requirement and the geographic location of each task are different, the set T ═ T1,t2,...,tnRepresents it. Each task tiIncluding a geographic location (x)i,yi) Detailed description of the invention DiAnd offer biAnd D isiIncluding task tiSensing range of, completion task tiSkill requirements and specific content of the task. Wherein the task tiThe geographic position and the perception range of the task mean that the task is effective only when the task is completed within a certain range in a certain place, and the task tiThe quote of (a) refers to the highest reward the task publisher is willing to pay the user. There are m heterogeneous users on the platform, i.e. the capacity of each user is differentFor the same task, the quality of completion is different for different users, using the set W ═ W1,w2,...,wmRepresents it. Each user wjIncluding a geographic location (x)j,yj) Reputation value repjSkill set AjAnd cost of completing the task cj. Where the user omegajThe geographic location of (a) refers to the location where the user is currently located; the reputation value reflects the user wjIn the past, the higher the reputation value is, the higher the quality of the task completed by the user is, and conversely, the lower the quality of the task completed by the user is. The skill set of the user refers to what types of tasks can be completed by the user, and the cost of the user refers to resources such as CPU resources and mobile phone electricity consumed by the user for completing the tasks. In each task allocation phase, each task is allocated to l users to complete, and as long as the users are within the perception range of the task and meet the skill requirements of the task, the users participate in the allocation of the task. Within each task assignment phase, each user is assigned to at most one task. In order to ensure that each task can be distributed to users and completed with high quality as much as possible, the platform reasonably selects the users and distributes the tasks in terms of the number of the users participating in the tasks and the reliability of the users participating in the tasks.
In view of the above problem model, referring to fig. 1, a method for allocating crowdsourcing tasks based on user reliability is disclosed in an embodiment of the present invention, wherein the symbolic descriptions involved in the steps are shown in table 1.
Table 1: are specific descriptions of the symbols in the present invention
Figure BDA0001171311930000081
Figure BDA0001171311930000091
Specifically, the crowd-sourced task allocation method based on user reliability in the embodiment includes the following six steps:
s1, the task publisher publishes n heterogeneous tasks on the crowdsourcing platform, and the set T is ═ T1,t2,...,tnIndicates that there are m heterogeneous users on the crowdsourcing platform, and the set W ═ W1,w2,...,wmRepresents;
s2, starting task allocation, initializing related tasks and user sets, and allocating the completed task sets
Figure BDA0001171311930000092
Set of users assigned to tasks
Figure BDA0001171311930000093
Is in accordance with task tiConditional set of users to be allocated
Figure BDA0001171311930000094
Is assigned to task tiUser set of
Figure BDA0001171311930000096
S3, for each task T in the task set T to be distributediSelecting users meeting the conditions to join the task tiSet of users Wr,iThe purpose of the step is to screen a part of users which do not meet the task requirement, and for the users which meet the task requirement, the platform can select proper users to complete the task according to the following steps;
s4, according to the number | W of users participating in all tasks to be distributed in the set Tr,iI (greater than 0) is arranged in ascending order (from small to large), and then each task t to be distributed is subjected toiSet of users Wr,iThe users in the step (2) are arranged in a descending order according to the user reputation value, and the step aims to ensure that each task can be distributed to the users as far as possible and simultaneously ensure that the tasks can be finished with high quality;
s5, continuing the user allocation from the second round to the first round, in the allocation process of each round, firstly arranging the tasks in the task set T to be allocated according to the user credit values to be allocated in an ascending order, and then traversing each task in the task set T to be allocated, wherein the purpose of the step is to ensure that each task is allocated to the user with high task quality as much as possible, and each task in each round is allocated to one user;
s6, finishing task distribution and finishing the distributed task set Ts=TsU.T. according to the set W of users assigned to the taskrAnd (4) the answers submitted by the users, and the task publisher evaluates the users. The purpose of this step is to update the reputation value of the user according to the evaluation obtained after the user completes the task, so that the platform decides whether to select the user according to the reputation value of the user in the task allocation of the next stage.
Referring to fig. 2, step S3 in this embodiment is specifically:
s301, traversing ith task T in task set T to be distributedi
S302, if i < ═ T |, namely task TiIn the task set T to be distributed, jumping to step S303, otherwise jumping to step S4;
s303, traversing jth user W in user set Wj
S304, if j < ═ W |, i.e. user WjIn the user set W, jumping to step S305, otherwise jumping to step S308;
s305, if the user wjAt task tiAnd satisfies task tiIf so, jumping to step S306, otherwise, jumping to step S307;
s306, conforming to the task tiRequested user wjJoining to a user set Wr,iPerforming the following steps;
s307, continuously traversing the j +1 th user in the user set W, and jumping to the step S304, wherein the purpose of the step is to do no matter the user omegajWhether to meet task tiThe request of (2) continues to traverse the (j + 1) th user in the user set W. (ii) a
S308, conforming to the task tiAnd (4) all the required users are traversed, the (i + 1) th task in the task set T to be distributed is continuously traversed, and the step S302 is skipped.
In step S4, the first round of user assignment is started from the task in the to-be-assigned task set T with the smallest number of users.
Referring to fig. 3, step S4 in this embodiment is specifically:
s401, for each task in the task set to be distributed, if the task requirement is met, the user set W to be distributedr,iIf the number of the tasks is null, that is, no user meets the requirement of the task, the distribution is finished, and the step is skipped to step S6, otherwise, the step is skipped to step S402;
s402, all tasks in the task set T to be distributed are determined according to the number | W of users participating inr,iI (greater than 0) is arranged in an ascending order (from small to large), so that users are distributed from the task with the least number of participating users, and each task can be distributed to the users as far as possible;
s403, for each task t to be distributediSet of users Wr,iThe users in the system are arranged in descending order according to the reputation value so as to distribute the user with the highest reputation value for each task;
s404, traversing the ith task T in the task set T to be distributediInitiating task tiAssigned subscriber identity flagiThis flag is used to determine task tiWhether it has been assigned to a user;
s405, if i < | T |, namely task TiIn the task set T to be distributed, jumping to step S406, otherwise jumping to step S5;
s406, traversing task tiSet of users Wr,iJ (th) user w in (1)j
S407, if j < ═ Wr,iI.e. user omegajIn a user set Wr,iIf yes, go to step S408, otherwise go to step S412;
s408, if the user wjIf the task is not allocated in the stage, jumping to step S409, otherwise jumping to step S410;
s409, processing the task tiIs assigned to user wjFlag, flagi=true,xi,j1 denotes the task tiIs assigned to user wjHold user wjJoining a set of users W assigned to a taskrAnd assigned to task tiSet of users WiAnd user wjFrom task tiTo be allocated user set Wr,iDeleting, and jumping to step S412;
s410, user wjHas been assigned to a task, user wjFrom task tiTo be allocated user set Wr,iDeleting;
s411, continuously traversing the user set Wr,iThe j +1 th user in (1) jumps to step S407. The purpose of this step is to slave task tiTo be allocated user set Wr,iFinding a user that is not assigned to the task;
s412, continuously traversing the (i + 1) th task in the task set T to be distributed, and jumping to the step S405.
As shown in fig. 4, step S5 in this embodiment specifically includes:
s501, starting the h-th round of user allocation, wherein the initial value of h is 2;
s502, for each task in the task set T to be distributed, if the task requirement is met, the user set W to be distributedr,iIf the data are all null, that is, no user meets the requirement of the task, the distribution is finished, and the step is skipped to step S6, otherwise, the step is skipped to step S503;
s503, if h < ═ l, that is, task allocation in this stage has not ended yet, jumping to step S504, otherwise jumping to S6;
s504, for all tasks in the task set T to be distributed, arranging the tasks according to the distributed user reputation values in an ascending order, and traversing the ith task T in the task set T to be distributediThe aim is to ensure that the task which is distributed to the low-quality users in the previous round is distributed to the high-quality users in the round as much as possible;
s505, if i < | T |, namely task TiIn the task set T to be distributed, jumping to step S506, otherwise jumping to step S515;
s506, traversing task tiSet of users Wr,iJ in (1)A user wj
S507, if j < ═ Wr,iI.e. user wjIn a user set Wr,iIf yes, jumping to step S508, otherwise jumping to step S511;
s508, if the user wjIf no task is allocated in this stage, go to step S509, otherwise go to step S510;
s509, task tiIs assigned to user wj,xi,j1 denotes the task tiIs assigned to user wjHold user wjJoining a set of users W assigned to a taskrAnd assigned to task tiUser W ofiAnd user omegajFrom task tiTo be allocated user set Wr,iDeleting, and jumping to step S514;
s510, user wjHas been assigned to a task, user wjFrom task tiTo be allocated user set Wr,iDeleting and continuously traversing the task tiTo be allocated user set Wr,iThe (j + 1) th user, and simultaneously jumping to the step S507;
s511, if the task tiAssigned subscriber identity flagiTrue, i.e. task tiIf the user is already allocated, but no user is next allocated, jumping to step S512, otherwise jumping to step 513;
s512, task tiAssigned to users, and assign task tiJoining to a set T of task assignment completionssAnd the task tiDeleting the task from the set T, continuously traversing the (i + 1) th task in the task set T, and simultaneously jumping to the step S505;
s513, task tiDirectly assigning task t to user without distributing task t to useriDeleting the task set T to be distributed;
s514, continuously traversing the (i + 1) th task in the task set T to be distributed, and jumping to the step S505;
and S515, continuing the h +1 th round of user allocation, and jumping to the step S502.
Steps in this embodimentStep S6 further includes: traverse set WrAccording to user wjCompletion of task tiEvaluation obtained thereafter ei,jBy the formula repr,j=αrepr-1,j+(1-α)2ei,jrepr-1,jUpdating user wjSo that the platform decides whether to select the user according to the reputation value of the user in the task allocation of the next stage.
As shown in fig. 5, step S6 in this embodiment is specifically:
s601, traversing a user set WrThe jth user ω in (1)j
S602, if j < | WrI.e. user wjIn a user set WrIf yes, jumping to step S603, otherwise ending the updating;
s603, the crowdsourcing platform updates the formula rep according to the creditr,j=αrepr-1,j+(1-α)2ei,jrepr-1,jAnd user wjEvaluation obtained ei,jTo user wjUpdating the reputation value of the database;
s604, continuously traversing the user set WrThe j +1 th user, jumps to step S602.
According to the technical scheme, the reliable task allocation method is provided under the conditions that the number of the task participants is small and the selfish characteristic exists in the user. Wherein:
in each task allocation stage, each task is allocated to l users to be completed, the users allocate the tasks in l rounds, each task can be allocated to only one user in each round, and each task is allocated to l users through the allocation in l rounds;
in each task allocation stage, firstly, arranging all tasks to be allocated in an ascending order (from small to large) according to the number of users participating in allocation, and then, arranging all tasks to be allocated in a descending order according to credit values of the users participating in allocation;
the first round of task allocation is to allocate users from the task with the least number of users participating in allocation (the aim is to ensure that the tasks with the least number of users participating in allocation are also allocated to the users as far as possible), and each task in each round can be allocated to only one user;
the assignment of tasks from the second round to the l round is as follows: firstly, arranging all tasks to be distributed in an ascending order according to the distributed user credit values, and distributing users from the task with the minimum value; if the task has no distributable users, deleting the task from the task set to be distributed; in each task allocation stage, once a user is allocated to a task, the user is deleted from a user set to be allocated, and the user cannot be allocated to other tasks in the stage;
and finally, the user submits the task answers to the task publisher, and the task publisher evaluates the user according to the answers submitted by the user. And the platform updates the reputation values of all the users distributed to the tasks according to the evaluation of the task publisher on the users. In the next task allocation phase, all users can participate in the allocation of tasks again.
In conclusion, the invention can not only ensure the reliability of users, the heterogeneity of users and the heterogeneity of tasks, but also improve the actual benefit of tasks and stimulate more users to finish the tasks with high quality.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Furthermore, it should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art should integrate the description, and the embodiments may be combined as appropriate to form other embodiments understood by those skilled in the art.

Claims (3)

1. A crowd-sourced task allocation method based on user reliability, the method comprising:
s1, the task publisher publishes n heterogeneous tasks on the crowdsourcing platform, and the set T is ═ T1,t2,...,tnIndicates that there are m heterogeneous users on the crowdsourcing platform, and the set W ═ W1,w2,...,wmRepresents;
s2, starting task allocation, initializing related tasks and user sets, and allocating the completed task sets
Figure FDA0002964132350000011
User collection assigned to tasks
Figure FDA0002964132350000012
Conforming to task tiConditional set of users to be allocated
Figure FDA0002964132350000013
Assigned to task tiUser set of
Figure FDA0002964132350000014
S3, for each task T in the task set T to be distributediSelecting users meeting the conditions to join the task tiSet of users Wr,iPerforming the following steps;
s4, according to the number | W of users participating in all tasks to be distributed in the set Tr,iI is arranged in ascending order, and then each task t to be distributed isiSet of users Wr,iThe users in the system are arranged in descending order according to the user reputation values;
s5, continuing the user allocation from the second round to the first round, and in the allocation process of each round, firstly arranging the tasks in the task set T to be allocated according to the ascending order of the user credit values to be allocated, and then traversing each task in the task set T to be allocated;
s6, finishing task distribution and finishing the distributed task set Ts=TsUT, set of users W according to assignment to tasksrThe answers submitted by the users, and the task publisher evaluates the users; the step S3 specifically includes:
s301, traversing ith task T in task set T to be distributedi
S302, if i < ═ T |, namely task TiIn the task set T to be distributed, jumping to step S303, otherwise jumping to step S4;
s303, traversing jth user W in user set Wj
S304, if j < ═ W |, i.e. user WjIn the user set W, jumping to step S305, otherwise jumping to step S308;
s305, if the user wjAt task tiAnd satisfies task tiIf so, jumping to step S306, otherwise, jumping to step S307;
s306, conforming to the task tiRequested user wjJoining to a user set Wr,iPerforming the following steps;
s307, continuously traversing the j +1 th user in the user set W, and jumping to the step S304;
s308, conforming to the task tiThe required users are completely traversed, the (i + 1) th task in the task set T to be distributed is continuously traversed, and the step S302 is skipped; the step S4 further includes:
starting first round user allocation from the task with the minimum user number in the task set T to be allocated; the step S4 specifically includes:
s401, for each task in the task set to be distributed, if the task requirement is met, the user set W to be distributedr,iIf the number of the tasks is null, that is, no user meets the requirement of the task, the distribution is finished, and the step is skipped to step S6, otherwise, the step is skipped to step S402;
s402, all tasks in the task set T to be distributed are determined according to the number | W of users participating inr,iI is arranged in ascending order;
s403, for each task t to be distributediSet of users Wr,iThe users in (1) are arranged in descending order according to the reputation value;
s404, traversing the ith task T in the task set T to be distributediInitiating task tiAssigned subscriber identity flagiThis flag is used to determine task tiWhether it has been assigned to a user;
s405, if i < | T |, namely task TiIn the task set T to be distributed, jumping to step S406, otherwise jumping to step S5;
s406, traversing task tiSet of users Wr,iJ (th) user w in (1)j
S407, if j < ═ Wr,iI.e. user omegajIn a user set Wr,iIf yes, go to step S408, otherwise go to step S412;
s408, if the user wjIf the task is not allocated in the stage, jumping to step S409, otherwise jumping to step S410;
s409, processing the task tiIs assigned to user wjFlag, flagi=true,xi,j1 denotes the task tiIs assigned to user wjHold user wjJoining a set of users W assigned to a taskrAnd assigned to task tiSet of users WiAnd user wjFrom task tiTo be allocated user set Wr,iDeleting while jumping to step S411;
s410, user wjHas been assigned to a task, user wjFrom task tiTo be allocated user set Wr,iDeleting;
s411, continuously traversing the user set Wr,iThe (j + 1) th user jumps to step S407;
s412, task tiA user is already allocated in the round of allocation, the (i + 1) th task in the task set T to be allocated is continuously traversed, and the step S405 is skipped; the step S5 specifically includes:
s501, starting the h-th round of user allocation, wherein the initial value of h is 2;
s502, for each task in the task set T to be distributed, if the task requirement is met, the user set W to be distributedr,iIf the data are all null, that is, no user meets the requirement of the task, the distribution is finished, and the step is skipped to step S6, otherwise, the step is skipped to step S503;
s503, if h < l, namely the task allocation in the stage is not finished, jumping to step S504, otherwise jumping to S6, wherein l is the number of users allocated to each task;
s504, for all tasks in the task set T to be distributed, arranging the tasks according to the distributed user reputation values in an ascending order, and traversing the ith task T in the task set T to be distributedi
S505, if i < | T |, namely task TiIn the task set T to be distributed, jumping to step S506, otherwise jumping to step S515;
s506, traversing task tiSet of users Wr,iJ (th) user w in (1)j
S507, if j < ═ Wr,iI.e. user wjIn a user set Wr,iIf yes, jumping to step S508, otherwise jumping to step S511;
s508, if the user wjIf no task is allocated in this stage, go to step S509, otherwise go to step S510;
s509, task tiIs assigned to user wj,xi,j1 denotes the task tiIs assigned to user wjHold user wjJoining a set of users W assigned to a taskrAnd assigned to task tiUser W ofiAnd user wjFrom task tiTo be allocated user set Wr,iDeleting, and jumping to step S514;
s510, user wjHas been assigned to a task, user wjFrom task tiTo be allocated user set Wr,iDeleting and continuously traversing the task tiTo be allocated user set Wr,iThe (j + 1) th user, and simultaneously jumping to the step S507;
s511, if the task tiAssigned subscriber identity flagiTrue, i.e. task tiIf the user is already allocated, but no user is next allocated, jumping to step S512, otherwise jumping to step 513;
s512, task tiAssigned to users, and assign task tiJoining to a set T of task assignment completionssAnd the task tiDeleting the task from the set T, continuously traversing the (i + 1) th task in the task set T, and simultaneously jumping to the step S505;
s513, task tiDirectly assigning task t to user without distributing task t to useriDeleting the task set T to be distributed;
s514, continuously traversing the (i + 1) th task in the task set T to be distributed, and jumping to the step S505;
and S515, continuing the h +1 th round of user allocation, and jumping to the step S502.
2. The method for crowd-sourced task allocation based on user reliability as claimed in claim 1, wherein the step S6 further comprises:
traverse set WrAccording to user wjCompletion of task tiEvaluation obtained thereafter ei,jBy the formula repr,j=αrepr-1,j+(1-α)2ei,jrepr-1,jUpdating user wjAlpha is a weight coefficient of the reputation value.
3. The method for distributing crowdsourcing tasks based on user reliability as claimed in claim 2, wherein the step S6 specifically comprises:
s601, traversing a user set WrThe jth user ω in (1)j
S602, if j < | WrI.e. user wjIn a user set WrIf yes, jumping to step S603, otherwise ending the updating;
s603, the crowdsourcing platform updates the formula rep according to the creditr,j=αrepr-1,j+(1-α)2ei,jrepr-1,jAnd user wjEvaluation obtained ei,jTo user wjUpdating the reputation value of the database;
s604, continuously traversing the user set WrThe j +1 th user, jumps to step S602.
CN201611105342.5A 2016-12-05 2016-12-05 Crowdsourcing task allocation method based on user reliability Active CN106557891B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611105342.5A CN106557891B (en) 2016-12-05 2016-12-05 Crowdsourcing task allocation method based on user reliability

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611105342.5A CN106557891B (en) 2016-12-05 2016-12-05 Crowdsourcing task allocation method based on user reliability

Publications (2)

Publication Number Publication Date
CN106557891A CN106557891A (en) 2017-04-05
CN106557891B true CN106557891B (en) 2021-05-11

Family

ID=58446230

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611105342.5A Active CN106557891B (en) 2016-12-05 2016-12-05 Crowdsourcing task allocation method based on user reliability

Country Status (1)

Country Link
CN (1) CN106557891B (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107230044B (en) * 2017-06-14 2020-12-29 象和文化科技(深圳)有限公司 Method and device for realizing digital media online collaboration data processing and storage equipment
CN109146212B (en) * 2017-06-16 2022-03-25 佛山科学技术学院 Large-scale isomorphic task allocation method in crowdsourcing system
CN107563616A (en) * 2017-08-17 2018-01-09 上海大学 A kind of user task distribution and the quorum-sensing system system and method for incentives strategy
CN108876173B (en) * 2018-06-28 2022-04-01 魏代利 Event realization method and device
CN109101329B (en) * 2018-07-25 2021-02-12 陕西师范大学 Fine-grained task allocation method and system for acquiring data through multiple mobile terminals
CN109522107B (en) * 2018-10-25 2020-11-20 陕西师范大学 Task allocation method and system for space-time constraint
CN109447489B (en) * 2018-11-02 2020-10-30 华东交通大学 Selection method and device of crowd sensing user, electronic equipment and storage medium
RU2743898C1 (en) 2018-11-16 2021-03-01 Общество С Ограниченной Ответственностью "Яндекс" Method for performing tasks
RU2744032C2 (en) 2019-04-15 2021-03-02 Общество С Ограниченной Ответственностью "Яндекс" Method and system for determining result of task execution in crowdsourced environment
CN110097277B (en) * 2019-04-28 2021-10-08 北京交通大学 Time window-based crowdsourcing task dynamic allocation method
RU2744038C2 (en) 2019-05-27 2021-03-02 Общество С Ограниченной Ответственностью «Яндекс» Method and a system for determining the result of a task in the crowdsourcing environment
RU2019128272A (en) 2019-09-09 2021-03-09 Общество С Ограниченной Ответственностью «Яндекс» Method and System for Determining User Performance in a Computer Crowdsourced Environment
RU2019135532A (en) 2019-11-05 2021-05-05 Общество С Ограниченной Ответственностью «Яндекс» Method and system for selecting a label from a plurality of labels for a task in a crowdsourced environment
RU2020107002A (en) 2020-02-14 2021-08-16 Общество С Ограниченной Ответственностью «Яндекс» METHOD AND SYSTEM FOR RECEIVING A LABEL FOR A DIGITAL PROBLEM PERFORMED IN A CROWDSORING ENVIRONMENT
CN111738576B (en) * 2020-06-10 2023-08-01 中北大学 Fair crowdsourcing workflow distribution method

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104463424A (en) * 2014-11-11 2015-03-25 上海交通大学 Crowdsourcing task optimal allocation method and system
CN105976205A (en) * 2016-05-04 2016-09-28 南京邮电大学 Crowdsourcing sensing method and system for quality sensitive geographical regional information

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104463424A (en) * 2014-11-11 2015-03-25 上海交通大学 Crowdsourcing task optimal allocation method and system
CN105976205A (en) * 2016-05-04 2016-09-28 南京邮电大学 Crowdsourcing sensing method and system for quality sensitive geographical regional information

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
《A Crowdsourcing Worker Quality Evaluation Algorithm on MapReduce for Big Data Applications》;Depeng Dang等;《Proceedings of the 2015 IEEE 12th International Conference on Mobile Ad Hoc and Sensor Systems. Washington,DC: IEEE Computer Society’2015》;20160731;全文 *
《Dynamic Participant Recruitment of Mobile Crowd Sensing for Heterogeneous Sensing Tasks》;Hanshang Li等;《Proceedings of the 2015 IEEE 12th International Conference on Mobile Ad Hoc and Sensor Systems. Washington,DC: IEEE Computer Society,2015:》;20151231;正文第II-IV节 *
《一种面向众包的基于信誉值的激励机制》;芮兰兰等;《电子与信息学报》;20160731;全文 *
李勇军等.软件"众包"任务分配方法.《计算机系统应用》.2015, *
软件"众包"任务分配方法;李勇军等;《计算机系统应用》;20150228;正文第1-3节 *

Also Published As

Publication number Publication date
CN106557891A (en) 2017-04-05

Similar Documents

Publication Publication Date Title
CN106557891B (en) Crowdsourcing task allocation method based on user reliability
CN109068288B (en) Method and system for selecting mobile crowd sensing incentive mechanism based on multi-attribute user
US20140162781A1 (en) System and method for building in groups
Kim et al. A shared parking model in vehicular network using fog and cloud environment
Iosifidis et al. Challenges in auction theory driven spectrum management
CN110741402A (en) System and method for capacity scheduling
CN103747096A (en) Scheme for sharing traffic between terminals
JP6003116B2 (en) Joint work setting support device, program, and joint work setting support system
CN113037876B (en) Cooperative game-based cloud downlink task edge node resource allocation method
CN111405527A (en) Vehicle-mounted edge computing method, device and system based on volunteer cooperative processing
CN108200610A (en) Take the intelligent perception resource allocation methods of distributed game
CN113377516B (en) Centralized scheduling method and system for unloading vehicle tasks facing edge computing
CN105631717A (en) Cost performance real-time bidding method and device
Chakraborty et al. QoS-aware dynamic cost management scheme for sensors-as-a-service
Liu et al. Truthful online double auctions for mobile crowdsourcing: An on-demand service strategy
Chen et al. Stable job assignment for crowdsourcing
JP2018023673A (en) Program and system
Huang et al. Hybrid market-based resources allocation in mobile edge computing systems under stochastic information
de Lucena Falcão et al. Enhancing fairness in P2P cloud federations
Zhou et al. Dynamic pricing in profit-driven task assignment: a domain-of-influence based approach
CN111885551A (en) Selection and allocation mechanism of high-influence users in multi-mobile social network based on edge cloud collaborative mode
CN107295526B (en) Stable matching algorithm-based frequency spectrum allocation method for ensuring lower limit of demand
JPWO2016203688A1 (en) Video game processing program and video game processing system
CN114970990A (en) Business travel recommendation method, device and medium
Gollapudi et al. You get what you share: Incentives for a sharing economy

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant