KR102155793B1 - Method and apparatus for managing worker's unit price of crowdsourcing based project for artificial intelligence training data generation - Google Patents

Abstract

Provided are a method and apparatus for managing work cost of a crowdsourcing-based project for generating artificial intelligence learning data. According to the present invention, the method, in managing the work cost of the crowdsourcing-based project which requires physical movement of workers, comprises the steps of: opening multiple works corresponding to multiple locations of the crowdsourcing-based project; identifying the shortest time required for a specific cycle of the project; and determining a real-time work cost of the specific cycle of the project based on the shortest time required for the work.

Description

A method and device for managing the work cost of a crowdsourcing-based project for generating artificial intelligence learning data {METHOD AND APPARATUS FOR MANAGING WORKER'S UNIT PRICE OF CROWDSOURCING BASED PROJECT FOR ARTIFICIAL INTELLIGENCE TRAINING DATA GENERATION}

The present invention relates to artificial intelligence learning data generation, and more particularly, to a method and apparatus for managing work cost of a crowdsourcing-based project.

Recently, more and more companies collect and process large amounts of data on a crowdsourcing basis that engages the general public in some process of corporate activities. In other words, by opening a project and allowing the general public, that is, workers and inspectors to participate in the project, necessary information (result data) is collected.

And, in order to collect more reliable information, the company assigns the results of work completed by the worker to the inspector to perform the inspection.

Specifically, when one project is opened, each task is assigned to a plurality of workers. Each worker performs a plurality of tasks assigned to it, and provides the task results.

Thereafter, a plurality of inspectors are assigned an inspection task for each work result, and each inspector performs a plurality of assigned inspections.

On the other hand, in the case of a project that collects source data or processes source data such as data annotation, the difficulty of the project may increase over time because workers perform easy tasks first.

However, in a situation where the difficulty level is increasing, if the work unit price of the worker is kept the same as the initial project, the worker's willingness to work is lost, resulting in a problem that the speed of work progress is slowed down or the progress itself is not performed.

Therefore, it is necessary to correct and reflect the work unit cost of the worker according to the difficulty level in the process of the project.

Unexamined Patent Publication No. 10-2014-0095956, 2014.08.04.

The problem to be solved by the present invention is to provide a method and apparatus for managing work cost of a crowdsourcing-based project.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

A method of managing work unit cost according to an aspect of the present invention for solving the above-described problem is, in a method of managing work unit cost of a crowdsourcing-based project requiring physical movement of workers, a plurality of locations of a crowdsourcing-based project Opening a plurality of tasks corresponding to, identifying a shortest working time required for a specific cycle of the project, and determining a real-time work cost of the specific cycle of the project based on the shortest working time required. Including, the step of identifying the shortest work required time, the work completion time of the n-1th task of each worker participating in the project during the specific period and the nth task performed following the n-1th task Calculating the time required for the work of the n-th task using the work completion time (where n is 2 or more and less than the number of tasks completed by the operator during the specific period), and all completed during the specific period And identifying the shortest time required for all tasks of the worker.

A computer program according to another aspect of the present invention for solving the above-described problems is combined with a computer, which is hardware, to execute the method for managing the unit cost of work of the crowdsourcing-based project, and is stored in a computer-readable recording medium.

An apparatus for managing work unit cost according to another aspect of the present invention for solving the above-described problem is an apparatus for managing work unit cost of a crowdsourcing-based project requiring physical movement of a worker. Sending a plurality of jobs corresponding to the positions to a plurality of workers, receiving a plurality of job results from the plurality of workers, transmitting a plurality of job results received from the plurality of workers to a plurality of inspectors, and the plurality of A communication module that receives a plurality of inspection results from an inspector, a memory in which a program for determining the real-time work unit cost of a project is stored as the physical movement of the worker is required, and the crowdsourcing by executing a program stored in the memory. Open a plurality of tasks corresponding to a plurality of locations of the base project, identify the shortest work required time of the specific cycle of the project, and determine the real-time work unit cost of the specific cycle of the project based on the shortest work time required Including a processor, wherein the identification of the shortest time required for the task may include a task completion time of each worker participating in the project during the specific period and a task completion time of the n-1 th task and a completed n th task following the n-1 th task. Calculate the time required for the nth task using the task completion time of the task (where n is 2 or more and less than the number of tasks completed by the operator during the specific cycle), and all completed during the specific cycle It includes identifying the shortest time required for all tasks of the operator.

Other specific details of the present invention are included in the detailed description and drawings.

According to any one of the solving means of the problem of the present invention described above, since the time required for work is calculated in consideration of the time required for the actual work of the worker and the moving time required to perform the work, and this is reflected in the work unit cost, As the physical movement of the worker is required, even if the difficulty of work increases, it is possible to motivate the worker.

In addition, even if the difficulty of work continues to increase, it is possible to maintain the required speed until completion of the project by periodically correcting the work unit cost in the process of the project.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a conceptual diagram of a crowdsourcing service according to an embodiment of the present invention.
2 is a flowchart illustrating a crowdsourcing-based project progress process according to an embodiment of the present invention.
3 is a flowchart of a crowdsourcing-based project cost management method according to an embodiment of the present invention.
4 is a diagram for explaining an example of a project requiring physical movement of a worker in an embodiment of the present invention.
5 is a view for explaining the problem of work unit cost in a project requiring physical movement of workers.
6 is a diagram for describing an example of determining a real-time work unit cost.
7 is a diagram for explaining a crowdsourcing-based project unit cost management apparatus according to an embodiment of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms, only the present embodiments are intended to complete the disclosure of the present invention, It is provided to fully inform the technician of the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used in the specification, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements. Throughout the specification, the same reference numerals refer to the same elements, and “and/or” includes each and all combinations of one or more of the mentioned elements. Although "first", "second", and the like are used to describe various elements, it goes without saying that these elements are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical idea of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram of a crowdsourcing service according to an embodiment of the present invention.

Referring to FIG. 1, a crowdsourcing service is performed by being composed of a client 10, a service provider 20, and a public 30.

The sponsor 10 refers to a company or individual who requests a crowdsourcing-based project (hereinafter, referred to as a project).

The requester 10 requests a project for the purpose of collecting source data or annotating data for generating artificial intelligence learning data. The data generated through the project can be used as learning data for arbitrary machine learning such as supervised learning, unsupervised learning, and reinforcement learning. Collection of source data refers to collecting raw data such as recorded voice collection and photo collection. Data annotation refers to inputting relevant annotation data into source data such as text, photos, and videos. For example, the data annotation may include finding an entity in a given fingerprint or finding a similar sentence, but is not limited thereto. Meanwhile, the types of the above-described projects are only one embodiment, and various projects may be handled in the present invention according to the design of the client.

The service provider 20 refers to a company that provides crowdsourcing services.

When the service provider 20 receives a request for a project for a product or service from the client 10, the service provider 20 allocates a task for the project to the general public 30 and receives the work result from the public 30. Thereafter, the final product extracted based on the work result is provided to the client 10.

At this time, the service provider 20 provides a crowdsourcing service to the client 10 and the public 30 through a crowdsourcing platform (hereinafter, the platform). That is, when the service provider 20 receives a request for a project from the client 10, the service provider 20 opens the project on the platform. Thereafter, when the work result for the open project is received from the public 30, the project is terminated on the platform, and the final product may be extracted and provided to the client 10.

The public 30 refers to the general public participating in the project open on the platform. Here, the public 30 may participate in a project opened on the platform through an application or website provided by the service provider 20.

The public 30 is composed of a worker 32 and an inspector 34.

The worker 32 decides to participate in a specific project among a plurality of projects open on the platform. Thereafter, the operator 32 performs an operation such as collection of source data or data annotation, and transmits it to the platform.

The inspector 34 decides to participate in a specific project among a plurality of projects open on the platform. Thereafter, the inspector 34 inspects the result of the work performed by the operator 32. As a result of performing the inspection, the inspector 34 may perform inspection pass processing or rejection processing, and may input a rejection reason when rejecting the job. In the case of passing the inspection, it is not necessary to rework and re-examination due to this, so passing inspection has the same meaning as completion of inspection.

2 is a flowchart illustrating a crowdsourcing-based project progress process according to an embodiment of the present invention.

First, the requester 10 requests one or more projects to the service provider 20 (S11).

Thereafter, the service provider 20 opens the requested project on the platform (S12). At this time, the service provider 20 may determine the grade in consideration of the difficulty of the project before opening the project. That is, depending on the difficulty level, it is possible to determine which level or higher public 30 to expose the project. Accordingly, it is possible to increase the reliability of the work result of the project.

Thereafter, the service provider 20 allocates a task to the workers 32 of the corresponding grade or higher according to the grade of the project (S13).

Thereafter, the worker 32 performs the assigned task (S14). In this case, the worker 32 may input the reason for the inability to work without performing the work for a work in which the work itself is impossible for some reason.

Thereafter, the service provider 20 receives the work result from the worker 32 (S15), and allocates the inspection work for the work result to the inspector 34 (S16).

Thereafter, the inspector 34 performs the assigned inspection (S17). At this time, the inspector 34 determines completion of the inspection when it is determined that the work has been properly performed, and determines rejection when it is determined that the inspection work is wrong. When deciding to reject, the inspector 34 inputs the rejection reason for what reason the task was judged to be wrong.

Thereafter, the service provider 20 receives the inspection result from the inspector 34 (S18).

When the inspection result is the inspection completion, the service provider 20 uses the work result as valid data, and based on this, extracts the final product at the end of the project.

When the inspection result is rejection processing, the service provider 20 may internally perform the inspection again or assign the job to the worker 32 again to perform the job.

Thereafter, when the project period ends or sufficient valid data is secured, the service provider 20 terminates the project (S19), calculates a final result based on the secured valid data, and provides it to the client 10 ( S20).

At this time, before the end of the project, the service provider 20 evaluates the performance results of the worker 32 and the inspector 34, calculates the work cost and the inspection cost according to the evaluation, to the worker 32 and the inspector 34. give.

Meanwhile, in FIGS. 1 and 2, the client 10, the service provider 20, the worker 32, and the inspector 34 are simply expressed, but these are smartphones, tablets, PDAs, and laptops operated by each participant. It means a computer device or a telecommunication device such as a desktop or a server.

3 is a flowchart of a method for managing a unit of work according to an embodiment of the present invention. 4 is a diagram for explaining an example of a project requiring physical movement of a worker in an embodiment of the present invention. 5 is a view for explaining the problem of work unit cost in a project requiring physical movement of workers. 6 is a diagram for describing an example of determining a real-time work unit cost.

Meanwhile, the steps shown in FIG. 3 may be understood as being performed by a platform server (hereinafter, referred to as a server) operated by the service provider 20, but are not limited thereto.

In addition, a plurality of workers 32 or a plurality of inspectors 34 perform work using a predetermined terminal device. Terminal devices of the operator 32 and the inspector 34 may be a computer device or a telecommunication device such as a smart phone, tablet, PDA, laptop, desktop, etc., but is not limited thereto.

First, referring to FIG. 3, the server opens a plurality of tasks of one crowdsourcing-based project (S110).

Here, one project consists of a plurality of data sets, and one data set contains a plurality of tasks. The plurality of jobs may be grouped into a plurality of tasks according to types, or each job may be a different type of job or the same job, but is not limited thereto.

In one embodiment, the project in the present invention may be a project that performs a predetermined task assigned to each of a plurality of predefined locations outdoors.

That is, unlike the general case in which a worker performs a work through a computer or a mobile terminal at a fixed indoor location desired by a worker, the project in the present invention is a case where the work can be performed only at a predetermined location outdoors. Thus, the project of the present invention is characterized by being affected by the uncontrollable physical environment of the worker.

As an example of the above project, the worker 32 may perform a task of collecting a target image from a predetermined outdoor location using the terminal of the worker 32 and transmitting it to the server.

Referring to FIG. 4, as an example, the worker 32 is a sign image of a corresponding point in a mutually "Fighting Master Daechi Point" building located at a specific location, "Seongchang Building 1F 2, 989-2 Daechi 2-dong, Gangnam-gu, Seoul" You can do the job of shooting it.

In order to perform such an operation, the operator 32 must first move to the corresponding position. In this case, in order to record the exact location at which the work is performed on the terminal of the worker 32, a process of checking whether the corresponding location is correct on the work page as shown in FIG. 4A may be performed.

After recording whether or not the location is correct, as shown in FIG. 4B, the worker 32 records information necessary for work, such as branch name or business type information, and then clicks the'take photo' button to take a signboard picture.

After taking the picture, the taken picture is output on the job page as shown in Fig. 4(c), and the operator 32 determines whether the taken picture and recorded related information are appropriate as the job result, and then clicks the'Cancel' button. Edit or retake the information, or submit the result to the server through the'Save' button.

Meanwhile, since a project including a task as shown in FIG. 4 includes a plurality of corresponding tasks, the worker 32 must perform a plurality of tasks.

However, in the case of a project as shown in FIG. 5 in which one work can be performed per pin (location), workers 32 can work per hour at the beginning because most of the areas (A) with high pin density are performed at the beginning. The number of cases is large, but as time passes, the density of pins decreases, such as in (B) or (C).

Workers 32 can perform many tasks with a small moving distance in the (A) area, but moving to the (B) area or (C) area to perform the remaining work increases the moving time.

This eventually leads to lower profits that can be earned per hour for the worker 32. And, this lowers the participation of the worker 32 and acts as a cause of delaying the progress of the project.

In order to solve this problem, an embodiment of the present invention calculates the time required for work in consideration of the physical movement of the worker 32 and reflects it to the work unit price in real time to increase the motivation for the worker 32 to perform the work, You can keep the pace of the whole project going or make it go faster.

Referring back to FIG. 3, the server identifies the shortest work required time of a specific period of the project (S120), and determines a real-time work unit cost of the specific period of the project based on the shortest work required time (S130). As a result, different work costs may be applied for each cycle.

Here, in order to identify the shortest work required time, the server is the work completion time of the n-1th task of each worker participating in the project during a specific period and the work completion time of the nth task performed following the n-1th task The time required for the n-th operation is calculated using. However, n is 2 or more and less than or equal to the number of tasks each worker has completed during a specific period.

In addition, the server identifies the shortest time required for all tasks of all workers completed during a specific period.

The n-1th task and the nth task mean tasks that have been continuously performed and completed.

For example, if a worker 32 has performed and completed three tasks during a specific period, the time required for the second task is calculated using the completion time of the first task and the completion time of the second task. Further, the time required for the third task is calculated using the completion time of the second task and the completion time of the third task.

For other examples, if any other worker 32 has completed five tasks during a specific period, the second task, the third task, the fourth task, and the fifth task are each calculated in the same way.

That is, the required time of the remaining tasks except for the first task that all the workers 32 have performed for the first time during a specific period are calculated.

To this end, an embodiment of the present invention records the actions of the worker 32 while performing the task of the worker 32. Specifically, the server may record the time when the worker 32 enters the page for performing the work, and record the time to input the work completion after completing the work. For example, the time when a specific pin (location) on the map of FIG. 4(a) is selected is recorded, and the time at which the job result is submitted to the server by clicking the save button of FIG. 4(c) is recorded.

Accordingly, the task completion time of the n-1th task described above refers to a time when a task completion is input in relation to the n-1th task by the worker 32. The task completion time of the n-th task similarly refers to a time when a task completion is input in relation to the n-th task by the worker 32.

The server uses the recorded work completion time in calculating the work required time of the nth work.

In an embodiment, the time required for the operation of the nth task may be calculated through a difference between the task completion time of the n-1th task and the task completion time of the nth task.

In addition to the time required to perform the actual work, the calculated time required for work may include a break time for some workers, and thus may vary for each individual worker or for each individual task. Accordingly, the time required for work in an embodiment of the present invention may be calculated on the assumption that at least one worker who participated in the project during a specific period has performed and completed the work continuously without a break, as will be described later.

In this case, the calculated time required for the work may include not only a break time but also a moving time from the n-1 th position to the n th position. The n-1th position denotes a position capable of performing the n-1th operation, and the nth position denotes a position corresponding to the nth operation. The time required for a task can also be defined as the time required to perform the task.

Referring to FIG. 6, the first job at the first position of worker A started at 15:00 and completed at 15:10, and the second job at the second position started at 16:00 and 16 It was completed at 10 minutes.

Here, the time required for the second operation is calculated as 1 hour, which is a deviation from 16:10 to 15:10.

On the other hand, the time required for the third task is calculated as 40 minutes, which is a deviation from 16:50 to 16:10.

As described above, the calculated time required for the second task and the time required for the third task include the moving time of the worker A for the corresponding task.

The server determines the real-time work unit cost of a specific period based on the time required for all jobs of all workers collected for a specific period.

In one embodiment, the server may identify the shortest time required for work based on the result of the inspection completed every predetermined period (eg, 24 hours) among the time required for work of a plurality of workers. Regarding the work that has not been inspected or rejected, the time required for the work may not be considered in identifying the shortest work time required.

For example, if the shortest time required for each worker A, B, and C during a specific period is 15 minutes, 20, and 30 minutes (there will be a number of time required for various tasks calculated for each worker, but omitted for convenience of explanation) ), the 15 minutes calculated in relation to worker A is identified as the shortest time required for a specific cycle.

If the initial work cost was set on the premise of 10 minutes, by changing it based on 15 minutes as above, it is possible to adequately compensate the physical travel time and prevent excessive increase in the work cost due to abusing. .

The predetermined period at which the shortest time required for work is determined and updated may be based on a time (for example, 24 hours), but is not limited thereto, and the shortest time required for work is determined according to the time when a predetermined number of work results are inspected and completed. You can also decide and update.

The server may determine a real-time work unit cost for a plurality of workers 32 of a specific period based on the shortest work required time.

As described above, the present invention assumes that at least one of the workers who participated in the project during a specific period has continuously performed and completed a plurality of tasks without a break. Only then can only travel time and actual work execution time be considered. In addition, there may be a difference in travel time depending on the physical environment of the worker and the means of transportation, and there may be differences in individual break time such as toilet use or smoking, but considering all of this is a concern for abusing, so the shortest time required for work Is used to determine the unit cost of work in real time. It is assumed that someone's worker who recorded the shortest duration of work in a particular cycle would have moved to the next location quickly and performed the task without a break.

In an embodiment, the server may determine a real-time work unit cost for a plurality of workers 32 in a specific period based on a reference cost per unit time and the shortest work required time in a specific period.

For example, targeting a task that has been inspected every 24 hours at a predetermined cycle, the shortest work required time of the cycle is identified, and the corresponding cycle based on the standard cost per unit time and the shortest work required time of the cycle according to Equation 1 Can determine the real-time operation unit price

[Equation 1]

Real-time work unit cost = standard cost per unit time/(1 hour/shortest time required for specific cycle)

For example, here, if the standard cost per unit time is 10,000 won, and the shortest time required for a corresponding cycle is 30 minutes, the real-time work unit cost may be calculated as 5,000 won. If the shortest time required for the next cycle is 1 hour, the real-time work unit cost may be calculated as 10,000 won.

In another embodiment, the server determines a real-time work cost for a plurality of workers 32 in a specific cycle based on the initial work cost, the shortest work required time in the first cycle, and the shortest work time required in a specific cycle. I can.

For example, targeting the work that has been inspected every 24 hours at a predetermined cycle, the shortest work required in the first cycle is calculated as 1 hour, and the initial work unit cost is 10,000 won, and the shortest work required time in the current cycle is If calculated as 15 minutes, according to Equation 2, the real-time work unit cost can be calculated as 2,500 won. That is, the real-time work unit cost may be determined not only high but also low compared to the previous cycle. If the shortest time required for the next cycle is calculated as 1 hour and 30 minutes, the real-time work unit price may be calculated as 15,000 won.

[Equation 2]

Real-time work unit cost = initial work unit cost/(shortest work time required for the first cycle/shortest work time required for a specific cycle)

Here, the initial unit cost may be set in advance by the pilot project.

As described above, one embodiment of the present invention compensates for the disadvantages of the workers 32 by increasing the real-time work cost even if the distance to be moved to the next location to perform the next task is relatively long after completing the task at the current location. I can.

On the other hand, unlike the above-described ideally, the real-time work cost may increase or decrease for each predetermined period depending on the degree of participation of the workers 32, the skill level of the workers 32 participating in a specific cycle of the project, and differences in physical environment. Of course you can.

Meanwhile, in the above description, steps S11 to S150 may be further divided into additional steps or may be combined into fewer steps according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order between steps may be changed. In addition, even if other contents are omitted, the contents of FIG. 7 to be described later may also be applied to the method of managing the work unit cost of FIGS. 1 to 6.

Hereinafter, an apparatus 100 for managing a unit of work according to an embodiment of the present invention will be described with reference to FIG. 7.

7 is a view for explaining a work unit cost management apparatus according to an embodiment of the present invention.

Referring to FIG. 7, the unit of work cost management apparatus 200 includes a communication module 210, a memory 220, and a processor 230.

The communication module 210 transmits a plurality of tasks corresponding to a plurality of locations of one crowdsourcing-based project to a plurality of workers 32 to request the task to be performed, and receives a plurality of task results from the plurality of workers 32. Receive. In addition, the plurality of work results received from the plurality of workers 32 are transmitted to the plurality of inspectors 34 to request inspection, and the plurality of inspection results are received from the plurality of inspectors 34.

The memory 220 stores a computer program for determining and managing a real-time work unit cost of a project according to the need for physical movement of a worker based on data received from the communication module 210.

The processor 230 executes a computer program stored in the memory 220. The computer program includes instructions for executing the above-described work unit cost management method. As the processor 230 executes the program stored in the memory 220, it opens a plurality of tasks corresponding to a plurality of locations of a crowdsourcing-based project, and identifies the shortest time required for a specific period of the project, A real-time work unit cost of a specific cycle of the project is determined based on the shortest work required time. Identifying the shortest time required for work is as described in connection with the method for managing the unit cost of work.

The unit of work cost management apparatus 200 described with reference to FIG. 7 may be provided as a component of the above-described server.

The above-described method for managing a unit of work according to an embodiment of the present invention may be implemented as a computer program (or application) and stored in a computer-readable recording medium to be executed by being combined with a computer as hardware.

The above-described program includes C, C++, JAVA, Ruby, which can be read by a processor (CPU) of the computer through the device interface of the computer, in order for the computer to read the program and execute the methods implemented as a program. It may include a code (Code) coded in a computer language such as machine language. Such code may include a functional code related to a function that defines necessary functions for executing the methods, and includes a control code related to an execution procedure necessary for the processor of the computer to execute the functions according to a predetermined procedure. can do. In addition, these codes may further include additional information required for the processor of the computer to execute the functions, or code related to a memory reference to which location (address address) of the internal or external memory of the computer should be referenced. have. In addition, when the processor of the computer needs to communicate with any other computer or server in the remote in order to execute the functions, the code uses the communication module of the computer to determine how It may further include a communication-related code for whether to communicate, what kind of information or media should be transmitted and received during communication.

The stored medium is not a medium that stores data for a short moment, such as a register, cache, memory, etc., but a medium that stores data semi-permanently and can be read by a device. Specifically, examples of the storage medium include, but are not limited to, ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like. That is, the program may be stored in various recording media on various servers to which the computer can access, or on various recording media on the user's computer. In addition, the medium may be distributed over a computer system connected through a network, and computer-readable codes may be stored in a distributed manner.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains can understand that it is possible to easily transform it into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

10: Client
20: service provider
30: public
32: worker
34: inspector
200: work unit cost management device
210: communication module
220: memory
230: processor

Claims (10)

As a method performed by a computer,
In a crowdsourcing-based project cost management method that requires physical movement of workers to perform work,
Opening a plurality of tasks corresponding to a plurality of predefined locations in which one crowdsourcing-based project (hereinafter, "project") can perform tasks;
Identifying the shortest time required for a specific period of the project; And
And determining a real-time work unit cost of the specific cycle of the project based on the shortest work required time,
The step of identifying the shortest operation required time,
The working time required for the n-th task using the work completion time of each worker participating in the project during the specific period and the work completion time of the n-th task performed following the n-1 task Calculating (wherein n is 2 or more and less than or equal to the number of tasks completed by the operator during the specific period),
Including the step of identifying the shortest time required for all the tasks of all workers completed during the specific period,
The operator can perform only one operation per one predetermined position,
The time required for the operation of the nth operation is a time required to actually perform the nth operation from the n-1th position corresponding to the n-1th operation to the nth position corresponding to the nth operation Including time and operator breaks,
It is assumed that at least one worker who participated in the project during the specific period has performed two or more tasks in succession without a break,
The real-time work unit price of the specific period of the project is corrected to be higher or lower than the real-time work unit price of the previous period and is determined,
How to manage unit cost for crowdsourced projects. delete delete The method of claim 1,
The step of identifying the shortest operation required time,
Recording a job completion input time related to the n-1th job by the operator as a job completion time of the n-1th job,
Further comprising the step of recording a job completion input time related to the n-th job by the operator as a job completion time of the n-th job,
How to manage unit cost for crowdsourced projects. The method of claim 1,
The step of determining the real-time work unit cost,
Determining a real-time work unit cost of the specific cycle of the project based on a reference cost per unit time and the shortest work required time of the specific cycle,
How to manage unit cost for crowdsourced projects. The method of claim 1,
The step of determining the real-time work unit cost,
Determining the real-time work unit cost of the specific cycle of the project based on the initial work unit price, the shortest work required time of the first cycle, and the shortest work time required of the specific cycle,
How to manage unit cost for crowdsourced projects. delete The method of claim 1,
The project includes a plurality of tasks of collecting target images of a plurality of predefined locations outdoors,
How to manage unit cost for crowdsourced projects. A computer program stored in a computer-readable recording medium in order to execute the method of managing work cost of a crowdsourcing-based project according to any one of claims 1, 4 to 6, and 8 in combination with a computer as hardware. In the work unit cost management device for a crowdsourcing-based project that requires physical movement of workers to perform work,
When a plurality of jobs corresponding to a plurality of pre-designated locations in which a job of one crowdsourcing-based project (hereinafter, “project”) can be performed are opened, the plurality of jobs are transmitted to a plurality of workers, and from the plurality of workers A communication module receiving a plurality of work results, transmitting a plurality of work results received from the plurality of workers to a plurality of inspectors, and receiving a plurality of inspection results from the plurality of inspectors;
A memory storing a program for determining a real-time work unit cost of a project according to the need for physical movement of the worker to perform work; And
As the program stored in the memory is executed, a plurality of tasks corresponding to a plurality of pre-designated locations of the project are opened, the shortest work required time of a specific cycle of the project is identified, and the shortest work time required And a processor that determines the real-time work unit cost of the specific period of the project,
Identifying the shortest operation time required,
The working time required for the n-th task using the work completion time of each worker participating in the project during the specific period and the work completion time of the n-th task performed following the n-1 task (However, n is 2 or more and less than or equal to the number of tasks completed by the operator during the specific period),
Including identifying the shortest work required time for all tasks of all workers completed during the specific period,
The operator can perform only one operation per one predetermined position,
The time required for the operation of the nth operation is a time required to actually perform the nth operation from the n-1th position corresponding to the n-1th operation to the nth position corresponding to the nth operation Including time and operator breaks,
It is assumed that at least one worker who participated in the project during the specific period has performed two or more tasks in succession without a break,
The real-time work unit price of the specific period of the project is corrected to be higher or lower than the real-time work unit price of the previous period and is determined,
Unit cost management device for crowdsourced projects.

Images