KR102244705B1 - Method for controlling worker inflow into project by reversal adjustment of work unit price between crowdsourcing based similar projects for training data generation - Google Patents

Abstract

The present invention relates to a method for controlling worker inflow by work unit price reversal adjustment between crowdsourcing-based similar projects for artificial intelligence training data generation. The method, which is executed by a computer, includes: a step of classifying crowdsourcing-based projects (hereinafter, projects) including the same type of functional element into a first project having a first difficulty level and a second project having a second difficulty level higher than the first difficulty level; a step of setting a work unit price by project such that an initial work unit price of the first project is higher than an initial work unit price of the second project; a step of decreasing the work unit price of the first project by a preset first amount each time an actual work amount of the first project is accumulated by a predetermined first ratio of a target work amount of the first project; and a step of increasing the work unit price of the second project by a preset second amount so as to correspond to the decrease in the work unit price of the first project. The work unit price of each project is adjusted such that a final work unit price of the first project is lower than a final work unit price of the second project.

Description

{METHOD FOR CONTROLLING WORKER INFLOW INTO PROJECT BY REVERSAL ADJUSTMENT OF WORK UNIT PRICE BETWEEN CROWDSOURCING BASED SIMILAR PROJECTS FOR TRAINING DATA GENERATION}

The present invention relates to a method for controlling worker inflow by reversing work cost of similar projects based on crowdsourcing for generating artificial intelligence learning data.

Recently, more and more companies collect and process large amounts of data on a crowdsourcing basis that engages the general public in some process of corporate activities. In other words, by opening a project and allowing the general public, that is, workers to participate in the project, necessary information is collected through the results of work completed by the workers.

At this time, in order to collect more reliable information, the company assigns the work result completed by the worker to the inspector to perform the inspection work.

Specifically, when one project is opened, a plurality of tasks are assigned to each of the plurality of workers. Each worker performs a plurality of tasks assigned to it, and provides the task results. Thereafter, a plurality of inspection tasks for the work results are assigned to each of the plurality of inspectors, and each inspector performs the assigned plurality of inspection tasks.

On the other hand, when multiple projects are being carried out at the same time, workers on the crowdsourcing platform prefer to participate in easy projects with relatively low difficulty. This is because the easier the project, the easier the operator can learn the work method, allowing for quick adaptation, and the lower the rejection rate of work results. The preference of workers according to the difficulty of these tasks eventually leads to a shortage of the number of workers in the project with high difficulty, resulting in the project being terminated without achieving the target amount of work. Therefore, when a plurality of projects are carried out at the same time, there is a need for a solution to the distraction of workers.

In addition, among a plurality of projects that are open and in progress at the same time, if a new worker without work experience repeatedly participates in a difficult project with high difficulty from the beginning, it will have a bad impression of the crowdsourcing platform. In the end, if such a situation occurs frequently, the frequency of revisiting the crowdsourcing platform of new workers decreases, resulting in not being able to secure enough workers on the crowdsourcing platform. Therefore, there is a need for a way to induce new workers to participate in projects with high difficulty after performing tasks by participating in easy projects with low difficulty even without the involvement of the project manager.

Unexamined Patent Publication No. 10-2014-0095956, 2014.08.04.

The problem to be solved by the present invention is to provide a method for controlling the influx of workers by reversing the work cost of similar projects based on crowdsourcing for generating artificial intelligence learning data.

However, the problem to be solved by the present invention is not limited to the problem as described above, and other problems may exist.

In order to solve the above-described problem, the method of controlling worker inflow through reversal control of the work unit cost of a similar project based on crowdsourcing according to an aspect of the present invention is a method performed by a computer, and includes a plurality of crowds including functional elements of the same type. Classifying a sourcing-based project (hereinafter, "project") into a first project having a first difficulty level and a second project having a second difficulty level higher than the first difficulty level, 2 Setting the work unit cost of each project to be higher than the initial work unit cost of the project. Whenever the actual work amount of the first project is accumulated by a predetermined first ratio of the target work amount of the first project, the first Decreasing the work unit cost of a project by a first preset amount, and corresponding to reducing the work unit cost of the first project, increasing the work unit cost of the second project by a second preset amount. Including, and adjusting the work unit cost of each project so that the final work unit cost of the first project is lower than the final work unit cost of the second project.

In some embodiments of the present invention, the step of classifying the first project and the second project may include calculating an average work time required per work of a plurality of projects including the same type of functional elements, respectively, and It may include the step of classifying the first project and the second project by comparing the average work time required per one task of each of the projects.

In some embodiments of the present invention, the step of calculating the estimated average working time required per one task, respectively, is based on the number of functional elements included in one task of the plurality of projects and the average working time for each type. It is possible to calculate the estimated average work time required per work of the plurality of projects, respectively.

In some embodiments of the present invention, the step of setting the work unit cost of each project includes setting the initial work unit price of the first project to an amount increased by a predetermined second ratio from the reference work unit price of the first project, and the The initial work unit price of the second project may be set to an amount reduced by the second ratio from the reference work unit price of the second project.

In some embodiments of the present invention, the step of setting the work unit cost of each project includes calculating the estimated average work time of each project, and the estimated average work time of each project and a standard wage per unit time, It may further include the step of calculating each of the standard work unit cost of each of the projects.

In some embodiments of the present invention, in the step of calculating each of the standard work cost of each project, each of the standard work cost of each project may be calculated according to the following equation.

Base work unit cost = Estimated average work time x Base wage per unit hour

In some embodiments of the present invention, the first amount is set as an amount of the first ratio of the base work unit price of the first project, and the second amount is the second amount of the base work unit price of the second project. It can be set at a rate of one.

In some embodiments of the present invention, the first project and the second project may be opened and terminated at the same time every preset period.

In some embodiments of the present invention, an insufficient amount of the actual work amount of the second project compared to the target work amount of the second project may be summed up and carried over to the target work amount of the second project in the next cycle.

A computer program according to another aspect of the present invention for solving the above-described problems executes a method of controlling worker inflow through reversal adjustment of the work unit cost of the crowdsourcing-based similar project in combination with a computer as hardware, and a computer-readable recording medium Can be stored in.

Other specific details of the present invention are included in the detailed description and drawings.

According to the present invention described above, by adjusting the work cost of a project with a different difficulty level, it is possible to solve the phenomenon of worker concentration according to the difficulty level that occurs when the worker is focused on a project with an easy difficulty level.

In addition, by reversing the cost of low-difficulty projects and high-difficulty projects, workers are encouraged to voluntarily participate in high-difficulty projects from low-difficulty projects. In this way, among a plurality of projects with different levels of difficulty and including the same type of work, the worker first participates in a project with a lower level of difficulty so that they can receive prior learning related to the work. In addition, by encouraging workers with improved work performance through prior learning to participate in projects with higher difficulty in the future, they can perform difficult tasks more skillfully. As a result, this can have the effect of increasing the quality of work results and satisfying the target workload of high-difficulty projects.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a conceptual diagram of a crowdsourcing service according to an embodiment of the present invention.
2 is a flowchart illustrating a crowdsourcing-based project progress process according to an embodiment of the present invention.
3 is a flowchart schematically illustrating a method of controlling worker inflow through reversal adjustment of a work unit cost of a crowdsourcing-based project according to an embodiment of the present invention.
4 is a flow chart schematically showing a method of measuring the difficulty of a project having the same functional elements according to an embodiment of the present invention.
5 is a view for explaining a point in time when an actual work amount of a first project is accumulated by a predetermined first ratio of a target work amount of a first project.
6 is a diagram illustrating adjustment of a work cost of a first project and a work cost of a second project based on an actual amount of work of the first project according to an embodiment of the present invention.
7 is a conceptual diagram showing the distribution of workers in a first project and a second project according to an initial work unit cost according to an embodiment of the present invention.
8 is a conceptual diagram showing a change in distribution of workers in a first project and a second project by adjusting the work unit cost according to an embodiment of the present invention.
9 is a flowchart schematically illustrating a method of calculating a reference work unit cost of each project based on the estimated average work time of each of a first project and a second project according to an embodiment of the present invention.
10 is a view for explaining an apparatus for controlling worker inflow through reversal adjustment of work unit cost of a similar crowdsourcing project according to an embodiment of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms. It is provided to fully inform the skilled person of the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used herein, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements. Throughout the specification, the same reference numerals refer to the same elements, and "and/or" includes each and all combinations of one or more of the mentioned elements. Although "first", "second", and the like are used to describe various elements, it goes without saying that these elements are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical idea of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used with meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram of a crowdsourcing service according to an embodiment of the present invention.

Referring to FIG. 1, the crowdsourcing service is performed by being composed of a client 10, a service provider 20, and a public 30.

The sponsor 10 refers to a company or individual who requests a crowdsourcing-based project (hereinafter, referred to as a project).

The client 10 requests a project for the purpose of collecting source data or annotating data for generating artificial intelligence learning data. The data generated through the project can be used as learning data for arbitrary machine learning such as supervised learning, unsupervised learning, and reinforcement learning. Collection of source data means collecting raw data such as recorded voice collection and photo collection. Data annotation refers to inputting relevant annotation data into source data such as text, photos, and videos. For example, the data annotation may include finding an entity in a given fingerprint or finding a similar sentence, but is not limited thereto. Meanwhile, the types of the above-described projects are only one embodiment, and various projects may be handled in the present invention according to the design of the client.

The service provider 20 refers to a company that provides crowdsourcing services.

When the service provider 20 receives a request for a project for a product or service from the client 10, the service provider 20 allocates a task for the project to the general public 30 and receives the work result from the public 30. Thereafter, the final product extracted based on the work result is provided to the requester 10.

At this time, the service provider 20 provides a crowdsourcing service to the client 10 and the public 30 through a crowdsourcing platform (hereinafter, the platform). That is, when the service provider 20 receives a request for a project from the client 10, the service provider 20 opens the project on the platform. Thereafter, when the work result for the open project is provided by the public 30, the project is terminated on the platform, and the final product may be extracted and provided to the client 10.

The public 30 refers to the general public participating in the project open on the platform. Here, the public 30 may participate in a project opened on the platform through an application or website provided by the service provider 20.

The public 30 is composed of a worker 32 and an inspector 34.

The worker 32 decides to participate in a specific project among a plurality of projects open on the platform. Thereafter, the operator 32 performs an operation such as collection of source data or data annotation, and transmits it to the platform.

The inspector 34 decides to participate in a specific project among a plurality of projects opened on the platform. Thereafter, the inspector 34 inspects the result of the work performed by the operator 32. As a result of performing the inspection, the inspector 34 may perform inspection pass processing or rejection processing, and input a rejection reason during rejection processing. In the case of passing the inspection, rework and the resulting re-inspection are not required, so passing the inspection has the same meaning as the completion of the inspection.

2 is a flowchart illustrating a crowdsourcing-based project progress process according to an embodiment of the present invention.

First, the client 10 requests one or more projects to the service provider 20 (S11).

Thereafter, the service provider 20 opens the requested project on the platform (S12). At this time, the service provider 20 may determine the grade in consideration of the difficulty of the project before opening the project. That is, depending on the difficulty level, it is possible to determine which level or higher public 30 to expose the project. Accordingly, it is possible to increase the reliability of the work result of the project.

Thereafter, the service provider 20 requests the work by assigning the work to the workers 32 of the corresponding level or higher according to the class of the project (S13).

Thereafter, the worker 32 performs the assigned task (S14). In this case, the worker 32 may input the reason for the inability to work without performing the work for a work in which the work itself is impossible for some reason.

Thereafter, the service provider 20 receives the work result from the worker 32 (S15), and assigns the work result to the inspector 34 to request the inspection (S16).

Thereafter, the inspector 34 performs the assigned inspection (S17). At this time, the inspector 34 decides to pass the inspection when it is determined that the work has been properly performed, and if it is determined that the inspection work is wrong, the inspector 34 rejects it. During rejection processing, the inspector 34 inputs the rejection reason for what reason the job was judged to be wrong.

Thereafter, the service provider 20 receives the inspection result from the inspector 34 (S18).

If the inspection result passes the inspection, the service provider 20 uses the work result as valid data, and based on this, extracts the final product at the end of the project.

If the result of the inspection is rejection processing, the service provider 20 may internally perform the inspection again, or assign the work to the worker 32 again to perform the rework. When reworking, re-examination by an inspector is required.

Thereafter, when the project period ends or sufficient valid data is secured, the service provider 20 terminates the project (S19), calculates a final result based on the secured valid data, and provides it to the client 10 ( S20).

At this time, before the end of the project, the service provider 20 evaluates the performance results of the worker 32 and the inspector 34, calculates the work cost and the inspection cost according to the evaluation, to the worker 32 and the inspector 34. give.

In Figures 1 and 2, it is simply expressed as a requester 10, a service provider 20, an operator 32, and an inspector 34, but these are smartphones, tablets, PDAs, laptops, desktops operated by each participant. It means a computer device such as a server or a telecommunication device.

Hereinafter, a method of controlling inflow of workers through reversal adjustment of work unit cost of a similar project based on crowdsourcing according to an embodiment of the present invention will be described with reference to FIGS. 3 to 10. A detailed description thereof will be omitted for overlapping contents related to the crowdsourcing service configuration and the crowdsourcing-based project progress process described above with reference to FIGS. 1 and 2.

Workers on a crowdsourcing platform generally prefer to participate in a project with relatively low difficulty among multiple projects. This is because the lower the difficulty, the easier the operator can adapt to the task, and the number of rejected work results is less. This also means that workers can more easily get paid for their work.

Therefore, when a low-difficulty project and a relatively high-difficulty project are opened at the same time, the worker is focused on the low-difficulty project. If a project with lower difficulty provides a higher cost of work than a project with higher difficulty, this concentration of workers will become more severe. Eventually, this concentration of workers results in not achieving the target workload due to the shortage of workers in a project with high difficulty.

Accordingly, an embodiment of the present invention seeks to solve this phenomenon of worker concentration by adjusting the work cost of projects with different difficulty levels. In addition, by reversing the cost of low-difficulty projects and high-difficulty projects, workers are encouraged to voluntarily participate in low-difficulty projects and then to high-difficulty projects. This has a particularly advantageous effect between projects in which the way the work is done is similar. Workers who participate in low-difficulty projects will receive prior learning related to the task while performing the task. In addition, by encouraging workers with improved work performance through prior learning to participate in projects with higher difficulty in the future, they can perform difficult tasks more skillfully. Ultimately, this can have the effect of improving the quality of work results for projects with high difficulty.

Hereinafter, embodiments of the present invention related thereto will be described in detail.

3 is a flowchart schematically illustrating a method of controlling worker inflow through reversal adjustment of work cost of a crowdsourcing-based project according to an embodiment of the present invention.

Reversal adjustment of work cost means that when the project is opened, the cost of a project with higher difficulty is set lower than that of a project with lower difficulty. It means adjusting the unit cost of work for both projects to be set. In other words, it means adjusting the work cost so that the high and low work cost of both projects is reversed in the process of the project.

First, referring to FIG. 3, as an embodiment of the present invention, a plurality of projects including functional elements of the same type are classified into a first project having a first difficulty level and a second project having a second difficulty level higher than the first difficulty level. Do (S110).

Here, the functional element is determined based on a tool for executing the project. The work tool is provided in a project and refers to a tool used by a worker to perform a task required by the project.

For example, if you need a Bounding Box Tool for bounding work, an Input Box Tool for transfer work, and a Make Step Tool for sorting work to perform a project. , The project can be classified as including a bounding functional element, a transcription functional element, and a classification functional element.

In step S110, a plurality of projects including functional elements of the same type are classified into a first project and a second project according to difficulty. In this case, among the plurality of projects, a project having a first difficulty level of low difficulty is classified as a first project, and a project having a second difficulty level of high daytime guidance is classified as a second project.

Hereinafter, a specific method of measuring the difficulty of a project will be described with reference to FIG. 4.

4 is a flow chart schematically showing a method of measuring the difficulty of a project having the same functional elements according to an embodiment of the present invention.

Referring to FIG. 4, in an embodiment of the present invention, step S110 is a step of calculating the estimated average work time required per work of a plurality of projects including the same type of functional element, and one of each project. It may include the step of classifying the first project and the second project by comparing the estimated average work time required per task.

Specifically, when measuring the difficulty of a plurality of projects including only the bounding functional element, the estimated average work time required per one task of each project is calculated (S111). In this case, the larger the calculated value of the estimated average work time required per task, the higher the difficulty of the project. The expected average work time may be calculated based on the average work time of a previous project that has already been completed, including the same functional element. Alternatively, it may be calculated based on the average working time of the previous project including tasks of the same content as the object of the bounding task required by the project. However, it is not limited thereto.

By comparing the estimated average work time required for one work of each project calculated in step S111, the first project and the second project are classified (S112).

Specifically, after calculating the estimated average work time required per one task of each project, when the estimated average work time is greater than or equal to a preset reference time, the project has the first difficulty level. It is identified as a project with 2 difficulty levels, and is classified into a first project and a second project, respectively.

Alternatively, the average value is calculated based on the estimated average work time required per one task of each project. In addition, a project having an estimated average working time less than the calculated average value may be classified as a first project, and a project having an estimated average working time greater than or equal to the average value may be classified as a second project.

On the other hand, the step of calculating the estimated average working time required per one task, respectively, is based on the number of functional elements included in one task of the plurality of projects and the average working time of each type. You can calculate the estimated average work time required per work, respectively.

Specifically, in the case of a plurality of projects including only the bounding functional element, the average working time of the project including the bounding functional element is calculated. This can be calculated based on the average working time of the previous project including only the bounding functional element. However, it is not limited thereto. Meanwhile, based on the calculated average work time for the bounding functional element, the estimated average work time required per work of each project may be calculated.

For example, assume that the average working time of a previous project with two bounding functional elements is 5 seconds. If so, the expected average working time of a project including one bounding functional element can be calculated as 2.5 seconds, and the expected average working time of a project including three bounding functional elements can be calculated as 7.5 seconds.

Meanwhile, the project may include a plurality of functional element types. For example, assume a project that includes all of the bounding functional elements, transcription functional elements, and tagging functional elements. In this case, the average working time of the previous project including each functional element is calculated. That is, the average working time for each type of functional element is calculated. And it will be possible to calculate the estimated average working time according to the number of each type included in each project. If the working time of the bounding function element is 3sec, the working time of the transfer function element is 2sec, and the working time of the tagging function element is 1.5sec, 1 bounding function element, 2 transfer function elements, and 1 tagging function element are included. The estimated average working time of the project is calculated as 8.5sec.

Referring back to FIG. 3, after classifying the first project and the second project in step S110, the work unit cost of each project is set so that the initial work unit cost of the first project is higher than the initial work unit cost of the second project (S120). )

That is, the work cost of each project is set so that the initial work cost of the first project including one or more projects of low difficulty is higher than the initial work cost of the second project including one or more projects of high difficulty.

In this case, when a plurality of projects are classified as a first project, the plurality of projects are set to have the same work unit cost. For example, assume that Project A and Project B having the first difficulty level are classified as the first project. At this time, if the initial work unit price of the first project is set to 2,000 won, the work unit cost of both project A and project B is set to 2,000 won. The same applies to multiple projects classified as a second project.

Referring again to FIG. 3, whenever the actual work amount of the first project is accumulated by a predetermined first ratio of the target work amount of the first project, the work unit cost of the first project is reduced by a first preset amount. That is, whether or not to adjust the work cost of the first project is determined according to the actual amount of work of the first project.

Here, the target workload refers to the number of source data that is targeted to be collected until one or more projects included in the first project are opened and terminated. When a plurality of projects are included in the first project, the target workload may be calculated by summing each target workload of the plurality of projects. For example, assuming that the target workload of project A included in the first project is 5000 and the target workload of project B is 3,000, the target workload of the first project is 8,000. Meanwhile, the actual workload of the first project may also be calculated by summing the actual workload of a plurality of projects included in the first project.

FIG. 5 is a diagram for explaining a point in time when the actual work amount of the first project is accumulated by a predetermined first ratio of the target work amount of the first project, and FIG. 6 is an actual work amount of the first project according to an embodiment of the present invention. It is a diagram showing how to adjust the work unit cost of the first project and the work unit cost of the second project based on.

Referring to FIG. 5, it is assumed that 500 of the target workload of the first project, the first predetermined ratio is 20%, and the first amount of the first project is 500 won. In this case, every time the actual amount of work of the first project is accumulated by 100, the work unit cost of the first project will be reduced by a preset first amount. The time when 100 actual workloads are initially accumulated is t1. Therefore, referring to FIG. 6, it can be seen that at t1, which is the time point when the actual amount of work is accumulated for the first 100 cases, the work unit cost of the first project is reduced by 500 won.

Meanwhile, referring to FIG. 3, corresponding to the reduction in the work cost of the first project, the work cost of the second project is increased by a preset second amount. That is, whether or not the work cost of the second project is adjusted depends on the adjustment of the work cost of the first project. As a result, when the actual work amount of the first project is accumulated by a predetermined first ratio of the target work amount of the first project, the work unit cost of the second project is adjusted. Referring back to FIG. 5, assuming that the second amount of the second project is 1,000 won, it can be seen that the work cost of the second project increases by 1,000 won at t1, when the work cost of the first project is reduced.

Meanwhile, according to an embodiment of the present invention described above, the work cost of each project is adjusted so that the final work cost of the first project is lower than the final work cost of the second project.

Specifically, the initial unit cost of the first project is set higher than the initial unit cost of the second project, but when the first project is terminated, the final unit cost of the first project is lower than the final unit cost of the second project. Is to adjust the unit cost of work. Therefore, in the process of progressing the project, the high and low cost of the work of both projects is reversed.

7 is an exemplary diagram showing the distribution of workers in the first project and the second project according to the initial work unit cost according to an embodiment of the present invention, and FIG. 8 is a first work unit cost adjustment according to an embodiment of the present invention. This is an example diagram showing the change in the distribution of workers in the project and the second project.

Referring to FIG. 7, it can be seen that in the initial stage of opening the first and second projects, relatively large numbers of workers were concentrated on the first project, which has a low level of difficulty and a high work unit cost. However, referring to FIG. 8, it can be seen that workers who have participated in the first project gradually move to the second project by increasing the work cost of the second project than the work cost of the first project. In other words, it voluntarily induces the worker to move to the second project with high difficulty through the adjustment of the cost of work. Through this, a worker experiences a project with easy difficulty among multiple projects including the same functional element, and then participates in a project with high difficulty. Workers who have already received prior learning about the same functional element will be able to perform the work of the second project with higher difficulty more easily. This makes it possible to collect the actual amount of work corresponding to the target work amount of the second project and also has the effect of improving the quality of work results.

Meanwhile, in an embodiment of the present invention, in the step of setting the work unit cost of each project, the initial work unit price of the first project is set to an amount increased by a predetermined second ratio from the reference work unit price of the first project, The initial work unit price of the second project may be set to an amount reduced by the second ratio from the reference work unit price of the second project.

The base work unit cost of the first project and the base work unit cost of the second project are set in advance, respectively. And, based on the standard work unit price, the initial work unit price of each project is set. The reference work unit price may be set to the same value for the first project and the second project, but is not limited thereto.

On the other hand, the standard work unit cost and the second ratio are the average work speed based on the estimated work time of the first project, the schedule of the first project, and the final work unit price of the first project so that the final work unit price of the second project can be adjusted lower than the final work unit cost. It may be set based on the target workload of the first project.

On the other hand, the amount reduced by the second percentage from the base work unit cost of the second project (the initial work unit cost of the second project) is the second ratio increased from the standard work unit cost of the first project (the first work unit cost of the second project). It is set to be small. For example, assume that the base work unit price of the first project is 1,000 won and the base work unit cost of the second project is 1,500 won. And if the second ratio is 30%, the initial unit cost of the first project is set to 1,300 won. On the other hand, the initial unit price of the second project may be set at 1,050 won.

9 is a flowchart schematically illustrating a method of calculating a reference work unit cost of each project based on the estimated average work time of each of a first project and a second project according to an embodiment of the present invention.

Meanwhile, referring to FIG. 9, as an embodiment of the present invention, in the case of calculating the initial work unit cost of the first project and the second project based on the respective reference work unit cost and the second ratio, step S120 is It may further include a step of calculating each expected average work time (S121), and a step of calculating each of the standard work unit cost of each project based on the expected average work time of each project and a standard wage per unit time (S122). .

Here, the estimated average working time of each project means the total estimated average working time of the first project and the second project. This is different from the expected average work time required per one task calculated to determine the difficulty of a plurality of projects including the same functional element as an embodiment of the present invention described above. For example, it is assumed that the estimated average working time per one task of Project A included in the first project is 50 seconds, and the estimated average working time per one task of Project B is 48 seconds. At this time, the estimated average working time of the first project corresponds to 49 seconds, which is an average value calculated by summing the estimated average work time required for each work of Project A and Project B.

Meanwhile, the standard work unit price of each project is calculated based on the estimated average work time of each project calculated in step S121 and the standard wage per unit time (S122).

In this case, in an embodiment of the present invention, in the step of calculating each of the standard work cost of each project, the standard work cost of each project may be calculated according to Equation 1 below.

[Equation 1]

Base work unit cost = Estimated average work time x Base wage per unit hour

For example, assume that the estimated average work time for the first project is 50 seconds. And as the standard wage per unit hour, the minimum standard wage per hour in 2020, 8,590 won is applied. At this time, the standard cost of work for the first project is estimated at 119.30 won (8,590 won X 50 seconds/3600 seconds). On the other hand, assuming that the expected average work time of the second project is 100 seconds, the standard work unit cost of the second project is calculated as about 238.61 won (8,590 won X 100 seconds/3600 seconds) by the same method. On the other hand, assuming that the predetermined second ratio is 50%, the initial unit cost of the first project is approximately 178.95 won and the initial unit cost of the second project is approximately 119.3 won.

Meanwhile, in an embodiment of the present invention, the first amount is set as the amount of the first ratio of the standard work unit price of the first project, and the second amount is the amount of the first ratio of the standard work unit price of the second project. Can be set.

For example, assume that the target workload of the first project is 1,000, the first ratio is 10%, and the standard work unit cost of the first project is 1,000 won. After the opening of the first project, after a certain period of time, 10% of the target workload of 1,000 (the first ratio) was accumulated with 100 actual workloads. At this time, the unit cost of the work of the first project is reduced by the first amount, which is 100 won, which is 10% of 1,000 cases. Therefore, the cost of work for the first project is adjusted to 900 won.

On the other hand, according to an embodiment of the present invention, the first project and the second project may be opened and terminated at the same time every preset cycle.

That is, one or more projects included in the first project and one or more projects included in the second project are simultaneously opened at a set cycle, and then the work unit cost of each project is adjusted based on the actual amount of work of the first project and then terminated simultaneously.

In this case, according to an embodiment of the present invention, an insufficient amount of the actual work amount of the second project compared to the target work amount of the second project may be summed up and carried over to the target work amount of the second project in the next cycle.

In the case of the second project, projects with relatively higher difficulty than the first project are included. In addition, the work cost of each project is adjusted based on the actual work amount of the first project. Therefore, even if the unit cost of the second project is gradually increased to induce the participation of workers, there may be cases where the actual work amount of the second project does not correspond to the target work amount of the second project until the schedule of the preset cycle is completed. I can. At this time, the amount of shortage of the actual amount of work that is less than the target amount of work of the second project may be added to the target amount of work of the second project of the next cycle and carried over.

Meanwhile, in the above description, steps S110 to S140 may be further divided into additional steps or may be combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, or the order between steps may be changed. In addition, even if other contents are omitted, the contents of FIG. 10 to be described later can also be applied to the method of controlling worker inflow through reversal adjustment of the work unit cost of the crowdsourcing-based similar project of Figs.

Hereinafter, an apparatus for controlling inflow of workers through reversal adjustment of work cost between similar projects based on crowdsourcing according to an embodiment of the present invention will be described with reference to FIG. 10.

10 is a view for explaining an apparatus for controlling worker inflow through reversal adjustment of work unit cost between similar projects based on crowdsourcing according to an embodiment of the present invention.

Referring to FIG. 10, the device 300 (hereinafter, referred to as the device) for controlling worker inflow through reversal adjustment of work cost between similar projects based on crowdsourcing includes a communication module 310, a memory 320, and a processor 330. .

The communication module 310 transmits a crowdsourcing-based work for one project to a plurality of workers 32 to request a task to be performed, and receives work results from the plurality of workers 32. The communication module 310 transmits the work results received from the plurality of workers 32 to the plurality of inspectors 34 to request inspection, and receives the inspection results from the plurality of inspectors 34. At this time, for the rejected inspection result, a corresponding rework is transmitted to the worker 32 to request rework, and the rework result is received from the worker 32.

In the memory 320, a program for controlling worker inflow through reversal adjustment of work unit cost between similar projects is stored based on data received from the communication module 310.

The processor 330 executes a program stored in the memory 320. As the processor 330 executes the program stored in the memory 320, the method of controlling the influx of workers by reversing the cost of work between similar projects based on crowdsourcing described with reference to FIGS. 3 to 9 may be performed.

The device 300 described with reference to FIG. 10 may be provided as a component of the above-described server.

The method for controlling the influx of workers through reversal adjustment of the cost of work between similar projects based on crowdsourcing according to an embodiment of the present invention described above is implemented as a program (or application) to be executed in combination with a computer, which is hardware, and is computer-readable. It can be stored on a recording medium.

The above-described program includes C, C++, JAVA, Ruby, which can be read by a processor (CPU) of the computer through the device interface of the computer, in order for the computer to read the program and execute the methods implemented as a program. It may include a code (Code) coded in a computer language such as machine language. Such code may include a functional code related to a function defining necessary functions for executing the methods, and a control code related to an execution procedure necessary for the processor of the computer to execute the functions according to a predetermined procedure. can do. In addition, these codes may further include additional information required for the processor of the computer to execute the functions or code related to a memory reference to which location (address address) of the internal or external memory of the computer should be referenced. have. In addition, when the processor of the computer needs to communicate with any other computer or server in a remote in order to execute the functions, the code is It may further include a communication-related code for whether to communicate, what kind of information or media to be transmitted and received during communication.

The stored medium is not a medium that stores data for a short moment, such as a register, cache, memory, etc., but a medium that stores data semi-permanently and can be read by a device. Specifically, examples of the storage medium include, but are not limited to, ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like. That is, the program may be stored in various recording media on various servers to which the computer can access, or on various recording media on the user's computer. In addition, the medium may be distributed over a computer system connected through a network, and computer-readable codes may be stored in a distributed manner.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that other specific forms can be easily modified without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative and non-limiting in all respects. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

10: requester
20: service provider
30: public
32: worker
34: inspector

Claims (10)

As a method performed by a crowdsourcing service provider's server computer (hereinafter, "server"),
The server classifies a plurality of crowdsourcing-based projects (hereinafter referred to as "projects") including functional elements of the same type into a first project having a first difficulty level and a second project having a second difficulty level higher than the first difficulty level. The step of doing;
Setting, by the server, a work unit cost of each project such that an initial work unit cost of the first project is higher than an initial work unit cost of the second project;
Reducing, by the server, the work unit cost of the first project by a first preset amount whenever the actual work amount of the first project is accumulated by a predetermined first ratio of the target work amount of the first project; And
In response to the server reducing the work unit cost of the first project, increasing the work unit cost of the second project by a second preset amount,
Adjusting the work cost of each project so that the final work cost of the first project is lower than the final work cost of the second project,
The first project and the second project are opened and terminated at the same time at each preset cycle, and
The insufficient amount of the actual work amount of the second project compared to the target work amount of the second project is added up to the target work amount of the second project in the next cycle and carried over,
The step of classifying the first project and the second project,
Calculating, by the server, an estimated average work time required per work of a plurality of projects including the functional elements of the same type, respectively; And
Comprising the step of classifying the first project and the second project by comparing, by the server, an estimated average work time required per work of each project,
The step of calculating each of the expected average work time required per one operation,
Estimated average work time required per work of the plurality of projects is calculated based on the number of functional elements included in one work of the plurality of projects and the average work time of each type, respectively,
The functional element is determined based on a work tool for executing a project, and the work tool is provided in a project and is a tool used by a worker to perform a task required by the project,
A method of controlling the influx of workers through crowdsourcing-based reversal adjustment of work unit costs between similar projects. delete delete The method of claim 1,
The step of setting the work unit cost for each of the above projects,
The initial work unit price of the first project is set to an amount that is increased by a predetermined second ratio from the reference work unit price of the first project, and the initial work unit price of the second project is set above the reference work unit price of the second project. Set to an amount reduced by a second rate,
A method of controlling the influx of workers through crowdsourcing-based reversal adjustment of work cost between similar projects. The method of claim 1,
The step of setting the work unit cost for each of the above projects,
Calculating, by the server, an estimated average working time of each project; And
The server further comprising, based on the estimated average work time of each project and a standard wage per unit time, each calculating a standard work unit price of each project,
A method of controlling the influx of workers through crowdsourcing-based reversal adjustment of work cost between similar projects. The method of claim 5,
The step of calculating each of the standard work unit costs for each of the above projects,
Calculate the standard work unit cost for each of the above projects according to the following equation,
Base work unit cost = Estimated average work time x Base wage per unit hour
A method of controlling the influx of workers through crowdsourcing-based reversal adjustment of work cost between similar projects. The method of claim 4,
The first amount is set as the amount of the first ratio of the standard work unit price of the first project,
The second amount is set as the amount of the first ratio of the base work unit price of the second project,
A method of controlling the influx of workers through crowdsourcing-based reversal adjustment of work cost between similar projects. delete delete In combination with a computer, a computer stored in a computer-readable recording medium to execute the method of controlling worker inflow through reversal adjustment of work unit cost between similar projects based on crowdsourcing of any one of claims 1, 4 to 7 program.

Images