JP7075969B2 - How to select inspectors according to the characteristics of crowdsourcing-based projects - Google Patents

Description

The present invention relates to a method for selecting inspectors according to the characteristics of a crowdsourcing-based project.

In recent years, an increasing number of companies are collecting and processing large amounts of data based on crowdsourcing, which involves the general public in some processes of corporate activities. That is, the company opens one project and allows the general public, that is, the worker and the inspector, to participate in the project, thereby causing the worker to perform the work and inspecting the inspector. Let them collect the necessary information.

At this time, the company must classify the types of projects to be opened and assign them to appropriate inspectors in order to collect more efficient and accurate information.

Conventionally, the type, difficulty level, work type, etc. of the project to be opened are classified into the items that have already been set, and the appropriate inspectors are evaluated for the attributes and functions of the classified project. The project was assigned to the inspectors by the matching method.

However, when dividing a project into items that have already been set, there is a problem that items must be added infinitely even if some exceptions occur to the attributes and functions of the project.

Also, if the project to be opened is classified into A / B / C items, if there is no previously completed project classified into A / B / C, that is, it is completely the same as the project to be opened. If there is no matching project in the previous project, when the inspector pool (pool) of the project to be opened is generated, the external elements of the previous project are evaluated for the inspector matching of the project to be opened. The problem is that it must be included in the element.

In addition, there is the complexity of having to manually update the classification items for classifying the project according to the trend, and if the classification items are not updated periodically, the project will be the same. Nevertheless, there is a problem that they can be classified into different items.

Korean Published Patent Gazette No. 10-2014-095956 (2014.08.04.)

The present invention has been made in view of the above circumstances, and the purpose is not to classify the projects themselves to be opened by existing items (for each) and match the inspectors, but to open one project. The purpose is to provide a method for selecting inspectors according to the characteristics of a crowdsourcing infrastructure project, which can be classified according to the functional elements (for each) necessary for the work of the project, and the inspectors can be evaluated and selected.

The problem to be solved by the present invention is not limited to the problem mentioned above, and other problems not mentioned above can be clearly understood by ordinary engineers from the following description.

The method of selecting inspectors according to the characteristics of the cloud sourcing platform project according to one aspect of the present invention for solving the above-mentioned problems is the stage of grasping the functional elements included in the project to be opened and the inspectors participated. Among multiple previous projects, the stage of extracting the previous project that contains one or more functional elements of the project to be opened, and the functional elements included in the extracted previous project. At the stage of calculating the experience score of the inspector for the previous project based on the functional element of the previous project corresponding to the functional element of the project to be opened, and the stage of calculating the experience score of the inspector for the previous project, and each of the calculated previous projects. Based on the stage of calculating the matching score with the project to be opened for the inspector by adding all the experience points of the inspector for the inspector and the calculated matching score with the project to be opened for the inspector. This includes the stage of selecting the inspectors.

In one embodiment of the present invention, the step of calculating the inspector's experience score for the previous project corresponds to the functional element of the project to be opened for the entire working time of the previous project. By obtaining the value (a) of the ratio of the working hours of the functional elements of, and multiplying the value (a) of this ratio by the number of cases (b) in which the inspector completed the inspection in the corresponding previous project. The experience score of the inspector for the corresponding previous project is calculated.

In one embodiment of the present invention, if the number of cases (b) in which the inspector has completed acceptance in the previous project is equal to or less than the reference value, the inspector's experience score for the previous project is 0. It is calculated.

In one embodiment of the invention, the functional elements are determined based on a working tool (tool) for performing the project.

In one embodiment of the present invention, in the step of selecting the inspectors, the matching scores of the plurality of projects scheduled to be opened calculated for each inspector are arranged in descending order, and only the number of inspectors required for the project to be opened is required. , Select the inspectors.

In one embodiment of the present invention, the number of inspectors required for the project to be opened is determined according to the reliability of the project to be opened.

In one embodiment of the present invention, a step of selecting inspectors based on the matching score of the project to be opened and generating a pool of inspectors of the project to be opened can be included.

In one embodiment of the present invention, the inspector pool of the open project is obtained by changing the functional elements of the open project or by updating the inspector's participation history in the previous project. , Updated in real time.

In one embodiment of the present invention, the history of participation in the previous project may be information on a previous project in which the inspector has previously participated and completed the acceptance.

A computer program according to another aspect of the present invention for solving the above-mentioned problems is combined with a computer as hardware to execute an inspector selection method according to the characteristics of the project of the crowdsourcing infrastructure. Stored in the medium.

Other specific matters of the present invention are included in the detailed description and drawings.

According to the present invention as described above, the following effects can be obtained.

First, by calculating the score of the inspector for each functional element of the project to be opened instead of the category item of the project that has been set once in the existing, it will be opened except for the elements unnecessary for the evaluation of the inspector. The effect is that it is possible to select more suitable inspectors for this project.

Second, because the inspectors are categorized based on the functional elements of the project to be opened and the inspector pool (pool) is generated, even if there are fluctuation factors in the project or the inspector's history is updated, The effect is that the inspector pool can be updated in real time by applying the changed part.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned above can be clearly understood by ordinary engineers from the following description.

It is a conceptual diagram of the crowdsourcing service by one Embodiment of this invention. It is a flowchart explaining the progress process of the project of the crowdsourcing platform by one Example of this invention. It is a flowchart of the inspector selection method according to the characteristic of the crowdsourcing infrastructure project by one Example of this invention. It is explanatory drawing explaining the work of the project by one Example of this invention. It is an exemplary diagram explaining the case where the project work is remanded according to one embodiment of the present invention. It is explanatory drawing explaining the functional element included in the project to be opened by one Example of this invention. It is an exemplary diagram explaining the participation history of the inspector in the previous project according to one embodiment of the present invention. It is an exemplary figure explaining the calculation of the work time ratio for each functional element about the previous project in which the inspector participated according to one embodiment of the present invention. It is an exemplary diagram explaining that the matching score for the project to be opened by the inspector is calculated by using the experience score of each previous project according to the embodiment of the present invention. It is an exemplary figure explaining that the inspector is selected based on the matching score of the project to be opened according to one Embodiment of this invention. FIG. 3 is a block diagram of an inspector sorting device according to the characteristics of a crowdsourcing infrastructure project according to an embodiment of the present invention.

The advantages and features of the present invention, and the methods for achieving them, will be clarified with reference to the examples described in detail with the accompanying drawings. However, the present invention is not limited to the examples disclosed below, and can be realized in various forms different from each other. However, the present embodiment is provided to complete the disclosure of the present invention and to allow ordinary engineers in the technical field to which the present invention belongs to fully understand the scope of the present invention, and the present invention is claimed. It is only defined by the scope of the scope.

The terms used herein are for illustration purposes only and are not intended to limit the invention. As used herein, the singular type also includes plural types unless otherwise specified. As used herein, "comprises" and / or "comprising" does not preclude the presence or addition of one or more other components other than those mentioned. The same drawing reference throughout the specification indicates the same component, where "and / or" includes each of the mentioned components and any combination of one or more. Of course, even if "first", "second", etc. are used to describe various components, these components are not limited by these terms. These terms are used solely to distinguish one component from the other. Therefore, it goes without saying that the first component referred to below can also be the second component within the technical idea of the present invention.

Unless otherwise defined, all terms used herein (including technical and scientific terms) are used in common sense by ordinary engineers in the art to which the invention belongs. Also, terms defined in commonly used dictionaries are not ideally or over-interpreted unless explicitly specifically defined.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a conceptual diagram of a crowdsourcing service according to an embodiment of the present invention.

Referring to FIG. 1, the crowdsourcing service is composed of a client 10, a service provider 20, and a mass 30.

The client 10 means a company or an individual who requests a crowdsourcing-based project (hereinafter referred to as a project).

The requester 10 requests a project for the purpose of collecting source data, data annotation, or the like. Collecting source data means collecting unprocessed data, such as collecting recorded audio, collecting photographs, and so on. Data annotation means entering relevant annotation data into source data such as text, photos, and videos. For example, data annotation may include, but is not limited to, searching for an individual in a given text, searching for similar sentences, and so on. On the other hand, the above-mentioned type of project is only one embodiment, and various projects are dealt with in the present invention depending on the design of the client.

The service provider 20 means a company that provides a crowdsourcing service.

When the service provider 20 receives a project request for a product or service from the client 10, the service provider 20 allocates the work for the project to the general public 30 and receives the work result from the public 30. After that, the output (final product) extracted based on the work result is provided to the requester 10.

Here, the service provider 20 provides the crowdsourcing service to the client 10 and the public 30 via the crowdsourcing platform (hereinafter referred to as the platform). That is, when the service provider 20 receives a project request from the client 10, the service provider 20 opens the project on the platform. After that, when the work result for the opened project is received from the public 30, the project can be completed on the platform, the output can be extracted and provided to the requester 10.

Mass 30 means the general public participating in a project opened on the platform. Here, the public 30 can participate in a project opened on the platform via an application or website provided by the service provider 20.

The mass 30 is composed of a worker 32 and an inspector 34.

Worker 32 decides to participate in a specific project among a plurality of projects opened on the platform. After that, the worker 32 performs work such as collecting source data or data annotation, and sends this to the platform.

The inspector 34 decides to participate in a specific project among a plurality of projects opened on the platform. After that, the inspector 34 inspects the work result performed by the worker 32. As a result of the acceptance inspection, the inspector 34 can pass the work (certification of acceptance) or remand the work, and can input the reason for the remand when the work is remanded.

FIG. 2 is a flowchart illustrating a progress process of a crowdsourcing-based project according to an embodiment of the present invention.

First, the client 10 requests the service provider 20 for one or more projects (S11).

After that, the service provider 20 opens the requested project on the platform (S12). At this time, the service provider 20 can determine the grade in consideration of the difficulty level of the project before opening the project. That is, it is possible to determine which grade or higher the public 30 should expose (present) the project according to the difficulty level. This will increase the reliability of the work results of the project.

After that, the service provider 20 allocates work to workers 32 of the corresponding grade or higher according to the grade of the project (S13).

After that, the worker 32 performs the assigned work (S14). Here, the worker 32 does not perform the work for the work that the work itself is impossible for some reason, and can input the reason why the work is impossible.

After that, the service provider 20 receives the work result from the worker 32 (S15), and assigns the acceptance inspection work for the corresponding work result to the inspector 34 (S16).

After that, the inspector 34 performs the assigned acceptance inspection (S17). At this time, the inspector 34 determines that the work has been performed normally, determines that the work has passed the acceptance inspection, and determines that the work to be inspected is incorrect, and decides to remand the work. When deciding to remand, the inspector 34 inputs the reason for remand for what reason the work is determined to be incorrect.

Here, in one embodiment of the present invention, in allocating the inspection yield to the inspector 34, the remand rate for the previous work section is calculated, and the sample work amount for the work section is determined based on this, and the acceptance is inspected. By allocating to the person 34, it is possible to secure a certain degree of reliability and minimize the acceptance burden of the inspector 34.

After that, the service provider 20 receives the acceptance result from the inspector 34 (S18).

If the acceptance result is pass (pass), the service provider 20 uses the corresponding work result as valid data and extracts the output at the end of the project based on this.

If the acceptance result is a remand, the service provider 20 can internally perform the acceptance again or assign the worker 32 to perform the work again.

After that, when the project period ends or sufficient valid data is secured, the service provider 20 terminates the relevant project (S19) and obtains the final result (output) based on the secured valid data. It is calculated and provided to the requester 10 (S20).

At this time, before the end of the project, the service provider 20 evaluates the execution results of the worker 32 and the inspector 34, calculates the work cost and the inspector cost according to the evaluation, and the worker 32 and the inspector 34. Pay to.

On the other hand, in FIGS. 1 and 2, although it is simply expressed as a client 10, a service provider 20, a worker 32, and an inspector 34, these are smartphones, tablets, PDAs, and laptops operated by each participant. , A computer device such as a desktop, a server, or a telecommunications device.

FIG. 3 is a flowchart of an inspector selection method according to the characteristics of a crowdsourcing infrastructure project according to an embodiment of the present invention. FIG. 4 is an exemplary diagram illustrating the work of a project according to an embodiment of the present invention. FIG. 5 is an exemplary diagram illustrating a case where project work is remanded according to an embodiment of the present invention. FIG. 6 is an exemplary diagram illustrating functional elements included in a project to be opened according to an embodiment of the present invention. FIG. 7 is an exemplary diagram illustrating the history of inspectors participating in previous projects according to an embodiment of the present invention. FIG. 8 is an exemplary diagram illustrating the calculation of the working time ratio for each functional element for the previous project in which the inspector participated according to the embodiment of the present invention. FIG. 9 is an example diagram illustrating that the matching score for the project to be opened by the inspector is calculated by using the experience score of each previous project according to the embodiment of the present invention. FIG. 10 is an exemplary diagram illustrating that an inspector is selected based on a matching score of a project to be opened according to an embodiment of the present invention.

On the other hand, each step shown in FIG. 3 can be understood to be performed by a platform server (hereinafter referred to as a server) operated by the service provider 20, but is not limited thereto.

Further, the worker 32 and the inspector 34 perform the work using a predetermined terminal device. The terminal device of the worker 32 or the inspector 34 may be, but is not limited to, a computer device such as a smartphone, tablet, PDA, laptop, desktop, or telecommunications device.

Referring to FIG. 3, the server grasps the functional elements included in the project to be opened (S110).

The server grasps the type and number of functional elements required for the worker 32 participating in the project to be opened to perform the project work. Here, the functional elements are determined based on the work tool (tool) for carrying out the project.

That is, the server grasps what work tools are used to perform the work of the project to be opened, and determines the functional elements based on this. At this time, the work tool used to perform the work of the project to be opened may be preset by the manager of the service provider 20, or may be determined by the progress of the pilot.

As an example, the work of a project can be done through work with multiple functional elements. That is, the worker 32 participating in the project can complete one work by performing a plurality of steps. Referring to FIG. 4, the worker must perform the first step, the second step and the third step in order to carry out the work of the project.

Specifically, the worker 32 can select a specific object from a specific image and perform one step, that is, bounding (range selection) work. At this time, the worker 32 can use a bounding box tool (Bounding Box Tool) to perform the bounding work.

After that, the worker 32 can input the name of the selected specific object and perform a two-step operation, that is, a transcription operation. At this time, the worker 32 can use the input box tool (Input Box Tool) to perform the transcription work.

After that, in order to classify the type of the specific object to which the name is given, the worker 32 may select a superordinate concept including the words input in the transcription work and perform the attribute classification work in three stages. can. At this time, the worker 32 can use the make step tool (Make Step Tool) to perform the attribute classification work.

As mentioned above, the worker 32 must use the Bounding Box Tool, the Input Box Tool, and the Make Step Tool in order to carry out the project to be opened. If set or determined as a thing, the server can grasp the functional elements of the project to be opened based on three working tools.

As an example, the functional elements included in the project to be opened can be basically set to be the same as the number and names of work tools. For example, as described above, the work tools required for the work of the project to be opened are set or determined in the bounding box tool (Bounding Box Tool), the input box tool (Input Box Tool), and the make step tool (Make Step Tool). If so, the server can set the names of the functional elements of the project to be opened to the Bounding Box Tool, Input Box Tool, and Make Step Tool, respectively, and function. The number of elements can be set to three.

As another example, the name of the functional element included in the project to be opened may be modified by the administrator.

Referring to FIG. 6, the project to be opened includes a functional element a, a functional element b, a functional element d, and a functional element f. That is, the project to be opened is set or determined so that the worker 32 works using the four work tools, and the four work tools are the functional element a, the functional element b, and the functional element d, respectively. And the functional element f.

Also, referring to FIG. 3, the server extracts the previous project of the inspector, which contains one or more functional elements of the project to be opened (S120).

The server contains at least one functional element of the project to be opened from the previous projects that the inspector 34 has inspected, based on the history of the inspector 34's participation in the previous project. , Extract the previous project. Here, the participation history of the previous project means the information of the previous project in which the inspector has previously participated and completed the acceptance.

The inspector 34 participates in the open project, and the worker 32 who participates in the same project inspects the work completed by using the plurality of functional elements.

The inspector 34 determines whether the worker 32 has normally performed the work using the respective functional elements. That is, the inspector 34 can inspect each functional element and send it back or pass it.

Specifically, if the work using a specific functional element among the plurality of functional elements is incorrect, the inspector 34 remands only the work of the corresponding functional element, and the work of the remaining functional elements. Can be passed.

Referring to FIG. 5, the project is configured to perform a bounding operation using a bounding box tool (Bounding Box Tool) and a transcription operation using an input box tool (Input Box Tool). The worker 32 may perform a bounding operation (a-1, a-2, a-3) for cutting out each text portion from the image provided by the server by using a bounding box tool (Bounding Box Tool). can. After that, the worker 32 uses the input box tool (Input Box Tool) for the transcription work (b-1) for each bound work (a-1, a-2, a-3). , B-2, b-3) can be performed.

After that, the inspector 34 can send back or pass (certify the pass) to each of the result of the bounding work and the result of the transcription work by the worker 32. Specifically, when the worker 32 completes the bounding work (a-1, a-2, a-3) and the transcription work (b-1, b-2, b-3) for the bounding work, the acceptance is accepted. Person 34 performs acceptance inspection for each of all the operations (a-1, a-2, a-3, b-1, b-2, b-3). Then, when it is determined that the bounding work for a-1 and the transcription work for b-2 do not meet the conditions, the work for a-2, a-3, b-1, and b-3 is passed, and a. Only the work for -1 and b-2 can be remanded.

For example, if the bounding work is remanded, there is a lot of margin in the bounded box, the characters in the bounded box are cut off, or there are unnecessary polygons (taken). , The case where the first point and the second point are not horizontal for vertical setting, and the case where the bounding is not performed clockwise can be included.

After that, when the project is completed, the participation history of the inspector 34 in the previous project will include information about the completed project. Specifically, the project information including the information on the functional elements of the completed project, the total working time of the project, the information on the working time for each functional element, the information on the number of cases in which the inspector 34 has completed the acceptance in the project, etc. It will be included in the history of participation in previous projects.

Also, if the project is in progress, the acceptance history of the inspector 34's participation in the previous project may include information about the project in progress. Specifically, information on the functional elements of the project in progress, the total work time performed from the time the project was opened to the present time, and the functional elements performed from the time the project was opened to the present time. Project information, including information on working hours of the project, information on the number of cases in which the inspector 34 has completed acceptance from the time the project was opened to the present time, etc., will be included in the history of participation in the previous project. Become.

Therefore, the server contains the functional elements of the project to be opened from the previous projects that the inspector 34 has previously participated in, based on the inspector's history of participation in the previous project, which changes in real time. You can extract the previous projects of the inspectors.

Referring to FIG. 7, the inspector 1 has a history of participating in and inspecting the previous project A, the previous project B, the previous project C, and the previous project D. Here, the previous project A includes the functional element a, the functional element c, and the functional element f, and the previous project B includes the functional element b, the functional element d, the functional element e, and the functional element f. Project C includes functional element a, functional element d, and functional element g, and the previous project D includes functional element e, functional element g, and functional element h.

As shown in FIG. 6, assuming that the project to be opened includes the functional element a, the functional element b, the functional element d and the functional element f, the server is the previous projects A, B, C of the inspector 1. , And D, the previous project A including the functional element a is extracted, and the previous project B containing the functional element b, the functional element d and the functional element f is extracted, and the functional element a is extracted. And the previous project C containing the functional element d is extracted. The previous project D is excluded because it does not contain any functional elements of the project to be opened.

Further, referring to FIG. 3, the server calculates the experience score of the inspector for the previous project based on the functional elements of the previous project (S130).

Here, the experience score for the previous project is based on the number of acceptances performed by the inspector 34 by participating in the previous project and using the functional element corresponding to the functional element of the project to be opened. It is calculated.

Specifically, the experience score for the previous project is the value (a) of the ratio of the working time of the functional element of the previous project corresponding to the functional element of the project to be opened to the total working time of the previous project. It is calculated by multiplying the value (a) of the ratio of the working hours of the functional elements obtained in this way and the number of cases (b) in which the inspector 34 has completed the inspection in the previous project. ..

As an example, when the number of functional elements of the previous project corresponding to the functional elements of the project to be opened is n (n is a natural number of 2 or more), the function elements of the previous project will be opened for the entire working time. After finding the value of the working time ratio of each of the n functional elements of the previous project corresponding to the functional element of the project, the working time ratio of each of the n functional elements thus obtained is obtained. By multiplying the sum of the values (a_1 + a_2 + ... + a_n) and the number of cases (b) in which the inspector 34 has completed acceptance in the previous project, the inspector 34 for the previous project Experience points can be calculated.

Here, the total work time includes not only the work time initially performed by the worker 32 in the previous project, but also the work returned by the inspector 34 up to the time when the worker 32 works again. It means the total working time considered.

Referring to FIG. 8, the total working time of the previous project A considering the number of remand is 3600 sec. (Seconds), of which the working time using the functional element a is 1650 sec. The functional element c is 1200 sec. And the functional element f is 750 sec. As a result, the percentages of working hours for each functional element in the previous project A are calculated to be 46%, 33%, and 21%, respectively.

The server calculates experience points for each of one or more previous projects extracted for each inspector.

Referring to FIG. 7, the server must calculate the experience score of the previous project A, the experience score of the previous project B, and the experience score of the previous project C for the inspector 1.

Specifically, the previous project A includes the functional element a among the functional elements of the project to be opened, and the working time ratio of the functional element a is 46%. The previous project B includes the functional element b, the functional element d, and the functional element f among the functional elements of the project to be opened, and the ratio of the working hours of the functional element b, the functional element d, and the functional element f is set. 30%, 20% and 35%, respectively. The previous project C includes the functional element a and the functional element d among the functional elements of the project to be opened, and the working time ratios of the functional element a and the functional element d are 30% and 40%, respectively. ..

Referring to FIG. 9, the number of cases in which the inspector 1 participated in the previous project A and completed the acceptance inspection was 10, and the number of cases in which the inspector 1 participated in the previous project B and completed the acceptance inspection was 20 cases. The number of cases that participated in the previous project C and completed the acceptance inspection is 50.

Therefore, the experience score of the inspector 1 for the previous project A is 0.46 × 10 = 4.6. The experience score of the inspector 1 for the previous project B is (0.3 + 0.2 + 0.35) × 20 = 17. The experience score of the inspector 1 for the previous project C is (0.3 + 0.4) × 50 = 35.

Further, referring to FIG. 3, the server calculates the matching score of the project to be opened by adding the experience scores of the inspectors for each previous project (S140).

Referring to FIG. 9, when the experience points of the inspector 1 for each of the previous projects A, B, and C are added (4.6 + 17 + 35), the matching score of the inspector 1 with the project to be opened is 56. It is calculated as 6 points.

As an example, if the number of cases (b) in which the inspector 34 has completed the inspection in a specific previous project is less than or equal to the already set reference value, the inspector's experience score for the corresponding previous project is 0. Can be calculated.

For example, when the standard value is 20, the number of cases in which the inspector 1 participates in the previous project A and completes the inspection is 10 as described above, and therefore does not reach the standard value. Therefore, the experience score of the inspector 1 for the previous project A is calculated as 0, and the matching score of the inspector 1 with the project to be opened is calculated as 0 + 17 + 35 = 52 points.

As another example, the matching score with the project to be opened is calculated based on the participation history of the inspector 34 in the previous project based on the functional elements of the project to be opened, so the maximum value is limited. do not have. That is, the more the inspector 34 has participated in the previous project, and the more the functional elements of the previously participated projects correspond to the functional elements of the project to be opened, the more open. The matching score of the planned project is calculated as a large value.

Further, referring to FIG. 3, the server selects the inspectors based on the matching score of the project to be opened (S150).

That is, the server calculates the matching score with each project scheduled to be opened for each inspector, and arranges the matching score with a plurality of projects scheduled to be opened calculated for each inspector in descending order to open the project. Only the number of inspectors 34 required for the project is selected.

At this time, the number of inspectors 34 required for the project to be opened is determined according to the reliability of the project to be opened. That is, the server can set the number of inspectors 34 to be larger as the reliability of the required level is higher, depending on the level requested by the client 10 or the nature of the project to be opened.

Referring to FIG. 10, when the number of inspectors 34 required for the project to be opened is 5, matching with the project to be opened among the plurality of inspectors included in the inspector pool. Inspectors up to the 5th place can be selected in descending order of score.

On the other hand, the server selects inspectors based on the matching score with the project to be opened and generates an inspector pool (pool) of the project to be opened.

That is, when the server selects only the required predetermined number of inspectors 34 based on the matching score with the project to be opened among the plurality of inspectors 34, the selected inspectors 34 are included in the open schedule. A pool of inspectors for the project will be generated.

Specifically, assuming that the number of inspectors 34 required for the project to be opened is 50, the matching values with the project to be opened calculated for a plurality of workers are arranged in descending order. Workers after the 50th can be excluded from the work pool (pool) of the project to be opened.

As an example, the inspector pool of a project to be opened is updated in real time by changing the functional elements of the project to be opened. That is, the matching score of the inspectors is calculated so as to be different according to the functional elements of the project to be opened, and the inspectors to be selected are also changed accordingly. For example, when the functional elements of the project to be opened are a and b, the inspector 1 and the inspector 2 are selected, and then the functional elements are changed to a and c, and the inspector 1 and the inspector 2 are inspected. In the case of being changed to person 3 and selected, since it was calculated that the matching score of the inspector 3 with the project to be opened is higher than that of the inspector 2, the inspector 2 is excluded and the inspector 3 is selected. Was selected.

As another embodiment, the inspector pool of a project to be opened is updated in real time by updating the inspector's participation history in the previous project. Since the inspector participates in a plurality of ongoing projects and continuously inspects the acceptance, the inspector's participation history in the previous project is updated in real time. By updating the participation history of each inspector in the previous project in real time, the matching score with the project to be opened, which is calculated for each inspector, is also calculated differently. The inspector to be accepted will also be changed. For example, when the inspector 1 participates in a project that includes a specific functional element among the functional elements of the project to be opened and performs the acceptance inspection, the inspector 1 so that the information of the corresponding project is included. The history of participation in previous projects is updated. As a result, the matching score of the inspector 1 with the project scheduled to be opened is calculated to be high, and the project to be opened can be selected as an inspector.

FIG. 11 is a block diagram of an inspector sorting device according to the characteristics of a crowdsourcing infrastructure project according to an embodiment of the present invention.

Referring to FIG. 11, the inspector selection device 100 (hereinafter referred to as “inspector selection device”) according to the characteristics of the crowdsourcing infrastructure project includes a communication unit 110, a judgment unit 120, an extraction unit 130, and a calculation unit 140. The control unit 150 and the storage unit 160 are included.

The communication unit 110 plays a role of communicating with at least one of the terminal device of the requester 10, the terminal device of the worker 32, and the terminal device of the inspector 34 to transmit and receive data.

The judgment unit 120 plays a role of grasping a plurality of functional elements included in the work of the project to be opened. In addition, the determination unit 120 plays a role of determining whether or not the functional elements of the project to be opened are included in each of the previous projects in which the inspector 34 has previously participated.

The extraction unit 130 serves to extract the previous project of the inspector, which is determined by the determination unit 120 to include the functional elements of the project to be opened. Further, the extraction unit 130 plays a role of extracting the functional elements of the project to be opened, the corresponding functional elements, and the ratio of the working time for each functional element from the extracted functional elements of the previous project.

In the calculation unit 140, the ratio of the work time for each functional element of the previous project corresponding to the functional element of the project to be opened extracted by the extraction unit 130, and the acceptance inspection by the inspector 34 in the corresponding previous project are completed. Based on the number of cases, it plays a role of calculating the experience score of the inspector 34 for the project to be opened. In addition, the calculation unit 140 plays a role of adding up all the experience points of the inspector 34 for each previous project and calculating the matching score of the inspector 34 with the project scheduled to be opened.

The control unit 150 controls each of the components of the inspector sorting device 100.

The storage unit 160 stores and manages the data received by the inspector selection device 100, the data generated by the inspector selection device 100, and the like.

As described above, the inspector selection method according to the characteristics of the crowdsourcing infrastructure project according to the embodiment of the present invention is executed in a program (or application) in combination with a computer as hardware. It can be embodied and stored in a medium.

In the above-mentioned program, C, C ++, which is read by the processor (CPU) of the computer through the device interface of the computer in order for the computer to read the program and execute the method embodied in the program. Codes encoded in computer languages such as JAVA®, Ruby, and machine language can be included. Such code can include functional code associated with functions and the like that define the functions required to perform the method, each of which is defined by the computer's processor. It can contain the control code related to the execution procedure, which is necessary to execute it according to the procedure of. In addition, such code should refer to the location (address) of the internal or external memory of the computer for additional information or media necessary for the processor of the computer to perform each of the functions. Further memory reference-related code can be included. In addition, when the processor of the computer needs to communicate with any other remote computer or server in order to execute each of the functions, the code is remotely transmitted by using the communication module of the computer. It can further include communication-related codes for how to communicate with any other computer or server in the above, what kind of information or media should be transmitted / received during communication, and the like.

The stored medium is not a medium that stores data only for a short moment such as a register, a cache, or a memory, but a medium that stores data semi-permanently and can be read by a device. Specifically, examples of the storage medium include, but are not limited to, ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like. That is, the program can be stored in various recording media on various servers to which the computer can be connected, or in various recording media on the user's computer. Further, the medium is distributed to computer systems connected by a network, and a code that can be read by a computer in a distributed method can be stored.

Although the embodiments of the present invention have been described above with reference to the accompanying drawings, ordinary engineers in the technical field to which the present invention belongs can use the present invention without changing its technical idea or essential features. It can be understood that it can be carried out in a concrete form of. Therefore, the examples described above are exemplary in all respects and should be understood as non-restrictive.

100 Inspector sorting device 110 Communication unit 120 Judgment unit 130 Extraction unit 140 Calculation unit 150 Control unit 160 Storage unit

Claims (7)

It ’s a computer-based method,
At the stage of grasping the functional elements included in the crowdsourcing platform project (hereinafter referred to as the project) scheduled to open,
The stage of extracting the previous project that contains one or more functional elements of the project to be opened from the multiple previous projects in which the inspector participated,
Among the functional elements included in the extracted previous project, the inspector's experience score for the previous project is based on the functional element of the previous project that corresponds to the functional element of the project to be opened. The stage of calculation and
At the stage of calculating the matching score with the project to be opened for the inspector by adding all the experience points of the inspectors for each of the calculated previous projects.
Including the step of selecting the inspector based on the calculated matching score of the inspector with the project to be opened.
The functional elements are determined based on a work tool (Tool) for carrying out the project, and the work tool is a tool provided by the project and used by a worker to perform the work required by the project.
The stage of calculating the experience score of the inspector for the previous project is
The value (a) of the ratio of the working time of the functional element of the previous project corresponding to the functional element of the project to be opened to the total working time of the previous project is obtained, and the value (a) of this ratio is obtained. , The characteristics of the crowdsourcing-based project in which the experience points of the inspector for the previous project are calculated by multiplying the number of cases (b) that the inspector has completed the acceptance in the previous project. Inspector selection method according to. When the number of cases (b) in which the inspector has completed the acceptance in the previous project is equal to or less than the reference value, the inspector's experience score for the previous project is calculated as 0. A method for selecting inspectors according to the characteristics of the project of the crowdsourcing platform according to claim 1. The stage of selecting the inspectors is
Claim 1 is characterized in that the matching scores of a plurality of projects scheduled to be opened, which are calculated for each inspector, are arranged in descending order, and the inspectors are selected according to the number of inspectors required for the project to be opened. How to select inspectors according to the characteristics of the described crowdsourcing infrastructure project. The crowdsourcing platform according to claim 3, further comprising a step of selecting inspectors based on the matching score of the project to be opened and generating a pool of inspectors of the project to be opened. How to select inspectors according to the characteristics of the project. The inspector pool of the project to be opened
The crowdsourcing platform according to claim 4 , wherein the crowdsourcing platform is updated in real time by changing the functional elements of the project to be opened or by updating the participation history of the inspector in the previous project. How to select inspectors according to the characteristics of the project. The participation history of the previous project depends on the characteristics of the crowdsourcing-based project according to claim 5 , which is information on the previous project in which the inspector has previously participated and completed the acceptance. How to select the inspectors. A computer program stored in a computer-readable recording medium in order to combine with a computer and execute the inspector selection method according to the characteristics of the crowdsourcing-based project according to any one of claims 1 to 6 . ..

Images