KR102155877B1 - Method for providing information of projects matching qualifications of crowdsourcing platform for artificial intelligence training data generation - Google Patents

Abstract

Provided is a method for providing information of a project matching a participation qualification of a crowdsourcing platform for artificial intelligence training data generation which can minimize a system load. The method comprises the steps of: configuring condition list information corresponding to a participation qualification set by a manager for each of a plurality of crowdsourcing-based projects (hereinafter, projects); comparing user information and the condition list information for each of a plurality of users of a crowdsourcing platform to filter a project matching the user among the plurality of projects; and providing information on the filtered project to the user.

Description

How to provide project information matching the qualifications for participation in the crowdsourcing platform for generating AI learning data {METHOD FOR PROVIDING INFORMATION OF PROJECTS MATCHING QUALIFICATIONS OF CROWDSOURCING PLATFORM FOR ARTIFICIAL INTELLIGENCE TRAINING DATA GENERATION}

The present invention relates to a method of providing project information matching the participation qualification of a crowdsourcing platform for generating artificial intelligence learning data.

Recently, more and more companies collect and process large amounts of data on a crowdsourcing basis that engages the general public in some process of corporate activities. In other words, by opening a project and allowing the general public, that is, workers to participate in the project, necessary information is collected through the work results completed by the workers.

At this time, in order to collect more reliable information, the company assigns the work result completed by the worker to the inspector to perform the inspection work.

Specifically, when one project is opened, a plurality of tasks are assigned to each of the plurality of workers. Each worker performs a plurality of tasks assigned to it, and provides the task results. Thereafter, a plurality of inspection tasks are assigned to each of the plurality of inspectors, and each inspector performs a plurality of inspection tasks assigned to them.

Meanwhile, in order to participate in a specific project as described above, a worker or inspector must select a project that is suitable for them after being provided with a list of projects including multiple projects.

At this time, if a project list including all projects provided by the crowdsourcing service is provided to a worker or an inspector, the operator or inspector has the trouble of having to select a project that is suitable for him after checking each one.

In addition, from the standpoint of crowdsourcing services, it is necessary to restrict participation qualifications for each project so that inappropriate workers or inspectors do not participate in the project. However, when the number of total projects and the number of workers and inspectors is large, filtering by participation qualification as described above is difficult to secure real-time, and there is a problem in that a large load is placed on the system.

Unexamined Patent Publication No. 10-2014-0095956, 2014.08.04.

The problem to be solved by the present invention is to provide a method for minimizing system load while securing real-time performance in providing project information matching the qualifications for participation to workers or inspectors.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

A method according to an aspect of the present invention for solving the above-described problem is the step of configuring condition list information corresponding to participation qualifications set by a manager for each of a plurality of crowdsourcing-based projects (hereinafter, projects), crowdsourcing Comparing user information and the condition list information for each of a plurality of users of the platform, filtering a project matching the user among the plurality of projects, and providing information on the filtered project to the user. The condition list information is composed of one or more condition element information, the condition element information includes a unique identifier of a condition group to which the condition element belongs, a category and a category value of the condition element, and the condition group is one A condition element of, or a set of one or more condition elements connected by an AND operation, and filtering a project matching the user among the plurality of projects includes the user information and the one or more conditions of the condition list information Comparing element information, and determining that the user does not satisfy a condition group to which the specific condition element belongs when the user does not satisfy a specific condition element according to a result of comparing the user information and the condition element information And filtering a project matching the user among the plurality of projects according to the determination result of the condition group.

In some embodiments of the present invention, the condition element information further includes a size (CS) of a condition group to which the condition element belongs, and the CS is the number of one or more condition elements constituting the condition group, and the user When the specific condition element is not satisfied, the determining that the user does not satisfy the condition group to which the specific condition element belongs may include a condition element that the user satisfies according to a comparison result of the user information and the condition element information. And grouping the filtered condition elements for each condition group to which the filtered condition element belongs using the unique identifier of the condition group, and calculating the number of the filtered condition elements and the CS of the condition group for each condition group. And determining a condition group not satisfied by the user according to the comparison result for each condition group.

In addition, comparing the number of the filtered condition elements for each condition group and the CS of the condition group is to compare the sum of the square of the number of condition elements and the CS of condition element information of the filtered condition element.

In addition, the condition element information further includes a unique identifier of a project corresponding to the condition element, and grouping the filtered condition element by condition group to which the filtered condition element belongs by using the unique identifier of the condition group And the filtered condition elements are grouped for each project and condition group to which the filtered condition element belongs using the unique identifier of the project and the unique identifier of the condition group.

In some embodiments of the present invention, the qualification for participation includes qualification for at least one of nationality, age, gender, place of birth, place of residence, foreign language ability, grade, and project history.

In some embodiments of the present invention, the participation qualification includes a participation qualification for a worker of the project or a participation qualification for a reviewer of the project.

In some embodiments of the present invention, the condition corresponding to the participation qualification is defined as a set of at least one condition group connected by an OR operation.

In some embodiments of the present invention, the user information includes information on at least one of the user's nationality, age, sex, place of birth, residence, foreign language ability, grade, and project history.

In some embodiments of the present invention, the providing of the information on the filtered project to the user includes, when the user logs in to the crowdsourcing platform, the information on the filtered project can be included in the project list Provided by

A computer program according to another aspect of the present invention for solving the above-described problems is combined with a computer as hardware to execute the above-described methods, and is stored in a computer-readable recording medium.

Other specific details of the present invention are included in the detailed description and drawings.

According to the present invention described above, in providing project information matching the qualifications for participation to a worker or inspector, the problem of logical matching with high complexity is solved by using a filter function and a group function provided in a general database, thereby securing real-time and simultaneously system load. Can be minimized.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a conceptual diagram of a crowdsourcing service according to an embodiment of the present invention.
2 is a flowchart illustrating a crowdsourcing-based project progress process according to an embodiment of the present invention.
3 is a flowchart of a method for providing project information according to an embodiment of the present invention.
4 is a diagram for describing condition list information of an exemplary project.
5 is a flowchart of a project filtering step in a method for providing project information according to an embodiment of the present invention.
6 is a diagram for describing filtering of condition elements that are satisfied by an exemplary user.
FIG. 7 is a diagram for explaining grouping of condition elements filtered for each exemplary condition group.
8 is a diagram for explaining determining whether a user meets each exemplary condition group.
9 is a diagram for describing example project condition list information further including a project unique identifier.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms, only the present embodiments are intended to complete the disclosure of the present invention, It is provided to fully inform the technician of the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used in the specification, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements. Throughout the specification, the same reference numerals refer to the same elements, and “and/or” includes each and all combinations of one or more of the mentioned elements. Although "first", "second", and the like are used to describe various elements, it goes without saying that these elements are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical idea of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram of a crowdsourcing service according to an embodiment of the present invention.

Referring to FIG. 1, a crowdsourcing service is performed by being composed of a client 10, a service provider 20, and a public 30.

The sponsor 10 refers to a company or individual who requests a crowdsourcing-based project (hereinafter, referred to as a project).

The requester 10 requests a project for the purpose of collecting source data or annotating data for generating artificial intelligence learning data. The data generated through the project can be used as learning data for arbitrary machine learning such as supervised learning, unsupervised learning, and reinforcement learning. Collection of source data refers to collecting raw data such as recorded voice collection and photo collection. Data annotation refers to inputting relevant annotation data into source data such as text, photos, and videos. For example, the data annotation may include finding an entity in a given fingerprint or finding a similar sentence, but is not limited thereto. Meanwhile, the types of the above-described projects are only one embodiment, and various projects may be handled in the present invention according to the design of the client.

The service provider 20 refers to a company that provides crowdsourcing services.

When the service provider 20 receives a request for a project for a product or service from the client 10, the service provider 20 allocates a task for the project to the general public 30 and receives the work result from the public 30. Thereafter, the final product extracted based on the work result is provided to the client 10.

At this time, the service provider 20 provides a crowdsourcing service to the client 10 and the public 30 through a crowdsourcing platform (hereinafter, the platform). That is, when the service provider 20 receives a request for a project from the client 10, the service provider 20 opens the project on the platform. Thereafter, when the work result for the open project is received from the public 30, the project is terminated on the platform, and the final product may be extracted and provided to the client 10.

The public 30 refers to the general public participating in the project open on the platform. Here, the public 30 may participate in a project opened on the platform through an application or website provided by the service provider 20. Among the public 30, a person who can join or register on the platform and participate in the project is called a user (or member). And, among the users, the person who is participating in the project is called a participant.

Participants are composed of a worker 32 and an inspector 34.

The worker 32 decides to participate in a specific project among a plurality of projects open on the platform. Thereafter, the operator 32 performs an operation such as collection of source data or data annotation, and transmits it to the platform.

The inspector 34 decides to participate in a specific project among a plurality of projects open on the platform. Thereafter, the inspector 34 inspects the result of the work performed by the operator 32. As a result of performing the inspection, the inspector 34 may perform inspection pass processing or rejection processing, and input a rejection reason during rejection processing. In the case of passing the inspection, it is not necessary to rework and re-examination due to this, so passing inspection has the same meaning as completion of inspection.

2 is a flowchart illustrating a crowdsourcing-based project progress process according to an embodiment of the present invention.

First, the requester 10 requests one or more projects to the service provider 20 (S11).

Thereafter, the service provider 20 opens the requested project on the platform (S12). At this time, the service provider 20 may determine the grade in consideration of the difficulty of the project before opening the project. In other words, depending on the difficulty level, you can determine which level or higher users will be exposed to the project. Accordingly, it is possible to increase the reliability of the work result of the project.

In addition, as will be described later, the service provider 20 may determine participation qualifications including the above grades in the case of projects requiring predetermined conditions. In addition, by exposing only suitable projects to individual users among all projects according to the qualifications of the worker 32, it is possible to improve reliability and facilitate the user to select a project to participate as a worker.

Thereafter, the service provider 20 allocates a task to the worker 32 that satisfies the level or participation qualification of the project and requests the task (S13).

Thereafter, the worker 32 performs the assigned task (S14). In this case, the worker 32 may input the reason for the inability to work without performing the work for a work in which the work itself is impossible for some reason.

Thereafter, the service provider 20 receives the work result from the worker 32 (S15), and assigns the work result to the inspector 34 to request the inspection (S16).

Similarly, as described later, the service provider 20 makes it possible for users to easily select a project to participate as an inspector in addition to improving reliability by exposing only suitable projects to individual users among all projects according to the qualification of the inspector 34, as described later. can do.

Thereafter, the inspector 34 performs the assigned inspection (S17). At this time, the inspector 34 determines that the inspection is completed when it is determined that the work has been properly performed, and if it is determined that the inspection operation is wrong, the inspector 34 rejects it. During rejection processing, the inspector 34 inputs the rejection reason for what reason the job was judged to be wrong.

Thereafter, the service provider 20 receives the inspection result from the inspector 34 (S18).

When the inspection result is the inspection completion, the service provider 20 uses the work result as valid data, and based on this, extracts the final product at the end of the project.

When the inspection result is rejection processing, the service provider 20 may internally perform the inspection again, or assign the work to the worker 32 again to perform the rework. When reworking, re-examination by an inspector is required.

Thereafter, when the project period ends or sufficient valid data is secured, the service provider 20 terminates the project (S19), calculates a final result based on the secured valid data, and provides it to the client 10 ( S20).

At this time, before the end of the project, the service provider 20 evaluates the performance results of the worker 32 and the inspector 34, calculates the work cost and the inspection cost according to the evaluation, to the worker 32 and the inspector 34. give.

In Figures 1 and 2, it is simply expressed as a client 10, a service provider 20, an operator 32, and an inspector 34, but these are smartphones, tablets, PDAs, operated by each client, manager, and participant. It means a computer device or telecommunication device such as a laptop, desktop, server, etc.

In the method of providing project information according to an embodiment of the present invention, in selectively providing information of a project meeting a qualification condition among a number of projects to a number of users having different characteristics, a problem of logic matching with high complexity is generally solved. Through the filter function and group function provided by the database, it is more suitable for real-time service and can be effectively provided in a way that minimizes system load.

Specifically, when creating or modifying a project, the manager of the service provider (20) that manages the project or the manager of a specific project is qualified to participate in the appropriate worker (32) or inspector (34) to ensure that the project proceeds smoothly. Can be specified.

For example, as conditions constituting the participation qualifications of the worker 32 or the inspector 34, nationality, age, sex, place of birth, place of residence, foreign language ability, grade (for example, starter, bronze, silver, gold, etc.), Factors such as project history (project type, number of participation, timing of participation, rejection rate, etc.) can be used. These elements can be stored and managed as user information for comparison purposes.

For example, the qualifications for participation of the worker 32 in a specific project may be specified under conditions such as male, 20s, Korea, starter grade, past two or more participation in type A projects.

These conditional elements may be connected through logical operators such as AND or OR, and may be combined in the form of multiple conditions. And, through this logical operation function, the manager of the project can more accurately and in detail define the conditions constituting the qualifications of the participants desired in the project.

For example, conditions for eligibility for participation can be clearly defined, such as "(female AND 20s) OR (OCR project rejection rate 20% or less)". In the example above, only a female in her 20s or a qualified user with a rejection rate of 20% or less for the OCR project will be able to participate in the project.

When a specific user logs in and accesses the platform, the platform provides a list of workable projects or a list of projects that can be reviewed according to the characteristics of the specific user. At this time, projects that can participate, that is, matching according to the above participation qualifications, must be searched and provided in the form of a list.

To this end, a method to determine whether the characteristics of individual users are appropriate for the project by reading the entire list of available projects first, and then repeatedly preparing conditions for participation qualifications set or specified for each project with user information. Can be applied.

However, this method is not efficient because it is necessary to compare the qualification conditions of the worker 32 or the inspector 34 every time as much as the total number of available projects. In other words, there is a problem that service quality may be fatal when the number of projects is large or the request for a list of participating projects is frequently requested.

Alternatively, it is possible to use a method of configuring a list of workers 32 or inspectors 34 at the time of setting or changing the qualifications for participation in the project. In other words, it is a method of constructing a list of workers 32 or inspectors 34 who are qualified for participation based on a specific time point for each specific project.

However, since this method uses a fixed list of workers 32 and inspectors 34 (or pool) for each project, the user status (for example, age, grade change, etc.) is changed or the platform is new. When a user occurs, there is a problem that it is difficult to reflect changes in real time, such as when the project status (pause, postponement, etc.) changes.

In other words, the management and infrastructure costs for creating or updating the project list increase, and it is unsuitable for real-time services due to mass calculations and frequent I/O occurrences, and there is a high possibility of burden in service design. There is.

In contrast, an embodiment of the present invention uses only the filter function and group function level provided by a general database to solve the problem of logical matching with high complexity, thereby securing real-time performance when providing project information suitable for individual users and minimizing system load. It has the advantage of being able to.

Hereinafter, a method of providing project information according to an embodiment of the present invention will be described with reference to FIGS. 3 to 7.

3 is a flowchart of a method for providing project information according to an embodiment of the present invention.

Meanwhile, the steps shown in FIG. 3 may be understood as being performed by a platform server (hereinafter, referred to as a server) operated by the service provider 20, but are not limited thereto.

In addition, a plurality of workers 32 or a plurality of inspectors 34 perform work using a predetermined terminal device. The terminal device of the operator 32 or the inspector 34 may be a computer device or a telecommunication device such as a smartphone, tablet, PDA, laptop, desktop, etc., but is not limited thereto.

Referring to FIG. 3, first, the server configures condition list information corresponding to the participation qualification set by the manager for each of a plurality of crowdsourcing-based projects (S110). Accordingly, each condition list information is configured for each project.

Here, the condition list information is composed of one or more condition element information.

The condition element information includes a number of fields consisting of a unique identifier (SN) of a condition group to which the condition element belongs, a size (CS) of a condition group to which the condition element belongs, and a category and a category value of the condition element.

A condition group refers to one condition element or a set of one or more condition elements connected by an AND operation. A set of one or more condition groups connected by an OR operation can define an overall condition corresponding to participation qualification.

The size of a condition group means the number of one or more condition elements constituting the condition group. For example, if there is one condition element constituting the condition group, the size of the condition group is 1, and if there are five condition elements constituting the condition group, the size of the condition group is 5.

The conditional element is defined as a category and its category value. Category refers to the classification or type for conditions such as nationality, age, gender, place of birth, place of residence, foreign language ability, grade, and project history as described above.

4 is a diagram for describing condition list information of an exemplary project.

Suppose the manager of an exemplary project has set up eligibility to participate in the project so that a male in his 20s, a 30-year-old (regardless of gender), or a 25-year-old woman in bronze grade can participate in the project.

The conditional expression of the eligibility for participation in the above project will be as follows.

Conditional expression: (20s AND male) OR (30s) OR (bronze grade AND 25 years old AND female) Referring to FIG. 4, the condition list information of an exemplary project is composed of six conditional element information. That is, the participation qualification is defined as multiple conditions consisting of six condition elements.

As described above, each condition element information has a unique identifier of a condition group, a size of a condition group, a category of a condition element, and a category value as fields. Each conditional element information is described in order as follows.

The first condition element information is "1, 2, age, 20, 29, null". Accordingly, it can be seen that the first condition element belongs to the first condition group, and the size of the first condition group to which the first condition element belongs is 2. The first condition group further includes one condition element in addition to the first condition element. The first condition group corresponds to "(20s AND male)" in the above conditional expression. The category of the first condition element is age. And, the category values represent the minimum value (min), the maximum value (max), and the same value (equal) in order. That is, in the case of the first condition element, the age is greater than or equal to 20 and less than or equal to 29. Meanwhile, the category value may be expressed in different ways according to embodiments.

The second condition element information is "1, 2, gender, null, null, male". The second condition element belongs to the first condition group, and the size of the first condition group is 2 as described above. The category of the second condition element is gender, and its value must be male.

The third condition element information is "2, 1, age, 30, 39, null". The third condition element belongs to the second condition group, and the size of the second condition group to which the third condition element belongs is 1. That is, the second condition group is composed of only the third condition element information. The second condition group corresponds to "(30s)" in the above conditional expression. The category of the third condition element is age, and the category value is greater than or equal to 30 and less than or equal to 39. Interpretation, the third conditional element is that the 30s are the condition.

The fourth condition element information is "3, 3, level, 2 2, null". The fourth condition element belongs to the third condition group, and the size of the third condition group to which the fourth condition element belongs is 3. It can be seen that the third condition group is composed of three condition element information. The third condition group corresponds to "bronze grade AND 25 years old AND female)" in the above conditional expression. The category of the fourth condition element is level, and its value must be 2. For example, if the grade is classified as starter, bronze, silver, and gold, the number 2 may represent the bronze grade. The fourth condition element information is substantially the same as "3, 3, level, null, null, 2".

The fifth conditional element information is "3, 3, age, 25, 25, null". The fifth condition element belongs to the third condition group, and the size of the third condition group is 3 as described above. The category of the fifth conditional element is age, and its value must be 25. The fifth condition element information is substantially the same as "3, 3, age, null, null, 25".

The sixth condition element information is "3, 3, gender, null, null, Female". The sixth condition element information belongs to the third condition group, and the size of the third condition group is 3 as described above. The category of the sixth conditional element information is gender, and the value must be Female.

Referring back to FIG. 3, next, the server compares user information and condition list information for each of a plurality of users of the crowdsourcing platform, and filters a project matching the user among the plurality of projects (S120). Since each user has different characteristics, the projects that match each user are different.

5 is a flowchart of a project filtering step in a method for providing project information according to an embodiment of the present invention.

Referring to FIG. 5, in order to filter a project matching a user, first, the server compares user information and one or more condition element information of condition list information (S121).

Next, if the user does not satisfy the specific condition element according to the comparison result, the server determines that the user does not satisfy the condition group to which the specific condition element belongs (S122).

In the determining step (S122), in detail, the condition element that the user satisfies is filtered according to the comparison result of the user information and the condition element information, and filtered by condition group to which the filtered condition element belongs using the unique identifier of the condition group. It includes grouping condition elements, comparing the number of condition elements filtered for each condition group and CS of the condition group, and determining condition groups that the user does not satisfy according to the comparison result for each condition group.

Assume that the characteristics of an exemplary random user are as follows. That is, any user is a 25 year old male and has a bronze rating.

When the condition element information of the condition list information of the exemplary project of FIG. 4 is compared with the user information and the condition element that the user satisfies is filtered as shown in FIG. 6.

6 is a diagram for describing filtering of condition elements that are satisfied by an exemplary user.

Referring to FIG. 6, since the user is 25 years old, the first condition element and the fifth condition element are satisfied. And, since the user has a male gender, the second condition element is satisfied. In addition, since the user is a bronze grade, the fourth condition element is satisfied.

In some embodiments, the server may use a filter function of the database based on user information. The server may divide user information by category and filter by each category to extract conditional element information shown in FIG. 6.

An exemplary pseudo query syntax that can be used at this time is as follows.

WHERE (cat = age AND min <= 25 <= max) OR (cat = gender AND equal = M) OR (cat = level AND min <= 2 <= max)

On the other hand, it is the condition group, not each condition element, that must be determined whether or not the user is ultimately satisfied. Accordingly, the server groups the filtered condition elements for each condition group to which the filtered condition element belongs.

FIG. 7 is a diagram for explaining grouping of condition elements filtered for each exemplary condition group.

Referring to FIG. 7, a first condition element and a second condition element belonging to a first condition group are grouped together, and a fourth condition element and a fifth condition element belonging to a third condition group are grouped together.

In some embodiments, the server may use the group by function of the database based on the unique identifier of the condition group. The server may group each condition element for each condition group by using the unique identifier of the condition group included in each condition element information.

The server compares the number of condition elements (RN) filtered for each condition group with the CS of the condition group. As described above, the condition group is a set of one or more condition elements connected by an AND operation. When connected by AND operation, if the user does not satisfy any one condition element, the condition group cannot be satisfied as a whole. Therefore, the number of conditional elements filtered for each condition group and CS of the condition group are the same for the condition group that the user satisfies, and the number of conditional elements filtered for each condition group and the CS of the condition group are different for condition groups that the user does not satisfy. will be. An embodiment of the present invention solves a logic matching problem with high complexity by utilizing these characteristics.

In order to process the above discrimination more quickly, the server compares the square of the number of condition elements (RN) and the CS sum (CSS) of condition element information of the filtered condition element.

8 is a diagram for explaining determining whether a user meets each exemplary condition group.

Referring to FIG. 8, when comparing the first condition group first, the number of condition elements that belong to the first condition group and are filtered is 2 and its square is 4, and the sum of CS of condition element information of the filtered condition element Is 2+2=4, so the result of comparison is the same. If the result of the comparison is the same, the server determines that the user satisfies the first condition group.

Meanwhile, when comparing the third condition group, the number of condition elements that belong to the third condition group and the number of filtered condition elements is 2 and its square is 4, but the sum of CS of condition element information of the filtered condition element is 3+3= Since it is 6, it is a different value as a result of the comparison. If the result of the comparison is different as described above, the server determines that the user does not satisfy the third condition group.

An exemplary pseudo query syntax that can be used at this time is as follows.

SELECT COUNT(1) RN, SUM(CS) CSS… GROUP BY SN, SN HAVING RN^2 = CSS

Referring back to FIG. 5, next, the server filters a project matching a user among a plurality of projects according to the determination result of the condition group (S123).

The server may perform the project filtering step described with reference to FIG. 5 for each project, or may perform the entire project. In the former case, the server searches for a condition group that the user satisfies, and in the latter case, the server searches for a project of a condition group that the user satisfies.

To this end, each condition element information may further include a unique identifier (PID) of a project corresponding to the condition element.

9 is a diagram for describing example project condition list information further including a project unique identifier.

Referring to FIG. 9, each condition element information has a unique identifier of a project, a unique identifier of a condition group, a size of a condition group, a category and a category value of the condition element as fields.

And, in order to group the above-described filtered condition element information, and to determine the project of the condition group that the user satisfies or does not satisfy, the server uses the unique identifier of the project and the unique identifier of the condition group to generate the filtered condition element. Filtered condition elements are grouped by the project to which they belong and the section group.

An exemplary pseudo-query syntax that can be used at this time is modified as follows.

SELECT PID, COUNT(1) RN, SUM(CS) CSS… GROUP BY PID, SN HAVING RN^2 = CSS

Referring back to FIG. 3, the server provides information on the filtered project to the user (S130).

When the user logs in to the crowdsourcing platform, the server can provide the user with information about the filtered project as a list of available projects.

In addition, even when a user requests to refresh the list of participating projects while connected to the crowdsourcing platform, the server can provide information on the newly filtered project to the user by executing the above-described processes in real time. .

According to the embodiment of the present invention described above, the complexity of logical matching is not high even if the conditions for participation qualification of each project are repeatedly compared with the information of the user, so real-time performance is secured when providing project information suitable for individual users. At the same time, it has the advantage of minimizing the system load.

Meanwhile, in the above description, steps S11 to S123 may be further divided into additional steps or may be combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order between steps may be changed. In addition, even if other contents are omitted, the contents of FIG. 10 to be described later may also be applied to the method of providing project information matching the participation qualification of the crowdsourcing platform of FIGS. 1 to 9.

The method for providing project information matching the participation qualification of the crowdsourcing platform according to an embodiment of the present invention described above may be implemented as a program (or application) to be executed in combination with a computer as hardware and stored in a medium. .

The above-described program includes C, C++, JAVA, Ruby, which can be read by a processor (CPU) of the computer through the device interface of the computer, in order for the computer to read the program and execute the methods implemented as a program. It may include a code (Code) coded in a computer language such as machine language. Such code may include a functional code related to a function that defines necessary functions for executing the methods, and includes a control code related to an execution procedure necessary for the processor of the computer to execute the functions according to a predetermined procedure. can do. In addition, these codes may further include additional information required for the processor of the computer to execute the functions, or code related to a memory reference to which location (address address) of the internal or external memory of the computer should be referenced. have. In addition, when the processor of the computer needs to communicate with any other computer or server in the remote in order to execute the functions, the code uses the communication module of the computer to determine how It may further include a communication-related code for whether to communicate, what kind of information or media should be transmitted and received during communication.

The stored medium is not a medium that stores data for a short moment, such as a register, cache, memory, etc., but a medium that stores data semi-permanently and can be read by a device. Specifically, examples of the storage medium include, but are not limited to, ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like. That is, the program may be stored in various recording media on various servers to which the computer can access, or on various recording media on the user's computer. In addition, the medium may be distributed over a computer system connected through a network, and computer-readable codes may be stored in a distributed manner.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains can understand that it is possible to easily transform it into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

10: Client
20: service provider
30: public
32: worker
34: inspector

Claims (10)

As a method performed by a computer,
Configuring condition list information corresponding to participation qualifications set by a manager for each of a plurality of crowdsourcing-based projects (hereinafter, referred to as projects);
Comparing user information with the condition list information for each of a plurality of users of the crowdsourcing platform, and filtering a project matching the user among the plurality of projects; And
Providing information on the filtered project to the user,
The condition list information is composed of one or more condition element information,
The condition element information includes a unique identifier of a condition group to which the condition element belongs, a size (CS) of the condition group to which the condition element belongs, a category and a category value of the condition element,
The CS is the number of one or more condition elements constituting the condition group,
The condition group is one condition element or a set of one or more condition elements connected by an AND operation,
The condition corresponding to the participation qualification is defined as a set of one or more condition groups connected by an OR operation,
Filtering the projects that match the user among the plurality of projects,
Comparing the one or more condition element information of the user information and the condition list information; and
Determining that the user does not satisfy a condition group to which the specific condition element belongs, if the user does not satisfy a specific condition element according to a result of comparing the user information and the condition element information;
And filtering a project matching the user among the plurality of projects according to the determination result of the condition group,
When the user does not satisfy a specific condition element, determining that the user does not satisfy a condition group to which the specific condition element belongs,
Filtering the condition element that the user satisfies according to the comparison result of the user information and the condition element information,
Grouping the filtered condition elements for each condition group to which the filtered condition element belongs by using the unique identifier of the condition group,
Compare the number of the filtered condition elements for each condition group and the CS of the condition group,
Determining a condition group that the user does not satisfy, according to the comparison result for each condition group,
Comparing the number of the filtered condition elements for each condition group and the CS of the condition group,
Comparing the sum of the square of the number of condition elements and CS of condition element information of the filtered condition element,
How to provide project information that matches the qualifications for participation in the crowdsourcing platform. delete delete The method of claim 1,
The condition element information further includes a unique identifier of a project corresponding to the condition element,
Grouping the filtered condition elements for each condition group to which the filtered condition element belongs by using the unique identifier of the condition group,
Grouping the filtered condition elements by project and condition group to which the filtered condition element belongs using the unique identifier of the project and the unique identifier of the condition group,
How to provide project information that matches the qualifications for participation in the crowdsourcing platform. The method of claim 1,
The qualification for participation includes qualifications for at least one of nationality, age, gender, place of birth, place of residence, foreign language ability, grade, and project history,
How to provide project information that matches the qualifications for participation in the crowdsourcing platform. The method of claim 1,
The participation qualification includes a participation qualification for a worker of the project or a participation qualification for an inspector of the project,
How to provide project information that matches the qualifications for participation in the crowdsourcing platform. delete The method of claim 1,
The user information includes information on at least one of the user's nationality, age, gender, place of birth, residence, foreign language ability, grade, and project history,
How to provide project information that matches the qualifications for participation in the crowdsourcing platform. The method of claim 1,
Providing information on the filtered project to the user,
When the user logs in to the crowdsourcing platform, providing information on the filtered project to the user as a list of available projects,
How to provide project information that matches the qualifications for participation in the crowdsourcing platform. A computer-readable recording medium in order to perform a method of providing project information matching the qualification for participation in the crowdsourcing platform of any of paragraphs 1, 4 to 6, 8, and 9 in combination with a computer. A computer program stored on it.

Images