KR102156584B1 - Method for providing work rewarded advertisements using crowdsourcing based projects for artificial intelligence training data generation - Google Patents

Abstract

The present invention relates to a method for providing a work-rewarded advertisement using a crowdsourcing-based project for artificial intelligence learning data generation. The method includes: a step of generating user behavior data based on the participation history data of a general crowdsourcing-based project (hereinafter, first project) of a user registered on a platform; a step of setting a first project participation condition based on the participation history data and profile data of the user; a step of setting a target condition of an advertisement-type crowdsourcing-based project (hereinafter, second project) based on the profile data and the behavior data; a step of extracting users satisfying the participation condition out of all of the users registered on the platform as workers and generating the workers as a first worker group; a step of extracting users satisfying the target condition out of all of the users registered on the platform as workers and generating the workers as a second worker group; a step of assigning at least one general work of the first project to the workers in the first worker group, requesting work execution, and receiving the input of a general work result; and a step of assigning at least one advertisement-type work of the second project to the workers in the second worker group, requesting work execution, and receiving the input of an advertisement-type work result.

Description

A method of providing work rewarded advertisements using crowdsourcing-based projects for generating artificial intelligence learning data {METHOD FOR PROVIDING WORK REWARDED ADVERTISEMENTS USING CROWDSOURCING BASED PROJECTS FOR ARTIFICIAL INTELLIGENCE TRAINING DATA GENERATION}

The present invention relates to a method for providing a work rewarded advertisement using a crowdsourcing-based project.

Recently, more and more companies collect and process large amounts of data on a crowdsourcing basis that engages the general public in some process of corporate activities. In other words, by opening a project and allowing the general public, that is, workers to participate in the project, necessary information is collected through the work results completed by the workers.

At this time, in order to collect more reliable information, the company assigns the work result completed by the worker to the inspector to perform the inspection work.

Specifically, when one project is opened, a plurality of tasks are assigned to each of the plurality of workers. Each worker performs a plurality of tasks assigned to it, and provides the task results. Thereafter, a plurality of inspection tasks are assigned to each of the plurality of inspectors, and each inspector performs a plurality of inspection tasks assigned to them.

On the other hand, in the prior art marketing, there have been many cases where the target person feels unpleasant by being exposed to advertisements and marketing sources even in an unwanted situation. In order to solve this problem, reward-type marketing has emerged in the form of providing rewards to marketing targets such as reward-type advertising. However, in the case of the existing reward-type marketing, the target of the marketing is unclear, and when a specific action such as installing an application is performed, points are paid to an unspecified number of people.This is because the targeting is unclear. After installation, only points were paid and deleted immediately.

As another method, there is a method of providing rewards such as discounts at short-distance offline stores based on the location of the marketing target, but this is limited to offline and regional marketing because marketing information is provided based on the location information of the marketing target. There is a problem of becoming.

Unexamined Patent Publication No. 10-2014-0095956, 2014.08.04.

The problem to be solved by the present invention is to provide a method of providing a rewarded advertisement using a crowdsourcing-based project that enables effective targeted marketing.

However, the problem to be solved by the present invention is not limited to the problem as described above, and other problems may exist.

In order to solve the above-described problem, a method for providing a job compensation type advertisement using a crowdsourcing-based project according to the first aspect of the present invention includes the steps of obtaining profile data of a user registered in a crowdsourcing platform (hereinafter, the platform), the Generating the user's behavior data based on the participation history data of the user's general type crowdsourcing-based project (hereinafter referred to as the first project) registered on the platform, the first based on the profile data and the participation history data Setting a project participation condition, setting a target condition for an advertisement-type crowdsourcing-based project (hereinafter, referred to as a second project) based on the profile data and the behavior data, the participation among all users registered on the platform Extracting a plurality of users meeting conditions as workers, generating a first worker group including the extracted plurality of workers, selecting a plurality of users meeting the target condition among all users registered on the platform as workers And generating a second worker group including the extracted plurality of workers, requesting to perform work by assigning one or more general-type tasks of the first project to a plurality of workers of the first worker group, Receiving one or more general type work results, assigning one or more advertisement type jobs of the second project to a plurality of workers of the second worker group to request job performance, and receiving one or more advertisement type job results. Include. At this time, the inspection by the inspector is performed with respect to the general type work result, and the inspection by the inspector is not performed with respect to the advertisement type work result.

In some embodiments of the present invention, in relation to the general type work result, when the inspection result by the inspector and the general type work result pass the inspection, a predetermined work cost is paid to the workers of the first worker group, and the In relation to the advertisement-type work result, a predetermined advertisement reward may be paid to the workers of the second worker group.

In some embodiments of the present invention, the step of creating the second worker group includes extracting a plurality of users whose integrity is equal to or greater than a first reference value among all users registered on the platform and satisfying the target condition as workers. , It is possible to create a second worker group including the extracted plurality of workers.

In some embodiments of the present invention, the sincerity is occupied by each task based on a time when the task starts to be performed for each task assigned to the worker and a time when the task result is input after completing the task. The time is measured, and the actual time required for each task is measured based on the time when the worker accesses the online work space for performing the task for each task, and based on the occupied time and the actual time required, the It is possible to evaluate the level of integrity of the worker.

In some embodiments of the present invention, the step of creating the second worker group includes extracting a plurality of users whose participation level is greater than or equal to the second reference value and meets the target condition among all users registered on the platform as workers. , It is possible to create a second worker group including the extracted plurality of workers.

In some embodiments of the present invention, in the advertisement-type job, text, image, audio, or video for advertisement purposes may be provided as a job object for annotation.

In addition, the method of providing a job compensation type advertisement using a crowdsourcing project according to the second aspect of the present invention includes the steps of acquiring profile data of a user registered in a crowdsourcing platform (hereinafter, the platform), the user registered on the platform Generating the user's behavior data based on the participation history data of the crowdsourcing-based project (hereinafter referred to as the project), setting the participation condition of the project based on the profile data and the participation history data, the profile Setting a target condition for an advertisement-type job based on data and the behavioral data, extracting a plurality of users satisfying the participation condition among all users registered on the platform as workers, including the extracted plurality of workers Generating a group of workers, extracting a plurality of workers meeting the target condition from among the plurality of workers of the worker group, and generating a target group including a plurality of workers meeting the target condition, the worker Assigning one or more general-type tasks to a plurality of workers in the group to request the task to be performed, and receiving one or more general-type task results, one or more advertisement-type tasks to a plurality of workers of the target group among the plurality of workers of the worker group And requesting to perform the task by assigning it, and receiving one or more advertisement-type task results. At this time, the inspection by the inspector is performed with respect to the general type work result, and the inspection by the inspector is not performed with respect to the advertisement type work result.

In some embodiments of the present invention, in relation to the general type operation result, when the inspection result by the inspector and the general type operation result pass the inspection, a predetermined work cost is paid to the operator who performed the general type operation, and the Regarding the result of the advertisement type operation, a predetermined advertisement reward may be paid to the worker who has performed the advertisement type operation.

In some embodiments of the present invention, the step of generating the target group includes extracting a plurality of workers whose integrity is equal to or greater than a first reference value and satisfies the target condition from among a plurality of workers of the worker group, and the target condition It is possible to create a target group including a plurality of workers satisfying.

In some embodiments of the present invention, the sincerity is occupied by each task based on a time when the task starts to be performed for each task assigned to the worker and a time when the task result is input after completing the task. The time is measured, and the actual time required for each task is measured based on the time when the worker accesses the online work space for performing the task for each task, and based on the occupied time and the actual time required, the It is possible to evaluate the level of integrity of the worker.

In some embodiments of the present invention, the step of generating the target group comprises extracting a plurality of workers whose participation degree is greater than or equal to a second reference value and satisfies the target condition from among a plurality of workers of the worker group, and the target condition It is possible to create a target group including a plurality of workers satisfying.

In some embodiments of the present invention, in the advertisement-type job, text, image, audio, or video for advertisement purposes may be provided as a job object for annotation.

In some embodiments of the present invention, the general type job and the advertisement type job may be provided as the same type of job.

A computer program according to another aspect of the present invention for solving the above-described problems is combined with a computer that is hardware to execute a method for providing a job compensation type advertisement using the crowdsourcing-based project, and is stored in a computer-readable recording medium. .

Other specific details of the present invention are included in the detailed description and drawings.

According to the present invention described above, it is possible to provide customized advertisements to target workers through a work type, and by allowing target workers to experience real services through advertisement-type work, more effective targeting-based marketing is possible. There is this.

In addition, a separate advertisement reward is provided to target workers in exchange for performing the advertisement-type work, thereby minimizing the rejection of the advertisement-type work and enabling active participation in the work.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a conceptual diagram of a crowdsourcing service according to an embodiment of the present invention.
2 is a flowchart illustrating a crowdsourcing-based project progress process according to an embodiment of the present invention.
3 is a diagram illustrating an example of an advertisement type work.
4 is a flowchart of a method for providing a job reward type advertisement using a crowdsourcing-based project according to an embodiment of the present invention.
5 is a diagram for explaining occupation time and actual time required for each task.
6 is a view for explaining the integrity of each task.
7 is a view for explaining the content of evaluating the sincerity of the worker based on the sincerity of each job.
8 is a diagram for describing first and second worker groups.
9 is a flowchart of a method for providing a job reward type advertisement using a crowdsourcing-based project according to another embodiment of the present invention.
10 is a diagram for describing a worker group and a target group.
11 and 12 are diagrams for explaining a unit for setting a target condition.
13 is a diagram for explaining an apparatus for providing a job compensation type advertisement using a crowdsourcing-based project according to an embodiment of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms, only the present embodiments are intended to complete the disclosure of the present invention, It is provided to fully inform the technician of the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used in the specification, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements. Throughout the specification, the same reference numerals refer to the same elements, and “and/or” includes each and all combinations of one or more of the mentioned elements. Although "first", "second", and the like are used to describe various elements, it goes without saying that these elements are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical idea of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram of a crowdsourcing service according to an embodiment of the present invention.

Referring to FIG. 1, a crowdsourcing service is performed by being composed of a client 10, a service provider 20, and a public 30.

The sponsor 10 refers to a company or individual who requests a crowdsourcing-based project (hereinafter, referred to as a project).

The requester 10 requests a project for the purpose of collecting source data or annotating data for generating artificial intelligence learning data. The data generated through the project can be used as learning data for arbitrary machine learning such as supervised learning, unsupervised learning, and reinforcement learning. Collection of source data refers to collecting raw data such as recorded voice collection and photo collection. Data annotation refers to inputting relevant annotation data into source data such as text, photos, and videos. For example, the data annotation may include finding an entity in a given fingerprint or finding a similar sentence, but is not limited thereto. Meanwhile, the types of the above-described projects are only one embodiment, and various projects may be handled in the present invention according to the design of the client.

The service provider 20 refers to a company that provides crowdsourcing services.

When the service provider 20 receives a request for a project for a product or service from the client 10, the service provider 20 allocates a task for the project to the general public 30 and receives the work result from the public 30. Thereafter, the final product extracted based on the work result is provided to the client 10.

At this time, the service provider 20 provides a crowdsourcing service to the client 10 and the public 30 through a crowdsourcing platform (hereinafter, the platform). That is, when the service provider 20 receives a request for a project from the client 10, the service provider 20 opens the project on the platform. Thereafter, when the work result for the open project is received from the public 30, the project is terminated on the platform, and the final product may be extracted and provided to the client 10.

The public 30 refers to the general public participating in the project open on the platform. Here, the public 30 may register (or subscribe) to an application or website provided by the service provider 20 to participate in a project opened on the platform. This public 30 is referred to as a user.

The user may perform the role of the operator 32 or the inspector 34.

The worker 32 decides to participate in a specific project among a plurality of projects open on the platform. Thereafter, the operator 32 performs an operation such as collection of source data or data annotation, and transmits it to the platform.

The inspector 34 decides to participate in a specific project among a plurality of projects open on the platform. Thereafter, the inspector 34 inspects the result of the work performed by the operator 32. As a result of performing the inspection, the inspector 34 may perform inspection pass processing or rejection processing, and input a rejection reason during rejection processing. In the case of passing the inspection, it is not necessary to rework and re-examination due to this, so passing inspection has the same meaning as completion of inspection.

2 is a flowchart illustrating a crowdsourcing-based project progress process according to an embodiment of the present invention.

First, the requester 10 requests one or more projects to the service provider 20 (S11).

Thereafter, the service provider 20 opens the requested project on the platform (S12). At this time, the service provider 20 may determine the grade in consideration of the difficulty of the project before opening the project. That is, depending on the difficulty level, it is possible to determine which level or higher public 30 to expose the project. Accordingly, it is possible to increase the reliability of the work result of the project.

Thereafter, the service provider 20 requests the work by assigning the work to the workers 32 of the corresponding level or higher according to the level of the project (S13).

Thereafter, the worker 32 performs the assigned task (S14). In this case, the worker 32 may input the reason for the inability to work without performing the work for a work in which the work itself is impossible for some reason.

Thereafter, the service provider 20 receives the work result from the worker 32 (S15), and assigns the work result to the inspector 34 to request the inspection (S16).

Similarly, according to an embodiment of the present invention, only a suitable project may be exposed to the inspector 34 out of the total projects being performed according to the level set according to the difficulty of the project or the qualification requirements of the inspector 34.

Thereafter, the inspector 34 performs the assigned inspection (S17). At this time, the inspector 34 determines that the inspection is completed when it is determined that the work has been properly performed, and if it is determined that the inspection operation is wrong, the inspector 34 rejects it. During rejection processing, the inspector 34 inputs the rejection reason for what reason the job was judged to be wrong.

Thereafter, the service provider 20 receives the inspection result from the inspector 34 (S18).

When the inspection result is the inspection completion, the service provider 20 uses the work result as valid data, and based on this, extracts the final product at the end of the project.

When the inspection result is rejection processing, the service provider 20 may internally perform the inspection again, or assign the work to the worker 32 again to perform the rework. When reworking, re-examination by an inspector is required.

Thereafter, when the project period ends or sufficient valid data is secured, the service provider 20 terminates the project (S19), calculates a final result based on the secured valid data, and provides it to the client 10 ( S20).

At this time, before the end of the project, the service provider 20 evaluates the performance results of the worker 32 and the inspector 34, calculates the work cost and the inspection cost according to the evaluation, to the worker 32 and the inspector 34. give.

In FIGS. 1 and 2, it is simply expressed as a requester 10, a service provider 20, an operator 32, and an inspector 34, but these are smartphones, tablets, PDAs, laptops, desktops, operated by each participant. It means a computer device such as a server or a telecommunication device.

Meanwhile, according to an embodiment of the present invention, in a crowdsourcing-based project, a matter to be marketed according to an advertiser's request may be planned and configured into a work, which is referred to as an advertisement type work.

3 is a diagram illustrating an example of an advertisement type work.

In the advertising-type work, text, images, audio, or video for advertising purposes may be provided as a work object for annotation.

Annotation refers to a preprocessing process in which machine-understandable metadata is added to raw data for artificial intelligence learning.

For example, after an advertisement phrase is provided as text, a specific word is tagged, an advertisement image is provided and a specific area of the image is labeled or transcribed, an image of a specific product is collected, an advertisement voice is provided and an advertisement voice An advertisement type operation may include writing down an advertisement, reading an advertisement phrase and performing a voice recording, providing an advertisement video and labeling or transcribing a specific area of an image of a predetermined frame of the advertisement video. .

As an example of an advertisement type operation, there may be an operation of selecting a specific area within a given advertisement image as shown in Fig. 3(a) and inputting text corresponding to the specific area, as shown in Fig. 3(b). There may be a task of listening to the advertisement voice and writing down the content. In the process of performing all of these tasks, workers are exposed to advertisements, and by being exposed to advertisements, the purpose of advertising-type work is achieved.

After this advertisement-type task is created, the generated advertisement-type task is assigned to the worker 32. At this time, the generated advertisement-type task may be assigned to all workers 32, but in order to further maximize the advertisement effect, the worker 32 that satisfies the target condition is extracted, and the advertisement-type task is assigned only to the extracted worker group. can do.

The crowdsourcing platform holds the profile data of workers and manages project participation history data for each worker, so accurate targeting can be achieved by cross-checking the profile data and project participation history data.

Accordingly, an embodiment of the present invention has the advantage of enabling more effective targeting-based marketing by allowing targeted workers to provide customized advertisements or allowing target workers to experience real services through advertisement-type work. . In addition, a separate advertisement reward is provided to target workers in exchange for performing the advertisement-type work, thereby minimizing the rejection of the advertisement-type work and enabling active participation in the work.

Hereinafter, a method of providing a job compensation type advertisement using a crowdsourcing-based project according to an embodiment of the present invention will be described with reference to FIGS. 4 to 8.

4 is a flowchart of a method for providing a job reward type advertisement using a crowdsourcing-based project according to an embodiment of the present invention. 5 is a diagram for explaining occupation time and actual time required for each task. 6 is a view for explaining the integrity of each task. 7 is a view for explaining the content of evaluating the sincerity of the worker based on the sincerity of each job. 8 is a diagram for describing first and second worker groups.

Meanwhile, the steps shown in FIGS. 4 and 9 to be described later may be understood as being performed by a platform server (hereinafter, referred to as a server) operated by the service provider 20, but are not limited thereto.

In addition, a plurality of workers 32 or a plurality of inspectors 34 perform work using a predetermined terminal device. The terminal device of the operator 32 or the inspector 34 may be a computer device or a telecommunication device such as a smartphone, tablet, PDA, laptop, desktop, etc., but is not limited thereto.

First, referring to FIG. 4, the server acquires profile data of a user registered in the crowdsourcing platform (S110).

In one embodiment, the user's profile data may be data representing demographic attributes. For example, it may be nationality, age, gender, place of birth, place of residence, foreign language ability, work grade (starter, bronze, silver, gold, etc.), but is not limited thereto.

Next, the user's behavior data is generated based on the participation history data of the user's general type crowdsourcing-based project (hereinafter referred to as the first project) registered on the platform (S120).

Here, the first project is a project that does not contain an advertising element, and targets users who meet the participation condition among all users registered on the platform. That is, an embodiment of the present invention is characterized in that a general type crowdsourcing-based project and an advertisement type crowdsourcing-based project to be described later are strictly separated.

In one embodiment, the participation history data refers to data that records the details of the project that each user has participated in, the activity content and evaluation over time. For example, the participation history data may include the name and type of the participating project, the date and time of the participation, the number of work performed by project, the inspection result, rejection rate, work execution time, and the cumulative work cost paid to date. However, it is not limited thereto.

Examples of participation history data include'foreign language translation work participation history data','foreign language image collection work participation history data','indoor work average daily execution time data','outdoor image collection work participation history data and execution time data' ','Fashion image binding and tagging work participation history data and execution time data','Cosmetic attribute input tagging work participation history data and execution time data','Image landmark work participation history data','Vehicle usage work participation history data This includes'and'data on the history of image work on wearing glasses'.

Behavioral data refers to data obtained by analyzing certain major behavior patterns that appear when users use crowdsourcing services within the platform. For example, behavioral data is a variety of behavioral patterns that appear when real users perform a project, such as the duration of their stay abroad, working hours indoors or outdoors during a certain period (daily average, weekly average, work unit, etc.), and working time per category. This may be the case.

For example, based on'foreign language image collection work participation history data', if you participated in image collection in the same country two or more times, and it is confirmed that the difference in period between participating projects is more than 1 month, The identified behavioral data can be created and considered together with the profile data to be set as target conditions.

As another example, based on the'average daily indoor working time data', workers with an average daily indoor working time within the top 30% are targeted as people with low physical activity to advertise health functional foods, exercise products, massage devices, etc. Type tasks can be assigned, and based on'outdoor image collection work participation history data and execution time data' and'indoor work average daily execution time data', the number of outdoor tasks is more than the average of all workers. It is possible to generate behavioral data for which the worker is determined to have a large amount of physical activity, and consider this together with profile data to set as a target condition.

As another example, based on'fashion image bounding and tagging work participation history data and execution time data', a group with a corresponding task execution time within the top 30% and a work load within the top 30% has behavioral data with high fashion interest. It can be viewed as a target for fashion interest groups.

Next, the participation condition of the first project is set based on the profile data and participation history data (S130).

At this time, the participation condition means a condition for identifying the worker 32 who can perform the work included in the first project well.

As an example, the conditions for participation in the first project may be set as '3 years overseas residence' and'foreign language translation work history', which is based on the profile data obtained in step S110, whether there is a user who has lived in foreign countries for 3 years or more. Participation conditions are set in consideration of whether there are users whose projects previously participated in foreign language translation work from participation history data, and the number of these users.

Next, a target condition for an advertisement-type crowdsourcing-based project (hereinafter referred to as a second project) is set based on the profile data and the behavior data (S140).

Here, the second project means a project created for the purpose of advertising only. That is, the work of the second project is an advertisement provided in the form of a work, and the advertisement effect is generated as the worker 32 performs the work. The advertisement type work has the same appearance as the general type work aimed at generating artificial intelligence learning data, but the work result is not used as artificial intelligence learning data because it is intended for advertising effect in the work process.

In addition, the target condition refers to a condition for identifying the worker 32 that is expected to have a large advertising effect, unlike the participation condition. Accordingly, participation conditions are set using profile participation history data, but target conditions are set using behavior data.

Next, among all users registered on the platform, a plurality of users that satisfy the participation condition are extracted as workers 32, and a first worker group including the extracted plurality of workers 32 is generated (S150).

In addition, among all users registered on the platform, a plurality of users that meet the target condition are extracted as workers 32, and a second worker group including the extracted plurality of workers 32 is generated (S160).

In an embodiment, the second worker group may be created to include workers 32 who have obtained prior consent for advertisement-type task assignment including personal information processing. Workers who do not obtain consent do not belong to the second worker group, and instead may belong to the first worker group depending on whether or not they are eligible to participate.

In some embodiments, the second worker group extracts a plurality of users whose integrity is equal to or greater than the first reference value and satisfies the target condition among all users registered on the platform as the worker 32, and the extracted plurality of workers ( 32) can be created to include.

Here, sincerity can be evaluated using the history of the first project that the worker 32 participated in. Specifically, sincerity may be evaluated based on occupation time for each task and actual time required for each task.

Specifically, the time occupied by each task is measured based on the time when the task starts to be performed for each task assigned to the worker 32 and the time at which the task is completed and the task result is input.

In this case, the occupation time for each job means the time to which job data is allocated. Specifically, the time to which the work data is allocated refers to the time when the worker 32 started performing the work and the time when the work result was input, and the time when the work started was assigned by the worker 32 according to the embodiment. It may be the time it was received. In this embodiment, when the worker 32 requests the next task after completing any one task, the next task is assigned and the task can be started.

After measuring the occupation time for each task, the actual time required for each task is measured based on the time when the worker 32 accesses the online workspace for performing the task for each task.

Here, the online workspace means a space in which online tasks such as a web page or a page on an application or a specific URL provided by a server can be performed.

At this time, in order to more accurately measure the actual time required, an embodiment of the present invention may measure the response of the worker 32. For example, in order to accurately measure the actual time required even when the worker 32 is eating or doing personal business while accessing the online workspace, in the case of a PC, movement of a mouse or keystroke is periodically performed. Can be measured. In the case of mobile, a camera can be used, an acceleration/gyro sensor can be used, a touch input, or whether an application for performing a task is activated can be checked.

Referring to FIG. 5, the occupied time for each task and the actual time required for each task are as follows.

First, a specific worker 32 started performing a certain task at 17:35:00 on December 11, and stopped for 12 minutes after performing the task for 30 seconds. After that, I reconnected to the online workspace at 17:47:30, performed it for 20 seconds, and then stopped for 12 minutes. Finally, after accessing the online workspace again at 17:59:50 time and executing it for 10 seconds, the work result was entered at 18:00:00 time.

In this case, the total time that the worker 32 occupied one work is 1500 seconds, but the actual work time is only 60 seconds.

In order to minimize the discrepancy between the time occupied by a task and the actual work time as described above, an embodiment of the present invention measures the occupation time (1500 seconds) for each task and the actual time required (60 seconds) for each task. After, it is characterized by using it.

Then, based on the occupied time and the actual required time, the integrity of the worker 32 is evaluated.

In one embodiment, based on the occupied time and the actual required time, it is possible to evaluate the integrity of the worker 32 for each job. In this case, the integrity of each task may be evaluated as a value obtained by dividing the actual work time for each task by the occupied time. After the integrity of each job is evaluated, the sincerity of the worker 32 can be evaluated by summing and averaging the integrity of each job.

Referring to FIG. 6, the worker 32 started performing work at 18:01 on December 11, and when submitting the work result at 18:02, the occupation time and actual time required are the same as 60 seconds, respectively. Do. In this case, the integrity of the work is evaluated as 1.

That is, the maximum value of the sincerity of each job is 1, and the maximum value of the sincerity of the worker 32 calculated by summing and averaging them is also 1.

According to this method, the sincerity for each job of the worker 32 shown in FIG. 7 is calculated as 1/60 for the ID 1001 job, and for ID 1002 and ID 1003 jobs. Each job's integrity is calculated as 1, and in the case of ID 1004, the job's integrity is calculated as 1/1329.

In addition, by summing and averaging each job's sincerity for four cases, the sincerity of the worker 32 is calculated as 0.5049.

If the sincerity of the worker 32 is evaluated, then, an embodiment of the present invention selects the worker 32 whose sincerity is equal to or greater than a predetermined first reference value among the plurality of workers 32. The predetermined first reference value, which is a reference, may be a specific ranking when the sincerity of the plurality of workers 32 is sorted in descending order. Alternatively, it may be a specific value. For example, the first reference value may be an average value of the sincerity of the workers 32 participating in the project. That is, it is possible to extract workers 32 having a specific ranking or higher or an average value or higher, and organize them into a second worker group according to whether or not the target condition is satisfied.

As described above, an embodiment of the present invention extracts users who meet the sincerity and target conditions among all users registered on the platform as workers 32 of the second worker group, so that the advertisement effect is expected to be low due to low work concentration. There is an advantage of being able to select innocent workers in advance.

In some other embodiments, the second worker group extracts, as the worker 32, a plurality of users whose participation level is greater than or equal to the second reference value and satisfies the target condition among all users registered on the platform, It can be created to include the worker 32.

The degree of participation may be calculated based on the participation history data, for example, the number of projects that the worker 32 participated in, the number of tasks performed, and the number of participation in a random project during a recent certain period.

As in the case of using sincerity, when the participation of the workers 32 is calculated, the second reference value or more corresponding to a specific value such as a specific rank or average value when the participation of the plurality of workers 32 is sorted in descending order. Worker 32 can be extracted.

As described above, according to an embodiment of the present invention, by pre-selecting and excluding the workers 32 who are likely not to enter the project as participants, it is possible to prevent the advertisement effect from being lowered due to assignment of advertisement-type tasks to them.

Referring again to FIG. 4, a request for performing a task by assigning one or more general-type tasks of the first project to a plurality of workers 32 of the first worker group, and receiving one or more general-type task results (S170).

At this time, with respect to the general type work result, the inspection by the inspector 34 is performed, and when the inspection by the inspector 34 passes, a predetermined work cost is paid to the workers 32 of the first worker group. .

Likewise, one or more advertisement-type tasks of the second project are assigned to the plurality of workers 32 of the second worker group to request task performance, and one or more advertisement-type task results are input (S180).

At this time, in the case of the advertisement type work result, unlike the general type work result, the inspection by the inspector 34 is not performed, and a predetermined advertisement reward is paid to the worker 32 of the second worker group. That is, in the advertisement-type work, a certain level of advertisement effect is generated through the exposure of the advertisement content to the worker 32, and this has achieved the purpose of the advertisement-type work, and the inspection by the inspector 34 is not performed. .

On the other hand, the advertisement rewards paid as a result of performing the advertisement-type work are different in nature from the work costs paid as a result of performing the general-type work, and the size and form of the amount paid may be different. In other words, the cost of work is paid only when the work is normally performed and when the inspection is passed, whereas the advertisement reward is a specific condition due to advertisement such as when exposed to an advertising type work or when the relevant advertising type work is completed. They are differentiated because they are paid if they are satisfied.

In one embodiment, the workers 32 included in the first worker group and the second worker group may be different workers 32, respectively.

Referring to FIG. 8A, the first worker group performing the first project is created to include workers A, B, and C, and the second worker group performing the second project is included in the first worker group. It can be created to include workers a, b, and c that are not.

In another embodiment, the first worker group and the second worker group may be created so that some of the workers 32 are duplicated.

Referring to (b) of FIG. 8, the first worker group performing the first project is created to include workers A, B, and C, and the second worker group performing the second project is included in the first worker group. It can be created to include workers A, C and other workers D.

This is because workers are selected according to the conditions of participation in the first worker group performing the first project, and workers are selected according to the target conditions in the case of the second worker group performing the second project.

In this case, workers A and C may be provided with both the work included in the first project and the work included in the second project. Alternatively, when the number of tasks to be performed for each worker 32 is determined, only tasks included in any one project may be provided. The number of tasks to be performed for each worker 32 may be determined according to the speed of the work progress, and for workers 32 belonging to both the first and second worker groups, the tasks included in the first project or the second project are It can be provided randomly according to the.

Meanwhile, each worker included in the worker group can participate in the project and decide whether to actually perform the task according to the individual's choice. Therefore, when creating the second worker group, the above-described degree of participation should be considered.

Hereinafter, a method of providing a job reward type advertisement using a crowdsourcing-based project according to another embodiment of the present invention will be described with reference to FIGS. 9 to 12. In this case, the content overlapping with the embodiment in FIGS. 4 to 8 will be omitted, and a description will be made focusing on the discriminating content.

9 is a flowchart of a method for providing a job reward type advertisement using a crowdsourcing-based project according to another embodiment of the present invention. 10 is a diagram for describing a worker group and a target group.

In this case, the embodiment of FIG. 9 is an embodiment in which, unlike the embodiment of FIG. 4, the general type project and the advertisement type project are not strictly separated, and a general type task and an advertisement type task are allocated within one project.

In this case, since the general type job and the advertisement type job are provided as the same type of job, the worker 32 included in the target group cannot distinguish between the general type job and the advertisement type job. For example, if the general type operation is to label or transfer a specific area among the provided images and a predetermined source image is provided, the advertisement type operation differs only in the provision of the advertisement image, and the operator 32 Since the content of the task to be performed is the same, the worker 32 cannot distinguish it.

Referring to FIG. 10, the general type work and the advertisement type work are not strictly classified and are all included in one project. In addition, the target group is composed of workers 32 who satisfy the target condition within the worker group, and the target group is created to belong to the worker group.

When the worker group and the target group are created in this way, only the general type job is provided to the worker group, but not only the general type job is provided to the target group, but at least one of a general type job and an advertisement type job may be provided.

Specifically, referring to FIG. 9, the server acquires profile data of a user registered on the crowdsourcing platform (S210), and generates user behavior data based on the participation history data of the crowdsourcing-based project of the user registered on the platform. (S220).

Next, a project participation condition is set based on the profile data and participation history data (S230), and a target condition of the advertisement-type work is set based on the profile data and behavior data (S240).

Next, among all users registered on the platform, a plurality of users meeting the participation condition is extracted as the worker 32, and a worker group including the extracted plurality of workers 32 is created (S250), and A target group including a plurality of workers 32 meeting the target condition is generated by extracting a plurality of workers 32 meeting the target condition from among the plurality of workers 32 (S260).

In one embodiment, the target group may be created to include workers 32 who have obtained prior consent for assignment of advertisement-type tasks including personal information processing.

In another embodiment, the target group extracts a plurality of workers 32 whose integrity is greater than or equal to the first reference value and meets the target condition from among the plurality of workers 32 of the worker group, and meets the target condition ( 32) can be created to include.

In another embodiment, the target group extracts a plurality of workers 32 whose participation is greater than or equal to the second reference value and satisfies the target condition among the plurality of workers 32 of the worker group, and meets the target condition. It can be created to contain (32).

Next, the task is requested by assigning one or more general-type tasks to the plurality of workers 32 of the worker group, and one or more general-type task results are inputted (S270), and the target group among the plurality of workers 32 of the worker group At least one advertisement type task is assigned to the plurality of workers 32 to request the task to be performed, and one or more advertisement type task results are input (S280).

At this time, the inspection by the inspector 34 is performed with respect to the general type work result, and the inspection by the inspector 34 is not performed with respect to the advertisement type work result.

Accordingly, in the case of the general type work result, if the inspection result by the inspector 34 passes, a predetermined work cost is paid to the worker 32 who performed the general type work. A predetermined advertisement reward is paid to the worker 32 who performed the operation.

11 and 12 are diagrams for explaining a unit for setting a target condition.

The present invention sets a target condition for an advertisement-type job based on user profile data and behavior data.

In an embodiment, the target condition may be set on a project basis. When the target condition is set based on the project unit, once the target group is created according to the target condition, the target group is maintained from the start to the end of the project. This has the advantage of being able to more easily manage worker groups and target groups until the end of the project from the project manager's perspective.

Referring to FIG. 11 for another embodiment, a target condition may be set for each individual advertisement type work unit. For example, a target condition may be managed in a form in which a first target group is generated for each first advertisement type job and a second target group is generated for each second advertisement type job.

The generation of the target group according to the target condition may be generated as an order of performing advertisement-type tasks arrives during the progress of the project, or a plurality of target groups may be generated and managed for each advertisement-type task in advance at the start of the project.

Referring to FIG. 12 as another embodiment, a target condition may be set for each of a plurality of advertisement-type work group units. This complements the two embodiments described above, and when target conditions are set and managed for each project unit, the target group is collectively created at the start of the project, so the accuracy of matching between the workers 32 of the target group and the advertisement-type work is There is a drawback of being low, and when target conditions are set and managed for each advertisement-type work unit, the matching accuracy is high, but when the number of workers 32 or advertisement-type jobs in the target group is large, management is burdened, which in turn leads to project progress. It will affect the duration.

Therefore, the disadvantages of the above two cases can be compensated for by managing the target group by setting the target condition for each of a plurality of advertisement-type work group units.

In the present invention, in the case of advertisement-type work, it has been described that it is not subject to the inspection by the inspector 34, but the present invention is not necessarily limited thereto, and the advertisement-type job can also be inspected by the inspector 34 according to the embodiment. Of course. In this case, the advertisement-type work may be provided to the workers 32 in the form of a work requiring inspection, not simply for the purpose of advertisement. In addition, the work result for the advertisement-type work may be provided to the general inspectors 34, and according to the embodiment, the inspector 34 that satisfies the target condition is extracted and set as a target group. By allowing the inspection to be assigned, the advertisement effect can be provided just by performing the inspection by the inspectors 34 of the target group.

Meanwhile, in the above description, steps S11 to S280 may be further divided into additional steps or may be combined into fewer steps according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order between steps may be changed. In addition, even if other contents are omitted, the contents of FIG. 13 to be described later can also be applied to the method of providing a job compensation type advertisement using the crowdsourcing-based project of FIGS. 1 to 12.

Hereinafter, an apparatus 300 for providing a job compensation type advertisement using a crowdsourcing-based project according to an embodiment of the present invention will be described.

13 is a diagram for explaining a work compensation type advertisement providing apparatus 300 using a crowdsourcing-based project according to an embodiment of the present invention.

Referring to FIG. 13, the apparatus 300 for providing a job compensation type advertisement using a crowdsourcing-based project according to the present invention includes a communication module 310, a memory 320, and a processor 330.

The communication module 310 transmits a crowdsourcing-based work for one project to a plurality of workers 32 to request a task to be performed, and receives work results from the plurality of workers 32. Further, the work results received from the plurality of workers 32 are transmitted to the plurality of inspectors 34 to request inspection, and the inspection results are received from the plurality of inspectors 34.

The memory 320 stores a program for creating and managing a worker group for performing an advertisement type task among all users registered in the platform. In addition, the memory 320 stores and manages profile data, participation history data, and behavior data of all users registered on the platform.

The processor 330 executes a program stored in the memory 320. As the processor 330 executes the program stored in the memory 320, it acquires profile data of all users registered on the platform, and generates behavior data based on participation history data of a general crowdsourcing-based project, Based on profile data and participation history data, general project participation conditions are set, and target conditions for advertisement-type crowdsourcing-based projects are set based on profile data and behavior data.

According to these participation conditions and target conditions, a worker group that satisfies the participation condition and a worker group that satisfies the target condition is created among all users registered on the platform, and the task result is assigned and requested to perform each of the general type task and the advertising type task It receives input.

In this case, according to an embodiment of the present invention, a general-type project and an advertisement-type project can be created to be distinguished, and in this case, a worker group performing a general-type task and an advertisement-type task are also distinguished. On the contrary, it can be created to include general type tasks and advertisement type tasks in one project, and in this case, the worker group performing the advertisement type task is extracted from the worker group performing the general type task. You can do it all.

The apparatus 300 for providing a job reward type advertisement using the crowdsourcing-based project described with reference to FIG. 13 may be provided as a component of the above-described server.

The above-described method for providing a job compensation type advertisement using a crowdsourcing-based project according to an embodiment of the present invention described above may be implemented as a program (or application) to be executed in combination with a computer, which is hardware, and stored in a medium. .

The above-described program includes C, C++, JAVA, Ruby, which can be read by a processor (CPU) of the computer through the device interface of the computer, in order for the computer to read the program and execute the methods implemented as a program. It may include a code (Code) coded in a computer language such as machine language. Such code may include a functional code related to a function defining necessary functions for executing the methods, and a control code related to an execution procedure necessary for the processor of the computer to execute the functions according to a predetermined procedure. can do. In addition, these codes may further include additional information required for the processor of the computer to execute the functions, or code related to a memory reference to which location (address address) of the internal or external memory of the computer should be referenced. have. In addition, when the processor of the computer needs to communicate with any other computer or server in the remote in order to execute the functions, the code uses the communication module of the computer to determine how It may further include a communication-related code for whether to communicate, what kind of information or media should be transmitted and received during communication.

The stored medium is not a medium that stores data for a short moment, such as a register, cache, memory, etc., but a medium that stores data semi-permanently and can be read by a device. Specifically, examples of the storage medium include, but are not limited to, ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like. That is, the program may be stored in various recording media on various servers to which the computer can access, or on various recording media on the user's computer. In addition, the medium may be distributed over a computer system connected through a network, and computer-readable codes may be stored in a distributed manner.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

10: Client
20: service provider
30: public
32: worker
34: inspector
300: Job compensation type advertisement providing device
310: communication module
320: memory
330: processor

Claims (15)

As a method performed by a computer,
Obtaining profile data of a user registered in a crowdsourcing platform (hereinafter, the platform);
Generating the user's behavior data based on the participation history data of the user's general crowdsourcing-based project (hereinafter, referred to as the first project) registered on the platform;
Setting a participation condition of the first project based on the profile data and the participation history data;
Setting a target condition for an advertisement-type crowdsourcing-based project (hereinafter, referred to as a second project) based on the profile data and the behavior data;
Extracting a plurality of users satisfying the participation condition among all users registered on the platform as workers, and creating a first worker group including the extracted plurality of workers;
Extracting a plurality of users satisfying the target condition from among all users registered on the platform as workers, and generating a second worker group including the extracted plurality of workers;
Assigning one or more general-type tasks of the first project to a plurality of workers of the first worker group to request a task to be performed, and receiving one or more general-type task results; And
Allocating one or more advertisement-type tasks of the second project to a plurality of workers of the second worker group to request task performance, and receiving one or more advertisement-type task results,
In relation to the general type work result, an inspection by an inspector is performed, and in relation to the advertisement type operation result, an inspection by the inspector is not performed,
With respect to the general type work result, when the inspection result by the inspector and the general type work result pass the inspection, a predetermined work cost is paid to the workers of the first worker group, and in relation to the advertisement type work result, To pay and process a predetermined advertisement reward to the workers of the second worker group,
A method of providing work rewarded advertisements using crowdsourced projects. delete The method of claim 1,
The step of creating the second worker group,
Extracting a plurality of users whose integrity is equal to or greater than a first reference value and meets the target condition among all users registered on the platform as workers, and generates a second worker group including the extracted plurality of workers,
A method of providing work rewarded advertisements using crowdsourced projects. The method of claim 3,
The above sincerity is,
For each task assigned to the worker, the occupation time for each task is measured based on the time when the task starts to be performed and the time when the task is completed and the task result is input,
The actual time required for each task is measured based on the time the worker accesses the online workspace for performing the task for each task,
To evaluate the integrity of the worker based on the occupancy time and the actual required time,
A method of providing work rewarded advertisements using crowdsourced projects. The method of claim 1,
The step of creating the second worker group,
Extracting a plurality of users whose participation level is greater than or equal to a second reference value and meets the target condition among all users registered on the platform as workers, and generates a second worker group including the extracted plurality of workers,
A method of providing work rewarded advertisements using crowdsourced projects. The method of claim 1,
The advertising-type work is provided in which text, image, voice, or video for advertising purposes is provided as a work object for annotation,
A method of providing work rewarded advertisements using crowdsourced projects. A computer program combined with a computer and stored in a computer-readable recording medium to execute a method for providing a job reward type advertisement utilizing the crowdsourcing-based project of any one of claims 1, 3 to 6. As a method performed by a computer,
Obtaining profile data of a user registered in a crowdsourcing platform (hereinafter, the platform);
Generating behavior data of the user based on participation history data of the user's crowdsourcing-based project (hereinafter, referred to as project) registered on the platform;
Setting a participation condition of the project based on the profile data and the participation history data;
Setting a target condition of an advertisement type job based on the profile data and the behavior data;
Extracting a plurality of users satisfying the participation condition among all users registered on the platform as workers, and generating a worker group including the extracted plurality of workers;
Extracting a plurality of workers satisfying the target condition from among a plurality of workers in the worker group, and generating a target group including a plurality of workers meeting the target condition;
Allocating one or more general-type tasks to a plurality of workers of the worker group, requesting to perform a task, and receiving one or more general-type task results; And
Allocating one or more advertisement-type tasks to a plurality of workers in the target group among the plurality of workers in the worker group, requesting to perform a task, and receiving one or more advertisement-type task results,
In relation to the general type work result, an inspection by an inspector is performed, and in relation to the advertisement type operation result, an inspection by the inspector is not performed,
Regarding the general type work result, when the inspection result by the inspector and the general type work result pass the inspection, a predetermined work cost is paid to the worker who performed the general type work, and in relation to the advertisement type work result, To pay and process a predetermined advertisement reward to the worker who performed the advertisement-type operation,
A method of providing work rewarded advertisements using crowdsourced projects. delete The method of claim 8,
The step of creating the target group,
Extracting a plurality of workers meeting the target condition and having a sincerity of the plurality of workers of the worker group is greater than or equal to a first reference value, and generating a target group including a plurality of workers meeting the target condition,
A method of providing work rewarded advertisements using crowdsourced projects. The method of claim 10,
The above sincerity is,
For each task assigned to the worker, the occupation time for each task is measured based on the time when the task starts to be performed and the time when the task is completed and the task result is input,
The actual time required for each task is measured based on the time the worker accesses the online workspace for performing the task for each task,
To evaluate the integrity of the worker based on the occupancy time and the actual required time,
A method of providing work rewarded advertisements using crowdsourced projects. The method of claim 8,
The step of creating the target group,
Extracting a plurality of workers whose participation degree is greater than or equal to a second reference value and satisfies the target condition from among the plurality of workers of the worker group, to generate a target group including a plurality of workers meeting the target condition,
A method of providing work rewarded advertisements using crowdsourced projects. The method of claim 8,
The advertising-type work is provided in which text, image, voice, or video for advertising purposes is provided as a work object for annotation,
A method of providing work rewarded advertisements using crowdsourced projects. The method of claim 8,
The general type job and the advertisement type job are provided as the same type of job,
A method of providing work rewarded advertisements using crowdsourced projects. A computer program combined with a computer and stored in a computer-readable recording medium to execute a method for providing a job reward type advertisement utilizing the crowdsourcing-based project of any one of claims 8 and 10 to 14.

Images