WO2021133076A1 - Procédé et dispositif de gestion du prix unitaire de travail d'un projet basé sur l'externalisation ouverte pour la génération de données d'apprentissage d'intelligence artificielle - Google Patents

Procédé et dispositif de gestion du prix unitaire de travail d'un projet basé sur l'externalisation ouverte pour la génération de données d'apprentissage d'intelligence artificielle Download PDF

Info

Publication number
WO2021133076A1
WO2021133076A1 PCT/KR2020/019043 KR2020019043W WO2021133076A1 WO 2021133076 A1 WO2021133076 A1 WO 2021133076A1 KR 2020019043 W KR2020019043 W KR 2020019043W WO 2021133076 A1 WO2021133076 A1 WO 2021133076A1
Authority
WO
WIPO (PCT)
Prior art keywords
time
work
project
task
crowdsourcing
Prior art date
Application number
PCT/KR2020/019043
Other languages
English (en)
Korean (ko)
Inventor
박민우
김지선
Original Assignee
주식회사 크라우드웍스
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=72471435&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=WO2021133076(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by 주식회사 크라우드웍스 filed Critical 주식회사 크라우드웍스
Publication of WO2021133076A1 publication Critical patent/WO2021133076A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063—Operations research, analysis or management
    • G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063—Operations research, analysis or management
    • G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
    • G06Q10/06311—Scheduling, planning or task assignment for a person or group
    • G06Q10/063112—Skill-based matching of a person or a group to a task
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/10—Office automation; Time management
    • G06Q10/103—Workflow collaboration or project management

Definitions

  • the present invention relates to artificial intelligence learning data generation, and more particularly, to a method and apparatus for managing unit cost of a crowdsourcing-based project.
  • a company opens a project and collects necessary information (result data) by allowing the general public, that is, workers and inspectors, to participate in the project.
  • the company assigns the results of the work completed by the operator to the inspector to perform the inspection.
  • each task is assigned to a plurality of workers.
  • Each worker performs a plurality of assigned tasks and provides task results.
  • the difficulty of the project may increase over time because workers proceed with easy tasks first.
  • the problem to be solved by the present invention is to provide a method and apparatus for managing the work unit cost of a crowdsourcing-based project.
  • a method for managing a unit cost of work for solving the above-described problem is a method for managing unit cost of a crowdsourcing-based project requiring physical movement of workers, a plurality of locations of one crowdsourcing-based project opening a plurality of tasks corresponding to the steps of, identifying the shortest work required time of the specific cycle of the project, and determining the real-time unit cost of the specific cycle of the project based on the shortest time required for the job Including, wherein the step of identifying the shortest time required for the task, the task completion time of the n-1 th task of each worker participating in the project during the specific period and the n th task completed following the n - 1 task Calculating the work required time of the n-th task using the task completion time (where n is 2 or more and less than or equal to the number of tasks performed and completed by the operator during the particular period), and all tasks completed during the particular period Including the step of identifying the shortest time required for all tasks of the operator.
  • a computer program according to another aspect of the present invention for solving the above-described problems is combined with a computer, which is hardware, to execute the method of managing the work unit cost of the crowdsourcing-based project, and is stored in a computer-readable recording medium.
  • An apparatus for managing a unit cost of work for solving the above-described problems is an apparatus for managing unit cost of a crowdsourcing-based project requiring physical movement of workers, a plurality of Sending a plurality of jobs corresponding to a location to a plurality of workers, receiving a plurality of job results from the plurality of workers, and sending a plurality of job results received from the plurality of workers to a plurality of inspectors,
  • a communication module for receiving a plurality of inspection results from an inspector, a memory in which a program for determining a real-time work unit price of a project is stored as the physical movement of the worker is required, and a memory in which the program stored in the memory is executed, the crowdsourcing Open a plurality of tasks corresponding to a plurality of locations of the base project, identify the shortest work required time of a specific cycle of the project, and determine the real-time unit price of the specific cycle of the project based on the shortest time required for the project Including a processor, wherein
  • the time required to calculate the work required in consideration of the travel time required to perform the work as well as the time required to perform the actual work of the worker is calculated and this is reflected in the work unit price, As the physical movement of the worker is required, there is an effect that can motivate the worker even if the work difficulty increases.
  • FIG. 1 is a conceptual diagram of a crowdsourcing service according to an embodiment of the present invention.
  • FIG. 2 is a flowchart for explaining a process of a crowdsourcing-based project according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of a method for managing a work unit cost of a crowdsourcing-based project according to an embodiment of the present invention.
  • Figure 4 is a view for explaining an example of a project that requires the physical movement of the operator in an embodiment of the present invention.
  • 5 is a view for explaining the problem of unit cost of work in a project that requires physical movement of the worker.
  • FIG. 6 is a view for explaining an example of determining a real-time work unit price.
  • FIG. 7 is a view for explaining an apparatus for managing unit cost of a project based on crowdsourcing according to an embodiment of the present invention.
  • FIG. 1 is a conceptual diagram of a crowdsourcing service according to an embodiment of the present invention.
  • the crowdsourcing service is performed by consisting of a requester 10 , a service provider 20 , and the public 30 .
  • the client 10 refers to a company or individual requesting a crowdsourcing-based project (hereinafter, a project).
  • the client 10 requests a project for the purpose of collecting source data or data annotation for the generation of artificial intelligence learning data.
  • the data generated through the project can be used as learning data for arbitrary machine learning such as supervised learning, unsupervised learning, and reinforcement learning.
  • the collection of source data means the collection of raw data such as recorded voice collection and photo collection.
  • Data annotation refers to inputting relevant annotation data into source data such as text, photos, and videos.
  • data annotation may include, but is not limited to, finding an entity in a given fingerprint, finding a similar sentence, and the like.
  • the type of the above-mentioned project is only one embodiment, and various projects may be handled in the present invention according to the design of the client.
  • the service provider 20 refers to a company that provides a crowdsourcing service.
  • the service provider 20 When the service provider 20 receives a request for a project for a product or service from the client 10 , the service provider 20 allocates the work for the project to the general public 30 and receives the work result from the public 30 . Thereafter, the final product extracted based on the work result is provided to the client 10 .
  • the service provider 20 provides a crowdsourcing service to the client 10 and the public 30 through the crowdsourcing platform (hereinafter, the platform). That is, when the service provider 20 receives a project request from the client 10 , the service provider 20 opens the project on the platform. Thereafter, when receiving the work results for the open project from the public 30 , the project may be terminated on the platform, and the final product may be extracted and provided to the client 10 .
  • the public 30 refers to the general public participating in the project open on the platform.
  • the public 30 may participate in a project open to the platform through an application or website provided by the service provider 20 .
  • the public 30 consists of an operator 32 and an inspector 34 .
  • the worker 32 decides to participate in a specific project among a plurality of projects open to the platform. Thereafter, the worker 32 collects source data or performs a task such as data annotation, and transmits it to the platform.
  • the inspector 34 decides to participate in a specific project among a plurality of projects opened on the platform. Thereafter, the inspector 34 performs inspection on the results of the work performed by the operator 32 . As a result of the inspection, the inspector 34 may process the inspection passing or reject it, and may input a reason for rejecting the work when rejecting the task. In the case of passing inspection, rework and subsequent re-inspection are not required, so passing inspection has the same meaning as inspection completion.
  • FIG. 2 is a flowchart for explaining a process of a crowdsourcing-based project according to an embodiment of the present invention.
  • the client 10 requests one or more projects to the service provider 20 (S11).
  • the service provider 20 opens the requested project on the platform (S12).
  • the service provider 20 may determine the grade in consideration of the difficulty of the corresponding project before opening the project. That is, it is possible to determine whether to expose the project to the public 30 or higher according to the level of difficulty. Accordingly, it is possible to increase the reliability of the work result of the project.
  • the service provider 20 assigns the task to the worker 32 of the corresponding grade or higher according to the grade of the project (S13).
  • the worker 32 performs the assigned task (S14).
  • the operator 32 may input a reason for not being able to work without performing the job for a job in which the job itself is impossible for some reason.
  • the service provider 20 receives the work result from the worker 32 (S15), and assigns an inspection task for the work result to the inspector 34 (S16).
  • the inspector 34 performs the assigned inspection (S17). At this time, the inspector 34 determines the completion of the inspection if it is determined that the work has been performed properly, and determines the rejection if it is determined that the inspection work is wrong. When deciding to reject, the inspector 34 inputs a reason for rejecting for what reason it is determined that the work is wrong.
  • the service provider 20 receives the inspection result from the inspector 34 (S18).
  • the service provider 20 uses the corresponding work result as valid data, and based on this, extracts the final product at the end of the project.
  • the service provider 20 may internally perform the inspection again, or assign the task to the worker 32 again to perform the task.
  • the service provider 20 terminates the project when the project period is over or sufficient valid data is secured (S19), and calculates a final result based on the secured valid data and provides it to the client 10 ( S20).
  • the service provider 20 evaluates the performance results of the operator 32 and the inspector 34 , and calculates the work cost and inspection cost according to the evaluation to the operator 32 and the inspector 34 . give.
  • FIGS. 1 and 2 it is simply expressed as the requester 10, the service provider 20, the worker 32, and the inspector 34, but these are a smartphone, tablet, PDA, laptop, means a computer device or telecommunication device such as a desktop, server, etc.
  • FIG. 3 is a flowchart of a method for managing a work unit price according to an embodiment of the present invention.
  • Figure 4 is a view for explaining an example of a project that requires the physical movement of the operator in an embodiment of the present invention.
  • 5 is a view for explaining the problem of unit cost of work in a project that requires physical movement of the worker.
  • 6 is a view for explaining an example of determining a real-time work unit price.
  • FIG. 3 may be understood to be performed by a platform server (hereinafter, referred to as a server) operated by the service provider 20, but is not limited thereto.
  • a platform server hereinafter, referred to as a server operated by the service provider 20, but is not limited thereto.
  • the terminal device of the operator 32 and the inspector 34 may be a computer device or a telecommunication device such as a smart phone, tablet, PDA, laptop, desktop, etc., but is not limited thereto.
  • the server opens a plurality of tasks of one crowdsourcing-based project (S110).
  • one project consists of a plurality of data sets, and one data set includes a plurality of tasks.
  • the plurality of tasks may be grouped into a plurality of tasks according to the type, or each task may be a different kind of task, or may be the same task, but is not limited thereto.
  • the project in the present invention may be a project for performing a predetermined task assigned to each of a plurality of pre-designated outdoor locations.
  • the project in the present invention is a case in which work can be performed only at a pre-specified location outdoors. Accordingly, the project of the present invention is characterized in that it is affected by the physical environment of the operator, which is out of control.
  • the worker 32 may perform a task of collecting a target image at a predetermined outdoor location using the terminal of the worker 32 and transmitting the target image to the server.
  • the worker 32 is to perform the task of shooting a sign image of the corresponding point in the mutual "XX store XX point" building in a specific location called "XX building XX-dong, XX-gu, Seoul" can
  • the operator 32 In order to perform such an operation, the operator 32 must first move to the corresponding position.
  • the terminal of the worker 32 may perform a process of confirming whether the corresponding location is correct on the work page as shown in FIG. 4A in order to record the exact location where the work is performed.
  • the worker 32 After recording whether the location is correct, as shown in FIG. 4b , the worker 32 records information necessary for the operation, such as branch name or industry information, and then clicks the 'take photo' button to take a photo of the signboard.
  • information necessary for the operation such as branch name or industry information
  • the taken photo After taking a photo, the taken photo is output on the work page as shown in FIG. 4c, and the operator 32 determines whether the taken photo and recorded related information are appropriate as a work result, and then corrects or rewrites the information through the 'Cancel' button Take a picture or submit it to the server as a work result through the 'Save' button.
  • the workers 32 perform most of the area (A) with a high density of pins at the beginning, so it is possible to work per hour at the beginning Although the number of cases is high, as time goes by, the density of pins decreases as in area (B) or area (C).
  • the workers 32 can perform many tasks with a small moving distance in the (A) area, but when they move to the (B) area or (C) area to perform the rest of the work, the movement time increases.
  • an embodiment of the present invention calculates the required work time in consideration of the physical movement of the worker 32 and reflects this in real time in the work unit price to increase the work performance motivation of the worker 32, You can keep the pace of the whole project going, or you can make it go faster.
  • the server identifies the shortest work required time of a specific cycle of the project ( S120 ), and determines a real-time unit price of work for a specific cycle of the project based on the shortest required work time ( S130 ). Accordingly, different work unit prices may be applied for each cycle.
  • the server determines the task completion time of the n-1 task of each worker participating in the project during a specific period and the task completion time of the n-th task that has been completed following the n-1 task. is used to calculate the required work time of the n-th task.
  • n is 2 or more and less than or equal to the number of tasks performed and completed by each worker during a specific period.
  • the server identifies the shortest time required for all tasks of all workers performed during a specific period as a target.
  • the n-1 th job and the n th job mean jobs that have been continuously performed.
  • the work required time of the second task is calculated using the completion time of the first task and the completion time of the second task.
  • the work required time of the third task is calculated using the completion time of the second task and the completion time of the third task.
  • the second task, the third task, the fourth task, and the task required time of the fifth task are calculated in the same manner, respectively.
  • an embodiment of the present invention records the behavior of the operator 32 while performing the operation of the operator 32 .
  • the server may record the time when the worker 32 enters the page for performing the job, and the time when the worker 32 enters the job completion after completing the job. For example, the time when a specific pin (location) is selected on the map of FIG. 4A is recorded, and the time when the job result is submitted to the server by clicking the save button of FIG. 4C is recorded.
  • the job completion time of the n-1 th job described above means the time when job completion is input in relation to the n-1 th job by the operator 32 .
  • the job completion time of the n-th job also means the time when job completion is input in relation to the n-th job by the operator 32 .
  • the server uses the thus recorded job completion time in calculating the job required time of the nth job.
  • the task required time of the nth task may be calculated through a deviation between the task completion time of the n-1 th task and the task completion time of the nth task.
  • the calculated work required time may include a break time for some workers, and thus may differ for each worker or for each individual job. Accordingly, the work required time in an embodiment of the present invention may be calculated assuming that at least one worker participating in the project during a specific cycle has continuously performed the work without a break, as will be described later.
  • the calculated work required time may include not only a rest time but also a moving time from the n-1 th position to the n th position.
  • the n-1 th position refers to a position at which an n-1 th operation can be performed
  • the n th position refers to a position corresponding to the n th operation.
  • the work required time can also be defined as the time required to perform the work.
  • the first job at the first position of worker A started at 15:00 and was completed at 15:10, and the second job at the second position started at 16:00 and 16 It was completed at 10 o'clock.
  • the work required time of the second work is calculated as 1 hour, which is a deviation from 16:10 to 15:10.
  • the work required time of the third task is calculated as 40 minutes, which is a deviation from 16:50 to 16:10.
  • the work required time of the second task and the work required time of the third task thus calculated include the movement time of the worker A for the corresponding task as described above.
  • the server determines the real-time unit price of a specific cycle based on the time required for all jobs of all workers collected for a specific cycle.
  • the server may identify the shortest work required time based on the result of the inspection completed every predetermined period (eg, 24 hours) among the work required time of a plurality of workers. Regarding the work that has not been inspected or that has been rejected, the time required for the work may not be considered in identifying the shortest time required for the work.
  • the shortest time required for each worker A, B, and C during a specific cycle is 15 minutes, 20, or 30 minutes (there will be a large number of work required times calculated for each worker, but omitted for convenience of explanation) ), 15 minutes calculated in relation to worker A are identified as the shortest required time of a specific cycle.
  • the initial work unit price is set on the premise of 10 minutes, by changing it based on 15 minutes as above, it is possible to properly compensate the physical movement time and prevent excessive increase in the work unit cost due to abusing. .
  • the predetermined cycle in which the shortest work required time is determined and updated may be based on time (eg, 24 hours), but is not necessarily limited thereto. It may be decided and updated.
  • the server may determine a real-time unit price of work for a plurality of workers 32 of a specific period based on the shortest work required time.
  • the server may determine a real-time unit price of work for the plurality of workers 32 in a specific cycle based on the reference cost per unit time and the shortest time required for the job in the specific cycle.
  • the shortest job required time of the cycle is identified, and the cycle is based on the reference cost per unit time and the shortest job duration of the cycle according to Equation 1 You can determine the real-time unit price of work.
  • Real-time unit price standard cost per unit time/(1 hour/shortest time required for a specific cycle)
  • the real-time work unit price may be calculated as 5,000 won. If the shortest time required for the next cycle is 1 hour, the real-time work unit price may be calculated as 10,000 won.
  • the server determines a real-time unit price for a plurality of workers 32 of a specific period based on the initial unit cost, the shortest work required time in the first cycle, and the shortest required work time in the specific cycle.
  • the shortest job required time in the first cycle is calculated as 1 hour, and when the initial job unit price is 10,000 won, the shortest job duration in the current cycle is If 15 minutes is calculated, the real-time work unit price can be calculated as 2,500 won according to Equation 2. That is, the real-time operation unit price may be determined not only to be high but also to be low compared to the previous period. If the shortest required work time of the next cycle is calculated as 1 hour and 30 minutes, the real-time work unit price may be calculated as 15,000 won.
  • Real-time unit price initial unit price/(shortest time required for first cycle/shortest time required for specific cycle)
  • the initial unit price may be preset by the pilot project.
  • an embodiment of the present invention compensates for the disadvantages of the workers 32 by increasing the real-time work unit cost even if the distance to move to the next location to perform the next work after completing the work at the current location is relatively long.
  • the real-time unit price may rise or fall for each predetermined cycle depending on the degree of participation of the workers 32 or the skill level of the workers 32 participating in a specific cycle of the project, the difference in physical environment, etc. Of course you can.
  • steps S11 to S150 may be further divided into additional steps or combined into fewer steps according to an embodiment of the present invention.
  • some steps may be omitted as necessary, and the order between steps may be changed.
  • the contents of FIG. 7, which will be described later, may also be applied to the work unit cost management method of FIGS. 1 to 6 , even if other contents are omitted.
  • FIG. 7 is a view for explaining an apparatus for managing a work unit price according to an embodiment of the present invention.
  • the work unit price management apparatus 200 includes a communication module 210 , a memory 220 , and a processor 230 .
  • the communication module 210 transmits a plurality of tasks corresponding to a plurality of locations of a single crowdsourcing-based project to a plurality of workers 32 to request to perform a task, and receives a plurality of work results from the plurality of workers 32 receive
  • the plurality of work results received from the plurality of workers 32 are transmitted to the plurality of inspectors 34 to request inspection, and a plurality of inspection results are received from the plurality of inspectors 34 .
  • the memory 220 stores a computer program for determining and managing the real-time unit cost of the project as the physical movement of the worker is required based on the data received from the communication module 210 .
  • the processor 230 executes a computer program stored in the memory 220 .
  • the computer program includes instructions for executing the above-described work unit cost management method.
  • As the processor 230 executes the program stored in the memory 220 a plurality of tasks corresponding to a plurality of locations of the crowdsourcing-based project are opened, and the shortest task duration of a specific cycle of the project is identified, A real-time unit cost of a specific period of the project is determined based on the shortest time required for the work. Identification of the shortest required work time is the same as described above in relation to the work unit cost management method.
  • the work unit price management apparatus 200 described with reference to FIG. 7 may be provided as a component of the above-described server.
  • the above-described work unit cost management method may be implemented as a computer program (or application) to be executed in combination with a computer, which is hardware, and stored in a computer-readable recording medium.
  • the above-mentioned program in order for the computer to read the program and execute the methods implemented as a program, C, C++, JAVA, Ruby, which the processor (CPU) of the computer can read through the device interface of the computer; It may include code coded in a computer language such as machine language. Such code may include functional code related to a function defining functions necessary for executing the methods, etc., and includes an execution procedure related control code necessary for the processor of the computer to execute the functions according to a predetermined procedure. can do. In addition, the code may further include additional information necessary for the processor of the computer to execute the functions or code related to memory reference for which location (address address) in the internal or external memory of the computer to be referenced. have.
  • the code uses the communication module of the computer to determine how to communicate with any other computer or server remotely. It may further include a communication-related code for whether to communicate and what information or media to transmit and receive during communication.
  • the storage medium is not a medium that stores data for a short moment, such as a register, a cache, a memory, etc., but a medium that stores data semi-permanently and can be read by a device.
  • examples of the storage medium include, but are not limited to, ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage device. That is, the program may be stored in various recording media on various servers accessible by the computer or in various recording media on the computer of the user.
  • the medium may be distributed in a computer system connected by a network, and a computer readable code may be stored in a distributed manner.

Landscapes

  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Engineering & Computer Science (AREA)
  • Strategic Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Economics (AREA)
  • Educational Administration (AREA)
  • Physics & Mathematics (AREA)
  • Development Economics (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Game Theory and Decision Science (AREA)
  • Data Mining & Analysis (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

L'invention concerne un procédé et un dispositif de gestion des prix unitaire de travail d'un projet basé sur l'externalisation ouverte pour la génération de données d'apprentissage d'intelligence artificielle. Un procédé de gestion des prix de l'unité de travail d'un projet basé sur l'externalisation ouverte qui nécessite un déplacement physique accompli par un travailleur comprend les étapes consistant à : ouvrir une pluralité de travaux correspondant à une pluralité d'emplacements d'un projet basé sur l'externalisation ouverte ; identifier un temps de travail le plus court d'une période particulière du projet ; et déterminer un prix unitaire de travail en temps réel de la période particulière du projet sur la base du temps de travail le plus court.
PCT/KR2020/019043 2019-12-27 2020-12-23 Procédé et dispositif de gestion du prix unitaire de travail d'un projet basé sur l'externalisation ouverte pour la génération de données d'apprentissage d'intelligence artificielle WO2021133076A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020190175967A KR102155793B1 (ko) 2019-12-27 2019-12-27 인공지능 학습데이터 생성을 위한 크라우드소싱 기반 프로젝트의 작업단가 관리 방법 및 장치
KR10-2019-0175967 2019-12-27

Publications (1)

Publication Number Publication Date
WO2021133076A1 true WO2021133076A1 (fr) 2021-07-01

Family

ID=72471435

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2020/019043 WO2021133076A1 (fr) 2019-12-27 2020-12-23 Procédé et dispositif de gestion du prix unitaire de travail d'un projet basé sur l'externalisation ouverte pour la génération de données d'apprentissage d'intelligence artificielle

Country Status (2)

Country Link
KR (1) KR102155793B1 (fr)
WO (1) WO2021133076A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102155793B1 (ko) * 2019-12-27 2020-09-14 주식회사 크라우드웍스 인공지능 학습데이터 생성을 위한 크라우드소싱 기반 프로젝트의 작업단가 관리 방법 및 장치
KR102310594B1 (ko) * 2021-03-19 2021-10-13 주식회사 인피닉 작업 비용 예측 방법 및 이를 실행하기 위하여 기록매체에 기록된 컴퓨터 프로그램

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011013763A (ja) * 2009-06-30 2011-01-20 Hitachi Ltd 所要時間算出装置および所要時間算出方法
JP2012160007A (ja) * 2011-01-31 2012-08-23 Japan Post Service Co Ltd 作業管理システム、作業管理方法及び作業管理プログラム
KR20190040770A (ko) * 2017-10-11 2019-04-19 ㈜배리어윙스 크라우드 소싱 기반 장애 시설물 정보 업로드 방법
JP2019185302A (ja) * 2018-04-06 2019-10-24 富士通株式会社 勤務状況管理プログラム、勤務状況管理装置および勤務状況管理方法
JP2019204222A (ja) * 2018-05-22 2019-11-28 株式会社日立製作所 見積支援システム
KR102155793B1 (ko) * 2019-12-27 2020-09-14 주식회사 크라우드웍스 인공지능 학습데이터 생성을 위한 크라우드소싱 기반 프로젝트의 작업단가 관리 방법 및 장치

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140095956A (ko) 2013-01-25 2014-08-04 한국전자통신연구원 크라우드 소싱기반 영상 지식 콘텐츠 생성 시스템 및 방법

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011013763A (ja) * 2009-06-30 2011-01-20 Hitachi Ltd 所要時間算出装置および所要時間算出方法
JP2012160007A (ja) * 2011-01-31 2012-08-23 Japan Post Service Co Ltd 作業管理システム、作業管理方法及び作業管理プログラム
KR20190040770A (ko) * 2017-10-11 2019-04-19 ㈜배리어윙스 크라우드 소싱 기반 장애 시설물 정보 업로드 방법
JP2019185302A (ja) * 2018-04-06 2019-10-24 富士通株式会社 勤務状況管理プログラム、勤務状況管理装置および勤務状況管理方法
JP2019204222A (ja) * 2018-05-22 2019-11-28 株式会社日立製作所 見積支援システム
KR102155793B1 (ko) * 2019-12-27 2020-09-14 주식회사 크라우드웍스 인공지능 학습데이터 생성을 위한 크라우드소싱 기반 프로젝트의 작업단가 관리 방법 및 장치

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
UHM , JEONGHAN: "[Innovation, Meet Startups] Earn 3 million won a month with your phone? Crowdworks", 4 December 2019 (2019-12-04), pages 1 - 5, XP055824760, Retrieved from the Internet <URL:https://sports.khan.co.kr/sports/sk_index.html?art_id=201912040700003> *

Also Published As

Publication number Publication date
KR102155793B1 (ko) 2020-09-14
KR102155793B9 (ko) 2021-07-29

Similar Documents

Publication Publication Date Title
WO2021040265A1 (fr) Procédé et dispositif de mesure de compétence de travailleur à l&#39;aide d&#39;un taux de retour moyen
WO2018101722A2 (fr) Système et procédé de prédiction de rendement de fabrication de semi-conducteurs reposant sur un apprentissage automatique
WO2021230660A1 (fr) Procédé et appareil de génération automatique d&#39;un pool de travailleurs sur la base d&#39;éléments fonctionnels et de niveaux de difficulté de projets basés sur l&#39;externalisation ouverte
WO2021133076A1 (fr) Procédé et dispositif de gestion du prix unitaire de travail d&#39;un projet basé sur l&#39;externalisation ouverte pour la génération de données d&#39;apprentissage d&#39;intelligence artificielle
WO2020251142A1 (fr) Dispositif et procédé pour effectuer une évaluation de personnel d&#39;une personne en charge d&#39;un travail
WO2021246772A1 (fr) Procédé de distribution de tâches unitaires d&#39;éléments fonctionnels d&#39;un projet basé sur une externalisation ouverte pour générer des données d&#39;apprentissage d&#39;intelligence artificielle, appareil associé et programme informatique associé
WO2020130306A1 (fr) Procédé et appareil pour vérifier une tâche de traitement d&#39;annotation pour utilisation effective en utilisant une tâche de traitement d&#39;annotation pour vérification
WO2011105714A2 (fr) Système d&#39;intermédiation de développement d&#39;application à distance pour assurer l&#39;intermédiation d&#39;un contrat de développement et d&#39;un développement de programme à l&#39;aide de la configuration de développement virtuelle du client et procédé pour assurer l&#39;intermédiation du développement du programme à distance
WO2020122291A1 (fr) Appareil et procédé d&#39;automatisation d&#39;instructions de travail de gestion d&#39;immeuble d&#39;appartements se basant sur l&#39;intelligence artificielle
WO2020004749A1 (fr) Appareil et procédé permettant à un équipement d&#39;apprendre, à l&#39;aide d&#39;un fichier vidéo
WO2022019500A1 (fr) Procédé pour fournir un entraînement pratique compensé pour des participants à un entraînement pratique pour un projet basé sur une externalisation ouverte pour générer des données d&#39;apprentissage d&#39;intelligence artificielle, dispositif associé et programme informatique pour celui-ci
WO2020138755A1 (fr) Procédé et dispositif de fourniture d&#39;un service de visite d&#39;expert
WO2021137523A1 (fr) Procédé pour mettre à jour automatiquement un coût unitaire d&#39;inspection au moyen d&#39;une comparaison entre le temps d&#39;inspection et le temps de travail d&#39;un projet basé sur une externalisation ouverte pour générer des données d&#39;entraînement d&#39;intelligence artificielle
WO2023182724A1 (fr) Système de mise en corresponde de main d&#39;œuvre
WO2023136493A1 (fr) Procédé d&#39;automatisation de génération et de gestion de modèle d&#39;évaluation de crédit de société de cb et appareil pour mettre en œuvre ledit procédé
WO2023090864A1 (fr) Appareil et procédé d&#39;analyse automatique de journal d&#39;événements malveillants
WO2018074619A1 (fr) Système d&#39;automatisation de processus de simulation et procédé de terminal à conteneurs
WO2021132831A1 (fr) Procédé permettant d&#39;augmenter ou de diminuer le nombre de travailleurs et d&#39;inspecteurs dans un projet basé sur une externalisation ouverte afin de créer des données d&#39;apprentissage d&#39;intelligence artificielle
CN115828022B (zh) 一种数据识别方法、联邦训练模型、装置和设备
WO2022005111A1 (fr) Procédé d&#39;accord automatique d&#39;une prérogative d&#39;inspection à un ouvrier en fonction des résultats de tâches d&#39;un projet à production participative de génération de données d&#39;apprentissage d&#39;intelligence artificielle, appareil associé et programme informatique associé
WO2023282500A1 (fr) Procédé, appareil et programme pour l&#39;étiquetage automatique des données de balayage de diapositive
WO2023058920A1 (fr) Procédé et appareil pour recommander un poste basé sur les tendances d&#39;un utilisateur pour la gestion des ressources humaines
WO2020235898A1 (fr) Procédé de mesure du prix unitaire de travail d&#39;un projet basé sur l&#39;externalisation ouverte
CN112669982B (zh) 密切接触者的确定方法、装置、设备和存储介质
CN112153341B (zh) 一种任务监督方法、装置、系统、电子设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20908356

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20908356

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 09.12.2022)

122 Ep: pct application non-entry in european phase

Ref document number: 20908356

Country of ref document: EP

Kind code of ref document: A1