KR20230039488A - Method for automatically generating artificial intelligence that trains training dataset including image data, and apparatus therefor - Google Patents

Abstract

The present invention relates to an artificial intelligence automatic generation platform that allows even non-experts to easily implement and perform desired functions. According to an embodiment of the present invention, an automatic artificial intelligence (AI) generation method comprises: a data setting step of configuring a learning data set containing image data including an image object; a data labelling step of performing, based on a user input, a manual labelling based on one or more manual labelling methods among a first manual labelling method for dividing the area of the image object included in the image data into a rectangular shape, a second manual labelling method for dividing an image in a discontinuous shape, and a third manual labelling for dividing an image object in a continuous shape, then generating auto labelling AI by learning the image data labelled manually, and performing labelling; an AI modelling step of modelling AI by learning the labelled learning data set; and an AI distributing step of distributing the modelled AI.

Description

Artificial intelligence automatic generation method for learning training data set containing image data and apparatus therefor

This specification proposes a method for automatically generating artificial intelligence (AI) based on deep learning and an MLOps device for improving artificial intelligence accuracy.

Recently, artificial intelligence (AI) technology is rapidly developing, and services using artificial intelligence technology are widely provided in various fields. In particular, deep learning technology is attracting great attention, and it is showing great results in various fields such as data analysis, image recognition, and natural language processing. Deep learning is a field of machine learning, which is a technology that expresses data in a form that can be processed by a computer, such as vectors or graphs, and builds AI that learns it. In other words, for specific learning goals, such as recognizing faces or facial expressions, deep learning aims to build better representation methods and efficient AI for learning. Many of the representations of deep learning are inspired by neuroscience and are based on patterns of information processing or communication in the nervous system.

However, the development of such artificial intelligence has been conducted in a closed manner only through experts due to its high level of technical expertise and difficulty, based on the R language and Python language. Therefore, it was impossible for non-experts to develop artificial intelligence that operates with the desired function. Recently, although the development of algorithms based on open source deep learning techniques is increasing, entry barriers are very high because they still require a high level of technical proficiency for non-experts to handle.

Therefore, in this specification, in order to solve the above-mentioned problems of conventional artificial intelligence development, we propose an artificial intelligence automatic generation platform that allows non-experts to easily implement/perform desired functions.

In the method for automatically generating AI (Artificial Intelligence) according to an embodiment of the present invention, in the method for automatically generating AI (Artificial Intelligence), the data setting step of constructing a data set for learning including image data including an image object. , Based on a user input, a first manual labeling method for partitioning the region of the image object included in the image data in a rectangular shape, a second manual labeling method for partitioning a discontinuous image, and a continuous image object After performing manual labeling based on any one or more manual labeling methods of the third manual labeling method for partitioning the area of , data to generate auto labeling AI by learning the manually labeled image data and performing labeling. It may include a labeling step, an AI modeling step of modeling the AI by learning the labeled training data set, and an AI distribution step of distributing the modeled AI.

According to an embodiment of the present invention, since high technical skill is not required to generate artificial intelligence, there is an effect that non-experts can easily develop artificial intelligence having desired functions/purposes.

In addition, according to one embodiment of the present invention, since it provides an artificial intelligence-based auto-labeling function, there is an effect that it is possible to reduce the waste of manpower and time required for conventional manual labeling.

In addition, according to an embodiment of the present invention, since artificial intelligence development and distribution are easily possible, there is an effect that an artificial intelligence development environment for non-experts is provided.

In addition, according to an embodiment of the present invention, since it is possible to purchase artificial intelligence developed by other users through the AI market, there is an effect that non-experts can easily use/utilize artificial intelligence. Furthermore, through this, the scope of AI utilization is expanded and applied to various fields, which has the effect of enhancing technological/industrial development in various fields.

Effects of the present invention are not limited to the above effects, and various effects for each embodiment will be described in detail below.

1 is a diagram illustrating a deep learning-based AI automatic generation method according to an embodiment of the present invention.
2 is a block diagram of an apparatus for automatically generating AI based on deep learning according to an embodiment of the present invention.
3 is a diagram illustrating a data setting function providing screen provided by a data setting module according to an embodiment of the present invention.
4 is a flowchart illustrating a data labeling method of a data labeling module according to an embodiment of the present invention.
5 to 8 are diagrams illustrating a manual labeling work tool according to an embodiment of the present invention.
9 is a diagram illustrating a screen for selecting an optimal auto-labeling AI among auto-labeling AI candidates according to an embodiment of the present invention.
10 is a diagram illustrating an auto labeling verification screen according to an embodiment of the present invention.
11 is a flowchart illustrating an AI modeling method of an AI modeling module according to an embodiment of the present invention.
12 is a diagram illustrating a screen for providing performance evaluation results for each AI candidate according to an embodiment of the present invention.
13 is a diagram illustrating a screen for providing analysis results of generated/modeled AI according to an embodiment of the present invention.
14 illustrates an AI market screen provided by an AI distribution module according to an embodiment of the present invention.

Since the technology to be described below can have various changes and various embodiments, specific embodiments will be illustrated in the drawings and described in detail. However, this is not intended to limit the technology described below to specific embodiments, and it should be understood to include all modifications, equivalents, or substitutes included in the spirit and scope of the technology described below.

Terms such as first, second, A, B, etc. may be used to describe various elements, but the elements are not limited by the above terms, and are merely used to distinguish one element from another. used only as For example, without departing from the scope of the technology described below, a first element may be referred to as a second element, and similarly, the second element may be referred to as a first element. The terms and/or include any combination of a plurality of related recited items or any of a plurality of related recited items. For example, 'A and/or B' may be interpreted as meaning 'at least one of A or B'. Also, '/' can be interpreted as 'and' or 'or'.

In the terms used in this specification, singular expressions should be understood to include plural expressions unless clearly interpreted differently in context, and terms such as “comprising” refer to the described features, numbers, steps, operations, and components. , parts or combinations thereof, but it should be understood that it does not exclude the possibility of the presence or addition of one or more other features or numbers, step-action components, parts or combinations thereof.

Prior to a detailed description of the drawings, it is to be clarified that the classification of components in the present specification is merely a classification for each main function in charge of each component. That is, two or more components to be described below may be combined into one component, or one component may be divided into two or more for each more subdivided function. In addition, each component to be described below may additionally perform some or all of the functions of other components in addition to its main function, and some of the main functions of each component may be performed by other components. Of course, it may be dedicated and performed by .

In addition, in performing a method or method of operation, each process constituting the method may occur in a different order from the specified order unless a specific order is clearly described in context. That is, each process may occur in the same order as specified, may be performed substantially simultaneously, or may be performed in the reverse order.

This specification describes a 'deep learning-based artificial intelligence automatic creation platform (hereinafter referred to as' The purpose is to propose an AI development automation platform)'. This 'deep learning-based artificial intelligence automatic generation platform' can be referred to as 'deep learning-based Data-Centric MLOps solution'. The AI development automation platform proposed in this specification has the effect that since all processes are automated based on AI, even non-experts / unskilled people can easily develop and deploy AI with the desired function implemented through the AI development automation platform. . The AI development automation platform may be implemented and distributed in a software format such as an application/program, or implemented as a web page and provided to users.

Hereinafter, the AI development automation platform will be described in detail with reference to each drawing.

1 is a diagram illustrating a deep learning-based AI automatic generation method according to an embodiment of the present invention, and FIG. 2 is a block diagram of a deep learning-based AI automatic generation apparatus according to an embodiment of the present invention.

The AI development automation platform proposed in this specification is a service platform in which a deep learning-based AI automatic generation method is implemented, and the deep learning-based AI automatic generation method is implemented/executed by the deep learning-based AI automatic generation device 200 It can be.

The deep learning-based AI automatic generation method can be largely composed of four steps (S110 to S140) as shown in FIG. 1, and each step (S110 to S140) is each module 210 as shown in FIG. ~ 240) may be implemented/performed. More specifically, the method of automatically generating AI based on deep learning may include a data setting step (S110), a data labeling step (S120), an AI modeling step (S130), and/or an AI distribution step (S140). Setting step (S110) by the data setting module 210, data labeling step (S120) by the data labeling module 220, AI modeling step (S130) by the AI modeling module 230, AI distribution step (S140) may be performed by the AI distribution module 140, respectively.

The data setting step (S110) corresponds to a step in which the data setting module 210 configures a data set for AI learning. The data setting module 210 may provide various functions so that a user can easily configure a data set for learning, and the user can conveniently configure a data set for learning by utilizing these functions. For example, the data setting module 210 provides an environment in which a user can easily build a data set for learning by providing a function of loading existing data, a function of using public data, and a function of combining learning data. A more detailed description of the data setting step ( S110 ) will be described later in detail with reference to FIG. 3 .

The data labeling step ( S120 ) corresponds to a step in which the data labeling module 220 labels data (eg, the training data set built in step S110 ). Here, data labeling means the task of classifying and processing data in a form that AI can learn on its own. High-accuracy labeling is very important because the quality of data improves as accurate labeling progresses, enabling higher-performance AI modeling. In the present specification, the data labeling step (S120) is largely divided into a manual labeling step and an auto labeling step, and a detailed description thereof will be described later in detail with reference to FIGS. 4 to 10.

The AI modeling step (S130) corresponds to a step in which the AI modeling module 230 automatically generates an AI suitable for the input data. In particular, the AI modeling step (S130) inputs / After being selected, AI can be automatically created by learning data according to the type of input/selected AI model. A detailed description of the AI modeling step (S130) will be described later in detail with reference to FIGS. 11 to 13.

The AI distribution step (S140) corresponds to a step in which the AI distribution module 240 distributes the AI automatically modeled/generated in the AI modeling step (S130). In particular, the AI distribution step (S140) is to enhance artificial intelligence through re-learning, configure a server optimized for artificial intelligence operation, real-time monitoring of the operating environment, and various programs so that the generated AI can be run with high performance in an optimized environment. It is possible to provide an AI distribution solution through an API (Application Program Interface) that supports languages. Furthermore, the AI distribution step (S140) may also provide an AI market function capable of selling the generated AI to other users. A detailed description of the AI distribution step (S140) will be described later in detail with reference to FIG. 14 .

The device for automatically generating AI based on deep learning proposed in FIG. 2 may correspond to, for example, a user device (eg, terminal, PC, laptop, tablet, etc.), a web server, and/or an application server, and at least one It can be implemented through hardware / software of.

When implemented through hardware, the device for automatically generating AI based on deep learning may include a processor, a memory, a display unit, a communication unit, and/or a user input unit.

The processor may include a central processing unit (CPU), a micro processor unit (MPU), a micro controller unit (MCU), an application processor (AP), an application processor (AP), or any type of processor well known in the art. may apply. The processor may implement the embodiments proposed in this specification by controlling at least one component included in the deep learning-based AI automatic generation device.

The memory unit is a storage space for storing various digital data, and for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), and a cloud may correspond thereto.

The display unit may include at least one image output unit and output various visual objects.

The communication unit may have at least one wired/wireless communication protocol to perform communication with an external device/server.

The user input unit may sense a user input using at least one sensor. For example, the user input unit may include a gravity sensor, a geomagnetic sensor, a motion sensor, a gyroscope sensor, an acceleration sensor, an infrared sensor, an inclination sensor, a brightness sensor, an altitude sensor, a depth sensor, a pressure sensor, and a bending sensor. , Audio sensor, video sensor, GPS (Global Positioning System) sensor, at least one of various sensing means such as a touch sensor and a grip sensor may be used to sense a user input to the deep learning-based AI automatically generating device.

3 is a diagram illustrating a data setting function providing screen provided by a data setting module according to an embodiment of the present invention.

Referring to FIG. 3 , the data setting module may provide an existing data upload function 310 for constructing a data set for learning. A user can easily build a data set (in particular, a data set for training) based on AI generation through the corresponding function 310 . The data setting module can support various file formats (e.g., CSV, ZIP, MP4, MOV, PNG, JPG, JPEG, GIF, etc.), and users can create training data sets by uploading data corresponding to the supported file formats. It can be built to lay the foundation for automatic AI generation.

Furthermore, the data setting module may configure a learning data set by interworking with a database management system and loading data from the corresponding system. For example, the data setting module supports linkage with database management systems such as MySQL, Postgre SQL, Oracle, MSSQL, etc., and can configure a training data set by loading data from them.

AI automatically generated according to each type of data may be shown in Table 1.

Although not shown in this drawing, the data setting module can provide the user with public data that is open to the public as data samples that can be used for constructing the learning data set, and the user can use this to construct a richer learning data set. there is. Public data can be updated periodically/in real time, and users can use public data to compose a richer and more diverse learning data set, laying the groundwork for automatic generation of AI with better performance.

The learning data set configured according to the present embodiment may be listed-up 320 and provided to the user through a data setting function providing screen as illustrated in this figure. The user can select at least one training data set from the list-up training data set 320 and use it to train the AI.

Furthermore, the data setting module may additionally provide a combining function between learning data sets. This function may be mainly used for the purpose of combining/integrating a plurality of training data sets into one training data set when there are a plurality of training data sets to be learned by AI. In this case, the user may learn the AI by combining a plurality of training data sets into one training data set.

Combining/integrating may be performed in a manner of combining/integrating data based on common items among a plurality of training data sets. For example, it may be assumed that the first and second training data sets including the following data items are combined.

- 1st learning data set: ID (1), gender (female), region (Busan)

- 2nd learning data set: ID (1), purchased product (jeans)

Since the data item common to the first and second training data sets is ID(1), data can be combined/integrated around ID(1), and the combined/integrated result is as follows.

- First and second learning data combination set: ID (1), gender (female), region (Busan), purchased product (jeans)

Since it is possible to combine learning data sets in this way, a more flexible and free learning data set configuration environment is created, which has the effect of providing the basis for automatic generation of AI that is more in line with user intentions and has good performance.

The combination of these learning data sets can be applied only to automatic text-based AI generation.

4 is a flowchart illustrating a data labeling method of a data labeling module according to an embodiment of the present invention.

Of course, at least one step in this flowchart may be excluded/omitted according to embodiments, a new step may be added, or the order may also be changed. This flowchart is described based on a data labeling operation for generating an image-based AI, but is not limited thereto and can be applied to a data labeling operation for generating a text-based AI, of course.

Referring to FIG. 4 , first, the data labeling module may perform a manual labeling operation based on a user input (S401). A manual labeling operation for image-based AI generation may be performed by selecting an image object to be recognized from image data based on a user input and assigning a label to the selected image object. Here, the image data may refer to image data included in a training data set pre-set/configured by the data setting module.

The data labeling module may provide a manual labeling work tool so that the user can perform manual labeling more easily and conveniently, and the user can use the manual labeling work more easily and conveniently. The manual labeling work tool may provide a manual labeling function of a bounding box method, a polyline method, a polygon method, or a magic tool method according to an image object selection method.

5 to 8 are diagrams illustrating a manual labeling work tool according to an embodiment of the present invention. In more detail, FIG. 5 is a manual labeling work tool execution screen providing a manual labeling function of a bounding box method according to an embodiment of the present invention, and FIG. 6 is a manual labeling of a polyline method according to an embodiment of the present invention. Manual labeling work tool execution screen providing a function, Figure 7 is a manual labeling work tool execution screen providing a polygon-type manual labeling function according to an embodiment of the present invention, Figure 8 is a magic according to an embodiment of the present invention Manual labeling work tool execution screens that provide tool-type manual labeling functions are exemplified.

Referring to FIG. 5, the bounding box method is a method of performing manual labeling by selecting/dividing an image object 510 into a rectangle/box shape, and the manual labeling work tool is a rectangle/box shape first image object selection indicator ( 530) can be provided. The user selects the image object 510 to be recognized through AI using the first image object selection indicator 530 (or divides the area of the image object 510), and labels the object 510. (520) can be given. For example, as illustrated in this drawing, the user selects/divisions the car 510, which is a recognition object, in the form of a rectangle/box using the first image object selection indicator 530, and the label 'car' ( 520) to perform manual labeling. When a plurality of image objects 510 are included in the image data, manual labeling using a bounding box method may be performed on all of the plurality of image objects 510 .

Referring to FIG. 6 , the polyline method is a method of manually labeling an image object 610 having a discontinuous start point and an end point, and the manual labeling work tool selects an image object 610 having a discontinuous shape. A second image object selection indicator 630 may be provided. The user selects the discrete image object 610 to be recognized (or divides the area of the image object 610) using the second image object selection indicator 630, and labels the corresponding object 610. (620) can be given. For example, as illustrated in this drawing, the user selects/divisions the road 610, which is a recognition object, in a discontinuous form using the second image object selection indicator 630, and displays a label 620 labeled 'road'. Manual labeling can be performed by assigning . When a plurality of image objects 610 are included in the image data, manual labeling using a polyline method may be performed on all of the plurality of image objects 610 .

Referring to FIG. 7 , the polygon method is a method of manually labeling an image object 710 having a continuous start point and an end point, and a manual labeling work tool is used to select an image object 710 having a continuous form. A third image object selection indicator 730 may be provided. The user selects the continuous image object 710 to be recognized (or divides the area of the image object 710) using the third image object selection indicator 730, and labels the corresponding object 710. (720) can be given. For example, as illustrated in this drawing, the user selects/divisions the cat 710 as a recognition object in a continuous form using the third image object selection indicator 730, and the label 'cat' 720 Manual labeling can be performed by assigning . When a plurality of image objects 710 are included in the image data, polygon-type manual labeling may be performed on all of the plurality of image objects 710 .

Referring to FIG. 8 , the magic tool method is a combination of the box bounding method and the polygon method. The image object selection indicator 840 is performed according to the magic tool method, and the image object 810 is selected/divisioned according to the polygon method. It can be. More specifically, the user may select the image object 810 (or divide the area of the image object 810) using the fourth image object selection indicator 840 in the form of a square/box, and the fourth image object 810 may be selected. This corresponds to a method of automatically selecting/dividing an image object 810 in the form of a closed curve existing within the partitioned/selected square/box area through the object selection indicator 840 and assigning a label thereto. For example, as illustrated in this drawing, the user may select/division a puppy as a recognition object in a square/box shape using the fourth image object selection indicator 840 . In this case, the boundary line 820 of the puppy 810, which is an image object in the selected/division area, can be extracted in a polygonal way and automatically selected/divisioned as the image object 810, and 'dog' for the object 810. Manual labeling may be performed by assigning a label 830 called '.

Although four types of manual labeling methods have been described, the present invention is not limited thereto, and various types of manual labeling methods may be applied.

Referring back to FIG. 4 , next, the data labeling module may generate at least one auto-labeling AI candidate (S402). Here, auto labeling means that the data labeling operation is automatically performed by the auto labeling AI. The data labeling module may generate at least one AI candidate for automatically labeling image data based on the manually labeled data/content. For example, the data labeling module can generate AI candidates for each method by learning manually labeled data with different deep learning methods.

Next, the data labeling module may select an optimal auto-labeling AI with the highest performance among the generated auto-labeling AI candidates (S403).

9 is a diagram illustrating a screen for selecting an optimal auto-labeling AI among auto-labeling AI candidates according to an embodiment of the present invention.

As illustrated in FIG. 9 , the data labeling module may perform an auto-labeling operation on image data using the generated auto-labeling AI candidates, and provide auto-labeling results 910 and 920 for each candidate to the user. there is. The user may examine the auto-labeling results 910 and 920 for each candidate, and perform an input to select image data 920 having the (most) high auto-labeling accuracy. The data labeling module views the auto-labeling AI candidate selected with the highest percentage as the optimal auto-labeling AI with the highest performance and selects it as the final auto-labeling AI, thereby completing the auto-labeling AI generation.

Referring back to FIG. 4 , the data labeling module may perform auto labeling on image data other than manually labeled image data among the training data set using the auto labeling AI generated in this way.

With this AI-based auto-leveling function, users do not have to perform manual labeling for all data, which significantly reduces the amount of work, and since it is possible to label a huge amount of data, it is possible to automatically generate AI with excellent performance. It has the effect of providing a basis.

10 is a diagram illustrating an auto labeling verification screen according to an embodiment of the present invention.

Accurate labeling of data directly affects the performance of AI, so high accuracy is required. Accordingly, in order to further improve data labeling accuracy, the data labeling module may additionally provide an inspection function for data auto-labeled by the auto-labeling AI according to an embodiment.

For example, as illustrated in FIG. 10 , the data labeling module may provide image data 1020 auto-labeled by the generated auto-labeling AI to the user. The user can check the auto-labeled image data 1020 to check whether the labeling has been properly/accurately performed as intended. For inspection convenience, the data labeling module provides a GUI (Graphic User Interface) (1010) may be provided. The user can perform inspection by checking the auto-labeled image data 1020 and selecting pass when the labeling is performed accurately as intended and reject when the labeling is performed incorrectly and unintentionally. Data rejected by the user may be discarded/deleted or relabeled by the manual labeling method described above.

When the inspection is completed, the data labeling module can regenerate/update the auto labeling AI by relearning the remaining passed data except for the discarded data. The data labeling module may perform a re-inspection operation on the regenerated/updated auto-labeling AI according to the above-described inspection method. In this way, the auto-labeling AI inspection work can be performed repeatedly until the rejected data is reduced to less than the preset ratio/number.

The auto-labeling AI finally created through the repeated process of reviewing and regenerating/updating the auto-labeling AI may re-perform the auto-labeling and review operations on the discarded/deleted data.

Although the data labeling and verification embodiment has been described above, focusing on the image data labeling and verification embodiment, the present invention is not limited thereto, and can be applied to text data labeling and verification operations as well.

For example, the above-described data labeling operation may be performed on structured data (eg, text-based data such as structured classification data, structured regression (continuous value) data, and natural language data). In this case, the labeling operation for the structured data may be performed in a manner of assigning a resultant value of each text data as a label. Labeling and checking operations for structured data can also be performed according to the embodiments proposed in FIGS. 4 and 10, and duplicate descriptions will be omitted.

11 is a flowchart illustrating an AI modeling method of an AI modeling module according to an embodiment of the present invention.

Of course, at least one step in this flowchart may be excluded/omitted according to embodiments, a new step may be added, or the order may also be changed.

Referring to FIG. 11 , first, the AI modeling module may receive data to be learned by the AI from the user (S1101). As the method of receiving data from the user, as described above with reference to FIG. 3 , the method of receiving data from the user in order for the data setting module to construct a data set for learning may be equally applied. Accordingly, the AI modeling module may receive data in various file formats as learning data based on user input. And/or, the AI modeling module may receive (learning) data that has been previously labeled by the data labeling module as data to be learned by the AI.

Next, the AI modeling module may receive input from the user of the type of AI model the user wants to create (S1102).

For example, the AI modeling module is the type of AI model that the user wants to create, such as a structured data automatic classification model, a structured category classification model, a structured continuous value classification model, a natural language processing model, a time series processing model, a recommender system model, and an image classification model. And any one of an image recognition model may be input. A brief introduction to the features of each AI model is as follows:

- Automatic Classification Model for Structured Data: A model that predicts result values appropriate to the situation by dividing a data set entered in a CSV-type table structure into a category classification and continuous value classification in the form of numbers.

- Fixed category classification model: A model that predicts a set outcome value or non-continuous value, such as grades, Yes or No, or a specific brand.

- Structured continuous value classification model: A model that predicts continuous result values in the form of numbers. It can be used for purposes such as expressing risks in a specific field as numbers, scoring a specific field, or predicting a score.

-Natural language processing model: A model that processes human language so that a computer can understand it.

- Time series processing model: A model that predicts the future based on past and present data by learning time series data that includes the concept of time

- Recommendation system model: A model that recommends products, contents, classes, etc. by analyzing customer preferences and finding potential customers with similar tendencies to the analyzed customer

- Image classification model: A model that predicts which category the target image belongs to by learning image data classified by category.

- Image Object Recognition Model: A model that recognizes and classifies objects in an image and partitions/separates the location area of the object.

AI model types are not limited to the above types, and AI model types of various functions/purposes may be input.

Next, the AI modeling module may generate/model at least one AI candidate of the AI model type input by the user by learning the data input from the user (S1103). A plurality of AI candidates may be created/modeled by learning the same input data with different deep learning methods.

Next, the AI modeling module may perform performance evaluation on each generated AI candidate and provide the performance evaluation result to the user (S1104).

12 is a diagram illustrating a screen for providing performance evaluation results for each AI candidate according to an embodiment of the present invention.

Performance evaluation can be performed based on how closely the predicted result values based on the input data of each AI candidate match the actual result values, and as illustrated in this figure, the accuracy and / or error rate is calculated for each candidate. and can be provided to the user.

Based on the performance evaluation, the user may select an AI candidate to be finally created/modeled among the AI candidates (S1105).

Referring back to FIG. 4 , the AI modeling module may determine the AI candidate selected by the user input as the final AI to complete AI generation (S1106). The user can predict the result value by inputting the data to be analyzed into the completed AI. The completed AI can provide individual prediction function and collective prediction function. The individual prediction function corresponds to a function in which the AI predicts and outputs a result value for each variable value when a user inputs each variable value to the AI one by one. The batch prediction function corresponds to a function in which, when a large amount of variable values are input to AI at once, the AI predicts and outputs result values for the input variable values. The former can be used for simple prediction, while the latter can be used for extensive prediction based on file/data. Depending on the purpose of use, the user can predict the result value by utilizing the individual prediction function and the batch prediction function.

13 is a diagram illustrating a screen for providing analysis results of generated/modeled AI according to an embodiment of the present invention.

The AI modeling module analyzes the generated AI and provides analysis results/information to the user to help the user better understand the function/characteristics of the AI. The AI modeling module mainly analyzes how much each attribute/variable/data value entered into AI affects the result value and provides it to the user. The results can be visualized and presented.

14 illustrates an AI market screen provided by an AI distribution module according to an embodiment of the present invention.

The AI distribution module may provide a download function for automatically completed AI according to the above-described procedure. For example, the AI distribution module may generate and provide a download link for downloading the completed AI to the user. Users can download and use the AI they have completed through the download function.

And/or the AI deployment module may provide a deployment function for the completed AI. The deployment function corresponds to a function that provides integrated MLOps (Machine Learning Model Operationalization Management) that can deploy, operate, and manage AI by renting a cloud server. Therefore, users can more easily deploy, operate, and manage AI by renting a server that provides the most suitable environment for running AI through the deployment function, without having to rent or build a separate server.

And/or, the AI modeling module may provide an AI market function for buying and selling completed AI, as illustrated in this figure. Users can sell AI completed by themselves through the AI Market or purchase AI completed by others through the AI Market. Through this, users do not end up simply developing and using AI, but there is an effect that it is possible to generate revenue through AI completed by themselves. In addition, there is an effect that users can easily purchase AI suitable for the purpose/intent of use through the AI market and use it for the desired purpose without having to develop AI themselves.

An embodiment according to the present invention may be implemented by various means, for example, hardware, firmware, software, or a combination thereof. In the case of hardware implementation, one embodiment of the present invention provides one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), FPGAs ( field programmable gate arrays), processors, controllers, microcontrollers, microprocessors, etc.

In addition, in the case of implementation by firmware or software, an embodiment of the present invention is implemented in the form of a module, procedure, function, etc. that performs the functions or operations described above, and is stored on a recording medium readable through various computer means. can be recorded. Here, the recording medium may include program commands, data files, data structures, etc. alone or in combination. Program instructions recorded on the recording medium may be those specially designed and configured for the present invention or those known and usable to those skilled in computer software. For example, recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs (Compact Disk Read Only Memory) and DVDs (Digital Video Disks), floptical It includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media such as a floptical disk, and ROM, RAM, flash memory, and the like. Examples of program instructions may include high-level language codes that can be executed by a computer using an interpreter or the like as well as machine language codes generated by a compiler. These hardware devices may be configured to act as one or more software modules to perform the operations of the present invention, and vice versa.

In addition, an apparatus or terminal according to the present invention may be driven by a command that causes one or more processors to perform the functions and processes described above. For example, such instructions may include interpreted instructions, such as script instructions such as JavaScript or ECMAScript instructions, or executable code or other instructions stored on a computer readable medium. Furthermore, the device according to the present invention may be implemented in a distributed manner over a network, such as a server farm, or may be implemented in a single computer device.

In addition, a computer program (also known as a program, software, software application, script or code) loaded into a device according to the present invention and executing the method according to the present invention includes a compiled or interpreted language or a priori or procedural language. It can be written in any form of programming language, and can be deployed in any form, including stand-alone programs, modules, components, subroutines, or other units suitable for use in a computer environment. A computer program does not necessarily correspond to a file in a file system. A program may be in a single file provided to the requested program, or in multiple interacting files (e.g., one or more modules, subprograms, or files that store portions of code), or parts of files that hold other programs or data. (eg, one or more scripts stored within a markup language document). A computer program may be deployed to be executed on a single computer or multiple computers located at one site or distributed across multiple sites and interconnected by a communication network.

In this specification, 'module' may be replaced with 'unit', 'component', or 'unit'.

For convenience of description, each drawing has been divided and described, but it is also possible to design to implement a new embodiment by merging the embodiments described in each drawing. In addition, the present invention is not limited to the configuration and method of the described embodiments as described above, but the above-described embodiments are configured by selectively combining all or part of each embodiment so that various modifications can be made. It could be.

In addition, although preferred embodiments have been shown and described above, this specification is not limited to the specific embodiments described above, and those skilled in the art in the art to which the specification pertains without departing from the subject matter claimed in the claims Of course, various modifications are possible by the person, and these modifications should not be individually understood from the technical spirit or perspective of the present specification.

Claims (15)

In the AI (Artificial Intelligence) automatic generation method,
A data setting step of constructing a data set for learning including image data including an image object;
Based on a user input, a first manual labeling method for partitioning the region of the image object included in the image data in a rectangular shape, a second manual labeling method for partitioning a discontinuous image, and a continuous image object After performing manual labeling based on any one or more manual labeling methods among the third manual labeling methods for partitioning regions, data labeling, which generates an auto labeling AI by learning the manually labeled image data, and performs labeling. step;
AI modeling step of modeling AI by learning the labeled training data set; and
AI distribution step of distributing the modeled AI; Including, AI automatic generation method. According to claim 1,
In the data setting step,
receiving data including an image object based on a user input; and
configuring the input data into the learning data set; Including, AI automatic generation method. According to claim 2,
In the step of receiving data including an image object based on the user input,
Uploading data including the image object based on the user input; and
loading data including the image object from the specific database management system in association with a specific database management system based on the user input; AI automatic generation method comprising at least one of. According to claim 1,
The data labeling step,
An auto-labeling step of further performing an auto-labeling operation on the remaining image data by inputting the remaining image data except for the manually-labeled image data among the image data included in the training data set to the auto-labeling AI; Including, AI automatic generation method. According to claim 1,
The process of performing the manual labeling,
recognizing the image object included in the partitioned area;
receive a label to be assigned to the image object; and
AI automatic generation method comprising assigning an input label to the recognized image object. According to claim 1,
The process of generating the auto-labeling AI,
Learning the manually labeled image data based on a plurality of deep learning techniques to generate a plurality of auto-labeling AI candidates;
inputting the remaining image data to each of the plurality of auto-labeling AI candidates and outputting an auto-labeling result for each auto-labeling AI candidate; and
Based on the auto-labeling result for each auto-labeling AI candidate, selecting an auto-labeling AI candidate with the highest auto-labeling accuracy as the final auto-labeling AI. According to claim 1,
Checking the auto-labeling result of the remaining data auto-labeled by the auto-labeling AI; Further comprising, AI automatic generation method. According to claim 7,
In the step of inspecting the auto labeling result,
providing an auto-labeling result of the remaining image data auto-labeled by the auto-labeling AI;
receiving a verification pass or verification rejection input for each remaining image data from a user based on a result of the auto labeling; and
Re-learning the auto labeling AI using the remaining image data input after passing the inspection; Including, AI automatic generation method. According to claim 8,
discarding the remaining image data input to reject the verification or performing the manual labeling operation on the remaining image data input to reject the verification based on the user input; Further comprising, AI automatic generation method. According to claim 8,
The step of inspecting the auto-labeling result is repeated until the ratio of the remaining data input to the inspection rejection is reduced to less than a preset ratio, AI automatic generation method. According to claim 1,
The AI modeling step,
Receiving an input of the type of AI model to be created; and
generating the AI by learning at least one of the training data set and the labeled image data according to an input AI model type; Including, AI automatic generation method. According to claim 11,
The step of generating the AI is,
generating a plurality of AI candidates by learning at least one of the image data set and the labeled image data based on a plurality of deep learning techniques set for the input AI model type;
Evaluating the performance of the plurality of AI candidates; and
selecting a final AI from among the plurality of AI candidates based on performance evaluation results for each of the plurality of AI candidates; Including, AI automatic generation method. According to claim 12,
Evaluating the performance of the plurality of AI candidates,
obtaining a result value for each AI candidate by inputting the same image data to the plurality of AI candidates;
Determining a matching degree by comparing a result value obtained for each AI candidate with an actual result value; and
Evaluating the performance higher as the matching degree increases; Including, AI automatic generation method. According to claim 12,
Analyzing the final AI and providing analysis results; Including more,
The analysis result includes a result of analyzing the effect of the attribute input to the final AI on the resultant value. According to claim 1,
The AI distribution step,
providing a download link through which the AI can be downloaded;
Providing an integrated Machine Learning Model Operationalization Management (MLOps) capable of operating and managing the AI; and
Providing an AI market function capable of selling the AI; AI automatic generation method comprising at least one of.

Images