KR102247246B1 - Method to identify label - Google Patents

Abstract

As a computer program stored in a computer-readable storage medium according to one embodiment of the present disclosure, the computer program provides a user interface (UI) that displays labeling information when executed on one or more processors of a computing device; and the user interface may comprise: an image viewer layer that displays an image including one or more label target objects and an annotation form for each of the one or more label target objects; and a label list layer that displays a class for each of the two or more classes included in the label of each of the one or more label target objects.

Description

How to check the label {METHOD TO IDENTIFY LABEL}

The present invention relates to a method of confirming a label, and more particularly, to a method of providing a user interface for displaying information for confirming a generated label.

Various types of research on machine learning algorithms are being conducted, and as a result, various deep learning techniques such as deep neural networks, convolutional neural networks, and recurrent neural networks are used in computer vision, It is applied to fields such as speech recognition and natural language processing.

These machine learning algorithms have a complex structure and can output results through complex operations. In order to process data using machine learning algorithms, a considerable understanding of machine learning algorithms must be preceded, and accordingly, users who can use machine learning algorithms are limited.

Accordingly, there is a need in the art to allow users to easily access machine learning algorithms, and there is a need to easily generate labeled data for learning of machine learning algorithms.

Korean Patent Publication No. 2016-0012537 discloses a neural network learning method and apparatus, and a data processing apparatus.

The present disclosure has been devised in response to the above-described background technology, and an object of the present disclosure is to provide a method of displaying information for labeling confirmation.

A computer program stored in a computer-readable storage medium according to an embodiment of the present disclosure for realizing the above-described problems, wherein the computer program is a user interface that displays labeling information when executed in one or more processors of a computing device ( UI), wherein the user interface includes: an image viewer layer for displaying an image including one or more label object objects and an annotation form for each of the one or more label object objects; And a label list layer that displays a class for each of two or more layers included in a label of each of the one or more label target objects.

In an alternative embodiment of computer program operations that allow to perform the following operations to provide a label verification method, the image viewer layer comprises: an annotation corresponding to the one or more labels, in response to a user selection input for one or more labels. Visual representation can be displayed on the form.

In an alternative embodiment of computer program operations that allow to perform the following operations to provide a label verification method, the label list layer is: in response to user selection input for one or more annotation forms, corresponding to the one or more annotation forms. Visual representation can be displayed on the label.

In an alternative embodiment of computer program operations for performing the following operations for providing a label verification method, the user interface comprises: at least one of a label included in the label list layer or an annotation form included in the image viewer layer. In response to a user modification input for, a label modification layer that allows a user class modification input for a class corresponding to each of two or more layers of the label target object may be further included.

In an alternative embodiment of computer program operations for performing the following operations for providing a label verification method, the label correction layer comprises: a first class display object corresponding to a first layer, a second class display object corresponding to a second layer Display a class display object, a layer addition object, and a layer deletion object, and further display a third class display object corresponding to a third layer in response to a user input to the layer addition object, or on the layer deletion object The second class display object corresponding to the second layer may be deleted in response to a user input for the second class.

In an alternative embodiment of computer program operations for performing the following operations for providing a label verification method, the label correction layer comprises: one or more first template classes corresponding to the first layer and one corresponding to the second layer. In response to a user label correction input for at least one of the first template class or the second template class, and including a template class selection area displaying the second template class, a first corresponding to the first layer At least one of the class display object or the second class display object corresponding to the second layer may be modified and displayed as at least one of the first template class or the second template class corresponding to the user label correction input, respectively.

In an alternative embodiment of computer program operations that allow to perform the following operations to provide a label verification method, the label list layer is: a label containing the same classes as the one label, if there is a modification to one label. Can be displayed by modifying them accordingly.

In an alternative embodiment of computer program operations that allow to perform the following operations to provide a label verification method, the image viewer layer is configured to: display the modified annotation form in response to a user modification input to the annotation form. I can.

In an alternative embodiment of computer program operations to perform the following operations for providing a label verification method, the image viewer layer is: When there is a modification to one annotation form, the label corresponding to the one annotation form The annotation forms corresponding to the label can be modified and displayed accordingly.

In an alternative embodiment of computer program operations that allow to perform the following operations for providing a label verification method, the image viewer layer is: If there is a modification to one annotation form, the class of the label of the one annotation form Annotation forms corresponding to a label including a class corresponding to at least some of the classes may be correspondingly modified and displayed.

In an alternative embodiment of computer program operations that allow to perform the following operations to provide a label verification method, the image viewer layer: When there is a modification of the shape for one annotation form, the label of the one annotation form and The shape of the annotation forms corresponding to the corresponding label may be corrected and displayed, and at least one of the size or angle of the annotation forms may be adjusted and displayed to correspond to at least one of the size or angle of the label target object.

In an alternative embodiment of computer program operations that allow to perform the following operations for providing a label verification method, the image viewer layer is: If there is a modification to one annotation form, the class of the label of the one annotation form Annotation forms corresponding to a label including a class corresponding to at least some of the classes may be correspondingly modified and displayed.

In an alternative embodiment of computer program operations to perform the following operations to provide a label verification method, the image viewer layer is: a label of the one annotation form if there is a modification of the shape for one annotation form. The shape of the annotation forms corresponding to the label corresponding to is corrected to be displayed, and at least one of the size or angle of the annotation forms may be adjusted and displayed to correspond to at least one of the size or angle of the label target object. .

In an alternative embodiment of computer program operations for performing the following operations for providing a label verification method, in response to a user selection input for an object viewer display object, an object viewer layer displaying one or more object viewer areas is further provided. The object viewer area may include: one annotation form and a label target object corresponding to the one annotation form may be adjusted and displayed so that an image is located at the center of the object viewer area.

In an alternative embodiment of computer program operations to perform the following operations for providing a label verification method, the object viewer layer: displays each of the label target objects to which a class of at least one layer included in the label corresponds. You can display the object viewer areas.

In an alternative embodiment of computer program operations to perform the following operations for providing a label verification method, the object viewer layer: In response to a user selection input for a label included in the label list layer, the selected label is Object viewer areas displaying each of the label target objects having a label corresponding to a class for at least one included layer may be displayed.

In an alternative embodiment of computer program operations for performing the following operations for providing a label verification method, the image viewer layer comprises: in response to a user selection input for one object viewer region, the one object viewer region The image can be adjusted and displayed so that the object to be labeled to be displayed is located in the center.

A method of displaying labeling information in a user terminal according to an embodiment of the present disclosure for realizing the above-described problem, comprising: an image including one or more label object objects in an image viewer layer and each of the one or more label object objects. Displaying an annotation form for; And displaying a class for each of two or more layers included in a label of each of the one or more label target objects on a label list layer.

A user terminal according to an embodiment of the present disclosure for realizing the above-described problem, comprising: a processor including one or more cores; Memory; And an output unit providing a user interface, wherein the user interface includes: an image viewer layer that displays an image including one or more label object objects and an annotation form for each of the one or more label object objects; And a label list layer that displays a class for each of two or more layers included in a label of each of the one or more label target objects.

A server according to an embodiment of the present disclosure for realizing the above-described problem, comprising: a processor including one or more cores; Network unit; And a memory, wherein the processor determines to transmit a user interface to a user terminal through the network unit, wherein the user interface includes: an image including one or more label object objects and an annotation form for each of the one or more label object objects An image viewer layer that displays; And a label list layer that displays a class for each of two or more layers included in a label of each of the one or more label target objects.

The present disclosure may provide a method of displaying information for labeling confirmation on a user interface.

1 is a diagram illustrating a block diagram of a computing device that performs operations for displaying labeling information on a user interface according to an embodiment of the present disclosure.
2 is an exemplary diagram in which labeling information is displayed on a user interface according to an embodiment of the present disclosure.
3 is an exemplary diagram in which labeling information is displayed on a user interface according to an embodiment of the present disclosure.
4 is an exemplary diagram in which labeling information is displayed on a user interface according to an embodiment of the present disclosure.
5 is a flowchart illustrating a method for checking labeling information according to an embodiment of the present disclosure.
6 is a block diagram of a computing device according to an embodiment of the present disclosure.

Various embodiments are now described with reference to the drawings. In this specification, various descriptions are presented to provide an understanding of the present disclosure. However, it is clear that these embodiments may be implemented without this specific description.

As used herein, the terms "component", "module", "system" and the like refer to a computer-related entity, hardware, firmware, software, a combination of software and hardware, or execution of software. For example, a component may be, but is not limited to, a process executed on a processor, a processor, an object, a thread of execution, a program, and/or a computer. For example, both an application running on a computing device and a computing device may be components. One or more components may reside within a processor and/or thread of execution. A component can be localized within a single computer. A component can be distributed between two or more computers. In addition, these components can execute from a variety of computer readable media having various data structures stored therein. Components can be, for example, through a signal with one or more data packets (e.g., data from one component interacting with another component in a local system, a distributed system, and/or a signal through another system and a network such as the Internet. Depending on the data being transmitted), it may communicate via local and/or remote processes.

In addition, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or”. That is, unless specified otherwise or is not clear from the context, "X employs A or B" is intended to mean one of the natural inclusive substitutions. That is, X uses A; X uses B; Or when X uses both A and B, "X uses A or B" can be applied to either of these cases. In addition, the term “and/or” as used herein should be understood to refer to and include all possible combinations of one or more of the listed related items.

In addition, the terms "comprises" and/or "comprising" should be understood to mean that the corresponding features and/or components are present. However, it is to be understood that the terms "comprising" and/or "comprising" do not exclude the presence or addition of one or more other features, elements, and/or groups thereof. In addition, unless otherwise specified or when the context is not clear to indicate a singular form, the singular in the specification and claims should be interpreted as meaning "one or more" in general.

Those of skill in the art would further describe the various illustrative logical blocks, configurations, modules, circuits, means, logics, and algorithm steps described in connection with the embodiments disclosed herein, including electronic hardware, computer software, or a combination of both. It should be recognized that it can be implemented as To clearly illustrate the interchangeability of hardware and software, various illustrative components, blocks, configurations, means, logics, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented in hardware or as software depends on the specific application and design restrictions imposed on the overall system. Skilled technicians can implement the described functionality in various ways for each particular application. However, such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.

Description of the presented embodiments is provided so that a person of ordinary skill in the art of the present disclosure can use or implement the present invention. Various modifications to these embodiments will be apparent to those of ordinary skill in the art. The general principles defined herein may be applied to other embodiments without departing from the scope of the present disclosure. Thus, the present invention is not limited to the embodiments presented herein. The invention is to be accorded the widest scope consistent with the principles and novel features presented herein.

In an embodiment of the present disclosure, the server may include other components for executing the server environment of the server. The server may include any type of device. The server is a digital device, and may be a digital device equipped with a processor, such as a laptop computer, a notebook computer, a desktop computer, a web pad, and a mobile phone, and equipped with a memory and computing power. The server may be a web server that processes services. The types of servers described above are only examples, and the present disclosure is not limited thereto.

In this specification, neural networks, artificial neural networks, and network functions can often be used interchangeably.

1 is a diagram illustrating a block diagram of a computing device that performs operations for displaying labeling information on a user interface according to an embodiment of the present disclosure.

The computing device 100 for providing a label checking method or a user interface for displaying label information according to an embodiment of the present disclosure includes a network unit 110, a processor 120, a memory 130, and an output unit 140. And an input unit 150.

In embodiments of the present disclosure, a layer may mean a layer that is displayed on a user interface and used to overlap and display multiple images. Two or more layers may be overlapped and displayed. When two or more layers are overlapped and displayed, one layer may hide the other layer and may not be visible. Alternatively, when two or more layers are overlapped and the upper layer is partially semi-transparent, at least a part of the lower layer may be visible. Two or more layers may have the same size. Also, two or more layers may have different sizes. The layer may include one or more regions. Also, a layer may include one or more display objects.

In embodiments of the present disclosure, a layer may be divided into a plurality of regions. The plurality of areas may be one space on the screen that does not overlap. One layer may include only one area or may include a plurality of areas. One area may include one or more display objects.

In the embodiments of the present disclosure, the object may be a set of pictures, symbols, or letters corresponding to each program, command, or data. According to an embodiment of the present disclosure, an object may be used to receive a user selection input. For example, when receiving a user input for an object, the processor 120 may execute a command or data stored in correspondence with the object and display it on the user interface. In the embodiments of the present disclosure, an object and a display object may be interpreted as having the same meaning.

In the embodiments of the present disclosure, “display” may be an operation of displaying data to a user through the output unit 140. "Display" and "display" can be used interchangeably.

Hereinafter, a method of providing a user interface displaying labeling information according to exemplary embodiments of the present disclosure will be described.

Research is being conducted on various methods of calculating images and the like using network functions. In order to learn the network function, supervised learning, unsupervised learning, and semi supervised learning may be used. As a method for learning a network function, a teacher learning method is generally used most. Teacher learning may be a method of learning a network function while knowing the input data and the correct answer to the input data. In order to train a network function, it is necessary to generate training data including input data and a pair of correct answers to the input data. In order to generate training data, it is necessary to label the correct answers to the input data with respect to the input data. In addition, there is a need to confirm or correct the correct answer labeled in the input data.

When constructing training data, you can use capital labeling. The capital labeling may be a temporary generation of a label for training data through an operation of a computing device. Experts may check the water-labeled learning data to determine a correct answer or error for the water supply labeling. When professionals create labeling from scratch, it is time-consuming and costly. However, when water supply labeling is first generated using a computing device, or when non-experts firstly create water supply labeling, and secondly, when experts determine whether or not the water supply labeling is appropriate, learning data is generated. , It is possible to reduce the time and cost consumption of building learning data.

In addition, when researching network functions, there is a need to partially modify the learning data according to the progress of the research. When conducting research on network functions, there is a need to modify at least some of the training data included in the training data set in order to first derive results using the training data and to derive secondary results in the other direction. exist. In this case, when learning data is checked or modified through a user interface provided according to an embodiment of the present invention, the efficiency of the network function may also be increased.

Hereinafter, a method of displaying a user interface by the processor 120 will be described with reference to FIG. 2.

The processor 120 may display the navigation layer 500 on the user interface. The navigation layer 500 may display a display object for receiving a user selection input for a labeling verification method. There may be two different methods of labeling verification. As for the labeling verification method, there may be a method of verifying the labeling by two different criteria. As a method of checking labeling, there may be a method of checking labeling based on a labeled image and a method of checking labeling based on a labeled object.

The navigation layer 500 may include an image viewer display object 510 and an object viewer display object 520.

The image viewer display object 510 may receive a user selection input for confirming labeling based on the labeled image. The processor 120 may display the image viewer layer 200 on the user interface in response to a user selection input for the image viewer display object 510. The processor 120 may arrange the label list layer 400 and the image viewer layer 200 side by side in the user interface in response to a user selection input for the image viewer display object 510. FIG. 2 illustrates an exemplary diagram in which a label list layer 400 and an image viewer layer 200 are arranged side by side in a user interface according to an embodiment of the present disclosure. The user may check the labeling target object included in the image and the annotation form for the labeling target object displayed on the image viewer layer 200. The user can check which labels are labeled with respect to the object to be labeled included in the image through the label list layer 400 arranged side by side with the image viewer layer 200. The detailed description of the above-described image viewer layer is only an example, and the present disclosure is not limited thereto.

The object viewer display object 520 may receive a user selection input for confirming labeling based on the labeled object. The processor 120 may display the label list layer 400 and the object viewer layer 600 on the user interface in response to a user selection input for the object viewer display object 520. The processor 120 may arrange the label list layer 400 and the object viewer layer 600 side by side in the user interface in response to a user selection input for the object viewer display object 520. 4 illustrates an exemplary diagram in which a label list layer 400 and an object viewer layer 600 are arranged side by side in a user interface according to an embodiment of the present disclosure. The user may check the annotation form for each of the one or more objects to be labeled, displayed on the object viewer layer 600. The object viewer layer 600 may display an object to be labeled and an annotation form for the object to be labeled, centering on the labeled objects. The user can check which labels are labeled for each labeling target object through the label list layer 400 arranged parallel to the object viewer layer 600. The detailed description of the above-described object viewer layer is only an example, and the present disclosure is not limited thereto.

The processor 120 may display the image viewer layer 200 on the user interface.

The image viewer layer 200 may display an image including one or more objects to be labeled. The size of the image viewer layer 200 may be the same size as the image. The size of the image viewer layer 200 may be different from the image. The image viewer layer 200 may adjust and display the image size so as to correspond to the size of the image viewer layer 200. The image viewer layer 200 may be a layer for displaying a visual representation of a label target object included in an image. The visual representation may be an annotation form for the object to be labeled.

The image can be the object of operation of the network function. The image may be data used to input training data. At least a portion of the image may be data to be input for training data. The image may be data input to the input layer of the network function. At least a portion of the image may be data input to the input layer of the network function. The image may be, for example, an image included in a satellite image. Images may include metadata. The metadata may be, for example, a latitude, longitude, or geographic coordinate system of a satellite image. The specific description of the above-described image is only an example, and the present disclosure is not limited thereto.

The image may include an object to be labeled. The label target object may be an object to be identified included in the image. The label target object may be an object to be identified using a network function. The object to be labeled may be an object to be labeled included in the image. For example, when the image is at least a part of a satellite image, the object to be labeled may be a mountain, a building, a ship, or the like. The detailed description of the label target object is only an example, and the present disclosure is not limited thereto.

The label object object may be associated with a label. Each of the two or more label target objects included in the image may be associated with a label, respectively. The label target object and the label included in the image may be labeled. The label may be a characteristic of the object to be labeled. The label associated with the label target object may include a class for a hierarchy.

Labels can contain classes for one layer. Labels may contain classes for each of two or more layers. For example, the label may include a class for each of the first layer and the second layer. One layer can be associated with more than one class. The specific description of the above label is for illustrative purposes only, and the present disclosure is not limited thereto.

According to an embodiment of the present disclosure, a hierarchy may represent an upper subset relationship of classes. One layer can have a sub-set relationship with other layers. For example, the first layer may be a superset of the second layer. The first layer and the second layer may have an inclusion relationship on the image. For example, in a satellite image, classes for the second layer may be a relationship included in the class for the first layer. For example, the image may be an image of an aircraft carrier floating on the sea. Aircraft carriers may contain fighters, tanks and containers. For example, for an aircraft carrier image, labels may include a first layer and a second layer. Classes for the first tier may be sea and aircraft carriers. The classes for the second tier can be fighters, tanks and containers. The label for the object to be labeled as a fighter aircraft may be'first layer: aircraft carrier' and'second layer: fighter aircraft'. Alternatively, for example, the class for the first layer may be a semiconductor panel and a conveyor belt, and the class for the second layer may be a hole, copper, or conductor included in the semiconductor panel. Specific description of the above-described label is only an example, and the present disclosure is not limited thereto.

According to an embodiment of the present disclosure, each layer may represent a classification of a different property. For example, the first layer and the second layer may represent classifications of different properties, respectively. For example, if the object to be labeled is clothes, the class for the first layer is top, bottom, dress, outerwear, the class for the second layer is women's wear, men's wear, and the class for the third layer is A brand, B It could be a brand. For example, a label for a specific label target object may be a first layer: dress,'second layer: women's wear', and'third layer: A brand'. Specific description of the above-described label is only an example, and the present disclosure is not limited thereto.

The image viewer layer 200 may include a display object for adjusting an image. Display objects for adjusting the image may be display objects for adjusting the size, contrast, brightness, shadow, transparency, angle, and the like of the image. The processor 120 may enlarge an image or adjust brightness in response to a user input to a display object for adjusting the image.

The image viewer layer 200 may adjust and display an image so that objects included in the image are displayed at the center of the image viewer layer 200. The processor 120 may analyze the image, enlarge a portion in which many labeled objects or annotation forms are distributed in the image, and display it on the image viewer layer 200. The processor 120 analyzes the image, adjusts the image so that a portion in which many labeled objects or annotation forms are distributed in the image to be located at the center of the image viewer layer 200 may be displayed on the image viewer layer 200. .

The image viewer layer 200 may adjust and display an image in response to a user's image adjustment input. For example, in response to an image adjustment input of dragging an image with a mouse, the image viewer layer 200 may adjust and display the position of the image in the dragging direction. For example, in response to an image adjustment input using an arrow on the keyboard, the image viewer layer 200 may adjust and display the position of the image in the direction of the arrow on the keyboard. The detailed description of the above-described image viewer layer is only an example, and the present disclosure is not limited thereto.

The image viewer layer 200 may be displayed in a user interface together with the minimap layer 210. The minimap layer 210 may be a layer different from the image viewer layer 200. The minimap layer 210 may be displayed by being superimposed on the image viewer layer 200. The minimap layer 210 may display a minimap for an image. The minimap may be a reduced whole image. For example, when the image is a satellite image, the minimap may be an image obtained by reducing the satellite image image. The minimap may be a map for displaying coordinates of a portion of an image displayed on the image viewer layer 200 among all images. It is possible to check which part of the image is the area currently displayed on the image viewer layer 200 through the mini-map. The minimap viewer layer 210 may display a visual representation of an area currently displayed on the image viewer layer 200 among all images. For example, when a container part of the satellite image image is enlarged and displayed on the image viewer layer 200, the minimap layer 210 may display a visual expression with a red border on the container part of the reduced satellite image image. The detailed description of the above-described minimap layer is only an example, and the present disclosure is not limited thereto.

The image viewer layer 200 may adjust and display an image so that the corresponding coordinates are displayed on the image viewer layer 200 in response to a user input for a specific coordinate in the minimap layer 210. For example, when a user drags a red border portion from the minimap layer 210 to another area, the image viewer layer 200 may adjust and display the image so that the other area is displayed. For example, when a user clicks a specific coordinate on the minimap layer 210, the red border may be moved so that the center of the red border overlaps with the specific coordinate, and the image layer 200 is the image viewer layer 200 ) Can be displayed by adjusting the image so that the corresponding part is displayed. The detailed description of the above-described minimap layer is only an example, and the present disclosure is not limited thereto.

The image viewer layer 200 may display annotation forms 202 and 204 for each of one or more label target objects. The image viewer layer 200 may display annotation forms 202 and 204 stored in correspondence with the image in advance. That is, annotation forms 202 and 204 and a label for the annotation forms 202 and 204 may be stored in the label target object included in the image. The image viewer layer 200 may display annotation forms 202 and 204 previously stored for objects of an image so that a user can check which part of the image or which object is labeled. The image viewer layer 200 may not only display one annotation form, but may display all the annotation forms 202 and 204 stored corresponding to the image.

The annotation forms 202 and 204 may be a determination of a label target position included in the image. Annotation forms 202 and 204 can be used to build a training data set.

According to an embodiment of the present disclosure, the processor 120 may construct a training data set using the entire image. That is, the processor 120 may include an image and a label generated corresponding to the image in the training data set. The processor 120 may determine the image as input data of the training data set. The processor 120 may determine the annotation forms 202 and 204 indicating positions for each of the label target objects included in the image and labels for the label target objects as correct answers of the training data set. For example, the processor 120 may determine the satellite image image extracted from the satellite image as input data of the training data. For example, the processor 120 determines the correct answer (that is, the first layer: aircraft carrier / second layer: fighter) of the form 202, 204 and label (first layer: aircraft carrier / second layer: fighter) for the object object to be labeled as a fighter aircraft included in the satellite image image. , Can be determined by the label of the input data). Detailed description of the above-described training data set is only an example, and the present disclosure is not limited thereto.

According to an embodiment of the present disclosure, the processor 120 may construct a training data set by separating only portions of the annotation forms 202 and 204. That is, the processor 120 may include the annotation forms 202 and 204 portions and a label generated corresponding to the annotation forms 202 and 204 in the training data set. For example, the processor 120 may separate the portions of the annotation forms 202 and 204 of the object to be labeled with the fighter plane from the image to input training data. The processor 120 may determine a label (first layer: aircraft carrier / second layer: fighter) for the object object to be labeled as a correct answer of the training data (ie, a label of input data). Detailed description of the above-described training data set is only an example, and the present disclosure is not limited thereto.

The annotation forms 202 and 204 may be for displaying an area of an object to be labeled, which is previously stored in correspondence with an image. By displaying the area of the label object object to generate training data, the processor 120 may perform the identification of the position of the label object object or the label object object through an image operation using a network function. The processor 120 may display the annotation forms 202 and 204 on the image viewer layer 200 to allow a user to check the annotation forms 202 and 204 that are the basis of the training data. The processor 120 may display the annotation forms 202 and 204 on the image viewer layer 200 so that the user can check whether labeling has been properly performed on the object to be labeled.

The annotation forms 202 and 204 may be displayed in various shapes. The annotation forms 202 and 204 may be displayed in a shape that is stored in correspondence with an image in advance. The annotation forms 202 and 204 may be previously stored as, for example, a rectangle, a circle, or a polygon. 2 illustrates the annotation forms 202 and 204 displayed based on the shape of the rectangular annotation form as an example, but the present disclosure is not limited thereto, and the display of the label target object area may be stored in various shapes. have. The detailed description of the above-described annotation form is only an example, and the present disclosure is not limited thereto.

According to an embodiment of the present disclosure, the image viewer layer 200 is an annotation form 202 corresponding to one or more labels in response to a user selection input for one or more labels 410 displayed on the label list layer 400. Visual expression can be displayed on. When the user selects a label included in the label list layer 400, an annotation form corresponding to the label is displayed on the image viewer layer 200, so that the user can determine which part of the image the label target object labeled with the label is It can be easily identified. The detailed description of the above-described image viewer layer is only an example, and the present disclosure is not limited thereto.

The processor 120 may receive a user selection input for at least one label among a plurality of labels displayed on the label list layer 400. The processor 120 may differentiate the user-selected input label 410 from other labels and display them differently. That is, the processor 120 may display a visual expression for the label input by the user selection. The visual expression may be an expression capable of distinguishing a user-selected input label from other labels. For example, the visual expression may be displayed by adjusting the color, transparency, and brightness of the label 410. The detailed description of the above-described label list layer is only an example, and the present disclosure is not limited thereto.

The processor 120 may display the annotation form 202 in which the user-selected input label is corresponding and stored, differently from the other annotation forms 204 in the image viewer layer 200. The processor 120 may display a visual representation on the annotation form 202 corresponding to the user selection input. The visual expression may be an expression capable of distinguishing one annotation form from other annotation forms. For example, the visual expression may be displayed by adjusting the color, transparency, and brightness of the annotation form. For example, the annotation form 202 may darken the interior, and the other annotation forms 204 may lighten the interior. The detailed description of the above-described image viewer layer is only an example, and the present disclosure is not limited thereto.

The processor 120 may receive a user selection input for two or more labels. Processor 120 may generate a different visual representation for each of the two or more labels. That is, the processor 120 may generate a first visual expression for the first label input by the user selection and generate a second visual expression for the second label. In response to the user selection input, the processor 120 may generate a visual expression corresponding to the first visual expression in the first annotation form corresponding to the first label. In response to the user selection input, the processor 120 may generate a visual expression corresponding to the second visual expression in the second annotation form corresponding to the second label. For example, when the processor 120 generates the visual expression in blue for the first label, the processor 120 may generate the visual expression in blue in the annotation form corresponding to the first label. For example, when the processor 120 generates the visual expression in yellow for the second label, the processor 120 may generate the visual expression in yellow in the annotation form corresponding to the second label. That is, even when the user selects more than one label, the visual representation of the labels and the annotation forms may be determined differently so that the user can easily identify which annotation form corresponds to a label. The detailed description of the above-described visual expression is only an example, and the present disclosure is not limited thereto.

According to an embodiment of the present disclosure, in response to a user selection input for one or more annotation forms included in the image viewer layer 200, the label list layer 400 provides a visual representation on a label corresponding to one or more annotation forms. Can be displayed. When the user selects the annotation form included in the image viewer layer 200, a label corresponding to the annotation form is displayed on the label list layer 400, so that the user You can easily check if it is a class. The detailed description of the above-described label list layer is only an example, and the present disclosure is not limited thereto.

The processor 120 may receive a user selection input for at least one annotation form 202 among a plurality of annotation forms 202 and 204 displayed on the image viewer layer 200. The processor 120 may differentiate and display the user-selected input annotation form 202 from other annotation forms 204. That is, a visual representation of the annotation form 202 inputted by the user selection may be displayed.

The processor 120 may display the label 410 stored in correspondence with the annotation form 202 input by the user selection input differently from other labels in the label list layer 400. The processor 120 may display a visual expression on the label 410 corresponding to the user selection input.

The processor 120 may receive user selection inputs for two or more annotation forms. Processor 120 may generate different visual representations for two or more annotation forms. The processor 120 may generate a first visual expression for the first annotation form inputted by the user selection, and may generate a second visual expression for the second annotation form. In response to the user selection input, the processor 120 may generate a visual expression corresponding to the first visual expression in the first label corresponding to the first annotation form. In response to the user selection input, the processor 120 may generate a visual expression corresponding to the second visual expression in the second label corresponding to the second annotation form.

Hereinafter, a method of modifying the annotation form by the processor 120 will be described.

The image viewer layer 200 may display a modified annotation form in response to a user modification input to the annotation forms 202 and 204. If there is a need to modify the annotation form among the annotation forms displayed on the image viewer layer 200, the user may modify at least some of the annotation forms. For example, if the user checks the learning data for which the labeling has been completed, and the annotation form is displayed incorrectly for the object to be labeled, the corresponding annotation form display can be corrected. Alternatively, for example, when learning a network function, performance according to previously labeled training data is low, and thus at least some of the annotation form display may be modified even when labeling is attempted in another way. Detailed description of the above-described user correction input is only an example, and the present disclosure is not limited thereto.

The user modification input may be an input for modifying the annotation forms 202 and 204. The user modification input may be an input for modifying at least one of the shape, position, size, or angle of the annotation forms 202 and 204. For example, when the shape of the annotation forms 202 and 204 is a square, the shape of the annotation form may be modified to be a polygon. For example, the user modification input for modifying the shape of the annotation form into a polygon may include a plurality of click-and-drag inputs. For example, the plurality of click-and-drag inputs may be performing click-and-drag inputs along an edge of an airplane object. For example, the annotation forms 202 and 204 may be adjusted in response to a user's click and drag input on the annotation forms 202 and 204. For example, in response to a click-and-drag input for an area within the annotation forms 202 and 204, the image viewer layer 200 may move and display the annotation forms 202 and 204 corresponding to the drag direction. For example, in response to a click-and-drag input on a border or corner of the annotation forms 202 and 204, the image viewer layer 200 resizes and displays the annotation forms 202 and 204 to correspond to the drag direction. can do. For example, in response to a click-and-drag input for a circle portion connected to the annotation form outside the annotation forms 202 and 204, the image viewer layer 200 moves the annotation forms 202 and 204 to an angle corresponding to the drag direction. Can be adjusted and displayed. The detailed description of the above-described user correction input is only an example, and the present disclosure is not limited thereto.

When there is a modification to one annotation form, the image viewer layer 200 may correspondingly modify and display an annotation form corresponding to a label corresponding to a label of one annotation form. The processor 120 may identify a label corresponding to the modified annotation form. The processor 120 may identify a label including the same classes as the corresponding label. The processor 120 may modify annotation forms for labels including the same classes to correspond to the modified annotation form. For example, when the label for the modified annotation form is'first layer/second layer/third layer: aircraft carrier/airplane/airplane A', the label is'first layer/second layer. Tier/Third Tier: Other annotation forms such as Aircraft Carrier/Airplane/Airplane A'can be modified accordingly. The processor 120 may not modify the annotation forms corresponding to “first layer/second layer/third layer: aircraft carrier/airplane/airplane B” because other classes are included. Detailed description of the above-described annotation form modification is only an example, and the present disclosure is not limited thereto.

When there is a modification to one annotation form, the image viewer layer 200 modifies the annotation forms corresponding to a label including a class corresponding to at least some of the classes of the label of one annotation form to be correspondingly modified. Can be displayed. The processor 120 may identify a label corresponding to the modified annotation form. The processor 120 may identify a class for each of two or more layers included in the label. The processor 120 may modify annotation forms for labels in which at least some of the two or more classes are the same to correspond to the modified annotation form. For example, the processor 120 may correspondingly modify the modified annotation form and other annotation forms having the same class for at least the second layer. Detailed description of the above-described annotation form modification is only an example, and the present disclosure is not limited thereto.

When the shape of one annotation form is modified, the image viewer layer 200 may display a label of one annotation form by correspondingly modifying the shape of the annotation forms corresponding to the corresponding label. When the shape of the annotation form is modified, the shape of the annotation forms of the label having the same class as at least some of the classes included in the label of one annotation form may be correspondingly modified and displayed. That is, in the case of a label target object labeled on the same label, the processor 120 is an object of the same shape, and thus the shape of the annotation forms may be correspondingly modified. For example, if the annotation form was displayed as a rectangle and the shape was modified to be a polygon so that the annotation form could display an airplane border, the processor 120 would also modify the annotation form to a corresponding polygon shape for the remaining airplane objects. I can. Detailed description of the above-described annotation form modification is only an example, and the present disclosure is not limited thereto.

The image viewer layer 200 may adjust and display at least one of the size or angle of the annotation forms to correspond to at least one of the size or angle of the label target object. Even in the case of label target objects labeled on the same label, they may be displayed in different sizes or angles on the image. Therefore, when there is a modification to one annotation form, the processor 120 modifies the shape of other annotation forms of the same label to correspond, but the angle or size is adjusted to fit the angle or size of each label target object. I can. Detailed description of the above-described annotation form modification is only an example, and the present disclosure is not limited thereto.

The processor 120 may display the label list layer 400 on the user interface. The label list layer 400 may display a list of labels that have been previously labeled and stored. The label list layer 400 may display labels of each of the training data included in the training data set.

The label list layer 400 may display a class for each of two or more layers included in each label of one or more label target objects.

The label list layer 400 may sequentially display labels for one or more training data. For example, the order of the label list may be determined by a predetermined order. For example, the order of labels included in the label list may be determined in the order in which the number of the same labels is large. For example, the order of labels included in the label list may be determined in alphabetical order. The detailed description of the above label list is only an example, and the present disclosure is not limited thereto.

The label list layer 400 may display the same labels by arranging them side by side. For example, the processor 120 may arrange the labels of “first layer/second layer/third layer: aircraft carrier/airplane/airplane A” in order and display them in the label list layer 400. . The detailed description of the above label list is only an example, and the present disclosure is not limited thereto.

The label list layer 400 may display labels having the same class in at least some of the two or more layers included in the labels adjacent to each other. For example, the processor 120 includes'first tier/second tier/third tier: aircraft carrier/airplane/airplane A'and “first tier/second tier/third tier: aircraft carrier/airplane/airplane. Since the label B'differs only in the class for the third layer, and the classes for the first layer and the second layer are the same, they may be arranged adjacent to each other and displayed on the label list layer 400. The detailed description of the above label list is only an example, and the present disclosure is not limited thereto.

The processor 120 may display the label correction layer 300 on the user interface. The label correction layer will be described with reference to FIG. 3.

The label modification layer 300 is a response to a user modification input for at least one of a label included in the label list layer 400 or an annotation form included in the image viewer layer 200, and each of two or more layers of the label target object User class modification input can be allowed for the class corresponding to. That is, if the user wants to modify at least some of the classes for each of two or more layers included in the label, the user may select the corresponding label from the label list layer 400, or the corresponding label from the image viewer layer 200. Since the annotation form can be selected, the user's convenience can be improved. In addition, when the labeled training data is modified according to an embodiment of the present disclosure, the accuracy of the training data is improved, and the performance of the network function may also be improved.

The label correction layer 300 may be a layer separated from the image viewer layer 200 or the label list layer 400. The label correction layer 300 may be a layer having a size different from that of the image viewer layer 200 or the label list layer 400. The label correction layer 300 may be a layer having a size smaller than that of the image viewer layer 200 or the label list layer 400. The label correction layer 300 may be an upper layer of the image viewer layer 200 or the label list layer 400. That is, the label correction layer 300 is displayed above the image viewer layer 200 or the label list layer 400, and the label correction layer 300 provides the image viewer layer 200 or the label list layer 400. At least part of it may be obscured. The detailed description of the above-described label correction layer is only an example, and the present disclosure is not limited thereto.

The label correction layer 300 may be moved independently from the image layer 200 or the label list layer 400. That is, the label correction layer 300 may be a floating layer. The size of the label correction layer 300 may be adjusted based on a user input. For example, when it is desired to check the label target object at the lower right of the image layer 200, the label correction layer 300 located at the lower right may be moved to a different position. The detailed description of the above-described label correction layer is only an example, and the present disclosure is not limited thereto.

The label modification layer 300 may allow a user modification input to modify a class for each of two or more layers included in a label of a label target object. Learning data corresponding to the label target object may be generated based on a user modification input in the label modification layer 300. The correct answer in the network model calculation for the label target object may be corrected based on the user correction input in the label layer 300.

The label correction layer 300 includes a first class display object 312 corresponding to a first layer, a second class display object 314 corresponding to a second layer, a layer addition object 322, and a layer deletion object 324. Can be displayed.

The class display objects 312, 314, and 316 may be display objects for indicating which class each of the layers of the label target object is. Alternatively, when there is a user's input to modify the class, it may be a display object for indicating the modified class. For example, the class is displayed as an aircraft carrier on the first class display object 312 and the class is displayed as a container box on the second class display object 314, and a user input for modifying the class for the second tier to cargo is provided. When received, the second class display object 314 may be changed from a container box to a cargo and displayed. That is, the class display objects 312, 314, and 316 may be display objects for displaying a label input by a user or modified by a user. The detailed description of the above-described class display object is only an example, and the present disclosure is not limited thereto.

The label correction layer 300 may further display a third class display object 316 corresponding to the third layer in response to a user input to the layer addition object 322. For example, if a label is displayed for only two layers, and you want to modify the label to include classes for three layers by adding one more layer, you can add a layer using the layer addition object 322. I can. The detailed description of the above-described class display object is only an example, and the present disclosure is not limited thereto.

The label layer 300 may delete the second class display object 314 corresponding to the second layer in response to a user input to the layer deletion object 324. For example, when class display objects corresponding to each of the first layer and the second layer are displayed on the label layer 300, and if the label is to be modified into one layer, the processor 120 A user input for deleting the corresponding second class display object 314 may be received. The label layer 300 may display only the first class display object 312 in response to a user's deletion input. The detailed description of the above-described class display object is only an example, and the present disclosure is not limited thereto.

The label correction layer 300 may include a template class selection area 330.

According to an embodiment of the present disclosure, the template class selection area 330 may display one or more first template classes corresponding to a first layer and one or more second template classes corresponding to a second layer. The template class selection area 330 may display one or more template classes corresponding to each of one or more layers. The processor 120 may receive a user modification input for template classes displayed in the template class selection area 330. The processor 120 may receive a user modification input for at least one of a first template class of a first layer or a second template class of a second layer among a plurality of template classes displayed in the template class selection area 330. . For example, the template class selection area 330 may display display objects for first template classes (aircraft carrier, sea) for the first layer. The template class selection area 330 may display display objects for second template classes (tank, container, airplane) for the second layer. Previously, if an aircraft carrier was stored as a class of the first tier and a tank was stored as a class of the second tier, and the user wants to modify the class of the second tier to an airplane By selecting, you can modify the class. Detailed description of the above-described template class is merely an example, and the present disclosure is not limited thereto.

The label correction layer 300 corresponds to the first class display object 312 corresponding to the first layer or the second layer in response to a user label correction input for at least one of the first template class or the second template class. At least one of the displayed second class display objects 314 may be modified and displayed as at least one of a first template class or a second template class corresponding to a user label correction input. That is, the class display objects 312, 314, and 316 of the label modification layer 300 may modify the class to correspond to a user's template class modification input for at least some of the layers in the template class selection area 330. Detailed description of the above-described template class is merely an example, and the present disclosure is not limited thereto.

According to an embodiment of the present disclosure, the template class selection area 330 may display a template class pair corresponding to each of the first layer and the second layer. For example, the template class selection area 330 may display'aircraft carrier/tank','aircraft carrier/container', and'aircraft carrier/airplane' template class pairs for the first layer and the second layer. . The processor 120 may receive a user modification selection input for one template class from among a plurality of template class pairs. The user selects the'aircraft carrier/container' in the template class selection area 330 when the label for the object object for the container label is stored as'aircraft carrier/airplane' in the image in which the container is placed on the aircraft carrier. , You can have the label edited. Detailed description of the above-described template class is merely an example, and the present disclosure is not limited thereto.

The template class selection area 330 may further display additional template classes in response to a user input to at least one of a first additional template class corresponding to the first layer or a second additional template class corresponding to the second layer. I can.

The label layer 300 may display a template class additional display object 340. Add Template Class In response to a user selection input for the display object 340, the user may add an additional template class. The processor 120 may receive at least one additional template class for at least one layer. Alternatively, the processor 120 may receive an additional pair of template classes corresponding to a plurality of layers. That is, the user may modify the label by adding a layer to the label through a selection input for the additional display object 340. Detailed description of the above-described template class is merely an example, and the present disclosure is not limited thereto.

When there is a modification to one label, the label list layer 400 may modify and display labels including the same classes as the one label correspondingly. The processor 120 may identify a class for each layer included in the label before modification. The processor 120 may identify labels including the same layer and the same class as the modified class among the classes included in the label before the modification. The processor 120 may modify the classes included in the identified labels in the same manner as the modifications of the modified label. The processor 120 may modify the classes included in the identified labels into a modified class included in the modified label. For example, if the label indicated as'aircraft carrier/tank' is modified to'aircraft carrier/container', the processor 120 all labels including'aircraft carrier/tank' which are the same classes as the label before the modification. It can be changed to'aircraft carrier/container'. Or, for example, the labels for each of'island/tank' and'pier/tank' in which the corrected label and the class for the second layer are the same can also be modified to'island/container','pier/container'. have. The specific description of the above-described label modification is only an example, and the present disclosure is not limited thereto.

Hereinafter, a method of displaying the object viewer layer 600 on the user interface by the processor 120 will be described. The object viewer layer will be described with reference to FIG. 4.

The processor 120 may display the object viewer layer 600 on the user interface in response to a selection input for the object viewer display object 520 included in the navigation layer 500. By displaying each of the objects to be labeled on the object viewer layer 600, it is possible to conveniently check the labeling results for each of the objects to be labeled.

The object viewer layer 600 may display one or more object viewer regions 610. The object viewer area 610 may adjust and display an image so that one annotation form and a label target object corresponding to one annotation form are located at the center of the object viewer area. The object viewer layer 600 may display two or more object viewer regions 610, and each of the two or more object viewer regions 610 may be regions for displaying different label target objects, respectively.

The object viewer layer 600 may display a predetermined number of object viewer areas 610. The object viewer layer 600 may display a predetermined number of object viewer areas 610 in which an annotation form for a label target object can be checked. For example, the object viewer layer 600 may display up to six object viewer areas 610 per page. The detailed description of the above-described object viewer layer is only an example, and the present disclosure is not limited thereto.

The object viewer layer 600 may include an object viewer page moving area 620. Label target objects included in the previous or next page may be displayed in the object viewer areas based on a user selection input for a previous or subsequent display object included in the object viewer page moving area 620. That is, since the number of label target objects that can be displayed on one page is determined, other label target objects and annotation forms for label target objects can be checked through page movement. For example, label target objects and annotation forms corresponding to first to sixth labels may be displayed on the first page, and label target objects corresponding to the seventh to 12th labels and You can display annotation forms. The detailed description of the above-described object viewer layer is only an example, and the present disclosure is not limited thereto.

The object viewer layer 600 may display object viewer regions 610 that display each of the label target objects corresponding to a class of at least one layer included in the label. Labels of label target objects corresponding to each of the plurality of object viewer regions 610 included in the object viewer layer 600 may include at least one common class. For example, all six object viewer areas included in one page of the object viewer layer 600 may include an image of a label target object corresponding to the'aircraft carrier/airplane/airplane A'label. That is, objects having the same label or at least some classes of the same can be displayed on one page. When label target objects having the same label are displayed on one page, users who check the label can conveniently check the objects. When objects corresponding to a plurality of labels are displayed on one page, there is a disadvantage that the time required for the user to check the labels is increased. When configuring an object viewer layer according to an embodiment of the present disclosure, it is possible to reduce a time required for a user to check a labeled object. The detailed description of the above-described object viewer layer is only an example, and the present disclosure is not limited thereto.

In response to a user selection input for a label included in the label list layer 400, the object viewer layer 600 selects each of the label target objects having a label corresponding to a class for at least one layer included in the selected label. Object viewer areas to be displayed can be displayed. The processor 120 may receive a user selection input for at least one label included in the label list layer 400. The processor 120 may display object viewer regions for a label including the same classes as the user-selected input label, or a label including the same class for at least some of the layers. For example, the label selected and input by the user may be'aircraft carrier/airplane/airplane B'. The processor 120 may display the object viewer regions including the label'aircraft carrier/airplane/airplane B'and the labeled label target objects on the object viewer layer 600. Alternatively, the processor 120 may display on the object viewer layer 600 object viewer areas including label target objects whose classes for the first layer and the second layer are'aircraft carrier/airplane'. That is, the object viewer regions included in the object viewer layer 600 may be labeled “aircraft carrier/airplane/airplane A” and aircraft carrier/airplane/airplane B” and labeled label target objects, respectively. The detailed description of the above-described object viewer layer is only an example, and the present disclosure is not limited thereto.

The label correction layer 300 is a user class correction input for a class corresponding to each of two or more layers of a label target object in response to a user correction input for at least one of the object viewer areas included in the object viewer layer 600 Can be allowed. For example, when a user double-clicks an object viewer area in which a label target object for which a label is to be modified is displayed in the object viewer layer 600, the label correction layer 300 may be displayed on the user interface. The detailed description of the above-described label correction layer is only an example, and the present disclosure is not limited thereto.

In response to a user selection input for one object viewer area included in the object viewer layer 600, the image viewer layer 200 adjusts and displays an image so that the label target object displayed by one object viewer area is centered. can do. The processor 120 may receive a user selection input for one object viewer region among a plurality of object viewer regions included in the object viewer layer 200. The processor 120 may display the image viewer layer 200 by adjusting the image so that the label target object and the annotation form included in the object viewer area inputted by the user selection are located at the center of the image. That is, a layer may be switched from the object viewer layer 600 to the image viewer layer 200 and displayed. While switching and displaying the layers, the label target object and the annotation form corresponding to the object viewer area selected by the user may be positioned at the center of the image viewer layer 200. When the user individually checks the labeled objects in the object viewer layer 600 and then wants to check all objects included in the image, the user may switch the layer to the image viewer layer 200. In this case, by setting a specific label target object to be located at the center of the image viewer layer 200, the user can easily and conveniently check the desired image area or labeling result for the label target object. The detailed description of the above-described layer switching is only an example, and the present disclosure is not limited thereto.

The computing device 100 according to the embodiments of the present disclosure includes a personal computer (PC), a notebook (note book), a mobile terminal, a smart phone, a tablet PC, and the like. And all types of terminals that can access wired/wireless networks.

The network unit 110 may transmit/receive an image including a label target object according to an embodiment of the present disclosure, such as another computing device, a server, or the like. In addition, the network unit 110 may enable communication between a plurality of computing devices so that learning of a network function using data labeled by each of the plurality of computing devices is distributedly performed.

The network unit 110 according to an embodiment of the present disclosure may operate based on any type of wired/wireless communication technology currently used and implemented, such as short-range (short-range), long-range, wired, and wireless communication technologies.

The processor 120 may be composed of one or more cores, a central processing unit (CPU), a general purpose graphics processing unit (GPGPU), and a tensor processing unit (TPU) of a computing device. unit) and the like may include a processor for displaying labeling information. The processor 120 may provide a user interface for displaying labeling information according to an embodiment of the present disclosure by reading a computer program stored in the memory 130. At least one of the CPU, GPGPU, and TPU of the processor 120 may provide or generate a user interface for displaying labeling information. For example, the CPU and GPGPU can provide a user interface that displays labeling information together. In addition, according to an embodiment of the present disclosure, a user interface for displaying labeling information may be provided by using processors of a plurality of computing devices together. In addition, the computer program executed in the computing device according to an embodiment of the present disclosure may be a CPU, a GPGPU, or a TPU executable program.

According to an exemplary embodiment of the present disclosure, the memory 130 may store information in an arbitrary form generated or determined by the processor 120 and information in an arbitrary form received by the network unit 110.

According to an embodiment of the present disclosure, the memory 130 is a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (for example, SD or XD memory), RAM (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read) -Only Memory), magnetic memory, magnetic disk, and optical disk. The computing device 100 may operate in connection with a web storage that performs a storage function of the memory 130 on the Internet. The description of the above-described memory is only an example, and the present disclosure is not limited thereto.

The output unit 140 according to an embodiment of the present disclosure may display an arbitrary user interface (UI) for providing labeling information. The output unit 140 may display a user interface as illustrated in FIGS. 2 to 4. User interfaces shown below and described below are only examples, and the present disclosure is not limited thereto.

The output unit 140 according to an embodiment of the present disclosure may output information in an arbitrary form generated or determined by the processor 120 and information in an arbitrary form received by the network unit 110.

In an embodiment of the present disclosure, the output unit 140 is a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), and an organic light-emitting diode (OLED). , It may include at least one of a flexible display (flexible display), a 3D display (3D display). Some of these display modules may be configured as a transparent type or a light-transmitting type so that the outside can be seen through them. This may be referred to as a transparent display module, and a representative example of the transparent display module is TOLED (Transparant OLED).

A user input may be received through the input unit 150 according to an embodiment of the present disclosure. The input unit 150 according to an embodiment of the present disclosure may include keys and/or buttons for receiving a user input. A computer program for providing information for labeling according to embodiments of the present disclosure may be executed according to a user input through the input unit 150.

The input unit 150 according to embodiments of the present disclosure may receive a signal by sensing a button manipulation or a touch input of a user, or may receive a voice or motion of a user through a camera or a microphone and convert it into an input signal. . To this end, speech recognition technology or motion recognition technology may be used.

The input unit 150 according to embodiments of the present disclosure may be implemented as an external input device connected to the computing device 100. For example, the input device may be at least one of a touch pad, a touch pen, a keyboard, or a mouse for receiving a user input, but this is only an example and the present disclosure is not limited thereto.

The input unit 150 according to an embodiment of the present disclosure may recognize a user touch input. The input unit 150 according to an embodiment of the present disclosure may have the same configuration as the output unit 140. The input unit 150 may be configured as a touch screen implemented to receive a user's selection input. For the touch screen, any one of a contact type capacitive method, an infrared light sensing method, a surface ultrasound (SAW) method, a piezoelectric method, and a resistive film method may be used. Detailed description of the above-described touch screen is only an example according to an embodiment of the present invention, and various touch screen panels may be employed in the computing device 100. The input unit 150 configured as a touch screen may include a touch sensor. The touch sensor may be configured to convert a change in pressure applied to a specific portion of the input unit 150 or a capacitance generated at a specific portion of the input unit 150 into an electrical input signal. The touch sensor may be configured to detect not only a touched position and area, but also a pressure at the time of touch. When there is a touch input to the touch sensor, a signal(s) corresponding thereto is transmitted to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the processor 120. As a result, the processor 120 can recognize whether an area of the input unit 150 has been touched or the like.

In an embodiment of the present disclosure, the server may include other components for executing the server environment of the server. The server may include any type of device. The server is a digital device, and may be a digital device equipped with a processor, such as a laptop computer, a notebook computer, a desktop computer, a web pad, and a mobile phone, and equipped with a memory and computing power.

A server (not shown) performing an operation for providing a user interface displaying labeling information to a user terminal according to an embodiment of the present disclosure may include a network unit, a processor, and a memory.

The server may generate a user interface according to embodiments of the present disclosure. The server may be a computing system that provides information to a client (eg, a user terminal) through a network. The server may transmit the generated user interface to the user terminal. In this case, the user terminal may be any type of computing device 100 capable of accessing the server. The processor of the server may transmit the user interface to the user terminal through the network unit. The server according to the embodiments of the present disclosure may be, for example, a cloud server. The server may be a web server that processes services. The types of servers described above are only examples, and the present disclosure is not limited thereto.

Each of the network unit, the processor, and the memory included in the server according to the embodiments of the present disclosure plays the same role as the network unit 110, the processor 120, and the memory 130 included in the above-described computing device 100. It can be performed or configured in the same way.

5 is a flowchart illustrating a method for checking labeling information according to an embodiment of the present disclosure.

The computing device 100 may display 710 an image including one or more label target objects and an annotation form for each of the one or more label target objects on an image viewer layer.

The computing device 100 may display 720 a class for each of two or more layers included in a label of each of the one or more label target objects on a label list layer.

In response to a user selection input for one or more labels included in the label list layer, the computing device 100 may display a visual expression on an annotation form corresponding to the one or more labels in the image viewer layer.

The computing device 100 may display a visual expression on a label corresponding to the one or more annotation forms in a label list layer in response to a user selection input for one or more annotation forms included in the image viewer layer.

In response to a user modification input for at least one of a label included in the label list layer or an annotation form included in the image viewer layer in the label modification layer, the computing device 100 User class modification input for the corresponding class can be allowed.

The computing device 100 displays a first class display object corresponding to a first layer, a second class display object corresponding to a second layer, a layer addition object, and a layer deletion object on the label correction layer, and the layer addition object The second class display object corresponding to the second layer is further displayed in response to a user input to the third layer, or in response to a user input to the layer deletion object Can be deleted.

In response to a user label correction input for at least one of the first template class or the second template class, the computing device 100 may provide a first class display object corresponding to the first layer or a first class display object corresponding to the second layer. At least one of the two class display objects may be modified to at least one of the first template class or the second template class corresponding to the user label modification input, respectively, and displayed on the label modification layer.

When a label is modified in the label list layer, the computing device 100 may modify and display labels including the same classes as the one label correspondingly.

The computing device 100 may display the modified annotation form in response to a user correction input for the annotation form on the image viewer layer. When there is a modification to one annotation form in the image viewer layer, the computing device 100 may correspondingly modify and display the annotation forms corresponding to the label corresponding to the label of the one annotation form. When there is a modification to one annotation form in the image viewer layer, the computing device 100 may generate annotation forms corresponding to a label including a class corresponding to at least some of the classes of the label of the one annotation form. It can be modified and displayed accordingly. When the shape of one annotation form is modified in the image viewer layer, the computing device 100 correspondingly modifies and displays the shape of the annotation forms corresponding to the label corresponding to the label of the one annotation form, and At least one of the size or angle of the annotation forms may be adjusted and displayed to correspond to at least one of the size or angle of the label object object.

The computing device 100 may display one or more object viewer areas in response to a user selection input for an object viewer display object on the object viewer layer. The object viewer area may be displayed by adjusting an image such that one annotation form and a label target object corresponding to the one annotation form are located at the center of the object viewer area. The computing device 100 may display object viewer areas displaying each of the label target objects corresponding to a class of at least one layer included in the label on the object viewer layer. In response to a user selection input for a label included in the label list layer in an object viewer layer, the computing device 100 may each of the label target objects having a label corresponding to a class for at least one layer included in the selected label. You can display object viewer areas that display. The computing device 100 may adjust and display the image so that the label target object displayed by the one object viewer area is centered in response to a user selection input for one object viewer area on the object viewer layer.

The user interface according to an embodiment of the present disclosure may be displayed by logic, modules, circuits or means capable of driving the above method for displaying the user interface.

The data structure may store data corresponding to an algorithm learned by the learning data set according to an embodiment of the present disclosure.

A computer-readable medium storing a data structure according to an embodiment of the present disclosure is disclosed.

Data structure can refer to the organization, management, and storage of data that enables efficient access and modification of data. The data structure may refer to an organization of data for solving a specific problem (eg, data search, data storage, data modification in the shortest time). Data structures may be defined as physical or logical relationships between data elements, designed to support specific data processing functions. The logical relationship between data elements may include a connection relationship between data elements that a user thinks. The physical relationship between the data elements may include an actual relationship between the data elements physically stored in a computer-readable storage medium (eg, hard disk). The data structure may specifically include a set of data, a relationship between data, and a function or instruction applicable to the data. Through an effectively designed data structure, the computing device can perform calculations while using the resources of the computing device to a minimum. Specifically, computing devices can increase the efficiency of computation, reading, insertion, deletion, comparison, exchange, and search through an effectively designed data structure.

The data structure can be classified into a linear data structure and a non-linear data structure according to the shape of the data structure. The linear data structure may be a structure in which only one data is connected after one data. The linear data structure may include a list, a stack, a queue, and a deck. The list may mean a series of data sets in which order exists internally. The list may include a linked list. The linked list may be a data structure in which data is linked in a way that each data has a pointer and is linked in a single line. In the linked list, the pointer may include connection information with the next or previous data. The linked list can be expressed as a single linked list, a double linked list, or a circular linked list. The stack can be a data listing structure that allows limited access to data. The stack may be a linear data structure that can process (eg, insert or delete) data only at one end of the data structure. The data stored in the stack may be a data structure (LIFO-Last in First Out) that comes out sooner as it enters the stack. A queue is a data arrangement structure that allows limited access to data, and unlike a stack, a queue may be a data structure (FIFO-First in First Out) that comes out later as data stored later. A deck can be a data structure that can process data at both ends of the data structure.

The nonlinear data structure may be a structure in which a plurality of data is connected behind one data. The nonlinear data structure may include a graph data structure. The graph data structure may be defined as a vertex and an edge, and the edge may include a line connecting two different vertices. The graph data structure may include a tree data structure. The tree data structure may be a data structure in which a path connecting two different vertices among a plurality of vertices included in the tree is one. That is, it may be a data structure that does not form a loop in the graph data structure.

Throughout this specification, a computational model, a neural network, a network function, and a neural network may be used with the same meaning. (Hereinafter, it will be unified and described as a neural network.) The data structure may include a neural network. In addition, the data structure including the neural network may be stored in a computer-readable medium. The data structure including the neural network may also include data input to the neural network, weights of the neural network, hyperparameters of the neural network, data obtained from the neural network, an active function associated with each node or layer of the neural network, and a loss function for learning the neural network. have. The data structure including the neural network may include any of the components disclosed above. That is, the data structure including the neural network is all or all of the data input to the neural network, the weight of the neural network, the hyper parameter of the neural network, the data obtained from the neural network, the active function associated with each node or layer of the neural network, and the loss function for training the neural network. It may be configured to include any combination of. In addition to the above-described configurations, the data structure including the neural network may include any other information that determines the characteristics of the neural network. In addition, the data structure may include all types of data that are used or generated in a neural network operation process, and is not limited to the above-described matters. Computer-readable media may include computer-readable recording media and/or computer-readable transmission media. A neural network may consist of a set of interconnected computational units, which may generally be referred to as nodes. These nodes may also be referred to as neurons. The neural network is composed of at least one or more nodes.

The data structure may include data input to the neural network. A data structure including data input to the neural network may be stored in a computer-readable medium. The data input to the neural network may include training data input during the neural network training process and/or input data input to the neural network on which the training has been completed. Data input to the neural network may include data that has undergone pre-processing and/or data to be pre-processed. Pre-processing may include a data processing process for inputting data into a neural network. Accordingly, the data structure may include data to be pre-processed and data generated by pre-processing. The above-described data structure is only an example, and the present disclosure is not limited thereto.

The data structure may include data input to or output from the neural network. A data structure including data input to or output from the neural network may be stored in a computer-readable medium. The data structure stored in the computer-readable medium may include data input during an inference process of a neural network or output data output as a result of inference of a neural network. In addition, since the data structure may include data processed by a specific data processing method, it may include data before and after processing. Accordingly, the data structure may include data to be processed and data processed through a data processing method.

The data structure may include weights of the neural network. (In the present specification, weights and parameters may have the same meaning.) In addition, a data structure including a weight of a neural network may be stored in a computer-readable medium. The neural network may include a plurality of weights. The weight may be variable and may be changed by a user or an algorithm in order for a neural network to perform a desired function. For example, when one or more input nodes are interconnected to one output node by respective links, the output node includes values input to input nodes connected to the output node and a link corresponding to each input node. The output node value may be determined based on the parameter. The above-described data structure is only an example, and the present disclosure is not limited thereto.

As an example and not a limitation, the weight may include a weight variable in a neural network training process and/or a weight on which neural network training has been completed. The variable weight in the neural network learning process may include a weight at a time point at which the learning cycle starts and/or a weight variable during the learning cycle. The weight at which the neural network training is completed may include the weight at which the learning cycle is completed. Accordingly, the data structure including the weight of the neural network may include a data structure including a weight variable during the neural network training process and/or a weight on which the neural network training has been completed. Therefore, it is assumed that the above-described weights and/or combinations of weights are included in the data structure including the weights of the neural network. The above-described data structure is only an example, and the present disclosure is not limited thereto.

The data structure including the weights of the neural network may be serialized and then stored in a computer-readable storage medium (eg, memory, hard disk). Serialization may be a process of storing data structures on the same or different computing devices and converting them into a form that can be reconstructed and used later. The computing device serializes the data structure to transmit and receive data through a network. The data structure including the weights of the serialized neural network can be reconstructed in the same or different computing devices through deserialization. The data structure including the weights of the neural network is not limited to serialization. Furthermore, the data structure including the weight of the neural network is a data structure to increase the efficiency of operation while using the resources of the computing device to a minimum (e.g., B-Tree, Trie, m-way search tree, AVL tree, Red-Black Tree). The foregoing is only an example, and the present disclosure is not limited thereto.

The data structure may include a hyper-parameter of a neural network. In addition, the data structure including the hyper parameter of the neural network may be stored in a computer-readable medium. The hyper parameter may be a variable that is variable by a user. Hyper parameters include, for example, learning rate, cost function, number of iterations of learning cycles, weight initialization (e.g., setting the range of weight values to be weighted to be initialized), Hidden Unit It may include the number (eg, the number of hidden layers, the number of nodes of the hidden layer). The above-described data structure is only an example, and the present disclosure is not limited thereto.

6 is a block diagram of a computing device according to an embodiment of the present disclosure.

6 shows a simplified and general schematic diagram of an exemplary computing environment in which embodiments of the present disclosure may be implemented.

While the present disclosure has generally been described above with respect to computer-executable instructions that can be executed on one or more computers, those skilled in the art will appreciate that the present disclosure may be implemented in combination with other program modules and/or as a combination of hardware and software. will be.

Generally, program modules include routines, programs, components, data structures, etc. that perform particular tasks or implement particular abstract data types. In addition, to those skilled in the art, the method of the present disclosure is not limited to single-processor or multiprocessor computer systems, minicomputers, mainframe computers, as well as personal computers, handheld computing devices, microprocessor-based or programmable household appliances, etc. (each of which is It will be appreciated that other computer system configurations may be implemented, including one that may operate in connection with one or more associated devices.

The described embodiments of the present disclosure may also be practiced in a distributed computing environment where certain tasks are performed by remote processing devices that are connected through a communication network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

Computers typically include a variety of computer-readable media. Any medium accessible by the computer may be a computer-readable medium. Computer-readable media includes volatile and nonvolatile media, transitory and non-transitory media, and removable and non-removable media. By way of example and not limitation, computer-readable media may include computer-readable storage media and computer-readable transmission media. Computer-readable storage media include volatile and nonvolatile media, temporary and non-transitory media, removable and non-removable media implemented in any method or technology for storing information such as computer readable instructions, data structures, program modules or other data. Includes the medium. Computer storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital video disk (DVD) or other optical disk storage device, magnetic cassette, magnetic tape, magnetic disk storage device, or other magnetic storage device, Or any other medium that can be accessed by a computer and used to store the desired information.

Computer-readable transmission media typically embodies computer-readable instructions, data structures, program modules or other data in a modulated data signal, such as other transport mechanisms, and includes all information delivery media. do. The term modulated data signal refers to a signal in which one or more of the characteristics of the signal is set or changed so as to encode information in the signal. By way of example and not limitation, computer-readable transmission media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media. Combinations of any of the above-described media are also intended to be included within the scope of computer-readable transmission media.

An exemplary environment 1100 is shown that implements various aspects of the present disclosure, including a computer 1102, which includes a processing unit 1104, a system memory 1106, and a system bus 1108. do. System bus 1108 couples system components, including but not limited to, system memory 1106 to processing device 1104. The processing unit 1104 may be any of a variety of commercially available processors. Dual processors and other multiprocessor architectures may also be used as processing unit 1104.

The system bus 1108 may be any of several types of bus structures that may be additionally interconnected to a memory bus, a peripheral bus, and a local bus using any of a variety of commercial bus architectures. System memory 1106 includes read-only memory (ROM) 1110 and random access memory (RAM) 1112. The basic input/output system (BIOS) is stored in non-volatile memory 1110 such as ROM, EPROM, EEPROM, etc. This BIOS is a basic input/output system that helps transfer information between components in the computer 1102, such as during startup. Includes routines. RAM 1112 may also include high speed RAM such as static RAM for caching data.

The computer 1102 also includes an internal hard disk drive (HDD) 1114 (e.g., EIDE, SATA)-this internal hard disk drive 1114 can also be configured for external use within a suitable chassis (not shown). Yes-, magnetic floppy disk drive (FDD) 1116 (for example, to read from or write to removable diskette 1118), and optical disk drive 1120 (e.g., CD-ROM For reading the disk 1122 or for reading from or writing to other high-capacity optical media such as DVD). The hard disk drive 1114, the magnetic disk drive 1116, and the optical disk drive 1120 are each connected to the system bus 1108 by a hard disk drive interface 1124, a magnetic disk drive interface 1126, and an optical drive interface 1128. ) Can be connected. The interface 1124 for implementing an external drive includes at least one or both of Universal Serial Bus (USB) and IEEE 1394 interface technologies.

These drives and their associated computer readable media provide non-volatile storage of data, data structures, computer executable instructions, and the like. In the case of computer 1102, drives and media correspond to storing any data in a suitable digital format. Although the description of the computer-readable medium above refers to a removable optical medium such as a HDD, a removable magnetic disk, and a CD or DVD, those skilled in the art may use a zip drive, a magnetic cassette, a flash memory card, a cartridge, etc. It will be appreciated that other types of media readable by a computer, such as the like, may also be used in the exemplary operating environment and that any such media may contain computer executable instructions for performing the methods of the present disclosure.

A number of program modules, including the operating system 1130, one or more application programs 1132, other program modules 1134, and program data 1136, may be stored in the drive and RAM 1112. All or part of the operating system, applications, modules and/or data may also be cached in RAM 1112. It will be appreciated that the present disclosure may be implemented on several commercially available operating systems or combinations of operating systems.

A user may input commands and information to the computer 1102 through one or more wired/wireless input devices, for example, a pointing device such as a keyboard 1138 and a mouse 1140. Other input devices (not shown) may include a microphone, IR remote control, joystick, game pad, stylus pen, touch screen, and the like. These and other input devices are often connected to the processing unit 1104 through the input device interface 1142, which is connected to the system bus 1108, but the parallel port, IEEE 1394 serial port, game port, USB port, IR interface, It can be connected by other interfaces such as etc.

A monitor 1144 or other type of display device is also connected to the system bus 1108 through an interface such as a video adapter 1146. In addition to the monitor 1144, the computer generally includes other peripheral output devices (not shown) such as speakers, printers, and the like.

Computer 1102 may operate in a networked environment using logical connections to one or more remote computers, such as remote computer(s) 1148, via wired and/or wireless communication. The remote computer(s) 1148 may be a workstation, a computing device computer, a router, a personal computer, a portable computer, a microprocessor-based entertainment device, a peer device, or other common network node, and is generally connected to the computer 1102. Although it includes many or all of the components described for simplicity, only memory storage device 1150 is shown. The logical connections shown include wired/wireless connections to a local area network (LAN) 1152 and/or to a larger network, eg, a wide area network (WAN) 1154. Such LAN and WAN networking environments are common in offices and companies, and facilitate enterprise-wide computer networks such as intranets, all of which can be connected to worldwide computer networks, for example the Internet.

When used in a LAN networking environment, the computer 1102 is connected to the local network 1152 via a wired and/or wireless communication network interface or adapter 1156. Adapter 1156 may facilitate wired or wireless communication to LAN 1152, which also includes a wireless access point installed therein to communicate with wireless adapter 1156. When used in a WAN networking environment, the computer 1102 may include a modem 1158, connected to a communication computing device on the WAN 1154, or through the Internet, to establish communication through the WAN 1154. Have other means. Modem 1158, which may be an internal or external and a wired or wireless device, is connected to the system bus 1108 through a serial port interface 1142. In a networked environment, program modules described for the computer 1102 or portions thereof may be stored in the remote memory/storage device 1150. It will be appreciated that the network connections shown are exemplary and other means of establishing communication links between computers may be used.

Computer 1102 is associated with any wireless device or entity deployed and operated in wireless communication, e.g., a printer, scanner, desktop and/or portable computer, portable data assistant (PDA), communication satellite, wireless detectable tag. It operates to communicate with any device or place, and a phone. This includes at least Wi-Fi and Bluetooth wireless technologies. Accordingly, the communication may be a predefined structure as in a conventional network or may simply be ad hoc communication between at least two devices.

Wi-Fi (Wireless Fidelity) allows you to connect to the Internet or the like without wires. Wi-Fi is a wireless technology such as a cell phone that allows such devices, for example computers, to transmit and receive data indoors and outdoors, that is, anywhere within the coverage area of a base station. Wi-Fi networks use a wireless technology called IEEE 802.11 (a, b, g, etc.) to provide a secure, reliable and high-speed wireless connection. Wi-Fi can be used to connect computers to each other, to the Internet, and to a wired network (using IEEE 802.3 or Ethernet). Wi-Fi networks can operate in unlicensed 2.4 and 5 GHz radio bands, for example, at a data rate of 11 Mbps (802.11a) or 54 Mbps (802.11b), or in products that include both bands (dual band). have.

Those of ordinary skill in the art of this disclosure will understand that information and signals may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols and chips that may be referenced in the above description are voltages, currents, electromagnetic waves, magnetic fields or particles, optical fields. Or particles, or any combination thereof.

Those of ordinary skill in the art of the present disclosure include various exemplary logical blocks, modules, processors, means, circuits and algorithm steps described in connection with the embodiments disclosed herein, electronic hardware For the sake of clarity, it will be appreciated that it may be implemented by various forms of program or design code or a combination of both (referred to herein as "software"). To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the particular application and design constraints imposed on the overall system. A person of ordinary skill in the art of the present disclosure may implement the described functions in various ways for each specific application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.

The various embodiments presented herein may be implemented as a method, apparatus, or article of manufacture using standard programming and/or engineering techniques. The term “article of manufacture” includes a computer program or media accessible from any computer-readable device. For example, computer-readable media include magnetic storage devices (e.g., hard disks, floppy disks, magnetic strips, etc.), optical disks (e.g., CD, DVD, etc.), smart cards, and flash memory. Devices (eg, EEPROM, card, stick, key drive, etc.). In addition, the various storage media presented herein include one or more devices and/or other machine-readable media for storing information.

It is to be understood that the specific order or hierarchy of steps in the presented processes is an example of exemplary approaches. Based on the design priorities, it is to be understood that within the scope of this disclosure a specific order or hierarchy of steps in processes may be rearranged. The appended method claims provide elements of the various steps in a sample order, but are not meant to be limited to the specific order or hierarchy presented.

A description of the presented embodiments is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these embodiments will be apparent to those of ordinary skill in the art. The general principles defined herein may be applied to other embodiments without departing from the scope of the present disclosure. Thus, the present disclosure is not to be limited to the embodiments presented herein, but is to be construed in the widest scope consistent with the principles and novel features presented herein.

Claims (18)

A computer program stored in a computer-readable storage medium, the computer program providing a user interface (UI) for displaying labeling information when executed on one or more processors of a computing device, the user interface comprising:
An image viewer layer for displaying an image including one or more label object objects and an annotation form for each of the one or more label object objects;
A label list layer that displays a class for each of two or more layers included in a label of each of the one or more label target objects; And
An object viewer layer displaying one or more object viewer areas in response to a user selection input for an object viewer display object;
Including,
The object viewer area is:
Adjusting and displaying an image so that one annotation form and a label target object corresponding to the one annotation form are located at the center of the object viewer area,
A computer program stored on a computer readable storage medium.
The method of claim 1,
The image viewer layer is:
In response to a user selection input for one or more labels, displaying a visual representation on an annotation form corresponding to the one or more labels,
A computer program stored on a computer readable storage medium.
The method of claim 1,
The label list layer is:
In response to user selection input for one or more annotation forms, displaying a visual representation on a label corresponding to the one or more annotation forms,
A computer program stored on a computer readable storage medium.
The method of claim 1,
The user interface is:
In response to a user modification input for at least one of a label included in the label list layer or an annotation form included in the image viewer layer, a user class modification input for a class corresponding to each of two or more layers of the label target object Allowable, label modification layer;
Further comprising,
A computer program stored on a computer readable storage medium.
The method of claim 4,
The label correction layer is:
A first class display object corresponding to the first layer, a second class display object corresponding to the second layer, a layer addition object and a layer deletion object, and
The third class display object corresponding to the third layer is further displayed in response to a user input to the layer addition object, or the second class display object corresponding to the second layer is displayed in response to a user input to the layer deletion object. 2 to delete the class display object,
A computer program stored on a computer readable storage medium.
The method of claim 4,
The label correction layer is:
A template class selection area displaying one or more first template classes corresponding to a first layer and one or more second template classes corresponding to a second layer;
Contains, and
In response to a user label correction input for at least one of the first template class or the second template class, one of a first class display object corresponding to the first layer or a second class display object corresponding to the second layer Modifying and displaying at least one of at least one of the first template class or the second template class corresponding to the user label modification input, respectively,
A computer program stored on a computer readable storage medium.
The method of claim 1,
The label list layer is:
When there is a modification to one label, the labels containing the same classes as the one label are correspondingly modified and displayed,
A computer program stored on a computer readable storage medium.
The method of claim 1,
The image viewer layer is:
In response to a user modification input to the annotation form, displaying the modified annotation form,
A computer program stored on a computer readable storage medium.
The method of claim 1,
The image viewer layer is:
When there is a modification to one annotation form, the annotation forms corresponding to the label corresponding to the label of the one annotation form are correspondingly modified and displayed,
A computer program stored on a computer readable storage medium.
The method of claim 1,
The image viewer layer is:
When there is a modification to one annotation form, the annotation forms corresponding to the label including the class corresponding to at least some of the classes of the label of the one annotation form are correspondingly modified and displayed,
A computer program stored on a computer readable storage medium.
The method of claim 1,
The image viewer layer is:
When there is a modification of the shape of one annotation form, the shape of the annotation forms corresponding to the label corresponding to the label of the one annotation form is correspondingly modified and displayed, and
Adjusting and displaying at least one of the size or angle of the annotation forms to correspond to at least one of the size or angle of the label target object,
A computer program stored on a computer readable storage medium.
delete The method of claim 1,
The object viewer layer is:
Displaying object viewer areas displaying each of the label target objects corresponding to the class of at least one layer included in the label,
A computer program stored on a computer readable storage medium.
The method of claim 1,
The object viewer layer is:
In response to a user selection input for a label included in the label list layer, displaying object viewer areas displaying each of the label target objects having a label corresponding to a class for at least one layer included in the selected label,
A computer program stored on a computer readable storage medium.
The method of claim 1,
The image viewer layer is:
In response to a user selection input for one object viewer region, adjusting and displaying the image so that the label target object displayed by the one object viewer region is at the center,
A computer program stored on a computer readable storage medium.
As a method of displaying labeling information in a user terminal,
Displaying an image including at least one label object object and an annotation form for each of the at least one label object object on an image viewer layer;
Displaying a class for each of two or more layers included in a label of each of the one or more label target objects on a label list layer; And
Displaying one or more object viewer areas on the object viewer layer in response to a user selection input for the object viewer display object;
Including,
The object viewer area is:
Adjusting and displaying an image so that one annotation form and a label target object corresponding to the one annotation form are located at the center of the object viewer area,
A method of displaying labeling information in a user terminal.
As a user terminal,
A processor including one or more cores;
Memory; And
An output unit providing a user interface;
Including,
The user interface,
An image viewer layer for displaying an image including one or more label object objects and an annotation form for each of the one or more label object objects;
A label list layer that displays a class for each of two or more layers included in a label of each of the one or more label target objects; And
An object viewer layer displaying one or more object viewer areas in response to a user selection input for an object viewer display object;
Including,
The object viewer area is:
Adjusting and displaying an image so that one annotation form and a label target object corresponding to the one annotation form are located in the center of the object viewer area,
User terminal.
As a server,
A processor including one or more cores;
Network unit; And
Memory;
Including,
The processor determines to transmit the user interface to the user terminal through the network unit,
The user interface is:
An image viewer layer for displaying an image including one or more label object objects and an annotation form for each of the one or more label object objects;
A label list layer that displays a class for each of two or more layers included in a label of each of the one or more label target objects; And
An object viewer layer displaying one or more object viewer areas in response to a user selection input for an object viewer display object;
Including,
The object viewer area is:
Adjusting and displaying an image so that one annotation form and a label target object corresponding to the one annotation form are located in the center of the object viewer area,
server.

Images