KR20220014493A - User-customized image and text editing method using artificial intelligence - Google Patents

Abstract

Disclosed is a method for editing a user-customized image and text using artificial intelligence, which includes the steps of: obtaining an original image; obtaining a removal target image; and obtaining an edited image.

Description

User-customized image and text editing method using artificial intelligence {USER-CUSTOMIZED IMAGE AND TEXT EDITING METHOD USING ARTIFICIAL INTELLIGENCE}

1 is a diagram illustrating a user-customized image and text editing method using artificial intelligence according to an embodiment.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the present embodiments allow the disclosure of the present invention to be complete, and those of ordinary skill in the art to which the present invention pertains. It is provided to fully understand the scope of the present invention to those skilled in the art, and the present invention is only defined by the scope of the claims.

The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. In this specification, the singular also includes the plural unless otherwise specified in the phrase. As used herein, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other components in addition to the stated components. Like reference numerals refer to like elements throughout, and "and/or" includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various elements, these elements are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first component mentioned below may be the second component within the spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used herein will have the meaning commonly understood by those of ordinary skill in the art to which this invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless specifically defined explicitly.

As used herein, the term “unit” or “module” refers to a hardware component such as software, FPGA, or ASIC, and “unit” or “module” performs certain roles. However, “part” or “module” is not meant to be limited to software or hardware. A “unit” or “module” may be configured to reside on an addressable storage medium or to reproduce one or more processors. Thus, by way of example, “part” or “module” refers to components such as software components, object-oriented software components, class components and task components, processes, functions, properties, Includes procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables. Components and functionality provided within “parts” or “modules” may be combined into a smaller number of components and “parts” or “modules” or as additional components and “parts” or “modules”. can be further separated.

Spatially relative terms "below", "beneath", "lower", "above", "upper", etc. It can be used to easily describe the correlation between a component and other components. Spatially relative terms should be understood as terms including different directions of components during use or operation in addition to the directions shown in the drawings. For example, when a component shown in the drawing is turned over, a component described as “beneath” or “beneath” of another component may be placed “above” of the other component. can Accordingly, the exemplary term “below” may include both directions below and above. Components may also be oriented in other orientations, and thus spatially relative terms may be interpreted according to orientation.

In this specification, a computer refers to all types of hardware devices including at least one processor, and may be understood as encompassing software configurations operating in the corresponding hardware device according to embodiments. For example, a computer may be understood to include, but is not limited to, smart phones, tablet PCs, desktops, notebooks, and user clients and applications running on each device.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Each step described in this specification is described as being performed by a computer, but the subject of each step is not limited thereto, and at least a portion of each step may be performed in different devices according to embodiments.

Recently, the need for overseas direct purchase is increasing, and accordingly, there are many cases where image files and video files containing the original text in foreign languages such as Chinese, French, and English are being used publicly.

This is inconvenient because it is difficult for a simple purchaser to accurately transmit information, and even if Korean editing (translation) is performed, the loss of the original image is unavoidable for editing the original background image or original video content.

Accordingly, there is a technical implication of the present invention for setting a specific object using artificial intelligence technology, extracting images and images, and preserving original images and image data.

In particular, according to the present invention, data of a specific image and text can be extracted using artificial intelligence, and after accumulating such data, an output such as deletion or change of a specific value can be automatically applied through data mining. .

In other words, it is an artificial intelligence-based technology that enables automatic conversion of foreign language images or texts scraped from overseas direct purchase sites and change and deletion through data preservation.

In an embodiment, the computer may recognize the text or each image object included therein from the overseas direct purchase image including the text or a specific image object. The method of recognizing the object is not limited, but a method of segmenting an image based on a boundary line or a method of recognizing each object based on a partial image similarity may be used, but is not limited thereto.

The computer may segment each text and object included in the image, and recognize what each object is.

The computer may receive an input for a user to select a specific object by outputting a list of recognized objects, or an input for a user to select a specific object within an image. The computer may recognize the selected object as the object to be removed.

In another embodiment, the computer may select a text from among the recognized objects, and identify a foreign language (eg, non-Korean) among the selected text. The computer may recognize the identified foreign language text as the object to be removed.

The computer removes the object to be removed from the image, but can fill in the blank area of the image that occurs as the object is removed in various ways. The blank area may be naturally filled based on the characteristics of the surrounding area (eg, data such as the color of the surrounding pixels), and according to an embodiment, an image may be reconstructed based on the GAN technology.

The image in which the removal of the object to be removed is completed may be provided after being edited in various forms. According to an embodiment, the foreign language text may be translated into Korean text, so that the translated Korean text image may be substituted for the foreign language text.

According to an embodiment, instead of removing the object to be removed from the image, the computer may use a method of reconstructing the remaining objects except for the object to be removed.

For example, if the computer recognizes that a specific product and object to be removed are included in the image, instead of erasing the object to be removed from the image and filling in the blanks, the computer creates an image of the product based on the characteristic information of the specific product. You can also create new images by automatically reconstructing them.

For example, the computer may generate a new image based on characteristics of goods collected from the image, for example, a GAN may be used, but is not limited thereto. Through this, the computer may generate various detailed images, and may also generate a plurality of images that are not limited to the original image.

According to an embodiment, the computer may collect an image of the corresponding product through Internet search, acquire more information based on the collected images, and reconstruct the image based on the acquired information.

The steps of a method or algorithm described in connection with an embodiment of the present invention may be implemented directly in hardware, as a software module executed by hardware, or by a combination thereof. A software module may include random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any type of computer-readable recording medium well known in the art to which the present invention pertains.

The components of the present invention may be implemented as a program (or application) to be executed in combination with a computer, which is hardware, and stored in a medium. Components of the present invention may be implemented as software programming or software components, and similarly, embodiments may include various algorithms implemented as data structures, processes, routines, or combinations of other programming constructs, including C, C++ , Java, assembler, etc. may be implemented in a programming or scripting language. Functional aspects may be implemented in an algorithm running on one or more processors.

As mentioned above, although embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains know that the present invention may be embodied in other specific forms without changing the technical spirit or essential features thereof. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

Claims (1)

User-customized image and text editing method using artificial intelligence.

Images