KR102374797B1 - Apparatus and method for processing text of multiimage - Google Patents

Abstract

The present invention relates to an apparatus and method for processing a multi-image text, which are able to integrate a large number of scanned documents, and extract and process a text from a multi-image made by re-scanning the scanned documents into a single file. According to the present invention, the apparatus for processing the multi-image text comprises: an image acquisition unit acquiring a multi-image; an image conversion unit converting the acquired multi-image into a large number of single images; a text extraction unit extracting a text from the converted single images; a text storage unit storing the extracted text; and a control unit controlling the image conversion unit, the text extraction unit, and the text storage unit. The control unit is able to generate a page information on each of the single images, add the generated page information to an index value, process the position and information of the extracted text as a page index for each of the single images, and control the text storage unit to store the position and information of the text processed as a page index. The present invention aims to provide an apparatus and method for processing a multi-image text to provide a user with accurate search results.

Description

Multi-image text processing apparatus and method {APPARATUS AND METHOD FOR PROCESSING TEXT OF MULTIIMAGE}

The present invention relates to a multi-image text processing apparatus, and more particularly, to a multi-image text processing apparatus and method capable of processing by extracting text from a multi-image obtained by merging a plurality of scanned documents into one file.

In general, various services using the Internet are provided due to the development and spread of the Internet, and a representative example among them is a search service.

Such a search service is a service in which, when a user inputs a word or combination of words to be searched as a query word, the search engine provides a search result corresponding to the inputted query word to the user.

In this way, in order to properly show the contents that users want to search, the search service provider collects various electronic documents, extracts document texts from the collected electronic documents, indexes them based on this, and stores them separately, Although it can be implemented to quickly provide users with search results for query words, it was impossible to extract and search imaged documents in the same way as electronic documents.

To solve this inconvenience, text in the image can be extracted and indexed through the OCR function, but only a single image scanned by dividing the document can be scanned and the position value can be created for the extracted text, and it is only limited to single images to provide a search function.

However, when extracting text from multi-images created as a single file by merging multiple documents after scanning, all images have no page division, and text location information is not provided when indexing after text is extracted. There was a problem in that the search function for multi-images could not be provided because the search efficiency was lowered.

For example, when indexing after extracting text from a 1000-page multi-image, it is difficult to estimate the location of the text on the image, so the efficiency of the search engine is reduced.

Therefore, in the future, there is a need for development of a multi-image text processing apparatus capable of providing an accurate search result to a user by providing the location and information of the text extracted from the multi-image page by page.

Republic of Korea Patent Publication No. 10-2019-0123790 (2019. 11. 01)

One object of the present invention for solving the above-described problems is to generate page information for a single image divided from a multi-image, add the generated page information to an index value, and store the location and information of the extracted text for each single image. An object of the present invention is to provide a multi-image text processing apparatus and method capable of providing an accurate search result to a user by providing the location and information of the text extracted from the multi-image page by page by performing page indexing.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

A multi-image text processing apparatus according to an embodiment of the present invention for solving the above problems includes an image acquisition unit for acquiring a multi-image, an image conversion unit for converting the acquired multi-image into a plurality of single images, and the conversion A text extraction unit for extracting text from the single image, a text storage unit for storing the extracted text, and a control unit for controlling the image conversion unit, the text extraction unit, and the text storage unit, wherein the control unit, each of the single image to generate page information for , add the generated page information to an index value to index the extracted text location and information for each single image, and store the page indexed text location and information It is characterized in that it controls the storage unit.

In an embodiment, the image conversion unit sets a division area from the multi-image, divides the multi-image according to the set division area, and converts each division area of the multi-image into a single image characterized.

In an embodiment, the image conversion unit is configured to set the division area according to a preset value when setting the division area from the multi-image.

In an embodiment, the image conversion unit is configured to set the division area according to a user input value when setting the division area from the multi-image.

In an embodiment, the text extraction unit is characterized in that it includes an optical recognition module that performs an OCR (Optical Character Recognition) function.

In an embodiment, the text extraction unit, when extracting text from the converted single image, extracts at least one of letters, symbols, and numbers included in the single image.

In an embodiment, the controller generates page information for the single image when the text of the single image is extracted.

In an embodiment, when the text extractor extracts the text of the single image, the controller controls the text extractor to generate page information for the single image.

On the other hand, the multi-image text method of the multi-image text processing apparatus according to an embodiment of the present invention includes the steps of obtaining a multi-image, converting the obtained multi-image into a plurality of single images, and from the converted single image extracting text, generating page information for each single image, adding the generated page information to an index value and performing page index processing on the location and information of the extracted text for each single image, and the page and storing the location and information of the indexed text.

A computer program for providing a multi-image text processing method according to another embodiment of the present invention for solving the above-described problems is stored in a medium in order to perform any one of the methods described above in combination with a computer that is hardware.

In addition to this, another method for implementing the present invention, another system, and a computer-readable recording medium for recording a computer program for executing the method may be further provided.

As described above, according to the present invention, page information for a single image divided from a multi-image is generated and the position and information of the extracted text are page indexed for each single image by adding the generated page information to an index value. By providing the location and information of the extracted text on a page-by-page basis, it is possible to provide an accurate search result to the user.

Effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a block diagram illustrating a multi-image text processing apparatus according to an embodiment of the present invention.
2 is a diagram for explaining a multi-image.
3 is a diagram for explaining a single image.
4 is a flowchart illustrating a multi-image text processing method of the multi-image text processing apparatus according to an embodiment of the present invention.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the present embodiments allow the disclosure of the present invention to be complete, and those of ordinary skill in the art to which the present invention pertains. It is provided to fully understand the scope of the present invention to those skilled in the art, and the present invention is only defined by the scope of the claims.

The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. In this specification, the singular also includes the plural unless otherwise specified in the phrase. As used herein, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other components in addition to the stated components. Like reference numerals refer to like elements throughout, and "and/or" includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various elements, these elements are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first component mentioned below may be the second component within the spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used herein will have the meaning commonly understood by those of ordinary skill in the art to which this invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless specifically defined explicitly.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Before the description, the meaning of the terms used in this specification will be briefly described. However, it should be noted that, since the description of the term is for the purpose of helping the understanding of the present specification, it is not used in the meaning of limiting the technical idea of the present invention unless explicitly described as limiting the present invention.

1 is a block diagram for explaining a multi-image text processing apparatus according to an embodiment of the present invention, FIG. 2 is a diagram for explaining a multi-image, and FIG. 3 is a diagram for explaining a single image am.

1, the multi-image text processing apparatus of the present invention includes an image acquisition unit 110 for acquiring a multi-image, an image conversion unit 120 for converting the acquired multi-image into a plurality of single images, and the conversion Controls the text extraction unit 130 for extracting text from the single image, the text storage unit 140 for storing the extracted text, and the image conversion unit 120 , the text extraction unit 130 and the text storage unit 140 . It may include a control unit 150 that

Here, the controller 150 generates page information for each single image, adds the generated page information to an index value, and indexes the location and information of the extracted text for each single image, and The text storage unit 140 may be controlled to store the location and information.

In the present invention, as shown in FIG. 2 , a multi-image may refer to an image file re-scanned into one file by merging the scanned documents after scanning a plurality of documents.

As an example, the multi-image, jpg, tif. It can contain multiple image files, including pngs, etc.

Also, as shown in FIG. 3 , a single image may include one image file divided from multiple images.

In addition, the image converter 120 may set a divided region from the multi-image, divide the multi-image corresponding to the set divided region, and convert each divided region of the multi-image into one single image.

For example, when setting the division area from the multi-image, the image converter 120 may set the division area according to a preset setting value.

Here, the preset setting value may include the size and number of divided regions, but this is only an example and is not limited thereto.

As another example, when setting the division area from the multi-image, the image converter 120 may set the division area according to a user input value.

Here, the user input value may include the size and number of divided regions, but this is only an example and is not limited thereto.

Next, the text extraction unit 130 may include an optical recognition module that performs an OCR (Optical Character Recognition) function, which is only an embodiment, but is not limited thereto.

And, when extracting text from the converted single image, the text extraction unit 130 may extract at least one of letters, symbols, and numbers included in the single image.

Next, the control unit 150 generates page information for each single image, adds the generated page information to an index value, and indexes the location and information of the extracted text for each single image, and The text storage unit 140 may be controlled to store the location and information.

Here, when the image acquisition unit 110 acquires a multi-image, the controller 150 may control the image conversion unit 120 to convert the acquired multi-image into a plurality of single images.

In some cases, when the image acquisition unit 110 acquires an image, the controller 150 checks whether the acquired image is a multi-image, and if the acquired image is a multi-image, converts the multi-image into a plurality of single images. The converter 120 may be controlled, and if the obtained image is not a multi-image, the text extractor 130 may be controlled to extract text from the image.

Also, when the multi-image is converted into a plurality of single images by the image conversion unit 110 , the controller 150 may control the text extraction unit 130 to extract text from the converted single image.

And, when the text of the single image is extracted, the controller 150 may generate page information for the single image.

Here, when the text of all single images is extracted, the controller 150 may generate page information for each single image.

In some cases, the controller 150 may generate page information for a corresponding single image whenever text of each single image is extracted.

In another case, when the text extractor 130 extracts text of a single image, the controller 150 may control the text extractor to generate page information for the single image.

As described above, according to the present invention, the control unit 150 may control the generation of page information for each single image according to the text extraction of the text extraction unit 130, and the text extraction unit 130 directly performs text extraction while You can also create page information for each single image.

Accordingly, in the present invention, various design modifications are possible in the generation of page information for each single image.

Next, when performing page indexing for each single image, the controller 150 may index the extracted text location and information as duplicate pages if the extracted text location and information are identically present in a plurality of single images.

As another embodiment, when the page indexing process for each single image is performed, the control unit 150 may include, when the location and information of the extracted text are identically present in a plurality of single images, the location and information of the extracted text are identical to a plurality of single images. Any one of the images may be selected, and the location and information of the text extracted as page information for the selected single image may be page indexed.

Here, when selecting any one of a plurality of single images having the same location and information of the extracted text, the control unit 150 includes a plurality of images having the same location and information of the extracted text according to a preset priority. You can select any one of the single images.

As such, in the present invention, when the location and information of the extracted text are identically present in a plurality of single images, various methods can be used for quick and rapid indexing.

In addition, the present invention selects any one of a plurality of single images in which the position and information of the extracted text according to the priority are the same, and processes the position and information of the extracted text as page information for the selected single image as page index processing By doing so, it is possible to provide a quick search result to the user.

Then, when storing the position and information of the text that has been indexed by the page, the controller 150 may group and store the position and information of the text extracted from the single image for each multi-image as a group, which is only an example, However, the present invention is not limited thereto.

In this way, the present invention generates page information for a single image divided from a multi-image, adds the generated page information to an index value, and indexes the location and information of the extracted text for each single image, thereby extracting the extracted information from the multi-image. By providing the location and information of text in units of pages, it is possible to provide users with accurate search results.

4 is a flowchart illustrating a multi-image text processing method of the multi-image text processing apparatus according to an embodiment of the present invention.

As shown in FIG. 4 , the multi-image text processing apparatus of the present invention may first obtain a multi-image and convert the obtained multi-image into a plurality of single images (S10).

Here, in the present invention, when converting a multi-image into a plurality of single images, a division area is set from the multi-image, the multi-image is divided according to the set division area, and each division area of the multi-image is converted into one single image. can be converted to

At this time, according to the present invention, when setting the division area from the multi-image, the division area may be set according to a preset setting value, or in some cases, the division area may be set according to a user input value.

And, according to the present invention, text can be extracted from the converted single image (S20).

Next, the present invention can generate page information for each single image (S30).

Here, in the present invention, when the text of all single images is extracted, page information for each single image may be generated. You can also create page information about it.

Next, according to the present invention, by adding the generated page information to the index value, the location and information of the extracted text may be page indexed for each single image (S40).

Here, in the present invention, when performing page indexing for each single image, if the location and information of the extracted text are identically present in a plurality of single images, the location and information of the extracted text can be indexed as a duplicate page.

In some cases, in the present invention, when performing page indexing for each single image, if the location and information of the extracted text are identically present in a plurality of single images, among a plurality of single images in which the location and information of the extracted text are identically present It is also possible to select any one and perform page index processing on the location and information of the text extracted as page information for the selected single image.

Here, in the present invention, when any one of a plurality of single images having the same location and information of the extracted text is selected, a plurality of single images having the same location and information of the extracted text according to a preset priority You can choose any one of them.

And, according to the present invention, it is possible to store the location and information of the page indexed text (S50).

Here, in the present invention, when storing the position and information of the page indexed text, the position and information of the text extracted from the single image for each multi-image can be bundled and stored as a group, which is only an example, and is limited thereto. it doesn't happen

In this way, the present invention generates page information for a single image divided from a multi-image, adds the generated page information to an index value, and indexes the location and information of the extracted text for each single image, thereby extracting the extracted information from the multi-image. By providing the location and information of text in units of pages, it is possible to provide users with accurate search results.

The method according to an embodiment of the present invention described above may be implemented as a program (or application) to be executed in combination with a server, which is hardware, and stored in a medium.

The above-described program is C, C++, JAVA, machine language, etc. that a processor (CPU) of the computer can read through a device interface of the computer in order for the computer to read the program and execute the methods implemented as a program It may include code (Code) coded in the computer language of Such code may include functional code related to a function defining functions necessary for executing the methods, etc., and includes an execution procedure related control code necessary for the processor of the computer to execute the functions according to a predetermined procedure. can do. In addition, this code may further include additional information necessary for the processor of the computer to execute the functions or code related to memory reference for which location (address address) in the internal or external memory of the computer should be referenced. there is. In addition, when the processor of the computer needs to communicate with any other computer or server located remotely in order to execute the functions, the code uses the communication module of the computer to determine how to communicate with any other computer or server remotely. It may further include a communication-related code for whether to communicate and what information or media to transmit and receive during communication.

The storage medium is not a medium that stores data for a short moment, such as a register, a cache, a memory, etc., but a medium that stores data semi-permanently and can be read by a device. Specifically, examples of the storage medium include, but are not limited to, ROM, RAM, CD-ROM, magnetic tape, floppy disk, and an optical data storage device. That is, the program may be stored in various recording media on various servers accessible by the computer or in various recording media on the computer of the user. In addition, the medium may be distributed in a computer system connected to a network, and a computer-readable code may be stored in a distributed manner.

The steps of a method or algorithm described in relation to an embodiment of the present invention may be implemented directly in hardware, as a software module executed by hardware, or by a combination thereof. A software module may contain random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any type of computer-readable recording medium well known in the art to which the present invention pertains.

As mentioned above, although embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains know that the present invention may be embodied in other specific forms without changing the technical spirit or essential features thereof. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

Claims (10)

an image acquisition unit for acquiring a multi-image;
an image conversion unit for converting the acquired multi-image into a plurality of single images;
a text extraction unit for extracting text from the converted single image;
a text storage unit for storing the extracted text; And,
A control unit for controlling the image conversion unit, the text extraction unit, and the text storage unit,
The control unit is
Generate page information for each single image, add the generated page information to an index value, perform page index processing for the location and information of the extracted text for each single image, and determine the location and information of the page indexed text control the text storage unit to store,
The control unit is
When performing page indexing for each single image, if the location and information of the extracted text are the same in a plurality of single images, select any one of a plurality of single images in which the location and information of the extracted text are the same, , and page indexing the location and information of the extracted text as page information for the selected single image,
When selecting any one of a plurality of single images having the same location and information of the extracted text, select any one of a plurality of single images having the same location and information of the extracted text according to a preset priority Multi-image text processing device, characterized in that the selection. According to claim 1,
The image conversion unit,
A multi-image text processing apparatus, characterized in that setting a division area from the multi-image, dividing the multi-image according to the set division area, and converting each division area of the multi-image into a single image. 3. The method of claim 2,
The image conversion unit,
Multi-image text processing apparatus, characterized in that when setting the division area from the multi-image, the division area is set according to a preset value. 3. The method of claim 2,
The image conversion unit,
Multi-image text processing apparatus, characterized in that when setting the division area from the multi-image, the division area is set according to a user input value. According to claim 1,
The text extraction unit,
Multi-image text processing apparatus comprising an optical recognition module that performs an OCR (Optical Character Recognition) function. 3. The method of claim 2,
The text extraction unit,
When extracting text from the converted single image, the multi-image text processing apparatus, characterized in that for extracting at least one of letters, symbols, and numbers included in the single image. 7. The method of claim 6,
The control unit is
Multi-image text processing apparatus, characterized in that when the text of the single image is extracted, page information for the single image is generated. 7. The method of claim 6,
The control unit is
When the text extractor extracts the text of the single image, the multi-image text processing apparatus of claim 1, wherein the text extractor controls the text extractor to generate page information for the single image. In the multi-image text method of the multi-image text processing device,
acquiring a multi-image;
converting the obtained multi-image into a plurality of single images;
extracting text from the converted single image;
generating page information for each single image;
adding the generated page information to an index value and performing page index processing on the location and information of the extracted text for each single image; and
Storing the location and information of the page indexed text,
The step of indexing the page for each single image is,
If the location and information of the extracted text are identically present in a plurality of single images, any one of a plurality of single images having the same location and information of the extracted text is selected, and as page information for the selected single image Page indexing the location and information of the extracted text,
When selecting any one of a plurality of single images in which the location and information of the extracted text are the same, select any one of a plurality of single images in which the location and information of the extracted text are identical according to a preset priority Multi-image text processing method, characterized in that the selection. A computer program for providing a multi-image text method of a multi-image text processing apparatus, which is combined with a computer as hardware and stored in a medium to perform the multi-image text processing method of claim 9.

Images