JP5787925B2 - SEARCH DEVICE, SEARCH PROGRAM, AND SEARCH METHOD - Google Patents

Description

  The present invention relates to a search device, a search program, and a search method.

  2. Description of the Related Art Computerization technology for books that creates text data based on scanned images of books has become widespread. In order to digitize a book, first, the book is scanned and a character image is extracted from the scanned image. By obtaining a character code corresponding to the character image from the character pattern dictionary, the character image is converted into text data. Then, by creating text data based on the scanned image, the book is converted into an electronic file.

  When searching for terms from sentences included in a scanned image, the scanned image is first digitized and converted into text data, and then a term search is performed based on the text data.

JP 2003-162469 A JP 2012-256140 A

  However, there is a problem that term search in the scanned image is difficult.

  The disclosed technology has been made in view of the above, and an object of the present invention is to provide a search device, a search program, and a search method that can perform a term search based on a scanned image of a document.

  The search device according to the present application stores a scanned image scanned from a document, a character image code set in which a character image included in the scanned image and a character code corresponding to the character image are associated with each other, An acquisition means for acquiring a character image corresponding to a character code related to a search target character designated as a search target from the character image code set, and collating the character image acquired from the character image code set with the scan image And collating means for outputting, and outputting means for outputting the collation result by the collating unit.

  According to the embodiment of the disclosed technology, the term search can be performed based on the scanned image of the document.

FIG. 1 is a diagram for explaining display processing according to the first embodiment. FIG. 2 is a diagram showing an example of a configuration relating to a book electronic processing system. FIG. 3 is a functional block diagram illustrating the configuration of the electronic processing server according to the first embodiment. FIG. 4 is a diagram illustrating an example of a scanned image. FIG. 5 is a diagram showing an example of a character pattern dictionary. FIG. 6 is a diagram showing an example of a character image code set. FIG. 7 is a diagram illustrating a procedure from creation of a character image code set from a scanned image. FIG. 8 is a flowchart illustrating a procedure for creating a character image code set according to the first embodiment. FIG. 9 is a functional block diagram illustrating the configuration of the search device according to the first embodiment. FIG. 10 is a diagram illustrating a state in which the scanned image downloaded from the computerization processing server is displayed on the search device. FIG. 11 is a diagram showing a state in which the search result of the search target term is displayed on the search device. FIG. 12 is a diagram showing a procedure until the search device displays the search result of the search target term. FIG. 13 is a flowchart illustrating a procedure until the search device according to the first embodiment displays the search result of the search target term. FIG. 14 is a diagram showing a procedure for collating a search target term with a scanned image by the first method when a plurality of search target characters are input in the search target character input field. FIG. 15 is a diagram showing a procedure for collating a search target term with a scan image by the second method when a plurality of search target characters are input in the search target character input field. FIG. 16 is a diagram showing a character image code set when a scanned image includes character images of a plurality of typefaces. FIG. 17 is a diagram when the portion where the search target term is shown in the scanned image is highlighted.

  Hereinafter, embodiments for carrying out a search device, a search program, and a search method according to the present application will be described in detail with reference to the drawings. Note that the search device, search program, and search method according to the present application are not limited by this embodiment. In the following embodiments, the same portions are denoted by the same reference numerals, and redundant description is omitted. Each embodiment can be appropriately combined within a range in which processing contents do not contradict each other.

  First, display processing according to the first embodiment will be described with reference to FIG. FIG. 1 is a diagram for explaining display processing according to the first embodiment. In the example of FIG. 1, the search device 13 includes a scan image 11 created by scanning a book from the computerization processing server 10, and a character image code set in which a character image and a character code included in the scan image 11 are associated with each other. 12 are downloaded.

  The search device 13 stores the scanned image 11 and the character code set 12 downloaded from the computerization processing server 10 in a storage area. The search device 13 receives a search target character that is a search target from the display unit 14. For example, since the search target character “outside” is input to the display unit 14 when the term search is started, the search device 13 accepts “outside” as the search target character. Next, the search device 13 acquires a character image corresponding to the character code related to the search target character from the character image code set 12. For example, the search device 13 acquires the character image “outside” from the character image code set 12 using the character code “8A4F” related to the search target character “outside”.

  Next, the search device 13 collates the character image acquired from the character image code set 12 with the scanned image 11. Then, the search device 13 displays the search results as a list on the display unit 14. For example, the search device 13 collates the character image “outside” with the character string of the scan image 11. At this time, since “outside” is included in the first line of the first page, the search device 13 displays a sentence including “outside” on the display unit 14 together with the display of “1p1 line”. The search device 13 lists and displays sentences including “Outside” on the display unit 14 together with the number of other pages and lines including “Outside”.

  As described above, the search device 13 acquires a character image corresponding to the character code related to the search target character from the character image code set 12, collates the acquired character image with the scan image 11, and displays the search result on the display unit. 14 is displayed. Thereby, the search device 13 can perform a term search based on the scanned image of the document.

[Overall configuration of electronic system]
FIG. 2 is a diagram illustrating an example of the overall configuration of the computerized system. The user terminal 101, the computerized server 110, and the management system 120 are communicably connected via a network (not shown) so that various types of information can be exchanged. As an aspect of such a network, there is an arbitrary communication network such as a local area network (LAN), a virtual private network (VPN), or a mobile communication network regardless of wired or wireless.

  The user terminal 101 is a terminal device operated by a user, and is, for example, an information processing apparatus such as a desktop PC (personal computer), a tablet PC, or a notebook PC. The user terminal 101 may be a smart phone, a PDA (Personal Digital Assistant), or a mobile phone. In the example of FIG. 2, one desktop PC and one smartphone are illustrated as the user terminals 101, but the disclosed system is not limited to this, and the number of user terminals 101 can be any number.

  The computerization server 110 is a server owned by a business entity 111 that digitizes paper-based books. A device such as a scanner is connected to the computerization server 110 to digitize a paper book.

  The management system 120 is a system that performs various types of management. For example, the management system 120 manages electronic book data. The management system 120 includes a receiving server 121, a file management server 122, an authentication server 123, and a settlement server 124. The receiving server 121, the file management server 122, the authentication server 123, and the settlement server 124 are communicably connected via a network (not shown) and exchange various types of information. An example of such a network is a LAN. The file management server 122 has a user storage area for each registered user.

  The electronic server 110 provides a web page 103 and accepts a request for digitizing a book from the web page 103. When digitizing a paper book, the user registers as a member from the Web page 103 and logs in to the Web page 103 using the assigned member number. On the Web page 103, various kinds of information such as a fee related to digitization of books are displayed.

  The electronic server 110 provides electronic book data to the user via the management system 120. The web page 103 is provided with an input area for inputting the user ID and password of the management system 120. When an electronic book is requested, the authentication server 123 authenticates the user using the user ID and password. . The user logs in by entering the user ID and password of the management system 120 on the Web page 103 (1). The web page 103 authenticates the user by the authentication server 123 using the input user ID and password, and accepts a request for digitization of the book when the authentication is obtained (2). When the Web page 103 receives a request for digitization of a book, the Web page 103 notifies the reception server 121 of the request content.

  When the business operator accepts the book sent from the user (3), the business operator reads the book with a scanner (not shown), and the electronic server 110 acquires the scanned image 12 from the scanner. The computerization server 110 acquires a character string included in the scanned image 12 and converts it into text data by digitizing the character string (4).

  When the electronic server 110 confirms charging by the user (5), the electronic server 110 transmits electronic book data such as the scan data 12 and the text data 111 to the receiving server 121 and writes it in the storage area for the business in the storage unit 21 ( 6). When the electronic book data 112 is written in the storage area for the business, the receiving server 121 stores the written electronic book data in the storage area of the requesting user who requested digitization provided in the file management server 122. Store. The user can browse the scanned image 12 and the text data 111 by accessing the storage area of the requesting user from the user terminal 101 (7).

[Processing in electronic processing server]
An example of a functional configuration of the electronic processing server 10 according to the first embodiment will be described. FIG. 3 is a functional block diagram illustrating the configuration of the electronic processing server according to the first embodiment. As illustrated in FIG. 3, the electronic processing server 10 includes a control unit 210 and a storage unit 220. In addition, the electronic processing server 10 is connected to the scanner 231 and the communication I / F 232.

  The scanner 231 is a device for capturing information on a paper medium as a scanned image. The scanner 231 captures each page of the book as a scanned image 11. The communication I / F 232 is an interface such as a NIC (Network Interface Card). The communication I / F 232 transmits the scan image 11 captured by the scanner 231 and the character image code set 12 created in the computerization processing server 10 to the search device 13.

  The storage unit 220 is a device that stores various types of information. The storage unit 220 includes an image storage unit 221, a dictionary storage unit 222, and a set storage unit 223. The storage unit 220 stores various programs including an OS (Operating System) executed by the control unit 210 and a program for executing a storage process described later.

  The image storage unit 221 included in the storage unit 220 stores the scanned image 11 of the book captured by the scanner 231. FIG. 4 is a diagram illustrating an example of the scanned image 11. As illustrated in FIG. 4, the image storage unit 221 may create the scan image 11 for each page, and store the number of pages corresponding to each scan image in association with the scan image 11. Further, the image storage unit 221 may collectively store the scanned images 11 relating to all pages of the book.

  The dictionary storage unit 222 included in the storage unit 220 stores the character pattern dictionary 21. The character pattern dictionary 21 is a data set in which character codes are associated with dictionary images. FIG. 5 is a diagram showing an example of the character pattern dictionary 21. As shown in FIG. 5, the character pattern dictionary 21 associates character images represented by a plurality of typefaces with one character code. For example, the dictionary image “outside” represented by four typefaces is associated with the character code “8A4F”. In addition, the dictionary image “country” represented by four typefaces is associated with the character code “8D91”. The character pattern dictionary 21 uses shift-JIS code, JIS code, EUC, Unicode, etc. as the character code.

  The set storage unit 223 included in the storage unit 220 stores the character pattern code set 12. The character pattern code set is a data set in which a character code is associated with a character image included in the scanned image 11. FIG. 6 is a diagram showing an example of the character image code set 12. As shown in FIG. 6, the character image code set 12 associates a character code with a character image. The character image code set 12 registers character images acquired from the scanned image 11 in the character image column without duplication. For example, the character image code set 12 associates the character image “outside” included in the scanned image 11 with the character code “8A4F”. The character image code set 12 associates the character image “country” included in the scanned image 11 with the character code “8D91”.

  The control unit 210 includes an acquisition unit 211, a set creation unit 212, and a transmission unit 213. Each function of the control unit 210 can be realized, for example, by a CPU (Central Processing Unit) executing a predetermined program.

  The capturing unit 211 included in the control unit 210 reads the scanned image 11 stored in the image storage unit 221 and acquires each character image included in the scanned image 11. For example, the character image “outside” at the head of the character string of the scanned image 11 shown in FIG. 4 is acquired.

  The set creation unit 212 included in the control unit 210 uses the character pattern dictionary 21 stored in the dictionary storage unit 222 to specify a character code corresponding to the acquired character image. Then, the set creation unit 212 associates the character image acquired from the scanned image 11 with the character code, creates the character image code set 12, and stores it in the set storage unit 223.

  As described above, the set creation unit 212 registers not the dictionary image but the character image acquired from the scanned image 11 in the character image column of the character image code set 12. Assuming that the set creation unit 212 registers a dictionary image in the character image code set 12, if the book on which the scanned image 11 is based is an old book, the collation is successful. The rate is thought to decline. However, since the character image acquired from the scan image 11 is registered in the character image code set 12, even if the scan image 11 includes a character of a unique typeface, the collation process in the collation process in the search device 13 is performed. Improve success rate.

  In the first embodiment, since the Gothic character image is included in the scan image 11, the character image code set 12 associates the character code with the Gothic character image. Further, the character image code set 12 includes not only the character image shown in FIG. 6 but also all character images included in the scan data 11.

  The transmission unit 213 transmits the scan image 11 stored in the image storage unit 221 and the character image code set 12 stored in the set storage unit 223 to the management system 120 via the communication I / F 232.

  Next, a procedure until the character image code set 12 is created will be described with reference to FIG. FIG. 7 is a diagram showing a procedure from acquisition of the scan image 11 to creation of the character image code set 12. The capturing unit 211 performs layout analysis on the scan image 11 and specifies a range in which a character string included in the scan image 11 is indicated. The capturing unit 211 extracts the character string in the specified range, and when the extracted characters are not uniform in size, normalizes each character image and arranges it uniformly.

  Next, the set creation unit 212 collates the character image acquired from the scanned image 11 with the dictionary image included in the character pattern dictionary 21. When a matching dictionary image is included, the set creation unit 212 acquires a character code corresponding to the dictionary image from the character pattern dictionary 21 and registers it in the character image code set 12 in association with the character image. However, if the same character image has already been registered in the character image code set 12, the set creation unit 212 avoids the duplicate registration of the same character image. 12 is not registered.

  For example, the capturing unit 211 acquires the character image “outside” described at the top of the scanned image 11. The set creation unit 212 collates the acquired character image “outside” with each dictionary image of the character pattern dictionary 21. Since the acquired character image “outside” matches the gothic dictionary image “outside”, the set creation unit 212 identifies the corresponding character code “8A4F”. The set creation unit 212 registers the character code “8A4F” in the character image code set 12 and registers the character image “outside” extracted from the scanned image 11 in association with each other.

  Next, a flow until the computerization server 10 creates the character image code set 12 will be described with reference to FIG. FIG. 8 is a flowchart illustrating a procedure for creating the character image code set 12 according to the first embodiment. As illustrated in FIG. 8, the capturing unit 211 captures the scanned image 11 stored in the image storage unit 221 (step S10). The set creation unit 212 performs layout analysis on the scanned image 11 (step S11), and specifies a range in which a character string is described in the scanned image 11. The set creation unit 212 extracts character images k (t) in order from the beginning of the character string included in the scanned image 11 (step S12). At this time, the set creation unit 212 determines whether extraction to the end of the scanned image 11 has been completed (step S13), and if it has been completed (step S13 Yes), the process is terminated. When the character image to be extracted remains in the scanned image 11 (No in step S13), the set creation unit 212 collates this character image k (t) with each dictionary image included in the character pattern dictionary 21, and sets the character image. A dictionary image matching the image k (t) is searched (step S14).

  If there is no dictionary image corresponding to the character image k (t) (step S14 No), the set creation unit 212 performs error processing (step S15). For example, the set creation unit 212 may shade the portion of the character image for which the character code could not be specified in the scan image 11 and further display a text box to input text related to the unknown character image.

  On the other hand, when there is a dictionary image corresponding to the character image k (t) (Yes in step S14), the set creation unit 212 confirms whether the character image k (t) is registered in the character image code set 12 (step S16). ). Next, when the character image k (t) is not registered in the character image code set 12 (No in step S16), the set creation unit 212 associates the character image of the scanned image 11 with the character code and sets the character image code. Register in the set 12 (step S17). Note that the set creation unit 212 avoids overlapping registration of character images based on the confirmation in step S16.

  On the other hand, if the character image k (t) has been registered (Yes in step S16), the set creating unit 212 returns to step S12, adds 1 to t, and then adds the next character image k (t) ( t ← t + 1) is extracted.

  The set creation unit 212 repeats the extraction process in step S12 until it is determined in step S13 that extraction to the end of the scanned image 11 has been completed.

[Processing in search device]
An example of a functional configuration of the search device 13 according to the first embodiment will be described. FIG. 9 is a functional block diagram illustrating the configuration of the search device 13 according to the first embodiment. As illustrated in FIG. 9, the search device 13 includes a control unit 310 and a storage unit 320. The search device 13 is connected to a communication I / F 331, an input unit 332, and an output unit 333. The search device 13 is a mobile terminal such as a smartphone, a personal computer, a server, or the like.

  The communication I / F 331 is an arbitrary communication interface for connecting to a communication network. The search device 13 receives the scanned image 11 and the character image code set 12 from the communication I / F 331, and stores the scanned image 11 in the image storage unit 321 and the character image code set 12 in the set storage unit. The input unit 332 is a touch panel or the like when the search device 13 is a mobile terminal such as a smartphone, and is a keyboard or a mouse when the search device 13 is a personal computer or the like. The search target device 13 receives a search target term from the input unit 332. On the other hand, the output unit 333 outputs the search result to a smartphone monitor or the like.

  The storage unit 320 includes an image storage unit 321 and a set storage unit 322. The storage unit 220 corresponds to, for example, a semiconductor memory device such as a random access memory (RAM), a read only memory (ROM), or a flash memory, and a storage device such as a hard disk or an optical disk.

  The image storage unit 321 included in the storage unit 320 stores the scanned image 11 transmitted from the computerization processing server 10, and the set storage unit 322 stores the character image code set 12. A specific example of the scanned image 11 is shown in FIG. 4, and a specific example of the character image code set 12 is shown in FIG.

  The control unit 310 includes an acquisition unit 311 and a collation unit 312. Each function of the control unit 310 can be realized, for example, by a CPU (Central Processing Unit) executing a predetermined program. The storage unit 210 corresponds to, for example, a semiconductor memory device such as a random access memory (RAM), a read only memory (ROM), or a flash memory, and a storage device such as a hard disk or an optical disk.

  The acquisition unit 311 searches the character image code set 12 stored in the set storage unit 332 for a character code corresponding to the search target term received from the input unit 332, and acquires a character image corresponding to the character code. .

  The collation unit 312 collates the acquired character image with the scan image 11. The matching unit 312 reads the scan image 11 from the image storage unit 321 and acquires a character string in the scan image 11. The collation unit 312 collates the character image with the scan image 11 by scanning the acquired character image along the character string of the scan image 11. When the matching unit 312 matches the scanned image 11, the matching unit 312 outputs the number of pages and the number of lines of the verified scanned image 11 together with the sentence including the character image to the output unit 333.

  The screen displayed when the acquisition unit 311 is waiting for input of a search target term will be described with reference to FIG. FIG. 10 is a diagram illustrating a screen waiting for input of a search target term. On the display unit 14 of the search device 13, a search target term input field 15, a search button 16, a scroll bar 17, and a display area 18 are displayed. In the search target term input field 15, a search target term to be searched can be input by a touch panel or the like. The search button 16 is a button for starting a search for a search target term. The search device 13 displays the scanned image 11 outside the display unit 14 by operating the display area 18. Further, the search device 13 indicates the position displayed in the current display area 18 in the scan image 11 on the scroll bar 11.

  Next, display of search results by the output unit 333 will be described with reference to FIG. FIG. 12 is a diagram showing a state in which search results for search target terms are displayed. A scroll bar 17, a display area 18, and a search target term display field 19 are displayed on the display unit 14 of the search device 13. The search device 13 displays the search target term in the search target term display field 19 and displays the search result in the display area 18.

  The search device 13 lists and displays the number of pages and lines including the search target term as a search result and a sentence including the search target term as a set in the display area 18. In addition, the search device 13 displays the search results outside the display area 18 by operating the display area 18 and scrolling the screen. The search device 13 may link each search result displayed in the display area 18 to a corresponding portion of the scanned image 11 and display the corresponding portion by pressing each search result.

  Thereby, the user can confirm the number of pages and the number of lines including the search target term in the scanned image 11 and can browse the sentence including the search target term in the same display as the scanned image 11. If the search device 13 displays each search result linked to the corresponding portion of the scanned image 11, the user can easily reach the corresponding portion of the search result, and the usability is improved.

  For example, when the search target term is “outside”, the display area 18 displays “one page and one line” where “outside” is included and a sentence including “outside” as a set. Also, “page 15 line 2” and “page 22 line 3” including “outside” are displayed as a set together with the sentence including “outside”. Subsequent pages can be browsed by scrolling the screen on the display unit 14.

  Next, a procedure until the search device 13 according to the first embodiment displays the search result of the search target term will be described with reference to FIG. FIG. 12 is a diagram showing a flow until the search device 13 displays the search result of the search target term. The search device 13 receives a search target term when the search target button 16 is pressed. For example, the acquisition unit 311 receives the term “outside” included in the scanned image 11 by inputting the term “outside” in the search target term input field 15 and pressing the search button 16.

  The acquisition unit 311 searches the character image code set 12 for the character code related to the search target term, and acquires the corresponding character image. For example, when the search target term is “outside”, the acquiring unit 311 searches the character image code set 12 for the character code “8A4F” of “outside”. Then, the acquiring unit 311 acquires the character image “outside” corresponding to the character code “8A4F” from the character image code set 12.

  For example, when the search button 16 is pressed in a state where the search target term “outside” is input in the search target term input field 15, the acquiring unit 311 stores the search target term “outside” in the character image code set 12. Search for “8A4F” corresponding to the character code. Then, the acquisition unit 311 acquires the character image “outside” corresponding to the character code “8A4F”.

  The collation unit 312 scans the character image “outside” along the character string of the scan image 11 and collates it with the scan image 11. Then, the search device 13 displays the search result in the display area 18b. For example, the search device 13 displays that the search target term “outside” is included in the first line and the first line in the display area 18 b together with a sentence including “outside”. The search device 13 also lists and displays “outside” included in other pages.

  Note that the collating unit 312 appropriately enlarges or reduces the character image to be scanned when there is a part that is different in size from the text described in the text, such as a character string of a headline part or a footnote part of the scanned image 11. You may collate after adjusting to the size of a character string. Thereby, the collation means 312 can improve the collation success rate.

  Next, a flow until the search device 13 according to the first embodiment displays the search result of the search target term will be described with reference to FIG. FIG. 13 is a flowchart illustrating a procedure until the search device 13 according to the first embodiment displays the search result of the search target term. As illustrated in FIG. 13, the acquisition unit 311 receives a search character when the search target character is input to the search target term input field 15 of the display unit 14 and the search button 16 is pressed (step S20). The acquisition unit 311 searches the character image code set 12 for a character code corresponding to the search target character, and acquires a character image corresponding to the character code (step S21).

  Next, the collation means 312 collates the acquired character image with the scanned image 11 (step S22). The collation unit 312 collates with the scan image 11 by scanning the character image along the sequence of the character string of the scan image 11. When the collation unit 312 determines that the character image has been scanned up to the end of the scan image 11 (Yes in step S23), the collation unit 312 ends the scan and ends the process.

  On the other hand, when the character string to be scanned remains (No in step S23), the collating unit 312 scans the character image along the character string and determines whether the character image matches the character image (step S24). When the character image being scanned matches the character image of the scanned image 11 (Yes in step S24), the collating unit 312 outputs the search result (step S25). When the matching unit 312 does not match the character image of the scanned image 11 (No in step S24), the matching unit 312 further scans the character image and matches the character image next to the scanned image 11. The collating unit 312 scans the character image until the condition of step S23 is satisfied.

[effect]
As described above, the search device 13 according to the embodiment includes the storage unit 320, the acquisition unit 311, the collation unit 312, and the output unit 333. The storage unit 320 stores a scanned image 11 scanned from a document, and a character image code set 12 in which a character image included in the scanned image 11 and a character code corresponding to the character image are associated with each other. The acquisition unit 311 acquires a character image corresponding to the character code related to the search target character designated as the search target from the character image code set. The collation unit 312 collates the character image acquired from the character image code set 12 with the scan image 11. The output unit 333 outputs the collation result by the collation unit 312.

  Thereby, the search device 13 according to the embodiment can perform a term search based on the scanned image 11 of the book. In addition, the search device 13 is not limited to the case where the scanned image 11 is written horizontally, and can search for terms even if it is written vertically.

  In the search device 13 according to the embodiment, the character image code set 12 selects a character code corresponding to each character image included in the scanned image 11 from the character pattern dictionary 21 that stores character codes corresponding to all characters. The selected character code and the character image corresponding to the character code are created by registration.

  Thereby, since the character image code set 12 is created only from the character image included in the scanned image 11, the storage area of the search device 13 can be saved and the processing speed of the search process can be reduced compared to the case where the character pattern dictionary 21 is used. Can be improved. Further, since the character image registered in the character image code set 12 is created based on the character image included in the scan image 11, the success rate of collation can be improved as compared with the case where the character pattern dictionary 21 is used.

[Search when the search term is multiple characters]
Next, a procedure for displaying a search result when the search target term is a plurality of characters will be described. The acquisition unit 311 collates the character image related to the search target term with the scan image 11 using one of the following two methods.

  As a first method, when there are a plurality of search target characters, the acquisition unit 311 searches the character image code set 12 with a character code corresponding to each search target character, and acquires each character image corresponding to the character code. To do. The collation unit 312 connects the acquired character images, and scans the connected character images along the character string of the scan image 11 in the same manner as when the character image is one character.

  The collation unit 312 acquires the pitch of the character image of the scan image 11 and adjusts the width of each character image to be connected according to the pitch when the extracted character images are connected. Thereby, the collation means 312 can improve the collation success rate.

  A specific example of the first method will be described with reference to FIG. FIG. 14 is a diagram illustrating a flow when the search target term is collated with the scan image 11 by the first method when a plurality of search target characters are input in the search target character input field 15. For example, when “foreign country” is entered in the search target character input field 15 of FIG. 14 and the search button 16 is pressed, the acquisition unit 311 accepts the search target term “foreign country”. The acquisition unit 311 searches the character image code set 12 for the character code “8A4F” corresponding to “outside” and the character code “8D91” corresponding to “country”, and the character image “outside” corresponding to the character code. ”And“ Country ”.

  Next, the collation unit 312 connects the character images “outside” and “country” in the vertical direction in accordance with the vertical writing of the scanned image 11. Further, the collation unit 312 adjusts the connection width of the “outside” and “country” character images in accordance with the arrangement pitch of the character strings in the scanned image 11. Subsequently, the collation unit 312 converts the character image “foreign” connected in the vertical direction from the first line of the scan image 11 to the character image of the scan image 11 in the same manner as when the character image is one character. Scan along a row. The collation unit 312 outputs the search result when the connected character image matches the scan image 11.

  As described above, in the search device 13 according to the embodiment, when the search target character includes two or more characters, the acquisition unit 311 converts the character image corresponding to the character code related to each search target character to the character image code set 12. Get from. Further, the collation unit 312 collates the scanned image 11 with a character image created by concatenating character images corresponding to the character codes related to the search target characters in the order of the character strings.

  Thereby, even if there are a plurality of search target characters, the search device 13 can collate as in the case where the search target character is one character, and the search efficiency can be improved.

  As a second method, the acquiring unit 311 searches the character image code set 12 with a character code corresponding to each search target character, and acquires a character image corresponding to the character code. The matching unit 312 scans only the first search target character among the plurality of search target characters along the character string of the scan image 11. The collation unit 312 collates the next search target character with the next character image of the scan image 11 when the first search target character matches the scan image 11. And the collation means 312 collates a some search object character in order, and when it matches with all the search object characters, it is made to output to a search result.

  A specific example of the second method will be described with reference to FIG. FIG. 15 is a diagram illustrating a flow when the search target term is collated with the scan image 11 by the second method when a plurality of search target characters are input in the search target character input field 15. For example, the acquisition unit 311 searches the character image code set 12 for the character code “8A4F” corresponding to “outside” and the character code “8D91” corresponding to “country”, and the character image corresponding to the character code. Get “outside” and “country”.

  Next, the matching unit 312 scans the character image “outside” corresponding to the first search target term along the character string of the scan image 11 from the first line of the scan image 11. When the character image “outside” matches the scan image 11, the collation unit 312 collates the character image “country” corresponding to the next search target term with the character image next to the scan image 11. When the character image “country” matches the scan image 11, the collation unit 312 outputs the search result.

  On the other hand, the collation unit 312 scans the character image “outside” from the character image of the scan image 11 when the character image “country” does not match the scan image 11. When the matching unit 312 scans the character image “outside” and matches the scanned image 11, the matching unit 312 similarly matches the character image “country” with the next character image of the scanned image 11. The collation unit 312 repeats the above operation until the end of the scanned image.

  As described above, in the search device 13 according to the embodiment, when the search target character includes two or more characters, the acquisition unit 311 converts the character image corresponding to the character code related to each search target character to the character image code set. 12 from. In addition, the collation unit 312 collates the character image related to the head of the search target character with the scan image 11 and if they match, the character images related to the second and subsequent search target characters are scanned in the order of the search target character. 11 is matched.

  Thereby, even when the character image corresponding to the search target term is described across the certain line and the next line in the scanned image 11, the search device 13 can collate with a simple procedure.

[When the scanned image contains multiple typeface text images]
Next, a case where a scanned image 11 includes a plurality of typeface character images will be described. FIG. 16 is a diagram showing a character image code set 12 when a scanned image 11 includes a plurality of typeface character images. In the character image code set 12, when the scanned image 11 includes character images of a plurality of typefaces, the character images of each typeface representing the same character are associated with one character code. For example, as shown in FIG. 16, the character image code set 12 associates the Gothic character image “outside” and the Mincho character image “outside” with the character code “8A4F”. The character image code set 12 associates the Gothic character image “country” and the line font character image “country” with the character code “8D91”.

  Thereby, even when the scanned image 11 includes character images of a plurality of typefaces, the character image code set 12 associates each typeface with one character code, so that the matching success rate when searching for the scanned image 11 is increased. It can be improved.

  As shown in FIG. 5, the character pattern dictionary 21 associates a plurality of typeface dictionary images with character codes. Therefore, the set creation unit 212 of the computerization processing server 10 can specify the character code corresponding to the character image by using the character pattern dictionary 21 even if the character image is described in the scanned image 11 in a typeface.

  As described above, in the search device 13 according to the embodiment, the character image code set 12 associates two or more character images having the same character and different typefaces with one character code. The collating unit 312 collates each of two or more character images having different fonts with the scanned image 11.

  Thereby, the search device 13 according to the embodiment allows the character image code set 12 to collate the scan image using the character image of each typeface even when the scan image 11 includes a plurality of typeface character images. , The success rate of matching can be improved.

[Another way to display search results]
Next, another method for displaying search results will be described. FIG. 17 is a diagram when a portion where the search target term is shown in the scanned image 11 is highlighted. As shown in FIG. 17, the display unit 14 highlights and displays only the portion related to “outside” which is the search target term. When the selection button 20 is pressed, the display unit 14 selects another “outside”. For example, when the third “outside” from the right is selected and the left side of the selection button 20 is further clicked, the display unit 14 scrolls to “outside” outside the left side of the display unit 14, and "Is highlighted.

  As a result, when the number of pages of the scanned image 11 is small, the user can easily check the portion including the search target term, and the usability of the user is improved.

  In addition, the search device 13 is not limited to the mobile terminal such as the smartphone illustrated in the drawing according to the first embodiment, but may be the server illustrated in FIG. When the search device 13 is a server, the search device 13 may transmit the search result to a smartphone or the like and display it on the screen. Further, the search device 13 may store the search result in the user storage area and display the search result on the smartphone when the user downloads the search result.

DESCRIPTION OF SYMBOLS 10 Electronic processing server 11 Scan image 12 Character image code set 13 Searching device 14 Display part 310 Control means 311 Acquisition means 312 Verification means 320 Storage means 321 Image storage means 322 Set storage means 331 Communication I / F
332 input means 333 output means

Claims (6)

Storage means for storing a scanned image scanned from a document, and a character image code set in which a character image included in the scanned image and a character code corresponding to the character image are associated with each other;
An acquisition means for acquiring, from the character image code set, a character image corresponding to a character code related to a search target character designated as a search target;
Collating means for collating the character image acquired from the character image code set with the scanned image;
And output means for outputting a verification result by the verification means,
Equipped with a,
When the search target character includes two or more characters, the acquisition unit acquires a character image corresponding to the character code related to each search target character from the character image code set, respectively.
The collation means collates a character image created by concatenating character images corresponding to character codes related to the search target characters in the order of the character strings, with the scan image,
The collation unit adjusts the width of each character to be coupled in accordance with the width between characters of the scan image when character images corresponding to the character codes related to the search target characters are concatenated in the order of the character strings. The search device characterized by performing. The character image code set associates two or more character images having the same character and different typefaces with one character code,
The search device according to claim 1, wherein the collating unit collates each of two or more character images having different fonts with the scanned image. When the search target character includes two or more characters, the acquisition unit acquires a character image corresponding to the character code related to each search target character from the character image code set, respectively.
The collating unit collates the character image related to the beginning of the search target character with the scanned image, and if they match, the character image related to the second or subsequent character of the search target character in the order of the search target character. The search device according to claim 1, wherein the search device is collated with a scanned image. The character image code set from the character pattern dictionary for storing character codes corresponding to all characters, and select a character code corresponding to each character image included in the scanned image, the selected character code and the character a character image corresponding to the code, the search device according to any one of claims 1 to 3, characterized in that created by registering. On the computer,
A holding procedure for holding a scanned image scanned from a document and a character image code set in which a character image included in the scanned image and a character code corresponding to the character image are associated;
An acquisition procedure for acquiring a character image corresponding to a character code related to a search target character designated as a search target from the character image code set;
A collation procedure for collating a character image acquired from the character image code set with the scanned image;
An output procedure for outputting a verification result by the verification procedure,
Was executed,
In the acquisition procedure, when the search target character includes two or more characters, a character image corresponding to a character code related to each search target character is acquired from the character image code set, respectively.
The collation procedure collates a character image created by concatenating a character image corresponding to a character code related to each search target character in order of the character string with the scan image,
In the collation procedure, when character images corresponding to character codes related to the search target characters are connected in the order of the character strings, the width of each character to be connected is adjusted in accordance with the width between characters of the scan image. A search program characterized by Computer
Holding a scan image scanned from a document, and a character image code set in which a character image included in the scan image and a character code corresponding to the character image are associated;
An acquisition step of acquiring a character image corresponding to a character code related to a search target character designated as a search target from the character image code set;
A collation step of collating the character image acquired from the character image code set with the scan image;
An output step of outputting the verification result by the verification step,
The execution,
In the acquisition step, when the search target character includes two or more characters, a character image corresponding to a character code related to each search target character is acquired from the character image code set, respectively.
The collation step collates a character image created by concatenating a character image corresponding to a character code related to each search target character in the order of the character string with the scan image,
The collating step adjusts the width of each character to be connected in accordance with the width between characters of the scan image when character images corresponding to the character codes related to the search target characters are connected in the order of the character strings. A search method characterized by:

Images