JP2008305248A - Retrieval device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To search for information input within a display screen at high speed, based on an input area or an input content. <P>SOLUTION: When additional information is input by an input section 11 to original information displayed on a display section 12, a CPU 10 of a retrieval device 1 relates the input additional information and operational information (area information, color information, or the like on the display screen) to this additional information to the original information and stores it in a storage section 15. In addition, when operational information is input by the input section 11 as a condition for searching for information to be displayed on the display section 12, the CPU 10 searches for the original information and the additional information stored in the storage section 15 based on the input operational information, and displays the original information and the additional information extracted by the search on the display section 12. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a search device and a program for searching for input information.

In recent years, devices capable of inputting to a display with a pen or the like, such as a touch panel and a liquid crystal pen tablet, have become widespread. In such an apparatus, for example, image data is displayed and necessary information is input with a pen. When searching for information input with this pen or the like, a method of displaying the input portion in bold type has been proposed (for example, see Patent Document 1).
Japanese Patent Laid-Open No. 11-7376

  However, as in the invention described in Patent Document 1, when searching for information input with a pen or the like, the method of displaying the input part in bold is characterized by the input area and input content on the display screen There was a problem that it was not effective as a search method.

  An object of the present invention is to make it possible to search information input in a display screen at high speed based on an input area and input contents.

  The search device according to claim 1 inputs the additional information for the original information displayed by the first display control means for displaying the original information to be searched on the display means, and the first display control means. First storage means for storing the first input means, additional information input by the first input means, and operation information related to the additional information in association with the original information, and information to be displayed on the display means. A second input means for inputting operation information as a condition for searching; and searching for original information and additional information stored in the storage means based on the operation information input by the second input means; Second display control means for displaying original information and additional information extracted by the search on the display means.

  According to a second aspect of the present invention, in the search device according to the first aspect, the operation information stored in the storage unit indicates an arrangement position on the display screen of the additional information input by the first input unit. Contains region information.

  According to a third aspect of the present invention, in the search device according to the first aspect, the operation information stored in the storage unit includes color information of additional information input by the first input unit.

  According to a fourth aspect of the present invention, in the search device according to the first or second aspect, the operation information stored in the storage unit includes an identifier for identifying the content input by the first input unit. Contains information about.

  The invention according to claim 5 is a computer for displaying original information to be searched on display means, means for inputting additional information with respect to the displayed original information, the input additional information, Means for storing operation information related to the additional information in association with the original information, means for inputting operation information as a condition for searching for information to be displayed on the display means, and storing the information based on the input operation information The original information and the additional information are searched, and the original information and the additional information extracted by the search are displayed as a means for displaying on the display means.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to search the information input within the display screen at high speed based on the input area and the input content.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
First, the configuration in the present embodiment will be described.

  FIG. 1 shows a main part configuration of a search device 1 according to an embodiment of the present invention. As shown in FIG. 1, the search device 1 includes a CPU (Central Processing Unit) 10, an input unit 11, a display unit 12, an OCR (Optical Character Reader) 13, a RAM (Random Access Memory) 14, and a storage unit 15. Each unit is connected via a bus.

  The CPU 10 reads out the control program stored in the storage unit 15 and develops it in the RAM 14 to execute various processes. Specifically, when additional information is input from the input unit 11 to the original information displayed on the display unit 12, the CPU 10 inputs the additional information and operation information related to the additional information (an area on the display screen). Information, color information, etc.) are associated with the original information and stored in the storage unit 15. When the operation information is input from the input unit 11 as a condition for searching for information to be displayed on the display unit 12, the CPU 10 stores the original stored in the storage unit 15 based on the input operation information. Information and additional information are searched, and the display unit 12 displays the original information and additional information extracted by the search.

  The input unit 11 includes an input device such as a tablet including a plate-shaped sensor unit and a pen, a mouse, and a keyboard, and outputs an operation signal from the input device to the CPU 10.

  The display unit 12 includes a display such as an LCD (Liquid Crystal Display), and performs a required display process according to a display control signal input from the CPU 10.

  The OCR 13 optically reads a handwritten character or a printed character, recognizes the character by collating with a previously stored pattern, and outputs the recognition result to the CPU 10.

  The RAM 14 expands a control program executed by the CPU 10 in a program storage area. The RAM 14 temporarily stores input data and processing result data generated when the control program is executed in the work area.

  The storage unit 15 is configured by an HDD (Hard Disc Drive), a nonvolatile semiconductor memory, or the like, and stores a control program executed by the CPU 10 and data necessary when the control program is executed. In addition, the storage unit 15 includes an original information file 151 that stores original information displayed on the display unit 12, an additional information file 152 that stores additional information input by the input unit 11 with respect to the original information, and the addition And an operation information file 153 for storing operation information (region information, color information, etc.) related to the information.

  FIG. 2 shows the data structure of the original information file 151. As shown in FIG. 2, the original information file 151 includes “No.” items for identifying the original information and “original information” items indicating the contents of the original information. In the “original information” item, image data as original information is stored.

  FIG. 3 shows the data structure of the additional information file 152. As shown in FIG. 3, the additional information file 152 is input with a “No.” item for identifying the original information and an “ID” item for identifying the additional information input to the original information. In this configuration, an “additional information” item representing the content of the additional information is associated. The additional information includes data (handwritten data) drawn on the tablet using the pen of the input unit 11 and the name of an icon that is an identifier for identifying input contents.

  The original information and the additional information are linked by the “No.” item in the original information file 151 and the additional information file 152. For example, in the example of FIGS. 2 and 3, the handwritten data 3 with “ID” 13 is additional information for the image data 1 with “No.” 1.

  FIG. 4 shows the data structure of the operation information file 153. As shown in FIG. 4, the operation information file 153 includes an “ID” item for identifying additional information and an “operation information” item representing operation information of the additional information. The operation information stored in the “operation information” item includes area information (coordinate value data) representing the arrangement position on the display screen of additional information input using the pen, color information of the area, and the like. . When additional information is input by selecting an icon, the “operation information” item of the operation information file 153 stores coordinate value data representing an arrangement position of the icon on the display screen as operation information related to the icon.

Next, the operation in this embodiment will be described.
With reference to the flowchart of FIG. 5 and FIG. 6, an information storage process executed under the control of the CPU 10 of the search device 1 will be described.

  First, image data serving as the original information 40 is stored in the original information file 151 (step S1). Next, the image data of the original information 40 stored in step S1 is displayed on the display unit 12 (step S2).

  Next, it is determined whether or not there is handwritten additional writing (character input such as a comment, graphic input, etc.) by the operation of the input unit 11 (step S3). If it is determined in step S3 that there is a handwritten additional writing (step S3; YES), the handwritten information is stored in the additional information file 152 as additional information (step S4).

  For example, as illustrated in FIG. 6, when characters or figures are drawn on the original information 40 using the pen 11 </ b> A of the input unit 11, the data of the drawing image 41 is stored in the additional information file 152 as additional information. The

  In addition to the drawn image 41 using the pen 11A, characters recognized by the OCR 13 may be stored in the additional information file 152 as additional information.

  After step S4, upper left coordinate values (x1, y1) and lower right coordinate values (x2, y2) on the display screen of handwritten information are calculated (step S5). In the display screen shown in FIG. 6, assuming that the upper left corner is the origin (0, 0), the right direction is the positive direction of the x coordinate, and the lower direction is the positive direction of the y coordinate, in step S5, the smallest surrounding the drawing image 41 is enclosed. Among the four diagonal points of the rectangular area 42 (rectangular area having sides parallel to the x-axis and y-axis), the upper left coordinate values (x1, y1) at which the x-coordinate and y-coordinate are minimum values, and x A lower right coordinate value (x2, y2) in which the coordinate and the y coordinate are maximum values is calculated.

  After step S5, the coordinate data of the two points calculated in step S5 and the color information (data representing the color of the drawn image) of the handwritten information stored as additional information in step S4 are stored in step S4. The information is stored in the operation information file 153 in association with the added additional information (that is, in association with the ID) (step S6), and the information storage process is terminated.

  When it is determined in step S3 that there is no handwritten additional writing (step S3; NO), it is determined whether an icon on the display screen is selected by the input unit 11 (step S7). If it is determined in step S7 that an icon has not been selected (step S7; NO), the process returns to step S3, and a waiting state for handwritten additional writing or icon selection is entered.

  If it is determined in step S7 that an icon has been selected (step S7; YES), the name of the selected icon is stored as additional information in the additional information file 152 (step S8).

  Next, the upper left coordinate value (x1, y1) of the area where the icon is arranged on the display screen is acquired (step S9). Next, the coordinate value data acquired in step S9 is stored in the operation information file 153 in association with the additional information stored in step S8 (that is, in association with the ID) (step S10). finish.

  Next, the search condition input process executed under the control of the CPU 10 of the search device 1 after the information storage process of FIG. 5 will be described with reference to the flowchart of FIG. 7 and FIG.

  In the search condition input process, it is assumed that a search screen 60 as shown in FIG. As shown in FIG. 8, the search screen 60 includes an area specifying unit 61 and a search condition input unit 62. The search condition input unit 62 includes a selection box 50 for selecting an icon, a color, and the like, an input box 51 for inputting a color, characters recognized by the OCR 13, and the like, and an area designating unit 61 for designating an area. An area designation start button 52, an area input box 53 for inputting coordinates on the display screen, and a search button 54 are configured.

  As for the color input using the input box 51, for example, RGB values of 256 gradations may be arbitrarily input. In order to specify an area in the area specifying unit 61, the area specifying start button 52 is selected, and then the area is specified using the pen 11A of the input unit 11 on the screen in the area specifying unit 61. The coordinate input in the area input box 53 is, for example, a desired rectangular area (for example, the upper left area, etc.) from each of the divided screens (for example, the 4-divided screen, the 9-divided screen, etc.) obtained by dividing the display screen. This is done by selecting the lower right area.

  In the search condition input unit 62, when a search target is selected by the selection box 50 (step S20; YES), the selected target is stored in the RAM 14 (step S21).

  In the search condition input unit 62, when a search target is input from the input box 51 (step S22; YES), the input target is stored in the RAM 14 (step S23).

  When the region specification start button 52 is selected in the search condition input unit 62 (step S24; YES), the search target region is specified by operating the pen 11A of the input unit 11 on the screen in the region specification unit 61. Accepted (step S25).

  Next, among the rectangular areas having sides parallel to the x axis and the y axis in the area specifying unit 61, the minimum value and the maximum value of the x coordinate of the minimum rectangular area surrounding the area specified in step S25 are calculated. Further, the minimum value and the maximum value of the y coordinate of the rectangular area are calculated, and the calculated coordinate value data is stored in the RAM 14 (step S26).

  In the search condition input unit 62, when a rectangular area to be searched is input from the area input box 53 (step S27; YES), the upper left coordinate value and the lower right coordinate value of the input rectangular area are acquired. These coordinate value data are stored in the RAM 14 (step S28).

  After any one of steps S21, S23, S26, and S28, the input of the search button 54 is accepted (step S29), and the search condition input process ends. Also, when no box or button of the search condition input unit 62 is selected (step S27; NO), the search condition input process is ended.

  Next, with reference to the flowchart of FIG. 9, the search process executed under the control of the CPU 10 of the search device 1 after the search condition input process of FIG.

  When the search button 54 is input on the search screen 60 (step S40; YES), it is determined whether or not the RAM 14 has a selection target or input target as a search condition (step S41).

  If it is determined in step S41 that there is a selection target or input target (step S41), operation information that matches the selection target or input target is searched in the operation information file 153, and the ID of the corresponding operation information is stored in the RAM 14. (Step S42).

  Next, it is determined whether or not there is further area designation or area input as a search condition (step S43). If it is determined in step S43 that there is no area designation or area input (step S43; NO), the original information corresponding to the ID of the operation information stored in step S42 and all the additional information corresponding to the original information Are extracted from the original information file 151 and the additional information file 152, respectively, and the extracted original information and additional information are superimposed and displayed on the display unit 12 (step S44), and the search process ends.

  When it is determined in step S43 that an area has been specified or an area has been input (step S43; YES), the operation information ID stored in step S42 and the operation information corresponding to the area specified or input in step S43 are the operation information. A search is made in the file 153 (step S45), and it is determined whether there is corresponding operation information (step S46).

  Specifically, in step S46, the overlapping portion of the rectangular area indicated by the coordinate value calculated or acquired in step S26 or S28 of FIG. 7 and the rectangular area indicated by the coordinate value of the operation information in the operation information file 153 is mostly. In the case of (for example, 80% or more) or the case where the former rectangular area covers the whole of the latter rectangular area, it is determined that “there is corresponding operation information”.

  When it is determined in step S46 that there is no corresponding operation information (step S46; NO), the original information corresponding to the ID of the operation information stored in step S42 and all the additional information corresponding to the original information are included. These are extracted from the original information file 151 and the additional information file 152, respectively, and the extracted original information and additional information are superimposed and displayed on the display unit 12 (step S44), and the search process is terminated. If it is determined in step S46 that there is no corresponding operation information (step S46; NO), a message that there is no corresponding information may be displayed on the display unit 12 and the search process may be terminated.

  On the other hand, when it is determined in step S46 that the corresponding operation information is present (step S46; YES), the original information corresponding to the operation information and all the additional information corresponding to the original information are respectively stored in the original information file. 151 and the additional information file 152, and the extracted original information and additional information are superimposed and displayed on the display unit 12 (step S47), and the search process ends.

  If it is determined in step S41 that there is no selection target or input target (step S41; NO), it is determined whether or not there is a region designation or region input as a search condition (step S48).

  If it is determined in step S48 that an area has been specified or an area has been input (step S48; YES), the operation information file 153 is searched for operation information corresponding to the specified or input area (step S49), and the operation information file 153 is searched. It is determined whether or not there is operation information corresponding to the area (step S50).

  In step S50, specifically, the overlapping portion of the rectangular area indicated by the coordinate value calculated or acquired in step S26 or S28 of FIG. 7 and the rectangular area indicated by the coordinate value of the operation information in the operation information file 153 is mostly large. In the case of (for example, 80% or more) or the case where the former rectangular area covers the entire latter rectangular area, it is determined that “there is operation information”.

  When it is determined in step S50 that the corresponding operation information is present (step S50; YES), the original information corresponding to the operation information and all the additional information corresponding to the original information are the original information file 151 and Extracted from the additional information file 152, the extracted original information and additional information are superimposed and displayed on the display unit 12 (step S51), and the search process ends.

  On the other hand, if it is determined in step S50 that there is no corresponding operation information (step S50; NO), or if it is determined in step S48 that there is no area designation or area input (step S48; NO), there is no corresponding information. Is displayed on the display unit 12 (step S52), and the search process ends.

  In addition, when a plurality of corresponding operation information is extracted in steps S42, S46, and S50, for example, for each extracted operation information, the corresponding original information and the additional information corresponding to the original information are superimposed to be a thumbnail. The displayed screen may be displayed on the display unit 12, and information desired by the user may be selected on this screen.

  As described above, according to the search device 1 of the present embodiment, when additional information is input by the input unit 11 with respect to the original information displayed on the display unit 12, the input additional information and the additional information are input. The operation information related to the information is stored in the storage unit 15 in association with the original information, and when the operation information is input by the input unit 11 as a condition for searching for information to be displayed on the display unit 12, the input operation Based on the information, the original information and the additional information stored in the storage unit 15 are searched, and the original information and the additional information extracted by the search are displayed on the display unit 12.

  As a result, it is possible to search information input in the display screen at high speed based on the input area and input contents, and it is possible to immediately display information desired by the user.

  In particular, region information (coordinate value data) that indicates the position of the additional information on the display screen is stored as operation information for the additional information that has been input, and additional information can be searched based on the region information that has been input as a search condition By doing so, it is possible to speed up the search when there is a feature in the area where the additional information is input.

  Further, the color information of the additional information is stored as the operation information of the input additional information, and the additional information can be searched based on the color information input as the search condition. The case search can be speeded up.

  Further, as operation information of the input additional information, data of coordinate values representing an arrangement position on the display screen of an icon, which is an identifier for identifying input contents, is stored, and the name of the icon is stored as additional information and searched. By making it possible to search for additional information based on region information (coordinate value data) input as a condition or an icon selected as a search condition, the search can be speeded up when the content of the additional information has a feature. Can do.

  As in the present embodiment, the additional information and the original information can be searched and displayed at high speed based on the input area or the input content in the display screen of the additional information input with respect to the original information. It can be applied to information retrieval in a wide range of industries such as companies and hospitals.

The block diagram which shows the principal part structure of the search device which concerns on embodiment of this invention. The figure which shows the data structure of the original information file memorize | stored in the memory | storage part of the search device. The figure which shows the data structure of the additional information file memorize | stored in the memory | storage part of the search device. The figure which shows the data structure of the operation information file memorize | stored in the memory | storage part of the search device. The flowchart which shows the information storage process performed under control of CPU of a search device. The figure which shows an image when additional information is input with respect to original information. The flowchart which shows the search condition input process performed under control of CPU of a search device. The figure which shows an example of the search screen displayed on the display part of a search device in search condition input processing. The flowchart which shows the search process performed under control of CPU of a search device.

Explanation of symbols

1 Search device 10 CPU
11 Input unit 12 Display unit 13 OCR
14 RAM
15 Storage Unit 151 Original Information File 152 Additional Information File 153 Operation Information File

Claims (5)

First display control means for displaying original information to be searched on the display means;
First input means for inputting additional information to the original information displayed by the first display control means;
Storage means for storing additional information input by the first input means and operation information related to the additional information in association with the original information;
Second input means for inputting operation information as a condition for searching for information to be displayed on the display means;
Based on the operation information input by the second input means, the original information and additional information stored in the storage means are searched, and the original information and additional information extracted by the search are displayed on the display means. Second display control means for
A search device comprising:   The search device according to claim 1, wherein the operation information stored in the storage unit includes region information indicating an arrangement position on the display screen of additional information input by the first input unit.   The search device according to claim 1, wherein the operation information stored in the storage unit includes color information of additional information input by the first input unit.   The search device according to claim 1, wherein the operation information stored in the storage unit includes information relating to an identifier for identifying the content input by the first input unit. Computer
Means for displaying original information to be searched on a display means;
Means for inputting additional information with respect to the displayed original information;
Means for storing the input additional information and operation information related to the additional information in association with the original information;
Means for inputting operation information as a condition for searching for information to be displayed on the display means;
Means for searching the stored original information and additional information based on the input operation information, and displaying the original information and additional information extracted by the search on the display means;
Program to function as.

Images