JPH086968A - Image additional information inputting method and input system - Google Patents

Abstract

PURPOSE:To construct a flexible system with extendability by separating a computer performing an image display and a computer inputting additional information and storing received additional information by making the information correspond to an image. CONSTITUTION:When a computer 10 reads an image from a storage device 16 and displays this image on a display 14, in a method inputting the additional information of the image in the computer 10 by referring to the image displayed on a display 14, the additional information is transmitted from a computer 20 connected with the computer 10 via a communication line 19. When the computer 10 receives this additional information, the additional information is stored in the storage device 16 by making the information correspond to an image being displayed. As a result, because a screen is not hidden due to a guide for an input and display information facilitating the input and the sharing of functions is distinctive, the development and maintenance, etc., of a system become easy and a flexible system with extendability can be constructed.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image additional information input method and an input system for inputting additional information to a large number of images and performing classification processing using this information. The present invention relates to a method and system for inputting additional information suitable for inputting classification information while visually observing.

[0002]

2. Description of the Related Art For example, on an input screen of a bank teller machine, in order to confirm the result read by an OCR (optical character reader), character image data and code data recognized are displayed side by side on a display. A system is known in which an operator corrects misrecognized characters and unreadable characters with a keyboard. In addition, overseas, the mail sorting machine (a device that reads the address of the mail with a character recognition device and automatically sorts the mail) displays the image of the mail that cannot be read on the display, and the operator can see the image. There is a system to enter the classification code with the keyboard. Further, for example, as an input screen of an automatic teller machine, there is a keyboard called a screen key set equipped with a touch panel. This is because a plurality of screen screens overlapping with the touch panel are registered, and the first screen is divided into 1 to 10 sections. By pressing the button to move to the next, 11 to 20 A screen transition is easily performed on the second screen divided into sections.

[0003]

However, for example, in the case of inputting an address while viewing the image data of a postal matter, the position where the address is written and the size of the characters are different, and the vertical writing is performed. Since horizontal writing was mixed, it could not be easily corrected like the OCR correction system. Also, if you enter the address as it is with the keyboard or enter the classification code directly, there is no problem, but in the case of an input method that displays a list of city / ward counties and town names and selects one of them In this case, the displayed postal image is hidden in the city, district, and town name, which causes a problem when entering the code. The screen keyset solves the problem of hiding the postal image, but since it is just a keyboard, it is not suitable for complex screen displays or input methods such as dynamically changing screens. An object of the present invention is to solve these conventional problems, to have an interface that can be operated by an unskilled person, to easily develop and maintain the system, and to provide a flexible system with expandability,
Another object of the present invention is to provide a method and system for inputting image additional information that can withstand various input methods and have good operability.

[0004]

In order to achieve the above object, the image additional information input method of the present invention comprises: (i) referring to the image displayed on the display (14), ) In the method of inputting additional information of the image,
The first computer (10) reads out the image from the storage device (16), displays the read-out image on the display (14), and then the first computer (10) is connected to the first computer (10) through the communication line (19). The second computer (20) transmits additional information to the first computer (10), and the first computer (10)
Then, when the additional information from the second computer (20) is received, the additional information is stored in the storage device (16) in association with the currently displayed image. Also, (ii)
The second computer (20) receives an image processing instruction such as image scrolling, zooming, and rotation, and transmits the instruction content to the first computer (10). It is also characterized by receiving the instruction content from the computer (20), performing image processing based on the instruction content, and displaying the processed image. (iii) In the system for inputting additional information of an image to the first computer (10) by referring to the image displayed on the display (14), the first computer (10) displaying the image and the additional computer A second computer (20) for inputting information is connected by a communication means (19), and an image retrieval means (163) for reading an image from a storage device (16) and a read for the first computer (10). An image display means (162) for displaying an image on a display; an additional information storage means (164) for storing the received additional information in a storage device in association with the currently displayed image; and a second computer (20). And a communication means (165) for communicating between the second computer (20) and an input screen display means (17) for displaying a screen for inputting additional information on the display.
3), and an input means (174) for receiving the input of additional information,
Communication means (1) for communicating with the first computer (10)
72) and are also featured.

[0005]

In the present invention, the first computer reads the image from the storage device (17) by the image search means (163) and displays the image read by the image display means (162) on the display (14), In the second computer (20), the input screen display means (173) displays a screen for inputting additional information on the display (24). The operator is the first computer
Looking at the image on the display (14) of (10), additional information is input to the input screen of the second computer (20). The second computer (20) receives the input of the additional information by the input means (174), transmits the additional information input by the communication means (19) to the first computer (10), and the first computer ( 10) by the communication means (19) to the second computer (2
The additional information sent from 0) is received, and the received additional information is stored in the storage device (18) in association with the image displayed by the additional information storage means (164). As a result, it is possible to realize an image additional information input method and system with good operability that can withstand various input methods.

[0006]

Embodiments of the present invention will now be described in detail with reference to the drawings. In the following description, it is assumed that the first computer is a personal computer and the second computer is a pen computer having a pen as a pointing device. FIG. 1 is a schematic configuration diagram of an image additional information input system of the present invention. In FIG. 1, 10 is a first computer, 11 is a central processing unit, 12 is a memory, 13
Is a control device for controlling various devices, 14 is a display, 15 is a keyboard, and 16 is a storage device. Further, 20 is a second computer, 21 is a central processing unit,
Reference numeral 22 is a memory, 23 is a control device for controlling various devices, 24 is a display, 25 is a tablet, 27 is an input pen, and 26 is a storage device. Also, 19 is the first
Is a communication line that connects the computer 10 and the second computer 20. FIG. 2 is a schematic view of the first computer. In FIG. 2, 14 is a display, 10 is a main body containing a central processing unit, and 15 is a keyboard. FIG. 3 is a schematic view of the second computer. FIG.
20 is a main body including a central processing unit, 2
Reference numerals 4 and 25 are displays integrated with the tablet, and 27 is an input pen.

The present invention will be described in detail with reference to FIG. 4 and subsequent figures by taking a concrete system as an example. In the system used for the explanation, the operator sees the address of the postal image displayed on the display 14 of the first computer 10 and inputs the address up to the municipality with the second computer 20. First, an example of a screen used in the system will be described. FIG. 4 is a diagram of a postal image display screen used by the first computer. In FIG. 4, 30 is an image area and 31 is a postal image. The operator inputs an address to the second computer 20 with reference to the postal image. When the input is complete, a new postal image is displayed. 5 to 7 show screens used by the second computer. FIG. 5 is a screen for selecting a region. 41 is a button for selecting a region. The operator selects the desired locality name by touching one of these buttons with the input pen. Reference numeral 50 denotes a button group for instructing rotation and scroll of the postal image displayed on the first computer. From top to bottom, scroll up, scroll down, scroll right, scroll left, rotate right, rotate left, and zoom (zoom).

FIG. 6 is a diagram of a screen for selecting a prefecture. When the button for selecting a region is touched on the screen for selecting a region in FIG. 5, this screen is displayed. In this example, "Chubu" is selected. 42 is a button for selecting a prefecture. The operator selects a prefecture name by touching one of these buttons with the input pen. FIG. 7 is a diagram of a screen for selecting a city. Touch the prefecture selection button on the prefecture selection screen of FIG. 6 to display this screen. In this example,
"Aichi Prefecture" is selected. 43 is a button for selecting a city / ward. The operator selects the city name by touching one of these buttons with the input pen. When the selection is completed, the screen returns to the region selection screen of FIG. FIG. 8 is a diagram of a screen when the postal image is enlarged and displayed. In this example, when the screen of FIG. 4 is displayed,
It is a screen when an enlargement instruction is given by the second computer. FIG. 9 is a diagram of a screen when a postal image is scroll-displayed. This example is a screen when the second computer issues an upward scrolling instruction while the screen of FIG. 8 is displayed.

FIG. 10 is a diagram of a screen when a postal image is rotated and displayed. When the second computer issues a rotation instruction to the right while the upper screen of FIG. 10 is displayed, the lower screen is displayed. FIG. 11 is a state transition diagram of the first computer. When the operation of the first computer is started, the initial screen is displayed (60).
Next, open the communication line (61) and wait for reception (62)
become. In this state, it waits for the system of the second computer to start. From the second computer, click "STA
When the message "RT" is received, "START" is transmitted to the second computer, meaning "OK" (63),
Then, by starting the reading of the image, the first postal image is retrieved (66), the retrieved postal image is displayed (67), and the system waits for reception (62). Where the second
When you receive scrolling, rotating and zooming instructions from your computer,
Performs zoom processing (64) and waits for reception (6
2). When the address input end message (completion of city / ward selection ends) is received, the input result is stored (65), the next postal image is searched (66), and the searched postal image is displayed (67). It returns to the waiting for reception (62). Where the second
When receiving the "END" message from the second computer, the "END" is transmitted to the second computer (6
3), the communication line is closed (68), and the process is terminated. In this figure, the initial screen display (60) may be omitted.

FIG. 12 is a state transition diagram of the second computer. When the operation of the second computer is started, the communication line is opened (70), the "START" message is transmitted to the first computer (71), and the system waits for reception (72). Here, when the "START" message is received from the first computer, the local input screen is displayed (73) and the pen touch input waiting is performed (7).
4). When the local selection input (local selection end) is accepted, the prefecture input screen is displayed (75), and the pen touch input waits (74). Here, when the selection input of the prefecture is completed (the selection of the prefecture is completed), the city / ward is searched (76) and the city / gun input screen is displayed (77).
It waits for a pen touch input (74). Here, when the selection input of the city / ward group is accepted, the entered address is assembled and sent to the first computer as an address input end message (71), the local input screen is displayed (73), and the pen touch input wait (74). When a scroll, rotation, or zoom instruction is received in the pen touch input waiting state (74), a message corresponding to the instruction is transmitted to the first computer (71), and the pen touch input waiting state (72).
Return to When the end instruction is accepted, the "END" message is transmitted to the first computer (71) and the reception is awaited (72). Here, when the "END" message is received from the first computer, the communication line is closed (78), and the process ends.

FIG. 13 is a diagram showing an example of a communication message between the first computer and the second computer. In FIG. 13, reference numeral 80 represents a message format.
“HD” is a header, “CD” is a command, “LN” is a data length, “DT” is data, and “EM” is an end mark. The data may not be present depending on the command. 81 to 86 are communication messages from the second computer (pen computer) to the first computer (personal computer), and 87 and 88 are communication messages from the first computer to the second computer. The alphanumeric character in the frame is a concrete code 1
It is expressed in hexadecimal. 81 is a “PenSt” that is transmitted when the system of the pen computer is started up.
"Art" message, 82 is a "Pen End" message that is sent before the system of the pen computer is terminated, 83 is a "Scroll" message that is sent when a scroll instruction of the postal image is received, and 84 is a
"Ro sent when the rotation instruction of the postal image is accepted
“Tate” message, 85 is a “Zoom” message to be transmitted when a mail image enlargement instruction is received, 8
Reference numeral 6 is an "Address Code" message that is transmitted when address input is accepted and the address input is completed.

In the data portion "nn" of the 83 "Scroll" message, "00" is downward and "0" is "0".
“1” indicates upward scrolling, “02” indicates rightward scrolling, and “03” indicates leftward scrolling. In addition, 84 “Rotat
The data part “mm” in the “e” message is “00”.
Indicates right rotation, and “01” indicates left rotation. 85 of "Z
The data part "kk" in the "oom" message is "0".
“0” indicates enlargement and “01” indicates reduction. 86 "A
The data length part “ii” in the “ddress Code” indicates the length of the data part “address”. On the other hand, 87 is "Pen Sta" from the second computer.
"PC St" to send after receiving the "rt" message
The "art" message, 88 is a "PC End" message to be transmitted after receiving the "Pen End" message from the second computer.

FIG. 14 is a processing flowchart of the first computer according to the present invention. First, the initial screen is displayed (step 111), and the communication line is opened (step 112). Then, steps 114 to 122 are repeated until the "Pen End" message is received from the second computer (step 113). "PenEn
When the "d" message is received, the "PC End" message is transmitted (step 123) and the communication line is closed (step 124). The iterative process in step 113 receives the message (step 11
4) The processing is sorted according to the content of the received message (step 115). If it is a "Pen Start" message, "PC Start" is transmitted (step 116). If the message is a "Scroll" message, the mail image is scrolled (step 117). If it is a "Rotate" message, the mail image is rotated (step 118). If it is a "Zoom" message, the mail image is enlarged / reduced (step 1).
19). If it is an "Address Code" message, the address as an input result is stored (step 120), and the next postal image is searched (step 121). After performing any of the above processes, a postal image is displayed (step 122).

FIG. 15 is a processing flowchart of the second computer according to the present invention. Here, the local input screen is processing mode 1, the prefecture input screen is processing mode 2,
The city / ward input screen is set to processing mode 3. First, open the communication line (step 131), and then "Pen St
"art" is transmitted (step 132), and "Pen Start" is received from the other party (step 13).
3). Next, the processing mode is set to 1 (step 13
4) The operation from step 136 to step 148 is repeated until the end instruction is input (step 13).
5). If the end instruction is input, "Pen En
"d" is transmitted (step 149), "PC End" is received (step 150), and the communication line is closed (step 151). The iterative processing in step 135 sorts the processing according to the processing mode (step 136). If the processing mode is 1, the local input screen is displayed (step 137), if the processing mode is 2, the prefecture input screen is displayed (step 138), and if the processing mode is 3, a city / district search is performed (step 139). ), The city / ward input screen is displayed (step 140). Next, it waits for a pen touch input (step 141). Here, the processing is divided into those for which the input is a scroll, rotation, and enlargement instruction and those for which it is not (step 142). If it is a scroll, rotation, or enlargement instruction, a message corresponding to the instruction content is transmitted (step 143), and if not, processing is distributed according to the processing mode (step 144). If the processing mode is 1, the processing mode is set to 2 to advance to the next mode (step 145), if the processing mode is 2, the processing mode is set to 3 (step 146), and if the processing mode is 3, the input address is set. It is transmitted as an assembly "Address Code" (step 147) and the processing mode is set to 1 (step 148).

FIG. 16 is a block diagram of an image additional information input system showing an embodiment of the present invention. Hereinafter, each internal means will be described, and processing steps corresponding to the operations of FIGS. 14 and 15 will be shown. 10 is a first computer, and 20 is a second computer. First, the means of the first computer will be described. An image display unit 162 displays a postal image (see step 122 in FIG. 14). Reference numeral 163 denotes an image reading means, which takes out an image from the database 17 in which postal images are stored (see step 121 in FIG. 14). Reference numeral 164 denotes an additional information storage means, which is the second
The postal image displaying the address received from the computer is stored in the additional information file 18 in association with each other (FIG. 1).
4 step 120). 165 is a communication means,
The communication line 19 is opened, closed, and messages are transmitted and received (steps 112, 114, 123 in FIG. 14,
124). Reference numeral 161 denotes an overall control unit, which performs overall control (see the remaining steps in FIG. 14). Next, the means of the second computer will be described. An input screen display unit 173 displays various input screens (see steps 137, 138 and 140 in FIG. 15). Reference numeral 174 denotes an input unit that receives a pen touch input (step 1 in FIG. 15).
41). Reference numeral 175 is a city / ward search means, which searches the address dictionary 28 for a city / city based on the data entered on the prefecture input screen (see step 139 in FIG. 15). The address dictionary 28 is a dictionary that covers all addresses. 172
Is a communication means, which opens and closes the communication line 19 and sends and receives a message (step 13 in FIG. 15).
1, 132, 133, 143, 147, 149, 15
0, 151).

As described above, by separating the computer for displaying the image and the computer for inputting the additional information from each other, the image is hidden by the guide for input or the display information for facilitating the input. Can be resolved. In addition, since the division of functions can be clarified, system development and maintenance are simplified, and a flexible system with expandability can be constructed. FIG. 17 is a diagram showing an application example of the present invention, and shows a case where the first computer and the second computer are housed in one housing and integrated. In FIG. 17, 10 is a first computer, 20
Is a second computer, and 200 is a housing. The integration makes it easy to carry, and the switch for turning on / off the power of both computers 10 and 20 at the same time is attached to the housing, so that the operation at the start and at the end becomes easy. FIG. 18 is a diagram showing another application example of the present invention, which is a diagram showing a mechanism for adjusting the angle of the display of the first computer and the display of the second computer. 201 is an angle adjusting mechanism, and fatigue can be reduced by adjusting the angle adjusting mechanism 201 to an angle at which the operator can most easily operate.

FIG. 19 is a diagram showing a screen for confirming the input result. In FIG. 19, reference numeral 210 denotes an input result confirmation screen, which is the city / ward input screen 24, 25 shown in FIG. 7.
Is displayed over the screen where the input of is completed. Also, 21
1 is a cancel button and 212 is an OK confirmation button. This allows the input result to be sent to the second computer before being sent to the first computer.
Display on the computer screen of and prompt the operator to confirm the contents. When the "cancel" button 211 is pressed, the result is not transmitted and the process returns to the beginning of input. When the "OK" button 212 is pressed, the result is transmitted and the process returns to the beginning of input. This makes it possible to correct an input error if you notice it. FIG. 20 is a diagram showing another application example of the present invention, which is an example of an operation by a gesture (a locus written with an input pen) instructing image processing. in this way,
The computer executes the process matching the instruction by detecting the direction of the line instructing the image processing drawn by the operator without providing the operation button individually. In FIG. 20, 221 is a rightward scroll, 222 is a leftward scroll, 223 is an upward scroll, and 224 is a downward scroll. Also, 225 is counterclockwise rotation, 22
6 is clockwise rotation. 227 is enlargement and 228 is reduction. The arrow in the figure indicates the direction. You can speed up the operation by giving instructions by gestures. The locus may be displayed on the screen, but may not be displayed. Further, the scroll amount may be proportional to the length of the locus or may be a constant amount.

In the present embodiment, the second computer has been described as a pen input computer, but the present invention is not limited to this and may be a touch panel computer or an ordinary personal computer. In the embodiment, the case where the mail that cannot be read by the mail sorter is displayed on the display and the operator writes the address from another computer while viewing the image has been described, but the present invention is limited to this case. Various fields, such as medical care, tax filing, resident management, employee management,
Alternatively, it can be widely applied to patent management and the like.

[0019]

As described above, according to the present invention, since the computer for displaying an image and the computer for inputting additional information are separated, a screen for displaying a guide for inputting or display information for facilitating inputting is displayed. Never hide. Further, since the functional division is clear, system development, maintenance, etc. are simplified, and a flexible system with expandability can be constructed.
Further, it is possible to realize an image additional information input method and system of an interface that can be operated even by unskilled persons.

[Brief description of drawings]

FIG. 1 is an overall configuration diagram of an image additional information input system of the present invention.

FIG. 2 is a perspective view showing an example of a first computer in FIG.

3 is a perspective view showing an example of a second computer in FIG. 1. FIG.

FIG. 4 is a diagram showing an example of a mail image display screen to which the present invention is applied.

FIG. 5 is a diagram of a local input screen in a first mode according to an embodiment of the present invention.

FIG. 6 is a diagram showing a prefecture input screen in a second mode according to an embodiment of the present invention.

FIG. 7 is a diagram of a city / gun county input screen in a third mode according to an embodiment of the present invention.

FIG. 8 is a diagram of a mail image zoom screen showing an embodiment of the present invention.

FIG. 9 is a diagram of a mail image scroll screen showing an embodiment of the present invention.

FIG. 10 is a diagram of a postal image rotation screen showing an embodiment of the present invention.

FIG. 11 is a state transition diagram of the first computer according to the embodiment of the present invention.

FIG. 12 is a state transition diagram of a second computer showing an embodiment of the present invention.

FIG. 13 is a format diagram of a communication message showing an embodiment of the present invention.

FIG. 14 is a processing flowchart of a first computer showing an embodiment of the present invention.

FIG. 15 is a processing flowchart of a second computer showing an embodiment of the present invention.

FIG. 16 is a detailed configuration diagram of an image additional information input system showing an embodiment of the present invention.

FIG. 17 is a perspective view of both computers integrated to show an application example of the present invention.

FIG. 18 is a functional operation diagram of an angle adjusting mechanism showing another application example of the present invention.

FIG. 19 is a diagram of an input result confirmation screen showing another application example of the present invention.

FIG. 20 is an explanatory diagram of an image processing instruction gesture showing still another application example of the present invention.

[Explanation of symbols]

10 ... First computer, 14 ... Display, 19
... communication line, 20 ... second computer, 24 ... display, 25 ... tablet, 27 ... input pen, 31 ... postal image, 50 ... image processing instruction button group, 162 ... image display means, 163 ... image reading display means, 164 ... Additional information storage means, 165 ... communication means, 172 ... communication means, 1
73 ... Input screen display means, 174 ... Input means, 200 ...
Enclosure, 201 ... Angle adjustment mechanism, 210 ... Input result confirmation screen, 221-228 ... Gesture.

Claims (3)

[Claims] 1. A method of inputting additional information of an image to a first computer with reference to an image displayed on a display, wherein the first computer reads the image from a storage device,
When the read image is displayed on the display, the second computer connected to the first computer via a communication line transmits additional information to the first computer, and the first computer transmits the second information to the second computer. When the additional information is received from the computer, the additional information is stored in the storage device in association with the currently displayed image. 2. The image additional information input method according to claim 1, wherein the second computer receives image processing instructions such as image scrolling, zooming, and rotation,
The content of the instruction is transmitted to the first computer, the first computer receives the content of the instruction from the second computer, performs image processing based on the content of the instruction, and displays the processed image. A method for inputting additional image information, which is characterized in that 3. A system for inputting additional information of an image to a first computer by referring to an image displayed on a display, wherein the additional information is input separately from the first computer for displaying the image. Two computers are provided, and the first and second
The computer is connected to the first computer by communication means, and the first computer has an image retrieval means for reading an image from a storage device, an image display means for displaying the read image on a display, and a received additional information currently being displayed. An additional information storage unit for storing the additional information in the storage device in association with the image and a communication unit for communicating with the second computer are provided, and a screen for inputting the additional information is provided in the second computer. An image additional information input system comprising: an input screen display means for displaying on a display; an input means for receiving an input of additional information; and a communication means for communicating with the first computer.