JP4243642B2 - Calibration method and information input support sheet - Google Patents

Description

  The present invention relates to a sheet on which a dot pattern is printed and a calibration method for using the sheet.

  Conventionally, in the operation of a personal computer, a PDA, a handy terminal, etc., a technique for inputting directly on the screen with a fingertip or a touch pen is known (for example, Patent Document 1).

  In these conventional techniques, for example, the coordinate operated by the touch pen is recognized by a pressure-sensitive or optical touch panel, and the control is notified to the control means.

  However, conventional touch panel technology uses expensive parts and materials, and most of them are manufactured integrally with hardware. Therefore, devices such as personal computers and ATMs equipped with touch panels are very It was expensive.

  In order to solve such a problem, some touch panels for detachably mounting on a display have been developed (for example, Patent Document 2).

JP-A-10-171600 JP 2001-92595 A

  However, when a touch panel is mounted on hardware that has already been used, it is expensive and has limited models and usage conditions, and cannot be used widely and simply. Moreover, most of the touch panels that are detachably mounted on the display are pressure-sensitive, so that the response due to touch panel input is not good, and the touch panel itself becomes dirty because it touches directly with a finger. The display has a drawback of poor recognition.

  Furthermore, the conventional detachable touch panel has been proposed only for mounting on a display, and no other touch panel used on a printed material or medium has been proposed.

  Therefore, the present inventor has proposed an information input auxiliary sheet that is simple and low-cost, has extremely high input accuracy and input efficiency, and does not select an attachment target.

  This information input auxiliary sheet is arranged on, for example, an existing display screen. When the user touches an icon or the like on the display screen with a scanner pen through the information input auxiliary sheet, information corresponding to the icon or the like is output.

  Moreover, this information input auxiliary sheet is used, for example, on an existing printed material. When the user touches a character or design on the printed material with a scanner pen through the information input auxiliary sheet, information corresponding to the character or design is output from a display, a speaker, or the like.

  As described above, in the case of a conventional touch panel, since the icon is touched with a finger, the icon is also provided with a large tolerance for error during input, and the input accuracy of the touch panel need not be so high.

  However, in the information input auxiliary sheet that is supposed to be used together with the existing screen display or printed matter, the display of the existing icon display or printed matter does not consider touch instructions, and the display is fine. When touching a printed pattern, high input accuracy may be required.

  The present invention has been made in view of the above points, and it is possible to accurately associate the aspect ratio between the information input auxiliary sheet and the screen or the printed material by a simple method, and achieve high input accuracy. It is a technical problem to provide a calibration method for using an input auxiliary sheet.

(1) A calibration method according to the present invention is arranged on a printed surface of a printed material or a display screen of a display, and is read by an optical reading device in order to output information related to the image of the printed material or the display of the display. A calibration method for using an information input auxiliary sheet provided with a dot pattern, wherein the information input auxiliary sheet is used by being arranged on a display screen of a display. Calibration marks are provided at two or more corners and / or in the center, and the display coordinate system and the coordinate system of the information input auxiliary sheet are properly adjusted by moving the cursor to match the mark. It is related to.

  In this way, by moving the cursor to the mark placed on the information input auxiliary sheet and matching it, it becomes possible to perform accurate calibration at the display resolution, and subsequent dot pattern reading on the information input auxiliary sheet It is possible to prevent a coordinate shift between the input by the means and the processing on the image on the display.

(2) calibration method according to the present invention, the calibration marks are formed on a detachable transparent seal, and characterized by peeling the seal from the information input help sheet after the calibration ends To do .

  Thereby, after calibration, the calibration mark on the information input auxiliary sheet can be eliminated, and the screen display of the display can be kept intact.

(3) In the calibration method according to the present invention, the calibration mark is provided in a removable state on the information input auxiliary sheet, and is removed from the information input auxiliary sheet after the calibration is completed. characterized in that that.

  Thereby, after calibration, the calibration mark on the information input auxiliary sheet can be erased, and the screen display of the display can be kept intact.

(4) the information input help sheet according to the present invention is characterized by being used in the calibration according to the above (1) to (3).

(5) The calibration method according to the present invention is arranged on a printed surface of a printed matter or a display screen of a display, and is read by an optical reading device in order to output information related to the image of the printed matter or the display on the display. A calibration method for using an information input auxiliary sheet provided with a dot pattern, wherein the information input auxiliary sheet is arranged and used on a display screen of a display, and two or more corner portions of the display In the center, the calibration mark is displayed at least temporarily, the dot pattern reading means is matched with the mark, and the dot pattern on the information input auxiliary sheet is read. A key to properly associate the coordinate system of the information input auxiliary sheet. And performing ablation.

  According to this, since it is not necessary to print a calibration mark on the information input auxiliary sheet, it is possible to perform calibration more easily.

(6) A calibration method according to the present invention is arranged on a printing surface of a printed material or a display screen of a display, and is read by an optical reading device in order to output information related to the image of the printed material or the display of the display. A calibration method for using an information input auxiliary sheet provided with a dot pattern, wherein the information input auxiliary sheet is used by being placed on a printing surface of a printed material. the corners of the above, a calibration mark and is printed, characterized in that by matching the marks both calibration, properly associate the coordinate system of the information input help sheet and the coordinate system of the printed matter And

  In this way, the calibration can be easily performed visually, and it is possible to prevent the occurrence of coordinate deviation between the subsequent input by the scanner on the information input auxiliary sheet and the processing for the image on the printed matter.

(7) information input help sheet according to the present invention is characterized by being used in the calibration according to the above (6).

(8) The calibration method according to the present invention is arranged on a printed surface of a printed material or a display screen of a display, and is read by an optical reading device in order to output information related to the image of the printed material or the display of the display. A calibration method for using an information input auxiliary sheet provided with a dot pattern, wherein the information input auxiliary sheet is used by being placed on a printed surface of a printed material, and is provided at two or more corners of the printed material. The calibration mark is printed, and the dot pattern reading means matches the mark, and the dot pattern on the information input auxiliary sheet is read, whereby the coordinate system of the printed matter and the coordinates of the information input auxiliary sheet are read. It is characterized by associating systems appropriately .

According to this, the calibration mark only needs to be printed on the printed material, and it is not necessary to print the calibration mark on the information input auxiliary sheet. Therefore, the information input auxiliary sheet can be used for general purposes.
(9) In the calibration method according to the present invention, an information input auxiliary sheet provided with a dot pattern, which is used by being arranged on a printed surface of a printed matter or a display screen of a display, is indicated by an optical reader. In the information processing apparatus for outputting information related to the image on the printing surface of the printed matter or the display matter on the display screen of the display, the position on the information input auxiliary sheet instructed by the optical reading device is the position of the printed matter. A calibration method that correctly corresponds to an image on a print surface or a display object on a display screen, wherein the display and the optical reading device are connected to the information processing device, and the information input auxiliary sheet is Used on the display screen of the display to output various multimedia information and For the operation instruction, the dots generated by the dot code generation algorithm are arranged according to a predetermined rule, and the information processing apparatus calibrates at two or more corners and / or the center of the display. A position indicated by the optical reading device by reading the dot pattern on the information input auxiliary sheet when the optical reading device is displayed at least temporarily and the optical reading device is matched with the mark. The coordinate value on the information input auxiliary sheet is detected, and the detected coordinate value on the information input auxiliary sheet is converted into the coordinate value on the display of the mark matched with the optical reading device. By performing all of the marks displayed on the display, the information is displayed. A coordinate conversion function or a coordinate conversion table for converting the coordinate value of the input auxiliary sheet into the coordinate value of the display is obtained, and the information processing apparatus then reads the coordinate value of the information input auxiliary sheet that is read by the optical reading apparatus. The coordinate value of the display is converted and input by the coordinate conversion function or the coordinate conversion table.
(10) In the calibration method according to the present invention, an information input auxiliary sheet provided with a dot pattern, which is used by being arranged on a printed surface of a printed matter or a display screen of a display, is indicated by an optical reader. In the information processing apparatus for outputting information related to the image on the printing surface of the printed matter or the display matter on the display screen of the display, the position on the information input auxiliary sheet instructed by the optical reading device is the position of the printed matter. A calibration method that correctly corresponds to an image on a printing surface or a display on a display screen of the display, wherein the optical reading device is connected to the information processing device, and the information input auxiliary sheet is the printed material Used on the print surface of various media information output and / or operation instructions. Therefore, the dots generated by the dot code generation algorithm are arranged according to a predetermined rule, and calibration marks are printed at two or more corners of the printed matter. When the optical reading device is matched with the mark, the optical reading device reads the dot pattern on the information input auxiliary sheet, thereby the coordinates on the information input auxiliary sheet at the position indicated by the optical reading device. A value is detected, and the detected coordinate value on the information input auxiliary sheet is converted into a coordinate value on the printed matter of the mark matched with the optical reading device, and this process is performed for all the marks printed on the printed matter. A coordinate conversion function for converting the coordinate value of the information input auxiliary sheet into the coordinate value of the printed matter, or A standard conversion table is obtained, and the information processing device converts the coordinate value of the information input auxiliary sheet that is subsequently read by the optical reading device into the coordinate value of the printed matter by the coordinate conversion function or the coordinate conversion table and inputs the coordinate value. It is characterized by doing.
(11) An information input auxiliary sheet according to the present invention is used for the calibration according to any one of (9) and (10).
(12) An information input auxiliary sheet according to the present invention is provided on one surface side of an infrared reflecting layer having a property of reflecting infrared light from one side and transmitting visible light, and on the one side of the infrared reflecting layer. And a dot pattern layer in which dots made of an infrared absorption characteristic material generated by a dot code generation algorithm are arranged in accordance with a predetermined rule for media information output and / or operation instruction.
(13) The information input auxiliary sheet according to the present invention is characterized in that a guide mark for guiding a position to be read by the optical reading device is provided for performing the calibration.
(14) In the information input auxiliary sheet according to the present invention, the guide mark is formed on a detachable transparent seal, and the seal can be peeled off from the information input auxiliary sheet after the calibration is completed. And
(15) In the information input auxiliary sheet according to the present invention, the guide mark is provided on the information input auxiliary sheet in a removable state, and is removed from the information input auxiliary sheet after completion of the calibration. It is characterized by that.

  According to the present invention, a device equipped with any display means, such as a general-purpose computer, PDA, or mobile phone, can be used as a touch panel type input means very easily.

  In addition, it can be attached to printed materials such as books and catalogs, and any media, and without printing any code on the media itself, the text, illustrations, It can output multimedia information such as photos, sounds, and moving pictures, and can operate devices.

  1 to 2 are explanatory diagrams showing an embodiment in which a grid sheet, which is an information input auxiliary sheet according to the present invention, is mounted on a display and used.

  FIG. 1 is a diagram in which a grid sheet is used in a general-purpose computer system that is an information processing apparatus. In this embodiment, a grid sheet is pasted on a display screen such as a liquid crystal display (LCD) such as a personal computer or a CRT (CRT). The grid sheet is formed of a transparent film, and is printed with a dot pattern. Although details will be described later, this dot pattern is obtained by patterning XY coordinate values and / or code values with a predetermined algorithm. A scanner which is a dot pattern reading unit is connected to the computer main body. The user touches the grid sheet with the scanner in accordance with the instructions on the fluoroscopic screen. The scanner reads the dot pattern and transmits it to the personal computer via the USB cable. The central processing unit (CPU) of the personal computer analyzes the dot pattern to obtain the XY coordinate value on the grid sheet, and further, xy on the display. Conversion to coordinate values enables input in touch panel format from the coordinate value information.

  According to this, input of a touch panel form is attained by this sheet, and it becomes possible to provide a touch panel that is inexpensive and excellent in convenience. Further, when browsing a site on the Internet, it is possible to search and refer to related information even if the link information is not set.

  In FIG. 1, a personal computer is used as the information processing apparatus. However, the present invention is not limited to this, and the information processing apparatus may be a personal computer, a PDA, a television receiver, a front and rear projector, a game device, a karaoke device, a portable device. A telephone terminal device, a POS terminal device, an ATM, a KIOSK terminal, a car navigation system, a pachinko machine, a watch, a smartphone, or the like may be used. In these, a grid sheet is arranged on a display screen or a display screen as a touch panel type input device.

  FIG. 2 is a cross-sectional view showing the internal structure of the grid sheet described in FIG.

  FIG. 6A is a longitudinal sectional view showing a state in which the grid sheet is touched by the scanner.

  As shown in the figure, the grid sheet has a structure in which an infrared reflecting layer, a dot pattern layer, and a protective transparent sheet (protective layer) are laminated from the display device side.

  The infrared reflective layer has a configuration in which an infrared reflective material is vapor-deposited on a transparent sheet for vapor deposition made of a material that transmits visible light, such as vinyl, envipet, and polypropylene. The infrared reflection layer reflects the infrared rays irradiated from the infrared irradiation means of the scanner and transmitted through the protective transparent sheet to the scanner and transmits visible light. At the same time, infrared rays from the display device are blocked. Thereby, only the infrared light irradiated from the infrared irradiation means of the scanner can be used as the irradiation light, and only a bright and clear dot pattern can be photographed, and the dot code can be analyzed accurately.

  On the dot pattern layer, a dot pattern in which dots made of an infrared absorbing material such as carbon ink are arranged according to a predetermined rule as described later is printed.

  The protective transparent sheet is made of a material that transmits visible light and infrared light, such as vinyl, envipet, and polypropylene. When the dot pattern is repeatedly touched with the scanner, the dots are worn out, resulting in a problem that the dot pattern cannot be read accurately. Therefore, by providing a protective transparent sheet, it is possible to prevent dot wear and dirt and to use the sheet for a long period of time.

  The scanner includes an IR-LED that is an infrared irradiation unit, an IR filter that cuts a predetermined wavelength component of the reflected light, a C-MOS sensor that is an image sensor, and a lens. The scanner captures reflected light of the irradiation light irradiated on the grid sheet. As described above, since the dot pattern is printed with ink having a characteristic of absorbing infrared rays, only the dot portion is photographed black in the captured image by the C-MOS sensor.

  In this case, the reflection layer that is specularly reflected by the infrared reflection layer is photographed in a state where the reflected light is not incident on the lens and the center is black as shown in FIG. End up. Therefore, it is impossible to photograph the dot pattern without omission. Therefore, it is necessary to diffusely reflect infrared light and to enter the lens. That is, as shown in FIG. 3A, an infrared diffusion layer is provided between the dot pattern printing layer and the infrared reflection layer. This infrared diffusion layer is made of a transparent or translucent material. As a result, as shown in FIG. 5B, the infrared light irradiated from the IR-LED is specularly reflected by the infrared reflecting layer and diffused by the infrared diffusing layer, and the reflected light of all the imaging regions enters the lens.

  In the figure, the grid sheet is provided with an infrared diffusing layer. However, the present invention is not limited to this, and a filter made of an infrared diffusing material may be provided at the photographing port of the scanner.

  FIG. 4 is a cross-sectional view showing various structures of the grid sheet.

  FIG. 2A is a grid sheet that includes an infrared reflection layer that reflects infrared light and transmits visible light, and a dot pattern layer. As shown in the figure, the infrared rays irradiated from the infrared irradiation means are first absorbed by the portion of the dot pattern layer where the dots are formed (hereinafter referred to as the dot portion) and transmitted through the other regions. Next, the transmitted infrared ray is specularly reflected by the infrared reflection layer and passes through the dot pattern layer except for the dot portion.

  FIG. 2B is a grid sheet in which an infrared diffusion layer that transmits visible light and diffuses the infrared light is provided between the infrared reflection layer and the dot pattern layer. As shown in the figure, the infrared rays irradiated from the infrared irradiation means are first absorbed by the dot portion of the dot pattern layer and transmitted in other regions. Next, the transmitted infrared rays are diffused by the infrared diffusion layer, then specularly reflected by the infrared reflection layer, diffused again by the infrared diffusion layer, and transmitted through the dot pattern layer except for the dot portion.

  FIG. 4C shows a grid sheet in which an infrared diffusion layer that transmits visible light and diffuses infrared light is provided on one side of the dot pattern layer, that is, on the opposite side of the infrared reflection layer. As shown in the figure, the infrared rays irradiated from the infrared irradiation means are first diffused by the infrared diffusion layer, then absorbed by the dot portion of the dot pattern layer, and transmitted in other regions. Next, the transmitted infrared ray is specularly reflected by the infrared reflection layer, and is again transmitted through the dot pattern layer except the dot portion and diffused by the infrared diffusion layer.

  FIG. 4D shows a grid sheet including an infrared diffuse reflection layer having a characteristic of diffusing and reflecting infrared light from one surface side and transmitting visible light, and a dot pattern layer. As shown in the figure, the infrared rays irradiated from the infrared irradiation means are first absorbed by the dot portion of the dot pattern layer and transmitted in other regions. Next, the transmitted infrared light is diffusely reflected by the infrared diffuse reflection layer, and passes through the dot pattern layer except for the dot portion.

  FIG. 4E is a grid sheet in which a protective layer having a property of transmitting infrared light and visible light is provided on the outer surface of the grid sheet shown in FIG. By providing such a protective layer, it is possible to prevent the dots from being worn and soiled and to use the sheet for a long period of time.

  In addition, the protective layer may be provided not only on the figure (a) but on the dot pattern layer side outer surface of the grid sheet shown in (b) to (d).

  FIG. 5F is a grid sheet having a characteristic of reflecting infrared rays from the side opposite to the dot pattern layer in the grid sheet shown in FIG. By having such characteristics, it is possible to block infrared rays from a display screen or a screen on which the grid sheet of the present invention is mounted, and to use only infrared rays emitted from infrared irradiation means as irradiation light. Therefore, only a bright and clear dot pattern can be photographed, and the dot code can be analyzed accurately.

  Note that the grid sheets shown in (b) to (e) as well as (a) in the figure may have a characteristic of reflecting infrared rays from the side opposite to the dot pattern layer (the other side). .

  FIG. 4G is a grid sheet in which an adhesive layer is provided on the side opposite to the dot pattern layer of the infrared reflecting layer in the grid sheet shown in FIG. The adhesive layer is made of a removable material. The pressure-sensitive adhesive layer is necessary only when the grid sheet is used by being attached to a display device or a medium, and is not necessary when it is placed on a printed material or sandwiched as described later. By providing such an adhesive layer, the grid sheet can be easily attached to a display or the like.

  In addition, the adhesion layer may be provided in the anti-dot pattern layer side of the infrared reflective layer of the grid sheet shown by (b)-(e) as well as the figure (a).

  FIG. 5 shows another embodiment of the grid sheet. In this embodiment, a dot pattern layer is provided on both sides of the sheet.

  The figure (a) from the infrared reflective layer which has the characteristic which permeate | transmits visible light while reflecting the infrared rays to each surface in each direction, and the dot pattern layer provided on both surfaces of the infrared reflective layer, It is a grid sheet. Thereby, since the sheet can be used on both sides, convenience is improved.

  FIG. 4B is a grid sheet in which an infrared diffusion layer that transmits visible light and diffuses infrared light from each direction is provided between the infrared reflective layer and the dot pattern layer on each surface. It is.

  FIG. 4C shows a grid sheet in which an infrared diffusion layer is provided on the outer surface of the infrared reflection layer and the dot pattern layer on each surface.

  FIG. 4D is a grid sheet composed of an infrared diffuse reflection layer and dot pattern layers provided on both sides of the infrared diffuse reflection layer.

  The figure (e) is an information input auxiliary sheet in which a protective layer having a property of transmitting infrared light and visible light from each direction is provided on both outer surfaces of the grid sheet shown in the figure (a). is there.

  In addition, the protective layer may be provided not only on the same figure (a) but on both outer surfaces of the grid sheets shown in (b) to (d).

  The figure (f) is a grid sheet in which an adhesive layer is provided on each anti-dot pattern layer side of the infrared reflection layer, that is, both outer surfaces of the grid sheet, in the grid sheet shown in the figure (a). is there.

  In addition, the adhesion layer may be provided not only on the same figure (a) but on both outer surfaces of the grid sheets shown in (b) to (e).

  The description of each layer and the description of reflection in the grid sheets of FIGS. 9A to 9F are the same as those described above, and thus the description thereof is omitted here.

  In the grid sheet shown in the figure, different coordinate values and / or code values may be patterned in the dot pattern layer on one side and the other side of the infrared reflecting layer or infrared diffuse reflecting layer.

  In the grid sheets shown in FIGS. 4 to 5, text, illustrations, photographs, and the like may be superimposed and printed on the dot pattern layer or other layers with ink made of an infrared transmitting material or an infrared reflecting material.

<Description of dot pattern>
The dot pattern printed on such an information input auxiliary sheet will be described with reference to FIGS.

<Description of dot pattern GRID1>
6-11 is explanatory drawing which shows GRID1 which is an example of the dot pattern of this invention.

  In these drawings, vertical and horizontal grid lines are provided for convenience of explanation, and are not present on the actual print surface. The key dots 2, information dots 3, reference grid point dots 4 and the like constituting the dot pattern 1 are made of invisible ink or carbon ink that absorbs infrared light when the scanner as imaging means has infrared irradiation means. It is desirable that it is printed.

  FIG. 6 is an enlarged view showing an example of dot display information dots and bit display of data defined therein. FIGS. 7A and 7B are explanatory diagrams showing information dots arranged around key dots.

  The information input / output method using a dot pattern according to the present invention includes generation of a dot pattern 1, recognition of the dot pattern 1, and means for outputting information and a program from the dot pattern 1. That is, the dot pattern 1 is captured as image data by the camera, the reference grid point dot 4 is extracted first, and then the key dot 2 is extracted because the dot is not originally placed at the position where the reference grid point dot 4 is located. Next, the information dot 3 is extracted and digitized to extract an information area to digitize the information, and information and a program are output from the dot pattern 1 based on the numerical information. For example, information such as voice or a program is output from the dot pattern 1 to an information output device, a personal computer, a PDA, a mobile phone, or the like.

  The dot pattern 1 of the present invention is generated by arranging fine dots, that is, key dots 2, information dots 3, and reference grid point dots 4 according to a predetermined rule in order to recognize numerical information by a dot code generation algorithm. To do. As shown in FIG. 6, in the block of dot pattern 1 representing information, a 5 × 5 reference grid point dot 4 is arranged based on the key dot 2 and the center of the block surrounded by the four reference grid point dots 4 is arranged. Information dots 3 are arranged around the virtual grid point 5. Arbitrary numerical information is defined in this block. In the illustrated example of FIG. 6, a state is shown in which four blocks (inside the bold line frame) of the dot pattern 1 are arranged in parallel. Of course, the dot pattern 1 is not limited to four blocks.

When the dot pattern 1 is captured by the camera as the image data, the reference grid point dot 4 corrects distortion of the lens of the camera, imaging from an oblique direction, expansion / contraction of the paper surface, curvature of the medium surface, and distortion during printing. Can do. Specifically, a correction function (X _n , Y _n ) = f (X _n ′, Y _n ′) for converting the distorted four reference grid point dots 4 into the original square is obtained, and the same function is obtained. Then, the information dot 3 is corrected to obtain a correct information dot 3 vector.

  If the reference grid dot 4 is arranged in the dot pattern 1, the image data obtained by capturing the dot pattern 1 with the camera corrects the distortion caused by the camera. Even when the image data of the dot pattern 1 is captured by the camera, it can be accurately recognized. Even if the camera is tilted and read with respect to the surface of the dot pattern 1, the dot pattern 1 can be accurately recognized.

  As shown in FIG. 6, the key dot 2 is a dot in which four reference grid point dots 4 at the corners of the four corners of the block are shifted in a certain direction. The key dot 2 is a representative point of the dot pattern 1 for one block representing the information dot 3. For example, the reference grid point dots 4 at the corners of the four corners of the block of the dot pattern 1 are shifted upward by 0.1 mm. However, this numerical value is not limited to this, and can be changed according to the size of the block of the dot pattern 1.

  The information dot 3 is a dot for recognizing various information. The information dot 3 is arranged around the key dot 2 as a representative point, and the center surrounded by the four reference grid point dots 4 is set as a virtual grid point 5 and expressed as a vector using this as a starting point. Arranged at the end point. For example, the information dot 3 is surrounded by the reference grid point dot 4, and as shown in FIG. 7A, a dot 0.1 mm away from the virtual grid point 5 has a direction and length expressed by a vector. Therefore, it is rotated 45 degrees clockwise and arranged in 8 directions to represent 3 bits. Accordingly, 3 bits × 16 pieces = 48 bits can be expressed by one block of dot pattern 1.

FIG. 7B is a method of defining information dots 3 having 2 bits for each grid in the dot pattern of FIG. 6, and each 2-bit information is shifted by shifting the dots in the + direction and the x direction. Defined. Thus, although 48-bit information can be originally defined, data can be given every 32 bits by dividing according to usage. A maximum of 2 ¹⁶ (about 65000) dot pattern formats can be realized by combining the + direction and the X direction.

  Note that the present invention is not limited to this, and it is possible to represent 4 bits by arranging in 16 directions, and it is needless to say that various changes can be made.

  The diameter of the key dot 2, the information dot 3 or the reference grid point dot 4 is preferably about 0.05 mm in consideration of appearance, printing accuracy with respect to paper quality, camera resolution, and optimal digitization.

  Further, in consideration of a necessary amount of information with respect to the imaging area and misidentification of the various dots 2, 3, and 4, it is desirable that the interval between the reference grid point dots 4 is about 0.5 mm vertically and horizontally. In consideration of misrecognition of the reference grid point dot 4 and the information dot 3, the shift of the key dot 2 is preferably about 20% of the grid interval.

  The distance between the information dot 3 and the virtual grid point surrounded by the four reference grid point dots 4 is preferably about 15 to 30% of the distance between the adjacent virtual grid points 5. This is because if the distance between the information dot 3 and the virtual lattice point 5 is closer than this distance, the dots are easily recognized as a large lump and become unsightly as the dot pattern 1. On the contrary, if the distance between the information dot 3 and the virtual grid point 5 is longer than this distance, it is difficult to identify which of the adjacent virtual grid points 5 is the information dot 3 having the vector directivity. Because it becomes.

  As shown in FIG. 6, one dot pattern is a dot pattern composed of 4 × 4 block areas, and 2-bit information dots 3 are arranged in each block. FIG. 8 shows a dot code format of the information dot 3.

  As shown in FIG. 8, a parity check, a code value, an X coordinate, and a Y coordinate are recorded in one dot pattern.

  FIG. 9 shows an example of the information dot 3 and the bit display of the data defined therein, and shows another form.

  In addition, using two types of information dots 3 that are long and short from the virtual lattice point 5 surrounded by the reference lattice point dot 4 and eight vector directions, 4 bits can be expressed. At this time, it is desirable that the longer one is about 25 to 30% of the distance between adjacent virtual lattice points 5, and the shorter one is about 15 to 20%. However, it is desirable that the center interval between the long and short information dots 3 is longer than the diameter of these dots.

The information dot 3 surrounded by the four reference lattice point dots 4 is preferably one dot in consideration of appearance. However, when it is desired to ignore the appearance and increase the amount of information, one bit is assigned to each vector, and the information dot 3 is expressed by a plurality of dots, so that a large amount of information can be provided. For example, the vector of concentric eight directions, an information dot 3 surrounded by four points lattice dots 4 can represent information of 2 ^8, and 16 pieces of information dots of one block 2 ^128.

  FIG. 10 shows an example of information dot and bit display of data defined therein. (A) shows two dots, (b) shows four dots, and (c) shows five dots arranged. It is shown.

  FIG. 11 shows a modification of the dot pattern, where (a) is a six information dot arrangement type, (b) is a nine information dot arrangement type, (c) is a 12 information dot arrangement type, and (d). Is a schematic diagram of a 36 information dot arrangement type.

  A dot pattern 1 shown in FIG. 6 shows an example in which 16 (4 × 4) information dots 3 are arranged in one block. However, the information dots 3 are not limited to 16 pieces arranged in one block, and can be variously changed. For example, according to the amount of information required or the resolution of the camera, six information dots 3 (2 × 3) are arranged in one block (a), and nine information dots 3 in one block (3 × 3) Arranged (b), 12 (3 × 4) information dots 3 arranged in one block (c), or 36 (d) arranged 36 information dots 3 in one block.

<Description of dot pattern Direction dots>
Next, direction dots, which are other forms of dot patterns, will be described with reference to FIG.

  This dot pattern defines the direction of the dot pattern according to the shape of the block. In FIG. 12A, reference points 48a to 48e are first arranged. A shape indicating the direction of the block (here, a pentagon facing upward) is defined by a line connecting the reference points 48a to 48e. Based on this reference point, virtual reference points 48f, 48g, and 48h are arranged, and information dots 3 are arranged at vector end points having directions and lengths starting from this virtual reference point. In this way, in the same figure, the direction of the block can be defined by the way the reference points are arranged. The size of the entire block is also defined by the direction dot that defines the direction of the block.

  In FIG. 12A, the reference points 48 a to 48 e and the information dots 3 are all described as having the same shape, but the reference points 48 a to 48 e may be larger than the information dots 3. Further, the reference points 48a to 48e and the information dot 3 may have any shape as long as they can be identified, and may be a triangle, a quadrilateral or more polygons.

  FIG. 12B defines information depending on whether there is an information dot on the virtual lattice point of the block.

  In addition, FIG.12 (c) connects the block shown in Fig.12 (a) 2 each in the vertical and horizontal direction.

  13-18 is a figure explaining other embodiment of this invention. In this embodiment, a grid sheet is used on a printed material.

  FIG. 13 is a diagram showing a case where a grid sheet on which a dot pattern is printed only on one side is used.

  The user uses a grid sheet on a printed matter such as a book, magazine, or newspaper. Even if it is used for the page on the right side as shown in FIG. 11A, the user can use the sheet even if it is used for the page on the left side as shown in FIG. Use with the front side facing up.

  FIG. 14A is a front view showing the surface of the grid sheet. On the grid sheet, a dot pattern that means XY coordinates is printed on almost the entire area, and at the bottom, icons with numbers from 0 to 9 and characters “page input”, “decision”, and “stop” are written, A dot pattern that means a code value is overprinted. This icon is an icon for inputting an index for specifying a printed matter using a scanner.

  FIG. 2B is a longitudinal sectional view of the grid sheet. This grid sheet is configured from the back side as a layer of a protective transparent sheet, a transparent infrared diffuse reflection layer, a dot pattern + graphic printing layer, and a protective transparent sheet. Here, the graphic print layer is a visible print layer.

  FIG. 15 is a diagram showing a case in which a grid sheet having a dot pattern printed on both sides is used. In this case, the grid sheet can be used while being sandwiched. That is, when a grid sheet is used on the right page, the grid sheet is put on the right page as shown in FIG. Then, the side on which the icon is printed on the right side is up. Next, when the grid sheet is used for the left page, the grid sheet is turned to the left side with the grid sheet being sandwiched as shown in FIG. Then, the side on which the icon is printed on the left side is up. The icon is printed on both sides with ink.

  FIG. 16A is a front view showing the front surface of the grid sheet, and FIG. 16B is a front view showing the back surface. On the surface of the grid sheet, a dot pattern that means XY coordinates is printed on almost the entire area, and numbers from 0 to 9 and characters “page input”, “decision”, and “stop” are written on the right side. An icon and a dot pattern representing a code value are printed in a superimposed manner. This icon is an icon for inputting an index for specifying a printed matter using a scanner. On the back surface of the grid sheet, a dot pattern that means XY coordinates is printed on almost the entire area, and the same icon and dot pattern as the front surface are superimposed and printed on the left side.

  FIG. 3C is a cross-sectional view of the grid sheet. This grid sheet is constituted by a protective transparent sheet, a dot pattern + graphic print layer, an infrared diffuse reflection layer, a dot pattern + graphic print layer, and a protective transparent sheet from the back side.

  FIG. 17 is a diagram showing a system for displaying information on a display by a user touching a grid sheet.

  As shown in FIG. 5A, the user covers a printed sheet with a grid sheet and touches the grid sheet with a scanner. A central processing unit (CPU) in the scanner analyzes the dot pattern, converts it into coordinate values and / or code values, and transmits them to a personal computer via a USB cable. It should be noted that the central processing unit in the personal computer may be analyzed and converted into coordinate values and / or code values.

  The coordinate value means an XY coordinate value in the dot coordinate system. In addition, an index (page, title, etc.) for specifying the printed paper surface is input by touching the icon printed on the grid sheet, or the index code value input with the keyboard is, for example, the number of pages on the printed paper surface. I mean. Therefore, it is assumed that n pages are designated. If you set in advance a mask that specifies print information such as text, illustrations, and photos with XY coordinate values and multimedia information that corresponds to the mask number, the XY coordinates of the dot pattern of the grid sheet read by the scanner Based on the value, the central processing unit in the personal computer uses the dot coordinate-mask No. stored in the hard disk. Refer to the correspondence table ((b) in the figure). The table is provided for each page. In this embodiment, the dot coordinates of n pages-mask No. Refer to the correspondence table. Then, the touch position mask No. Is detected. For example, when the crossed portion shown in FIG. Is 1. Next, the page No. shown in FIG. -Mask No. References the multimedia information file correspondence table. In the table, page No. And mask No. A multimedia information file is registered correspondingly. For example, a web address is registered in the n-page mask 1, and a local drive and an execution file are registered in the n-page mask 2. From the table, page No. And mask no. Search and output multimedia information files corresponding to. That is, page No. Is n and mask no. Since 1 is 1, the Web page at the registered Web address is displayed.

  FIG. 18 is a diagram showing another form of a system for displaying information on a display by a user touching a sheet.

  In the figure, as an example, a case where a character “Tokyo” is touched in a printed matter in which “Tokyo” is described in a sentence will be described.

  As shown in the figure, touch the icon printed on the grid sheet and enter the index to identify the printed paper surface, or enter the index with the keyboard to identify the printed paper surface, and the user specifies the printed paper surface on the printed material. And touch the dot pattern of the part marked “Tokyo” with the scanner. Then, the central processing unit (CPU) in the scanner analyzes the dot pattern, converts it into coordinate values or / and code values, and dot XY coordinates, and transmits them to a personal computer via a USB cable. It should be noted that the central processing unit in the personal computer may be analyzed and converted into coordinate values and / or code values.

  The central processing unit (CPU) of the personal computer converts the printed paper surface ID and dot XY coordinates obtained as described above into DTPxy coordinates on the printing information (xy coordinates on the DTP surface which is the original data of the printed material).

  Next, the central processing unit (CPU) of the personal computer accesses the document management server via the network (NW). The document management server stores a DTP file corresponding to each printed sheet. The central processing unit (CPU) takes out the DTP file of the corresponding printed paper (for example, ID = n) from the document management server. Then, in the DTP file with ID = n, the DTP coordinate (xt, yt) closest to the touch position (x, y) is selected to specify “Tokyo”. The DTP coordinates (xt, yt) are the coordinates of the center position of the text area. When the DTP coordinates are searched, the dictionary server is accessed and a data file indicating the specified text, illustration, photo, etc. is searched. The dictionary server stores explanations corresponding to data files indicating text, illustrations, photographs, and the like, URLs, and related information such as multimedia information. The central processing unit (CPU) of the document management server searches for “Tokyo” from the dictionary server based on the program, and automatically transmits the related information to the personal computer via the network (NW). As a result, the explanation regarding “Tokyo” is output and displayed on the display of the personal computer.

  According to this, it is possible to display detailed explanations such as texts, illustrations, and photographs on the printed matter on the screen simply by placing the grid sheet on the printed matter and touching it with the scanner.

  Conventionally, text, illustrations, photographs, etc. and dot patterns are superimposed on a printed material, and the user touches the printed material with a scanner to output information corresponding to the touched character or the like. However, this method cannot handle a medium that has already been printed, and requires new printing. In the present invention, since a printed material is covered with a sheet, the existing printed material can be used. Further, since a single sheet can be used in common for a plurality of printed materials, convenience is enhanced.

  FIG. 19 is an explanatory diagram showing an embodiment in which a grid sheet is attached to a display, content specifying information touched with a scanner is recognized, and related information is automatically searched and output.

  In the figure, as an example, a case where a character “Tokyo” displayed on the display screen is touched will be described.

  As shown in the figure, a grid sheet is pasted on the display screen of the personal computer. The user touches the dot pattern of the portion displayed as “Tokyo” with the scanner. Then, the central processing unit (CPU) in the scanner analyzes the dot pattern, converts it into XY coordinates, and transmits it to the personal computer via the USB cable. The XY coordinates are XY coordinate values of the touch position in the dot coordinate system. In addition, you may analyze and convert into a coordinate value with the central processing unit in a personal computer.

  Next, the central processing unit (CPU) of the personal computer accesses the Web server of each content displayed on the display via the network (NW). Each content file is stored in the Web server. The central processing unit retrieves the displayed content file (HTML, XML, flash, etc.). Then, in the extracted content file, the XY coordinate value of the touch position in the dot coordinate system is converted into the xy coordinate value in the format information of the content such as HTML, XML, and flash.

  If the displayed content file is on a personal computer, it is not necessary to access the Web server and retrieve the content file.

  Next, the coordinate value (xt, yt) of the content specifying information such as text, illustration, or photograph displayed on the display closest to the touch position coordinate value (x, y) is searched. The coordinate values (xt, yt) of the content specifying information are the coordinates of the center position of the content specifying information. When the content identification information is recognized, various multimedia information such as audio information and image information corresponding to the content identification information such as a data file indicating the recognized text, illustration, photo, etc. is stored in an electronic dictionary or a multimedia corresponding beforehand. Search from the database where the information is set. The dictionary server stores content-related information such as explanations, URLs, and multimedia information corresponding to data files indicating text, illustrations, photographs, and the like. The central processing unit (CPU) retrieves “Tokyo” from the dictionary server, and automatically outputs the content related information to the personal computer via the network (NW). As a result, the explanation about “Tokyo” is displayed on the display of the personal computer.

  According to this, it is possible to display detailed explanations such as text, illustrations, and photos on the display by simply arranging the grid sheet on the display.

  FIG. 20 is a longitudinal sectional view of a grid sheet used in such an example. The grid sheet is composed of an adhesive layer, an infrared diffuse reflection layer, a dot pattern + graphic printing layer, and a protective transparent sheet from the back side.

  FIG. 21 is a diagram illustrating a case where a grid sheet is used in a front projector system.

  In this embodiment, a grid sheet is pasted and used on the screen. A predetermined image is projected and displayed on the screen by the projector. The projector is connected to a personal computer or a video distribution system (not shown). When a desired position on the screen is touched using a scanner connected to the personal computer, the dot pattern at that position is read into the scanner and the personal computer uses the scanner. Converted to coordinate values. A hard disk device or video distribution server of a personal computer refers to an index table in which coordinate values are associated with instructions, addresses, etc., and outputs multimedia information and operation instructions defined in the corresponding addresses.

  FIG. 22 shows an example using a rear projector panel, which is a system for projecting an image from the rear by a rear projector.

  A grid sheet is attached to the surface of the rear projector panel. The structure of the grid sheet is the same as that shown in FIG.

  A predetermined image is projected and displayed on the rear projector panel by the rear projector. The rear projector is connected to a personal computer or video distribution system (not shown), and when a desired position on the rear projector panel is touched using the scanner connected to the personal computer, the dot pattern at that position is read into the scanner. Are converted into coordinate values by a personal computer. A hard disk device or video distribution server of a personal computer refers to an index table in which coordinate values are associated with instructions, addresses, etc., and outputs multimedia information and operation instructions defined in the corresponding addresses.

  FIG. 23A shows an example in which a grid sheet is used for a mobile terminal. A grid sheet is attached to the display of the portable terminal. Then, the grid sheet is touched with a scanner connected by wireless or cable. Then, the dot pattern at that position is read into the scanner and converted into coordinate values in the scanner or portable terminal. In the memory of the portable terminal or in the portable dot code management server, an index table in which coordinate values are associated with commands or addresses is stored. The central processing unit in the portable terminal refers to the index table, and outputs multimedia information and an operation instruction specified by the corresponding address.

  FIG. 23B shows an example in which a grid sheet is used in the car navigation device.

  Thus, when used in a car navigation device, it is preferable that communication between the scanner and the car navigation device is performed by wireless communication using Bluetooth or the like. Further, the scanner may be connected to a mobile terminal and transmit data corresponding to the read dot pattern to the server via the mobile terminal network.

  Further, the car navigation shown in the figure may be used in combination with a map such as a tourist guide on which a dot pattern is printed.

  FIGS. 24 to 25 are diagrams illustrating an embodiment in which the grid sheet according to the present invention is used in the thin client system.

  A thin client is a generic term for a system in which a client terminal used by a user has only a minimum function, and resources such as application software and files are managed on the server side.

  As shown in FIG. 24, in this embodiment, a plurality of displays are connected to one server (information processing apparatus) via a network. As this display, various types of displays other than a general television monitor and a personal computer display which do not have a built-in CPU can be used. An information input auxiliary sheet is affixed on the display screen of each display. The server and each display are connected by a wired system or a wireless system such as RDP, USB, BNC (Bayonet Neil Concelman). The server and the scanner are connected by a wired method or a wireless method.

  When the user touches the dot pattern on the grid sheet with the scanner, the dot pattern at that position is read into the scanner and converted into XY coordinate values within the scanner. In the hard disk device of the server, an index table in which XY coordinate values are associated with commands or addresses is stored. The central processing unit of the server refers to the index table, and outputs multimedia information and an operation instruction specified by the corresponding address.

  In this way, by attaching a grid sheet on the display screen, touch panel format input is possible with a simple terminal system having only a display.

  In the dot pattern, a code value may be registered together with the XY coordinate value. The code value is for identifying each display. In this case, when the scanner reads the dot pattern, it transmits the code value and the XY coordinate value to the server (information processing apparatus). The server recognizes which display from the code value. Then, various multimedia information and / or operation instructions corresponding to each display are recognized, and output information is displayed on the display.

  In addition, XY coordinate values that uniquely identify the display may be printed on the dot pattern as a dot pattern. In this case, XY coordinates obtained by dividing a large area in advance are printed on the sheet, and this sheet is used separately for each display. That is, the XY coordinate values are different for each display. When the XY coordinate value read by the scanner is transmitted to the server (information processing apparatus), the server specifies which display is operated from the XY coordinate value. Then, various multimedia information output and / or operation instructions corresponding to each display are recognized, and the output information is displayed on the display.

  Further, as shown in FIG. 25, a sticker on which a code value for identifying each display is printed as a dot pattern may be attached to the display. The user touches the grid sheet after touching the seal. The server specifies which display is operated by the code value registered in the dot pattern of the seal. Next, the touch position of the user is recognized from the XY coordinate values transmitted from the dot pattern of the grid sheet, various multimedia information and / or operation instructions corresponding to each display are recognized, and output information is displayed on the display. To display. The seal may be made of the same material as that used for the adhesive sticker on paper on which a normal dot pattern is printed or the grid sheet of the present invention.

  By adopting the thin client system in this way, it is possible to use various types of displays other than a general television monitor and a personal computer display without a built-in CPU, and thus a system is provided at low cost. It becomes possible.

<Calibration>
FIG. 26 to FIG. 29 are diagrams for explaining calibration performed when the grid sheet is used.

  When the user touches the display or the printed material, the positional relationship between the display or the printed material and the grid sheet needs to be matched in order to output information that accurately reflects the instruction displayed at the touch position. . Therefore, calibration is performed to properly associate the coordinate system of the display or printed material with the coordinate system of the grid sheet.

  26 to 27 are diagrams illustrating a case where calibration is performed on the display screen of the display.

  FIG. 26 is a diagram illustrating a case where calibration marks are provided on the grid sheet.

  As shown in FIG. 5A, calibration marks are provided in the vicinity of the four corners on one side of the grid sheet. The calibration mark is not necessarily provided near the four corners, and may be provided at two or more corners or may be provided at the center. Moreover, you may provide in two or more corner parts and the center.

  As shown in FIG. 5B, the user moves the cursor to the calibration mark and left-clicks the mouse. The central processing unit of the personal computer recognizes the clicked position. Then, the display coordinate system and the grid sheet coordinate system are appropriately associated with each other. As a result, calibration is performed.

  In the figure, the calibration mark is formed on a detachable transparent seal. After the calibration is completed, the user peels off the seal from the grid sheet as shown in FIG.

  The calibration mark may be directly printed on the grid sheet in addition to the case where it is formed on the transparent sticker. Moreover, it is provided in a removable state on the grid sheet, and may be removed from the grid sheet after calibration is completed.

  FIG. 27 is a diagram illustrating a case where a calibration mark is displayed on the display screen of the display.

  As shown in FIG. 4A, calibration marks are displayed near the four corners of the display. Note that the calibration mark is not necessarily displayed near the four corners, and may be displayed at two or more corners, or may be displayed at the center. Moreover, you may display on both the corner part and center of 2 or more.

The user touches the grid sheet at the position where the calibration mark is displayed as shown in FIG. The scanner reads the dot pattern on the grid sheet and transmits it to the personal computer. The central processing unit of the personal computer recognizes the dot XY coordinates (X ₁ , Y ₁ ) of the touch position from the transmitted dot pattern, and performs calibration to properly associate the display coordinate system and the grid sheet coordinate system. Do.

  Note that the calibration mark is not displayed after the calibration is completed.

  28 to 29 are diagrams illustrating a case where calibration is performed on a printed material.

  FIG. 28 is a diagram illustrating a case where calibration marks are provided on both the printed material and the grid sheet for the printed material.

  As shown in FIG. 4A, calibration marks are printed in the vicinity of the four corners of the grid sheet and the printed material. Note that the calibration mark is not necessarily printed in the vicinity of the four corners, and may be printed in two or more corner portions.

  The user puts the grid sheet on the printed matter by matching both the calibration marks. As a result, calibration for properly associating the coordinate system of the printed material with the coordinate system of the grid sheet is performed.

  FIG. 29 is a diagram illustrating a case where a calibration mark is printed only on a printed material.

  As shown in FIG. 5A, calibration marks are printed in the vicinity of the four corners of the printed material. Note that the calibration mark is not necessarily printed in the vicinity of the four corners, and may be printed in two or more corner portions.

The user puts a grid sheet on the printed material. Then, the scanner is matched with the mark. The scanner reads the dot pattern on the grid sheet and transmits it to the personal computer. The central processing unit of the personal computer recognizes the XY coordinates (X ₁ , Y ₁ ) of the touch position from the transmitted dot pattern, and performs calibration to properly associate the coordinate system of the printed material and the coordinate system of the grid sheet. .

  By performing such calibration, the positional relationship between the coordinate position of the grid sheet and the image of the display or printed matter is matched, and information corresponding to the image or character touched by the user is output accurately. Become.

  In each of the above-described embodiments, when a grid sheet is used for a display screen or the like, it may be used by other methods such as using a grid sheet attached from the upper part of the display screen, in addition to being attached with an adhesive.

  The present invention can be used as a touch panel by sticking on a screen of any display such as a personal computer, PDA, bank ATM or the like. Moreover, by covering the printed material and outputting information related to the information described in the printed material on the screen, it can be used for a dictionary, a catalog of mail order, a learning material, and the like.

It is the figure which used the grid sheet (information input auxiliary sheet) concerning the present invention for the general-purpose computer system which is an information processor. It is sectional drawing (1) explaining a diffuse reflection. It is sectional drawing (2) explaining a diffuse reflection. It is sectional drawing which showed the various structures of the grid sheet. It is sectional drawing which showed the structure of the grid sheet | seat which provided the dot pattern layer on both surfaces. It is explanatory drawing which shows an example of the dot pattern of GRID1. It is an enlarged view which shows an example of the information dot of the dot pattern in GRID1. It is explanatory drawing which shows the format of the dot pattern in GRID1. It is an example of the information dot in GRID1 and the bit display of the data defined there, and shows another form. It is an example of the bit display of the information dot in GRID1 and the data defined there, (a) shows two dots, (b) shows four dots, and (c) shows five dots. . FIG. 6 shows a modification of a dot pattern in GRID1, where (a) is a six information dot arrangement type, (b) is a nine information dot arrangement type, (c) is an information dot twelve arrangement type, and (d) is It is the schematic of 36 information dots arrangement type. It is explanatory drawing which shows the dot pattern of a direction dot. It is the figure which showed the specific example which used the grid sheet | seat which has a dot pattern layer only on one side for printed matter. It is the front view and sectional drawing of a grid sheet used in FIG. It is the figure which showed the specific example which used the grid sheet | seat which has a dot pattern layer on both surfaces for printed matter. It is the front view and sectional drawing of a grid sheet used in FIG. It is the figure which showed the system for a user to touch a grid sheet and to display information on a display. It is the figure which showed the other form of the system for a user to touch a sheet | seat and to display information on a display. It is explanatory drawing shown about the Example which sticks a grid sheet | seat on a display, recognizes the content specific information touched with the scanner, and searches and outputs related information automatically. It is sectional drawing of the grid sheet stuck and used for a display. It is the figure shown about the case where a grid sheet is used for a projector system. It is the figure shown about the case where a grid sheet is used for a rear projector system. (A) is the figure shown about the case where a grid sheet is used for a portable terminal, (b) is the figure shown about the case where a grid sheet is used for a car navigation system. It is a block diagram of a thin client system using a grid sheet. It is the figure which showed an example of the display and sticker which are used for a thin client system. It is the figure explaining the grid sheet used for the calibration method and calibration with respect to a display. It is the figure explaining the other Example of the calibration method with respect to a display. It is the figure explaining the grid sheet used for the calibration method with respect to printed matter, and calibration. It is the figure explaining the other Example of the calibration method with respect to printed matter.

Explanation of symbols

1 dot pattern 2 key dot 3 information dot 4 reference grid point dot 5 virtual grid point 48a, 48b, 48c, 48d, 48e reference dot 48f, 48g, 48h virtual reference point

Claims (7)

An information input auxiliary sheet provided with a dot pattern to be used on a printed surface of a printed material or a display screen of the display is instructed by an optical reader , whereby an image or display on the printed surface of the printed material is displayed . In the information processing apparatus that outputs information related to a display object on the display screen, the position on the information input auxiliary sheet instructed by the optical reading device is displayed on an image on the print surface of the print object or on the display screen of the display. A calibration method that correctly corresponds to a display object ,
The display and the optical reading device are connected to the information processing device,
Wherein the information input help sheet, the used and disposed the display of the display screen, for a variety of multimedia information output and / or operation instructions, and the dots generated by a dot code generation algorithm accordance with a predetermined rule Has been placed,
The information processing apparatus displays a calibration mark at least temporarily in two or more corners and / or the center of the display,
Wherein when the optical reader Ru is matched to the mark, the by optical reader to read the dot pattern on the information input help sheet, wherein the information input help sheet on the coordinates of the position indicated by the optical reader A value is detected, and the detected coordinate value on the information input auxiliary sheet is converted into a coordinate value on the display of the mark matched with the optical reader, and this processing is performed for all the marks displayed on the display. By performing a coordinate conversion function or a coordinate conversion table for converting the coordinate value of the information input auxiliary sheet into the coordinate value of the display,
A calibration method in which the information processing apparatus converts a coordinate value of the information input auxiliary sheet that is subsequently read by the optical reading apparatus into a coordinate value of the display by the coordinate conversion function or the coordinate conversion table and inputs the coordinate value . An information input auxiliary sheet provided with a dot pattern to be used on a printed surface of a printed material or a display screen of the display is instructed by an optical reader , whereby an image or display on the printed surface of the printed material is displayed . In the information processing apparatus that outputs information related to a display object on the display screen, the position on the information input auxiliary sheet instructed by the optical reading device is displayed on an image on the print surface of the print object or on the display screen of the display. A calibration method that correctly corresponds to a display object ,
The optical reading device is connected to the information processing device,
Wherein the information input help sheet is used by covering onto the printed surface of the printed material, for a variety of multimedia information output and / or operation instructions, and the dots generated by a dot code generation algorithm accordance with a predetermined rule arrangement Has been
Calibration marks are printed at two or more corners of the printed matter,
Wherein the information processing apparatus, when the optical reader Ru is matched to the mark, the by optical reader to read the dot pattern on the information input help sheet, the information on the position indicated by the optical reader A coordinate value on the input auxiliary sheet is detected, and the detected coordinate value on the information input auxiliary sheet is converted into a coordinate value on the printed material of the mark matched with the optical reading device, and this processing is performed on the printed material. By performing all the printed marks, a coordinate conversion function or a coordinate conversion table for converting the coordinate value of the information input auxiliary sheet into the coordinate value of the printed matter is obtained,
A calibration method in which the information processing apparatus converts the coordinate value of the information input auxiliary sheet, which is subsequently read by the optical reading apparatus, into the coordinate value of the printed matter by the coordinate conversion function or the coordinate conversion table and inputs the coordinate value .   An information input auxiliary sheet used for the calibration according to claim 1. The information input auxiliary sheet is
Infrared reflective layer that reflects infrared light from one side and transmits visible light;
The infrared reflection layer is provided on one surface side, and dots composed of infrared absorption characteristic materials generated by a dot code generation algorithm are arranged according to a predetermined rule for various multimedia information output and / or operation instructions. A dot pattern layer,
The information input auxiliary sheet according to claim 3, comprising:   The information input auxiliary sheet according to claim 3 or 4, wherein the information input auxiliary sheet is provided with a guide mark for guiding a position to be read by the optical reading device in order to perform the calibration. The guide mark is formed in a detachable transparent seal, the calibration peelable claim 5, wherein the information input help sheet after the end of the seal from the information input help sheet. The guide mark is provided in a removable state on the information input auxiliary sheet,
The calibration information input help sheet according to claim 5, wherein the removed from the end after the information input help sheet.

Images