JP2007080241A - Information output device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve a medium excellent in convenience and its information output by defining a plurality of information in the same region of a dot pattern printed on a medium face such as a map, and selectively outputting the information according to an image pickup operation by an image pickup means. <P>SOLUTION: A dot pattern printed on a medium so as to be overlapped with a map or the like contains coordinate information and code information, so that the information corresponding to the coordinate information and the information corresponding to the code information can be selectively or redundantly output. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a medium on which a dot pattern is printed and an information output apparatus thereof.

  Conventionally, a map in which an identifier such as a barcode is provided on a map as a medium is known. In the car navigation device, position data such as latitude and longitude is recorded in the identifier on the map, and when the identifier is read by the reading means, it is registered as the destination by the car navigation device. Then, on the display of the car navigation device, the current location, the direction and distance to the destination, and the like are displayed (for example, see Patent Document 1).

Also, information corresponding to the identifier on the map is stored in a memory or a memory card of a computer, and when the identifier is read by the reading means, the information corresponding to the identifier is stored on an electronic device such as a computer or a mobile phone. There has also been proposed an information display method of being displayed. For example, a bar code is printed at a tourist attraction on a map, and when the bar code is read, an explanation of the sightseeing spot is displayed as a video (for example, see Patent Document 2).
JP-A-6-103498 JP 2004-54465 A

However, in Patent Document 1, the map displayed on the display of the navigation device cannot be enlarged or reduced, or even if there is a point other than the current location, the map cannot be displayed easily. There was a problem of lack of sex.
Moreover, in patent document 2, the information obtained from an identifier is limited to description of a facility etc., For example, even if it wants to obtain information about a map, such as a road around a facility, there is a problem that it cannot be obtained. there were.

  The present invention has been made in view of the above points, and by defining a plurality of information in the same area of a dot pattern printed on a medium surface such as a map, the information is obtained by an imaging operation or the like by an imaging means. A technical problem is to realize a convenient medium and information output by selectively outputting the information.

  The present invention employs the following means.

  That is, according to a first aspect of the present invention, an image pickup unit reads a dot pattern on the medium surface with respect to a medium on which a dot pattern based on a predetermined rule is printed in a superimposed manner with printing, and the image pickup unit An information output device comprising: a conversion unit that converts a captured image obtained from a code value or a coordinate value that means a dot pattern; and an output unit that outputs information corresponding to the code value or the coordinate value, At least one surface has a dot pattern obtained by patterning coordinate values and a dot pattern obtained by combining a dot pattern obtained by patterning code values, and the conversion unit includes the imaging unit. When the coordinate value is read from the dot pattern of the multiple information area on the medium surface, the conversion means reads the information based on the coordinate value from the storage means. Information is output from the output means and when the code value is read from the dot pattern on the multiple information area on the medium surface, the conversion means reads the information associated with the code value from the storage means and outputs from the output means It is.

  In this way, since a dot pattern in which a code value and a coordinate value are combined is printed in the dot pattern, for example, when the medium is a map, the symbol description value, image, Moving images, audio information, and the like can be output from a display device or speaker as output means, and a map image corresponding to the map and the coordinate values on the symbols can be output from the display device.

  Note that the coordinate value may include the Z coordinate in addition to the XY coordinate.

  In addition to the case where the entire medium surface is a multiple information area in which coordinate values and code values are printed, the entire medium surface is set as XY coordinates so that code information is included only in a certain area or symbol portion thereof. Also good.

  According to a second aspect of the present invention, information corresponding to the code value read from the dot pattern on the multiple information area is read from the storage means and output to the medium surface, or information corresponding to the coordinate value is read from the storage means and output. The information output device according to claim 1, wherein an icon graphic on which a dot pattern for switching a mode for switching is printed.

  In this way, by selectively printing information on the medium surface that can select whether to output information corresponding to the code value or to output information corresponding to the coordinate value, information can be selectively displayed using the imaging means. Can be output.

  For example, when the medium is a map, a “map icon” and an “information icon” are printed on the map, and when the “map icon” is imaged, the map coordinate value is read and the corresponding map is read. An image can be output from the display device. When an “information icon” is imaged, an explanatory text, an image, a moving image, a sound, or the like corresponding to the symbol on the map is output from an output unit such as a display device or a speaker. It is like that.

  In addition, the printing here includes not only direct printing on the medium surface but also an act of laminating a seal or a transparent film printed with a dot pattern on the medium surface.

  3. The information output apparatus according to claim 2, wherein the coordinate value on the medium surface includes at least an XY coordinate and a Z coordinate, and information corresponding to the XY and Z coordinates is stored in the storage means. It is.

  Thus, by including the Z coordinate as a coordinate value, it becomes possible to give the height of a mountain or hill, the depth of a sea, a lake, a pond, etc. as information on a map, for example.

  According to a fourth aspect of the present invention, on the medium surface, an icon graphic is further printed, in which code values for up / down / left / right movement for moving the image information output from the output means on the output means are superimposed and printed. An information output apparatus according to claim 1.

  By printing and arranging such icon figures, it is possible to easily move image information displayed on output means such as a display device.

  5. An icon graphic in which a code value for enlarging / reducing the image information output from the output unit on the output unit is further printed on the medium surface. It is an information output device.

  By printing and arranging such icon figures, image information displayed on output means such as a display device can be easily enlarged or reduced.

  According to a sixth aspect of the present invention, an image obtained by reading a dot pattern on the surface of the medium by an image pickup unit with respect to a medium on which a dot pattern based on a predetermined rule is printed in a superimposed manner with printing, is obtained from the image pickup unit. An information output device comprising conversion means for converting an image into a code value or coordinate value that means a dot pattern, and output means for outputting information corresponding to the code value or coordinate value. A medium on which a dot pattern in which values are patterned is superimposed and printed, and a multiple information area in which a dot pattern in which code values are patterned together with at least coordinate values is superimposed and printed on the medium surface, The imaging means reads the coordinate value and the code value from the dot pattern of the multiple information area on the medium surface, and the coordinate value and the code value from the storage means. Reading information corresponding to the respective outputs from the output means, the read operation of the dot pattern of the medium surface of the imaging unit, an information output device to switch the output information.

  Thus, since the output information can be switched by the reading operation of the dot pattern on the medium surface of the imaging unit, for example, the information output from the output unit can be switched by a simple operation on the medium surface of the imaging unit.

  More specifically, as described in claim 7, the switching of the output information is performed by switching whether the output information is a coordinate value or a code value, and among the read coordinates, an XY coordinate or an XYZ For example, switching of coordinates to be output, or resetting of output information.

  For example, a map is printed on the medium surface, a dot pattern in which coordinate values are patterned is printed on the map, and a symbol area in which code values are patterned together with the coordinate values is printed on the map. In this case, as the switching between the output information based on the coordinate value and the output information based on the code value, almost the same XY coordinate value or code value within a predetermined time by a grid tapping operation on the medium surface (symbol region) of the imaging means. Is read a plurality of times (claim 8), image information such as a map displayed on a display device as an output means, and explanatory information such as a tourist spot corresponding to a symbol area (character, image, sound, video, etc.) And switching.

  In addition, switching of output information within coordinate values refers to switching, enlargement / reduction, etc., of map image layers displayed on the output means (display device) by reading the medium surface (map coordinate values) of the image pickup means. Continuous switching, movement of the map screen in the X and Y directions, dynamic change of the landscape screen with the viewpoint moved in a 3D map, and the like.

  In addition, switching within the code value means that the description text, image, video, audio displayed on the output means (display device, speaker) by the reading operation of the medium surface (code value on the map symbol) of the imaging means. Switching can be mentioned.

Further, the reading operation of the medium surface of the imaging unit may be performed by recognizing the XY coordinate values read within a predetermined time as a substantially circular locus by a circular grid sliding operation. (Claim 9). Thus, the output information from the output means may be switched by performing an operation of drawing a circle on the medium surface by the imaging means.

  Further, the medium surface reading operation of the image pickup means is performed by recognizing the XY coordinate values read within a predetermined time as a substantially linear locus by a linear grid scroll operation on the medium surface of the image pickup means. (Claim 10).

  Further, as the reading operation of the medium surface of the image pickup means, the grid scratch operation of the image pickup means, that is, the locus of the XY coordinates read within a predetermined time may be recognized as a repetition of the locus on the short-distance straight line. Good (claim 11). Further, it may be performed by recognizing the grid tilting operation of the imaging means, that is, the inclination of the imaging optical axis with respect to the vertical line of the medium surface. In addition, the grid grinding operation of the imaging means, that is, the change in the tilt state of the imaging optical axis is recognized by rotating around the vertical line while maintaining a constant tilt of the imaging optical axis with respect to the vertical line of the medium surface. May be performed. The inclination of the imaging unit as described above can be recognized by the difference in brightness in the imaging field of view of the imaging unit.

  According to a twelfth aspect of the present invention, the medium is a map, and the output information is switched from the map to the information, the map layer is switched, the map is continuously enlarged or reduced, and the map display position is XY. 8. The information output device according to claim 6, wherein the information output device is continuous switching in a direction and switching of a line of sight. By selecting the map as the medium in this way, the image information (digital map) displayed on the display device as the output means can be variously changed.

  In addition, the medium is a map in which a dot pattern in which 3D map information based on XYZ coordinates is formed as a coordinate value is superimposed and printed, and the output information is the XYZ information with respect to the gazing point as viewed from the viewpoint. The 3D map image generated based on the above may be displayed on a display device as output means by continuously switching the gazing point, the angle, or the viewing angle.

  Further, the output information may be switched by continuously switching the viewpoint altitude and displaying a corresponding 3D map image on a display device as an output means.

  Accordingly, it is possible to display a 3D image in which the gaze point is fixed and the Z coordinate of the viewpoint is changed, or the gaze point itself is also changed in the Z direction.

  According to the present invention, a plurality of information is selectively defined in a dot pattern printed on a medium surface such as a map, and the information is selectively output by an imaging operation or the like by an imaging unit. Media and its information output can be realized.

(First embodiment Plan map)
1 to 22 show a first embodiment of the present invention.

  In this embodiment, a map is used as a medium. When a map is captured by a pen-type scanner (imaging means), a map and information corresponding to the captured content are displayed on a display device (monitor) that is an output means. It is like that. The display device displays an electronic map installed in a personal computer, and corresponding characters, graphics, sounds, moving images, and the like.

  FIG. 1 is a diagram showing a surface printing state of a map (medium) used in the present invention.

  The map according to the present invention includes an icon portion on which icons for instructing operations for performing various displays on the display device are printed, and a map portion on which roads, tracks, tourist facilities, and the like are printed. .

  A dot pattern indicating a code corresponding to an operation instruction is printed in the area of each icon in the icon portion. The dot pattern printed here will be described later. The icons are printed on the top and bottom of the map, respectively, and on the top are “Information”, “Map”, “GS Gas Station”, “Convenience Store”, “ATM Bank”, “Accommodation”, “Meals”, “Release” An icon is provided.

  Also, at the bottom, icons for "Up", "Right", "Down", "Left", and "Back" to move the electronic map, and "Enlarge" to change the size of the electronic map "Standard" and "Reduce" icons are printed.

  In the map portion, symbols for displaying tourist facilities and the like in addition to roads and tracks are printed. In the area of the map portion, a dot pattern that means XY coordinates corresponding to the position of the road or track is printed. In addition to the XY coordinates corresponding to the location of the facility, the symbol is overprinted with a dot pattern in which the facility information is encoded.

  FIG. 2 is an explanatory diagram showing the use state of the map.

  As shown in the figure, the map (medium) in the present invention is used in conjunction with an electronic device such as a personal computer and a pen-type scanner (imaging means). That is, a pen-type scanner is connected to a computer with a USB cable or the like. The user clicks (captures) an arbitrary position or symbol on the map portion or various icons printed on the icon portion using the scanner.

  An electronic map address is registered in the map mode icon. When the user clicks the map mode icon, the electronic map registered in the hard disk device of the personal computer is read out and displayed on the display.

  In FIG. 2, the scanner is connected to a computer. However, the present invention is not limited to this, and the scanner may be used in conjunction with another communication device such as a mobile phone or a PDA (Personal Data Assistant). .

  FIG. 3 is a hardware block diagram showing the configuration of the computer and the scanner.

  As shown in the figure, a personal computer is mainly composed of a central processing unit (CPU), a main memory (MM), a hard disk device (HD) connected by a bus, a display device (DISP) as output means, and input means. As a keyboard (KBD).

  A scanner serving as an imaging unit is connected via a USB interface (USB I / F).

  Although not shown, a printer, a speaker, and the like are connected as an output device in addition to the display device (DISP).

  The bus (BUS) is connected to a general-purpose network (NW) such as the Internet via a network interface (NW I / F), and includes electronic map data, character information, image information, audio information, video information, and a program. Etc. can be downloaded from a server (not shown).

  In the hard disk (HD), together with an operating system (OS), application programs such as a dot pattern analysis program used in the present embodiment, electronic map data, character information, image information, audio information, video information, various tables, etc. Is registered.

  The central processing unit (CPU) sequentially reads and executes application programs in the hard disk via the bus (BUS) and the main memory (MM), reads out the data, and outputs and displays it on the display device (DISP). The functions described in this embodiment are realized.

  Although not shown, the scanner includes an infrared irradiation means (red LED), an IR filter, and an optical imaging device such as a CMOS sensor and a CCD sensor, and functions to capture the reflected light of the irradiation light irradiated on the medium surface. have. Here, the dot pattern on the medium surface is printed with carbon ink, and portions other than the dot pattern are printed with non-carbon ink.

  Since the carbon ink has a characteristic of absorbing infrared light, only the dot portion is photographed black in the image captured by the optical image sensor.

  The captured image of the dot pattern read in this way is analyzed by a central processing unit (CPU) in the scanner, converted into a coordinate value or code value, and transmitted to a personal computer via a USB cable.

  The central processing unit (CPU) of the personal computer refers to the table indicating the received coordinate values or code values, and displays electronic map data, character information, image information, audio information, and moving image information corresponding to these on the display device (DISP). ) And a speaker (not shown).

  Next, a dot pattern used in the present invention will be described with reference to FIGS.

  FIG. 4 is an explanatory diagram showing GRID1, which is an example of the dot pattern of the present invention.

  In these drawings, vertical and horizontal grid lines are provided for convenience of explanation, and are not present on the actual print surface. The key dots 2, information dots 3, reference grid point dots 4 and the like constituting the dot pattern 1 are printed with carbon ink that absorbs infrared light when the scanner as imaging means has infrared irradiation means. It is desirable.

  FIG. 5 is an enlarged view showing an example of information dots of the dot pattern and bit display of the data defined therein. FIGS. 6A and 6B are explanatory diagrams showing information dots arranged around key dots.

  The information input / output method using a dot pattern according to the present invention includes generation of a dot pattern 1, recognition of the dot pattern 1, and means for outputting information and a program from the dot pattern 1. That is, the dot pattern 1 is captured as image data by the camera, the reference grid point dot 4 is extracted first, and then the key dot 2 is extracted because the dot is not originally placed at the position where the reference grid point dot 4 is located. Next, the information dot 3 is extracted and digitized to extract an information area to digitize the information, and information and a program are output from the dot pattern 1 based on the numerical information. For example, information such as voice or a program is output from the dot pattern 1 to an information output device, a personal computer, a PDA, a mobile phone, or the like.

  The dot pattern 1 according to the present invention is generated in accordance with a predetermined rule for fine dots, that is, key dots 2, information dots 3, and reference lattice point dots 4, in order to recognize information such as voice by a dot code generation algorithm. Arrange. As shown in FIG. 4, in the block of dot pattern 1 representing information, a 5 × 5 reference grid point dot 4 is arranged on the basis of the key dot 2 and the center of the center surrounded by the four reference grid point dots 4 is arranged. Information dots 3 are arranged around the virtual grid point 5. Arbitrary numerical information is defined in this block. In the illustrated example of FIG. 4, a state is shown in which four blocks (inside the bold line frame) of the dot pattern 1 are arranged in parallel. Of course, the dot pattern 1 is not limited to four blocks.

  One corresponding information and program can be output to one block, or one corresponding information and program can be output to a plurality of blocks.

  When the dot pattern 1 is captured as image data by the camera, the reference grid point dot 4 corrects distortion of the lens of the camera, imaging from an oblique direction, expansion / contraction of the paper surface, curvature of the medium surface, and distortion during printing. Can do. Specifically, a correction function (Xn, Yn) = f (Xn ′, Yn ′) for converting the distorted four reference grid point dots 4 into the original square is obtained, and the information dot 3 is obtained using the same function. Is corrected to obtain a correct vector of information dots 3.

  If the reference grid dot 4 is arranged in the dot pattern 1, the image data obtained by capturing the dot pattern 1 with the camera corrects the distortion caused by the camera. Even when the image data of the dot pattern 1 is captured by the camera, it can be accurately recognized. Even if the camera is tilted and read with respect to the surface of the dot pattern 1, the dot pattern 1 can be accurately recognized.

  As shown in FIG. 4, the key dot 2 is a dot in which four reference grid point dots 4 at the corners of the four corners of the block are shifted in a certain direction. The key dot 2 is a representative point of the dot pattern 1 for one block representing the information dot 3. For example, the reference grid point dots 4 at the corners of the four corners of the block of the dot pattern 1 are shifted upward by 0.2 mm. When the information dot 3 represents the X and Y coordinate values, the coordinate point is a position where the key dot 2 is shifted downward by 0.2 mm. However, this numerical value is not limited to this, and can be changed according to the size of the block of the dot pattern 1.

The information dot 3 is a dot for recognizing various information. The information dot 3 is arranged around the key dot 2 as a representative point, and the center surrounded by the four reference grid point dots 4 is set as a virtual grid point 5 and expressed as a vector using this as a starting point. Arranged at the end point. For example, the information dot 3 is surrounded by the reference grid point dot 4 and, as shown in FIG. 5, the dot 0.2 mm away from the virtual grid point 5 has a direction and a length expressed by a vector. Then, it is rotated 45 degrees clockwise and arranged in 8 directions to represent 3 bits. Accordingly, 3 bits × 16 pieces = 48 bits can be expressed by one block of dot pattern 1.

  In the illustrated example, 3 bits are expressed by arranging in 8 directions. However, the present invention is not limited to this, and 4 bits can be expressed by arranging in 16 directions. Of course, various changes can be made. is there.

  The diameter of the key dot 2, the information dot 3 or the reference grid point dot 4 is preferably about 0.1 mm in consideration of appearance, printing accuracy with respect to paper quality, camera resolution, and optimal digitization.

  In addition, in consideration of a necessary amount of information with respect to the imaging area and misidentification of the various dots 2, 3, and 4, the interval between the reference grid point dots 4 is preferably about 1 mm in the vertical and horizontal directions. In consideration of misrecognition of the reference grid point dot 4 and the information dot 3, the shift of the key dot 2 is preferably about 20% of the grid interval.

  The distance between the information dot 3 and the virtual grid point surrounded by the four reference grid point dots 4 is preferably about 15 to 30% of the distance between the adjacent virtual grid points 5. This is because if the distance between the information dot 3 and the virtual lattice point 5 is shorter than this distance, the dots are easily recognized as a large lump and become unsightly as the dot pattern 1. On the other hand, if the distance between the information dot 3 and the virtual grid point 5 is longer than this distance, it is difficult to determine which of the adjacent virtual grid points 5 is the information dot 3 having the vector directionality. Because it becomes.

For example, the information dot 3, as shown in FIG. 6 (a), the lattice spacing of placing the _{I 16} from _{I 1} clockwise from the block center is 1 mm, the 3 bits × 16 = 48 bits 4mm × 4mm Express.

In addition, it is possible to further provide sub-blocks having independent information contents in the block and not affected by other information contents. FIG. 6B illustrates this, and sub-blocks [I ₁ , I ₂ , I ₃ , I ₄ ], [I ₅ , I ₆ , I ₇ , I, which are composed of four information dots 3. ₈ ], [I ₉ , I ₁₀ , I ₁₁ , I ₁₂ ], [I ₁₃ , I ₁₄ , I ₁₅ , I ₁₆ ] are independent data (3 bits × 4 = 12 bits) developed into information dot 3 It has come to be. By providing sub-blocks in this way, error checking can be easily performed on a sub-block basis.

  It is desirable that the vector direction (rotation direction) of the information dots 3 is uniformly determined every 30 to 90 degrees.

  FIG. 7 is an example of the bit display of the information dot 3 and the data defined therein, and shows another form.

  In addition, using two types of information dots 3 that are long and short from the virtual lattice point 5 surrounded by the reference lattice point dot 4 and eight vector directions, 4 bits can be expressed. At this time, it is desirable that the longer one is about 25 to 30% of the distance between adjacent virtual lattice points 5, and the shorter one is about 15 to 20%. However, it is desirable that the center interval between the long and short information dots 3 is longer than the diameter of these dots.

The information dot 3 surrounded by the four reference lattice point dots 4 is preferably one dot in consideration of appearance. However, if it is desired to ignore the appearance and increase the amount of information, one bit is assigned to each vector, and the information dot 3 is expressed by a plurality of dots, so that a large amount of information can be provided. For example, the vector of concentric eight directions, an information dot 3 surrounded by four points lattice dots 4 can represent information of 2 ^8, and 16 pieces of information dots of one block 2 ^128.

  FIG. 8 shows an example of information dot and bit display of data defined therein. (A) shows two dots, (b) shows four dots, and (c) shows five dots arranged. It is shown.

  FIG. 9 shows a modification of the dot pattern, where (a) is a six-information dot arrangement type, (b) is a nine-information dot arrangement type, (c) is a twelve information dot arrangement type, and (d). Is a schematic diagram of a 36 information dot arrangement type.

  The dot pattern 1 shown in FIGS. 4 and 6 shows an example in which 16 (4 × 4) information dots 3 are arranged in one block. However, the information dots 3 are not limited to 16 pieces arranged in one block, and can be variously changed. For example, according to the amount of information required or the resolution of the camera, six information dots 3 (2 × 3) are arranged in one block (a), and nine information dots 3 in one block (3 × 3) Arranged (b), 12 (3 × 4) information dots 3 arranged in one block (c), or 36 (d) arranged 36 information dots 3 in one block.

  Next, FIG. 10 shows the relationship among the dot pattern, code value, and XY coordinate value printed on the map surface.

FIG. 10A shows a table of values defined in 32 bits from C _{0 to} C ₃₁ of this dot pattern. C ₀ -C ₇ the _{X-coordinate,} C 8 _{-C 15} is _{Y-coordinate,} the C 16 _{-C 27} is meant map _numbers, C 28 _{-C 30 parity, C 31} is XY map data, respectively.

C _{16 to} C ₂₇ are not limited to map numbers, but may be other codes (code values).

  These values are arranged in the lattice region shown in FIG.

  In this way, in this dot pattern, the X coordinate and the Y coordinate as well as the corresponding code information (code value) can be registered in the 4 × 4 lattice area. Specific code information can be given to the area portion together with the XY coordinates. With such a dot pattern format, text, image, video, and audio information corresponding to a symbol icon such as a building can be associated with information based on XY coordinates and output.

  FIG. 11 is a diagram illustrating an operation for enlarging or reducing the electronic map by clicking an icon displayed at the lower part of the icon portion.

  FIG. 11A is an operation performed on the map by the user, and FIG. 11B is a diagram showing an image displayed on the display device (monitor) when the operation is performed. As shown in (a), when the user clicks the “enlarge” symbol located at the lower part of the icon portion using the scanner, the imaging device captures a dot pattern printed on the symbol, and the captured image is It is analyzed by a central processing unit (CPU) built in the scanner, converted into a dot code (coordinate value or code value), and transmitted to a personal computer.

  The central processing unit (CPU) of the personal computer refers to the table in the hard disk device (HD) based on the dot code, and stores image data (here, enlarged data of the electronic map) corresponding to the dot code. ) Is read and displayed on the display device (monitor).

  The central processing unit (CPU) may perform display control of the display device (DISP) based on the dot code, and directly enlarge the map image data displayed on the display (monitor).

  In this way, the magnification of the electronic map on the display device (monitor) is enlarged as shown in FIG. Similarly, clicking on the “reduce” symbol reduces the magnification of the electronic map. Click the “Standard” symbol to return to the standard magnification.

  FIG. 12 is a diagram for explaining an operation of moving the map displayed on the display device (monitor) by clicking the icon displayed at the lower part of the icon portion.

  In the figure, when the “to the right” icon is clicked (imaged by a scanner), the central processing unit (CPU) of the scanner analyzes the dot pattern of the icon by an analysis program, and a dot code (coordinate value or code value). And convert it to a personal computer.

  The central processing unit (CPU) of the personal computer that has received the dot code refers to a table in the hard disk device (HD) based on the dot code, and stores image data (here, the corresponding dot code). Map data on the left and right sides of the coordinate position of the electronic map) is read and displayed on the display device (monitor).

  The central processing unit (CPU) may perform display control of the display device (DISP) based on the dot code, and directly move and draw the map image data displayed on the display (monitor).

  In the above embodiment, the image data displayed on the display device (DISP) is moved leftward on the screen with the “rightward” icon. However, the image data is moved in the opposite rightward direction. May be.

  Similarly, when the user clicks “left”, the screen is scrolled left (or right), when “up” is clicked, upward (or downward), and when “down” is clicked, scrolls downward (or upward). Clicking “Return” returns to the state before scrolling.

  FIG. 13 is a diagram for explaining an operation of scrolling the electronic map when the user clicks on the map.

  FIG. 13 is a diagram illustrating a case where the user clicks an arbitrary position such as a road or a river on the map. (A) is an operation performed on the map by the user, and (b) is a diagram showing an image displayed on the display device (monitor) when the operation is performed. For example, as shown in (a), when the user clicks on a road intersection using a scanner, the central processing unit (CPU) of the scanner analyzes the dot pattern using an analysis software program. This dot code is transmitted to the central processing unit (CPU) of the computer. The computer reads only the code representing the XY coordinates of the position among the dot codes. In this way, as shown in FIG. 5B, the scroll is performed so that the intersection is located at the center of the display.

  In the present invention, the clicked part is not limited to a road or a river, but may be a symbol on a map such as a gas station. When the user clicks on the symbol, the code representing the XY coordinates of the symbol is read and scrolled so that the symbol is positioned at the center of the display by the method described above.

  FIG. 14 is a diagram illustrating an operation of scrolling the electronic map by a grid drag operation.

  (A) is an operation performed on the map by the user, and (b) is a diagram showing an image displayed on the display when the operation is performed. Here, the grid drag operation refers to moving the scanner in a state where the scanner is brought into contact with the map portion. Here, the user first clicks the center of the intersection, and moves the scanner to the center of the map part without leaving the map part. Then, as shown in (b), the screen is scrolled so that the center of the intersection is located at the center of the display.

  By such an operation, the scanner first reads the coordinate value of the intersection, and the coordinate value read as the scanner moves changes.

  The coordinate values changing in this way are sequentially transmitted to the personal computer. The central processing unit (CPU) of the personal computer moves (scrolls) the electronic map displayed on the display device (monitor) based on the change in the coordinate values. As a result, in the present invention, the electronic map is scrolled so that the part clicked by the scanner is displayed in the center of the display.

  FIG. 15 is a diagram for explaining the facility search function.

  FIG. 15A is an operation performed on the map by the user, and FIG. 15B is a diagram showing an image displayed on the display device (monitor) when the operation is performed.

  When the user clicks one of the icons “GS”, “ATM”, “Accommodation” and “Meals” printed on the top of the map, an icon symbol indicating the facility corresponding to the symbol icon is displayed on the electronic map. The For example, as shown in (a), when the user clicks the “GS” icon, as shown in (b), a “GS” symbol indicating a gas station is displayed at the position where the gas station exists on the electronic map. . Similarly, when the user clicks the “ATM” icon, an icon indicating an ATM such as a bank is clicked, and when the user clicks an “accommodation” icon, a symbol indicating an accommodation facility such as a hotel or an inn is clicked. Then, a symbol indicating a restaurant or the like is displayed. Thereby, the user can easily know where the target facility is located.

  Here, the code value is printed as a dot pattern for each predetermined icon on the icons “GS”, “ATM”, “accommodation”, and “meal”, and the image sensor of the scanner reads the dot pattern as a captured image. Then, the central processing unit (CPU) of the scanner converts it into a code value based on the ROM analysis program, and transmits the code value to the personal computer.

  The central processing unit (CPU) of the personal computer searches the table based on the code value, and maps and displays a symbol image corresponding to the code value on the electronic map image displayed on the display (monitor).

  When the symbol is displayed on the electronic map and the user clicks again on the icon corresponding to the symbol, the symbol on the electronic map is deleted.

  FIG. 16 is a diagram illustrating the information mode.

  The information mode refers to a state in which information (characters, images, sounds, moving images, etc.) corresponding to symbols on the map portion is described.

  In the present embodiment, the map mode is set as the initial setting. In order to switch to the information mode, as shown in (a), the user first clicks the “information” icon at the top of the icon part. Thereby, the switching process from map mode to information mode is performed.

  Specifically, a predetermined code value is printed as a dot pattern on the “information” icon, and when the image sensor of the scanner reads the dot pattern as a captured image, the central processing unit (CPU) of the scanner reads the data in the ROM. The code value is converted based on the analysis program, and the code value is transmitted to the personal computer.

  The central processing unit (CPU) of the personal computer that has received the code value switches the display mode of the display (monitor) to the information mode.

  Next, the user clicks a symbol indicating a facility for which information is desired. For example, as shown in (a), a temple icon symbol is clicked. Thereby, the code value meaning the temple is transmitted to the personal computer. The central processing unit (CPU) of the personal computer that has received the code value of the temple searches the table based on the code value and displays information (characters, images, sounds, videos, etc.) corresponding to the code value ( Output from the monitor. Here, an image of the temple is displayed on the display, and a sound describing the temple is output from the speaker.

  FIG. 17 is a diagram illustrating a method for switching from the map mode to the information mode.

  As described with reference to FIG. 16, two types of icons “information” and “map” are printed on the upper part of the icon portion. However, in addition to clicking these icons, it is possible to switch modes by operating the scanner.

  (A) performs switching by a grid tapping operation. The grid tapping operation is an operation of hitting the map by moving the scanner up and down while standing the scanner in the vertical direction of the map. For example, when the user performs a grid tapping operation on a temple symbol, the map mode is switched to the information mode, and a temple image is displayed on the display (monitor).

  Specifically, the central processing unit (CPU) of the personal computer reads the substantially same XY coordinate information or code information a plurality of times within a predetermined time, so that the central processing unit (CPU) performs the grid tapping operation. Recognize what happened.

  (B) performs switching by a grid sliding operation. The grid sliding operation is an operation of sliding the scanner in a circle on the map. The user performs a grid sliding operation so as to surround the symbol. Thereby, switching from map mode to information mode is performed, and the image | video of a temple is displayed on a display (monitor).

  Specifically, the central processing unit (CPU) of the personal computer recognizes the XY coordinate information read within a predetermined time as a substantially circular locus by a circular grid sliding operation on the medium surface of the imaging means. Done by

  (C) performs switching by grid scratch operation. The grid scratch operation refers to an operation of moving the scanner a plurality of times so as to be scratched on the map. The user performs a grid scratch operation on the symbol. Thereby, switching from map mode to information mode is performed, and the image | video of a temple is displayed on a display (monitor).

  Specifically, it is performed by the central processing unit (CPU) of the personal computer recognizing the trajectory of the XY coordinates read within a predetermined time as a repetition (scratch) of a trajectory on a short-distance straight line.

  Note that the operation of the scanner for switching from the map mode to the information mode is not limited to the above-described embodiment. When the user performs an operation other than the above-described operations, the information mode may be switched.

  18A and 18B are diagrams for explaining an operation of scrolling the electronic map according to the orientation of the scanner (grid tilt operation). FIG. 18A is a diagram for explaining a user's operation. FIG. 18B is a diagram illustrating the inclination of the scanner with respect to the vertical direction. The figure explaining the case changed, (c) is the figure explaining the state scrolled on a display (monitor).

  The orientation of the scanner is the direction in which the frame buffer faces upward when taking an image. As shown in (a), the user sets the orientation of the scanner in the direction to be scrolled and clicks. Then, the position clicked by the user is scrolled in the direction indicated by the orientation of the scanner.

  In this case, the scroll distance of the electronic map is determined by the inclination of the scanner with respect to the vertical line of the map and the angle formed by the scanner and the map. In (b), (1) is a vertically standing state before the scanner is tilted, (2) is a state where it is tilted forward, (3) is a state where it is further tilted forward, and (4) is a state where it is tilted backward , (5) is a state where it is further tilted backward. The operation of tilting the scanner back and forth in this way is called grid tilt. In each case, (c) explains how to scroll on the display (monitor). It is assumed that the part clicked on the map part by the user is located at the center of the screen before the scanner is brought down. Then, when the scanner is tilted forward, the electronic map moves in parallel with the direction indicated by the orientation of the scanner. In addition, the moving speed and the moving distance increase as the arm is tilted deeper. On the other hand, when the scanner is tilted backward, the electronic map moves in a direction 180 degrees opposite to the direction indicated by the scanner direction, and as it is tilted forward, the moving speed and the moving distance increase as it is tilted deeper.

  FIG. 19 is a diagram for explaining an operation for scrolling a map displayed on a display (monitor) according to the inclination of the scanner with respect to the direction of the dot pattern, (a) is a diagram for explaining a user's operation, and (b). Is a diagram for explaining a case where the tilt of the scanner is changed with respect to the vertical direction, and (c) is a diagram for explaining a state of being scrolled on a display (monitor).

  The inclination of the scanner is an angle formed by the direction of the dot pattern described above and the scanner body. The electronic map is scrolled in the direction in which the scanner is tilted.

  The scrolling distance is determined by the depth at which the scanner is tilted. In (b), (1) is a vertically standing state before the pen is tilted, (2) is a forwardly tilted state, and (3) is a further forwardly tilted state. In each case, (c) explains how to scroll on the display (monitor). It is assumed that the part clicked on the map by the user is located at the lower right center of the screen before the scanner is brought down. When the scanner is tilted forward, the electronic map moves in parallel with the direction indicated by the orientation of the scanner. In addition, the moving speed and the moving distance increase as the arm is tilted deeper.

  The direction in which the scanner is tilted and the scroll direction of the electronic map on the display may be opposite to the above.

  FIG. 20 is a diagram illustrating the relationship between the tilt of the scanner and the angle at which the map on the display (monitor) is scrolled.

The dot pattern on the map is superimposed and printed in the same direction as the vertical direction of the paper. As shown in (a), the angle formed by the direction of the dot pattern and the direction of the scanner is α. Further, as shown in (b), when the user tilts the scanner, an angle formed by the scanner tilt and the scanner orientation is β. In this case, the electronic map moves in the direction of an angle γ formed by the dot direction and the scanner tilt. That is, the angle γ is
γ = α + β
It becomes.

  Note that the tilt of the scanner can be recognized by the difference in brightness in the imaging field, which will be described later.

  FIG. 21 is a diagram illustrating the operation of the scanner for enlarging the screen displayed on the display (monitor) by the grid grind operation.

  Grid grind is an operation that rotates the scanner. (A) is an operation performed on the map by the user, and (b) is a diagram showing an image displayed on the display (monitor) when the operation is performed. As shown in (a), when the user grids the scanner in the right direction, the electronic map is enlarged as shown in (b).

  Grid grinding is an operation of rotating the scanner, and grid grinding in the right direction is also referred to as “grid grinding light”.

  Specifically, the central processing unit (CPU) of the personal computer rotates the imaging optical axis around the vertical line while maintaining a constant inclination of the imaging optical axis with respect to the vertical line on the medium surface. This is done by recognizing changes.

  FIG. 22 is a diagram for explaining the operation of the scanner for reducing the screen displayed on the display (monitor) by the grid grind operation.

  (A) is an operation performed on the map by the user, and (b) is a diagram showing an image displayed on the display (monitor) when the operation is performed. As shown in (a), when the user grids the scanner in the left direction, the electronic map is reduced as shown in (b).

  Note that such grid grinding in the left direction is also referred to as “grid grind left”.

(Second embodiment 3D map)
FIG. 23 to FIG. 31 illustrate the display of a three-dimensional map when the electronic map is a three-dimensional map, which is the second embodiment of the present invention.

  Also in this embodiment, similarly to the planar map, the map on which the dot pattern is superimposed and printed is used in conjunction with an electronic device such as a computer. That is, when an arbitrary part on the map such as a mountain or a pond is clicked with a scanner, a stereoscopic image corresponding to the part is displayed on a display (monitor).

  FIG. 23 shows the relationship among the dot pattern, code value, and XYZ coordinate value printed on the map surface.

FIG. 23A shows a table of values defined in 32 bits from C _{0 to} C ₃₁ of the dot pattern. C ₀ -C ₇ the _{X-coordinate,} C 8 _{-C 15} is Y _coordinates, C 16 _{-C 23} are _{Z-coordinate,} C 24 _{-C 27} is a map _number, C 28 _{-C 30 parity, C 31} is XYZ map data Respectively.

C _{24 to} C ₂₇ are not limited to map numbers, but may be other codes.

  These values are arranged in the lattice region shown in FIG.

  FIG. 24 is a diagram illustrating an operation for changing the viewpoint by the grid grind operation described above.

  (A) is a diagram explaining the change of the viewpoint in (a) and (b) when (a) is rotated counterclockwise, (b) is when the scanner is rotated clockwise, and (c). is there.

In (c), Z is the altitude at the part clicked by the user. When the user clicks an arbitrary part, a landscape viewed from the part clicked by the user is displayed as a stereoscopic image on the display device (monitor). In this case, the viewpoint is Z + h ₁ which is the sum of the altitude and the height of the human eye, which is the standard viewpoint. As shown in (a), when the user rotates the scanner counterclockwise, the viewpoint rises to the position (1). Then, when it is rotated clockwise as shown in (b), the raised viewpoint is lowered.

  FIG. 25 and FIG. 26 are diagrams illustrating operations for chilling up and down the viewpoint depending on the orientation of the scanner.

  FIG. 25 is a diagram illustrating a user's operation on a map. As shown in (1), the user first places the scanner perpendicular to the map. Then, as shown in FIG. 26A, the image is displayed on the display (monitor) in the standard mode. When the user tilts the scanner forward as shown in FIG. 25 (2), the viewpoint moves downward with a movement that makes the human posture lean forward as shown in FIG. 26 (b). Also, as shown in FIG. 25 (3), when the scanner is tilted backward, the viewpoint moves upward so that the upper body of the person warps backward as shown in FIG. 26 (c).

  27 and 28 are diagrams illustrating an operation for changing the angle by tilting the scanner left and right.

  In FIG. 27A, (1) is a state in which the scanner is standing vertically with respect to the map, (2) is a state in which the scanner is tilted to the left side, and (3) is a state in which the scanner is tilted to the right side.

  In the case of (1), the three-dimensional map is displayed in the standard mode on the display (monitor). When the user tilts the scanner to the left as shown in (2), a screen with the viewpoint moved to the left is displayed as shown in FIG. As shown in (3), when the user tilts the scanner to the right, a screen with the viewpoint moved to the right is displayed as shown in FIG.

  29 and 30 are diagrams illustrating an operation for changing the magnification of the map displayed on the screen by the grid pump operation.

  The grid pump operation is an operation for quickly and repeatedly tilting the scanner forward or backward. Before the grid pump operation is performed, a screen similar to that taken with the standard lens of the camera is displayed on the display (monitor) as shown in FIG. When the user quickly and repeatedly tilts the pen forward as shown in FIGS. 29 (a) and 29 (1), the image is gradually enlarged as shown in FIG. Is displayed. Also, as shown in FIGS. 29 (a) and 29 (2), when the pen is quickly and repeatedly tilted backward, the angle of view gradually widens, and as shown in FIG. 30 (b), the screen shot with the wide lens is displayed. Is displayed.

  FIG. 31 is a diagram illustrating an operation of resetting the viewpoint operation by the grid tapping operation.

  The grid tapping operation is an operation of hitting the map by moving the scanner up and down while standing the scanner vertically.

  For example, as shown in (b), it is assumed that a screen in a state of being photographed with a wide lens is displayed at a position elevated to a high altitude by the grid pump operation described above. In this case, when the grid tapping operation is performed as shown in FIG. 31A, the standard mode is reset as shown in FIG.

  When the telephoto mode is set by the grid pump operation, the standard mode is similarly reset.

  Also, when the viewpoint is changed by the grid grind operation described in FIG. 24, the viewpoint is reset by performing the grid tapping operation.

  FIG. 32 shows another embodiment of the scanner.

  FIG. 32A shows a scanner fixed with a tripod-like tool. An opening is provided in the center of the tool, and rubber is formed around the opening. Insert the scanner into the opening. With such a structure, when the user performs an operation such as grid grinding, the scanner can be fixed, and the sensor unit can prevent the dot pattern other than the target dot pattern from being read. be able to.

  In (b), a scanner is fixed by installing a spring on a cup-shaped tool. Openings are provided in the upper and lower parts of the tool, and a plurality of springs are installed in the upper part. The scanner is used with this spring.

  When a user performs various operations using a scanner, the conventional scanner has a problem that the bottom part is shaken when rotated, and the dot pattern cannot be read accurately. With this structure, the bottom is fixed, and the dot pattern can be read accurately. In addition, the user can perform a smooth operation by using rubber or a spring.

  FIGS. 33 to 37 are diagrams illustrating a method of calculating the tilt direction when the scanner is tilted.

  About the inclination with respect to the vertical direction of the medium surface (map) of a scanner (imaging means), as shown in FIG.20 (b), it can recognize by the difference in the brightness in the imaging visual field of the said scanner.

  The inclination direction of the scanner means an angle between the scanner and the map as shown in FIG. Which direction the user tilts the scanner can be obtained by the following method.

  First, calibration is performed. As shown in FIG. 33B, the scanner is set up vertically with respect to the map, and the brightness of the cells 1 to 48 shown in FIG. (A) is an area around the scanner. The brightness at this time is assumed to be BL0 (i). i is the value of the measured cell. For example, the brightness of the cell No. 24 is displayed as BL0 (24).

  Two LEDs are installed inside the scanner. Therefore, even if the scanner is set up vertically with respect to the map, the brightness differs between cells near the LED and cells located away from the LED. Therefore, calibration is performed.

Next, the brightness when the scanner is tilted is measured. As shown in FIG. 34B, the brightness from the cell 1 to the cell 48 when the scanner is tilted in a certain direction is measured, and the brightness in the cell i is set to BL (i). Then, the difference between BL (i) and BL0 (i) in each cell is calculated. And
Max (BL0 (i) -BL (i))
Calculate

  When the scanner is tilted, the direction opposite to the tilted direction becomes dark. This is because the LED also tilts in the direction in which the scanner is tilted, so that the distance from the LED is longer in the direction opposite to the tilted direction. Therefore, as shown in FIG. 34B, the direction opposite to the cell where the difference is the maximum is the position where the scanner is tilted.

  As a result, the direction in which the scanner is tilted is determined.

  33 to 34 show a method of determining the inclination direction and the angle by performing calibration.

  First calibrate. First, the scanner is set up vertically with respect to the map, the brightness of the cells 1 to 48 shown in FIG. 33A is measured, and the brightness in the cell i is set to BL0 (i).

  Next, the scanner is tilted by 45 ° and made a round around the pen tip as shown in FIG. In this case, the brightness when the scanner comes to the position of cell i is BL45 (i). BL45 (i) from cell 1 to cell 48 is obtained. Calibration is completed by the above operation.

を求める。 Next, when the user tilts the scanner, the brightness from cell 1 to cell 48 is measured, and the brightness in cell i is set to BL (i), i = 1, n (= 48). And

Ask for.

は最大値となる。上述した如く、スキャナを傾けた方向と逆の方向が最も暗くなるため、この場合のセルｉの逆方向が、スキャナを傾けた方向となる。 Since BL0 (i) -BL45 (i) is constant, when the value of BL0 (i) -BL (i) is the largest, that is, when BL (i) is the smallest.

Is the maximum value. As described above, since the direction opposite to the direction in which the scanner is tilted becomes darkest, the reverse direction of the cell i in this case is the direction in which the scanner is tilted.

となる。 The angle at which the scanner is tilted is

It becomes.

となる。 In addition, although the above-described equation assumes that the angle θ is linear with respect to the brightness, strictly speaking, approximation can be further improved by approximating as follows using a trigonometric function or the like. This way the angle is

It becomes.

  FIG. 36 shows a method of measuring the tilt direction using a Fourier function.

  As shown in FIG. 35, eight cells 1 to 8 are used as measuring points, and the brightness of each cell is measured.

The sine function is
αj {sin (1/2) j−1 (θ−βj)}
It is represented by That is, there are two unknowns.

ただし、n=2m（nは測点の数）
で表される。 Accordingly, when there are n measurement points, there are n discrete points, so the sum of n / 2 sine functions is obtained, and this is the brightness BL (i) at the radius from the analysis center.
That is,

However, n = 2m (n is the number of stations)
It is represented by

  In this embodiment, since the number of measurement points is 8, n = 8. Therefore, by synthesizing four sine function expressions, α1 to α4 and β1 to β4 of Fourier series are obtained. Then, the brightness BL (i) at the radius from the analysis center is represented by the sum of four sine functions.

  From the above formula, the angle θ at which BL (i) becomes the minimum value is the darkest position, and the opposite direction of 180 ° is the direction in which the scanner is inclined.

  FIG. 37 shows a method of measuring the tilt direction by solving an nth-order equation.

The graph in FIG. 37 shows an n-order function. When an n-order function is used, the brightness BL (i) at the radius from the analysis center is
BL (i) = α1 (θ−β1) · α2 (θ−β2)... Αj (θ−βj)
However, j = n / 2, n = 2m
It is represented by

  As shown in FIG. 35, since there are eight measurement points in this embodiment, it is necessary to obtain eight solutions. Since one equation contains two unknowns αj and βj, four equations are solved to obtain α1 to α4 and β1 to β4.

  Thereby, the angle θ at which BL (i) is the minimum value is obtained. The position corresponding to the angle θ is the darkest position, and the direction opposite to 180 degrees is the direction in which the scanner is inclined.

  Note that the measurement method shown in FIGS. 36 and 37 cannot measure the inclination of the scanner with respect to the vertical line of the map. Therefore, by using in combination with the measuring method shown in FIGS. 33 to 34, it is possible to measure a specifically tilted angle.

  FIG. 38 is an explanatory diagram showing another embodiment of the facility search function described with reference to FIG.

  In this embodiment, when the user performs a grid drag operation, a specified range is determined based on the locus, and a facility or the like specified by the user is searched within the range.

  In (a), A is the start point and B is the end point. When the user drags from arbitrary A to B in the map portion, the coordinate values of A and B are recognized, and a rectangle or square having AB as a diagonal line becomes the designated range. After the grid drag operation is performed, when a facility icon to be searched for such as “GS” and “ATM” printed on the icon portion is clicked, only the facilities within the designated range are displayed.

  In (b), when the user drags from arbitrary A to B in the map portion, a circle having a radius of AB becomes the designated range. In (c), when the user draws an arbitrary shape such that the start point and the end point are the same, the shape becomes the designated range.

  FIG. 39 is an explanatory diagram showing a method of displaying a cross section by a grid drag operation in a three-dimensional map.

  (A) shows an operation performed by the user on the map, and (b) shows a screen displayed on the display (monitor) when the operation is performed. As shown in (a), the user performs a grid drag operation with A as the start point and B as the end point. Then, as shown in (b), a sectional view taken along the line segment AB is displayed on the display (monitor). Since the map has a Z coordinate as well as an XY coordinate as described in FIG. 23, the cross-sectional view can be easily generated based on the Z coordinate with respect to the XY coordinate in the line segment AB. This is because.

It is a front view of the planar map which is one Embodiment of this invention. It is explanatory drawing which shows the use condition of a map. It is a block diagram which shows the system configuration | structure of a scanner and a computer used in conjunction with a map. It is explanatory drawing which shows an example of a dot pattern. It is an enlarged view which shows an example of the information dot of a dot pattern. It is explanatory drawing which shows arrangement | positioning of an information dot. It is an example of the information dot and the bit display of the data defined there, showing other forms It is an example of the bit display of an information dot and the data defined there, (a) arranges two dots, (b) arranges four dots, and (c) arranges five dots. FIG. 6 shows a modification of a dot pattern, where (a) is a six information dot arrangement type, (b) is a nine information dot arrangement type, (c) is a 12 information dot arrangement type, and (d) is an information dot. It is a schematic diagram of 36 arrangement type. It is the figure explaining the format of the dot pattern in a plane map, (a) is explanatory drawing which showed the value defined by each dot with a table | surface, (b) is explanatory drawing which shows arrangement | positioning of each dot. It is a figure for demonstrating operation which expands / reduces the map displayed on a display apparatus (monitor) by clicking an icon part, (a) is a user's operation, (b) is (a). It is a figure explaining the screen on the display (monitor) in the case. It is a figure for demonstrating operation which scrolls the map on a display (monitor) by clicking an icon part, (a) is a user's operation, (b) is on a display (monitor) in the case of (a). FIG. It is a figure for demonstrating operation which scrolls the map on a display (monitor) by clicking the road of a map part, (a) is a user's operation, (b) is a display (monitor) in the case of (a). It is a figure explaining the upper screen. It is a figure for demonstrating operation which scrolls the map on a display (monitor) by clicking the symbol of a map part, (a) is a user's operation, (b) is a display (monitor) in the case of (a). It is a figure explaining the upper screen. It is a figure for demonstrating operation which displays a symbol on a display (monitor) by clicking an icon part, (a) is a user's operation, (b) is a display (monitor) in the case of (a). It is a figure explaining the upper screen. It is a figure for demonstrating information mode, (a) is a user's operation, (b) is a figure explaining the display screen on a display (monitor) in the case of (a). It is a figure for demonstrating operation for switching from map mode to information mode. It is a figure for demonstrating operation which scrolls the map on a display (monitor) by the direction of a scanner, (a) is a user's operation, (b) is the state which pushed down the scanner, (c) is the state of (b). It is a figure explaining the screen on the display (monitor) in the case. It is a figure for demonstrating operation which scrolls the map on a display (monitor) by the inclination of a scanner, (a) is a user's operation, (b) is the state which tilted the scanner, (c) is (b). It is a figure explaining the screen on the display (monitor) in the case. It is explanatory drawing which showed the relationship between the direction and inclination of a scanner, and the direction to scroll. It is a figure for demonstrating operation which expands the map on a display (monitor) by rotating a scanner, (a) is a user's operation, (b) is on a display (monitor) in the case of (a). It is a figure explaining the screen. It is a figure for demonstrating operation which reduces the map on a display (monitor) by rotating a scanner, (a) is a user's operation, (b) is on a display (monitor) in the case of (a). It is a figure explaining the screen. It is a figure for demonstrating the format of the dot pattern in the solid map which is other embodiment of this invention, (a) is explanatory drawing which showed the value defined by each dot with a table | surface, (b) is each dot It is explanatory drawing which shows arrangement | positioning. 3A and 3B are diagrams for explaining an operation of changing a viewpoint by rotating a scanner in a three-dimensional map, in which (a) and (b) are user operations, and (c) is a display in the cases of (a) and (b). It is a figure explaining the screen on (monitor). It is a figure for demonstrating operation which chills up and down a viewpoint, and is a figure explaining operation which a user performs. FIG. 26 is a diagram for describing operations for chilling up and down a viewpoint, and is a diagram illustrating a screen displayed on a display (monitor) when each operation of FIG. 25 is performed. It is a figure for demonstrating operation which changes a viewpoint to right and left, (a) is a user's operation, (b) is a figure explaining the screen on a display (monitor) in the case of (a). It is a figure for demonstrating operation which changes a viewpoint to right and left, and is a figure explaining the screen on a display (monitor) in the case of FIG. It is a figure for demonstrating operation which changes the mode of the screen on a display (monitor) by grid pump operation | movement, (a) is a user's operation, (b) is about the screen on the display (monitor) in standard mode. FIG. It is a figure for demonstrating operation which changes the mode of the screen on a display (monitor) by grid pump operation | movement, (a) is a telephoto mode, (b) is a case where it changes to a wide mode on a display (monitor). FIG. It is a figure for demonstrating operation which resets a viewpoint to a standard mode by a grid tapping operation | movement, (a) is a user's operation, (b) is a screen on the display (monitor) before operation, (C) is after operation. It is the figure explaining the screen on the display (monitor). It is explanatory drawing which shows other embodiment of the scanner used in order to perform various operation on a map. It is a figure for demonstrating the method to measure the direction and angle which inclined, when performing various operation by the inclination of a scanner. It is a figure for demonstrating the method to measure the direction and angle which inclined, when performing various operation by the inclination of a scanner. It is a figure for demonstrating the method to measure the direction inclined, when performing various operation by the inclination of a scanner. It is a figure for demonstrating the method to measure the direction inclined by using a Fourier function, when performing various operation by the inclination of a scanner. It is a figure for demonstrating the method to measure the direction which inclined by using n-order equation, when performing various operation by the inclination of a scanner. It is a figure for demonstrating the function which designates a range by grid drag operation and displays a symbol on a display (monitor). It is a figure for demonstrating the function to display a cut surface on a display (monitor) by grid drag operation.

Explanation of symbols

CPU Central processing unit MM Main memory USB I / F UFB interface HD Hard disk device DISP Display device (display means)
KBD keyboard NW I / F network interface NW network

Claims (14)

For media printed with a dot pattern based on a predetermined rule superimposed on printing
A conversion unit that reads the dot pattern on the medium surface by the imaging unit and converts the captured image obtained from the imaging unit into a code value or a coordinate value that means the dot pattern, and corresponds to the code value or the coordinate value An information output device comprising output means for outputting the information,
At least one surface has a multiple information area on which a dot pattern obtained by combining a dot pattern obtained by patterning coordinate values and a dot pattern obtained by patterning code values is printed,
When the imaging unit reads the coordinate value from the dot pattern of the multiple information area on the medium surface, the conversion unit reads the information based on the coordinate value from the storage unit and outputs the information from the output unit. When the code value is read from the dot pattern on the multiple information area, the conversion means reads the information associated with the code value from the storage means and outputs it from the output means.   On the medium surface, in order to switch whether information corresponding to the code value read from the dot pattern on the multiple information area is read out and output from the storage means or information corresponding to the coordinate value is read out from the storage means and output. The information output device according to claim 1, wherein an icon graphic on which a dot pattern for switching the mode is printed.   3. The information output apparatus according to claim 2, wherein the coordinate value on the medium surface includes at least an XY coordinate and a Z coordinate, and information corresponding to the XY and Z coordinates is stored in the storage unit.   An icon figure printed by patterning code values for moving up, down, left, and right for moving image information output from the output unit on the output unit is further printed on the medium surface. 1. The information output device according to 1.   2. The information output according to claim 1, wherein an icon graphic is further printed on the medium surface in which a code value for enlarging / reducing the image information output from the output means on the output means is patterned. apparatus. For media printed with a dot pattern based on a predetermined rule superimposed on printing
A conversion unit that reads the dot pattern on the medium surface by the imaging unit and converts the captured image obtained from the imaging unit into a code value or a coordinate value that means the dot pattern, and corresponds to the code value or the coordinate value An information output device comprising output means for outputting the information,
A medium in which a dot pattern in which coordinate values are patterned is superimposed and printed on at least one surface;
A multi-information area on which dot patterns obtained by patterning code values together with at least coordinate values are superimposed and printed on the medium surface;
The converting means reads out the coordinate value and code value from the dot pattern of the multiple information area on the medium surface, reads out the information corresponding to each of the coordinate value and code value from the storage means, and outputs the information Output from the means,
An information output device for switching output information by a dot pattern reading operation on a medium surface of the imaging means.   The switching of the output information includes switching whether the output information is a coordinate value or a code value, switching whether to output XY coordinates or XYZ coordinates among the read coordinates, or resetting the output information The information output device according to claim 6.   8. The output information is switched by reading substantially the same XY coordinate value or code value a plurality of times within a predetermined time by a grid tapping operation on the medium surface of the image pickup means. The information output device described.   The output information is switched by recognizing an XY coordinate value read within a predetermined time as a substantially circular locus by a circular grid sliding operation on the medium surface of the image pickup means. The information output device described.   8. The output information is switched by recognizing an XY coordinate value read within a predetermined time as a substantially linear locus by a linear grid scroll operation on the medium surface of the imaging means. The information output device described.   7. The output information switching is performed by recognizing a trajectory of XY coordinates read within a predetermined time as a repetitive trajectory on a short distance line by a grid scratch operation on a medium surface of an imaging unit. Or the information output device of 7.   The medium is a map, and the output information is switched from the map to the information, the map layer is switched, the map is continuously enlarged or reduced, and the map display position is continuously changed in the XY directions. The information output device according to claim 6 or 7, wherein the information output device is a simple switching or a line of sight switching.   The medium is a map on which a dot pattern obtained by patterning 3D map information with XYZ coordinates as coordinate values is superimposed and printed, and the output information is generated based on the XYZ information with respect to a gazing point viewed from a viewpoint. The information output device according to claim 6 or 7, wherein the 3D map image is displayed on a display device as an output means by continuously switching a gazing point, an angle, or a viewing angle. 14. The information output apparatus according to claim 13, wherein the output information is switched by continuously switching the altitude of the viewpoint and displaying a corresponding 3D map image on a display device as output means.

Images