JP2009080504A - Print output processing methods - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a highly convenient medium capable of defining multiple pieces of information in one area of a dot pattern printed on a map, or the like, thereby selectively outputting the pieces of information by imaging operations, or the like, using an imaging means, and to attain its information output. <P>SOLUTION: The print output processing method for obtaining a printed map capable of inputting information from a displayed electronic map comprises a step to download electronic map data stored in a server and having latitude/longitude information and display the data on a display device as an electronic map; a step to accept the printing instruction of the displayed electronic map; a step of making at XY coordinates correspond to the electronic map, when the printing instruction is accepted; a step to correlate a map number imparted on the basis of the print instruction, latitude and longitude of the center of printing, and the reduction scale with each other and store them in a storage means and include the XY coordinates and the map number in the dot pattern; and a step of adding the dot pattern to the electronic map and perform print output processing. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a medium printed with a dot pattern and a print output processing method thereof.

  Conventionally, a map in which an identifier such as a barcode is provided on a map as a medium is known. In the car navigation device, position data such as latitude and longitude is recorded in the identifier on the map, and when the identifier is read by the reading means, it is registered as the destination by the car navigation device. Then, on the display of the car navigation device, the current location, the direction and distance to the destination, and the like are displayed (for example, see Patent Document 1).

  Also, information corresponding to the identifier on the map is stored in a memory or a memory card of a computer, and when the identifier is read by the reading means, the information corresponding to the identifier is stored on an electronic device such as a computer or a mobile phone. There has also been proposed an information display method of being displayed. For example, a bar code is printed at a tourist attraction on a map, and when the bar code is read, an explanation of the sightseeing spot is displayed as a video (for example, see Patent Document 2).

JP-A-6-103498 JP 2004-54465 A

  However, in Patent Document 1, the map displayed on the display of the navigation device cannot be enlarged or reduced, or even if there is a point other than the current location, the map cannot be displayed easily. There was a problem of lack of sex.

  Moreover, in patent document 2, the information obtained from an identifier is limited to description of a facility etc., For example, even if it wants to obtain information about a map, such as a road around a facility, there is a problem that it cannot be obtained. there were.

  The present invention has been made in view of the above points, and by defining a plurality of information in the same area of a dot pattern printed on a medium surface such as a map, the information is obtained by an imaging operation or the like by an imaging means. It is a technical problem to realize a convenient medium, information output thereof, and print output of such a medium by selectively outputting.

  The present invention employs the following means.

  (1) In the print output processing method according to the present invention, electronic map data having latitude / longitude information stored in a server is downloaded and displayed as an electronic map on a display device; and displayed on the display device A step of accepting a print instruction for the electronic map; a step of associating at least XY coordinates with the electronic map when the print instruction is accepted; a map number assigned based on the print instruction; Storing the latitude and longitude and the scale in association with each other in the storage means, including the XY coordinates and the map number in the dot pattern, and adding the dot pattern to the electronic map and performing print output processing; In order to obtain a printed map in which information can be input from a displayed electronic map.

  (2) An information output apparatus according to the present invention reads a dot pattern on the medium surface by an imaging unit with respect to a medium on which a dot pattern based on a predetermined rule is printed and superimposed with printing. An information output device including a conversion unit that converts a captured image obtained from an imaging unit into a code value or coordinate value that means a dot pattern, and an output unit that outputs information corresponding to the code value or coordinate value. The conversion unit has a medium printed with a dot pattern in which coordinate values are patterned on at least one surface, and the imaging unit reads the coordinate value from the dot pattern printed on the medium surface and stores it. The information corresponding to the coordinate value is read from the means and output from the output means, and the grid tilt repeated tapping operation of the image pickup means, that is, the dot on the medium surface. By recognizing the pattern twice or more continuously, the XY coordinates at the time of imaging are captured, and then based on the difference from the XY coordinates after sliding when the imaging means is slid on the medium surface. The direction of movement and the amount of movement are determined, and the movement of the electronic map displayed on the display screen is controlled.

  Here, the grid tilt means an operation of tilting the scanner back and forth, and the position on the map can be specified by this operation. Further, the position on the map may be specified by repeated tap operations. In short, the grid tilt / repeated tap operation means that the dot pattern on the map (on the medium surface) is recognized twice or more by operating the scanner on the map.

  (3) In the information output device according to the present invention, the conversion means recognizes the grid tapping operation of the imaging means by the imaging means continuously changing the brightness of the reflected light from the medium surface, and the code value or Coordinate values may be recognized.

  As described above, in order to recognize the tapping operation, it is not always necessary for the imaging unit to read the coordinate value first, and the imaging unit is tapped on the medium surface due to the continuous change in brightness of reflected light from the medium surface. I can recognize that. Note that when the tapping operation is completed, the imaging unit stops on the medium surface. At that time, the dot pattern on the medium surface may be read to read the coordinate value or code value.

  (4) In the information output device according to the present invention, the electronic map information defined by the latitude and longitude downloaded from the server or read from the storage medium via the network is displayed on the display device. The predetermined position is designated by the designation means, the latitude / longitude designated by the designation means is stored in the storage means, and the medium surface of the medium on which the dot pattern in which the XY coordinate values are patterned on at least one surface is printed by the imaging means. An image is picked up, a dot pattern is extracted from the picked-up image, the dot pattern is analyzed by an analysis unit and converted into an XY coordinate value, the XY coordinate value obtained by the analysis unit, and the latitude / longitude on the electronic map Is stored in the previous storage means, and when the dot pattern on the medium is imaged, the storage means is accessed to access the dot pattern. It may be displayed on the display means, electronic map information about the latitude and longitude associated with the XY coordinate values obtained from the turn.

  (5) In the information output device according to the present invention, the storage unit stores an address where feature information existing as a symbol on an electronic map is registered in association with a latitude / longitude indicating the position. It may be characterized by being.

  (6) In the information output device according to the present invention, the electronic map information defined by the latitude and longitude downloaded from the server or read from the storage medium via the network is displayed on the display device. The predetermined position is designated by the designation means, the latitude / longitude designated by the designation means is stored in the storage means, and at least the dot pattern obtained by patterning the XY coordinate values corresponds to the XY coordinate values on the map medium printed. It is stored in the storage means in association with the latitude / longitude of the electronic map information, and is pasted at the position of the XY coordinate value on the map medium as a symbol of the medium on which the dot pattern in which the code value is patterned on at least one surface is printed. The dot pattern on the medium surface is picked up by the image pickup means, the dot pattern is extracted from the picked-up image, and the dot pattern is extracted. The analysis means converts the code value into a code value, the code value obtained by the analysis means, the latitude / longitude, and the XY coordinate value are associated with each other and stored in the previous term storage means, and the medium When the upper dot pattern is imaged, the electronic map information may be displayed on the display means centering on the latitude / longitude associated with the code value obtained from the dot pattern by accessing the storage means. .

  (7) In the information output device according to the present invention, the storage unit stores an address where feature information existing as a symbol on the electronic map is registered in association with the latitude / longitude indicating the position. It may be characterized by being.

  (8) The print output control means according to the present invention displays electronic map information defined by latitude and longitude downloaded from a server or read from a storage medium via a network on a display device, and the electronic map information The latitude / longitude indicating the upper position is converted into XY coordinate values according to a predetermined scale, the XY coordinate values and the latitude / longitude are stored in the storage means in association with each other, and the electronic map is printed on the medium printed according to the scale. A dot pattern obtained by patterning the XY coordinate value as a dot code is superimposed and printed.

  (9) In the print output control means according to the present invention, the map area is associated with the XY coordinates of the map area in a different area from the map area on which the dot pattern in which the XY coordinate values are patterned as dot codes is superimposed and printed. A map number area on which a patterned dot pattern having latitude and longitude information as dot codes is printed may be printed.

  (10) In the print output control means according to the present invention, the latitude and longitude of the center of the map information may be printed as a dot pattern in the map number area.

  (11) In the print output control means according to the present invention, scale information may also be printed as a dot pattern on the map symbol.

  (12) In the print output control means according to the present invention, in order to display the electronic map information from the captured image from a server via a network or to display it on a display read from the storage means, The longitude and the scale are stored as dot codes in the storage means, and a dot pattern obtained by repeatedly patterning the dot codes is superimposed on a map icon printed on the medium surface to guide imaging by the imaging means. May be.

  (13) In the print output control unit according to the present invention, the storage unit stores an address in which the feature information existing as a symbol of the electronic map information is registered in association with the latitude / longitude indicating the position, A code for identifying the symbol from the captured image or a feature information code defined by the latitude / longitude is stored in the storage means as a dot code, and the X and Y coordinate values are recorded on the symbol of the electronic map information to be printed. A dot pattern in which dot codes are repeatedly patterned may be superimposed and printed.

  (14) In the print output control means according to the present invention, in the storage means, an address in which attribute information of an area divided on the electronic map is registered is an attribute code indicating the attribute and a representative point in the divided area. On the electronic map to be stored in association with the latitude / longitude indicating the position, the code for identifying the divided area from the captured image or the attribute code defined by the latitude / longitude is stored in the storage means as a dot code and printed In this divided area, a dot pattern obtained by repeatedly patterning the dot code together with the X and Y coordinate values may be superimposed and printed.

  (15) In the print output control means according to the present invention, the position of the representative point in the divided area may be a latitude / longitude obtained from the centroid of the divided area.

  (16) In the print output control means according to the present invention, different inks that can distinguish the ink for printing the electronic map and the ink for printing the dot pattern may be used on the medium surface.

  (17) In the print output control means according to the present invention, the different distinguishable inks may be two or more inks having different frequency characteristics for enabling discrimination between a dot pattern and other printing.

  (18) In the print output control means according to the present invention, the different distinguishable inks are an ink that absorbs light of an arbitrary frequency and an ink that reflects so that the dot pattern and other prints can be distinguished. It may be.

  (19) In the print output control means according to the present invention, the distinguishable different inks are inks having at least one invisible ink and having a light absorption characteristic for enabling discrimination between a dot pattern and other printing. There may be.

  According to the present invention, a plurality of information is selectively defined in a dot pattern printed on a medium surface such as a map, and the information is selectively output by an imaging operation or the like by an imaging unit. Media and its printed output can be realized.

It is a front view of the planar map which is one Embodiment of this invention. It is explanatory drawing which shows the use condition of a map. It is a block diagram which shows the system configuration | structure of a scanner and a computer used in conjunction with a map. It is explanatory drawing which shows an example of a dot pattern. It is an enlarged view which shows an example of the information dot of a dot pattern. It is explanatory drawing which shows arrangement | positioning of an information dot. It is an example of the information dot and the bit display of the data defined there, showing other forms It is an example of the bit display of an information dot and the data defined there, (a) arranges two dots, (b) arranges four dots, and (c) arranges five dots. FIG. 6 shows a modification of a dot pattern, where (a) is a six information dot arrangement type, (b) is a nine information dot arrangement type, (c) is a 12 information dot arrangement type, and (d) is an information dot. It is a schematic diagram of 36 arrangement type. It is the figure explaining the format of the dot pattern in a plane map, (a) is explanatory drawing which showed the value defined by each dot with a table | surface, (b) is explanatory drawing which shows arrangement | positioning of each dot. It is a figure for demonstrating operation which expands / reduces the map displayed on a display apparatus (monitor) by clicking an icon part, (a) is a user's operation, (b) is the case of (a) It is the figure explaining the screen on the display (monitor) in. It is a figure for demonstrating operation which scrolls the map on a display (monitor) by clicking an icon part, (a) is a user's operation, (b) is on a display (monitor) in the case of (a). FIG. It is a figure for demonstrating operation which scrolls the map on a display (monitor) by clicking the road of a map part, (a) is a user's operation, (b) is a display (monitor) in the case of (a). It is a figure explaining the upper screen. It is a figure for demonstrating operation which scrolls the map on a display (monitor) by clicking the symbol of a map part, (a) is a user's operation, (b) is a display (monitor) in the case of (a). It is a figure explaining the upper screen. It is a figure for demonstrating operation which displays a symbol on a display (monitor) by clicking an icon part, (a) is a user's operation, (b) is a display (monitor) in the case of (a). It is a figure explaining the upper screen. It is a figure for demonstrating information mode, (a) is a user's operation, (b) is a figure explaining the display screen on a display (monitor) in the case of (a). It is a figure for demonstrating operation for switching from map mode to information mode. It is a figure for demonstrating operation which scrolls the map on a display (monitor) by the direction of a scanner, (a) is a user's operation, (b) is the state which pushed down the scanner, (c) is the state of (b). It is a figure explaining the screen on the display (monitor) in the case. It is a figure for demonstrating operation which scrolls the map on a display (monitor) by the inclination of a scanner, (a) is a user's operation, (b) is the state which tilted the scanner, (c) is (b). It is a figure explaining the screen on the display (monitor) in the case. It is explanatory drawing which showed the relationship between the direction and inclination of a scanner, and the direction to scroll. It is a figure for demonstrating operation which expands the map on a display (monitor) by rotating a scanner, (a) is a user's operation, (b) is on a display (monitor) in the case of (a). It is a figure explaining the screen. It is a figure for demonstrating operation which reduces the map on a display (monitor) by rotating a scanner, (a) is a user's operation, (b) is on a display (monitor) in the case of (a). It is a figure explaining the screen. It is a figure for demonstrating the format of the dot pattern in the solid map which is other embodiment of this invention, (a) is explanatory drawing which showed the value defined by each dot with a table | surface, (b) is each dot It is explanatory drawing which shows arrangement | positioning. 3A and 3B are diagrams for explaining an operation of changing a viewpoint by rotating a scanner in a three-dimensional map, in which (a) and (b) are user operations, and (c) is a display in the cases of (a) and (b). It is a figure explaining the screen on (monitor). It is a figure for demonstrating operation which chills up and down a viewpoint, and is a figure explaining operation which a user performs. FIG. 26 is a diagram for describing operations for chilling up and down a viewpoint, and is a diagram illustrating a screen displayed on a display (monitor) when each operation of FIG. 25 is performed. It is a figure for demonstrating operation which changes a viewpoint to right and left, (a) is a user's operation, (b) is a figure explaining the screen on a display (monitor) in the case of (a). It is a figure for demonstrating operation which changes a viewpoint to right and left, and is a figure explaining the screen on a display (monitor) in the case of FIG. It is a figure for demonstrating operation which changes the mode of the screen on a display (monitor) by grid pump operation | movement, (a) is a user's operation, (b) is about the screen on the display (monitor) in standard mode. FIG. It is a figure for demonstrating operation which changes the mode of the screen on a display (monitor) by grid pump operation | movement, (a) is a telephoto mode, (b) is a case where it changes to a wide mode on a display (monitor). FIG. It is a figure for demonstrating operation which resets a viewpoint to a standard mode by a grid tapping operation | movement, (a) is a user's operation, (b) is a screen on the display (monitor) before operation, (C) is after operation. It is the figure explaining the screen on the display (monitor). It is explanatory drawing which shows other embodiment of the scanner used in order to perform various operation on a map. It is a figure for demonstrating the method to measure the direction and angle which inclined, when performing various operation by the inclination of a scanner. It is a figure for demonstrating the method to measure the direction and angle which inclined, when performing various operation by the inclination of a scanner. It is a figure for demonstrating the method to measure the direction inclined, when performing various operation by the inclination of a scanner. It is a figure for demonstrating the method to measure the direction inclined by using a Fourier function, when performing various operation by the inclination of a scanner. It is a figure for demonstrating the method to measure the direction which inclined by using n-order equation, when performing various operation by the inclination of a scanner. It is a figure for demonstrating the function which designates a range by grid drag operation and displays a symbol on a display (monitor). It is a figure for demonstrating the function to display a cut surface on a display (monitor) by grid drag operation. It is a figure for demonstrating printing of an electronic map. It is a figure for demonstrating the correspondence with the dot code format of the printed map, and a map number and XY coordinate. It is a figure (1) for demonstrating the reduced scale in the case of printing an electronic map. It is FIG. (2) for demonstrating the reduced scale in the case of printing an electronic map. 6 is a flowchart for explaining a printing process. It is a figure (1) for demonstrating the link with the icon on an electronic map, and an icon seal. It is a figure (2) for demonstrating the link with the icon on an electronic map, and an icon seal. It is a figure (3) for demonstrating the link with the icon on an electronic map, and an icon seal. It is the figure explaining the Example which uses an electronic map and the map book which superimposed and printed the dot pattern correspondingly. It is a flowchart (1) for demonstrating the process which matches an electronic map and the map book which superimposed and printed the dot pattern. It is a flowchart (2) for demonstrating the process which matches an electronic map and the map book which superimposed and printed the dot pattern. It is a figure for demonstrating operation which scrolls an electronic map by inclining a scanner. It is a figure for demonstrating operation which expands an electronic map by rotating a scanner. It is a figure for demonstrating operation which reduces an electronic map by rotating a scanner. It is a figure for demonstrating the function which switches the mode of an electronic map by grid tapping operation. It is a figure explaining operation which displays feature information on a monitor. It is a figure (1) for demonstrating the case where the latitude and longitude where the representative point on a map is located as an attribute code in a division area. It is a figure (2) for demonstrating the case where the latitude and longitude where the representative point on a map is located as an attribute code in a divided area. It is a figure for demonstrating the case where the latitude and longitude of the centroid of a division area are used as an attribute code in a division area. It is a figure for demonstrating the case where the paper medium on which the map and the dot pattern were superimposed printed is read with a scanner, and the feature icon is displayed on an electronic map. It is a figure (1) for demonstrating the function to scroll an electronic map by sliding a scanner on a printing map. It is a figure (2) for demonstrating the function to scroll an electronic map by sliding a scanner on a printing map. It is a figure for demonstrating the function which associates the dot pattern printed on the medium, and the latitude longitude. It is a figure for demonstrating the case where an electronic map and feature information are displayed on the same display monitor. It is a figure for demonstrating two types of ink used when a map and a dot pattern are superimposed and printed.

(First embodiment Plan map)
1 to 22 show a first embodiment of the present invention.

  In this embodiment, a map is used as a medium. When a map is captured by a pen-type scanner (imaging means), a map and information corresponding to the captured content are displayed on a display device (monitor) that is an output means. It is like that. The display device displays an electronic map installed in a personal computer, and corresponding characters, graphics, sounds, moving images, and the like.

  FIG. 1 is a diagram showing a surface printing state of a map (medium) used in the present invention.

  The map according to the present invention includes an icon portion on which icons for instructing operations for performing various displays on the display device are printed, and a map portion on which roads, tracks, tourist facilities, and the like are printed. .

  A dot pattern indicating a code corresponding to an operation instruction is printed in the area of each icon in the icon portion. The dot pattern printed here will be described later. The icons are printed on the top and bottom of the map, respectively, and on the top are “Information” “Map” “GS Gas Station” “Convenience Store” “ATM Bank” “Accommodation” “Meals” An icon is provided.

  Also, at the bottom, icons for "Up", "Right", "Down", "Left", and "Back" to move the electronic map, and "Enlarge" to change the size of the electronic map "Standard" and "Reduce" icons are printed.

  In the map portion, symbols for displaying tourist facilities and the like in addition to roads and tracks are printed. In the area of the map portion, a dot pattern that means XY coordinates corresponding to the position of the road or track is printed. In addition to the XY coordinates corresponding to the location of the facility, the symbol is overprinted with a dot pattern in which the facility information is encoded.

  FIG. 2 is an explanatory diagram showing the use state of the map.

  As shown in the figure, the map (medium) in the present invention is used in conjunction with an electronic device such as a personal computer and a pen-type scanner (imaging means). That is, a pen-type scanner is connected to a computer with a USB cable or the like. The user clicks (captures) an arbitrary position or symbol on the map portion or various icons printed on the icon portion using the scanner.

  An electronic map address is registered in the map mode icon. When the user clicks the map mode icon, the electronic map registered in the hard disk device of the personal computer is read out and displayed on the display.

  In FIG. 2, the scanner is connected to a computer. However, the present invention is not limited to this, and the scanner may be used in conjunction with another communication device such as a mobile phone or a PDA (Personal Data Assistant). .

  FIG. 3 is a hardware block diagram showing the configuration of the computer and the scanner.

  As shown in the figure, a personal computer has a central processing unit (CPU) as a center, a main memory (MM), a hard disk device (HD) connected by a bus, a display device (DISP) as output means, and input means. As a keyboard (KBD).

  A scanner serving as an imaging unit is connected via a USB interface (USB I / F).

  Although not shown, a printer, a speaker, and the like are connected as an output device in addition to the display device (DISP).

  The bus (BUS) is connected to a general-purpose network (NW) such as the Internet via a network interface (NW I / F), and includes electronic map data, character information, image information, audio information, video information, and a program. Etc. can be downloaded from a server (not shown).

  Content data such as electronic map data, character information, image information, audio information, moving image information, and programs may be read from a storage medium such as a CD-ROM or DVD in addition to downloading from the server.

  In the hard disk (HD), together with an operating system (OS), application programs such as a dot pattern analysis program used in the present embodiment, electronic map data, character information, image information, audio information, video information, various tables, etc. Is registered.

  The central processing unit (CPU) sequentially reads and executes application programs in the hard disk via the bus (BUS) and the main memory (MM), reads out the data, and outputs and displays it on the display device (DISP). The functions described in this embodiment are realized.

  Although not shown, the scanner includes an infrared irradiation means (red LED), an IR filter, and an optical imaging device such as a CMOS sensor or a CCD sensor, and functions to capture the reflected light of the irradiation light irradiated on the medium surface. have. Here, the dot pattern on the medium surface is printed with carbon ink, and portions other than the dot pattern are printed with non-carbon ink.

  Since the carbon ink has a characteristic of absorbing infrared light, only the dot portion is photographed black in the image captured by the optical image sensor.

  Here, the irradiation light has been described in the case of using a dot pattern printed with carbon ink (ink having characteristics of absorbing infrared rays) using infrared rays in the present embodiment. However, the present invention is not limited to this, and the dot pattern may be printed using, for example, ultraviolet rays and ink having a characteristic of absorbing ultraviolet rays.

  The captured image of the dot pattern read in this way is analyzed by a central processing unit (CPU) in the scanner, converted into a coordinate value or code value, and transmitted to a personal computer via a USB cable.

  The central processing unit (CPU) of the personal computer refers to the table indicating the received coordinate values or code values, and displays electronic map data, character information, image information, audio information, and moving image information corresponding to these on the display device (DISP). ) And a speaker (not shown).

  Next, a dot pattern used in the present invention will be described with reference to FIGS.

  FIG. 4 is an explanatory diagram showing GRID1, which is an example of the dot pattern of the present invention.

  In these drawings, vertical and horizontal grid lines are provided for convenience of explanation, and are not present on the actual print surface. The key dots 2, information dots 3, reference grid point dots 4 and the like constituting the dot pattern 1 are printed with carbon ink that absorbs infrared light when the scanner as imaging means has infrared irradiation means. It is desirable that

  FIG. 5 is an enlarged view showing an example of information dots of the dot pattern and bit display of the data defined therein. FIGS. 6A and 6B are explanatory diagrams showing information dots arranged around key dots.

  The information input / output method using a dot pattern according to the present invention includes generation of a dot pattern 1, recognition of the dot pattern 1, and means for outputting information and a program from the dot pattern 1. That is, the dot pattern 1 is captured as image data by the camera, the reference grid point dot 4 is extracted first, and then the key dot 2 is extracted because the dot is not originally placed at the position where the reference grid point dot 4 is located. Next, the information dot 3 is extracted and digitized to extract an information area to digitize the information, and information and a program are output from the dot pattern 1 based on the numerical information. For example, information such as voice or a program is output from the dot pattern 1 to an information output device, a personal computer, a PDA, a mobile phone, or the like.

  The dot pattern 1 according to the present invention is generated in accordance with a predetermined rule for fine dots, that is, key dots 2, information dots 3, and reference lattice point dots 4, in order to recognize information such as voice by a dot code generation algorithm. Arrange. As shown in FIG. 4, in the block of dot pattern 1 representing information, a 5 × 5 reference grid point dot 4 is arranged on the basis of the key dot 2 and the center of the center surrounded by the four reference grid point dots 4 is arranged. Information dots 3 are arranged around the virtual grid point 5. Arbitrary numerical information is defined in this block. In the illustrated example of FIG. 4, a state is shown in which four blocks (inside the thick line frame) of the dot pattern 1 are arranged in parallel. Of course, the dot pattern 1 is not limited to four blocks.

  One corresponding information and program can be output to one block, or one corresponding information and program can be output to a plurality of blocks.

  When the dot pattern 1 is captured by the camera as the image data, the reference grid point dot 4 corrects distortion of the lens of the camera, imaging from an oblique direction, expansion / contraction of the paper surface, curvature of the medium surface, and distortion during printing. Can do. Specifically, a correction function (Xn, Yn) = f (Xn ′, Yn ′) for converting the distorted four reference grid point dots 4 into the original square is obtained, and the information dot 3 is obtained using the same function. Is corrected to obtain a correct vector of information dots 3.

  If the reference grid dot 4 is arranged in the dot pattern 1, the image data obtained by capturing the dot pattern 1 with the camera corrects the distortion caused by the camera. Even when the image data of the dot pattern 1 is captured by the camera, it can be accurately recognized. Even if the camera is tilted and read with respect to the surface of the dot pattern 1, the dot pattern 1 can be accurately recognized.

  As shown in FIG. 4, the key dot 2 is a dot in which four reference grid point dots 4 at the corners of the four corners of the block are shifted in a certain direction. The key dot 2 is a representative point of the dot pattern 1 for one block representing the information dot 3. For example, the reference grid point dots 4 at the corners of the four corners of the block of the dot pattern 1 are shifted upward by 0.1 mm. When the information dot 3 represents the X and Y coordinate values, the coordinate point is a position where the key dot 2 is shifted downward by 0.1 mm. However, this numerical value is not limited to this, and can be changed according to the size of the block of the dot pattern 1.

The information dot 3 is a dot for recognizing various information. The information dot 3 is arranged around the key dot 2 as a representative point, and the center surrounded by the four reference grid point dots 4 is set as a virtual grid point 5 and expressed as a vector using this as a starting point. Arranged at the end point. For example, the information dot 3 is surrounded by the reference grid point dot 4 and, as shown in FIG. 5, a dot 0.1 mm away from the virtual grid point 5 has a direction and a length expressed by a vector. Then, it is rotated 45 degrees clockwise and arranged in 8 directions to represent 3 bits. Therefore, 3 bits × 16 pieces = 48 bits can be expressed by one block of the dot pattern 1.

  In the illustrated example, 3 bits are expressed by arranging in 8 directions. However, the present invention is not limited to this, and 4 bits can be expressed by arranging in 16 directions. Of course, various changes can be made. is there.

  The diameter of the key dot 2, the information dot 3 or the reference grid point dot 4 is preferably about 0.05 mm in consideration of appearance, printing accuracy with respect to paper quality, camera resolution, and optimal digitization.

  Further, in consideration of a necessary amount of information with respect to the imaging area and misidentification of the various dots 2, 3, and 4, it is desirable that the interval between the reference grid point dots 4 is about 0.5 mm vertically and horizontally. In consideration of misrecognition of the reference grid point dot 4 and the information dot 3, the shift of the key dot 2 is preferably about 20% of the grid interval.

  The distance between the information dot 3 and the virtual grid point surrounded by the four reference grid point dots 4 is preferably about 15 to 30% of the distance between the adjacent virtual grid points 5. This is because if the distance between the information dot 3 and the virtual lattice point 5 is closer than this distance, the dots are easily recognized as a large lump and become unsightly as the dot pattern 1. On the contrary, if the distance between the information dot 3 and the virtual grid point 5 is longer than this distance, it is difficult to identify which of the adjacent virtual grid points 5 is the information dot 3 having the vector directivity. Because it becomes.

For example, the information dot 3, as shown in FIG. 6 (a), the lattice spacing of placing the _{I 16} from _{I 1} clockwise from the block center is 0.5 mm, 3 bits × 16 = 48 in 2mm × 2mm Represents a bit.

In addition, it is possible to further provide sub-blocks having independent information contents in the block and not affected by other information contents. FIG. 6B illustrates this, and sub-blocks [I ₁ , I ₂ , I ₃ , I ₄ ], [I ₅ , I ₆ , I ₇ , I, which are constituted by four information dots 3. ₈ ], [I ₉ , I ₁₀ , I ₁₁ , I ₁₂ ], [I ₁₃ , I ₁₄ , I ₁₅ , I ₁₆ ] are independent data (3 bits × 4 = 12 bits) developed into information dot 3 It has come to be. By providing sub-blocks in this way, error checking can be easily performed on a sub-block basis.

  It is desirable that the vector direction (rotation direction) of the information dots 3 is uniformly determined every 30 to 90 degrees.

  FIG. 7 is an example of the bit display of the information dot 3 and the data defined therein, and shows another form.

  In addition, using two types of information dots 3 that are long and short from the virtual lattice point 5 surrounded by the reference lattice point dot 4 and eight vector directions, 4 bits can be expressed. At this time, it is desirable that the longer one is about 25 to 30% of the distance between adjacent virtual lattice points 5, and the shorter one is about 15 to 20%. However, it is desirable that the center interval between the long and short information dots 3 is longer than the diameter of these dots.

The information dot 3 surrounded by the four reference lattice point dots 4 is preferably one dot in consideration of appearance. However, if it is desired to ignore the appearance and increase the amount of information, one bit is assigned to each vector, and the information dot 3 is expressed by a plurality of dots, so that a large amount of information can be provided. For example, the vector of concentric eight directions, an information dot 3 surrounded by four points lattice dots 4 can represent information of 2 ^8, and 16 pieces of information dots of one block 2 ^128.

  FIG. 8 shows an example of information dot and bit display of data defined therein. (A) shows two dots, (b) shows four dots, and (c) shows five dots arranged. It is shown.

  FIG. 9 shows a modification of the dot pattern, where (a) is a six-information dot arrangement type, (b) is a nine-information dot arrangement type, (c) is a twelve information dot arrangement type, and (d). Is a schematic diagram of a 36 information dot arrangement type.

  The dot pattern 1 shown in FIGS. 4 and 6 shows an example in which 16 (4 × 4) information dots 3 are arranged in one block. However, the information dots 3 are not limited to 16 pieces arranged in one block, and can be variously changed. For example, according to the amount of information required or the resolution of the camera, six information dots 3 (2 × 3) are arranged in one block (a), and nine information dots 3 in one block (3 × 3) Arranged (b), 12 (3 × 4) information dots 3 arranged in one block (c), or 36 (d) arranged 36 information dots 3 in one block.

  Next, FIG. 10 shows the relationship among the dot pattern, code value, and XY coordinate value printed on the map surface.

FIG. 10A shows a table of values defined in 32 bits from C _{0 to} C ₃₁ of this dot pattern. C ₀ -C ₇ the _{X-coordinate,} C 8 _{-C 15} is _{Y-coordinate,} the C 16 _{-C 27} is meant map _numbers, C 28 _{-C 30 parity, C 31} is XY map data, respectively.

C _{16 to} C ₂₇ are not limited to map numbers, but may be other codes (code values).

  These values are arranged in the lattice region shown in FIG.

  In this way, in this dot pattern, the X coordinate and the Y coordinate as well as the corresponding code information (code value) can be registered in the 4 × 4 lattice area. Specific code information can be given to the area portion together with the XY coordinates. With such a dot pattern format, text, image, video, and audio information corresponding to a symbol icon such as a building can be associated with information based on XY coordinates and output.

  FIG. 11 is a diagram illustrating an operation for enlarging or reducing the electronic map by clicking an icon displayed at the lower part of the icon portion.

  FIG. 11A is an operation performed on the map by the user, and FIG. 11B is a diagram showing an image displayed on the display device (monitor) when the operation is performed. As shown in (a), when the user clicks the “enlarge” symbol located at the lower part of the icon portion using the scanner, the imaging device captures a dot pattern printed on the symbol, and the captured image is It is analyzed by a central processing unit (CPU) built in the scanner, converted into a dot code (coordinate value or code value), and transmitted to a personal computer.

  The central processing unit (CPU) of the personal computer refers to the table in the hard disk device (HD) based on the dot code, and stores image data (here, enlarged data of the electronic map) corresponding to the dot code. ) Is read and displayed on the display device (monitor).

  The central processing unit (CPU) may perform display control of the display device (DISP) based on the dot code, and directly enlarge the map image data displayed on the display (monitor).

  In this way, the magnification of the electronic map on the display device (monitor) is enlarged as shown in FIG. Similarly, clicking on the “reduce” symbol reduces the magnification of the electronic map. Click the “Standard” symbol to return to the standard magnification.

  FIG. 12 is a diagram for explaining an operation of moving the map displayed on the display device (monitor) by clicking the icon displayed at the lower part of the icon portion.

  In the figure, when the “to the right” icon is clicked (imaged by the scanner), the central processing unit (CPU) of the scanner analyzes the dot pattern of the icon by an analysis program, and a dot code (coordinate value or code value). And convert it to a personal computer.

  The central processing unit (CPU) of the personal computer that has received the dot code refers to a table in the hard disk device (HD) based on the dot code, and stores image data (here, the corresponding dot code). Map data on the left and right sides of the coordinate position of the electronic map) is read and displayed on the display device (monitor).

  The central processing unit (CPU) may perform display control of the display device (DISP) based on the dot code, and directly move and draw the map image data displayed on the display (monitor).

  In the above embodiment, the image data displayed on the display device (DISP) is moved leftward on the screen with the “rightward” icon. However, the image data is moved in the opposite rightward direction. May be.

  Similarly, when the user clicks “left”, the screen is scrolled left (or right), when “up” is clicked, upward (or downward), and when “down” is clicked, scrolls downward (or upward). Clicking “Return” returns to the state before scrolling.

  FIG. 13 is a diagram for explaining an operation of scrolling the electronic map when the user clicks on the map.

  FIG. 13 is a diagram illustrating a case where the user clicks an arbitrary position such as a road or a river on the map. (A) is an operation performed on the map by the user, and (b) is a diagram showing an image displayed on the display device (monitor) when the operation is performed. For example, as shown in (a), when the user clicks on a road intersection using a scanner, the central processing unit (CPU) of the scanner analyzes the dot pattern using an analysis software program. This dot code is transmitted to the central processing unit (CPU) of the computer. The computer reads only the code representing the XY coordinates of the position among the dot codes. In this way, as shown in FIG. 5B, the scroll is performed so that the intersection is located at the center of the display.

  In the present invention, the clicked part is not limited to a road or a river, but may be a symbol on a map such as a gas station. When the user clicks on the symbol, the code representing the XY coordinates of the symbol is read and scrolled so that the symbol is positioned at the center of the display by the method described above.

  FIG. 14 is a diagram illustrating an operation of scrolling the electronic map by a grid drag operation.

  (A) is an operation performed on the map by the user, and (b) is a diagram showing an image displayed on the display when the operation is performed. Here, the grid drag operation refers to moving the scanner in a state where the scanner is brought into contact with the map portion. Here, the user first clicks the center of the intersection, and moves the scanner to the center of the map part without leaving the map part. Then, as shown in (b), the screen is scrolled so that the center of the intersection is located at the center of the display.

  By such an operation, the scanner first reads the coordinate value of the intersection, and the coordinate value read as the scanner moves changes.

  The coordinate values changing in this way are sequentially transmitted to the personal computer. The central processing unit (CPU) of the personal computer moves (scrolls) the electronic map displayed on the display device (monitor) based on the change in the coordinate values. As a result, in the present invention, the electronic map is scrolled so that the part clicked by the scanner is displayed in the center of the display.

  FIG. 15 is a diagram for explaining the facility search function.

  FIG. 15A is an operation performed on the map by the user, and FIG. 15B is a diagram showing an image displayed on the display device (monitor) when the operation is performed.

  When the user clicks one of the icons “GS”, “ATM”, “Accommodation” and “Meals” printed on the top of the map, an icon symbol indicating the facility corresponding to the symbol icon is displayed on the electronic map. The For example, as shown in (a), when the user clicks the “GS” icon, as shown in (b), a “GS” symbol indicating a gas station is displayed at the position where the gas station exists on the electronic map. . Similarly, when the user clicks the “ATM” icon, an icon indicating an ATM such as a bank is clicked, and when the user clicks an “accommodation” icon, a symbol indicating an accommodation facility such as a hotel or an inn is clicked. Then, a symbol indicating a restaurant or the like is displayed. Thereby, the user can easily know where the target facility is located.

  Here, the code value is printed as a dot pattern for each predetermined icon on the icons “GS”, “ATM”, “accommodation”, and “meal”, and the image sensor of the scanner reads the dot pattern as a captured image. Then, the central processing unit (CPU) of the scanner converts it into a code value based on the ROM analysis program, and transmits the code value to the personal computer.

  The central processing unit (CPU) of the personal computer searches the table based on the code value, and maps and displays a symbol image corresponding to the code value on the electronic map image displayed on the display (monitor).

  When the symbol is displayed on the electronic map and the user clicks again on the icon corresponding to the symbol, the symbol on the electronic map is deleted.

  FIG. 16 is a diagram illustrating the information mode.

  The information mode refers to a state in which information (characters, images, sounds, moving images, etc.) corresponding to symbols on the map portion is described.

  In the present embodiment, the map mode is set as the initial setting. In order to switch to the information mode, as shown in (a), the user first clicks the “information” icon at the top of the icon part. Thereby, the switching process from map mode to information mode is performed.

  Specifically, a predetermined code value is printed as a dot pattern on the “information” icon, and when the image sensor of the scanner reads the dot pattern as a captured image, the central processing unit (CPU) of the scanner reads the data in the ROM. The code value is converted based on the analysis program, and the code value is transmitted to the personal computer.

  The central processing unit (CPU) of the personal computer that has received the code value switches the display mode of the display (monitor) to the information mode.

  Next, the user clicks a symbol indicating a facility for which information is desired. For example, as shown in (a), a temple icon symbol is clicked. Thereby, the code value meaning the temple is transmitted to the personal computer. The central processing unit (CPU) of the personal computer that has received the code value of the temple searches the table based on the code value and displays information (characters, images, sounds, videos, etc.) corresponding to the code value ( Output from the monitor. Here, an image of the temple is displayed on the display, and a sound describing the temple is output from the speaker.

  FIG. 17 is a diagram illustrating a method for switching from the map mode to the information mode.

  As described with reference to FIG. 16, two types of icons “information” and “map” are printed on the upper part of the icon portion. However, in addition to clicking these icons, it is possible to switch modes by operating the scanner.

  (A) performs switching by a grid tapping operation. The grid tapping operation is an operation of hitting the map by moving the scanner up and down while standing the scanner in the vertical direction of the map. For example, when the user performs a grid tapping operation on a temple symbol, the map mode is switched to the information mode, and a temple image is displayed on the display (monitor).

  Specifically, the central processing unit (CPU) of the personal computer reads the substantially same XY coordinate information or code information a plurality of times within a predetermined time, so that the central processing unit (CPU) performs the grid tapping operation. Recognize what happened.

  (B) performs switching by a grid sliding operation. The grid sliding operation is an operation of sliding the scanner in a circle on the map. The user performs a grid sliding operation so as to surround the symbol. Thereby, switching from map mode to information mode is performed, and the image | video of a temple is displayed on a display (monitor).

  Specifically, the central processing unit (CPU) of the personal computer recognizes the XY coordinate information read within a predetermined time as a substantially circular locus by a circular grid sliding operation on the medium surface of the imaging means. Is done by.

  (C) performs switching by grid scratch operation. The grid scratch operation refers to an operation of moving the scanner a plurality of times so as to be scratched on the map. The user performs a grid scratch operation on the symbol. Thereby, switching from map mode to information mode is performed, and the image | video of a temple is displayed on a display (monitor).

  Specifically, it is performed by the central processing unit (CPU) of the personal computer recognizing the trajectory of the XY coordinates read within a predetermined time as a repetition (scratch) of a trajectory on a short-distance straight line.

  Note that the operation of the scanner for switching from the map mode to the information mode is not limited to the above-described embodiment. When the user performs an operation other than the above-described operations, the information mode may be switched.

  18A and 18B are diagrams illustrating an operation of scrolling the electronic map according to the orientation of the scanner (grid tilt operation). FIG. 18A is a diagram illustrating a user's operation. FIG. 18B is a diagram illustrating the inclination of the scanner with respect to the vertical direction. The figure explaining the case changed, (c) is the figure explaining the state scrolled on a display (monitor).

  The orientation of the scanner is the direction in which the frame buffer faces upward when taking an image. As shown in (a), the user sets the orientation of the scanner in the direction to be scrolled and clicks. Then, the position clicked by the user is scrolled in the direction indicated by the orientation of the scanner.

  In this case, the scroll distance of the electronic map is determined by the inclination of the scanner with respect to the vertical line of the map and the angle formed by the scanner and the map. In (b), (1) is a vertically standing state before the scanner is tilted, (2) is a state where it is tilted forward, (3) is a state where it is further tilted forward, and (4) is a state where it is tilted backward , (5) is a state where it is further tilted backward. The operation of tilting the scanner back and forth in this way is called grid tilt. In each case, (c) explains how to scroll on the display (monitor). It is assumed that the part clicked on the map part by the user is located at the center of the screen before the scanner is brought down. Then, when the scanner is tilted forward, the electronic map moves in parallel with the direction indicated by the orientation of the scanner. In addition, the moving speed and the moving distance increase as the arm is tilted deeper. On the other hand, when the scanner is tilted backward, the electronic map moves in a direction 180 degrees opposite to the direction indicated by the scanner direction, and as it is tilted forward, the moving speed and the moving distance increase as it is tilted deeper.

  FIG. 19 is a diagram for explaining an operation for scrolling a map displayed on a display (monitor) according to the inclination of the scanner with respect to the direction of the dot pattern, (a) is a diagram for explaining a user's operation, and (b). Is a diagram for explaining a case where the tilt of the scanner is changed with respect to the vertical direction, and (c) is a diagram for explaining a state of being scrolled on a display (monitor).

  The inclination of the scanner is an angle formed by the direction of the dot pattern described above and the scanner body. The electronic map is scrolled in the direction in which the scanner is tilted.

  The scrolling distance is determined by the depth at which the scanner is tilted. In (b), (1) is a vertically standing state before the pen is tilted, (2) is a forwardly tilted state, and (3) is a further forwardly tilted state. In each case, (c) explains how to scroll on the display (monitor). It is assumed that the part clicked on the map by the user is located at the lower right center of the screen before the scanner is brought down. When the scanner is tilted forward, the electronic map moves in parallel with the direction indicated by the orientation of the scanner. In addition, the moving speed and the moving distance increase as the arm is tilted deeper.

  The direction in which the scanner is tilted and the scroll direction of the electronic map on the display may be opposite to the above.

  FIG. 20 is a diagram illustrating the relationship between the tilt of the scanner and the angle at which the map on the display (monitor) is scrolled.

The dot pattern on the map is superimposed and printed in the same direction as the vertical direction of the paper. As shown in (a), the angle formed by the direction of the dot pattern and the direction of the scanner is α. Also, as shown in (b), when the user tilts the scanner, the angle formed by the scanner tilt and the scanner orientation is β. In this case, the electronic map moves in the direction of an angle γ formed by the dot direction and the scanner tilt. That is, the angle γ is
γ = α + β
It becomes.

  Note that the tilt of the scanner can be recognized by the difference in brightness in the imaging field, which will be described later.

  FIG. 21 is a diagram illustrating the operation of the scanner for enlarging the screen displayed on the display (monitor) by the grid grind operation.

  Grid grind is an operation that rotates the scanner. (A) is an operation performed on the map by the user, and (b) is a diagram showing an image displayed on the display (monitor) when the operation is performed. As shown in (a), when the user grids the scanner in the right direction, the electronic map is enlarged as shown in (b).

  Grid grinding is an operation of rotating the scanner, and grid grinding in the right direction is also referred to as “grid grinding light”.

  Specifically, the central processing unit (CPU) of the personal computer rotates the imaging optical axis around the vertical line while maintaining a constant inclination of the imaging optical axis with respect to the vertical line on the medium surface. This is done by recognizing changes.

  FIG. 22 is a diagram for explaining the operation of the scanner for reducing the screen displayed on the display (monitor) by the grid grind operation.

  (A) is an operation performed on the map by the user, and (b) is a diagram showing an image displayed on the display (monitor) when the operation is performed. As shown in (a), when the user grids the scanner in the left direction, the electronic map is reduced as shown in (b).

  Note that such grid grinding in the left direction is also referred to as “grid grind left”.

(Second embodiment 3D map)
FIG. 23 to FIG. 31 illustrate the display of a three-dimensional map when the electronic map is a three-dimensional map, which is the second embodiment of the present invention.

  Also in this embodiment, similarly to the planar map, the map on which the dot pattern is superimposed and printed is used in conjunction with an electronic device such as a computer. That is, when an arbitrary part on the map such as a mountain or a pond is clicked with a scanner, a stereoscopic image corresponding to the part is displayed on a display (monitor).

  FIG. 23 shows the relationship among the dot pattern, code value, and XYZ coordinate value printed on the map surface.

FIG. 23A shows a table of values defined in 32 bits from C _{0 to} C ₃₁ of the dot pattern. C ₀ -C ₇ the _{X-coordinate,} C 8 _{-C 15} is Y _coordinates, C 16 _{-C 23} are _{Z-coordinate,} C 24 _{-C 27} is a map _number, C 28 _{-C 30 parity, C 31} is XYZ map data Respectively.

C _{24 to} C ₂₇ are not limited to map numbers, but may be other codes.

  These values are arranged in the lattice region shown in FIG.

  FIG. 24 is a diagram illustrating an operation for changing the viewpoint by the grid grind operation described above.

  (A) is a diagram explaining the change of the viewpoint in (a) and (b) when (a) is rotated counterclockwise, (b) is when the scanner is rotated clockwise, and (c). is there.

  In (c), Z is the altitude at the part clicked by the user. When the user clicks an arbitrary part, a landscape viewed from the part clicked by the user is displayed as a stereoscopic image on the display device (monitor). In this case, the viewpoint is Z + h1, which is the sum of the altitude and the height of the human eye, and this is the standard viewpoint. As shown in (a), when the user rotates the scanner counterclockwise, the viewpoint rises to the position (1). Then, when it is rotated clockwise as shown in (b), the raised viewpoint is lowered.

  FIG. 25 and FIG. 26 are diagrams illustrating operations for chilling up and down the viewpoint depending on the orientation of the scanner.

  FIG. 25 is a diagram illustrating a user's operation on a map. As shown in (1), the user first places the scanner perpendicular to the map. Then, as shown in FIG. 26A, the image is displayed on the display (monitor) in the standard mode. When the user tilts the scanner forward as shown in FIG. 25 (2), the viewpoint moves downward with a movement that makes the human posture lean forward as shown in FIG. 26 (b). Also, as shown in FIG. 25 (3), when the scanner is tilted backward, the viewpoint moves upward so that the upper body of the person warps backward as shown in FIG. 26 (c).

  27 and 28 are diagrams illustrating an operation for changing the angle by tilting the scanner left and right.

  In FIG. 27A, (1) is a state in which the scanner is standing vertically with respect to the map, (2) is a state in which the scanner is tilted to the left side, and (3) is a state in which the scanner is tilted to the right side.

  In the case of (1), the three-dimensional map is displayed in the standard mode on the display (monitor). When the user tilts the scanner to the left as shown in (2), a screen with the viewpoint moved to the left is displayed as shown in FIG. As shown in (3), when the user tilts the scanner to the right, a screen with the viewpoint moved to the right is displayed as shown in FIG.

  29 and 30 are diagrams illustrating an operation for changing the magnification of the map displayed on the screen by the grid pump operation.

  The grid pump operation is an operation for quickly and repeatedly tilting the scanner forward or backward. Before the grid pump operation is performed, a screen similar to that taken with the standard lens of the camera is displayed on the display (monitor) as shown in FIG. When the user quickly and repeatedly tilts the pen forward as shown in FIGS. 29A and 29A, the image is gradually enlarged as shown in FIG. Is displayed. Also, as shown in FIGS. 29 (a) and 29 (2), when the pen is quickly and repeatedly tilted backward, the angle of view gradually widens, and as shown in FIG. 30 (b), the screen shot with the wide lens is displayed. Is displayed.

  FIG. 31 is a diagram illustrating an operation of resetting the viewpoint operation by the grid tapping operation.

  The grid tapping operation is an operation of hitting the map by moving the scanner up and down while standing the scanner vertically.

  For example, as shown in (b), it is assumed that a screen in a state of being photographed with a wide lens is displayed at a position elevated to a high altitude by the grid pump operation described above. In this case, when the grid tapping operation is performed as shown in FIG. 31A, the standard mode is reset as shown in FIG.

  When the telephoto mode is set by the grid pump operation, the standard mode is similarly reset.

  Also, when the viewpoint is changed by the grid grind operation described in FIG. 24, the viewpoint is reset by performing the grid tapping operation.

  FIG. 32 shows another embodiment of the scanner.

  FIG. 32A shows a scanner fixed with a tripod-like tool. An opening is provided in the center of the tool, and rubber is formed around the opening. Insert the scanner into the opening. With such a structure, when the user performs an operation such as grid grinding, the scanner can be fixed, and the sensor unit is prevented from reading a dot pattern other than the target dot pattern. be able to.

  In (b), a scanner is fixed by installing a spring on a cup-shaped tool. Openings are provided in the upper and lower parts of the tool, and a plurality of springs are installed in the upper part. The scanner is used with this spring.

  When a user performs various operations using a scanner, the conventional scanner has a problem that the bottom part is shaken when rotated, and the dot pattern cannot be read accurately. With this structure, the bottom is fixed, and the dot pattern can be read accurately. In addition, the user can perform a smooth operation by using rubber or a spring.

  FIGS. 33 to 37 are diagrams illustrating a method of calculating the tilt direction when the scanner is tilted.

  About the inclination with respect to the vertical direction of the medium surface (map) of a scanner (imaging means), as shown in FIG.20 (b), it can recognize by the difference in the brightness in the imaging visual field of the said scanner.

  The inclination direction of the scanner means an angle between the scanner and the map as shown in FIG. Which direction the user tilts the scanner can be obtained by the following method.

  First, calibration is performed. The scanner is set up vertically with respect to the map, and the brightness of the cells 1 to 48 shown in FIG. 33 is measured. FIG. 33 shows an area around the scanner. The brightness at this time is assumed to be BL0 (i). i is the value of the measured cell. For example, the brightness of the cell No. 24 is displayed as BL0 (24).

  Two LEDs are installed inside the scanner. Therefore, even if the scanner is set up vertically with respect to the map, the brightness differs between cells near the LED and cells located away from the LED. Therefore, calibration is performed.

Next, the brightness when the scanner is tilted is measured. As shown in FIG. 34A, when the scanner is tilted in a certain direction, the brightness from cell 1 to cell 48 is measured, and the brightness in cell i is defined as BL (i). Then, the difference between BL (i) and BL0 (i) in each cell is calculated. And
Max (BL0 (i) -BL (i))
Calculate

  When the scanner is tilted, the direction opposite to the tilted direction becomes dark. This is because the LED also tilts in the direction in which the scanner is tilted, so that the distance from the LED is longer in the direction opposite to the tilted direction. Therefore, as shown in FIG. 34B, the direction opposite to the cell where the difference is the maximum is the position where the scanner is tilted.

  As a result, the direction in which the scanner is tilted is determined.

  Another method for determining the inclination direction and the angle by performing calibration will be described with reference to FIGS. 33 to 34.

  First calibrate. First, the scanner is set up vertically with respect to the map, the brightness of the cells 1 to 48 shown in FIG. 33A is measured, and the brightness in the cell i is set to BL0 (i).

  Next, the scanner is tilted by 45 ° and made a round around the pen tip as shown in FIG. In this case, the brightness when the scanner comes to the position of cell i is BL45 (i). BL45 (i) from cell 1 to cell 48 is obtained. Calibration is completed by the above operation.

  Next, when the user tilts the scanner, the brightness from cell 1 to cell 48 is measured, and the brightness in cell i is set to BL (i), i = 1, n (= 48). And

Ask for.

  Since BL0 (i) -BL45 (i) is constant, when the value of BL0 (i) -BL (i) is the largest, that is, when BL (i) is the smallest.

Is the maximum value. As described above, since the direction opposite to the direction in which the scanner is tilted becomes darkest, the reverse direction of the cell i in this case is the direction in which the scanner is tilted.

  The angle at which the scanner is tilted is

It becomes.

  In addition, although the above-described equation assumes that the angle θ is linear with respect to the brightness, strictly speaking, approximation can be further improved by approximating as follows using a trigonometric function or the like. This way the angle is

It becomes.

  FIG. 36 shows a method of measuring the tilt direction using a Fourier function.

  As shown in FIG. 35, eight cells 1 to 8 are used as measuring points, and the brightness of each cell is measured.

The sine function is
αj {sin (1/2) j−1 (θ−βj)}
It is represented by That is, there are two unknowns.

  Accordingly, when there are n measurement points, there are n discrete points, so the sum of n / 2 sine functions is obtained, and this is the brightness BL (i) at the radius from the analysis center. That is,

However, n = 2m (n is the number of stations)
It is represented by

  In this embodiment, since the number of measurement points is 8, n = 8. Therefore, the Fourier series α1 to α4 and β1 to β4 are obtained by synthesizing four sine function equations. The brightness BL (i) at the radius from the analysis center is represented by the sum of four sine functions.

  From the above formula, the angle θ at which BL (i) becomes the minimum value is the darkest position, and the opposite direction of 180 ° is the direction in which the scanner is inclined.

  FIG. 37 shows a method of measuring the tilt direction by solving an nth-order equation.

The graph in FIG. 37 shows an n-order function. When an n-order function is used, the brightness BL (i) at the radius from the analysis center is
BL (i) = α1 (θ−β1) · α2 (θ−β2)... Αj (θ−βj)
However, j = n / 2, n = 2m
It is represented by

  As shown in FIG. 35, since there are eight measurement points in this embodiment, it is necessary to obtain eight solutions. Since one equation includes two unknowns αj and βj, four equations are solved to obtain α1 to α4 and β1 to β4.

  Thereby, the angle θ at which BL (i) is the minimum value is obtained. The position corresponding to the angle θ is the darkest position, and the direction opposite to 180 degrees is the direction in which the scanner is inclined.

  Note that the measurement method shown in FIGS. 36 and 37 cannot measure the inclination of the scanner with respect to the vertical line of the map. Therefore, when the measurement method shown in FIGS. 33 to 34 is used in combination, it is possible to measure a specifically tilted angle.

  FIG. 38 is an explanatory diagram showing another embodiment of the facility search function described with reference to FIG.

  In this embodiment, when the user performs a grid drag operation, a specified range is determined based on the locus, and a facility or the like specified by the user is searched within the range.

  In (a), A is the start point and B is the end point. When the user drags from arbitrary A to B in the map portion, the coordinate values of A and B are recognized, and a rectangle or square having AB as a diagonal line becomes the designated range. After the grid drag operation is performed, when a facility icon to be searched such as “GS” or “ATM” printed on the icon portion is clicked, only the facilities within the specified range are displayed.

  In (b), when the user drags from arbitrary A to B in the map portion, a circle having a radius of AB becomes the designated range. In (c), when the user draws an arbitrary shape such that the start point and the end point are the same, the shape becomes the designated range.

  FIG. 39 is an explanatory diagram showing a method of displaying a cross section by a grid drag operation in a three-dimensional map.

  (A) shows an operation performed by the user on the map, and (b) shows a screen displayed on the display (monitor) when the operation is performed. As shown in (a), the user performs a grid drag operation with A as the start point and B as the end point. Then, as shown in (b), a sectional view taken along the line segment AB is displayed on the display (monitor). Since the map has a Z coordinate as well as an XY coordinate as described in FIG. 23, the cross-sectional view can be easily generated based on the Z coordinate with respect to the XY coordinate in the line segment AB. This is because.

<Printing an electronic map>
40 to 44 are diagrams for explaining printing of an electronic map.

  FIG. 40A shows an electronic map. When this electronic map is printed, the map is output on paper as shown in FIG.

  When the electronic map (a) and the printed map (b) are associated with each other, it is originally necessary to express all latitudes and longitudes as XY coordinates.

  However, as shown in FIG. 41A, since the dot code assigned to the latitude / longitude is 8 bits, it is impossible to express all the latitudes / longitudes, and different latitudes / longitudes can be represented by the same XY. Sometimes expressed in coordinates.

  Therefore, a map number is provided in the upper left part of the page, and a different map number is assigned to each map. Thereby, even if the same XY coordinates are used, it is possible to print maps with different latitudes and longitudes.

  FIG. 41 is a diagram for explaining the dot code format of the print map.

FIG. 41A shows a table of values defined in 32 bits from C _{0 to} C ₃₁ of the dot pattern. C _{0 to} C ₇ are Y coordinate, C _{8 to} C ₁₅ are X coordinate, C _{16 to} C ₂₉ are feature codes, and C _{30 to} C ₃₁ are parity.

C _{16 to} C ₂₉ are not limited to the feature codes, but may be other codes (code values).

  Further, the dot code is not limited to 32 bits, but may be other number of bits.

  Here, the feature code is a unique code assigned to a house, a building, or the like provided on the ground, but it is not always necessary to use the code, and the latitude and longitude may be used instead.

  The user can freely set the feature code and the longitude / longitude. Note that latitude and longitude cannot overlap for different features.

  When such an electronic map is opened to the user, if the user applies for a feature code each time his / her feature is registered, the code issuing procedure becomes complicated and its management becomes difficult. End up.

  Therefore, if the latitude / longitude of the position where the user's own feature exists is substituted for the feature code, all users can freely register the latitude / longitude as the feature code.

  FIG. 41B is a table showing the correspondence between map numbers, X coordinates, and Y coordinates.

  The table is stored in the storage means, and the minimum value / maximum value of the X coordinate and the minimum value / maximum value of the Y coordinate are registered in association with each map number.

  42 to 43 are diagrams illustrating the scale when printing an electronic map.

  As shown in FIG. 42A, an electronic map is displayed on the monitor in the range of vertical M and horizontal L. The maximum print area of the paper is vertical K and horizontal J as shown in FIG.

  As shown in (c), when the aspect ratio of the electronic map is less than or equal to the aspect ratio of the maximum print area,

, The electronic map is scaled so that the width L of the electronic map becomes the width J of the paper. Therefore, the scale factor is

It becomes.

  On the other hand, as shown in (d), when the aspect ratio of the electronic map is larger than the aspect ratio of the maximum print area, that is,

, The scale is scaled so that the length M of the electronic map becomes the length K of the maximum print area. Therefore, the scale factor is

It becomes.

  In the present embodiment, as shown in FIG. 43, the user can determine the scale of the map and print the electronic map.

  FIG. 44 is a flowchart for explaining the printing process of FIGS. 42 and 43.

  First, it is determined whether or not the print mode is ON (4401). When the user gives a print instruction such as clicking a print icon (not shown), an interrupt signal for printing is generated. When the central processing unit (CPU) receives the signal, the print mode is turned on.

  If it is determined that the print mode is ON, it is determined whether a paper size has been selected (4402). The user can select an arbitrary paper size from a plurality of sizes such as A4, B5, and A3.

  If the paper size is selected, it is determined whether or not the user has specified a scale (4403).

  When the scale is designated, the scale ratio designated by the user is determined (4404).

  If no scale is designated, the central processing unit (CPU) compares the vertical and horizontal ratio of the electronic map with the vertical and horizontal ratio in the maximum print area on the paper (4405). If the aspect ratio of the electronic map is less than or equal to the aspect ratio of the maximum print area,

If the

(4406).

  On the other hand, when the aspect ratio of the electronic map is larger than the aspect ratio of the maximum print area,

If the

(4407).

  Next, the printing area is determined (4408). The central processing unit (CPU) determines the printing area according to the scale determined by the processing in step 4404, 4406 or 4407.

  Next, output processing is performed (4409). The central processing unit (CPU) prints the map to which the dot pattern is added from the printing device, and ends this processing.

<Link between electronic map and dot pattern>
45 to 46 are diagrams for explaining a link between an icon on the electronic map and an icon sticker.

  A link refers to associating icon information on an electronic map with a dot pattern of an icon seal. For example, when the icon is a restaurant, the icon information includes information such as the Web address of the restaurant and the latitude and longitude where the restaurant is located.

  The link setting is managed by a table in the storage unit shown in FIG.

  To perform link processing, the user first clicks on an icon to be linked using a mouse. Then, the central processing unit (CPU) reads the address corresponding to the feature code of the clicked icon with reference to the table shown in FIG. Further, latitude / longitude values indicating the positions of the icons are stored in the memory. Next, when the user clicks on the icon sticker with the scanner, the central processing unit (CPU) registers the icon address and map information on the electronic map in association with the dot code of the dot pattern. Thereby, the link process is completed.

  The icon sticker that has been subjected to the link process can be used by being pasted into a notebook as shown in FIG. Moreover, the icon on which such a dot pattern is printed is not limited to a sticker, but may be in another form such as a sticky note.

  Further, as shown in FIG. 47, the user can register an arbitrary Web address for the icon on the electronic map in the table.

  FIG. 48 is a diagram for explaining an embodiment in which an electronic map and a map book on which dot patterns are superimposed and printed are used in association with each other.

  A dot pattern is preliminarily printed on the map book. Feature information such as icons is not described.

  By attaching an icon sticker that links XY coordinates and feature information to this map book, the user can associate only necessary icons from the icons displayed on the electronic map.

  A procedure for associating an electronic map with a map book will be described with reference to the flowcharts of FIGS.

  First, it is determined whether or not an icon on the electronic map is clicked by the user (4901). When the user places the cursor on the icon on the electronic map and clicks it with the mouse, an interrupt signal indicating that the icon has been clicked is transmitted to the central processing unit (CPU) of the computer. If the central processing unit (CPU) determines that a signal has been received, the process proceeds to step 4902.

  Next, latitude / longitude (x, y) is calculated (4902). The central processing unit (CPU) calculates the latitude and longitude of the clicked icon. Next, feature information such as a Web address registered in the icon is obtained (4903).

  Next, it is determined whether or not the map book is clicked by the user (4904). As shown in FIG. 48B, when the user clicks the map book using the scanner, the scanner reads the dot pattern superimposed on the map book. The central processing unit (CPU) of the scanner analyzes the dot pattern with analysis software and converts it into a dot code (code information). This dot code is transmitted to the central processing unit (CPU) of the computer. When the dot code is transmitted, it is determined that the map book is clicked.

  Next, the central processing unit (CPU) of the computer performs calculation for converting the XY coordinate information in the transmitted dot code into latitude / longitude (x ′, y ′) (4905).

  Next, it is determined whether the latitude / longitude calculated in 4902 and the latitude / longitude obtained in 4905 are substantially the same (4906). In this process, what percentage error is determined to be almost coincident is stored in advance in the storage means. If it is determined that they are almost the same, the process proceeds to 5001, and if it is not determined that they are the same, the process 4904 is performed again.

  Next, location registration processing is performed (5001). The central processing unit (CPU) registers the latitude / longitude of the electronic map in association with the XY coordinates of the map book in the storage means.

  Then, after that, the central processing unit (CPU) determines whether or not a sticker is attached (5002), and when it is recognized that the sticker is attached and clicked (5003), from the sticker. It is determined whether or not the read dot pattern substantially matches the XY coordinates registered above (5004). If they match, link processing (5005) is performed, for example, to a corresponding address (URL) registered in the table. Execute access.

  FIG. 51 is a diagram for explaining an operation of scrolling the electronic map by the grid tilt operation. Here, as described with reference to FIGS. 18 and 20, the grid tilt operation recognizes the tilted direction due to the difference in brightness in the imaging field generated by tilting the scanner, and performs a predetermined operation.

  For example, when the scanner is tilted in the direction (1) of FIG. 10A (rightward on the paper surface), the electronic map is scrolled in the upper right direction of the screen as shown in FIG. When the scanner is tilted in the direction (2) in FIG. 10A (leftward on the paper surface), the electronic map is scrolled in the lower left direction of the screen as shown in FIG. When the scanner is tilted in the direction (3) of (a) (upper right direction on the paper), the electronic map is scrolled in the upper right direction of the screen as shown in (3) of FIG.

  52 and 53 are diagrams illustrating an operation of enlarging or reducing the electronic map by the grid grind operation.

  The grid grind operation is as described in FIG.

  In the figure, when the rear end of the scanner is rotated clockwise (clockwise), the electronic map displayed on the display screen is gradually enlarged (FIG. 52), and when rotated counterclockwise (counterclockwise), the display is displayed. The electronic map displayed on the screen is gradually reduced and displayed (FIG. 53).

  FIG. 54 is a diagram illustrating an operation for switching modes by a grid tapping operation.

  The grid tapping operation is the operation of the scanner described with reference to FIG. In other words, it is an operation of hitting the map by moving the scanner up and down with the scanner standing in the vertical direction of the map. In the map according to the present embodiment, as shown in FIG. 54A, the grid tapping operation can be switched to three types of modes: a map mode, an information mode, and an aerial photograph mode.

<Feature information>
FIG. 55 is a diagram illustrating an operation for displaying feature information on a monitor.

  As shown in the figure, a map and a feature symbol (for example, an icon) are printed on the map book, and a dot pattern is printed so as to be superimposed on these prints.

  When these feature symbols (icons) are imaged by the scanner, the dot pattern on the feature symbols (icons) is read by the scanner and converted into dot codes, and the corresponding feature information is displayed on the display monitor. Is displayed ((b) of the figure).

  FIG. 56 is an explanatory diagram in a case where latitude / longitude where a representative point on a map is located is used as an attribute code.

  That is, the map is divided into a plurality of divided areas, and a representative point (10 m × 10 m area here) is set for each divided area.

  That is, in the divided area, the latitude / longitude at which the representative point is located is used as the attribute code of the area.

  FIG. 57 shows an example of a correspondence table for associating attribute codes, representative points, and addresses (URLs, etc.).

  Thus, by using the latitude / longitude of the representative point as the attribute code of the divided area, the same attribute code can be assigned to a predetermined divided area (for example, a municipality or an administrative division).

  The attribute code may be used not only for the latitude / longitude of the representative point but also for the latitude / longitude of the centroid of the divided area as shown in FIG.

  If there is a feature code, you can identify your company or home on the map. However, feature codes cannot be issued by individuals. A huge management system is required to issue feature codes.

  However, if the latitude and longitude can be used as the feature code, it becomes very easy to specify the location. Therefore, in the present embodiment, latitude and longitude are used as feature codes.

  FIG. 59 shows an example in which a paper medium on which a map and a dot pattern are superimposed and printed is read by a scanner and a feature icon is displayed on an electronic map.

  When a map medium on which XY coordinates and feature information codes are printed in a dot pattern is read by a scanner, the feature information codes and XY coordinates are read into a personal computer.

  The central processing unit (CPU) of the personal computer refers to the feature information code table of the storage means and reads multimedia information such as an image, a moving image, and character information stored at an address corresponding to the feature information code. Output from the display screen or speaker of the personal computer.

  On the other hand, in this table, the latitude and longitude as the representative point of the feature is also associated with the feature information code and the address. For example, when there is a spread of XY coordinates in a range in the feature, The latitude and longitude as the representative point of the feature is used. By using the concept of a representative point of a feature in this way, it becomes easy to calculate the distance from the station of the feature.

  The XY coordinates read together with the feature information code are converted into latitude and longitude according to a conversion algorithm prepared in advance, and an electronic map is displayed.

(Map mode)
The map mode and the information mode can be switched by reading an icon (dot pattern) printed in advance on a paper medium with a scanner.

  In the map mode, when the XY coordinates are read, they are converted into latitude and longitude according to a conversion algorithm prepared in advance, and an electronic map centered on the latitude and longitude is displayed.

  At this time, if the window is divided on the display screen on the personal computer and multimedia information such as images, moving images, and character information can be displayed simultaneously with the electronic map, the image is read simultaneously with the XY coordinates. Multimedia information stored at an address corresponding to the object information code is output.

(Information mode)
When the feature information code is read in the information mode, the multimedia information is read and output from the address corresponding to the feature information code.

  When calculating the distance from the feature to the station, etc., the latitude and longitude as the representative point of the feature is read out, and the latitude and longitude are calculated as the latitude and longitude of the feature.

  In either map mode or information mode, when a feature information code is read, it is possible to display, calculate distance, etc. using the latitude and longitude as the representative point of the feature associated with it. It is.

<Scrolling electronic map>
60 and 61 are diagrams illustrating a method of scrolling an electronic map.

  As shown in FIG. 60A, when the user taps the scanner twice or more continuously at an arbitrary position on the map (paper medium) and then slides the scanner on the map, as shown in FIG. The electronic map (the map displayed on the display monitor) is scrolled in the sliding direction.

  At this time, the grid tilt means an operation of tilting the scanner back and forth, and the position on the map can be specified by this operation. Further, the position on the map may be specified by repeated tap operations. In short, the grid tilt / repeated tap operation means that the dot pattern on the map (on the medium surface) is recognized twice or more by operating the scanner on the map.

That is, the XY coordinates (a ₁ , a _{2 in} FIG. 61) at the time of imaging are captured by recognizing the dot pattern on the medium surface twice or more continuously, and then the imaging means is slid on the medium surface. Thus, the difference ((b ₁ = f ₁ (a ₁ , Δx), b ₂ = f ₂ (a ₂ , Δy)) from the XY coordinates (b ₁ , b ₂ ) when the scanner is moved away from the map Based on this, the direction and amount of movement are determined and displayed on the display screen.

  As shown in FIG. 61, based on the amount of difference in the XY directions read by the scanner, this is converted into latitude and longitude. Finally, the amount of movement is expressed by latitude and longitude.

  In the case of the tapping operation, the program of the central control unit (CPU) may recognize the grid tapping operation of the scanner by the change in brightness of the continuous reflected light from the map surface (medium surface).

  As described above, in order to recognize the tapping operation, the scanner does not necessarily need to read the dot pattern (coordinate value) first, but the map surface is changed by the change in brightness of continuous reflected light from the map surface (medium surface). It can be recognized that the scanner is tapped on (medium surface). When the tapping operation is completed, the scanner stops on the map surface (medium surface). At that time, the dot pattern on the map surface (medium surface) may be read as a coordinate value or a code value.

  FIG. 62 is a diagram illustrating a procedure for associating a dot pattern printed on a medium with latitude and longitude.

  The user can register the dot pattern and the latitude and longitude of the electronic map in association with each other.

  Specifically, the user moves the cursor to the position (a, b) (latitude is a, longitude is b) on the electronic map shown in (a), and clicks using the mouse. Next, the user clicks the seal as shown in FIG. Then, the latitude a, the longitude b, and the dot code of the seal are associated and registered as a table shown in (c). Thus, when the user clicks on the seal, (a, b) is displayed at the center of the electronic map.

  The medium on which the dot pattern is printed is not limited to a sticker, but may be another medium such as an icon or a bookmark.

  FIG. 63 shows an example in which the electronic map and the feature information are displayed on the same display monitor.

  FIG. 64 is a diagram illustrating a case where different inks that can be discriminated are used for ink for printing an electronic map and ink for printing a dot pattern.

  (A) explains the case where two types of ink having different frequency characteristics are used. Ink A and ink B have different frequency characteristics. For example, ink A and ink B have different color contents at frequency α. Therefore, the dot pattern, the map, and the icon are discriminated by analyzing the color of the medium on which the dot pattern, the map, and the icon are superimposed and printed.

  (B) illustrates the case where two types of ink are discriminated depending on whether light of an arbitrary frequency is absorbed or reflected. For example, as shown in the figure, at frequency β, ink A is reflected and ink B is absorbed. By using the ink B for printing the dot pattern and using the ink A for printing the map and the icon, it is possible to distinguish the dot pattern from the map and the icon.

  Note that the ink that absorbs light at an arbitrary frequency and the ink that reflects reflect ink that has a high light absorption rate at an arbitrary frequency and an ink that has a high reflectivity.

  (C) explains the case where the ink B is an invisible ink in the case of (b). That is, since the ink B is invisible in the visible light region, it is difficult for the user to recognize the dot pattern.

  In this way, the ink for printing the map and the ink for printing the dot pattern have different characteristics, that is, inks having different light absorption characteristics and light reflection characteristics that can be discriminated when photographed with a scanner or the like. As a result, it is possible to increase the security of the dot pattern and to provide various types of information such as printing different information for each characteristic.

CPU Central processing unit MM Main memory USB I / F UFB interface HD Hard disk device DISP Display device (display means)
KBD keyboard NW I / F network interface NW network

Claims (1)

Downloading electronic map data having latitude / longitude information stored in a server and displaying the electronic map data on a display device; and
Receiving a print instruction for the electronic map displayed on the display device;
Associating at least XY coordinates with the electronic map when receiving the print instruction;
Storing the map number given based on the print instruction, the latitude / longitude of the print center, and the scale in association with each other in the storage means, and including the XY coordinates and the map number in the dot pattern;
Adding the dot pattern to the electronic map and performing a print output process;
A print output processing method for obtaining a print map capable of inputting information from a displayed electronic map.

Images