JP5654278B2 - Information input / output method and information input / output apparatus using stream dots - Google Patents

Description

  The present invention relates to a technique for optically reading stream dot pattern information formed on a printed material and reproducing various information corresponding to the dot pattern.

  2. Description of the Related Art Conventionally, a sound generating toy that reads a bar code printed on a picture book or a game card using an optical sensor and produces a specific sound has been proposed. In these sound generating toys, various kinds of sound information can be reproduced by reading out sound information corresponding to the read barcode from the memory.

  However, the technology using such a barcode requires a dedicated area for barcode printing on the paper surface, and the barcode is for the information processing system to read. For readers, the contents of the code could not be grasped visually, so the bar code printed on limited paper is bothersome for the reader and can reduce the product value of books such as picture books. It was.

  Furthermore, as mentioned above, the barcode technology cannot be printed over the characters, figures and symbols printed on the paper. In other words, the barcode has to be printed in the vicinity of the characters, etc., and the reader has the characteristic that it is difficult for the reader to tell intuitively that other audio information has been added to the characters.

  Regarding this point, in the “dot code” technique disclosed in Japanese Patent Laid-Open No. 10-261559, a method of reading code information printed with a dot pattern and reproducing the information has been proposed.

Japanese Patent Laid-Open No. 10-261059

  In such prior art, data is defined according to the arrangement of dot patterns in a block area, and markers are defined by dot patterns that cannot be data dot patterns, thereby functioning as synchronization signals. Therefore, in this technique, a dot pattern in which dots are printed in a two-dimensional direction on the paper surface according to a predetermined law is read by a pen-type scanner, and the scanning speed and scanning direction of the scanner are analyzed by an information processing device and associated in advance. It is a method of reproducing information such as voice.

  However, since the dot code technology is based on the premise that the scanner is dynamically scanned, it is possible to reproduce audio information along the characters printed on the paper surface, but there are characters or the like on the paper surface. It is not suitable for applications in which information is to be reproduced simply by bringing the reader into contact with a picture book or the like that is freely printed and arranged. In other words, in order to obtain meaningful code information in this dot code technology, it is necessary to perform scanning over a certain distance on the XY coordinates, so the dot code is associated with the minimal area printed on the paper. Could not be printed.

  The present invention proposes a dot pattern in which code information and XY coordinate information can be defined even in a minimal region, and proposes an information input / output method and an information input / output device based on the dot pattern.

  (1) An information input / output method according to the present invention includes a step of arranging a plurality of reference dots continuously in a line according to a predetermined rule in order to output various multimedia information, and the plurality of reference dots. Providing a first virtual reference line composed of a straight line, a broken line and / or a curve, and a straight line and / or a curve defined at a predetermined position from the reference dot and / or the first virtual reference line A step of providing at least one or more second virtual reference lines, a step of providing a plurality of virtual reference points at predetermined positions on the second virtual reference line, and a vector represented by the virtual reference points as starting points At the end point, a stream dot pattern arranged in accordance with the step of arranging information dots in which the XY coordinate value and / or code value is defined by the distance and direction from the virtual reference point is one line. Alternatively, a medium such as a printed matter on which a plurality of dot patterns formed side by side are formed is read as image data by an optical reading unit, the dot pattern of the image data is analyzed and converted into the XY coordinate values and / or code values, and the XY The multimedia information corresponding to the coordinate value and / or code value is read from the storage means and output.

  Here, the multimedia information may be any information such as sound, image, moving image information, and visible, audible and readable information such as characters and symbols. Furthermore, it may be digital data for reproducing moving image / audio information, character information, etc. from another personal computer, a television receiver system or a radio broadcasting terminal.

  Here, by forming a plurality of stream dot patterns with a constant reference point interval, the XY coordinate values are defined on the medium such as a printed matter without any gaps. Furthermore, when characters, staffs, maps, figures, etc. are printed on a print medium, and the user scans or touches the line segment with a scanner pen, a stream dot pattern is formed only along that line segment. , Can arrange the dot pattern reasonably. In addition, when a dot pattern in which XY coordinates are defined is formed as a two-dimensional code (used as an index), it is not restricted by the shape of the rectangular area, and is matched to the information area visually formed on the medium surface. In addition, it is possible to form a dot pattern by repeating a set of constant information in a free shape.

  In the dot pattern (607), code information corresponding to audio data registered in the storage unit may be defined, or an XY coordinate value may be defined. Also, code information and XY coordinate values may be mixed. A flag defining whether the dot pattern is code information or XY coordinates can be registered in the header of the dot pattern (607).

  The medium can be a picture book or a photograph. Even if the dot pattern (607) for recognizing the audio information corresponding to the picture (606b) of the picture book or the like is superimposed on the picture (606b) and printed. Good.

  (2) Also, the stream dot pattern is a reference for defining the second virtual reference line and / or for defining the direction of the dot pattern and one XY coordinate value and / or code value. A reference dot may be provided at a predetermined position.

  According to this, by setting a new reference point, it is possible to easily define the direction of the stream dot pattern and a set of constant information without using information dots, thereby suppressing unnecessary information reduction. It is done. Furthermore, the position of the virtual reference point that is the starting point of the information dot can be accurately indicated by the arrangement of the new reference point.

  (3) The optical reading unit may include an irradiation unit that irradiates infrared rays or ultraviolet rays, and may read only the dot pattern printed with ink that absorbs infrared rays or ultraviolet rays.

  (4) Further, the medium is a printed matter or a photograph, and the dot pattern is formed so as to overlap in order to output sound information corresponding to characters or designs arranged on the medium, or It may be formed by being divided into a plurality of regions according to the printed matter or the picture pattern.

  (5) Moreover, the said dot pattern may be formed in the surface of the sealing material which can be stuck on the said printed matter, a card | curd, or a solid substance.

  Thus, the dot pattern may be printed on the sealing material.

  Moreover, you may form a dot pattern (607) in a transparent film (611). In that case, the said transparent film may be arrange | positioned on a paper surface, and may be affixed on the display means (613) of solid objects, such as an electronic device, using the said transparent film (611) as a touch panel. In this case, the instruction information may be displayed on the display means (613) to prompt the user to operate the reading means.

  Further, an infrared blocking filter (614) may be disposed between the touch panel (612) and a medium such as the paper surface or the screen of the display means (613).

  The touch panel may be attached to a book such as a picture book, a drawing, or the like in addition to the case where the touch panel is attached to the display means (613).

  (6) An information input / output device according to the present invention includes a step of arranging a plurality of reference dots continuously in a line according to a predetermined rule in order to output various multimedia information, and the plurality of reference dots. Providing a first virtual reference line composed of a straight line, a broken line and / or a curve, and a straight line and / or a curve defined at a predetermined position from the reference dot and / or the first virtual reference line A step of providing at least one or more second virtual reference lines, a step of providing a plurality of virtual reference points at predetermined positions on the second virtual reference line, and a vector represented by the virtual reference points as starting points At the end point, a stream dot pattern arranged in accordance with the step of arranging information dots in which the XY coordinate value and / or code value is defined by the distance and direction from the virtual reference point is one line. Alternatively, with respect to a medium such as a printed matter on which a plurality of dot patterns formed side by side are formed, an optical reading unit that reads the dot pattern of the medium as image data, and converts the dot pattern of the image data into XY coordinate values and / or code values Analysis means for storing, storage means for storing multimedia information corresponding to the XY coordinate values and / or code values, and output means for outputting the multimedia information.

  (7) The medium may be a mouse pad or a tablet, and the optical reading unit or the optical reading unit and the analyzing unit may be accommodated in a mouse or a pen case.

  (8) The information input / output device may be housed in a pen-like case.

  (9) Further, the information input / output device has a microphone as an input unit and stores the recorded voice in the storage unit so as to correspond to an XY coordinate value and / or code value defined in an arbitrary dot pattern. A link table is generated by a predetermined method, the dot pattern is read by the optical reading unit, the XY coordinate value and / or the code value is converted by the analyzing unit, and the XY coordinate value and the code value are referred to by referring to the link table. The voice corresponding to the code value may be output.

  According to this, audio information is associated with each dot pattern, and when the dot pattern is read by the optical reading unit, the audio information related to the dot pattern can be output. In this way, a dot pattern is printed on the surface of a picture book, a card, etc., and voice information corresponding to a picture book pattern or story is reproduced, or voice information corresponding to a character written on a card is reproduced. Can do. Further, the voice information can be newly related to, released from or changed to the new dot pattern by the correlation instruction means.

  (10) The link table reads an arbitrary dot pattern with the optical reading means within a predetermined time during recording of the voice or after recording, or presses a link button provided in the optical reading means. While reading an arbitrary dot pattern with the optical reading means, or reading the dot pattern superimposed on a link icon on the medium with a link icon for a link instruction, the optical reading is performed immediately thereafter. An arbitrary dot pattern may be read by the means, or the sound recorded on the XY coordinate values and / or code values converted by the analysis means may be generated in correspondence.

  According to this, it is possible to newly associate voice information with a new dot pattern by a simple method.

  (11) The information input / output device may be a PC, a PDA, a mobile phone, or an electronic toy.

  (12) The electronic toy may be a figure, and the optical reading means may be provided downward on the bottom of the figure to read a dot pattern provided on the medium surface.

  According to this, various games such as a board game and a self-propelled toy can be provided by using a mechanism in which the figure reads the dot pattern provided on the medium.

  (13) In addition, the optical reading unit transmits an image obtained by reading the dot pattern to the analyzing unit, or the optical reading unit reads the dot pattern as an image, and is converted by the analyzing unit. You may provide the transmission means which transmits XY coordinate value and / or code value to the said memory | storage means.

  According to this, in accordance with the purpose of the user, the optical reading unit can have a structure that only reads the dot pattern, or can have a structure that can convert the dot pattern into XY coordinate values and / or code values.

FIG. 1 is a diagram (1) illustrating a stream dot pattern used in the present invention. FIG. 2 is a diagram (2) for explaining the stream dot pattern used in the present invention. FIG. 3 is a diagram (3) for explaining the stream dot pattern used in the present invention. FIG. 4 is a diagram (4) for explaining the stream dot pattern used in the present invention. FIG. 5 is a diagram (5) for explaining the stream dot pattern used in the present invention. FIG. 6 is a diagram (6) for explaining the stream dot pattern used in the present invention. FIG. 7 is a functional block diagram for explaining the state of the picture book and the information reproducing method. FIG. 8 is a front view showing an example in which a picture book picture and a story text are printed. FIG. 9 is a front view showing another example in which a picture book picture and a story text are printed. FIG. 10 is a front view showing still another example in which a picture book picture and a story text are printed. FIG. 11 is a cross-sectional view showing another embodiment in which a printing surface on which a dot pattern is formed is used as a tablet. FIG. 12 is an explanatory diagram showing a dot pattern composed of XY coordinate information. FIG. 13 is an explanatory diagram of a processing method for recognizing a dot pattern composed of XY coordinate information. FIG. 14 is an explanatory diagram of another method for recognizing and processing a dot pattern made up of XY coordinate information. FIG. 15 is an explanatory diagram showing a dot pattern composed of code number information. FIG. 16 is an explanatory diagram of a method for recognizing and processing a dot pattern made up of code number information. FIG. 17 illustrates a state in which only image data of a dot pattern printed with carbon ink is captured by a camera from an information transmission unit such as characters or figures printed with non-carbon color ink by irradiating the printed matter with infrared rays. It is explanatory drawing. FIG. 18 is a functional block diagram illustrating an embodiment of a portable information input / output device using an information input / output method by camera input. FIG. 19 is a functional block diagram illustrating an embodiment of a portable information input / output device using an information input / output method by camera input. FIG. 20 is a perspective view showing a portable information input / output device housed in a compact case body. FIG. 21 is a functional block diagram illustrating an embodiment in which the camera unit and the output portion are configured separately. FIG. 22 is a functional block diagram illustrating an embodiment in which the camera unit and the output portion are configured separately. FIG. 23 is a perspective view showing an apparatus in which the camera unit portion and the output side main body are separated. FIG. 24 is a functional block diagram illustrating an embodiment of an information input device using a camera for a mobile phone. FIG. 25 is a functional block diagram illustrating an embodiment of an information input device using a camera. FIG. 26 is a front view showing an embodiment of a portable electronic toy using a dot pattern. FIG. 27 is a right side view showing the portable electronic toy. FIG. 28 is a left side view showing a portable electronic toy. FIG. 29 is a bottom view showing a portable electronic toy. FIG. 30 is a perspective view showing an embodiment of a portable electronic toy that mainly generates sound corresponding to a minifigure. FIG. 31 is a functional block diagram of the portable electronic toy according to the embodiment. FIG. 32 is a perspective view showing a state where a plurality of sound generating toys are connected to the controller unit. FIG. 33 is a functional block diagram illustrating an embodiment in which a camera and an output unit are integrally configured for a figure unit having an information output function by camera input. FIG. 34 is a functional block diagram illustrating a modification of the embodiment. FIG. 35 is a functional block diagram illustrating an embodiment in which a camera unit and an output unit are configured separately for a figure unit having an information output function by camera input. FIG. 36 is a functional block diagram illustrating a modification of the embodiment. FIG. 37 is a perspective view showing a figure provided with a camera unit, where (a) shows a doll, (b) shows a soccer ball, (c) shows a car, and (d) shows an animal. FIG. 38 is a perspective view showing a state where the figure unit is placed on the central battle stage of the new simulation board game. FIG. 39 is an explanatory sectional view showing another embodiment of the present invention in which a camera unit and an output unit are built in a stuffed toy that is one form of a figure. FIG. 40 is an explanatory cross-sectional view showing another embodiment in which a camera unit and an output unit are built in a stuffed toy that is one form of a figure. FIG. 41 is an explanatory sectional view showing another embodiment of the present invention in which a camera unit and an output unit are incorporated in a stuffed toy that is one form of a figure. FIG. 42 is an explanatory diagram showing the structure of the pen-type scanner. FIG. 43 is an explanatory diagram showing a state where the pen-type scanner is connected to the apparatus main body. FIG. 44 is an explanatory diagram showing a wireless pen-type scanner. FIG. 45 is an explanatory diagram showing a modification of the pen-type scanner. FIG. 46 is a perspective view showing a board game to which the present invention is applied. FIG. 47 is a perspective view showing a state in which the minifigure and the apparatus main body are separated. FIG. 48 is an explanatory diagram when the dot pattern formed on the pedestal is read by the scanner unit provided on the bottom surface of the minifigure. FIG. 49 is a cross-sectional view showing another configuration example of the minifigure. FIG. 50 is an explanatory diagram showing a toy using a card provided with a dot pattern. FIG. 51 is a front view of a card used in the toy of FIG. FIG. 52 is a front view showing a crossword puzzle played with a pen-type scanner. FIG. 53 is an enlarged front view showing a state in which a hint is displayed on the liquid crystal display unit. FIG. 54 is a perspective view showing a stuffed toy of a self-propelled cat. FIG. 55 is a perspective view showing a self-propelled or radio-controlled toy car. FIG. 56 is a perspective view showing a competitive card game to which the present invention is applied. FIG. 57 is a perspective view of the apparatus main body in which only one card can be inserted. FIG. 58 is an explanatory diagram showing a case where the apparatus main body is a simple card reader. FIG. 59 is a perspective view of an apparatus main body for continuously reading a large postcard sheet on which a dot pattern is formed. FIG. 60 is a perspective view of an apparatus main body that can be used in a POS register or the like. FIG. 61 is an explanatory diagram showing an example in which the apparatus main body and a minifigure are combined. FIG. 62 is an explanatory diagram showing an example in which the apparatus main body is connected to a television monitor. FIG. 63 is a perspective view of a photo stand type apparatus main body. FIG. 64 is an explanatory diagram showing a state where the pen-type scanner is connected to the personal computer via the USB cable. FIG. 65 is an explanatory diagram showing a state where a pen-type scanner is connected to the PDA with a cable. FIG. 66 is an explanatory diagram showing connection with a personal computer when the scanner is built in the mouse. FIG. 67 is a cross-sectional view showing a mouse having a digitizer function. FIG. 68 is a perspective view showing a mouse having a digitizer function. FIG. 69 is a perspective view showing a configuration in which a scanner unit is provided in the main body of the PDA. FIG. 70 is a perspective view showing a configuration in which a scanner unit is provided in a personal computer main body. FIG. 71 is a front view (1) showing a scanner-integrated mobile phone. FIG. 72 is a diagram illustrating a state where the pen-type scanner is connected to the connector of the mobile phone. FIG. 73 is a front view (2) showing the scanner-integrated mobile phone. FIG. 74 is an explanatory diagram showing a configuration in which a liquid crystal display unit and a speaker are provided in a pen-type scanner. FIG. 75 is an explanatory diagram showing a configuration in which a microphone and a speaker are provided in a pen-type scanner. FIG. 76 is an explanatory diagram showing a case where a system notebook, notebook, and pen-type scanner are used in combination.

  First, an example of a method for forming a stream dot, which is a dot pattern used in the present invention, will be described with reference to FIGS.

  1 and 2 sequentially show an example of a process for forming a stream dot pattern.

  The dot pattern according to the present invention is different from the conventional dot pattern. First, in step 1, corresponding to the visible information on the surface of the medium, the reference dot 701 is continuously arranged in a line at a position where information is to be input / output. Place multiple.

  In FIG. 1A, the reference dots 701 are arranged in a curved shape. However, the arrangement of the reference dots 701 is not limited to this, and is composed of a plurality of line segments interwoven with straight lines and curves. Various modifications can be made to form the dot pattern in a shape that matches the area where information is input and output, such as a polygonal line.

  Further, the reference dot 701 may be arranged on a real line visibly formed on the medium surface, or the reference dot 701 may be arranged according to a predetermined rule along the real line. The real line here is a concept with respect to a virtual line, and includes all the lines that actually exist. For example, a solid line, a broken line, a dotted line, a straight line, a curved line, and the like can be mentioned. In the present invention, regardless of the medium on which the line is formed (for example, a display of a video display device) or the substance that forms the line (for example, ink). Absent. In addition, the dot pattern may be unevenness such as printing, display display, or a hole or groove on a metal or plastic.

  In addition, it is desirable to arrange the reference dots at equal intervals from the viewpoint of improving reading accuracy, but the reference dots are not limited to this, and a plurality of intervals are mixed to define a set of constant information of the dot pattern, It is also possible to define both a set of constant information of a dot pattern and a direction of the dot pattern by arrangement intervals of three different reference dots in the set of fixed information.

  Next, as step 2, a first virtual reference line 702 that connects the reference dots 4 arranged linearly is provided. In FIG. 1B, the first virtual reference line 702 is provided by a curved line, but the first virtual reference line 702 is not limited to this, and the reference dots 701 arranged in a curved line are not limited thereto. A straight first virtual reference line 702 may be provided, or a curved first virtual reference line 702 may be provided for the reference dots 701 arranged in a straight line. That is, depending on where the second virtual reference line 703, the virtual reference point 704, and the information dot 705 in Step 3 to Step 5 to be described later are arranged, a first line consisting of a straight line, a broken line and / or a curve connecting the reference dots. One virtual reference line 702 can be freely defined.

  As shown in FIG. 3, the first virtual reference line 702 in the case of a curve is preferably a Bezier curve.

  That is, first, the reference dots 704 on the first virtual reference line 702 are set as P0 and P3, and P1 and P2 are set as given control points. Next, points P4, P5, and P6 are obtained by dividing the three line segments P0-P1, P1-P2, and P2-P3 obtained by connecting the control points in order at a one-to-one ratio. Then, points P7 and P8 are obtained by dividing the two line segments P4-P5 and P5-P6 obtained by connecting these points in order at a one-to-one ratio.

  Finally, a point P9 that further divides the line segment connecting the two points, P7-P8, at a ratio of 1: 1 is obtained, and this point becomes a point on the Bezier curve.

  By repeating this procedure, a Bezier curve having control points P0, P1, P2, and P3 is obtained.

  Note that the first virtual reference line 702 may be provided using various algorithms such as a spline curve obtained using a spline function, an nth order polynomial, an elliptic arc, and the like, not limited to a Bezier curve.

  Also, in the second virtual reference line 9, it is possible to define a curve using this method as with the first virtual reference line 702.

  Next, as Step 3, a second virtual reference line 703 defined at a predetermined position from the reference dots 701 and / or the first virtual reference line 6 arranged in a line is provided. In FIG. 1 (c), the second virtual reference line 703 is arranged adjacent to the reference dot 701 toward a predetermined position on the vertical line with respect to the tangent line of the first virtual reference line 703 at the intermediate point between the adjacent reference dots 701. However, the second virtual reference line 703 is not limited to this, and a virtual reference point is provided in accordance with an area in which information is input / output by a dot pattern as will be described later. In addition, it can be defined by various methods.

  In addition, the second virtual reference line 703 may be provided only on one side with respect to the first virtual reference line 702 to define the direction of the dot pattern, or may be provided on both sides to increase the amount of information. .

  Next, as step 4, a plurality of virtual reference points 704 are provided at predetermined positions on the second virtual reference line 703. In FIG. 2A, the virtual reference point 704 is an isosceles triangle with the intersection of the second virtual reference line 703, that is, a straight line connecting adjacent reference dots 701 as the base and the second virtual reference line 703 as the opposite side. However, the position of the virtual reference point 704 is not limited to this, and it is provided at the midpoint of the second virtual reference line 703 or instead of the second virtual reference line 703. Various modifications such as provision on the dots 701 are possible.

  In step 5, the information dot 705 is arranged at the end point represented by a vector with the virtual reference point 704 as the start point. In FIG. 2B, one information dot 705 is arranged for one virtual reference point 704 so that the vector direction from the virtual reference point 704 is eight directions and the distance from the virtual reference point 704 is equal. However, the arrangement of the information dots 705 is not limited to this, and the information dots 705 are arranged on the virtual reference point 704, the vector direction is set to 16 directions, or two are arranged for one virtual reference point 704. It is possible to arrange a plurality of elements in any direction and in any length.

  FIG. 4 is an enlarged view showing an example of dot display information dots and bit display of data defined therein.

  The information dot 705 is a dot for recognizing various information. This information dot 705 is arranged at the end point represented by a vector with the virtual reference point 704 as the start point. For example, as shown in FIG. 4, the information dot 705 is rotated by 45 degrees clockwise because a dot 0.1 mm away from the virtual reference point 5 has a direction and a length expressed by a vector. These are arranged in 8 directions to represent 3 bits.

  In the illustrated example, 3 bits are expressed by arranging in 8 directions, but the present invention is not limited to this, and 4 bits can be expressed by arranging in 16 directions. Of course, it can be arranged in length.

  Further, in FIG. 2B, in all the virtual reference points 704, the information dot 705 is arranged at the end position starting from the virtual reference point 704. However, the present invention is not limited to this. Information may be defined depending on whether or not is arranged. For example, information can be defined as “1” if a dot is arranged on a virtual reference point, and “0” if no dot is arranged.

  FIG. 5 shows an example of the information dot and the bit display of the data defined therein, and shows another form.

  Further, regarding the information dot 705, if two types of short (upper part in FIG. 5) and long (lower part in FIG. 5) are used from the virtual reference point 5 derived from the reference dot 701, and the vector direction is eight directions, then 4 bits. Can be expressed. At this time, it is desirable that the longer one is about 25-30% of the distance between the adjacent virtual reference points 5, and the shorter one is about 15-20%. However, it is desirable that the center interval between the long and short information dots 3 is longer than the diameter of these dots.

The information dot 705 is preferably one dot in consideration of its appearance. However, if the appearance is ignored and the amount of information is to be increased, a large amount of information can be obtained by assigning 1 bit to each vector and expressing the information dot 3 with a plurality of dots. For example, the vector of concentric eight directions, an information dot 3 defined from the reference dots 4 can represent information of 2 ^8, and 2 ⁶⁴ in chunks of the information dot eight constant information 1.

  As described above, the stream dot pattern according to the present invention is continuous with a line including a curve unlike the reference dot formed in a two-dimensional lattice pattern in the conventional dot pattern proposed by the present inventor. Are formed based on the reference dots arranged in this manner.

  FIG. 6 is a diagram showing an example of a state in which stream dot patterns are arranged in the vertical direction.

  In the figure, in addition to the reference dots and information dots, key dots and side dots are arranged. Key dots are dots arranged at both ends of a set of fixed information. This key dot is a representative point of the dot pattern 1 for one region representing a group of information dots. The side dots are dots arranged on the positive and negative extension lines of the shift of the key dot 2.

  In FIG. 6B, reference dots and stream dot patterns are arranged at equal intervals. In this manner, by forming a plurality of stream dot patterns with a constant reference point interval, the XY coordinate values are defined without any gaps in the writing area. However, the stream dot pattern according to the present invention is not limited to this, and the interval between the dot patterns may be arbitrarily set as shown in FIG. Also, the interval between the reference dots can be set arbitrarily.

  As described above, the stream dot pattern according to the present invention is continuous with a line including a curve unlike the reference dot formed in a two-dimensional lattice pattern in the conventional dot pattern proposed by the present inventor. Are formed based on the reference dots arranged in this manner.

  As a result, the dot pattern in which the XY coordinates are defined is formed in the information area visually formed on the surface of the medium without being restricted by the shape of the rectangular area when used as a two-dimensional code (used as an index). It is possible to form a dot pattern by repeating a set of constant information in a combined free shape.

  Note that the virtual reference line and the virtual reference point according to the present invention are not actually printed and formed on the surface of the medium, but only when the dot pattern is arranged on the image memory of the computer or when the dot pattern is read. Is set virtually.

  By using this stream dot pattern, it is possible to form a dot pattern on a curved surface body such as a globe, a three-dimensional structure such as a human body model, a three-dimensional map, etc., and the present invention is not limited to a planar map or picture book. It is possible to use the input / output device according to the above.

  FIG. 7 is a functional block diagram for explaining the state of the information reproducing method using the picture book and the dot pattern of the present invention.

  The dot pattern 601 as described above is formed into a dot pattern 607 by printing on a printed material 606 such as a picture book or text. The dot pattern 607 is image-recognized by the camera 602, and the corresponding audio information is read from the memory based on the digitized data extracted from the image data, and the personal computer 608, PDA, mobile phone or other speaker 9 is used. The corresponding voice and music are reproduced from the output means.

  FIG. 8 is a front view showing an example in which a picture book picture and a story text are printed.

  In such a page, the icon 606a at the upper left of the page is read by the camera 602 and turned on. Next, the text portion 606c on which the text of the story corresponding to the pattern 6b is printed is read by the camera 602. Since the dot pattern 607 is printed on each of the icon 606a and the sentence portion 606c, the dot pattern 607 recognizes the information in which area of which page of the picture book, and the voice of the story stored so as to correspond to it. Is played back by the personal computer 608. For example, the dot 5 of the dot pattern 607 can be read with infrared irradiation by printing or printing with carbon, and printing or printing with the non-carbon color ink.

  FIG. 9 is a front view showing another example in which a picture book picture and a story text are printed. FIG. 10 is a front view showing still another example in which the picture book picture and the story text are printed.

  The information reproducing method using the dot pattern of the present invention is not limited to a picture book consisting of a story, but can be applied to teaching materials that teach arithmetic in an easy-to-understand manner as shown in FIG. Further, as shown in FIG. 10, it can be applied to teaching materials that teach music in an easy-to-understand manner.

  In the memory of the personal computer 608, PDA, or mobile phone, content that can be used as a picture book for generating conversations such as music and the main character in addition to the picture of the picture book as a “sound picture book” is stored. However, contents that can be used as teaching materials that generate sound in combination with toys such as building blocks, and contents that can be translated and used as dictionary software by tracing foreign words and sentences as “sounding dictionaries” Of course it is also possible.

The information reproducing method using the dot pattern of the present invention further has the following usage.
"Pop book with sound"
Taking advantage of the characteristic that the camera 602 only touches or scans the dot pattern 607, it can be combined with a “pop picture book” in which a three-dimensional object appears when a page is opened. When the page is opened, a dot pattern 607 is pasted or printed in a three-dimensional object, and when the dot pattern 607 is searched and the tip of the camera 602 is brought into contact, various sounds are generated. Can be used. For example, when the page is opened, a “Horror House” pops up, and when the dot pattern 607 in the “window” is traced with the camera 602, a female screaming voice such as “Care!” Is played and is in the “corridor” When the dot pattern 607 is traced with the camera 602, the sound of an eerie footstep such as “knack, knack, knack ...” is reproduced.

"Creative picture book (creative book)"
Use it as a “creative picture book (creative book)” where you can place a dot pattern 607 on a favorite part of the picture book, which is the printing unit 6, and you can set a switch anywhere if you put a dot pattern 607 that allows users to create content. can do. For example, an original story can be created by pasting a set of a picture book, a collection of lines, a sound list, sound source data, etc. with a line pattern 607 of lines or music on the picture book 6 as the user likes.

  In addition, a sticker for the sound source list on which a dot pattern 607 is formed, an icon sticker, etc. are prepared in a picture book on which nothing is drawn, and the user draws a picture on the picture book himself and attaches these stickers to the original. You can create stories and let users create picture books that produce sound.

"Sound teaching materials"
The present invention can be used as a “sound teaching material” for all generations from children to adults to elderly people. For example, when the tip of the camera 602 is brought into contact with or scanned with the dot pattern 607 of the printed matter 606, the sound is reproduced, and can be used as language teaching such as English conversation, early childhood education such as intellectual education and music, and auxiliary teaching material such as a drill.

  As described above, the present invention can be used as an input interface printed on the printed material 606 or the like, so that an interface suitable for each content can be manufactured. In addition, the dot pattern data can be downloaded to the personal computer 608 via a general-purpose network such as the Internet, and the user can freely combine the dot pattern data and print the dot pattern on the paper surface with a general-purpose printer device. The above-mentioned “picture book with picture” or the like can be created by the user himself / herself.

  Further, URL information is defined in the dot pattern 607 of other medium such as the printed material 606, and the URL is extracted from the image data obtained by capturing the dot pattern 607 with the camera 602, whereby the browser program installed in the personal computer 608 is added to the URL. You may make it access and perform a predetermined | prescribed operation | movement.

  FIG. 11 is a cross-sectional view showing another embodiment in which the printing surface on which the dot pattern 607 is formed is used as a tablet.

  In this embodiment, a printing surface on which a dot pattern 607 is formed using a pen-shaped member 619 in which a camera 602 is built in and a table 620 (or a trace table) is used as a tablet. A paper 621 (printing surface) on which a dot pattern 607 is printed is set on the table 620, a picture or character is traced with the pen-like member 619, and data is taken into the personal computer 608 or PDA by turning on the switch 622a. Can do. Further, the tip of the pressure switch 622 b is projected from the tip of the pen-like member 619.

  The pen-like member 619 can be used to draw a picture or character on paper at hand in the same way as drawing a normal picture or character without looking at the display. Is recognized and input to the personal computer 608 or PDA. Therefore, it can be used for illustrations, drawings, and tracing. Until now, it was necessary to look at the display while tracing with the mouse, but this is no longer necessary and the input load is reduced. In addition, operations that can only be realized with a coordinate input device conventionally called a tablet can be realized at low cost.

  Thus, the present invention can operate the personal computer 608 in place of the normal keyboard and mouse in the personal computer 608, and anyone can easily operate the personal computer 608 simply by pressing. Therefore, the present invention can provide an interface with a high affinity with humans. Further, it can be manufactured at a lower cost with a simpler structure than the input pad.

  Note that the present invention is not limited to the above-described embodiment of the present invention, and by recognizing the dot pattern 607 of the printed matter 606 or the transparent film 611 (touch panel 612), various information can be used by reproducing predetermined information and sound. Of course, the structure is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the present invention.

  FIG. 12 is an explanatory diagram showing a dot pattern composed of XY coordinate information. FIG. 13 is an explanatory diagram of a processing method for recognizing a dot pattern composed of XY coordinate information.

  The dot pattern 6 of the present invention can be created with XY coordinate information, and the XY coordinate information can be associated with the contents of the information transmission unit 7. As for the dot pattern 6, as described above, the image data is captured using the camera unit 2, the image information is digitized and digitized, and the X direction and the Y direction are converted into coordinate information. , Corresponding to any position of the contents of each information transmission unit 7 expressed by the square part B and the triangular part C. At this time, the XY coordinates are associated with the contents of each information transfer unit 7 using the reference table 1 of FIG. That is, which XY area is which content of the information transmission unit 7 is compared, and the information and program corresponding to the dot pattern 6 are output by referring to the reference table 2 in FIG.

  FIG. 14 is a diagram showing another method for recognizing and processing a dot pattern composed of XY coordinate information.

  The method shown in the figure is used when the information transmission unit 7 is rectangular. As shown in FIG. 2A, the printed matter 5 is printed with a dot pattern 6 made of XY coordinate information and an information transmission unit 7. As shown in FIG. 6B, the lower left coordinate value (Xmin, Ymin) and the upper right coordinate value (Xmax, Ymax) of the information transmission unit 7 are determined in advance. Next, with reference to the table of FIG. 10C, it is searched for which range of the table the coordinate value obtained in FIG. And the index No. corresponding to the corresponding range. To get. Next, referring to the table in FIG. Sound corresponding to the (goodbye, hello, etc.) to output. In the table of FIG. 4D, the audio file itself is index No. Alternatively, a plurality of addresses may be stored in the audio file, and the addresses may be associated with each other.

  According to the dot pattern 6 composed of the XY coordinate information, a printed matter 5 on which the dot pattern 1 is printed in advance is prepared, and a specific content (content) is obtained simply by overprinting the information transmission unit 7 on the printed matter 5. It is possible to associate the XY coordinate area with information such as speech and a program. That is, since it is not necessary to create the dot pattern 6 according to the contents of the information transmission unit 7, the versatility thereof becomes very high.

  FIG. 15 is an explanatory diagram showing a dot pattern composed of code number information. FIG. 16 is an explanatory diagram showing a dot pattern recognition and processing procedure comprising code number information.

  The dot pattern 6 of the present invention can be created with code number information instead of the XY coordinate information described above, and the code number information can be associated with the contents of the information transmission unit 7. For example, corresponding to the contents of the information transmission unit 7 of the circular part A, the information transmission part 7 of the square part B, or the information transmission part 7 of the triangular part C, the dot pattern 6 including one code number information is printed. . As for the dot pattern 6, as described above, the image data is captured by using the camera unit 2, the image information is digitized and digitized (code number information), and the reference table in FIG. 16 is referred to. Information and a program corresponding to the dot pattern 6 are output. In the reference table, the audio file itself is index No. Alternatively, a plurality of addresses may be stored in the audio file, and the addresses may be associated with each other.

  According to the dot pattern 6 composed of the code number information, the code number and the contents of the information transmission unit 7 directly correspond to each other, and therefore, one reference table may be created as shown in FIG. Furthermore, since only one reference table needs to be created, the information processing time can be shortened.

  Of course, it is possible to print the dot pattern 6 composed of the XY coordinate information and the code number information on the same plane of the printed matter 5.

  FIG. 17 illustrates a state in which only image data of a dot pattern printed with carbon ink is captured by a camera from an information transmission unit such as characters or figures printed with non-carbon color ink by irradiating the printed matter with infrared rays. FIG.

  As shown in the figure, the printed matter 5 formed on the white paper an information transmission unit 7 printed with an ink that is transparent in the infrared wavelength range and colored in the visible wavelength range, such as a non-carbon ink (dye ink). Is. Next, the printed matter 5 is further printed with ink that develops color in the infrared wavelength region, for example, a dot pattern 6 printed with carbon ink such as toner, infrared ink, or transparent ink. The information transmission unit 7 and the dot pattern 6 are imaged with the camera of the camera unit 2 in a state where the information pattern is printed on the same surface. At this time, the infrared filter 2a cuts visible light wavelengths and allows only infrared wavelengths to pass. Only the dot pattern 1 can be obtained from the camera. On the contrary, it is also possible to print the dot pattern 6 first and then the information transmission unit 7.

  The camera unit 2 recognizes dots printed on these dot patterns 6 according to a predetermined rule, digitizes them, digitizes them, and by reading the numerical information, the dot pattern 6 is located in any region of the printed matter 5. It recognizes whether it is a certain information or program, and outputs and executes various information and programs stored corresponding to it from the storage unit (memory). For example, information and a program corresponding to the dot pattern 6 can be output as text and images or sounds.

  It is also possible to use a method of irradiating the dot pattern 6 with ultraviolet rays when the camera unit 2 captures only the image data of the dot pattern 6 in the printed matter 5.

  In the method of the present invention described above, various audio information can be output and executed via a medium called the printed matter 5. For example, picture books, pop-up picture books, photographs themselves, teaching materials, texts, problem collections, magazines, newspapers, cards, membership cards, photo stands, photos with adhesives, descriptions of exhibits in the museum, card games, board games, brochures, It can be applied to any printed matter 5 such as a catalog for mail order sales. In this way, the audio information from the dot pattern 6 can be recognized together with the visual information from the information transmission unit 7 made up of characters or figures in the printed matter 5.

  FIG. 18 is a functional block diagram illustrating a first embodiment of a portable information input / output device using an information input / output method by camera input.

  The portable information input / output device includes a sensor unit 8 including a camera unit 2 and a main body processing unit 11 including a processing unit 9 and a storage unit (memory) 10. The sensor unit 8 includes a camera unit 2 that captures only image data of the dot pattern 6 in the printed matter 5 and an image processing unit 12 that digitizes the image data and digitizes the image data. An infrared light emitting unit 13 for irradiating the printed matter 5 with infrared light is provided near the camera unit 2.

  The main body processing unit 11 includes a processing unit 9 that outputs and executes information and programs stored in a storage unit (memory) 10 corresponding to the dot pattern 6 based on the numerical values obtained by image processing by the image processing unit 12. It is. The main body processing unit 11 includes an output unit 15 such as a speaker 14, an earphone or a liquid crystal monitor 25. In addition to this audio output, the output unit 15 can also output an audio output (line), an image to a TV monitor or a personal computer.

  In addition to storing information and programs in advance, the storage unit 10 can store information and programs later. For example, information and programs can be stored in the storage unit 10 by voice using the microphone 17a serving as the input unit 17. In addition to the microphone 17a, the input unit 17 can be connected to an audio input terminal, a video input terminal, a personal computer, and the like to store information and programs.

In this way, for example, since the voice can be input later using the microphone 17 a, the portable information input / output device stores the voice of himself or an acquaintance related to the printed material 5 such as a picture book using the microphone 17. Then, by reading the printed matter 5 with this portable information input / output device, another person can hear the audio information corresponding to the contents of the printed matter. For example, it can be used as “a message device for a parent and child” or “a photo with an adhesive with a voice message” in which a voice is included in a photo.

  The main body processing unit 11 can be equipped with a communication card 16 to output or execute external information and programs. For example, the dot pattern 1 input by the camera unit 2 can be digitized and the data can be transmitted to the computer 23 such as a server via the communication card 16. It is also possible to digitize the dot pattern 1 input by the camera unit 2 and transmit the data to the computer 23 such as a server via the communication card 16 to receive information and programs corresponding to the data. . Data obtained by digitizing the dot pattern 1 input by the camera unit 2 is input, and sound corresponding to the data is input. A communication card 16 is attached and information and programs are stored in the storage unit 10.

  By using the communication card 16 in this way, information and programs can be easily transmitted and received. For example, it is possible to answer a questionnaire with a voice using a portable information input / output device and transmit the voice information to a computer 23 such as a server. Answering a question collection or a test with a voice and transmitting the voice information to a computer 23 such as a server for a pronunciation test or correction.

  Further, the URL information is embedded in the dot pattern 6 of another medium such as the printed matter 5 and automatically connected to the site after scanning. Alternatively, a specific operation can be performed after the connection.

  You can also create your own publications that produce sound. Audio information can be added to postcards and letters later. For example, BGM (background music), SE (sound effect), etc. can be added to these printed matter 5 later.

  By providing the main body processing unit 11 with a GPS 24, the current position information can be easily displayed.

  FIG. 19 is a functional block diagram illustrating an embodiment of a portable information input / output device using an information input / output method by camera input.

  In the portable information input / output device of this embodiment, the sensor unit 8 includes only the camera unit 2, and the sensor unit 8 can be configured compactly.

  Note that the present invention is not limited to the illustrated embodiment, and any structure that can reproduce various information and sound by recognizing only the dot pattern 6 in the printed matter 5 to enable various uses, Of course, it is not limited to the utilization method described above, and various modifications can be made without departing from the scope of the present invention.

  FIG. 20 is a perspective view showing a portable information input / output device housed in a compact case body.

  The portable information input / output device of the present invention accommodates the above-described main body processing unit 11 in a main body case 18 of a size that can easily fit in the palm of the hand, and the camera unit 2 is provided downward in the main body case 18. A speaker 14 serving as the output unit 15 or an earphone terminal 19 is provided on the side surface. A button switch 20 is provided on the upper portion of the main body case 18, and a USB card 21 and a memory card slot 22 serving as the storage unit 10 are provided on the front surface.

  The portable information input / output device of the present invention can further include a liquid crystal monitor 25, an earphone jack 19, a TV monitor output terminal 26, and the like. Further, the main body case 18 includes a microphone 17 a, a shooting button 27, a recording button 28, a program selection button 29, an output lamp 30, a GPS 24, an audio input terminal 31, a USB terminal 21, and a memory card slot 22 serving as the storage unit 10. Yes.

  The main body case 18 can be formed into a rounded shape as shown in FIG. 31 so as to easily fit in the palm of the hand. By forming in this way, it becomes possible to easily capture the image data of the dot pattern 6 of the printed matter 5.

  In addition, the shape of the main body case 18 is not limited to the form of the example of illustration, Of course, it can change variously in the range which does not deviate from the summary of this invention.

  21 and 22 are functional block diagrams illustrating an embodiment in which the camera and the output portion are configured separately.

  In this embodiment, the camera unit 2 can be configured to be separated from the image processing unit 12, the storage unit 10, the processing unit 9, and the output unit 15 described above and to transmit via the interface unit. This interface unit transmits wirelessly in addition to wired communication. When transmitting wirelessly, as shown in the figure, it can be transmitted via a wireless transmission unit 32 and a wireless reception unit 33 serving as an interface unit.

  In FIG. 22, the sensor unit 8 includes only the camera 2. By comprising in this way, the sensor part 8 can be comprised compactly.

  FIG. 23 is a perspective view showing an apparatus in which the camera unit portion and the output side main body are separated.

  The illustrated example shows a wired type in which a camera unit portion and an output side main body are separated and connected by a cable 34. By separating in this way, the camera unit 2 can be easily applied to the printed matter 5, and the portable information input / output device of the present invention can be easily used on a table. This camera unit 2 includes a ring-type switch 35 around the camera. With this configuration, the switch can be turned on simply by pressing the camera unit 2 against the printed matter 5 and can be easily operated with one hand.

  FIG. 24 is a functional block diagram for explaining an embodiment of an information input device using a camera for a mobile phone.

  The information input device 118 includes a sensor unit 108 including a camera unit 102 and a main body processing unit 111 including a processing unit 109. The sensor unit 108 includes a camera unit 102 that captures only image data of a dot pattern 6 (see FIG. 27) in the printed material 5 and an image processing unit 112 that digitizes the image data and digitizes the image data. . An infrared light emitting unit 113 for irradiating the printed material 5 with infrared rays is provided in the vicinity of the camera unit 102.

  The main body processing unit 111 outputs and executes a storage unit (memory) information and a program stored in advance in the mobile phone 10 corresponding to the dot pattern 6 based on the numerical value subjected to image processing by the image processing unit 112. 109 is provided. By providing the main body processing unit 111 with a GPS (not shown), the current position information can be easily displayed.

  In addition to storing information and programs in advance in the storage unit (memory) of the mobile phone 110, information and programs can be stored later. For example, information and a program can be stored in the storage unit of the cellular phone 110 by voice, image, or text information using a microphone or a camera (not shown).

  FIG. 25 is a functional block diagram illustrating an embodiment of an information input device using a camera.

  In the portable information output device of the embodiment, the sensor unit 108 includes only the camera unit 102, and the sensor unit 108 can be configured compactly.

  FIG. 26 is a front view showing the portable electronic toy according to the embodiment. FIG. 27 is a right side view illustrating the portable electronic toy according to the embodiment. FIG. 28 is a left side view illustrating the portable electronic toy according to the embodiment. FIG. 29 is a bottom view showing the portable electronic toy according to the embodiment.

  The portable electronic toy 801 according to the embodiment is a toy that generates various sounds or music related to books, game cards, accessories, toys, and the like to be the medium 802 by reproducing dot pattern information. The portable electronic toy 801 includes a dot pattern 803 for recognizing sound related to a description item such as a book, a sound storage unit 804 that stores various sounds, and a processing unit (CPU) that reproduces the sound on a speaker 805. 806 and an audio reproduction LSI 807, which are housed in a case body 808. A pen-type camera 810 for capturing image data of the dot pattern 803 is connected to the case main body 808 with a cable 809.

  The voice storage unit 804 stored in the case main body 808 of the portable electronic toy 801 stores voices to be reproduced based on the information of the dot pattern 803 that recognizes voices related to the description items such as books. This audio storage unit 804 can be used not only as an internal memory as it is, but also by using the external memory to capture the latest content. For example, the program can be downloaded from the outside and the audio content can be updated, and one portable electronic toy 801 can be used repeatedly.

  The camera 810 captures image data of a dot pattern 803 that is affixed to books, game cards, accessories or toys, or a dot pattern 803 that directly prints numbers, characters, and the like as recognition signals on a book or the like. The image data of the dot pattern 803 captured by the camera 810 is processed by an image processing algorithm to extract dots, and the distortion caused by the camera 810 is corrected by the distortion correction algorithm, so a lens with a high distortion is attached. Even when the image data of the dot pattern 803 is captured by the popular camera 810, it can be accurately recognized. Even when the camera 810 is tilted and read with respect to the surface of the dot pattern 803, the dot pattern 803 can be accurately recognized.

  The camera 810 recognizes the information of the dot pattern 803 and reproduces sound and music corresponding to the information from the speaker 805 by the sound reproduction LSI 807.

  The case main body 808 of the portable electronic toy 801 of the present invention has a size that can be easily carried in the size of a “system notebook” of, for example, 13 cm long × 18 cm wide. Therefore, the portable electronic toy 801 can be carried in a hand or put in a bag.

  In addition, information other than sound is simultaneously displayed by the liquid crystal display unit 812 provided in the case main body 808. The liquid crystal display unit 812 is displayed on the image reproduction LSI 13. Since information other than voice can be obtained at the same time, the portable electronic toy 801 of the present invention has a wide range of applications. In this portable electronic toy 801, when the switch 14 on the side surface of the case body 808 is turned on, the pilot lamp 15 is turned on.

  The audio storage unit 804 can use a flash memory, a compact flash (registered trademark), a smart media, a storage IC card, a memory stick, or the like as the storage medium 816. Thereby, the audio content can be easily changed.

  The voice storage unit 804 stores, for example, content data (voice data, image data, moving image data, or character code data such as characters / symbols) that can be used as a teaching material that teaches pronunciation of a foreign language by voice. In addition, the voice storage unit 804 is a picture book that can make music, content that can be used as an orchestra using figure dolls, content that can be used as teaching materials that generate sound in combination with toys such as assembly blocks, Content that can be used as a picture book to generate conversations such as music and the main character in addition to the picture book picture, content that can be used as dictionary software that translates words and sentences in foreign languages as a “sounding dictionary” Remember.

  Furthermore, the present invention can be used for a battle game or RPG software in combination with a battle card. As a “promotional tool”, it can be used as a pamphlet that explains the features of the product and the company profile by voice. Alternatively, as “various information (guides and the like)”, it can be used as an electronic device that explains a facility such as a museum or a tourist attraction in a voice.

  The camera 810 can be stored on the side of the case body 808 so that the portable electronic toy 801 of the present invention can be carried after use.

  By providing a light (not shown) near the camera 810, the dot pattern 803 can be accurately recognized even in a dark place by illuminating the dot pattern 803.

  The portable electronic toy 801 of the present invention can be used in various ways as described below depending on the combination of a medium 802 such as a book, a game card, an accessory, or a toy, and a dot pattern 803.

"Sound teaching materials"
A mini-size book that can be set on the bottom surface of the case body 808 can be used as a teaching material. Utilizing the feature that the present invention is excellent in portability, it can be studied anytime, anywhere, regardless of location, and it can be used as a "sound teaching material" for all generations from children to adults and elderly people Can do. For example, when a book is traced, sound is reproduced and can be used as language teaching such as English conversation, early childhood education such as education and music, and auxiliary teaching materials such as a drill.

"Battle card game"
The portable electronic toy 801 of the present invention can be used as a “match card game”. When a “dedicated sticker & data collection” corresponding to the battle card game is created and a dot pattern 803 corresponding to each card is pasted, the character of the card speaks vividly from the speaker 805 of the portable electronic toy 801. be able to. It can also be used as an item that expands the card function, such as explaining the character's voice and teaching tricks.

  Alternatively, if a “dedicated sticker & data collection” corresponding to a popular movie card is produced, a dot pattern 803 corresponding to the card can be pasted, so that movie lines and music can be played. Or, create a “dedicated sticker & data collection” for idol cards that has a definite fan base, and put a dot pattern 803 sticker for each card so that the present voice of the idol will flow. Can do. At this time, it is also possible to use it for tie-up development in which only one phrase is played on each sheet, and when all the songs are collected, it becomes one song.

  The portable electronic toy 801 of the present invention creates a prank-like “special sticker & data collection” that can be enjoyed by putting a dot pattern 803 on various things around you and making sounds. A dot pattern 803 can be pasted on the camera and traced with the camera 810. For example, all boys combine with their favorite minicar kits to create a “dedicated sticker and data collection” to create a sounding road. Attach a dot pattern 803 to a minicar road kit that includes a railroad crossing and a building. When you come to the railroad crossing, you will hear “Kankankan” and “Kiki! Danger!” Can be issued.

  The portable electronic toy 801 of the present invention can be used for a new way of playing in which a T-shirt on which many dot patterns 803 are printed is produced and worn.

  The portable electronic toy 801 of the present invention can be used as a “fortune-telling device”. It can be used for party entertainment such as newcomers and year-end parties, as well as enjoy yourself. For example, when characters (dot pattern 803) written on the “exclusive dial” are traced with the camera 810 in order, a random and interesting comment flows. By entering the name using the dial, it can be used for first name and last name judgment. Comments such as “Today's fortune” are made to flow. For example, “Love luck, work luck, health luck are the worst. However, only animal luck is Psycho. If you go out, you can have a nice love with a dog walking. It may be possible to display a weak comment such as “It may sprout!”.

"Treasure hunt game"
The portable electronic toy 801 of the present invention can be used as a “treasure hunt game”.

  As many portable electronic toys 801 of the present invention as the number of participants are prepared, and dot patterns 803 are hidden in various places in advance. After that, start from the starting point (entrance, etc.) all at once, find the hidden dot pattern 803, proceed while looking for instructions to go to the next place, such as “Find the corridor”, and the dot pattern of the goal first It can be used for a game where a person who finds 803 wins.

"Foreign language translation device"
The portable electronic toy 801 of the present invention can be used as a “foreign language translation device”.

  When a word (dot pattern 803) is traced with the camera 810 when an unknown word is read while reading an English newspaper or a foreign magazine, it can be used to translate it into Japanese and read it out.

  A USB connector (not shown) can be provided on the case main body 808 so that a plurality of portable electronic toys 801 can support a network. A cable connected to the USB connector can be connected to each other, or connected to a personal computer or the like to form a network.

  FIG. 30 is a perspective view showing an embodiment of a portable electronic toy that mainly generates sound corresponding to a minifigure. FIG. 31 is a perspective view showing a state where a plurality of sound generating toys are connected to the controller unit.

  The portable electronic toy 821 of the embodiment is a toy that is configured to generate mainly sound corresponding to a minifigure. The portable electronic toy 821 includes a dot pattern 803 that records code information for generating voice information corresponding to the character of the mini-figure 822, a voice storage unit 804 that stores voice stored in the case body 823, A camera 810, a processing unit (CPU) 806 that reproduces sound on a speaker 805, and a sound reproduction LSI 807 are provided.

  The dot pattern 803 is made of a circular sheet material to be attached to the base 824 of the mini-figure 822 or the inner ceiling of the bottle cap, and an adhesive is pasted on one side thereof, and the dot pattern 803 is placed on the other side of the sheet material. It is displayed. Instead of this sheet material, it is also possible to print the dot pattern 803 on the minifigure 822 itself.

  The voice storage unit 804 housed in the case main body 823 of the portable electronic toy 821 can be used as it is as an internal memory as well as the latest content data can be captured using the external memory. For example, an audio program can be updated by inputting a program or data from the outside or downloaded via a network, and one portable electronic toy 821 can be used repeatedly.

  By providing a light as an illuminating means near the camera 810 at the center of the case body 823, the dot pattern 803 can be illuminated so that the dot pattern 803 can be accurately captured even in a dark place. Is preferred.

  FIG. 32 is a functional block diagram of the portable electronic toy according to the embodiment.

  A USB connector (not shown) can be provided on the case main body 823 so that a plurality of portable electronic toys 821 can support a network. It is also possible to connect the cable connected to the USB connector to a personal computer or the like to form a network.

  FIG. 33 and FIG. 34 are functional block diagrams illustrating an embodiment in which a camera and an output unit are integrally configured for a figure unit having an information output function by camera input.

  The embodiment includes a sensor unit 208 including a camera 202 and an image processing unit 212, and a main body processing unit 211 including a processing unit 209 and a storage unit (memory) 210. The sensor unit 208 includes a camera 202 that captures only image data of a dot pattern 803 in the printed material 5 and an image processing unit 212 that digitizes the image data and digitizes the image data. An infrared light emitting unit 213 for irradiating the printed matter 5 with infrared light is provided near the camera 202.

  The main body processing unit 211 includes a processing unit 209 that outputs and executes information and programs stored in the storage unit (memory) 210 corresponding to the dot pattern 803 based on numerical values obtained by image processing by the image processing unit 212. It is. The main body processing unit 211 includes an output unit 15 such as a speaker 14.

  In addition to storing information and programs in advance, the storage unit 10 can store information and programs later. For example, it is possible to store information and programs by voice using the microphone 17 in the storage unit 10.

  FIG. 34 shows a modification of the embodiment, in which the sensor unit 208 includes only the camera 202. With this configuration, the sensor unit 208 can be configured in a compact manner.

  FIG. 35 and FIG. 36 are functional block diagrams illustrating an embodiment in which the camera unit and the output unit are configured separately for the figure unit having an information output function by camera input.

  This embodiment comprises a camera unit A and an output unit B. The camera unit A includes a camera 202, a sensor unit 208 including an image processing unit 212, and a wireless transmission unit 221 serving as an interface unit. The sensor unit 208 includes a camera 202 that captures only image data of a dot pattern 803 in the printed material 5 and an image processing unit 212 that digitizes the image data and digitizes the image data. An infrared light emitting unit 213 for irradiating the printed matter 5 with infrared light is provided near the camera 202.

  The output unit B includes a wireless reception unit 222, a main body processing unit 211 including a processing unit 209 and a storage unit (memory) 210, and an output unit 15 such as a speaker 14. The main body processing unit 211 includes a processing unit 209 that outputs and executes information and programs stored in the storage unit (memory) 210 corresponding to the dot pattern 803 based on numerical values obtained by image processing by the image processing unit 212. It is. The wireless transmission unit 221 and the wireless reception unit 222 serving as the interface unit communicate using infrared rays. This output unit B can use a personal computer as it is.

  FIG. 36 is a modification of the embodiment, and the sensor unit 208 includes only the camera 202. With this configuration, the sensor unit 208 can be configured in a compact manner.

  FIG. 37 is a perspective view showing a figure provided with a camera unit, where (a) shows a doll, (b) shows a soccer ball, (c) shows a car, and (d) shows an animal.

  The illustrated example is a figure unit provided with a camera unit A provided with a camera 202 on a figure 218. When the lens of the camera 202 is disposed downward and the figure 218 is placed on the printed matter 5, when the image data of the dot pattern 803 is captured, the dot pattern 803 is irradiated with infrared rays, thereby being non-carbonized. Only the dot pattern 803 in which dots are printed with carbon is read from the information transmission unit 7 printed with the color ink. Note that the shape of the figure 218 is not limited to the illustrated example, and can be variously changed without departing from the gist of the present invention.

  In the figure unit of the present invention described above, various audio information can be output and executed via a medium called the printed matter 5. For example, there is the following usage.

Use as “Sugoroku” or “Board Game” Pieces The figure 218 of the present invention can be used as “Sugoroku” or “board game” pieces. When this figure 218 is placed on "Sugoroku" or "Board Game", a specific voice of the dot pattern 803 on the printed matter 5 is generated by the camera 202 of the figure 218, and the instruction content is notified by voice. it can. Therefore, it is possible to give a wide range to how to play these “Sugoroku” and “Board game”.

Use of “military shogi” as a piece The figure 218 of the present invention can be used as a piece of “military shogi”. When this figure 218 is placed on the shogi board (printed material 5) of “military shogi”, a specific sound of the dot pattern 803 on the base (printed material 5) of the board game is generated by the camera 202 of the figure 218, Since the contents of the instructions can be notified by voice, it is possible to make a leap to a game with a new aspect different from the past. For example, a contingency or a time axis can be provided in the confrontation of a piece (figure 218) by the processing program of the main body. Such added value is an important element that realistically reproduces the actual battlefield, creating new strategies that were not found in normal warrior shogi and being able to play happily.

  FIG. 38 is a perspective view showing a state in which the figure unit of the present invention is placed on the central battle stage of the new simulation board game.

Use as “New Simulation Board Game” Piece The figure unit of the present invention can be used as a “board game” piece. With the base (printed material 5) and the figure 218 set, the figure 218 can be placed on the base (printed material 5) and played. In the battle, the figure 218 is placed facing the center battle stage (printed material 5), and the dot pattern 803 and the information transmission unit 7 are printed on the stage. The dot pattern 6 is displayed on the camera 202 of the figure 218. You can unfold complex battles with the internal processing program.

  Thus, since the figure unit of the present invention can be used as an input interface printed on the printed matter 5 or the like, an interface suitable for each content can be manufactured. It is also possible to supply the interface via the network if the paper interface is downloaded via the Internet as PDF or the like and output by a printer device, and the corresponding program is downloaded and set in a personal computer or the like. is there.

  FIG. 39 is an explanatory cross-sectional view showing another embodiment of the present invention in which a camera unit and an output unit are incorporated in a stuffed toy that is one form of a figure.

  The camera unit A and the output unit B of the present invention are incorporated in a so-called stuffed toy 231 in which an elastic material such as cotton or sponge, which is one form of the above-described figure 218, is packed in a shell having a predetermined form. It is possible. For example, the lens portion of the camera unit A is disposed as it is in the eyeball 232 portion of the stuffed toy 231 and the output unit B is built in and out of the body 233 of the stuffed toy 231. If comprised in this way, favorite stuffed toy 231 can be used as an apparatus which reproduces | regenerates predetermined information and an audio | voice as it is.

  40 and 41 are explanatory sectional views showing another embodiment in which a camera unit and an output unit are incorporated in a stuffed toy that is one form of a figure.

  The camera unit A built in the stuffed toy 231 is not necessarily arranged in the eyeball 232 portion of the stuffed toy 231. For example, in addition to the eyeball 232 portion of the stuffed toy 231, it can be placed on the hand 34 of the stuffed toy 231 as shown in the figure. In addition to this, the camera unit A of the present invention can of course be arranged at the buttocks, belly, legs, and other desired positions of the stuffed toys 231. The arrangement position of the camera unit A is determined according to the type and size of the stuffed toy 231 or the purpose of playing.

  The present invention is not limited to the embodiment of the invention described above, and any structure that can reproduce various information and sound by recognizing only the dot pattern 6 in the printed matter 5 and recognizing only the dot pattern 6 in the printed matter 5 can be used. Of course, the present invention is not limited to the above-described usage method, and various modifications can be made without departing from the scope of the present invention.

  In the dot pattern of the present invention, the same dot pattern can have a different meaning by changing how the key dots are shifted. That is, the key dot KD functions as the key dot KD by shifting from the grid point, but by shifting this shift method by 45 degrees at equal distances from the grid point, eight patterns of key dots can be defined.

  Here, when the dot pattern is imaged by an imaging means such as a C-MOS, the imaging data is recorded in the frame buffer of the imaging means. At this time, the position of the imaging means is the vertical axis (imaging axis) of the paper surface. , That is, a position rotated about the imaging axis (shifted position), the imaging axis of the imaging means is determined from the positional relationship between the captured grid dots and the key dots KD. You can see the shift (camera angle) centered on. If this principle is applied, even if the same area is photographed by the camera, it is possible to have another dimension parameter called an angle. Therefore, even if the same area at the same position is read, different information can be output for each angle.

  In other words, hierarchical information can be arranged in the same area by angle parameters.

  Examples of applying this principle are shown in FIGS. 48, 50, and 52. FIG. In FIG. 48, since the scanner unit 1105 provided on the bottom surface of the minifigure 1101 can rotate the minifigure 1101 by 45 degrees on the pedestal to obtain different angle information along with the dot pattern read information, Audio content can be output.

  42 to 76 are diagrams showing further modifications of the embodiment.

  In FIG. 42, the camera is housed in a pen-like case (apparatus body) 1015 as a pen-type scanner 1001.

  A battery 1016, a speaker 1007, and a circuit board 1017 are provided inside the case 1015. A central processing unit (CPU) and a memory are mounted on the surface of the circuit board 1017. Moreover, you may incorporate the microphone etc. which were abbreviate | omitted illustration. A memory cartridge 1014 is detachably attached to the rear end (upper right end in the figure) of the case 1015. In this memory cartridge 1014, a program, existing audio data, or the like is registered. The memory cartridge 1014 is configured to be replaceable, and can be replaced with a ROM cartridge, a microphone unit cartridge, or the like.

  Buttons 1130a to 1130c are provided on the surface of the case 1015 so that reading start, recording start, voice reproduction, and the like can be controlled.

  By pressing the record button among the buttons, the sound can be recorded with a microphone (not shown). The recorded audio data is recorded in the memory cartridge 1014. At this time, when the dot pattern is scanned while the recording button is pressed, the recorded voice is assigned to the dot pattern. When the dot pattern is scanned while pressing the erase button, the assignment of the voice to the dot pattern is canceled. At this time, the audio data may be stored in the memory cartridge 1014.

  In the figure, the C-MOS camera unit along the vertical axis of the medium surface when the case 1015 is tilted about 45 degrees and abuts against the medium surface at the tip of the case 1015 (lower left end in the figure). A spring 1121 and a tapered nose 1125 are provided. When the case 1015 is pressed in the medium surface direction, the nose 1125 moves backward (moves to information) against the urging force of the spring 1121, and presses the switch 1123.

  A lens 1126 of the C-MOS camera unit is attached to the space inside the nose 1125 so as to face the space, and a window at the tip of the nose can be imaged.

  An irradiation tube 1127 having two bent portions of 45 degrees each in a crank shape is provided in the inner space of the nose 1125.

  The irradiation tube 1127 is made of a transparent resin cylinder, the base end surface of which faces the LED 1122, and the irradiation light of the LED 1122 is incident on the irradiation tube. The diffusion component of the irradiation light on the inner wall surface of the irradiation tube (the light component having an angle larger than 45 degrees with respect to the optical axis) passes through the inner wall surface of the irradiation tube and is radiated to the outside. Then, the linear component of the irradiation light (light component having an angle smaller than 45 degrees with respect to the optical axis) is reflected by the inner wall surface of the irradiation tube and travels in the tube. In the irradiation tube, only the component substantially parallel to the optical axis is irradiated from the tip surface to the opening of the nose 1125 in the irradiation tube.

  As described above, the irradiation light passes through the crank-shaped irradiation tube made of a transparent resin and becomes converged light parallel to the optical axis, so that a uniform amount of light is supplied over the entire opening of the nose portion 1125. be able to. As described above, according to the present embodiment, since there is no darkness in the peripheral portion that occurs in the case of diffused light, the reading accuracy of the dot pattern 607 can be improved.

  FIG. 43 shows such a pen-type scanner 1001 connected to the apparatus main body 1002. In the figure, the apparatus main body 1002 is provided with a memory card slot 1003, and a memory card 1004 in which audio data and programs are registered can be inserted. A microphone 1005 is connected to the apparatus main body 1002 so that audio data can be registered in a memory in the apparatus main body from the outside. Audio data can be output from the speaker 1007 of the apparatus main body 1002 or the speaker 1006 connected to the apparatus main body 1002.

  In FIG. 43, the pen scanner 1001 and the apparatus main body are connected by a cable. However, as shown in FIG. 44, a wireless interface is built in the scanner so that the apparatus main body 1002 can communicate wirelessly. Also good.

  FIG. 45 shows a modification of the pen type scanner. As shown in the figure, the pen-type scanner 1001a includes a battery 1010 and a speaker 1007, and a memory card 1004 such as an SD card, a memory stick, or a smart media can be attached.

  FIG. 46 shows a case where the present invention is applied to a board game. The mini-figure 1101 is displayed on the board 1102 with the mini-figure 1101 as a piece, and the mini-figure 1101 is displayed on the mini-figure 1101 by the number determined by the dice or the speaker 1104. It moves along the eyes. A reading element such as a CCD or C-MOS is provided on the bottom surface of the minifigure 1101, and a dot pattern is formed on the grid of the board 1102. Therefore, by placing the mini-figure 1101 on the grid, different audio information for each grid can be output from the speaker 1104 connected by the cable. As a result, for example, it is possible to output information necessary for moving to the next cell and information necessary for the progress of the game as audio information.

  47 separates the minifigure 1101 and the apparatus main body 1102, reads a dot pattern (not shown) by the scanner unit 1105 provided on the bottom surface of the minifigure 1101, and reads the corresponding to the dot pattern on the apparatus main body 1102 by wireless communication. A signal is transmitted. The apparatus main body 1102 is provided with a speaker 1007, and audio information corresponding to the read signal is read from the memory card 1004 and output as audio information.

  In this configuration, in order to reduce communication traffic between the mini-figure 1101 and the apparatus main body 1102, a decoder is provided in the main body of the mini-figure 1101 to decode the read dot pattern image data and code several digits. It is desirable to convert the information into information and transmit only the code information to the apparatus main body 1102 as a read signal.

  FIG. 48 shows a modification in which a dot pattern formed on the surface of the base 1110 is read by the scanner unit 1105 provided on the bottom surface of the minifigure 1101. In the present embodiment, the read content can be changed depending on the position of the scanner unit 1105 with respect to the dot pattern. For example, if the tilt angle of the mini-figure 1101 is tilted by a predetermined angle with respect to the dot pattern, the read signal can be changed, so that the audio content to be output can be changed depending on the direction of the mini-figure. . Since the method for changing the audio content by changing the angle of the minifigure with respect to the dot pattern has been described above, it will be omitted.

  FIG. 49 shows another configuration example of the minifigure 1101. In this embodiment, the minifigure 1101 includes a scanner unit 1105, a battery 1010, a speaker 1007, and a memory card 1004. Thus, by exchanging the memory card 1004, it is possible to change a program or voice data to change a completely different game or minifigure 1101 to a completely different character.

  Note that the mini-figure 1101 described in these figures has been described as a simple doll shape in the drawings, but it may be an animation character, a small animal such as a pet, a fictitious animal, a person, or the like. Of course.

  In FIG. 50, a dot pattern 1122 is provided on a card 1121, and a score is output as voice or display data by placing the card 1121 at a predetermined angle on a pedestal 1123 in which a scanner for reading the dot pattern 1122 is built. This type of toy.

  FIG. 52 shows an example of playing a crossword puzzle 1132 printed on a magazine or the like using the pen-type scanner 1001. The dot pattern 1122 of the present invention is formed in the blank frame 1133 of the crossword puzzle 1132 on the paper surface, and is set in the blank frame 1133 by bringing the tip of the pen-type scanner 1001 into contact with the predetermined blank frame 1133. The hints of the column or row word thus displayed are displayed on the liquid crystal display unit 1131 of the pen-type scanner 1001.

  In this case, the tip of the pen-type scanner 1001 is brought into contact with the inside of the blank frame 1133 where the hint is desired to read the dot pattern formed in the blank frame and display the hint of the word on the liquid crystal display unit 1131. Can be made. At this time, even in the case of abutting in the same blank frame, the hint in the vertical direction, the hint in the horizontal direction, and the hint in the oblique direction can be displayed according to the angle at which the pen-type scanner 1001 abuts. At this time, as described above, when the shift from the grid point of the key dot to the grid dot is calculated by the central processing unit (CPU), the camera tilts (in the rotation direction of the image sensor about the vertical axis of the paper surface). Shift), the vertical, horizontal and diagonal directions of the crossword puzzle according to the tilt of the camera can be recognized. Therefore, a hint corresponding to the information can be read out from the storage means and displayed, or can be uttered from the speaker 1007.

  Note that the movement in the XY coordinate direction is detected by moving the pen-type scanner 1001 by about two frames in the vertical direction, the horizontal direction, or the oblique direction (the detection method is described above), and the hint of the word in the direction is displayed on the liquid crystal. You may display on the display part 1131 or you may utter as audio | voice information from the speaker 1007. FIG.

  In FIG. 54, a scanner unit 1105 is provided on the bottom of the abdomen of a self-propelled cat stuffed toy 1141, and the stuffed toy 1141 runs on a dot pattern 1122 formed by a seal or the like on a board or a floor in the home. Thus, the dot pattern 1122 is read and the read signal is transmitted to the apparatus main body 1102.

  In FIG. 55, a scanner unit 1105 is provided on the bottom surface of a self-propelled or radio-controlled car toy 1151, and a dot pattern 1122 formed with a seal or the like on a board or a floor surface is read and a read signal is sent to the apparatus main body 1102 Is transmitted from the speaker 1007 of the apparatus main body 1102 to the voice information corresponding to the dot pattern 1122.

  For example, when a sheet printed on a city road is prepared and a car toy is run on the sheet to play, a sticker in which a dot pattern 1122 is formed is pasted on the sheet before an intersection or a railroad crossing. Audio information that prompts a temporary stop when the toy 1151 approaches an intersection or railroad crossing may be output from the speaker 1007 of the apparatus main body 1102.

  FIG. 56 is an explanatory diagram when the present invention is applied to a competitive card game.

  As shown in the figure, the apparatus main body 1102 is provided with a pair of card insertion slots, and by inserting the respective holding cards 1121 and 1121 that compete against each card insertion slot, the cards 1121 and 1121 are inserted. The superiority or inferiority of the parameter set in the above is determined. As described with reference to FIG. 51, the dot patterns 1122 are provided on the surfaces of the cards 1121 and 1121, and the parameters associated with the dot patterns 1122 are obtained by reading the dot patterns 1122 with the scanner unit 1105 of the apparatus main body 1102. Is read out from the memory card 1004 so that the winner can be determined. The apparatus main body 1102 may be provided with a liquid crystal display screen so that the winning / losing result can be displayed. FIG. 57 shows an example of the apparatus main body 1102 in which only one card 1102 can be inserted.

  FIG. 58 shows an embodiment in which the apparatus main body 1102 is a simple card reader and the apparatus main body 1102 is connected to a personal computer. FIG. 59 shows an example of an apparatus main body 1102 for continuously reading large postcard sheets 1161 on which dot patterns are formed. For example, when reply postcards from users on which dot patterns are formed are read one after another. It is a suitable device configuration.

  FIG. 60 is an example of an apparatus main body 1102 that can be used at a POS register or the like, and has a glass surface 1171 on the surface, and a product that passes over the glass surface 1171 by the scanner unit 1105 disposed below the glass surface 1171. By scanning the dot pattern 1122 affixed to the product, merchandise management, sales management, and the like similar to the barcode can be performed. In this case, in the present invention, since the dot pattern can be formed on the printing surface of the packaging box or wrapping paper so as to overlap the printing surface, the barcode sticker having a bad appearance may occupy the surface of the product like the barcode system. Absent.

  FIG. 61 shows an example in which the apparatus main body is composed of a pedestal 1102 and combined with a minifigure 1101. In this embodiment, a glass plate 1171 is disposed on the upper surface of the pedestal 1102, and a scanner unit 1105 is provided below the glass plate 1171. Then, when the minifigure 1101 having the dot pattern 1122 formed on the bottom surface is placed on the pedestal 1102, the dot pattern 1122 is read by the scanner unit 1105, and audio data corresponding to the code number read from the dot pattern 1122 is obtained. It is read from the inserted memory card 1004 and output from the speaker 1007.

  FIG. 62 shows an example in which the apparatus main body 1102 is connected to the television monitor 1171. A video signal and an audio signal are output from the apparatus main body 1102 to the television monitor 1171 via a pin plug. The audio data and the video data are stored in the memory card 1004 or the built-in memory of the apparatus main body 1102, and the moving image data corresponding to the dot pattern 1122 read by the pen type scanner 1001 is separated into the audio data and the video data, and the television It is input to the monitor 1171 and output from the screen and speaker of the television monitor 1171.

  FIG. 63 shows a photo stand type apparatus main body 1102. A dot pattern 1122 is formed on the back surface of the photograph 1181, and a scanner unit (not shown) is provided on the back surface of the stand portion. Audio information corresponding to the code number obtained by reading the dot pattern 1122 is stored in the apparatus. It is read from a memory or a memory card built in the main body 1102 and output from the speaker 1007. According to this embodiment, voice corresponding to the dot pattern 1122 is registered in advance in the built-in memory or the memory card 1004 for each photograph 1181, so that an explanation at the time of taking a picture or a voice message such as “Happy Birthday” is sent. It can be reproduced from the speaker 1007.

  Note that a microphone 1005 may be provided in addition to the speaker 1007, and audio data may be registered in the built-in memory or the memory card 1004 and associated with the dot pattern 1122 attached to the back surface of the photograph 1181 in advance.

  In addition, the photo stand type apparatus main body 1102 in the figure has a liquid crystal display unit 1131, and data such as shooting date / time and message text are associated with the dot pattern 1122 and associated with the photograph 1181. These data may be displayed on the liquid crystal display unit 1131.

  FIG. 64 shows a case where a pen type scanner 1001 is connected to a personal computer 1201 via a USB cable. The connection between the pen-type scanner 1001 and the personal computer 1201 may be a serial interface based on RS-232C, a LAN interface, an IEEE 1394 interface, or the like, in addition to using a USB interface.

  Alternatively, a wireless interface card 1209 may be attached to a personal computer and connected to the pen-type scanner 1001 by wireless communication. As the wireless interface, Bluetooth, wireless LAN, or the like can be used. Further, the pen scanner 1001 and the personal computer 1201 may be connected using an optical interface such as infrared communication in addition to the wireless interface.

  FIG. 65 is a diagram in which the pen-type scanner 1001 is connected to the PDA 1202 with a cable. The connection between the PDA 1202 and the pen-type scanner 1001 may be realized by a wireless connection or an optical communication connection in addition to a wired connection.

  FIG. 66 shows the connection with the personal computer 1201 when the scanner is built in the mouse 1301. The mouse 1301 is generally connected to the personal computer 1201 via a USB interface, but may be wireless connection or optical communication connection.

  67 and 68 show a mouse 1301 provided with a digitizer function. A scanner unit 1105 is provided in the mouse, and a transmission window is provided at the tip of the mouse 1301 with a glass member 1302 so that the reading target of the dot pattern 1122 by the scanner unit 1105 can be visually confirmed from above. ing.

  FIG. 69 shows a configuration in which the scanner unit 1105 is provided in the main body of the PDA 1202, and FIG. 70 shows a configuration in which the scanner unit 1105 is provided in the personal computer main body 1201. When the scanner unit 1105 is provided in the main body of the PDA 1202 as shown in FIG. 71, the dot pattern 1122 can be read by placing the scanner unit 1105 of the main body of the PDA 1202 over a dot pattern 1122 such as a paper surface. On the other hand, when the scanner unit 1105 is provided in the personal computer main body 1201 as shown in FIG. 70, the dot pattern 1105 is read by placing the dot pattern 1122 provided on the business card or card 1121 (see FIG. 51) over the scanner unit 1105. Can be used as 71 and 73, a scanner unit 1105 may be provided in the main body of the mobile phone 1401, or a scanner unit may be provided in the game machine main body (not shown).

  FIG. 72 shows a case where a pen type scanner 1001 is connected to a connector of a mobile phone 98. In such a configuration, a read signal corresponding to a dot pattern read by the pen-type scanner 1001 may be processed by a program downloaded in advance to the mobile phone 1401 and displayed on the display unit of the mobile phone or output by voice. Good. In addition, the mobile phone 1401 may receive result data obtained by accessing the server with the program, transmitting a read signal, and processing the server.

  FIG. 74 illustrates a configuration in which a liquid crystal display unit 1131 and a speaker 1007 are provided in a pen-type scanner 1001. The pen-type scanner 1001 of this embodiment is equipped with a writing tool 1601 such as a ballpoint pen at its tip, and a scanner unit 1105 is provided around it.

  As an example of using such a pen-type scanner 1001, a dot pattern 1122 is formed on a menu of a restaurant or the like, and the menu and the pen-type scanner 1001 are handed over to a customer.

  The visitor selects the menu and checks the rectangular box of the menu selected with the writing instrument 1601. At this time, the dot pattern 1122 corresponding to the menu selected by the scanner unit 1105 is read. Thus, the character information corresponding to the menu is read from the memory and displayed on the liquid crystal display unit 1131 by the processing of the central processing unit inside the pen type scanner 1001. In the same figure, the menu name “Japanese style hamburg plate set” selected by the visitor, the calorie “864 kcal”, and the amount “1,250 yen” are displayed on the liquid crystal display unit 1131.

  Thus, since the store visitor himself can select the menu and confirm the selection, the store clerk can complete the order processing only by collecting the pen-type scanner 1001.

  FIG. 75 shows a configuration in which a microphone 1005 and a speaker 1007 are provided in a pen-type scanner 1001. In this embodiment, the dot pattern 1122 formed on the surface of the photograph 1181 is read by the scanner unit 1105, and after the reading is completed, sound corresponding to the dot pattern 1122 is input using the microphone 1005. The input voice data is registered in a memory (not shown) in the pen type scanner 1001. The voice at this time may be an explanatory note or a greeting that the photograph 1181 was taken. If the dot pattern 1122 is formed over the entire surface of the photo, in the case of a group photo or the like, it is also possible to register an explanatory note for each individual shown in the photo.

  Next, the above-described audio data can be reproduced from the speaker 1007 by bringing the tip of the pen-type scanner 1001 (scanner unit 1105) into contact with the portion of the photograph 1181 to be explained.

  In this way, in addition to the photograph 1181, the dot pattern 1122 can be formed on each sticker, and the pen-type scanner 1001 can be brought into contact with the sticker surface to input voice data.

  FIG. 76 shows an example in which the system notebook 1701, notebook, and pen-type scanner 1001 are used in combination.

  In the figure, a dot pattern 1122 is formed in advance in the schedule field 1702 of the system notebook 1701. When a schedule is registered in the schedule field 1702, if there is no room for recording characters at a destination or the like, the tip of the pen-type scanner 1001 (scanner unit 1105) is brought into contact with the schedule field 1702 of the date on which the schedule is input. Then, the schedule for the date is inputted by voice from a microphone 17a (not shown).

  When it is desired to confirm the schedule on the system notebook 1701, the pen type scanner 1001 (scanner unit 1105) is brought into contact with the schedule column 1702 of the confirmed date, and the dot pattern 1122 is read. The schedule input at is reproduced from the speaker 1007.

The pen-type scanner 1001 can be connected to the personal computer 1201 through a USB interface or the like, so that a schedule management system (for example, Microsoft Outlook, Lotus Notes, etc.) in the personal computer 1201 and a data link (synchronize). If the dot pattern 1122 in the date column (schedule column 1702) is read by the pen-type scanner 1001, the schedule corresponding to the date is displayed on the liquid crystal display unit 1131 as character data as shown in FIG. You can also.


Note that the pen-type scanner 1001 may be connected to the personal computer 1201, and input control of the personal computer 1201 may be performed by reading a dot pattern formed on the surface of the system notebook 1701, ID card, license, or the like. .

  The dot pattern 1122 may be formed on a normal book, a greeting card, a newspaper, a mail order catalog, a brochure, a paper craft, an origami, a recipe, or the like, in addition to a medium such as a picture book described in the embodiment.

  For example, by forming a dot pattern in a mail order catalog, the dot pattern is read by the scanner unit, and a description of the product is uttered, or a purchase application program registered in the memory of the personal computer is started. It may be.

  Further, by forming a dot pattern on paper craft or origami, the dot pattern may be read by a scanner unit, and a method of assembling a work may be explained by a voice from a speaker.

  Also, by forming a dot pattern in the recipe, a recipe such as a dish can be output by voice.

  Moreover, you may provide the picture book for coloring using the dot pattern of this invention. Specifically, a different color for each region (for each mask region) may be colored with a crayon, a felt pen, a watercolor paint, or the like. In this case, even if it is a non-carbon watercolor paint, crayon, felt pen or the like even on the paper surface on which the dot pattern is formed, infrared rays can pass through the colored layer, The dot pattern can be read.

  The dot pattern may be printed over a barcode reader. In that case, a barcode is printed with a non-carbon ink on a medium such as paper, and a dot pattern is printed thereon with a carbon ink. A normal barcode reader can accurately read a barcode even if a small dot is hit. Next, using the pen-type scanner of this embodiment, only the dot pattern is read and an information code is input.

  In addition, the barcode is printed with an ink that absorbs “(A) infrared rays or ultraviolet rays close to the visible light wavelength region” or “(B) infrared rays or ultraviolet rays close to the visible light wavelength region”. You may print with the ink which absorbs "(C) Infrared rays or ultraviolet rays different from the wavelength range of infrared rays or ultraviolet rays used by the barcode".

  In this case, a visible light blocking filter is attached to the C-MOSS camera, the first LED that emits light having the same wavelength as that of (A) or (B) is irradiated, and only the barcode is read. Next, a second LED that emits light of the same wavelength as in (C) is irradiated, only the dot pattern is read, and an information code is input. As described above, by arranging information from the dot pattern on the barcode, it is possible to obtain superimposing information (a code from the barcode and the dot pattern).

  In the present invention, the dot pattern is a publishing field such as a book or picture book on which it is formed, a photo sticker, a sticker in which a dot pattern is formed for input, a photo sticker, a game board, a figure, a character product such as a stuffed toy, It can be used as a touch panel for monitor screens of personal computers and televisions.

  The dot pattern reading system can be used as an input system for a general-purpose computer in the field of toy computers for children.

  Furthermore, if the system is housed in a case, it can be used in the fields of electronic devices, voice recorders, and the like as a single scanner.

DESCRIPTION OF SYMBOLS 1,601 Dot pattern 2,102 Camera unit 5,606 Printed matter 6,601,607,803,1122 Dot pattern part 7 Information transmission part 8,108,208 Sensor part 9,109,209,806 Processing part 10,210 Memory | storage Part (memory)
11, 111, 211 Main body processing unit 12, 112, 212 Image processing unit 14 Speaker 15 Output unit 16 Communication card 17 Input unit 18 Main unit case 19 Earphone terminal 20 Button switch 21 USB terminal 23 Computer 24 GPS
31 Audio input terminal 32 Wireless transmission unit 33 Wireless reception unit 34 Cable 36 Pen 40 Mouse-type main body 110 Mobile phone 113, 213 Infrared light emitting unit 118 Information input device 123 Computer 202, 602, 810 Camera 218 Figure 231 Nuigurumi 603 First direction 604 Second direction 605 Dot 608, 1201 Personal computer 611 Transparent film 612 Touch panel 615 Case 616 Mouse pad 619 Pen member 620 Table 621 Paper 622 Switch 701 Reference dot 702 First virtual reference line 703 Second virtual reference line 704 Virtual reference point 705 Information dots 801 and 821 Portable electronic toy 802 Medium 805 Speaker 807 Audio reproduction LSI
808 Case main body 809 Cable 812, 1311, Liquid crystal display unit 813 Image reproduction LSI
816 Storage medium 822, 1101 Mini figure 824 stand 823 Case main body 1001 Pen type scanner 1002, 1102 Device main body 1004 Memory card 1007 Speaker 1015 Case 1105 Scanner unit 1121 Card 1124 Cylindrical case 1125 Nose unit 1181 Photo 1202 PDA
1301 Mouse 1401 Mobile phone 1701 System notebook 2022 LED
2023 filter

Claims (20)

A plurality of reference dots arranged in succession in a single linear accordance Jo Tokoro rule, connecting the reference dot of the plurality of straight, the first virtual reference line of one consisting of polygonal and / or curved At least one second virtual reference line consisting of a straight line and / or a curve that can be defined at a predetermined position based only on the reference dot and / or the first virtual reference line, and the second A plurality of virtual reference points that are virtually provided at predetermined positions on the virtual reference line, and at least one of the distance and direction from the virtual reference point, which is arranged at the end point represented by a vector with the virtual reference point as a starting point bracts information dots XY coordinate value and / or code values are defined, the stream dot pattern comprising formed by arranging one line or more in the stream dot patterns formed Media.
In order to define the second virtual reference line and / or to define the direction of the dot pattern and one XY coordinate value and / or code value, the stream dot pattern has a reference dot serving as a reference. The medium on which the stream dot pattern according to claim 1 is formed, which is provided at a predetermined position.
The medium having the stream dot pattern formed thereon according to claim 1 or 2, wherein the stream dot pattern is printed with ink that absorbs infrared rays or ink that reacts with ultraviolet rays.
The medium on which the stream dot pattern according to any one of claims 1 to 3 is formed, wherein the medium is a printed matter or a photograph, and the stream dot pattern is formed so as to overlap a pattern or a character of the medium. .
Photographing the stream dot pattern according to claim 1 or 2,
A stream dot pattern reading method for analyzing and acquiring data contents defined by the stream dot pattern.
Reading the medium on which the stream dot pattern according to claim 1 is formed with a reading unit;
By processing means
Extracting dots from the stream dot pattern;
Analyzing the data content defined by the stream dot pattern according to the arrangement of the dots;
Outputting information corresponding to the data content stored in the storage means by the output means;
An information processing method using a stream dot pattern.
With respect to the medium on which the stream dot pattern according to claim 1 is formed,
A stream dot pattern reading device comprising means for photographing a stream dot pattern of the medium.
The stream dot pattern reading device according to claim 7 , further comprising means for extracting dots from the stream dot pattern.
9. The stream dot pattern reading apparatus according to claim 8 , further comprising means for analyzing data contents defined by the stream dot pattern in accordance with the dot arrangement.
With respect to the medium on which the stream dot pattern according to claim 1 is formed,
Means for photographing the stream dot pattern of the medium;
Means for extracting dots from the stream dot pattern;
Means for analyzing the data content defined by the stream dot pattern according to the arrangement of the dots;
Storage means for storing information corresponding to the data content;
An information processing apparatus using a stream dot pattern, comprising: output means for outputting information corresponding to the data content.
Extracting dots from the stream dot pattern according to claim 1 or 2;
Analyzing the data content defined by the stream dot pattern according to the arrangement of the dots;
For causing the information processing apparatus to execute the program
Means for extracting dots from the stream dot pattern according to claim 1 or 2;
Means for analyzing the data content defined by the stream dot pattern according to the arrangement of the dots;
An information processing apparatus using a stream dot pattern.
A transparent film which is a medium on which the stream dot pattern according to claim 1 is formed;
The transparent film is affixed to the display means of the electronic device, and according to the instruction information displayed on the display means, reading means for photographing and capturing the stream dot pattern of the transparent film, and extracting dots from the stream dot pattern Stream dot pattern reading comprising: means; means for analyzing data content defined by the stream dot pattern according to the arrangement of the dots; and transmission means for transmitting the data content to an external device via wire or wirelessly Equipment,
An information processing apparatus using a stream dot pattern, comprising: a storage unit that stores information corresponding to the transmitted data content; and an electronic device that includes a unit that reads out the information and causes the output unit to output the information.
The information processing apparatus using a stream dot pattern according to claim 13, wherein an infrared shielding filter is disposed between the transparent film and the screen of the display unit.
A camera unit that reads a stream dot pattern in the printed material, with respect to a printed material on which only the stream dot pattern according to claim 1 is printed,
An image processing unit comprising: means for extracting dots from the stream dot pattern; and means for analyzing data content defined by the stream dot pattern according to the arrangement of the dots.
Processing means for reading out information corresponding to the data content from the storage unit;
Output means for outputting the information,
The camera unit is
The stream dot pattern according to claim 1 printed with ink that reacts with light of a predetermined wavelength and the information transfer unit that is printed with ink that does not react with light of the predetermined wavelength and includes characters or figures are flush with each other. An information processing apparatus, which is a camera unit that reads only a stream dot pattern in the printed material by irradiating the printed material with the predetermined wavelength light with respect to the printed material printed on.
The information processing apparatus according to claim 15, wherein the information processing apparatus is a mobile phone.
A mouse pad, which is a medium on which the stream dot pattern according to claim 1 is formed.
A mouse comprising means for photographing a stream dot pattern formed on the mouse pad according to claim 17.
A tablet which is a medium on which the stream dot pattern according to claim 1 is formed.
  A personal computer comprising a scanner unit including means for photographing the stream dot pattern according to claim 1.

Images