JP2012022424A - Audio information recording device using stream dot - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an audio information recording system using stream dots capable of associating each dot pattern with different audio information and playing the same audio information with plural different dot patterns, for example.SOLUTION: A link table is generated to associate each dot pattern using stream dots with audio information in advance, and when the dot pattern is scanned with a scanner, the audio information associated with the dot pattern is played from a speaker. In this way, by printing a dot pattern on a surface of a picture book, a card and the like in advance, audio information corresponding to the design or story of the picture book can be played, and audio information corresponding to a character on the card can be played, for example. Besides, a new dot pattern and new audio information can be associated, and the association can be canceled or changed using the link table, for example.

Description

  The present invention relates to an information input / output method using a stream dot pattern for outputting audio information by optically reading stream dot pattern information formed on a printed material or the like.

  Conventionally, there has been proposed an information output method for reading a barcode printed on a printed matter or the like, and reading out information such as sound corresponding to the barcode from a memory and outputting the information. For example, a method has been proposed in which information matching key information given in advance to a storage means is stored, information is retrieved by searching from a key read by a bar code reader. Also, in order to be able to output a variety of audio information, a dot pattern in which fine dots are arranged according to a predetermined rule is generated, and the dot pattern printed on a printed material is captured as image data by a camera and digitized to output audio information Techniques for making them have also been proposed.

  However, the conventional method of outputting sound or the like using the barcode has a problem that the barcode printed on the printed matter is annoying. In addition, because the barcode is large and occupies a part of the paper, if the barcode is large in this way, characters and objects that have the meaning of appearing in some texts or sentences, or photographs, pictures, or graphic images There is a problem in that it is difficult to assign a large number of barcodes for each object because of the layout.

  Furthermore, the voice assigned to the barcode is fixed, and only the same voice information can be output when the same barcode is read.

  The present invention has been developed to solve such problems. That is, the object of the present invention is to propose a mechanism by which a user can arbitrarily set / release the relationship (link) between a dot pattern and audio information, thereby enabling recording of audio information associated with an arbitrary dot pattern, In addition, by making it possible to set and release the relationship (link) between audio information and the dot pattern, the relationship between the two can be made flexible so that different audio information can be related to each dot pattern, or multiple different It is a technical object to provide an audio information recording method capable of reproducing the same audio information with a dot pattern.

  The present invention employs the following means in order to solve the above problems.

  (1) An audio information recording apparatus according to the present invention includes an audio information input unit that inputs audio information, a storage unit that stores the input audio information, and a linear print according to a predetermined rule printed in advance. Arranging a plurality of reference dots, providing a first virtual reference line composed of a straight line, a broken line and / or a curve connecting the plurality of reference dots, and the reference dots and / or the first Providing at least one or more second virtual reference lines made of straight lines and / or curves defined at predetermined positions from the virtual reference lines, and a plurality of virtual references at predetermined positions on the second virtual reference lines An information dot in which an XY coordinate value and / or code value is defined by a distance and a direction from the virtual reference point is arranged at a step of providing a point and an end point expressed by a vector with the virtual reference point as a starting point. An optical reading unit that reads a dot pattern formed by arranging one or more stream dot patterns arranged in accordance with the step, a conversion unit that converts the dot pattern read by the optical reading unit into code information / coordinate information, and the conversion unit An association instruction means for associating the code information / coordinate information converted by the voice information, a link table for registering an association between the code information / coordinate information related by the association instruction means and the voice information; The voice information recording apparatus comprises voice information reproducing means for reading the voice information associated with the link table from the storage means and outputting it after the dot pattern is read again by the optical reading means.

  According to this voice information recording apparatus, voice information is associated with each dot pattern, and when the dot pattern is read by the optical reading means, the voice information related to the dot pattern is output from the voice information reproducing means. can do. As a result, a dot pattern can be printed on the surface of a picture book, card, etc., and voice information corresponding to a picture book pattern or story can be reproduced, or voice information corresponding to a character written on a card can be reproduced. . Further, the voice information can be newly related to, released from or changed to the new dot pattern by the correlation instruction means.

  The dot pattern may be provided on any medium such as a business card, a notebook, or a seal in addition to the picture book or card.

  Further, the dot pattern may be code information corresponding to audio information stored in the storage means, or may be coordinate information. In the case of code information, the audio information recorded at the address corresponding to the code information can be reproduced. In the case of coordinate information, the audio information corresponding to the position (coordinate information) read by the optical reading means Can be played.

  In addition, by forming a plurality of stream dot patterns with a constant reference point interval, XY coordinate values are defined without gaps in the medium, and trajectory information can be generated. In addition, when characters, staffs, maps, figures, etc. are printed on the medium and the operation is performed by tracing or touching the line segment with a scanner pen, by forming a stream dot pattern only along the line segment, A dot pattern can be arranged rationally. In addition, when a dot pattern in which XY coordinates are defined is formed as a two-dimensional code (used as an index), it is not restricted by the shape of the rectangular area, and is matched to the information area visually formed on the medium surface. In addition, it is possible to form a dot pattern by repeating a set of constant information in a free shape.

  (2) Also, the stream dot pattern is a reference for defining the second virtual reference line and / or for defining the direction of the dot pattern and one XY coordinate value and / or code value. A reference dot may be provided at a predetermined position.

  According to this, by providing a new reference point, the direction of the stream dot pattern and the set of constant information can be easily defined without using information dots, and the reduction of unnecessary information can be suppressed. Furthermore, the position of the virtual reference point that is the starting point of the information dot can be accurately indicated by the arrangement of the new reference point.

  (3) The link table may relate a plurality of code information / coordinate information to one piece of voice information.

  By associating one piece of sound information with a plurality of dot patterns in this way, the same sound information can be reproduced even when a plurality of cards having different dot patterns are read by the optical reading means.

  (4) Further, according to a third aspect of the present invention, the storage means for storing the audio information may be a card storage medium.

  By attaching a removable card storage medium to the audio information recording apparatus, different audio information can be reproduced for each card storage medium. Further, by providing a collation table and a collation code for each card storage medium, it is possible to change the reproduction condition of the audio information for each card storage medium. Specifically, a different verification code is set for each company and for each game, and the specification is such that the permission / non-permission of reproduction of audio information is determined based on whether or not the verification code registered in the dot pattern is correct. You can also

  (5) In addition, a dot pattern that can be read by the optical reading unit is printed in order to instruct at least input start of the audio information, input end of the audio information, reproduction of the audio information, and stop of the reproduction. You may have a printed medium.

  By performing the instruction input such as the start of voice information input by reading the dot pattern, it is possible to operate the voice information recording apparatus visually and intuitively as compared with the case where these are performed by the hardware switch.

  (6) In addition, a print in which a dot pattern that can be read by the optical reading unit is printed as the association instruction unit that instructs the association or release of the association between the code information / coordinate information and the audio information. The medium may be provided separately from the apparatus main body.

  By performing the relationship between the dot pattern and the voice information and the cancellation instruction by reading the dot pattern, the voice information recording apparatus can be further operated visually and intuitively.

  By configuring the audio information recording apparatus using a print medium (so-called paper controller) on which such a dot pattern is printed, the audio information recording apparatus can be visually operated by visually observing the printed portion.

  (7) The dot pattern is a dot pattern having a direction depending on a positional relationship between the medium surface and the optical reading unit, and an image storage area in which the dot pattern photographed by the optical reading unit is stored as a pixel group. Means for calculating the angle formed by the X positive direction or Y positive direction of the XY coordinates based on the pixel group stored therein and the direction of the dot pattern, and in addition to the code information and coordinate information, angle information There may be provided means for making it possible to store and reproduce the different audio information for each.

  Since the dot pattern has a direction depending on the positional relationship between the medium surface and the optical reading means, attention is paid to this, and different audio information is output for each direction.

It is a front view (1) of a voice recorder. It is a left view of a voice recorder. It is a right view of a voice recorder. It is explanatory drawing which shows the use condition of a voice recorder. It is an internal block diagram of a voice recorder. It is a figure which shows the arrangement | positioning state of the symbol of an instruction | indication board. It is a figure which shows an audio | voice file format. It is explanatory drawing of a collation table and a collation code. It is a front view (2) of a voice recorder. It is explanatory drawing of a link table. It is a figure which shows a memory card. It is a figure (1) for demonstrating a stream dot pattern. It is a figure (2) for demonstrating a stream dot pattern. FIG. 6 is a diagram (3) for explaining a stream dot pattern. FIG. 6 is a diagram (4) for explaining a stream dot pattern. FIG. 6 is a diagram (5) for explaining a stream dot pattern. FIG. 6 is a diagram (6) for explaining a stream dot pattern. It is a figure for demonstrating the state which uses SD card as a memory card. It is a figure for demonstrating other embodiment of a voice recorder. It is a figure for demonstrating the voice recorder which has a function which detects an angle. It is a figure which shows the arrangement | positioning state of the symbol of the instruction board used in FIG. It is a flowchart (1) which shows a recording and link process. It is a flowchart (2) which shows a recording and link process. It is a flowchart which shows the process which reproduces | regenerates the audio | voice by which linked. It is a figure (1) for demonstrating the method to detect an angle. It is a figure for demonstrating an audio | voice determination table. It is FIG. (2) for demonstrating the method to detect an angle. It is a figure (1) for demonstrating other embodiment of the voice recorder which has a function which detects an angle. It is FIG. (2) for demonstrating other embodiment of the voice recorder which has a function which detects an angle. It is FIG. (3) for demonstrating other embodiment of the voice recorder which has a function which detects an angle. It is a figure for demonstrating other embodiment of this invention. It is a figure which shows the arrangement | positioning state of the symbol of the instruction board used in the Example of FIG. It is a network block diagram in the voice mail system which is one Embodiment of this invention. It is a figure which shows the arrangement | positioning state of the symbol of the paper controller used in a voice mail system. It is a figure for demonstrating a voice mail database. It is a flowchart which shows the process which transmits / receives a voice mail. It is a figure for demonstrating transmission / reception of a voice mail. It is a figure for demonstrating the voice mail manager which is one Example of a voice mail system. It is a figure which shows the arrangement | positioning state of the symbol of the paper controller used in a voice mail manager. It is a figure for demonstrating the apparatus control by the speech recognition data communication which is one Embodiment of this invention. It is a figure which shows the arrangement | positioning state of the symbol of the paper controller used in apparatus control.

  1 is a front view of a voice recorder (voice information recording apparatus) according to an embodiment of the present invention, FIG. 2 is a right side view thereof, and FIG. 3 is a left side view thereof.

  The voice recorder 101 is provided with a speaker 102 on the surface of the casing, and audio information can be reproduced and output. Above the speaker 102, a recording / stop button 103, a recording / playback display unit 104, a link display unit 105, and a microphone 107 for inputting voice information are provided at the upper left.

  Note that a liquid crystal screen 901 as shown in FIG. The liquid crystal screen 901 can display a recording state, a reproduction state, a stop state, a link state, a recording / reproduction track number, and the like.

  On the right side of the voice recorder 101, a power switch 108 and a volume 109 are arranged, and the voice recorder 101 is turned on and the volume of audio information reproduced from the speaker 102 can be adjusted.

  On the left side of the voice recorder 101, a connector terminal (SCANNER) 110, an audio output terminal (PHNE) 111, and an external power supply terminal (DC IN) 112 are provided. The connector terminal 110 is a general-purpose serial interface such as a USB terminal, for example, and a USB connector 115 provided at the end of the cable 114 of the scanner 113 (optical reading means) is attached as shown in FIG. Yes.

  As shown in FIG. 5, the scanner 113 is provided with a CMOS imaging device (CMOSS), which irradiates the dot pattern printing surface with light emitted from the LED (IRLED), and reflects the reflected light into a visible light filter ( The light is received as wavelength light only in the infrared region through a not-shown), and this is photographed by a CMOS image sensor through a lens, the photographed image is analyzed by a central processing unit (MPU), and code information of the analysis result (MPU) (32-bit dot code) or coordinate information is transmitted to the voice recorder 101. At this time, key dots 2 (see FIGS. 12 and 14) are arranged in the dot pattern, and the direction (angle) of the blocks constituting the dot pattern can be received as angle information.

  In other words, by developing the captured image of the dot pattern in the video memory, the XY coordinate value of each dot can be found. By searching for the grid dot and the key dot based on this, the direction of the dot pattern (correction of the video memory) The angle of the dot pattern with respect to the XY coordinate axes) can be detected.

  The scanner stores analysis software in a ROM or the like, and the central processing unit (MPU) reads the software from the ROM to analyze the captured image (dot pattern recognition → numerical conversion → Dot code, coordinate information, and angle information).

  As shown in FIG. 5, the main body of the voice recorder 101 is configured around a central processing unit (MPU). That is, under the control of the central processing unit (MPU), audio information input from the microphone is processed by an A / D converter and a compression circuit via an amplifier, and is stored as digital audio information via a connector in the memory card 106 (stored). Means).

  FIG. 11 shows the appearance of the memory card 106. The memory card 106 is, for example, a credit card-sized plastic card incorporating an IC chip as a memory, and has a contact-type electrode 106a that constitutes a signal pin and a power supply pin. A non-contact wireless communication type RFID card may be used. In addition to such a card, a standard type memory card such as an SD card (trade name), a mini SD card (trade name), a Memory Stick (trade name), or a Memory Stick Duo (trade name) may be used.

  When the voice recorder 101 reproduces the voice information, the digital voice information read from the memory card 106 (storage means) is read into the central processing unit (MPU) via the connector, and is reversed by the compression circuit. It is compressed (decompressed), converted into analog information by an A / D converter, and output from a speaker via an amplifier (AMP).

  The drive current of the voice recorder 101 is supplied from the battery to the central processing unit (MPU), the compression circuit, and the amplifier (AMP) via the DC-DC converter.

  FIG. 6 shows an instruction board 600 (paper controller: print medium) for operating the voice recorder 101 by reading the scanner 113. On this instruction board 600, a symbol indicating an operation instruction of the voice recorder 101 is printed. A dot pattern indicating a code corresponding to the operation instruction is printed in the symbol area. The dot pattern will be described later.

  This instruction board 600 is made of a paper material, a dot pattern is printed on the surface of the paper material, and further, a laminate process is applied to the upper layer.

  On the instruction board 600, a recording 601, audio quality 602a to 602c, playback 604, fast forward 605, stop 606, pause 619, return / play 607, feed / play 608, head / play 609, tail / play 610 are provided. Each function of the voice recorder 101 can be commanded.

  A link-related instruction symbol is printed at the bottom of the instruction board 600. That is, instruction symbols for link start 611, link end 612, link release 613, and all link release 614 are arranged.

  Furthermore, at the bottom of the instruction board 600, instruction symbols for voice erasure 615 and all voice erasure 616, and instruction symbols for execution 617 and stop 618 are arranged.

  Although not shown, a voice navigation symbol may be printed on the instruction board 600 instead. This voice navigation is a symbol for inputting an indication of the presence or absence of voice guidance when operating the voice recorder 101 or the instruction board 600.

  FIG. 7 shows a format of audio information recorded in the storage means (memory card). The audio information is composed of an index 701 and a plurality of audio file tracks 702.

  In the index 701, management information for each track and a reproduction flag are registered.

  In addition, the index 701 records the erasure / update prohibition information of each audio file track 702. As a result, the audio file track can be erased / updated, and the erasure / update is prohibited. It is possible to manage by dividing into two types.

  For example, as a track for which erasure / update is prohibited, a memory card 106 sold as a set with a track storing a navigation voice file for instructing the next operation of the voice recorder 101 or the instruction board 600 by voice, a picture book, or the like. Then, a track where the voice actor has recorded the voice according to the story of the picture book can be considered. On the other hand, for a track that can be deleted / updated, it is possible to input a speech or the like that the purchased user becomes a character of a picture book and speaks.

  In addition, the above-mentioned voice navigation guidance voice or the like may be registered in a track for which deletion / update is prohibited.

  FIG. 8 shows a collation table and a collation code provided in the storage means (memory card).

  As shown in the figure, in the collation table in this embodiment, the values C8 to C22 and C31 are set as the collation range, and the collation code existing in this range matches the collation code read from the dot pattern. In this case, reproduction of audio information is permitted on the assumption that the dot pattern is suitable for the voice recorder.

  The collation table can be arbitrarily changed. For example, the collation range of the collation table may be changed for each manufacturer of the voice recorder, each manufacturer of the memory card, and each type of game.

  By registering such a collation table and collation code in the memory card 106, audio information can be recorded / reproduced only with a picture book in which the same code as the collation code is printed as a dot pattern. Is possible. That is, it is possible to provide a mechanism in which voice recording / playback can be performed only by a combination of a picture book sold as a set and the memory card 106.

  At this time, the central processing unit (MPU) receives a dot code (collation code) of a predetermined area from the scanner 113 based on the dot pattern read by the scanner 113 and compares it with the collation code of the memory card 106. If they match, recording / reproduction of the voice information in the memory card 106 is permitted.

  FIG. 10 illustrates the link table, and the link table is provided in the memory card 106. As shown in the figure, the link table is composed of a label indicating the registration order, an audio file track number, and a 32-bit dot code. In the present embodiment, a plurality of dot codes can be related to one audio file track number. This makes it possible to reproduce the same audio information even when a scanner 113 reads a medium such as a photograph, sticker, or picture book on which many different dot patterns are printed.

  Next, the dot pattern used in this embodiment will be described.

  12 and 13 sequentially show an example of a process for forming a stream dot pattern.

  The dot pattern according to the present invention is different from the conventional dot pattern. First, in step 1, corresponding to the visible information on the surface of the medium, the reference dot 1 is continuously arranged in a line at a position where information is input / output. Place multiple.

  In FIG. 11A, the reference dots 1 are arranged in a curved shape, but the arrangement of the reference dots 1 is not limited to this, and is composed of a plurality of line segments interwoven with straight lines and curves. Various modifications can be made to form the dot pattern in a shape that matches the area where information is input and output, such as a polygonal line.

  Further, the reference dot 1 may be arranged on an actual line that is visibly formed on the medium surface, or the reference dot 1 may be arranged according to a predetermined rule along the actual line. The real line here is a concept with respect to a virtual line, and includes all the lines that actually exist. For example, a solid line, a broken line, a dotted line, a straight line, a curved line, and the like can be given. Absent. In addition, the dot pattern may be unevenness such as printing, display display, or a hole or groove on a metal or plastic.

  In addition, it is desirable to arrange the reference dots at equal intervals from the viewpoint of improving reading accuracy, but the reference dots are not limited to this, and a plurality of intervals are mixed to define a set of constant information of the dot pattern, It is also possible to define both a set of constant information of a dot pattern and a direction of the dot pattern by arrangement intervals of three different reference dots in the set of fixed information.

  Next, as step 2, a first virtual reference line 2 that connects the reference dots 1 arranged in a line is provided. In FIG. 12B, the first virtual reference line 2 is provided by a curved line, but the first virtual reference line 2 is not limited to this, and for the reference dots 1 arranged in a curved line. The straight first virtual reference line 2 may be provided, or the curved first virtual reference line 2 may be provided for the reference dots 1 arranged in a straight line. That is, the second virtual reference line 3, the virtual reference point 4, and the information dot 5 in Step 3 to Step 5 which will be described later are arranged according to the positions where the reference dots are connected to each other. One virtual reference line 8 can be freely defined.

  As shown in FIG. 13, the first virtual reference line 2 in the case of a curve is preferably a Bezier curve.

  That is, first, the reference dots 1 on the first virtual reference line 2 are P0 and P3, and P1 and P2 are given control points. Next, points P4, P5, and P6 are obtained by dividing the three line segments P0-P1, P1-P2, and P2-P3 obtained by connecting the control points in order at a one-to-one ratio. Then, points P7 and P8 are obtained by dividing the two line segments P4-P5 and P5-P6 obtained by connecting these points in order at a one-to-one ratio.

  Finally, a point P9 that further divides the line segment connecting the two points, P7-P8, at a ratio of 1: 1 is obtained, and this point becomes a point on the Bezier curve.

  By repeating this procedure, a Bezier curve having control points P0, P1, P2, and P3 is obtained.

  Note that the first virtual reference line 8 may be provided using various algorithms such as a spline curve obtained using a spline function, an nth order polynomial, an elliptic arc, and the like, not limited to a Bezier curve.

  Also, in the second virtual reference line 3, it is possible to define a curve using this method as in the first virtual reference line 2.

  Next, as step 3, a second virtual reference line 3 defined at a predetermined position from the reference dots 1 and / or the first virtual reference line 2 arranged in a line is provided. In FIG. 12 (c), the second virtual reference line 3 is adjacent to the reference dot 1 adjacent to the predetermined position on the vertical line with respect to the tangent line of the first virtual reference line 2 at the midpoint between the adjacent reference dots 1. However, the second virtual reference line 3 is not limited to this, and a virtual reference point is provided in accordance with an area in which information is input / output by a dot pattern as will be described later. In addition, it can be defined by various methods.

  Further, the second virtual reference line 3 may be provided only on one side with respect to the first virtual reference line 2 to define the direction of the dot pattern, or may be provided on both sides to increase the amount of information. .

  Next, as step 4, a plurality of virtual reference points 4 are provided at predetermined positions on the second virtual reference line 3. In FIG. 13A, the virtual reference point 4 is an isosceles triangle whose bottom is the intersection of the second virtual reference lines 3, that is, the straight line connecting the adjacent reference dots 1, and the second virtual reference line 3 is the opposite side. However, the position of the virtual reference point 4 is not limited to this, and is provided at the midpoint of the second virtual reference line 3 or instead of the second virtual reference line 3. Various modifications such as provision on the dot 1 are possible.

  In step 5, the information dot 5 is arranged at the end point expressed by a vector with the virtual reference point 4 as the start point. In FIG. 13B, one information dot 5 is arranged for one virtual reference point 4 so that the vector direction from the virtual reference point 10 is eight directions and the distance from the virtual reference point 4 is equal. However, the arrangement of the information dots 5 is not limited to this, and the information dots 5 are arranged on the virtual reference point 4, the vector direction is set to 16 directions, or two are arranged for one virtual reference point 4. It is possible to arrange a plurality of elements in any direction and in any length.

  FIG. 15 is an enlarged view showing an example of dot display information dots and bit display of data defined in the dot.

  The information dot 5 is a dot for recognizing various information. The information dot 5 is arranged at the end point represented by a vector with the virtual reference point 4 as the start point. For example, as shown in FIG. 5, the information dot 5 is rotated by 45 degrees in the clockwise direction because a dot 0.1 mm away from the virtual reference point 5 has a direction and length expressed by a vector. These are arranged in 8 directions to represent 3 bits.

  In the illustrated example, 3 bits are expressed by arranging in 8 directions, but the present invention is not limited to this, and 4 bits can be expressed by arranging in 16 directions. Of course, it can be arranged in length.

  Further, in FIG. 13B, the information dot 3 is arranged at the end position of the virtual reference point 5 with the virtual reference point 5 as the starting point. However, the present invention is not limited to this. Information may be defined depending on whether or not is arranged. For example, information can be defined as “1” if a dot is arranged on a virtual reference point, and “0” if no dot is arranged.

  FIG. 16 shows an example of the information dot and the bit display of the data defined therein, and shows another form.

  Further, regarding the information dot 5, if two types of short (upper part in FIG. 16) and long (lower part in FIG. 16) are used from the virtual reference point 4 derived from the reference dot 1 and the vector direction is eight directions, then 4 bits. Can be expressed. At this time, it is desirable that the longer one is about 25-30% of the distance between the adjacent virtual reference points 5, and the shorter one is about 15-20%. However, it is desirable that the center interval between the long and short information dots 5 be longer than the diameter of these dots.

The information dot 5 is preferably one dot in consideration of its appearance. However, when it is desired to ignore the appearance and increase the amount of information, it is possible to have a large amount of information by allocating 1 bit for each vector and expressing the information dot 5 by a plurality of dots. For example, the vector of concentric eight directions, an information dot 5 is defined from the reference dot 1 can represent information of 2 ^8, and 2 ⁶⁴ in chunks of the information dot eight constant information 1.

  As described above, the stream dot pattern according to the present invention is continuous with a line including a curve unlike the reference dot formed in a two-dimensional lattice pattern in the conventional dot pattern proposed by the present inventor. Are formed based on the reference dots arranged in this manner.

  FIG. 17 is a diagram illustrating an example of a state where stream dot patterns are arranged in the vertical direction.

  In the figure, in addition to the reference dots and information dots, key dots and side dots are arranged. Key dots are dots arranged at both ends of a set of fixed information. This key dot is a representative point of the dot pattern 1 for one region representing a group of information dots. The side dots are dots arranged on the positive and negative extension lines of the shift of the key dot 2.

  In FIG. 6B, reference dots and stream dot patterns are arranged at equal intervals. As described above, by forming a plurality of stream dot patterns having a constant reference point interval, the XY coordinate values are defined without a gap. However, the stream dot pattern according to the present invention is not limited to this, and the interval between the dot patterns may be arbitrarily set as shown in FIG. Also, the interval between the reference dots can be set arbitrarily.

  As a result, the dot pattern in which the XY coordinates are defined is formed in the information area visually formed on the medium surface without being restricted by the shape of the rectangular area when used as a two-dimensional code (used as an index). It is possible to form a dot pattern by repeating a set of constant information in a combined free shape.

  Note that the virtual reference line and the virtual reference point according to the present invention are not actually printed and formed on the surface of the medium, but only when the dot pattern is arranged on the image memory of the computer or when the dot pattern is read. Is set virtually.

  By using this stream dot pattern, it is possible to form a dot pattern on a curved surface body such as a globe, a three-dimensional structure such as a human body model, a three-dimensional map, etc., and the present invention is not limited to a planar map or picture book. It is possible to use the input / output device according to the above.

  Such a dot pattern is printed on the surface of a photograph 116 (see FIG. 4), a picture book, a card, or the like. Further, each symbol portion of the instruction board 600 (paper controller) described with reference to FIG. 6 is also provided.

  Next, an operation procedure using the voice recorder 101 of this embodiment will be described.

(Basic function)
A picture book in which a dot pattern is superimposed on a picture and a recorded memory card 106 are sold as a set, and a user who purchases the memory card 106 installs the memory card 106 in the voice recorder 101. Then, as shown in FIG. 4, the connector 115 of the scanner 113 is attached to the connector terminal 110. When the scanner 113 reads a dot pattern superimposed on, for example, a picture of a dog in a picture book, the central processing unit (MPU) of the scanner analyzes the dot pattern with analysis software and converts it into dot code (code information). To do. This dot code is transmitted to the central processing unit (MPU) of the voice recorder 101. The voice recorder 101 searches the link table (see FIG. 10) of the memory card 106 based on the dot code. Then, an audio file track 702 corresponding to the dot code is searched, and the corresponding audio file track 702 (for example, dog cry) in the memory card 106 is read. The audio information of the audio file track 702 is reverse-compressed (decompressed) by a compression circuit, converted to analog audio information by an A / D converter, and output from a speaker via an amplifier (AMP). In this way, when the picture portion of the dog in the picture book is read by the scanner 113, the dog cry is reproduced from the speaker 102 of the voice recorder 101.

(Playback procedure)
Next, various reproduction methods in the case where audio information is associated with dot patterns in the memory card 106 in advance will be described in detail.

  First, when clicking (imaging) a picture book, photo, sticker, etc., on which a dot pattern is printed by a scanner, the dot code corresponding to the dot pattern is analyzed as described above, the link table is referenced, and the dot code is Corresponding audio information is played back. At this time, the central processing unit (MPU) turns on the LED of the recording / playback display unit along with the playback of the audio information.

  Next, when the fast-forwarding 605 symbol on the instruction board 600 is clicked (captured) by the scanner 113 during audio reproduction, fast-forward reproduction (x-times reproduction: x is an arbitrary integer) is executed.

  Here, when it is desired to restore the reproduction speed (normal audio reproduction), the fast-forward 605 symbol on the instruction board 600 is clicked again or the reproduction 604 symbol is clicked.

  If the symbol of the pause 619 on the instruction board 600 is clicked by the scanner 113 during the audio playback, the playback is paused (paused). Clicking the pause 619 symbol again resumes playback.

  Further, when the forward / replay 608 is clicked during the audio reproduction, the central processing unit (MPU) searches the link table (see FIG. 10) in the memory card 106 and the audio file track currently being reproduced. Playback of the audio file track 702 registered at the next label (order of registration) of 702 is started. When return / playback 607 is clicked, the central processing unit (MPU) searches the link table (see FIG. 10) and registers it in the label (order of registration) before the audio file track 702 that is currently played back. Playback of the audio file track 702 being started is started.

  When the tail / playback 610 is clicked during the audio playback, the central processing unit (MPU) searches the link table (see FIG. 10) in the memory card 106 and searches the last track of the audio file track 702 (see FIG. 10). In FIG. 10, reproduction of the audio file track No. 4) is started. When the top / reproduction 609 is clicked, the reproduction of the first track of the audio file track 702 (audio file track No. 3 in FIG. 10) is started.

(Recording procedure)
When a new voice is recorded in the voice recorder 101, the recording is started by clicking the symbol of the recording 601 on the instruction board 600 with the scanner 113 or pressing the recording / playback button 103 on the main body. The voice uttered toward the microphone 107 is digitally converted by an A / D converter and compressed by a compression circuit. Audio information is sequentially registered in the memory card 106 in such a compressed data format.

  During this recording, the recording is stopped by clicking the symbol of recording 601 or stop 606 on the instruction board 600 with the scanner 113 or pressing the recording / stop button 103 of the main body. Audio information recorded up to this time is recorded in the memory card 106.

  When erasing these sounds, the speaker 102 is in a state where the sound is being reproduced from the speaker 102 or when the symbol of the sound erasing 615 on the instruction board 600 is clicked by the scanner 113 within 5 seconds after the reproduction of the sound is completed. “Peep” sound is output from and the LED of the recording / playback display section 106 blinks for 5 seconds. If the execution symbol 617 on the instruction board 600 is clicked during the five seconds, the reproduced voice is deleted. At this time, the central processing unit (MPU) performs processing for deleting the data of the audio file track 702 from the memory card 106.

  Also, if the stop 618 symbol is clicked by the scanner 113 during the five seconds or no symbol is clicked during the five seconds, the voice erasure mode is terminated.

  Further, when it is desired to delete all the audio information recorded in the memory card 106, the symbol of all audio deletion 616 may be clicked with the scanner 113 instead of the above audio deletion 615.

(Link work)
In the present embodiment, it is possible to freely set which dot pattern the voice information recorded by the user himself or the existing voice information stored in the memory card 106 is related to. This is called link setting.

  The link setting is managed by a link table (set in the memory card 106) shown in FIG.

  When creating a link, first, the sound recording is started by clicking the symbol of the recording 601 on the instruction board 600 with the scanner 113 or pressing the recording / stop button 103. At this time, the LED of the recording / playback display unit 104 is in a blinking state.

  Next, when the dot pattern printed on the picture book, photograph, sticker, card, etc. is clicked (imaged) by the scanner 113 while maintaining the recording state, the central processing unit (MPU) stops the recording state, The dot code of the imaged dot pattern is registered in association with the recorded audio file track number. At this time, a “beep” sound is output from the speaker 102 to notify the user of link generation.

  When a dot pattern is clicked by the scanner 113, if another audio file track 702 is already associated with the dot code corresponding to the dot pattern and registered in the link table, the central processing unit (MPU) ) Outputs a “buzz” sound from the speaker 102 to notify the user that a link cannot be created.

  Next, a procedure for generating a link with a dot pattern when audio information is already registered in the memory card 106 will be described.

  First, when the link start 611 symbol on the instruction board 600 is clicked by the scanner 113, the central processing unit (MPU) of the voice recorder 101 blinks the LED of the link display unit 105 to notify the user of the link start.

  Next, the sound of the audio file track 702 to be linked by clicking the symbol of the reproduction 604 on the instruction board 600 with the scanner 113 is reproduced. At this time, the user sequentially switches the audio file track 702 to be reproduced by clicking forward / reproduce 608, return / reproduce 607, head / reproduce 609, and tail / reproduce 610 on the instruction board 600, and the desired audio file track 702 is selected. Find out.

  When a dot pattern printed on a picture book, photo, sticker, card, or the like is clicked on the scanner 113 while the desired audio file track 702 is being played in this way or within 5 seconds after the end of the audio playback, the audio file track 702 is clicked. The track 702 and the dot code of the dot pattern are related and registered in the link table. If the other audio file track 702 is already associated with the dot code corresponding to the dot pattern and registered in the link table, the central processing unit (MPU) sends “ A sound is output to notify the user that a link cannot be created.

  As described above, one dot pattern (dot code) can be linked to only one audio file track. Conversely, one audio file track 702 can be linked to a plurality of dot patterns (dot codes). . Therefore, even if the dot patterns are completely different, the same audio information can be reproduced by clicking.

  When ending the above link mode, the symbol of link end 612 on the instruction board 600 is clicked with the scanner 113. As a result, the voice recorder 101 returns to the initial state when the power switch 108 is turned on.

  Next, a procedure for deleting a link in the link table set as described above will be described.

  If one of the links is to be deleted, first the dot pattern for which a link has already been generated in the link table is clicked by the scanner 113, and the central processing unit (MPU) reads the associated audio file track. Reproduce.

  Next, the symbol of the link release 613 is clicked by the scanner 113 during the reproduction of the sound or for 5 seconds after the reproduction is finished. Next, the central processing unit (MPU) outputs a “beep” sound from the speaker 102 for 5 seconds and blinks the LED of the link display unit 105. During this time, if the execution execution 617 symbol on the instruction board 600 is clicked by the scanner 113, the link between the dot pattern (dot code) and the audio file track is released. At this time, the associated audio file track is not deleted simply by releasing the link.

  In addition, when the stop 618 symbol is clicked by the scanner 113 during the five seconds or when no symbol is clicked during the five seconds, this mode is terminated.

  Next, when all the links in the link table are to be released, the all link release 614 symbol may be clicked with the scanner 113 instead of the link release 613 symbol. Since the procedure is the same as that for releasing the individual links, the description thereof is omitted.

(Other features)
The voice recorder 101 has the following additional functions in addition to the above functions.

  If no switch or button is operated for 5 minutes and no dot pattern or symbol is clicked by the scanner 113, the power is turned off. This is realized when the central processing unit (MPU) performs counting for 5 minutes using a clock and performs control to open a switch between the central processing unit (MPU) and the DC-DC converter.

  The voice recorder 101 can change the voice quality (bit rate) with respect to the voice to be recorded. When the “low” symbol 602c of the voice quality is clicked by the scanner 113, the bit rate to be recorded is set low and recording for a long time becomes possible. On the other hand, when the “high” symbol 602a is clicked, the bit rate is set high and high-quality recording is possible. The “medium” 602b symbol can be set to an intermediate bit rate.

  The central processing unit (MPU) monitors the free space of the memory card 106, and notifies the user that the recordable time is short by blinking the LED of the recording / playback display unit 104 when the free space becomes less than 0.2 Mbytes. It is supposed to be. At this time, as described above, when the voice navigation symbol is clicked on the instruction board 600 with the scanner 113, the user is notified of the voice information, for example, the voice information such as “the memory is low”. You may output from 102.

  In the above embodiment, only the case of code information (dot code) as a dot pattern formed on a photo, a picture book, a card, a sticker, etc. has been described. You may make it read a combination and the combination of the angle information by the key dot 2 with a scanner.

  When the angle information is combined, for example, it is possible to output different audio information depending on the orientation (angle) of the card on which the dot pattern to be read is printed.

  18 and 19 show another embodiment of the present invention.

  A voice recorder 101a shown in FIG. 18 is substantially the same as the voice recorder 101 shown in FIG. 1, but uses an SD card 106A as a memory card. The other functions are the same as those described with reference to FIG. Although an SD card is illustrated in FIG. 18, any medium such as miniSD, a memory stick, or a memory stick Duo may be used as long as it is a memory medium.

  FIG. 19 shows a voice recorder 1901 integrated with a scanner.

  A sensor unit 1903 is built in the front end (upper end in the figure) of the voice recorder 1901. Although not shown, a CCD that captures reflected light from an infrared irradiation means such as an infrared LED or a dot pattern. And an imaging means made of CMOS is provided. That is, the scanner 113 described with reference to FIGS. 4 and 5 is structured so as to be integrated in the main body of the voice recorder 1901.

  A speaker 1902 is provided on the side surface in the vicinity of the bottom of the main body, and voices input from the microphone 1908, voices or music registered in advance in the SD card 106A (not shown in FIG. 19) or a built-in memory, etc. It is output.

  A scan button 1904, a recording button 1905, a volume 1906, an LED 1907, and a microphone 1908 are arranged on the front surface (operation surface, surface shown in FIG. 19B) of the voice recorder 1903 from the sensor unit side.

<Embodiment with rotation parameters>
20 to 27 show another embodiment of the present invention.

  These embodiments relate to a pedestal (voice information recording apparatus) that can output a dot code and a voice corresponding to the angle by recognizing the angle of the dot pattern (the direction of the figure).

  As shown in FIG. 20, the present embodiment includes a pedestal 2001, a scanner 113 connected thereto, a paper controller 2006 for reading by the scanner 113, and a figure 2003 placed on a stage 2002 on the upper surface of the pedestal 2001. Composed.

  Further, a microphone 2004 and a liquid crystal display unit 2005 are provided on the front side of the peripheral surface of the pedestal 2001.

  A sticker printed with the dot pattern described with reference to FIGS. 12 to 17 is attached to the bottom of the figure 2003.

  Inside the pedestal 2001, there are provided an infrared irradiation means (for example, an infrared irradiation LED) and an imaging means (CCD, CMOS, etc.) (not shown), and a figure 2003 through a reading hole provided in the stage 2002 of the pedestal 2001. The dot pattern on the bottom surface can be imaged.

  An instruction board (paper controller 2006) used in this embodiment is shown in FIG.

  The paper controller 2006 includes a recording area for designating recording, a link area, a rotation parameter area, a playback control area for performing playback control such as playback, fast forward, return / playback, feed / playback, head / playback, tail / playback, etc. A link control area for controlling the generation and release of the link and the erasure of the voice is provided, and a dot pattern is printed on each.

  That is, by imaging these areas of the paper controller 2006 with the scanner 113, it is possible to control voice input, reproduction, and relationship (link) with the figure.

  Further, the paper controller 2006 is provided with an ON / OFF area for rotation parameters.

  In this rotation parameter ON / OFF area, the dot pattern orientation parameter provided on the bottom surface of the figure is turned on (a mode in which the orientation parameter is also added) or turned off (ignoring the orientation parameter). Control mode), and when the ON region is imaged by the scanner 113, the figure 2003 on the stage 2002, for example, when placed with the front facing ( 20 (a)), different sound is output when placed sideways (FIG. 20 (b)) and placed with the back facing the front (FIG. 20 (c)). Is possible.

  FIG. 25 is a diagram illustrating a technique for detecting the direction of a dot pattern.

  As described with reference to FIG. 12, the dot pattern 1 has a configuration in which the information dots 3 are arranged around the key dots 2. Therefore, in an algorithm (an analysis program executed by the central processing unit) for extracting a value meaning an information dot from the dot pattern 1, the image data of the dot pattern 1 captured by the scanner 113 or the sensor unit 1903 is stored in a video memory. First, the key dot 2 is searched by analyzing the pixels of the video memory. Therefore, when the key dot 2 is retrieved, the direction of the dot pattern 1 (the angle θ of the inclination of the dot pattern 1 with respect to the imaging reference line 2501 (here, the Y positive direction)) can be calculated.

  In the present embodiment, the angle of this direction is added as a parameter to a code value that means a dot pattern, and voice data (voice address) to be output can be changed depending on the angle even for the same dot pattern.

  Here, the angle with the direction of the dot pattern relative to the positive Y direction has been described here, but it goes without saying that the positive X direction may be used as a reference.

  FIG. 26 is a sound determination table when the angle is added as a parameter. This will be specifically described in association with the orientation of the figure 2003 described in FIG. 20. When the figure 2003 is placed facing the front (FIG. 20A), the angle is −46 to +45. Since it is (0 ± 45) degrees, the angle no. The sound “Good morning” registered in the voice address a with 001 selected is uttered from a speaker (not shown) of the base 2001.

  Also, as shown in FIG. 20B, when the figure 2003 is placed facing leftward, the angle is +46 to +135 (90 ± 45) degrees. 002 is selected, the voice that has been registered in the voice address b "Hello" is uttered from the speaker of the base 2001 (not shown).

  Furthermore, as shown in FIG. 20C, when the figure 2003 is placed backward as viewed from the front, the angle is +136 to +225 (180 ± 45) degrees. 003 is selected and the voice “Good evening” registered in the voice address c is uttered from the speaker (not shown) of the base 2001.

<Recording and link processing>
Next, the operation procedure of the voice recorder of this embodiment will be described with reference to FIGS.

  First, the central processing unit (MPU) of the scanner determines whether or not the symbol of the rotation parameter ON 804 is clicked by the user based on the program (2201). If it is determined that the button has been clicked, the process proceeds to step 2202. If it is not determined that the button has been clicked, the process ends.

  In step 2202, the rotation parameter is turned ON. The central processing unit (MPU) of the scanner analyzes the dot pattern read in step 2201 with analysis software, and converts it into dot code (code information). This dot code is transmitted to the central processing unit (MPU) of the base 2001. Then, the central processing unit (MPU) of the base 2001 turns on the rotation parameter.

  Next, it is determined whether or not the recording 801 has been clicked (2203). If it is determined that the button has been clicked, the process proceeds to step 2204. If it is not determined that the button has been clicked, the process ends.

  In step 2204, the recording mode is turned ON.

  Next, a recording process is performed (2205). The central processing unit (MPU) of the pedestal 2001 digitally converts the voice uttered toward the microphone 2004 by the A / D converter and compresses it by the compression circuit. Audio information is sequentially registered in the memory in such a compressed data format.

  Next, it is determined whether or not the link start 802 symbol has been clicked (step 2206). If it is determined that the button has been clicked, the recording is stopped (2301). If it is not determined that the button has been clicked, the process proceeds to step 2207.

  In step 2207, it is determined whether or not the voice recording is completed (2207). If it is determined that the symbol of the recording 801 or the symbol of the stop 808 has been clicked, it is determined that the recording has been completed. If it is determined that the recording has been completed, this process is terminated. If it is not determined that the recording has been completed, the process of step 2207 is performed again.

  In step 2301, the recording state is stopped. Then, the link mode is turned ON (2302).

  Next, it is determined whether or not the link end 803 symbol has been clicked (2303). If it is determined that the button has been clicked, the process ends. If it is not determined that the button has been clicked, the process proceeds to step 2304.

  In step 2304, it is determined whether or not the figure 2003 is placed on the stage 2002 of the pedestal 2001. Whether or not the figure 2003 is placed is determined based on whether or not the pedestal sensor unit can read the dot pattern on the bottom surface of the figure 2003. If it is placed, the dot pattern read by the sensor is transmitted to the central processing unit (MPU).

  In step 2305, code information is extracted and an angle is detected. The central processing unit (MPU) extracts code information from the read image information by an image processing algorithm. Then, the angle of the dot pattern is calculated from the position of the key dot.

  Next, it is determined whether or not the dot code and the angle are already linked (2306). The pedestal central processing unit (MPU) determines whether or not another audio file track has already been registered in the link table in association with the dot code and the angle. If it is already linked, the processing from step 2303 is performed again, and if it is not determined that it is linked, the processing moves to step 2307.

  In step 2307, link processing is performed. The central processing unit (MPU) registers code information and an angle in association with the recorded audio file track number.

  Next, the central processing unit (MPU) reads the value of the timer and determines whether or not 5 seconds have passed since the link start 802 symbol was clicked. If it is less than 5 seconds, the processing from step 2303 is performed again. If 5 seconds have elapsed, this processing is terminated.

  In this process, recording and linking are performed continuously, but it is also possible to generate a link with voice information already registered in the memory.

<Linked audio playback processing>
Next, the procedure for reproducing the voice linked by the processing of FIGS. 22 and 23 will be described with reference to FIG.

  First, the central processing unit (MPU) of the scanner determines whether or not the user has clicked on the rotation parameter ON 804 symbol. If it is determined that the button has been clicked, the rotation parameter is set to ON (2402). If it is not determined that the button has been clicked, this process ends.

  Next, it is determined whether or not the figure is placed (2403). If it is determined that the figure is placed, the dot pattern read by the sensor is transmitted to the central processing unit (MPU). Then, code information is extracted from the read image information (2404), and the angle of the dot pattern is calculated from the position of the key dot (2405).

  Next, an audio reproduction process is performed (2406). The central processing unit (MPU) searches the link table in the memory, searches for an audio file track corresponding to both the code information and the angle, and reads the corresponding audio file track in the memory. The audio information of the audio file track 702 is reverse-compressed (decompressed) by a compression circuit, converted to analog audio information by an A / D converter, and output from a speaker via an amplifier (AMP).

<Angle detection method>
As described above, FIG. 25 illustrates the angle of the dot pattern 1, and the angle (orientation) of the inclination of the dot pattern 1 in the plane direction is detected by detecting the position of the key dot 2 described above. Can be done. The voice determination table of FIG. It consists of a voice address. When the dot pattern 1 is read by the sensor, the character code recorded in the dot pattern 1 is first determined. Next, when the angle of the dot pattern 1 is calculated based on the key dot 2, the angle No. Is determined. The character code and angle No. Thus, the corresponding voice address is determined. Voice address and is associated the voice, for example, if the voice address is of a "Hello", in the case of b is output voice of a "goodbye".

  In FIG. 26, the angle No. is set every 90 degrees, that is, in four directions. Is determined. In this case, the angle information is expressed by 2 bits. However, the present invention is not limited to this. May be determined. For example, in the case of 8 directions, the angle No. is changed every 45 degrees. The angle information is expressed in 3 bits. In the case of 16 directions, the angle No. is changed every 22.5 degrees. The angle information is expressed in 4 bits.

  FIG. 27 is a diagram illustrating the relationship between the tilt and angle of the sensor.

  As shown in (a), the angle formed by the direction of the dot pattern and the direction of the sensor is α. Also, as shown in (b), the angle formed by the sensor tilt and the sensor orientation is β. In this case, an angle γ formed by the direction of the dot and the inclination of the sensor is an angle obtained by inclining the figure. That is, the angle γ is γ = α + β.

<When the angle parameter is OFF>
Next, a procedure for reproducing the sound linked to the dot pattern when the angle parameter is OFF will be described.

  When the user clicks the symbol of the angle parameter OFF 805, the angle parameter is turned OFF. Next, when the sensor of the pedestal 2001 reads the dot pattern on the bottom of the figure 2003 placed on the stage, the central processing unit (MPU) analyzes the dot pattern with analysis software and converts it into a dot code (code information). Convert. Then, the memory link table is searched based on the dot code, and the audio file track corresponding to the dot code is read. Here, when a plurality of sounds are linked to the dot code at different angles, the last recorded sound is read out.

<Operation by connecting to a personal computer>
In the embodiment described above, the operation is performed using the instruction board 800, but the present invention is not limited to this.

  For example, as shown in FIG. 28, the pedestal 2001 may be connected to a personal computer 2801 using a connector. In this case, the user performs operations such as recording, reproduction, and linking using a keyboard and a mouse (not shown).

<Operation with buttons on the base>
Also, as shown in FIG. 29, this pedestal 2001 itself can be connected to the USB terminal of a personal computer 2801, and sound control, alarm time setting, etc. can be performed on the personal computer side. In this case, the liquid crystal display unit 2005 provided on the base 2001 may be unnecessary.

  Further, as shown in FIG. 30, a card may be placed on a pedestal 2001, and the above operation may be performed by reading a dot pattern printed on the card.

<Voice recorder with voice recognition function>
FIG. 31 shows another form of the voice recorder in which the scanner is integrated.

  This voice recorder 3101 has an input function for voice recognition and a liquid crystal display screen 3110 in addition to the functions of the integrated voice recorder shown in FIG.

  In the voice recorder 3101, when the recording button 3105 is also used as a voice input button, when the voice recorder 3101 is used as a voice input device, the voice information is voiced by uttering toward the microphone 3108 while pressing the recording button 3105. Input to the recorder 3101.

  The utterance information is digitally converted by an A / D converter (not shown) in the voice recorder, then analyzed by a voice recognition circuit, and converted into text information corresponding to the utterance information.

  For example, when schedule information such as a business trip is registered in advance, when the user utters “schedule” or “plan” while pressing the recording button 3105, this is analyzed by the voice recognition circuit, and “schedule” or “schedule” respectively. The database is converted to text data “schedule”, and the database constructed in the memory using these text data as search keys is searched to extract the text information “XX business trip”, which is converted into voice information and speaker 3102. Say “Business trip”.

  Note that the database stores voice information itself “XX business trip” in a memory, and date information (for example, “April 28”) may be associated with the text.

  In this case, by simply saying “April 28” to the voice recorder 3101 by voice, the voice is converted into text data, the database is searched, and the voice of “XX trip” corresponding to this text data is searched. Information may be output from the speaker 3102.

  In the above example, the case has been described where the data searched by searching the database in the voice recorder based on the input voice information is uttered from the speaker 3102. However, the voice recorder is used for voice recognition. It may be used only as an input device, or may be used as a voice recognition terminal having a scanner function by omitting the recording function. A personal computer may be connected to a plurality of voice recorders to exchange voice mails.

  For example, when voice information uttered while the user presses the record button 3105 is input, the central processing unit (MPU) of the voice recorder transmits the voice information from the antenna 3109 to the personal computer through a communication interface (not shown), The voice information is analyzed by the voice recognition program in the personal computer, converted into text data, the database constructed in the personal computer or the database on the network is searched, and the search result is output to the display device of the personal computer. May be.

  Alternatively, the search result data may be returned to the voice recorder using a communication function and uttered as voice information from the speaker 3102 of the voice recorder.

  FIG. 32 shows a configuration of the paper controller 3200 for improving the voice recognition accuracy and for classifying the inputted voice information.

  As shown in the figure, the paper controller 3200 includes “name input” (3208), “postal code input” (3209), “address input” (3210), “telephone number input” (3211), “mail”. Input voice categories such as “address input” (3214) are printed as areas, and different codes are printed as dot patterns in these areas. Similarly, as an input function, areas of “up”, “decision”, and “down” are printed, so that a candidate or menu displayed on the display screen can be selected.

  That is, when a voice input is performed by pressing the recording button 3105 of the voice recorder 3101, the category code (dot pattern) is scanned in advance by the sensor unit 3103, thereby improving the voice recognition accuracy and classifying the input voice information. Is.

  For example, if you say “Ueno”, it is difficult to know whether it is Ueno or the name of a person, but after “Address input” is scanned, the voice “Ueno” is input as voice information. In this case, the voice information of “Ueno” is transmitted to the personal computer together with the address input category code.

  The central processing unit (MPU) of the personal computer can easily determine that the voice information of the “Ueno” is the “address” category by adding the address input category code. Can be displayed on the display screen of a personal computer.

  Note that the communication destination of the voice recorder is not limited to such a personal computer, and may be any device such as a car navigation device, an information home appliance, a control device, or a robot. That is, by using this voice recorder as an input device for a voice recognition function, it is possible to control all information devices and information home appliances.

  Next, as an example of this embodiment, a case where voice recognition is performed using an instruction boat (paper controller) 3200 shown in FIG. 32 will be described.

  The instruction board 3200 is used when ordering products from a catalog of mail order sales. In a mail-order catalog (not shown), a dot pattern is superimposed and printed on the product photo, and the user clicks the product photo with the sensor unit 3103 of the voice recorder 3101 (dots in the photo portion with the sensor unit). When a pattern is imaged), a product description screen corresponding to the code meaning the dot pattern is displayed on the display screen of a personal computer (not shown). In addition, the dot pattern is also superimposed on the part of the catalog where the product number is printed, and when you click the product number print surface, the order product information is displayed on the display screen of the personal computer. Registered in Next, when a confirmation 3201 is clicked, an order list is displayed on the screen. When selecting a product registered in the order list, click each symbol of 3202 up and 3203 down. To change the number of orders, increase the number of orders 3204 or decrease the number of orders 3205 Click. When canceling the order list of the registered products, the user clicks all cancel 3206, and when the product and quantity to be ordered are determined, clicks on the order 3207. Also, to return to the last viewed product catalog screen, click Back 3212. To end the order program, click End 3213. When performing these operations, the user clicks a desired product photo and symbol while pressing the scan button 3104.

  After the product to be ordered is determined, the user inputs a name, an address, and the like. When the user clicks the name input 3208 while pressing the scan button 3104, the central processing unit (MPU) built in the scanner 3101 analyzes the dot pattern and converts it into a dot code (code information). When this dot code is transmitted to the central processing unit (MPU) of the computer, the speech recognition mode is turned on based on the dot code.

  Next, the user speaks his / her name toward the microphone 3108 while pressing the recording button 3105. Then, the central processing unit (MPU) digitally converts the voice uttered toward the microphone by an A / D converter (not shown), and compresses and / or converts it by a compression circuit. Such compressed data is transmitted to the computer through the antenna 3109. The central processing unit (MPU) of the computer analyzes the voice data with voice analysis software, converts it into character information, and displays the character information on the screen. By the same operation, the postal code, address, and telephone number are also input by the voice input function.

  By having such a voice input function, the user can input information such as an address with a simple operation without performing a complicated operation using a keyboard or a scanner.

  In the present embodiment, as described above, the dot pattern is read only when the dot pattern is clicked while the scan button 3104 is pressed. An LED, a CMOS sensor, and the like are built in the sensor unit 3103, but these consume power. Furthermore, since the voice recorder 3101 is wireless, it requires idling power to maintain the communication function at all times, so a battery (including a charger) is used, and it is necessary to suppress this power consumption. There is.

  Therefore, in order to minimize power consumption, the sensor unit 3103 is energized and functions only when the scan button 3104 is pressed.

  In the voice recognition function, voice input is performed only while the recording button 3105 is pressed. If the voice is always input, the microphone 3108 may recognize a voice that the user is not trying to input, and information that is not intended by the user may be input. Voice input is performed only while the voice input button 3105 is pressed so that only information desired by the user can be input.

  Note that the voice recorder 3101 shown in FIG. 31 is provided with an antenna 3109 so as to communicate with a personal computer by a wireless communication method, thereby transmitting voice information and code information obtained by reading a dot pattern to the personal computer side. However, only voice information or only code information may be transmitted to the personal computer.

<Voice mail system>
33 to 39 are for explaining a voice mail system using a voice recorder according to the present invention.

  FIG. 33 is a network configuration diagram in the present embodiment. In the voice mail system of the present invention, a personal computer is connected to another personal computer via a network such as the Internet, and data can be transmitted and received. These personal computers can communicate with the voice recorder by a short-range wireless communication system such as Bluetooth. The communication between the voice recorder and the personal computer is not limited to such Bluetooth, but may be any communication such as infrared communication, wireless LAN, or wired connection using a USB cable.

  FIG. 34 is a diagram illustrating a paper controller 3400 used when a user performs registration, transmission / reception, and the like of voice mail.

  On the left side of the paper controller 3400, a symbol for recording, reproducing, and linking voice is printed, and on the right side, a symbol for transmitting and receiving voice mail is printed.

  FIG. 35 is a diagram for explaining the voice mail database.

  FIG. 1 shows a system in which voice recorders transmit and receive voice mails, that is, voice data, inputted by the voice recorders while communicating with a voice mail control unit via a Bluetooth interface (I / F).

  The voice mail control unit is configured by a general-purpose server or personal computer that can be connected to a network, and a voice data storage unit is provided in a hard disk device connected to the server or personal computer.

  The voice data storage unit is provided with a reception index table and a transmission index table. Here, in the reception index table, the reception ID (the transmission source address or the ID number of the receiving voice recorder) and the data storage address are registered in association with each other. In the transmission index table, a transmission ID (transmission destination address or transmission destination voice recorder ID number) and a data storage address are associated and registered.

  That is, the voice mail control unit registers the ID of the voice recorder to be managed by the voice mail control unit in the reception index table, and sends the voice mail addressed to the reception ID defined in the voice recorder to itself. Are registered in the reception index table of the voice data storage unit.

  On the other hand, when voice mail is input from the voice recorder managed by the voice mail control unit, a transmission ID (transmission destination address or transmission destination voice recorder ID) is once registered in the transmission index table. After that, the voice mail control unit periodically accesses the transmission index table, and when there is unsent voice mail here, the voice mail data is sent via the network interface (NW I / F) and the network. The data is transmitted to a voice mail control unit (not shown) that manages the transmission ID.

  FIG. 36 is a flowchart for explaining data transmission / reception between a voice recorder and a personal computer (voice mail control unit).

  First, it is determined whether there is a voice recorder in the communicable area (3601). When the voice recorder is arranged in the vicinity of the personal computer, the voice recorder ID is transmitted to the personal computer by a short-range wireless communication system such as Bluetooth. If this voice recorder ID is transmitted, it is determined that there is a voice recorder in the communicable area.

  Next, it is determined whether or not a voice recorder ID has been read (3602). The personal computer reads the voice recorder ID via the Bluetooth I / F.

  Next, it is determined whether there is a matching ID in the reception index table (3603). The control unit determines whether there is an ID that matches the read voice recorder ID in the reception index table in the voice data database. If it is determined that the received ID exists, the data storage address corresponding to the received ID is accessed, and the received data is read (3604). Then, the read reception data is transferred to the voice recorder via the Bluetooth I / F (3605), and this process is terminated.

  On the other hand, if there is no ID that matches the reception index table, it is determined whether there is transmission data in the voice recorder (3606). If there is transmission data, the transmission data, that is, the destination address and voice data are read and registered in the transmission data index table in the database (3607). When registration is completed, this process is terminated.

  FIG. 37 shows a specific example in which voice mail is transmitted and received between users. As shown in FIG. 38, this figure is a system in which a voice mail management server is connected to the network to manage voice mails centrally.

  When the user A utters a voice to be input toward the microphone of the voice recorder outdoors, the voice data is stored as digital data in the memory through the microphone of the voice recorder.

  Next, the user A determines the destination of the voice mail. That is, a destination address is input using a paper controller. The input address is registered in the memory of the voice recorder.

  When a user A enters an indoor location such as a home or office and performs voice mail transmission processing, the user first places the voice mail in the vicinity of the personal computer. Then, with the Bluetooth communication function, the personal computer reads the device ID defined for each voice recorder, that is, the voice recorder ID. Next, the voice data and mail address stored in the memory are transmitted to the personal computer.

  When the personal computer (voice mail control unit) receives the voice data and the mail address, the personal computer (voice mail control unit) displays “receiving voice mail” on the monitor (display device). Then, the voice data and the mail address are transmitted to the voice mail management server.

  The voice mail management server registers the received voice data and address in a database in the server. Then, the voice data is transmitted to the corresponding mail address via the network I / F. The personal computer that has received the voice mail displays “voice mail acquisition / transmission” on the monitor (display device). Then, the voice data is transmitted to the voice recorder of the user B through the Bluetooth I / F. When the voice recorder receives the voice data, the voice recorder notifies the user B of “voice mail has arrived” on the voice and / or voice recorder monitor. Thereby, the user B receives the message transmitted by the user A.

  FIG. 38 shows an example in which a voice recorder is used in conjunction with a voice mail management server by a control program (voice mail manager) installed in a personal computer (PC).

  The user accesses the CD-ROM or Internet distribution server and executes the downloaded installation program on the personal computer (PC), and registers the voice mail manager as a resident program on the OS (operating system).

  Next, when the voice recorder is arranged in the vicinity of the personal computer (PC), the voice recorder ID is transmitted to the personal computer (PC) by a short-range wireless communication system such as Bluetooth. The central processing unit (CPU) in the personal computer (PC) authenticates the voice recorder ID in the voice mail management server. That is, it is authenticated whether or not the transmitted voice recorder ID is an ID of a voice recorder that can transmit and receive data using the personal computer (PC).

  Here, in the case of a voice recorder capable of transmitting and receiving, the voice mail transmitted to the voice recorder ID is stored with reference to the voice mail management table (dot code management table) in the personal computer (PC). Check if it is.

  If voice mail is stored, the central processing unit (CPU) reads the voice mail and transmits it to the voice recorder by a short-range wireless communication system such as Bluetooth.

  Next, the voice data received (downloaded) from the personal computer is reproduced by the voice recorder, so that the receiver can listen to the voice mail.

  If no voice mail is stored in the voice mail management table (dot code management table), the voice mail management server on the Internet is referred to. Here, if the voice mail transmitted to the voice recorder ID is stored in the voice mail management table of the voice mail management server, the voice mail is read and downloaded into the personal computer (PC).

  When necessary voice mail is downloaded into the personal computer (PC) for each personal computer managing the voice recorder, the voice mail and additional data in the voice mail management table for starting the voice mail (voice data) are downloaded. Data storage address, dot code) are also downloaded and thereafter managed only by the voice mail management table in the personal computer.

  Therefore, when the same voice recorder ID is transmitted thereafter, the voice mail management server on the Internet is not accessed again, and the personal computer is based on the voice mail management table including the newly added data. The voice mail downloaded in the hard disk device (HD) is read out.

  When performing transmission processing using a voice recorder, the personal computer performs Bluetooth communication with the voice recorder when the voice recorder managed by the personal computer is located nearby, and the voice recorder ID (device) ID) and voice mail stored from the memory of the voice recorder. At this time, the dot code when the dot pattern is scanned during recording by the voice recorder is registered in association with the device ID.

  Then, by the batch processing, the personal computer periodically accesses the voice mail management server, and transmits the data of the voice mail management table to the voice mail management server. When the voice mail management server receives the data, the voice mail management server updates its own voice mail management table based on the data.

<Voice recognition data communication>
FIG. 40 describes an embodiment of the present invention. In the present invention, various controls can be performed by performing voice recognition data communication. FIG. 40 shows, as an example, a specific example in the case where control is performed in a factory, and FIG. 41 shows a paper controller used in the control.

As described above, according to the present invention, it is possible to control the machine robot and the printing press using the voice recorder whose input is controlled by the dot pattern. For example, when controlling the printing press, click on the “printing press” and “voice command input” icons on the paper controller in FIG. 41, and then input instructions such as “Move at double speed” and “Start printing” by voice. To do. To control a surveillance camera, click “Monitor Camera” or “Voice Command Input” and then “Light up”.
Input a voice command such as “Set to wide angle”.

  In addition to the aspect described in the present embodiment, the present invention can also be applied as, for example, a control technique for a voice recorder for coverage. For example, it may be used as a voice recorder when an interviewer interviews and the voice recognition may be controlled by the paper controller shown in FIG.

  Also, since the voice recorder described in FIGS. 37 and 38 has a function of transmitting and receiving voice data via a network, the voice recorder can also be used as a terminal equipped with a microphone and a speaker of an IP phone, for example. . In this case, when the voice recorder is always arranged in the vicinity of the personal computer, it can be used as a normal IP telephone terminal, so that an internal memory for storing voice data is not necessary. By installing a memory, voice mail can be registered in the voice recorder even when the user is in an isolated place where communication with a personal computer is not possible. In this case, when the voice recorder is arranged in the vicinity of the personal computer, the voice mail can be automatically transmitted or received by the voice mail manager or the like installed in the personal computer by Bluetooth communication. .

  FIG. 39 shows a paper controller used for such a purpose, and it is possible to reproduce or download a voice mail addressed to itself received by a personal computer.

  In addition, voice mail can be created / registered and uploaded to a personal computer.

  In addition, an area in which dot patterns of modes (PC and sync) for synchronizing the contents of voice mail and voice recorder memory in the personal computer are prepared.

  The present invention relates to the relationship between media such as picture books, photographs, cards, and stickers and the reproduction of audio information, and can be used as an audio recorder, audio reproduction device, and input device for audio recognition.

1 reference dot 2 first virtual reference line 3 second virtual reference line 4 virtual reference point 5 information dot 101, 1901, 3101 voice recorder 102, 1902, 3102 speaker 103 recording / stop button 104 recording / reproduction display unit 105 link Display unit 106 Memory card 107 Microphone 108 Power switch 109 Volume 110 Connector terminal 111 Audio output terminal 112 External power supply terminal 113 Scanner (optical reading means)
114 Cable 115 USB connector 116 Photo 600 Instruction board 701 Index 702 Audio file track

Claims (7)

Voice information input means for inputting voice information;
Storage means for storing the input voice information;
A preprinted step of arranging a plurality of reference dots continuously in a line according to a predetermined rule, and a first virtual reference line comprising a straight line, a broken line and / or a curve connecting the plurality of reference dots Providing at least one second virtual reference line consisting of a straight line and / or a curve defined at a predetermined position from the reference dot and / or the first virtual reference line; A step of providing a plurality of virtual reference points at predetermined positions on the second virtual reference line, and an XY coordinate value and / or an end point represented by a vector with the virtual reference point as a starting point and a distance and direction from the virtual reference point Alternatively, an optical reading that reads a dot pattern formed by arranging one or more stream dot patterns arranged according to the process of arranging information dots in which code values are defined. And the stage,
Conversion means for converting the dot pattern read by the optical reading means into code information and coordinate information;
An association instruction means for associating the code information / coordinate information converted by the conversion means with the voice information;
A link table for registering the relationship between the audio information and the code information / coordinate information related by the correlation instruction means;
An audio information recording apparatus comprising: an audio information reproducing unit that reads out and outputs the audio information associated with the link table after the dot pattern is read again by the optical reading unit.   In order to define the second virtual reference line and / or to define the direction of the dot pattern and one XY coordinate value and / or code value, the stream dot pattern has a reference dot serving as a reference. The audio information recording apparatus according to claim 1, provided at a predetermined position. 2. The audio information recording apparatus according to claim 1, wherein the link table relates a plurality of code information / coordinate information to one audio information. 2. The audio information recording apparatus according to claim 1, wherein the storage means for storing the audio information is a card storage medium. At least the input start of the audio information, the input end of the audio information, the reproduction of the audio information,
2. The audio information recording apparatus according to claim 1, further comprising a print medium on which a dot pattern readable by the optical reading unit is printed separately from the apparatus main body in order to instruct to stop reproduction.   As the association instruction means for instructing the association between the code information / coordinate information and the audio information or canceling the association, a print medium on which a dot pattern that can be read by the optical reading means is printed The audio information recording apparatus according to claim 3, which is separately provided. The dot pattern is a dot pattern having an orientation depending on a positional relationship between the medium surface and the optical reading unit,
An angle formed by the X positive direction or Y positive direction of the XY coordinates based on the pixel group stored therein and the direction of the dot pattern in the image storage area in which the dot pattern photographed by the optical reading unit is stored as a pixel group And means for calculating
6. The audio information recording apparatus according to claim 1, further comprising means for storing and reproducing the audio information that differs for each angle information in addition to the code information and coordinate information.

Images