JP3564051B2 - Information reproducing apparatus and information reproducing method - Google Patents

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention optically converts so-called multimedia information including audio information such as audio and music, video information obtained from a camera and video, and digital code data such as text data obtained from a personal computer and a word processor. The present invention relates to an information reproducing apparatus and an information reproducing method for reading the above dot code from a sheet-like recording medium such as paper, various resin films, and metal recorded as a readable dot code and reproducing and outputting the original multimedia information.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, various media such as a magnetic tape and an optical disk have been known as media for recording voice, music, and the like.
[0003]
However, even if these media are made in large quantities, the unit price is somewhat expensive, and a large space is required for storage.
[0004]
Furthermore, if it is necessary to hand over the recorded media to another person at a remote location, it takes time and effort to mail it or take it directly. There was also.
[0005]
Therefore, it has been considered to record audio information on paper in the form of image information that can be transmitted by facsimile and that can be copied in large quantities at low cost. For example, as disclosed in Japanese Patent Application Laid-Open No. Sho 60-244145, a proposal has been made such that audio information is converted into image information by sending a small amount of audio into an optical code and can be transmitted by facsimile. Have been.
[0006]
[Problems to be solved by the invention]
However, in the apparatus disclosed in the above publication, the facsimile apparatus has a sensor for reading the optically readable recorded voice, and reproduces the voice according to the sensor output. Therefore, it is assumed that the optically readable audio information transmitted by facsimile can only be heard at the place where the facsimile device is installed, and that the facsimile output paper is moved to another place to reproduce the sound. Had not been.
[0007]
Therefore, if the recording capacity of audio information is increased, it may affect other facsimile transmission / reception. If the content of audio recording itself is difficult, the first It is possible that you forget. Furthermore, the recording capacity is limited by the recording density and the compression method, and only a few seconds of audio can be transmitted. Therefore, in order to transmit a large amount of audio information, a magnetic tape or an optical disk must be used.
[0008]
Further, even for short-time audio information, the reproduction apparatus itself is built in the facsimile apparatus, so that it is inconvenient for the repeated reproduction of the audio information.
[0009]
A low-cost and large-capacity recording / reproducing system for so-called multimedia information including video information obtained from a camera, video, and the like, and digital code data obtained from a personal computer, a word processor, etc., other than audio information. Has not yet been realized.
[0010]
SUMMARY OF THE INVENTION The present invention has been made in view of the above points, and has been made in consideration of the above, and provides multimedia information including audio information, video information, digital code data, and the like recorded on a recording medium in a format that can be recorded at a low cost, has a large capacity, and can be repeatedly reproduced. It is an object of the present invention to provide an information reproducing apparatus and an information reproducing method capable of reproducing and outputting the information.
[0011]
[Means for Solving the Problems]
In order to achieve the above object, an information reproducing apparatus according to the present invention reproduces the data by optically reading the code from a recording medium having a portion where data is recorded as an optically readable code. An information reproducing apparatus,
The code is
A data dot pattern in which a plurality of dots are two-dimensionally arranged according to the data;
A marker for setting a reading point of the dot, having a size larger than the size of the dot by a predetermined amount and having a pattern that is impossible in the data dot pattern;
At least,
The code to be read is readableMultiple types with different dot sizes from each otherThe largest size of codeIncludes dots and markersAssuming codeTheRead the codeStarting, when it is determined that the assumption is not a correct assumption, the code to be read is re-assumed to be a code including a dot and a marker of the next largest size among the readable codes, and ReadIt is characterized by having a means for performing.
[0012]
Further, an information reproducing method according to the present invention is an information reproducing method for reproducing the data by optically reading the code from a recording medium having a portion where data is recorded as an optically readable code,
The code is
A data dot pattern in which a plurality of dots are two-dimensionally arranged according to the data;
A marker for setting a reading point of the dot, having a size larger than the size of the dot by a predetermined amount and having a pattern that is impossible in the data dot pattern;
At least,
The code to be read is readableMultiple types with different dot sizes from each otherThe largest size of codeIncludes dots and markersAssuming codeTheRead the codeStarting, when it is determined that the assumption is not a correct assumption, the code to be read is re-assumed to be a code including a dot and a marker of the next largest size among the readable codes, and ReadIt is characterized by performing.
[0013]
That is, according to the information reproducing apparatus and the information reproducing method of the present invention, the code is read on the assumption that the code to be read is the largest code among the readable codes. Then, when the assumption is not a correct assumption, the code to be read is read again assuming that it is the next largest code among the readable codes.
[0014]
Accordingly, multimedia information including audio information, video information, digital code data, and the like recorded on the recording medium in a format that can be recorded at low cost and with large capacity and that can be repeatedly reproduced can be reproduced and output. Further, a code having a different dot size can be reproduced by one reproducing apparatus.
[0015]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings. First, embodiments of multimedia information related to audio information such as voice and music will be described.
[0016]
FIG. 1 is a block diagram of an audio information recording apparatus for recording audio information such as voice and music on a paper as an optically readable digital signal in the first embodiment of the present invention.
[0017]
An audio signal input from an audio input device 12 such as a microphone or an audio output device is amplified by a preamplifier 14 (in the case of microphone audio, AGC is applied), and then converted into a digital signal by an A / D converter 16. The digitized audio signal is subjected to data compression in a compression circuit 18 and then an error correction code addition circuit 20 adds an error correction code.
[0018]
After that, the memory circuit 22 performs interleaving. This interleaving is to two-dimensionally disperse an array of data according to a predetermined rule. When the data is returned to the original array by the reproducing apparatus, bursty stains and scratches on the paper, that is, The errors themselves are dispersed, so that error correction and data interpolation become easier. This interleaving is performed by appropriately reading and outputting the data stored in the memory 22A by the interleaving circuit 22B.
[0019]
The output data of the memory circuit 22 is then converted by a data adding circuit 24 into a marker, an x-address and a y-address indicating a two-dimensional address of the block for each block in accordance with a predetermined recording format which will be described in detail later. , And an error determination code, the data is modulated by the modulation circuit 26 for recording. Then, after data such as image data recorded together with the output data of the audio information is superimposed by the synthesizing circuit 27, the printer system or the printing plate-making system 28 performs a process for printing.
[0020]
Thereby, for example, it is recorded on the paper 30 as a recording medium in a format as shown in FIG. That is, the digital signalized sound data is printed as the recording data 36 together with the image 32 and the character 34. Here, the recording data 36 is composed of a plurality of blocks 38. Each block 38 includes a marker 38A, an error correction code 38B, audio data 38C, x address data 38D, y address data 38E, and an error determination code 38. 38F.
[0021]
Note that the marker 38A also functions as a synchronization signal, and uses a pattern such as DAT that does not normally appear in recording modulation. The error correction code 38B is used for error correction of the audio data 38C. The audio data 38C corresponds to an audio signal input from the audio input device 12 such as the microphone or the audio output device. The x and y address data 38D and 38E are data indicating the position of the block 38, and the error determination code 38F is used for error determination of these x and y addresses.
[0022]
The recording data 36 in such a format is obtained by changing the data of “1” and “0” to “1” with black dots and “0” with no black dots, for example, like a bar code. Alternatively, print recording is performed by the printing plate making system 28. Hereinafter, such recording data is referred to as a dot code.
[0023]
FIG. 2B shows a scene in which sound data recorded on the paper 30 as shown in FIG. 2A is read out by the pen-type information reproducing device 40. By tracing over the dot code 36 with the pen-type information reproducing device 40 as shown in FIG. 3, the dot code 36 can be detected, converted into sound, and heard by the audio output device 42 such as an earphone.
[0024]
FIG. 3 is a block diagram of the information reproducing apparatus 40 according to the first embodiment of the present invention. In the information reproducing apparatus according to the present embodiment, parts other than the audio output device 42 such as headphones and earphones are housed in one portable pen-shaped housing (not shown). Of course, a speaker may be built in the housing.
[0025]
The detection unit 44 basically has the same function as an imaging unit such as a television camera. That is, the light source 44A illuminates the dot code 36 on the paper surface, which is a subject, and reflects the reflected light through an imaging system 44B such as a lens and a spatial filter 44C by an imaging unit 44D including a semiconductor area sensor or the like. , And the signal is amplified and output by the preamplifier 44E.
[0026]
Here, the pixel pitch of the area sensor is set to be equal to or smaller than the dot pitch of the dot code 36 on the imaging surface according to the sampling theorem. Furthermore, a spatial filter 44C installed on the imaging surface is also inserted based on this theorem in order to prevent the moire phenomenon (aliasing) on the imaging surface. In addition, as shown in FIG. 4A, the number of pixels of the area sensor is determined by taking into account camera shake during manual scanning of the detection unit 44, and in the vertical direction of a predetermined dot code 36 that is specified to be readable at a time. It is set to be larger than the width of. That is, FIGS. 4A and 4B show the movement state of the image pickup area in a certain cycle when the detection unit 44 is manually scanned in the direction of the arrow. In particular, FIG. The state of manual scanning when the vertical width of the code 36 falls within the image pickup area (considering camera shake) is shown. (B) shows a case where the amount of the dot code 36 is large and the vertical width is one. The case where it does not fit in the imaging area is shown. In the latter case, a mark 36A for manual scanning is printed at a position where manual scanning of the dot code 36 is started. Therefore, a large number of dot codes 36 can be detected by performing manual scanning a plurality of times along the manual scanning mark 36A.
[0027]
The image signal detected by the detection unit 44 as described above is then input to the scan conversion and lens distortion correction unit 46. In the scan conversion and lens distortion correction section 46, an input image signal is first converted into a digital signal by an A / D converter 46A and stored in a frame memory 46B. This frame memory 46B has 8-bit gradation.
[0028]
Further, the marker detection circuit 46C scans the image information stored in the frame memory 46B as shown in FIG. 4C to detect the marker 38A. The detection circuit 46D detects which marker 38A detected by the marker detection circuit 46C corresponds to which address value on the imaging surface, and, based on the address value, the inclination of the imaging surface with respect to the arrangement direction of the dot code. Calculate θ. Note that the marker detection circuit 46C rotates by approximately 90 ° in the scan in only the direction as shown in FIG. 4C as shown in FIG. When the imaging of the code 36 is performed, the inclination θ may not be correctly obtained. That is, when scanning is performed in the short direction of the block 38, there is a possibility that θ may not be obtained correctly. Therefore, the marker detection circuit 46C also performs the scanning in the orthogonal direction as shown in FIG. The correct one of the results obtained by the two-way scanning is selected.
[0029]
On the other hand, the lens aberration information memory 46E stores previously measured aberration information of the lens used in the imaging system 44B of the detection unit 44 for correcting lens distortion. The next time the address control circuit 46F reads out the data stored in the frame memory 46B, the value of the inclination θ calculated by the θ detection circuit 46D and the lens aberration stored in the lens aberration information memory 46E are used. A read address in accordance with the information is given to the frame memory 46B, and scan conversion is performed in the data arrangement direction while performing data interpolation by the interpolation circuit 46G.
[0030]
FIG. 5A shows the principle of data interpolation performed by the interpolation circuit 46G. Basically, the interpolation data is created by the convolution filter and the LPF using the pixels around the position Q at which the data is interpolated. The pixel pitch and the scan line pitch after the scan conversion are set to be equal to or smaller than the dot pitch of the dot code based on the sampling theorem, as in the case of imaging.
[0031]
In the case of simple data interpolation using four pixels around the position Q to be interpolated, Q = (D6 × F6) + (D7 × F7) + (D10 × F10) + (D11 × F11) In the case of relatively accurate data interpolation using 16 surrounding pixels, interpolation data is created by the calculation of Q = (D1 × F1) + (D2 × F2) +... + (D16 × F16). . Here, Dn is a data amplitude value of the pixel n, and Fn is a coefficient of an interpolation convolution filter (LPF) determined according to a distance to the pixel n.
[0032]
The image of the dot code 36 read from the frame memory 46B after being subjected to the scan conversion as described above is binarized by the binarization circuit 48 including the latch 48A and the comparator 48B. The threshold value at the time of performing this binarization is determined by the threshold value determination circuit 50 using the value of the histogram for each screen or for each block in the screen. That is, the threshold is determined according to the stain on the dot code 36, the distortion of the paper 30, the accuracy of the built-in clock, and the like. As the threshold value judgment circuit 50, for example, it is preferable to use a circuit using a neural network disclosed in Japanese Patent Application No. Hei 4-131051 by the present applicant.
[0033]
At the same time, the image of the dot code 36 read from the frame memory 46B is input to the PLL circuit 52, and generates a clock pulse CK synchronized with the reproduced data. The clock pulse CK is used as a reference clock for binarization and demodulation after scan conversion, and for an error determination circuit 56A, x, y address detection circuit 56B and a memory unit 56C in the data string adjustment unit 56, which will be described later. .
[0034]
The binarized data is demodulated by a demodulation circuit 54 and input to an error determination circuit 56A and an x, y address detection circuit 56B in the data string adjustment unit 56. The error determination circuit 56A uses the error determination code 38F in the block 38 to determine whether or not the x and y address data 38D and 38E have an error. If there is no error, the demodulated data from the demodulation circuit is recorded in the audio data string adjustment memory unit 56C according to the address detected by the x, y address detection circuit 56B. If there is an error, the audio data 38C of the block 38 is not recorded in the audio data string adjustment memory unit 56C.
[0035]
The purpose of the data string adjusting unit 56 is to adjust the accuracy of the scan conversion in the scan conversion and lens distortion correction unit 46 (which depends on the accuracy of the reference clock and the S / N of the image sensor) and the distortion of the data. An object of the present invention is to correct a slight shift generated in the arrangement direction and the scan direction after scan conversion. This will be described with reference to FIG. In the figure, dot codes D1, D2, and D3 indicate data for each block. The pitch of the scanning lines 1, 2, 3,... After the scan conversion may be set to be equal to or less than the data dot pitch based on the sampling theorem as described above, but in FIG. It is set to の of the dot pitch for the sake of convenience. Therefore, as apparent from the figure, the dot code D1 is detected without error on the scan line 3 after the scan conversion. D2 is detected without error on the scan line 2 after the scan conversion, and D3 is similarly detected without error on the scan line 1 after the scan conversion.
[0036]
Then, in accordance with the x and y addresses 38D and 38E in the respective blocks 38, the data is stored in the data string adjusting memory 56C.
[0037]
Next, as shown in FIGS. 4A and 4B, by manually scanning the detection unit 44, the voice dot code 36 on the paper 30 can be completely stored in the data row adjustment memory unit 56C. Can be stored.
[0038]
The audio dot code whose data string has been adjusted by the data string adjusting unit 56 is then used for adjusting the data string in accordance with a reference clock CK ′ generated by a reference clock generating circuit 53 different from the PLL circuit 52. From the memory section 56C. Then, at this time, the data is de-interleaved by the de-interleave circuit 58 and converted into a formal data string. Next, error correction using the error correction code 38B in the block 38 is performed by the error correction circuit 60. Then, the decoding circuit 62 decodes the compressed data, and the data interpolation circuit 64 interpolates the error-correctable audio data. After that, the signal is converted into an analog audio signal by the D / A conversion circuit 66, amplified by the amplifier 68, and converted into sound by the audio output device (earphone, headphone, speaker, etc.) 42.
[0039]
As described above, audio information such as voice and music can be recorded on paper, and the reproduction device is a small portable device, so that it can be printed out, transmitted by facsimile, or printed. Prepress makes it possible to hear what is printed in book form anywhere and any number of times.
[0040]
It should be noted that the memory section 56C for adjusting the data string in the data string adjusting section 56 is not limited to a semiconductor memory, but may use other storage media such as a floppy disk, an optical disk, and a magneto-optical disk.
[0041]
There are various applications of the audio information recorded as described above. For example, for general use, language teaching materials, music scores, various texts such as distance learning, product specifications, manuals for repairs, dictionaries in foreign languages, encyclopedias, books such as picture books, product catalogs, travel guides, direct mail and guidance Letters, newspapers, magazines, flyers, albums, congratulations, postcards, etc. are possible. For business use, FAX (voice and fax) business instructions, minutes, electronic blackboard, OHP, identification card (voiceprint), business cards, telephone memos, sticky papers, high quality paper rolled supply products (Consumables), and the like. Here, as shown in FIG. 5 (B), the consumables are provided with an easily peelable paste such as a double-sided tape or a sticky note on the back surface of the rolled paper 30A. The dot code 36 is recorded on the recording medium, and it is cut off as much as necessary and can be attached to various objects (hereinafter, this is referred to as a reel seal). Further, as shown in FIG. 3C, the width of the paper 30A is widened so that a plurality of levels of dot codes 36 can be recorded, and a manual scanning mark 36B as a guideline for manual scanning of the detection unit 44 is provided. May be printed vertically and horizontally. The mark 36B can also be used at the same time as a guide for the recording position of the dot code 36. That is, if a sensor is provided in the printer system 28, and the mark 36B is read by the sensor and a cue for printing is performed, the dot code 36 is always printed in the area surrounded by the mark 36B. Therefore, the recorded audio information can be surely reproduced by performing the manual scanning along the mark 36B. Of course, when printing the dot code 36, the mark 36B may also be printed.
[0042]
The recording time of the audio information is 200 fps in the case of a general facsimile, for example, when data is recorded in an area of 1 inch × 7 inch (2.54 cm × 17.78 cm) along one side of the paper, The total number is 280 kbit. From now on, the marker, the address signal, the error correction code, and the error determination code (however, the error determination code in this case also includes the audio data 38C in addition to the x and y addresses 38D and 38E) (30%) Is subtracted, it becomes 196 kbit. Therefore, the recording time when audio is compressed to 7 kbit / s (bit rate of mobile communication) is 28 seconds. When recording on the entire back surface of A4-size double-sided facsimile paper, an area of 7 inches × 10 inches (17.78 cm × 25.4 cm) can be taken, so that 4.7 minutes of voice recording is possible.
[0043]
Also, in the case of a G4 facsimile of 400 dpi, as a result of calculation in the same manner as described above, it is possible to record 18.8 minutes of audio in an area of 7 inches × 10 inches.
[0044]
In the case of high-quality printing at 1500 dpi, when printing is performed in an area of 5 mm × 30 mm, as a result of calculation in the same manner as above, voice recording for 52.3 seconds is possible. Also, when printing is performed on a tape-shaped area of 10 mm × 75 mm, a minute of sound recording is possible when calculated with a sound signal of high sound quality (compressed 30 kbit / s) capable of music.
[0045]
FIG. 7 is a diagram showing the configuration of the second exemplary embodiment of the present invention. The second embodiment is an example in which a memory and an xy address type imaging unit such as a CMD which can be randomly accessed are used as an imaging device, and a detection unit 44 of a reproducing apparatus and a scan conversion and lens distortion correction circuit 46 are used. Only the third embodiment differs from the first embodiment. That is, the detection unit and the scan conversion unit 70 detect the marker of the image data stored in the xy address type imaging unit 70A in the same manner as in the first embodiment, and interpolate four data when reading the data. Are sequentially read out by the decoder address generator 70B and the x, y decoders 70C, 70D and input to the interpolator 72. The interpolation unit 72 sequentially reads out coefficients from the coefficient generation circuit 70E and multiplies the input data by the multiplier 70F. The sample and hold is performed by the sample and hold circuit 70J, and the scan-converted dot code is supplied to the binarization circuit 48, the threshold value determination circuit 50, and the PLL circuit 52.
[0046]
With such a configuration, the same function as that of the first embodiment can be performed, and the frame memory 46 can be omitted, so that cost reduction and size reduction can be realized. Further, the xy address type imaging section 70A, the address generation section 70B, the decoders 70C and 70D, and the interpolation section 72 are formed on a single substrate to form an IC, so that the size can be further reduced.
[0047]
FIG. 8 is a diagram showing a configuration of the third exemplary embodiment of the present invention. In the present embodiment, the dot code 36 is recorded on the paper 30 on which pictures and characters are printed by using a transparent paint (ink) 74 that is easily specularly reflected (total reflection). Then, in the detection unit 44, polarizing filters 44F and 44G are provided between the light source 44A and the imaging system 44B, and the polarization planes of the polarizing filters 44F and 44G are matched, so that the inside (from the surface of the paper 30) can be seen. And the reflected light from the place where the hole 74A through which the transparent paint 74 is cut out according to the code, the polarization directions are disjointed, and a half of the reflected light is cut by the polarizing filter 44G. Since the difference in the amount of light between the reflected light and the totally reflected light is originally large, the contrast of the dot code recorded with the transparent paint 74 is enhanced and the image is taken.
[0048]
Further, the paper 30 is subjected to a surface treatment such as a mirror finish so that the surface is easily specularly reflected, and the transparent paint 74 is made of a material having a refractive index higher than the refractive index of the surface-treated surface, and about 1 / 4λ ( By taking into account the change in the optical path length due to the incident angle, the thickness of the film can be reduced to 1/4 of the optical path length in the transparent paint). It is amplified and easily reflected on the surface (specular reflection).
[0049]
In this case, for example, the formation of the dot code is performed by fine chemical etching or the like, and the portion of the hole corresponding to the dot is roughened to reduce the reflectance.
[0050]
When the dot code 36 is recorded with the transparent paint 74 in this manner, it can be recorded on a character or a picture. Therefore, when used in combination with a character or a picture, the recording capacity is increased as compared with the first embodiment. can do.
[0051]
Further, instead of the transparent paint, a transparent fluorescent paint may be used, or a color may be multiplexed. In the case of this color, a normal color ink can be used, or a color can be obtained by mixing a dye with a transparent ink.
[0052]
Here, as an example, the transparent ink may be an ink composed of a volatile liquid and a binder (for example, phenol resin varnish, linseed oil varnish, and alkyd resin), and the pigment may be a pigment.
[0053]
Next, a portable voice recorder to which the audio information recording device is applied will be described. FIGS. 9A and 9B are external views. This portable voice recorder comprises a main body 76 and an audio input section 80 which can be attached to and detached from the main body 76 by attaching / detaching members (surface fastener, magic tape, etc.) 78A and 78B on the main body side and the audio input section side. A recording start button 82 and a print sheet discharge unit 84 are provided on the surface of the main body 76. Note that the main body 76 and the audio input unit 80 are connected by a cable 86. Of course, a signal may be transmitted from the voice input unit 80 to the main unit 76 by wireless or infrared rays.
[0054]
FIG. 10 is a block diagram of such a portable voice recorder. The sound input from the microphone 88 is amplified by a preamplifier 90, converted to digital by an A / D converter 92, and supplied to a compression processing unit (ADPCM) 94. The data subjected to the compression processing is added with an error correction code by an error correction code addition section 96, and the result is supplied to an interleave section 98, where each data is stored, and thereafter, an interleave processing is performed. The interleaved data is further added with the address of the block and an error determination code (CRC or the like) for the block by the address data adding unit 100, and the result is input to the modulation circuit 102. The modulation circuit 102 converts 8-bit data, such as 8-10 modulation, into another 10-bit data. After that, the marker adding section 104 generates and adds a marker using a data string that is not included in the 256 data strings associated with the modulation circuit 102.
[0055]
The data to which the marker has been added in this manner is sent to the simple printer system 106, printed on the reel seal 108 as shown in FIGS. 11A and 11B, and discharged from the print sheet discharge section 84. In this case, the simple printer system 106 prints the date and time measured by the timer 110 on the reel sticker 108.
[0056]
The above-described units are controlled by the control unit 112 in accordance with the operation of the recording start button 82. In addition, there is no particular limitation on which part of the above components from the microphone 88 is configured in the audio input unit 80. For example, the microphone 88, the preamplifier 90, the A / D It is assumed that a converter 92 is built-in.
[0057]
FIG. 12 is an operation flowchart of the portable voice recorder having such a configuration. That is, when the recording start button 82 provided on the main body 76 is pressed down (step S12), while the button is pressed down (step S14), processing from voice input to printing of the dot code 114 on the reel seal 108 is performed. This is performed (step S16). When the pressing of the recording start button 82 is stopped, it is determined whether or not the recording start button 82 is pressed again within a predetermined period of time (step S18). And the above processing is repeated. However, if the recording start button 82 has not been pressed within a certain time, the current date and time are referred to by the timer 110 (step S20), and the reel seal 108 is fed while feeding the blank portion 116 while referring to the current date and time. The printed date and time are printed (step S22).
[0058]
In such a portable voice recorder, when the main body 76 and the voice input unit 80 are connected as shown in FIG. 9A, the user holds the main body 76 by hand and brings the voice input unit 80 close to the lips. The voice is recorded on the reel sticker 108 as a dot code 114. Also, as shown in FIG. 9B, the main body 76 and the voice input unit 80 are separated, and the voice input unit 80 is attached to the receiver side of the telephone handset using the detachable member 78B, so that the telephone can be used. Instead of writing down the content, the other party's business can be directly recorded on the reel sticker 108 as the dot code 114. Moreover, in this case, as shown in FIGS. 11A and 11B, not only is the date and time printed on the reel seal 108, but also a blank portion 116 is formed. And write comments such as to whom.
[0059]
Note that the voice input unit 80 may have various modes other than the configuration in which the voice input unit 80 is attached to and detached from the main body by the detachable member as described above. For example, as shown in FIGS. 11C and 11D, an earphone type can be used. In the case of such an earphone type voice input unit 80, the voice input unit 80 is pulled out from the voice input unit storage unit 118 of the main body 76 and inserted into the user's ear as shown in FIG. While listening to the other party's voice heard from the handset side of the telephone handset, it can be recorded in the form of a dot code.
[0060]
In the above description, the dot code printing is performed only while the recording start button 82 is kept pressed. However, a separate recording end button is provided on the main body 76, and the recording end button is pressed once the recording start button 82 is pressed. Until the button is pressed, dot code printing may be performed.
[0061]
The recording apparatus may incorporate a reproducing function as shown in FIG. 3 to be used as a recording / reproducing apparatus. At that time, the earphone type voice input unit 80 may also have an earphone function.
[0062]
In the above embodiment, the information to be recorded is described by taking audio information such as voice and music as an example. However, not only audio information but also video information obtained from a camera, video, etc. An embodiment for handling so-called multimedia information including digital code data such as text data obtained from a personal computer (hereinafter referred to as a personal computer), a word processor (hereinafter referred to as a word processor), and the like will be described.
[0063]
FIG. 13 is a block diagram of a multimedia information recording apparatus for recording such multimedia information.
[0064]
As in the case of FIG. 1, audio information is input from a microphone or an audio output device 120, amplified by a preamplifier 122, converted to digital by an A / D converter 124, and compressed. It is supplied to the unit 126.
[0065]
In the compression processing unit 126, the input digital audio signal is selectively supplied to a voice compression circuit 130 such as an ADPCM circuit and a voice synthesis coding circuit 132 by a switch 128. The audio compression circuit 130 performs data compression by performing adaptive differential PCM on the input digital audio information. The voice synthesis coding circuit 132 recognizes one voice of the input digital audio information and then converts it into a code. This is because the ADPCM encodes it in the form of audio information and reduces the amount of data, that is, processes it as it is, but once changes it to another synthesized code, it is relatively possible. It reduces the amount of data. Regarding the switching of the switch 128, for example, the user manually switches according to the purpose, for example. Alternatively, for example, information of high sound quality such as information from an audio output device is passed through a voice compression circuit 130, and information such as a human voice or comment from a microphone is passed through a voice synthesis coding circuit 132. If determined in advance as described above, it is also possible to adopt a configuration in which the input audio information is recognized at the preceding stage of the switch and automatically switched.
[0066]
Various data coming from a personal computer, a word processor, a CAD, an electronic organizer, a communication, etc., already formed as digital code data, are first transmitted via an interface (hereinafter referred to as I / F) 134 to a data form discriminating circuit 136. Is input to The data form determination circuit 136 basically determines whether or not compression can be performed by the compression processing unit 126 at the subsequent stage. The data has already undergone some compression processing. The information for which the effect of the above is not obtained is passed directly to the subsequent stage of the compression processing unit 126, bypassing the compression processing unit 126. If the input data is uncompressed data, it is sent to the compression processing unit 126. send.
[0067]
The data determined to be uncompressed code data by the data form discriminating unit 136 is input to the compression processing unit 126, and the code data is optimally compressed by a compression circuit 138 such as a Huffman, arithmetic code, or Jibrempel. A compression process is performed. The compression circuit 138 also performs a compression process on the output of the speech synthesis coding circuit 132.
[0068]
Note that the speech synthesis coding circuit 132 may recognize and convert character information other than speech into speech synthesis code.
[0069]
The image information of the camera or the video output device 140 is supplied to the compression processing unit 126 after being amplified by the preamplifier 142 and A / D converted by the A / D converter 144.
[0070]
In the compression processing unit 126, the image area determination and separation circuit 146 determines whether the input image information is a binary image such as a handwritten character or a graph or a multivalued image such as a natural image. This image area determination and separation circuit 146 uses, for example, a method of discriminating image area separation using a neural network as disclosed in Japanese Patent Application No. 5-163635 filed by the present applicant, to generate binary image data. Separate multi-valued image data. The binary image data is compressed as binary compression by a general binary compression processing circuit 148 such as MR / MH / MMR using JBIG or the like. For multi-value image data, a static image such as DPCM or JPEG is used. Is compressed by the multi-level compression processing circuit 150 using the compression function.
[0071]
The data that has been subjected to the compression processing as described above are combined by the data combining processing unit 152 as appropriate.
[0072]
Note that it is not always necessary to provide all the information input and compression processing systems in parallel, and one or a plurality of systems may be appropriately combined according to the purpose. Therefore, the data synthesizing unit 152 is not always necessary, and if there is only one type of data system, the data synthesizing unit 152 is omitted, and the data is directly input to the error correction code adding unit 154 in the next stage. Can be.
[0073]
The error correction code adding section 154 adds an error correction code and inputs the code to the data memory section 156. In the data memory unit 156, each data is stored, and thereafter, an interleave process is performed. This means that when data is actually recorded as a dot code and it is reproduced, it is possible to reduce errors a little, for example, to reduce the number of block errors due to noise etc. This is a process of distributing the columns at appropriately distant positions. That is, an operation of reducing the risk of a burst error in units of bit errors is performed.
[0074]
To the interleaved data, an address data adding unit 158 adds a block address and an error determination code (CRC or the like) for the address, and the result is input to the modulation circuit 160. The modulation circuit 160 performs, for example, 8-10 modulation.
[0075]
In the above-described embodiment, a code for error correction may be added after interleaving.
[0076]
Thereafter, the marker adding unit 162 generates and adds a marker using a data string that is not included in the 256 data strings associated with the modulation circuit 160. By adding the marker after the modulation in this way, there is an effect of solving the problem that even the marker is modulated, which makes it difficult to recognize the marker.
[0077]
The data with the marker added thereto is sent to the synthesizing and editing processing unit 164, and is recorded on a recording paper other than the generated data. For example, the data is synthesized with an image, a title, a character, or the like. The data is edited, converted to a printer output format or a data format compatible with printing prepress, and sent to the next printer system or printing prepress system 166. Then, the image is finally printed on a sheet, a tape, a printed material, and the like by the printer system and the printing plate making system 166.
[0078]
Note that the editing process in the synthesis and editing processing unit 164 may be performed by appropriately setting the code length in word units, content breaks, and the like, by adjusting the layout of the page information and the dot code, the dot size of the code to the resolution of a printing machine, a printer, or the like. This includes editing operations such as performing a step change of a break, that is, a step change in which one row is moved to the next line.
[0079]
The printed matter printed in this way is transmitted by, for example, FAX 168. Of course, instead of printing the data generated by the combining and editing processing unit 164, the data may be directly transmitted by fax.
[0080]
Here, the concept of the dot code 170 in the present embodiment will be described with reference to FIG. In the data format of the dot code 170 according to the present embodiment, one block 172 includes a marker 174, a block address 176, address error detection / error correction data 178, and a data area 180 in which actual data is entered. I have. That is, in the embodiment described with reference to FIG. 2A, one block is one-dimensionally configured in the line direction, but in the present embodiment, two blocks are two-dimensionally developed. It is formed in a shaped form. The blocks 172 are vertically, horizontally, and two-dimensionally arranged, and are collected to form a dot code 170.
[0081]
Next, the configuration of a multimedia information reproducing apparatus will be described with reference to the block diagram of FIG. The information reproducing apparatus detects a dot code from a sheet 182 as a recording medium on which the dot code 170 is printed, and performs a scan for recognizing the image data supplied from the detector 184 as a dot code and normalizing the image data. A conversion section 186, a binarization processing section 188 for converting multi-valued data into binary, a demodulation section 190, an adjustment section 192 for adjusting a data string, a data error correction section 194 for correcting a read error and a data error during reproduction, and a data The data separation unit 196 separates the data according to each attribute, a decompression processing unit for data compression processing according to each attribute, a display unit or a reproduction unit, or another input device.
[0082]
In the detection unit 184, the dot code 170 on the sheet 182 is illuminated by the light source 198, and the reflected light is transmitted through the imaging optical system 200 such as a lens and the spatial filter 202 for removing moire and the like. The light information is detected as an image signal by an imaging unit 204 such as a CCD or CMD that converts the light information into an electric signal, and is amplified by a preamplifier 206 and output. The light source 198, the imaging optical system 200, the spatial filter 202, the imaging unit 204, and the preamplifier 206 are configured in an external light shielding unit 208 for preventing disturbance to external light. Then, the image signal amplified by the preamplifier 206 is converted into digital information by the A / D converter 210 and supplied to the scan converter 186 at the next stage.
[0083]
The imaging unit 204 is controlled by the imaging unit control unit 212. For example, when an interline transfer type CCD is used as the imaging unit 204, the imaging unit control unit 212 uses the V blank signal for vertical synchronization and the information charge for resetting information charges as control signals of the imaging unit 204. Image sensor reset pulse signal, charge transfer gate pulse signal for sending charges accumulated in two-dimensionally arranged charge transfer accumulation units to a plurality of vertical shift registers, horizontal shift for transferring charges in the horizontal direction and outputting them outside A horizontal charge transfer CLK signal which is a transfer clock signal of the register, a vertical charge transfer pulse signal for transferring the plurality of vertical shift register charges in the vertical direction and sending the charges to the horizontal shift register are output. The timing of these signals is shown in FIG.
[0084]
Then, the imaging unit control unit 212 supplies the light source with a light emitting cell control pulse for setting the light emission timing of the light source 198 in accordance with this timing.
[0085]
Basically, the timing chart of FIG. 16 is a conceptual diagram for one field. The image data is read between the V blank of this one field and the V blank. The light source 198 performs pulse lighting instead of continuous lighting, and performs subsequent pulse lighting while synchronizing in units of fields. In this case, the timing is controlled such that exposure is performed during the V blanking period, that is, while no image charges are being output, so that clock noise during pulse lighting does not enter the signal output. That is, since the light emitting cell control pulse is a very thin digital clock pulse generated instantaneously and gives a large power to the light source, it is necessary to prevent noise caused by the light from entering the analog image signal. It is necessary, and as a measure for this, the light source is pulsed during the V blanking period. By doing so, the S / N is improved. In addition, turning on the pulse means shortening the light emission time, and thus has a great effect of eliminating the influence of blurring due to the shake and movement of the manual operation. Thus, high-speed scanning can be performed.
[0086]
Further, even when the reproducing apparatus is tilted and disturbance such as external light enters for some reason in spite of the presence of the external light shielding section 208, the V-block is set to minimize the S / N deterioration. Immediately before the light source 198 emits light during the ranking period, an image sensor reset pulse is output once to reset the image signal, light emission is performed immediately after that, and reading is performed immediately thereafter.
[0087]
Here, returning to FIG. 15, the scan conversion unit 186 will be described. The scan conversion unit 186 is a unit that recognizes image data supplied from the detection unit 184 as a dot code and performs normalization. As a method for this, first, the image data from the detection unit 184 is stored in the image memory 214, read out therefrom once, and sent to the marker detection unit 216. The marker detector 216 detects a marker for each block. Then, the data array direction detection unit 218 detects the rotation or tilt and the data array direction using the marker. The address control unit 220 reads out the image data from the image memory 214 based on the result so as to correct the image data and supplies it to the interpolation circuit 222. At this time, lens aberration information is read from the memory 224 for correcting distortion of the lens in the imaging optical system 200 of the detection unit 184, and the lens is also corrected. Then, the interpolation circuit 222 performs an interpolation process on the image data to convert the image data into an original dot code pattern.
[0088]
The output of the interpolation circuit 222 is provided to a binarization processing unit 188. Basically, as can be seen from FIG. 14, the dot code 170 is a pattern of white and black, that is, binary information, and is therefore binarized by the binarization processing unit 188. At this time, binarization is adaptively performed by the threshold determination circuit 226 while determining the threshold in consideration of the influence of disturbance, the influence of signal amplitude, and the like.
[0089]
Then, since the modulation described with reference to FIG. 13 is performed at the time of recording, the demodulation unit 190 first demodulates the data, and then inputs the data to the data string adjustment unit 192.
[0090]
In the data string adjusting unit 192, first, the block address of the above-described two-dimensional block is detected by the block address detecting unit 228, and thereafter, the block address error is detected and corrected by the block address error detecting and correcting unit 230. , The address control unit 232 stores the data in the data memory unit 234 in block units. By storing data in units of block addresses in this way, data can be stored without waste even when data is lost or entered halfway.
[0091]
After that, the data read from the data memory unit 234 is subjected to error correction by the data error correction unit 194. The output of the error correction unit 194 is branched into two, one of which is sent to a personal computer, a word processor, an electronic notebook, etc. as digital data via the I / F 236. The other is supplied to the data separation unit 196, where it is divided into images, handwritten characters and graphs, characters and line drawings, and sounds (two types, that is, a sound as it is and a voice synthesized).
[0092]
The image is equivalent to a natural image and is a multi-valued image. This is performed by the decompression processing section 238 to perform decompression processing corresponding to JPEG at the time of compression, and further, the data interpolation circuit 240 interpolates data that cannot be corrected.
[0093]
For binary image information such as handwritten characters and graphs, the decompression processing unit 242 performs decompression processing on MR / MH / MMR and the like performed by compression, and the data interpolation circuit 244 cannot correct errors. The interpolation of the data is performed.
[0094]
Characters and line drawings are converted to another display pattern via a PDL (page description language) processing unit 246. Note that, in this case, if the line drawing and the character are subjected to the code compression processing after being coded, the decompression processing unit 248 performs the corresponding decompression (Huffman, Jibrempel, etc.) processing, and then The data is supplied to the PDL processing unit 246.
[0095]
The outputs of the data interpolation circuits 240 and 244 and the PDL processing unit 246 are combined or selected by a combining or switching circuit 250, converted into analog signals by a D / A converter 252, and then converted to a CRT (television monitor) or FMD. (A face mounted display) or the like. Note that the FMD is a spectacle-type monitor (handy monitor) for wearing on the face, and is effective when, for example, virtual reality is used or when a large screen is viewed in a small place.
[0096]
For audio information, a decompression process is performed on the ADPCM by the decompression processing unit 256, and a data interpolation circuit 258 interpolates data that cannot be corrected. Alternatively, in the case of speech synthesis, the speech synthesis unit 260 receives the speech synthesis code and actually synthesizes the speech from the code and outputs the synthesized speech. In this case, when the code itself is compressed, as in the case of the characters and line drawings, the decompression processing unit 262 performs decompression processing such as Huffman or Jibrempel, and then performs speech synthesis.
[0097]
Further, as shown in FIG. 17, the text information may be recognized by the text recognition unit 271 and then output as voice information by the voice synthesis unit 260.
[0098]
The decompression processing unit 262 can also be used as the decompression processing unit 248. In this case, the data is appropriately switched by the switches SW1, SW2, and SW3 according to the attribute of the data to be decompressed, and the PDL processing unit 246 or the speech synthesis unit 260.
[0099]
The outputs of the data interpolation circuit 258 and the voice synthesis unit 260 are synthesized or selected by a synthesis or switching circuit 264, converted into an analog signal by a D / A conversion unit 266, and then output to a speaker, headphones, or other similar audio output device. 268.
[0100]
In addition, characters and line drawings are output directly from the data separation unit 196 to the page printer and plotter 270, and characters and the like are printed on paper as word processing characters, or line drawings and the like are output as plotters and the like. You can also.
[0101]
Of course, the image can be printed not only by the CRT or FMD but also by a video printer or the like, and the image can be photographed.
[0102]
Next, the data string adjusting unit 192 will be described. Here, in order to apply to the above-described audio information reproducing apparatus (see FIG. 3), as shown in FIG. 18A, the dot code is a block address 272A indicated by reference numeral 272 and its error correction data 272B. Are arranged two-dimensionally, linear markers 274 as shown in FIG. 3B are arranged in the vertical direction, and reference numerals 276 are assigned to each line of each block. Description will be made assuming that the indicated line address 276A and error detection data 276B are arranged.
[0103]
In this embodiment, as shown in FIG. 18C, the pitch is doubled for each line as compared to the scanning method described with reference to FIG. 6, and after the center of the marker is detected. , The center line between the markers is equally divided by twice the number of dots. That is, as shown in (D) of the figure, first, in the first scan, a vertical and horizontal half, that is, a quarter of the dot 278 is captured. In this case, the pitch is taken at the same interval as the dots 278, and therefore data is taken every other dot. In this manner, data up to the CRC error detection data 276B, for example, if one block has 64 dots, 64 dots are taken in every other dot.
[0104]
Then, first, it is confirmed whether or not the line address can be actually read by using the latter line address 276A and the CRC error detection data 276B for the line address. If this line address is readable, it is determined that the preceding data dot itself is also correctly readable. If it is determined to be wrong, the second scan is performed by shifting one dot to the right, for example, to the right (the black circle in (D) of the figure). This is taken in for all 64 dots, and it is similarly confirmed whether the line address has been actually read. If incorrect, the third scan is performed by shifting one dot down from the first dot, and if still incorrect, the fourth scan is performed by shifting one dot to the right.
[0105]
In this manner, if the scanning of one line is repeated four times, it is considered that at least one of these can be correctly read. If it is determined that the data has been read correctly, the data is written to the data memory unit 234.
[0106]
In this case, if the line address of the fetched line is, for example, "0" (start address), that is, the line address is recognized as the first, the preceding data is determined to be the block address 272A and the error correction data 272B. Note that the error correction data 272B can be used for error detection of a block address such as CRC, or error correction of Reed-Solomon of a block address in addition to error correction depending on the purpose. Then, when the first address line 0 is recognized, the block address 272A is read first, and it is determined from this address data which block the block is in. On the other hand, since the actual data is entered from the next line, the data is read, and the data is written to the block of the data memory unit 234 corresponding to the block.
[0107]
In the above description, if there is no error while scanning one line, the scanning is skipped to the scanning of the next line. However, the scanning may be repeated four times for each line. good. At that time, it is determined that there is no error a plurality of times, but there is no problem since the same data is simply written at the same address in the data memory unit 234. To simplify the processing, the scanning is repeated four times. When priority is given to speed, the former scanning method is adopted.
[0108]
The actual configuration of the block address detection section 228 and the block address error detection and correction section 230 for realizing the operation of the data string adjustment section 192 will be described with reference to FIG.
[0109]
When 10 bits of the binary interpolation data are input into the shift register 190A, the demodulation unit 190 converts the binary data into 8 bits using a look-up table (LUT) 190B.
[0110]
In the data string adjusting section 192, the demodulated data is temporarily stored in a buffer memory (all 64 dots are contained) 282 under the control of the write address control section 280. Then, only the line address information and the CRC information for the address are read out by the data read address control unit 284, and the line address error detection circuit 286 detects an error. When the determination signal indicating the result of the error detection is true, that is, when there is no error, the data read address control unit 284 reads the information before the line address information from the buffer memory 282, that is, the actual data information.
[0111]
On the other hand, the start address detection circuit 288 checks whether or not the line address for which the error has been detected by the line address error detection circuit 286 is the start address. When the start address is detected, the start address detection circuit 288 informs the block address detection circuit 290 that the line is a line having a block address as information. A block address is detected from the data read from 282, and an error detection circuit 292 performs error detection and correction. Then, the result is latched by the address control unit 232 of the data memory unit 234 as a block address.
[0112]
Note that only error detection is added to the line address in order to obtain an accurate read position, but an error correction code is added to the block address because it is used as address information.
[0113]
Since the subsequent lines are successive data lines, they are written into the data memory unit 234 as data. At that time, depending on the processing, a line address is output together if necessary. Alternatively, if there is an internal counter, the line address can be automatically counted up internally.
[0114]
When the next start address "0" is detected, the block is recognized as the next block, and the same operation is repeated for all the blocks.
[0115]
On the other hand, the determination signal output from the line address error detection circuit 286 is also supplied to the address control unit 220 of the image memory 214. This is a signal necessary for skipping to the next line when the data becomes true in order to shorten the time in the four scans per line.
[0116]
In the above example, the line address error detection circuit 286 performs the address detection on the interpolation data using the same address information for four times until it becomes true. Then, when the data becomes true, the address is skipped once to the data line of the next dot of the new next line, interpolation data is created, and then four points in the interpolation data are read out. Therefore, for such control, a determination signal is passed to the address control unit 220 of the image memory 214, whereby the same address is generated four times to interpolate, read in a different order of interpolation, or A process is performed in which the address is rewritten on the next line, the data on that line is output, and the data is output four times while interpolating.
[0117]
Although not specifically shown, the address control unit 232 of the data memory unit 234 performs mapping to the data memory unit 234, and when reading further, the address control unit 232 also controls de-interleaving. Again, for example, when an address for each dot is generated using a look-up table or the like, the block, line, and data obtained by combining the dot addresses are actually output from the look-up table using a ROM or the like. The conversion is performed so as to form a memory data string. This is the work of de-interleaving (de-shuffling), and the data is read out in the form of the original data sequence only after the processing is performed. Of course, this de-interleaving may be performed at the time of reading from the data memory unit 234, or at the time of writing, such conversion may be performed once and data may be written in a random order (mapping). Is also good.
[0118]
Further, in this example, the marker 274 has a line shape, but may be a circle as shown in FIG. 14 or a square marker. Once a marker is detected, the rest of the block is read on a line, so that the marker need not necessarily be line-shaped. For example, as shown in FIGS. 20A to 20C, markers 294, 296, and 298 of a circle, a square, and a rectangle can be considered.
[0119]
If the printed code is substantially accurate without any partial bleeding or misalignment, it can be said that (approximate center = accurate center). The processing can be performed only by the center detection processing. However, in this case, dots 294A, 296A, and 298A for detecting the arrangement direction are provided in the marker portion in order to detect the arrangement direction.
[0120]
FIG. 20D shows another aspect of the multimedia information reproducing apparatus. This means that the A / D conversion section 210 of the detection section 184 is moved to the scan conversion section 186, and the functions of the block address detection section 228 and the block address error detection / correction section 230 of the data string adjustment section 192 are changed to the scan conversion section 186. Since the configuration after the data error correction section 194 is the same as that of FIG. 15, it is omitted in the figure.
[0121]
That is, in FIG. 20 (D), the biggest difference from the configuration shown in FIG. 15 is the scan conversion unit 186 and the data string adjustment unit 192. In this embodiment, the function of the data string adjustment unit 192 is performed simultaneously from the marker detection unit 216 to the address control unit 220 in the scan conversion unit 186. That is, the marker is detected by the marker detecting unit 216, and the data array direction, that is, the inclination, rotation, and direction are detected by the data array direction detecting unit 218. Then, the block address detection, error determination, and accurate center detection unit 300 detects the block address, performs the error determination, and detects the correct center, that is, the true center depending on whether the block is erroneous or not. In this case, since the block address is detected when the true center is detected, the marker and block address are interpolated by the next marker and block address interpolation unit 302, and the information of the block address is transferred to the data. It is also provided to the address control unit 232 of the memory unit 234.
[0122]
As in the configuration of FIG. 15, the address control unit 220 performs address control based on the data of the block address interpolation processing, and controls the address, writing, and output to the image memory 214.
[0123]
Other than that, the function is not different from the embodiment of FIG.
[0124]
In FIG. 15 and FIG. 20 (D), the detection unit 184 converts the data into, for example, 8-bit multi-valued digital data by the A / D conversion unit 210, and thereafter performs the processing. Instead of the D conversion unit 210, a binarization processing unit (comparator) 188 and a threshold value determination circuit 226 may be arranged at the A / D conversion unit 210, and all subsequent processing may be performed using binary data.
[0125]
In this case, the interpolation circuit 222 performs a so-called interpolation process of four-point or sixteen-point interpolation using pixel data around the interpolation address coordinates obtained from the address control unit 220 as shown in FIG. Instead, the pixel data closest (near) to the interpolation address coordinates can be adopted as data.
[0126]
By performing binarization and processing instead of A / D conversion, the number of signal lines and the data amount are reduced to 1/8 of the case of 8 bits, for example. Therefore, the memory capacity of each of the image memory 214 and the data memory unit 234 is also reduced to 1/8, and the processing of each unit is simplified. For example, the circuit scale is significantly reduced, the processing amount is significantly reduced, and the processing time is significantly reduced. This contributes to downsizing, low cost, and speedup of the apparatus.
[0127]
In the case of (D) in FIGS. 15 and 20, when the image data is output to the interpolation circuit 222, the address output of the address control unit 220 becomes, for example, four pixel addresses around the interpolation address coordinates. The signal 222 is distance information for calculating a weighting coefficient for each pixel address by a signal line (not shown). Alternatively, each pixel address and the interpolation address coordinate data may be sent, and the interpolation circuit 222 may calculate the distance from each pixel address to calculate the weighting coefficient.
[0128]
Further, at the time of processing with binary data as described above, the address control unit 220 outputs a pixel address near the interpolation address coordinates. Therefore, in this case, the data output from the image memory 214 is directly input to the demodulation unit 190.
[0129]
Here, specific examples of the dot code shown in the conceptual diagram of FIG. 14 will be described with reference to FIGS.
[0130]
The blocks 304 are two-dimensionally arranged as shown in the conceptual diagram of FIG. 14, and have a block address 306 added thereto. The block address 306 has addresses corresponding to the X address and the Y address. For example, the upper left block in FIG. 21A is (X address, Y address) = (1, 1). On the other hand, the block address of the block on the right side is (2, 1). In the same manner, the block address incremented toward the right and the one incremented from the Y address toward the right are added. Thus, the block address 306 is added to all the blocks 304.
[0131]
Here, the lowermost marker and the rightmost marker are dummy markers 308. That is, the block 304 corresponding to a certain marker 310 is the data obliquely lower right of the four markers 310 including the marker, and the lowermost and rightmost markers are the second lowermost and the second lowermost rightmost markers. An auxiliary marker that is arranged to define a block for the marker, that is, a dummy marker 308.
[0132]
Next, the contents of the block 304 will be described. As shown in FIG. 21B, a block address 306 and an error detection code 312 of the block address are added between the marker 310 of the block 304 and a marker below. Similarly, a block address 306 and its error detection code 312 are added between the marker 310 and the right marker. In the conceptual diagram of FIG. 14, the marker is located at the upper left of the block, and the block address is located at the lower right. However, in the present embodiment, the block address 306 is located at the left and upper sides, and the marker 310 is located at the upper left. The shape is arranged at the corner. Although the block address 306 is shown as an example where it is recorded at two places in one block, it may be at one place. However, by recording at two locations, even if an error occurs due to noise on one block address, it can be reliably detected by detecting the other address. Is more preferred.
[0133]
The position of the data of the block with respect to a certain marker, the position of the block address, the position of the dummy marker on the code determined by the position, and the like are not limited to the above example.
[0134]
Next, a pattern example of the marker 310 will be described. As shown in FIG. 20C, in the present embodiment, a circular black pattern 310A having a diameter of 7 dots is used as the marker 310. Then, a portion 310B around the black circle 310A is set to white, so that a black portion of the marker can be easily distinguished. Reference numeral 310C in FIG. 21C is an auxiliary line for explanation.
[0135]
The range of the white portion 310B is desired to be as small as possible to increase the recording density, but is required to be large in order to perform marker detection processing easily and at high speed. Therefore, the range 310C for sufficiently identifying the black pattern 310A when the rotation is 45 ° is set to be within the portion 310B.
[0136]
As for the image magnification of the imaging optical system 200 in FIGS. 15 and 20D, as shown in FIG. 21D, the size of the data dot 316 in the data area 314 will be described below. Under the conditions, it is assumed that an image is formed on 1.5 pixels. The pixel here means one pixel of the imaging element of the imaging unit 204. That is, one dot recorded on the sheet 182, for example, a dot of 30 to 40 μm, is imaged through an imaging lens on 1.5 pixels of an image pickup element which is usually 7 μm or 10 μm in size. Shall be. In the sampling theorem, the pixel pitch may be smaller than the dot pitch, but here, 1.5 pixels are set here after considering safety. In the case of binarization instead of the above-mentioned A / D conversion, two pixels are used for further safety.
[0137]
Adopting the two-dimensional block division method as described above has the following advantages. That is, if the dot pitch of each dot is equal to or less than the resolution of the image sensor, a code (a set of unit data blocks) can be read even if the data dot size is different; the image pickup unit 204 is inclined with respect to the code. It is possible to read even if there is local expansion and contraction of the sheet, and it is possible to read even if it rotates. The unit block can be freely expanded two-dimensionally according to the total data amount. As a result, the code size can be freely changed; since each block address is added, it is possible to reproduce even if reading is started from the middle of the code. The shape of the code can be freely laid out according to other information, for example, characters, pictures, graphs, and the like. A rectangular dot code is shown in FIG. , Or the key type, or it is also possible that causes a little more deformation; predetermined start code as in the barcode, the stop code is not required, also the clock code is not necessary.
[0138]
Also, by utilizing these characteristics, reproduction can be performed even if there is camera shake. Accordingly, it is very easy to handle a handy playback device.
[0139]
That is, although the details will be described later, normalization is performed by detecting four adjacent markers on the reproduction device side and equally dividing the number of dots by the number of dots, so that the reproduction device is resistant to enlargement, reduction, deformation, and the like. In addition, there is an advantage that it is strong against camera shake and the like.
[0140]
As for the dots 316 in the data area 314, for example, one dot has a size of several tens of μm. Although this can be up to several μm depending on the application, it is generally 40 μm, 20 μm, or 80 μm. The data area 314 has a size of, for example, 64 × 64 dots. These can be freely expanded or reduced to a range in which the error due to the above-mentioned equal division can be absorbed. Further, the marker 310 has not only a function as a synchronization signal but also a function as a position index. The marker 310 has a size that is not included in the modulated data. In the present embodiment, the marker 310 has a round shape and a circle having a diameter of, for example, 7 dots or more or 7 × 7 dots with respect to the dots in the data area 314. The black marker 310A is used.
[0141]
Here, the inclination, rotation, and the like during reproduction will be described.
[0142]
The inclination of the image pickup unit 204 means that the playback apparatus should be vertically opposed to the sheet 182 on which the dot code is printed, but the user has the playback apparatus obliquely. Refers to a state that has become oblique to. Further, the rotation refers to a state in which the imaging area (see FIG. 4A) is not parallel to the dot code written on the sheet 182.
[0143]
When the above-described tilt occurs, the image obtained by the imaging unit 204 is reduced as compared with the image when the images are vertically opposed. For example, if a 30-degree tilt occurs, the apparent projected image will be reduced to 86.5%. In other words, for example, if the block 304 is a square and is inclined 30 degrees in the horizontal direction with respect to the vertical direction, the horizontal portion is 0.865 times even if the vertical direction is 1: 1. It becomes a rectangle. If there is such a slope, if there is an original internal synchronization clock, each unit operates with the equally-spaced clock, so that the resulting data may not match the original data. .
[0144]
In addition, if the image of rotation is taken as horizontal or vertical, the real data goes up diagonally or goes down diagonally, so that real information cannot be obtained. . Furthermore, when a combined state of tilt and rotation occurs, the imaging result of the square block becomes a rhombus, and the condition that the horizontal and vertical data arrays are orthogonal is not satisfied.
[0145]
Hereinafter, the marker detection unit 216 for solving these problems will be described. As shown in FIG. 22, the marker detecting section 216 detects a marker by extracting the marker from the code, a marker area detecting section 320 for detecting the area where the marker is present, and detecting the approximate center thereof. Approximate center detection unit 322 shown in FIG.
[0146]
The marker determining unit 318 searches for seven or more and thirteen or less continuous black pixels, and recognizes a case where the continuous black pixels continue for seven consecutive lines as a circular black marker 310A. As shown in FIG. Is binarized, and black and white are identified for each pixel (step S32). Then, black pixels continuous in the X-axis direction are detected on the image memory 214 (step S34). That is, continuous black pixels having 7 or more and 13 or less continuous black are detected. Next, it is checked whether or not a point shifted by one pixel in the Y-axis direction from the center pixel of the first and last black pixels is black (step S36). Then, if this continues seven times in the Y-axis direction (step S38), it is determined as the circular black marker 310A (step S40). If it is not detected in step S34 or if it is not a black pixel in step S36, it is not determined to be a marker (step S42).
[0147]
That is, it is assumed that the marker is checked on the image memory, and there is a line in which, for example, seven black pixels continue. Then, it is checked whether the point shifted by one pixel in the Y-axis direction from the center of the first black pixel and the last black pixel is black, and if black, the left and right Check if 13 pixels are black from 13 consecutive pixels, and look in the same manner while shifting one pixel at a time in the Y-axis direction. If it lasts seven times in the Y-axis direction, Is determined as the circular black marker 310A.
[0148]
Note that the minimum value of 7 when checking continuous black in the X-axis and Y-axis directions is to distinguish and discriminate the black portion (circular black marker 310A) of the marker 310 from the modulated data. This is a lower limit value set so that the data area 314 and the circular black marker 310A can be distinguished from each other even if there is a reduction due to paper shrinkage or inclination. The maximum value 13 is an upper limit value set in consideration of elongation of paper, bleeding of ink, and the like. This prevents noise such as dust and scratches larger than the marker from being erroneously detected as the marker.
[0149]
In addition, since the marker pattern 30A is circular, there is no need to consider rotation, so the difference between the lower limit and the upper limit can be minimized, and erroneous marker detection can be reduced.
[0150]
The marker area detecting section 320 slightly expands and contracts or deforms the range of the circular black marker 310A determined by the marker determining section 318 due to a change in inclination, a change in image magnification of an image, and the like. It is for detecting whether or not it is in
[0151]
As shown in FIG. 24, the marker area detection unit 320 first detects a temporary center pixel of the circular black marker 310A determined by the marker determination unit 318 (step S52). That is, one pixel near the center of the range determined by the marker determination unit 318 is set as a temporary central pixel.
[0152]
Then, it is checked from the temporary center pixel that the pixel is black in the upward direction (negative direction on the Y axis). If the pixel becomes white, the left and right pixels are checked. If the pixel is black, the upward direction is checked in the same manner as above. It checks up to the Y address where no black exists, and sets the Y address in the Ymin register (see FIG. 25A) (step S54). Similarly, it is checked that the pixel is black in the downward direction (plus direction on the Y axis) from the temporary center pixel. If white, the left and right pixels are checked. If black, the downward direction is checked in the same manner as above. It checks up to the Y address where black does not exist, and sets the Y address in the Ymax register (step S56).
[0153]
Next, it is checked from the temporary center pixel that the pixel is black in the left direction (negative direction on the X axis). If it is white, it is checked that several upper and lower pixels are black. The direction is checked in the same manner as described above, up to the X address where no black exists, and the X address is set in the Xmin register (step S58). Similarly, check that the pixel is black in the right direction (plus direction on the X axis) from the temporary center pixel. If white, check several upper and lower pixels. If black, check the right direction as above. It checks up to the X address where no black exists, and sets the X address in the Xmax register (step S60).
[0154]
A marker area 324 is selected from the values of the Xmin, Xmax, Ymin, and Ymax registers thus obtained as shown in the table of FIG. 25B (step S62). In other words, the marker area 324 is not the square area including the circular black marker 310A but the hatched area in FIG. The marker area 324 may be a square, but there is actually data around the white portion 310B of the marker 310, and the data is stored inside the white portion 310B due to the influence of the spatial filter or the like. It is conceivable that the user enters the marker area 324 for calculating the approximate center. In order to avoid this as much as possible, it is desirable to make the marker area 324 as small and necessary as possible. In this case, it is only necessary to set a circular area having the same shape as the circular black marker 310A, that is, a circle and larger than the circular black marker 310A. In the present embodiment, since the circular black marker 310A is a small circle composed of 7 dots in diameter, it becomes a marker area 324 as shown in FIG.
[0155]
The approximate center detection unit 322 is for finding the approximate center of the black circle of the marker in the marker area detected by the marker area detection unit 320 in this way. In general, in printing or the like, there is a phenomenon that a dot becomes wider than a target size due to swelling of ink (this is called dot gain) or becomes smaller (this is called dot reduction). Further, it is assumed that the ink spreads around the periphery or the ink permeates to one side. The approximate center detecting unit 322 obtains the center of the image of the circular black marker 310A, that is, the so-called center of gravity, and processes the approximate center thereof in order to cope with such dot gain, dot reduction, or ink stain. I do. Here, the processing is for obtaining the center with an accuracy smaller than one pixel pitch.
[0156]
First, for this marker area 324 on the image, the image memory 214 is divided into two directions, that is, the X axis direction and the Y axis direction, and the center line on the X axis and the center line on the Y axis are searched for. Find the final center, or approximate center. FIGS. 25C and 25D are diagrams showing accumulated values of each pixel and each pixel in the vertical and horizontal directions in FIG. 25A. The center of gravity is a half of the total cumulative value, that is, a portion where the upper, lower, left, and right cumulative values are equal.
[0157]
First, in the case of (C) in the figure, for example, if the addition result Sxl of each accumulation of the portion shown by hatching in the figure still satisfies 1/2 of the entire area S. However, if adding the next Sxc portion to it adds more than half the area, it can be determined that the column Sxc includes the center line X including the approximate center. In other words, the X address at the approximate center accumulates the accumulated value of each column (Xk) from the left side (Xmin direction), and exceeds 1/2 of the total accumulated value when the column of X '+ 1 is accumulated. At that time, there is a general center between the row of X 'and the row of X' + 1. When the column of X '+ 1 is divided into right and left so as to be added to the accumulated value up to X' and to be 1/2 of the total area S, the division line includes the approximate center.
[0158]
Therefore, the ratio of the portion excluding the portion accumulated from the area of 1/2 to the X-th column, that is, (1/2) S-Sxl, and the accumulated value Sxc of the middle column is Δx (approximate center = X ′ + Δx ).
[0159]
This will be described with reference to the flowchart of FIG.
[0160]
First, normalization is performed (step S72). That is, the white data portion is set to 0, the black data is set to 1 and the data in the image memory 214 is set to the multi-valued data so that adding the periphery to each data of the marker area 324 does not affect the accumulation. Is normalized as data having a gradation of. This is for the purpose of accurately recognizing the state because the periphery becomes blurred due to a spatial filter or the like and accurately and accurately detecting the center of gravity. Next, the accumulated value Sk of each column Xk (k = min, min + 1,..., Max) is obtained (step S74), and the barycenter calculation subroutine is called (step S76).
[0161]
In the center-of-gravity calculation subroutine, as shown in (B) of the figure, the entire area S is obtained, 1/2 is set to Sh, and Sl is set to 0 (step S92). It is set from the column (step S94), and is obtained by calculating Sl '= Sl + Si (step S96). Initially, Sl = 0, so here is Si itself, and Sl ′ = Smin. Next, Sl 'is compared with Sh, that is, the size of one half of the entire area (step S98). If Sl' does not exceed Sh, i is incremented (step S100), and Sl 'is set to Sl. Then (step S102), the next column is accumulated by repeating from step S96. Then, when the cumulative result exceeds half of the total area, Δx is obtained by subtracting Sl from S / 2 and dividing by Si (step S104). (Step S106), and returns to the upper routine.
[0162]
In the upper routine, the value of C is set as the X coordinate of the approximate center (step S78).
[0163]
Hereinafter, the same processing is performed in each row direction in steps S80 to S84, the Y coordinate is obtained, and X and Y are set as the approximate centers of the markers (step S86).
[0164]
The configuration for realizing such a process is as shown in FIG.
[0165]
The normalization circuit 326 normalizes white data as 0 and black data as 1. The output of the normalizing circuit 326 is accumulated so that the total area S is calculated by the accumulating unit 328, halved by the 掛 け multiplying unit 330, and latched by the latch circuit 332.
[0166]
On the other hand, the output of the normalization circuit 326 is delayed by the delay circuits 334 and 336 for the block in the X-axis direction, the respective columns are accumulated by the accumulator 338 in the order from the left, and the accumulator 340 outputs each column unit. Is accumulated. At the time of outputting the result, the central column Sxc is output.
[0167]
The comparator 342 compares the half area latched by the latch circuit 332 with the accumulated value of each column accumulated by the accumulation unit 338. The latch 344 stores the timing of the determination and the accumulation of the column up to that time. When the comparator 342 determines that the area has exceeded the area of ２, the X address calculation unit 346 calculates the accumulated area of １ ／ of the area latched by the latch circuit 332 and Sxl latched by the latch 344. The final X address of the approximate center of the marker is calculated from the accumulated value Sxc from the unit 340 and the address corresponding to X ′ supplied from the address control unit 220 via the delay circuit 348.
[0168]
Similarly, using the delay circuits 350 and 352, the accumulators 354 and 356, the comparator 358, the latch 360, and the Y address calculator 362, the Y address at the approximate center of the marker is calculated. Note that the delay circuits 350 and 352 in this case are constituted by line memories.
[0169]
Here, the delay circuits 334, 336, 350, and 352 adjust the respective output timings of S / 2, Sxl, Sxc, Syl, and Syc to timings required by the X address calculation unit 346 and the Y address calculation unit 362. Circuit.
[0170]
Next, the data array direction detection unit 218 will be described. For convenience of description, the detailed arrangement of each block 304 of the dot code will be described first. The dot code blocks 304 are arranged as shown in FIG. 21B, and more specifically, as shown in FIG. 28A. That is, the block address 306 is divided into an upper address code 306A and a lower address code 306B, and the error detection code 312 is also divided into an upper address CRC code 312A and a lower address CRC code 312B. The lower address code 306B is arranged beside the marker 310, and the upper address code 306A is arranged beside the marker 310 with a size larger than the lower address code 306B. Next, a CRC code 312A for the upper address having the same size as the upper address code 306A is added, and further a CRC code 312B for the lower address having the same size as the lower address code 306B is added.
[0171]
The block address and the error detection data are also arranged below the marker 310 in the above order toward the lower marker.
[0172]
Here, the upper address code 306A and the upper address CRC code 312A are collectively called a step 1 code, and the lower address code 306B and the lower address CRC code 312B are collectively called a step 2 code.
[0173]
Also, when the lower address code 306B is decomposed, on the right side of the marker 310, the data is inverted both above and below (left and right in the case of the lower side of the marker 310) the data of each dot for indicating the lower address data. The code to be used is described. Further, a data blank portion 364 is provided for distinguishing the data from the upper and lower data areas 314. Note that the data margin portion 364 may be omitted. The inversion code is added not only to the lower address but also to the upper address code. Here, dots are indicated by circles for easy understanding of the data, but actually white circles indicate that there are no dots to be printed. That is, it is not to print a white circle. Hereinafter, white circles shown in the drawings indicate the same.
[0174]
Here, assuming that the upper address and the lower address are, for example, if all addresses are composed of 12 bits, the first 4 bits are assigned to the upper address and the next 8 bits are assigned to the lower address. It is something. The data length can be appropriately changed according to the device. Basically, for all the block addresses, there is a distinction as to how many of the block addresses from the beginning are to be the upper addresses and from there to the lower addresses are to be the lower addresses.
[0175]
By providing the address codes in the horizontal and vertical directions as described above, there is an advantage that even if an address cannot be detected with a one-way address code, it can be detected with the other address code.
[0176]
Another dot code arrangement will be described with reference to FIG. This figure omits the vertical address code of FIG. 28 (A). Since the address code is only in one direction, the data area can be increased and the processing speed can be increased. If the address code is unidirectional and the address code cannot be detected, the address of the block is unknown, but can be captured by the address interpolation processing described later.
[0177]
In FIG. 29A, the block address code exists only between the markers in the horizontal direction, but a dot code having the block address code only in the vertical direction may be used.
[0178]
Alternatively, as shown in FIG. 28B, the upper address code 306A may be added between the lower address codes 306B, and the upper address CRC code 312A may be added between the lower address CRC codes 312B. .
[0179]
Hereinafter, the processing will be described based on the dot code of FIG. Only in the case of the process specific to the dot code in FIG.
[0180]
FIGS. 30 and 31 are a block diagram of the data array direction detection unit 218 shown in FIG. 20D and a flowchart showing the operation thereof.
[0181]
The data array direction detecting unit 218 receives data of the approximate center of the marker from the approximate center detecting unit 322 of the marker detecting unit 216, and the adjacent marker selecting unit 366 selects an adjacent marker. That is, the center address of each marker has been mapped on one screen by the processing of the approximate center detection unit 322, and a representative marker to be processed now, that is, a marker of interest is set for it (step S112). An adjacent marker is selected to detect which marker has the approximate center closest to the representative marker (step S114).
[0182]
In the adjacent marker selection process, as shown in FIG. 32A, the distance d between the representative marker and the adjacent marker is calculated, and the adjacent marker within the range of d ≦ dmax is specified (step S142). However, in this case, dmax is the length of the long side of the data block + α (α is determined by the expansion and contraction of the paper, etc.). Then, the approximate center address is sent to the step 1 sample address generation circuit 368 in the order of shorter distance d from the designated adjacent markers (step S144). For example, in FIG. 32B, the approximate center address at the distance D2 is closest to the representative marker, then the approximate center addresses of the distances D1 and D4, and the approximate center addresses of D3 and D5. First, the approximate center address at the closest distance D2 is sent. If the distances d are the same, a marker is searched clockwise from the distance calculation start address, and direction detection is performed in the order in which the markers appear (step S146). That is, the approximate center addresses located at the distances of D1, D4, D3, and D5 are sequentially sent to the step 1 sample address generation circuit 368, and the direction detection described later is performed.
[0183]
That is, the step 1 sample address generation circuit 368 generates a step 1 sample address centered on the approximate center of the representative marker and the selected adjacent marker (step S116), and generates a scanning line connecting the step 1 sample addresses (step S116). In step S118, a read address is generated so as to sample the data in the image memory 214 at the equally divided points on the scanning line (step S120). The address control unit 220 supplies the address of the sample point to the image memory 214 as a read address to read data.
[0184]
In the above description, the data of the sample point is approximated and output (from the image memory). However, as shown in FIG. 5A, it is determined that the sample point is between the data of the image memory. Sometimes, it may be obtained by interpolating from the data of the surrounding four pixels.
[0185]
As a result, after the read data, that is, the upper address code is detected by the error detection circuit 370 as an error, it is supplied to the upper block address calculation and center calculation circuit 372. The upper block address calculation and center calculation circuit 372 causes the next adjacent marker selection process to be performed if there is an error as a result of the error detection in the error detection circuit 370, and if a marker in two directions is detected, Since it is no longer necessary to detect the adjacent marker, the address calculation result is sent to the adjacent marker selection unit 366 to end the adjacent marker selection processing.
[0186]
When the dot code shown in FIG. 29A is used, the marker selection process is terminated when the upper address code in one direction is detected.
[0187]
If the result of the address calculation indicates that there is an address error (step S122), it is determined whether scanning of all sample points has been completed (step S124). If not, the process proceeds to step S118. If the scanning of all sample points has been completed, the presence or absence of an unsearched adjacent marker is checked (step S126). If there is, the process proceeds to step S114, and if not, the same processing is performed for all markers. After finishing the processing for all the markers, the process proceeds to the marker / address interpolation processing (step S128).
[0188]
The error detection circuit 370 is described in the Journal of the Institute of Television Engineers of Japan, Vol. 44, no. 11, p. 1549-P. A general method such as error detection based on a cyclic code as disclosed in 1555 “Code Theory” may be used.
[0189]
On the other hand, if there is no address error in step S122, it is determined whether scanning of all sample points has been completed (step S130). If not, the process proceeds to step S118, and scanning of all sample points has been completed. If so, the upper address is determined (step S132), and the center address of step 1 is calculated (step S134) and determined (step S136).
[0190]
That is, the direction is detected from the marker closest to the representative marker (in FIG. 32B, the approximate center address is at the distance D2). The detection method determines in which direction there is a surrounding marker depending on whether an address recorded in a dot code (step 1 code) larger than the data dot for direction detection can be recognized. In the step 1 code, the upper block address and its CRC code are recorded, and it is assumed that if the code is scanned, if there is no error, it is recognized.
[0191]
When the direction is detected, the inclination of the data block can be predicted. The step 1 code has directionality, and the block address is normally recognized only when scanning is performed from the representative marker to the surrounding markers. Therefore, when a recognition error does not occur, a block address code in two directions is always detected. Processing is performed until a two-way block address code is detected. Further, the data arrangement can be estimated from the positional relationship in two directions (see FIG. 32C).
[0192]
In the case of the dot code of FIG. 29A, an address code is detected only in one direction. At this time, the data area can be recognized from the detected line and the scanning direction (see FIG. 29B).
[0193]
In the actual operation, the direction is detected from the distance D2 which is the shortest distance from the representative marker, and if the address is not recognized, the search is performed clockwise. Therefore, the same operation is performed at the next closest distance D1. repeat. Assuming that the detection is performed clockwise, the detection continues with distances D4, D3, and D5. Processing is performed until two directions are detected.
[0194]
In the case of FIG. 29A, processing is performed until one direction is detected.
[0195]
If one direction can be detected, the other direction can be predicted in some cases. For example, if D4 and D5 are in the forward direction, and if D2 does not exist and the search is started from D4, if the address is confirmed at D4, it is predicted that the address can be recognized by either D3 or D5.
[0196]
The direction detection processing as described above will be described in more detail with reference to FIG.
[0197]
The approximate center of the representative marker detected by the approximate center detection unit 322 of the marker detection unit 216 is defined as a dot A5 on the upper left side of the figure, and eight dots separated by 1.5 dots (this can be appropriately changed by processing). Sample points A1 to A4 and A6 to A9 are generated by a step1 sample address generation circuit 368. Similarly, a sample address is generated around a marker whose direction is to be detected, for example, about the approximate center of the distance D2 (dot B5 on the upper right side in the figure).
[0198]
Here, the reason why the 1.5 dot interval is used will be described.
[0199]
In the processing for obtaining the approximate center of the marker, the difference is described so that the difference from the center is within one dot. However, it is assumed that no problem such as ink bleeding occurs. The detection range was set to ± 1.5 dots in consideration of ink bleeding and the like.
[0200]
The address control unit 220 draws a certain line between the addresses of both markers. First, a scanning line is drawn on the dots A1 and B1. Then, a sample clock is provided so that the upper address can be sampled, and data sampling of the image memory 214 is performed.
[0201]
As shown in FIG. 28A, since the CRC code 312A is added to the upper address code 306A, if the data sample is correctly read, the upper address code 306A is added to the upper address code 306A. The error detection result in the error detection circuit 370 is detected in a form that there is no problem, and if it cannot be read correctly, it is determined that there is an error.
[0202]
In the same manner, similarly, scanning lines are sequentially drawn in the order of dots A1 and B2, A1 and B3, A1 and B4, and each time it is checked whether an error has been detected. In total, there are nine positions on the representative marker side and nine positions on the detection marker side, so that 81 kinds of processing are performed.
[0203]
If an error occurs in all of the 81 processes, it is determined that there is no direction code in that direction, that is, the detection-side marker is a marker other than the array (a marker that has been erroneously detected).
[0204]
For example, in (A) of FIG. 33, when data is taken at each sample point on a scanning line (shown by a dotted line) drawn for dots A1 and B7, the sample points indicated by a broken circle in FIG. Since it is off, an erroneous detection is made. In particular, as described above, since an inverted code is provided on the upper and lower sides of the address data dot, an error always occurs.
[0205]
On the other hand, when the dots A5 and B5 are connected, since the data is properly collected, there is no detection error, and it is recognized that a code exists in this direction.
[0206]
In order to facilitate error detection, inverted codes are provided at the top and bottom. However, it is not always necessary to provide the inverted codes at the top and bottom. The format may be such that black data continues for the number of dots. In this case, the data on the end on the detection marker side always becomes black data, and the outside of the data becomes a white margin, so that a data error can be correctly detected. Also, when the inverted code is used, it is not necessary to provide the inverted code in the entire area of the inverted code portion, and it may be provided in a part of both sides (FIG. 28C).
[0207]
Here, the size of the dot will be described. As shown in FIG. 33B, assuming that the size of each dot of the upper address code 306A is n dots and the width of the step 1 code is m dots, the relationship between m and n is that at the inner end of the step 1 sample address. Then, a diagonal line is drawn by providing a width of 2 dots with respect to the center, and the width m determined by how much the upper address code 306A is provided has a long side, and the height of a rectangle having the diagonal line as its diagonal line is n. . That is, once m is determined, n is necessarily determined. Even if the entire area between the inner edges of the sample address of step 1 is this address code, there are only up to two dots, so n dots have a width of up to two dots. Although the width of one dot is not determined, a width that allows easy recognition of data is preferable.
[0208]
Note that the above-mentioned two dots can be obtained in such a range that, for example, a hit occurs in a scanning line connecting dots A5 and B5, but no hit occurs in a line connecting dots A6 and B4 and a line connecting A2 and B8. It is stipulated as follows. If it is larger than that, for example, in the case of hitting with dots A5 and B5, a hit may occur even when A2 and B8 are subtracted, and the detection as a center is spread. This value can also be changed according to the device.
[0209]
In the example of FIG. 33A, the hits are made for dots A5 and B5. However, in the case where a hit is also made to a line connecting dot A4 and, for example, B4, the next center detection step 2 is executed. At this stage, processing such as starting from the center of the dots A4 and A5 and performing the same search around the center is performed.
[0210]
Other methods are also conceivable. This will be described with reference to FIG. Here, when A4 and A5 are hit and B4 and B5 are hit on one side, the sample addresses (A41 to A45, A51 to A55, B41 to B45, B51 to B55) shown in FIG. . In this case, since the number of sample address points in step 2 increases from 9 to 10, the number of processes also increases from 81 to 100 (the number of scanning lines). However, the process of deriving the midpoint of A4 and A5 and the process of generating nine step2 sample addresses centering on the midpoint are eliminated because a predetermined sample point is used. Overall, processing is likely to be reduced.
[0211]
Further, assuming that there is an accurate center of step 2 between A4 and A5, assuming that address detection processing is performed on a scanning line connecting A42 to A44, A52 to A54 and B42 to B44, B52 to B54, It is possible to think that the number is reduced from 81 to 36 (6 × 6).
[0212]
In the above processing, a rough center in step 1 is obtained.
[0213]
As described above, by detecting the CRC, it is detected whether the data blocks are properly arranged in that direction. In FIG. 32B, the marker located at the distance D2 is a marker that is erroneously detected. Therefore, when the direction of the data is viewed in that direction, there is no code of the upper address. Thus, after all 81 detections have been made, all errors will occur in that direction, and it will be determined that there is no direction.
[0214]
When it is determined that there is no D2 in this way, the next closest distances are D1 and D4, but since the marker turns clockwise with respect to the marker of interest, processing is performed on the distance D1 next. As described above, since it is possible to determine only from left to right and from top to bottom in terms of data arrangement, in this case, processing is performed in the direction from the representative marker to the marker at distance D1. , That is, the CRC code is read first, and then the address code is read, so that this is naturally determined to be an error. Therefore, it is determined that there is no direction for the distance D1.
[0215]
Next, the distance D4 is determined. When D4 is read along the distance D4 from the representative marker, the address code and the CRC code are read in this order, so that it is determined that D4 has directionality. That is, no error occurs.
[0216]
Next, the objects to be determined are distances D3 and D5 that are equidistant. On the other hand, since the rotation is clockwise, the processing is first performed from the distance D3. As for D3, the CRC code is read first as described above, so that it is detected that there is no directivity. Then, finally, the distance D5 is read, and it is determined that there is a direction here.
[0217]
As a result, since the distances D4 and D5 are read, it is recognized that data corresponding to the block addresses described in the distances D4 and D5 are written in the hatched portions in FIG. can do. Eventually, if two directions are detected for one representative marker, the direction of that block can be detected. Therefore, processing is performed until two directions can be detected.
[0218]
In the case of the dot code of FIG. 29A, only one direction is detected. Processing is performed until one direction is detected (D5 in FIG. 29B).
[0219]
If an error occurs when processing is performed for all of the five directions, the direction detection processing is performed for a diagonal marker. In this case, in order to prevent an increase in the number of processing, The processing outside of a certain range is not performed, and necessary information such as address information that cannot be obtained is obtained by marker and block address interpolation processing.
[0220]
Further, as described above, the block address is not modulated. However, when the modulation is performed, a process of demodulating after recognizing the block address code is required.
[0221]
In the above description, whether or not there is directionality is determined using error detection of the upper address. However, for example, a directional pattern such as "11100001" is used instead of the upper address CRC code. Alternatively, when "11100001" is detected by pattern matching, a method of recognizing that there is a marker having a direction in that direction may be adopted.
[0222]
In the direction detection, it is not necessary to search for an adjacent marker clockwise for all markers, and the next block may perform an operation for recognizing an upper address code in that direction. That reduces the number of processes. Further, even when an abnormality occurs in the detection of the upper address, it may be recognized that there is a code in the direction obtained by detecting the peripheral direction.
[0223]
Next, the block address detection, error determination, and accurate center detection unit 300 will be described with reference to the block diagram of FIG. 35A and the flowchart of FIG.
[0224]
The upper block address calculation and center calculation circuit 372 of the data array direction detector 218 detects the upper block address when the upper address is detected. It is sent to the block address calculation and center calculation circuit 374. Further, since the approximate center at the time of detecting the upper address is known, the central address is led to the step 2 sample address generating circuit 376 (step S152).
[0225]
The step 2 sample address generation circuit 376 generates this approximate center sample address (step S154). That is, as shown in FIG. 35 (B), the sample addresses are placed at eight points outside the rough center (the center of the direction detection) obtained earlier, similarly to the above. Then, eight points are similarly provided for the markers for which the directionality has been found, and a scanning line is similarly drawn (step S156) to perform processing such as whether or not a lower address can be detected. In this case, the data interval for forming the sample address is defined every 0.5 dots in the present embodiment, but can be appropriately changed according to the specifications of the apparatus.
[0226]
Then, the address control unit 220 reads data from the image memory 214 based on the generated sample address, and derives data according to this sample point to the error detection circuit 378 (step S158). Similarly to the direction detection (as shown in FIG. 5A), when the sample point is between the data in the image memory, it is not a method representing one data in the memory but is derived by interpolation from surrounding data. Is also good. If an error has occurred in the error determination (step S160), it is determined whether or not scanning of all sample points has been completed (step S162). If not, the process proceeds to step S156, and scanning of all sample points has been completed. If so, the process proceeds to marker / block address interpolation processing after addresses have been detected for all blocks (step S164).
[0227]
On the other hand, if there is no address error in step S160, it is determined whether scanning of all sample points has been completed (step S166). If not, the process proceeds to step S156, and scanning of all sample points has been completed. If so, the lower address is determined (step S168), and the accurate center (step 2 center) is determined (step S170).
[0228]
That is, error detection is performed by the error detection circuit 378, and if an error occurs in the error determination, the process proceeds to the next process. The block address calculation and center calculation circuit 374 is supplied with a start and end address at the time of center detection from the address control unit 220, that is, a signal indicating which point is connected to which point. Determine whether or not it is possible. When there is no error detection, the block address calculation and center calculation circuit 374 combines the derived lower address with the upper address sent from the upper block address calculation and center calculation circuit 372 to generate a block address. To the next marker and address interpolation unit 302. Similarly, the center address is derived to the marker and block address interpolation unit 302.
[0229]
In FIG. 35B, the reason why the dot is set to 0.5 dot is that the sample point is detected within the range of 0.5 dot, and the center (direction detection direction) finally obtained in this processing is obtained. This is because the difference between the center and the true center falls within the 1/4 dot range. If the sampling point formed by the above processing is within the 1/4 dot range, the data in the data area can be properly reproduced.
[0230]
Further, since the smallest dot of the step 2 code is one dot, a data arrangement smaller than that is meaningless as data, so it is formed by one dot.
[0231]
As in the case of the step 1 code, inverted codes may be provided above and below the address data dots, or black data may be provided in the last few dots, and the surrounding area may be a margin. The data margin portion 364 for distinguishing the address code from the data code has a very small probability of being mistaken for a marker even if the region for distinguishing from the data area 314 is overlapped with, for example, black. , The data area 314 may be directly entered from the inversion layer.
[0232]
As shown in FIG. 35 (B), as a result, a CRC code is added in the form of a lower address, an upper address, which is almost half the data length of the entire data length, and further, the same size. The reason is that the data length is set to this data length so as to be able to detect even if a noise has been put on the entire address length or ink has come on, and a burst error in such a state can be detected. The ratio of the data length can also be changed as appropriate.
[0233]
By the above-described tree search processing, that is, a detection method of obtaining a rough center and obtaining a finer center, the accurate center for sampling data in the data area 314 and the block address have been recognized. become. That is, by performing a process called a tree search, the process is significantly reduced, and the amount of processing and the processing time are reduced as compared with the case where sampling is performed at a fine pitch from the beginning. Further, by using the block address for the direction detection and the accurate center detection, the redundancy of the entire data amount can be reduced.
[0234]
Next, the marker and address interpolation unit 302 will be described with reference to FIG. Now, it is assumed that the surrounding black marker portion has been detected in response to the error that the marker for the block B2 has not been detected or the address has not been detected.
[0235]
In this case, first, a line connecting the marker of the block B1 and the determined center of the block B3 is drawn, and a line connecting the marker of the block A2 and the determined center of the block C2 is drawn. I do. Then, address detection and processing can be performed further from the prediction center point toward the marker of block C2 and the marker of block B3. Further, even if address detection is not performed, since the arrangement is known, if the block B2 exists below the block B1, the address of the block B2 is set from the surrounding addresses, so that no detection is required. Can also be estimated. That is, it is possible to detect the address of the block and the center of the marker, which could not be predicted, which are currently focused on from the surrounding processing.
[0236]
The marker and block address interpolation unit 302 guides the address data that has been normally read, the center position, the interpolated address, and the information of the predicted center to the address control unit.
[0237]
If the scanning direction is the direction of the arrow as shown in the figure, the processing is performed with the upper left corner as the first representative marker. The center is sequentially detected in the vertical direction, and the center of eight (the markers in blocks A1 to A4 and the markers in blocks B1 to B4) is obtained by performing the first vertical detection. When the center of the next column is detected, the centers of the markers in blocks B1 to B4 are already known, so that the processing is not performed on the centers of the markers in blocks C1 to C4. , The center of step1, and the center of step2. Therefore, as described above, 81 scanning lines are not required, and once the center is obtained, the processing may be performed so as to sample the subsequent nine points. Therefore, nine processings are performed. That is, the center is obtained by 18 kinds of processing. Thus, there is an advantage that the processing is performed only at the beginning, but the processing after that is reduced.
[0238]
In the case of the dot code of FIG. 29A, first, a direction detection process is performed in the horizontal direction with A1, B1, and C1 using A1 at the upper left as a representative marker. In the processing, when the marker centers of A1 and B1 are obtained, the center detection processing of C1 may be performed in nine types of processing. In order to determine that the block below A1 is A2, since there is no address code, processing is performed as described below.
[0239]
That is, the size of the block may be determined from the lengths of the A1 marker and the B1 marker, and detection may be started from a marker located at an appropriate position based on the predicted block size, or the marker immediately below A1 may be represented first. The processing may be performed as a marker. Then, a block whose horizontal block address matches the detected block address may be set to A2. When the two-stage direction detection (A1 stage and A2 stage in the figure) is completed, the direction can be predicted in the vertical direction (the process of selecting the A3 marker), so that only the marker in that direction is detected. What is necessary is just to perform a process. Even if there is an erroneously detected marker, the processing can be performed excluding it.
[0240]
Next, the address control unit 220 of FIG. 20A will be described with reference to the block diagram of FIG.
[0241]
First, in the address control unit 220, the address generated by the write address generation unit 380 that generates an address when writing data from the A / D conversion unit 210 to the image memory 214 is stored in the image memory 214. The data of the / D conversion unit 210 is stored.
[0242]
As described above, an address is generated in each of the marker detecting section 216, the data array direction detecting section 218, the block address detection, the error determination, the accurate center detecting section 300, and the marker and address interpolating section 302. The address generators 382 to 388 are required for this purpose. In this case, in the marker generation address generation unit 382, the data generation direction detection address generation unit 384, the block address detection, the error determination, and the accurate center detection address generation unit 386, the corresponding marker detection unit 216 is used. (Internal marker determination section 318, marker area detection section 320, approximate center detection section 322), data array direction detection section 218, block address detection, error determination, accurate information exchange with center detection section 300 and address. Generate. Further, for a block in which four markers around the block are present, the interpolation processing address generation unit 388 calculates an address (hereinafter, referred to as a marker address) in which the exact center of each marker is associated with the image memory and the number of data. Further, a memory read address of the interpolation address coordinate data obtained by equally dividing the inside of the block and pixel data in the vicinity thereof is generated.
[0243]
The selection circuit 390 selects these address generation units 382 to 388 at the respective timings and supplies them to the lens aberration distortion correction circuit 392. The lens aberration distortion correction circuit 392 receives the lens aberration distortion information from the lens aberration distortion memory 224, converts (corrects) the selectively supplied address, and passes through the selection circuit 394. It is given to the image memory 214 as a read address.
[0244]
Next, another embodiment of the marker determination unit 318 in the marker detection unit 216 will be described with reference to FIGS.
[0245]
In the above-described embodiment, when the size of the dot code is determined, an image is formed by the imaging optical system 200 such that one dot corresponds to 1.5 pixels of the image sensor of the image capturing unit 204, and the marker determination unit 318 In the above, two-dimensionally continuous black pixels are found and determined as markers. On the other hand, in the present embodiment, when there are codes having different dot sizes, for example, a code having a dot size of 20 μm, a code having a dot size of 40 μm, and a code having a dot size of 80 μm, the image magnification in the imaging optical system 200 is not changed. This allows the reproduction of each code.
[0246]
That is, in various applications, the paper quality, sheet properties, ink, and printing level are different, and therefore, a dot size code corresponding to each application is used. For example, it is conceivable that 20 μm is used when the recording density can be extremely increased, and 80 μm is used depending on an application using a very rough low-cost sheet with poor sheet quality. In such a situation, the purpose is to judge the size and reproduce this code correctly.
[0247]
That is, as shown in FIG. 2B, there are a marker having a circular dot size of 20 μm, a marker having a dot size of 40 μm, and a marker having a dot size of 80 μm. The reproducing apparatus to which the present embodiment is applied is, for example, 20 μm. It is assumed that the apparatus is an apparatus for reproducing the code efficiently, that is, an apparatus having a magnification of an imaging system capable of decoding more information by one imaging. Then, in an apparatus in which the image of 20 μm is picked up at 1.5 times the image magnification, each of the 40 μm and 80 μm codes can be reproduced in the imaging system without changing the image magnification. That is the purpose. However, the size of the marker shown in (B) of the figure is seven times the diameter of each dot size.
[0248]
Therefore, as shown in FIG. 18A, first, the code of the maximum dot size to be selected is initialized (step S182). For example, if there are 80 μm, 40 μm, and 20 μm codes, and all of them are to be reproduced, the maximum size is set to 80 μm. This may be set by a key input by the user, or if it is determined that there are three types, that is, 80 μm, 40 μm, and 20 μm, and if it is possible to cope only with that size, the device itself will be the best. It may be set as a large size of 80 μm.
[0249]
Then, the temporary center is determined by performing the determination using the marker determination formula in FIG. 17B (step S184).
[0250]
That is, assuming that a code is created using markers for each dot size of 7 dots, at that time, as an image, the imaging optical system has an image magnification of 1.5 times. A code having a diameter of 10.5 dots and a code of 40 μm has a size of 21 dots, and a code of 80 μm has a size of 42 dots. Therefore, if 7 to 12 pixels and black pixels are two-dimensionally continuous, it is determined as a 20 μm code marker, 14 to 24 pixels is determined as a 40 μm code marker, and 29 to 47 pixels. Those below the pixel are determined as markers with a code of 80 μm.
[0251]
The value of this pixel is calculated by the following equation.
[0252]
r = s × d × mint (r × 0.7) ≦ R ≦ int (r × 1.1 + 1)
Where r is the number of pixels equivalent to the diameter of the marker (= 7)
s: dot size (20 μm, 40 μm, 80 μm)
m: imaging system image magnification (= 1.5)
d: number of dots of marker diameter
R: number of pixels of the diameter of the marker in the binary image
0.7: Reduction ratio due to inclination, dot rejection, etc.
1.1: Enlargement ratio due to dot gain or the like.
[0253]
Since the marker of 80 μm is initially set in step S182, it is checked in step S184 whether the marker is a marker of 80 μm by the above-described marker determination formula, and the size of the marker (80 μm dot) is checked. The temporary center is determined for a marker determined to have a marker composed of
[0254]
Next, the number of the markers is checked, and it is checked that there are four or more markers (step S186). This means that a determination is made as to whether there is one or more blocks since one block is surrounded by four markers.
[0255]
Then, it is checked whether or not the marker has a predetermined positional relationship with the adjacent marker as shown in (C) of the figure, that is, whether or not the marker is aligned (step S188). That is, a marker B near the marker A of interest, a marker C near a position D away from the marker A in the direction perpendicular to the direction connecting the markers A and B, and the marker B A marker D located near a position separated by a distance D in the same direction as the direction from the markers A to C is detected. If they exist, for example, it is determined that the code is 80 μm in this case.
[0256]
If there are no four or more 80 μm markers in step S186, or if it is determined in step S188 that they are not aligned, this is not an 80 μm code. Thus, the code is set to one smaller code, in this case, 40 μm (step S190), and the process returns to step S184 to perform another marker determination.
[0257]
If the smallest size cannot be determined even if the smallest size is determined, the process is terminated because the code is not a code or the code cannot be reproduced. In this case, it is preferable to proceed to a process of issuing a warning such as issuing an alarm.
[0258]
Next, another embodiment of the marker determination unit 318 will be described. That is, a method of determining a marker pattern and modulated data by dilation, which is general image processing, will be described. Here, the dilation process is a process of converting a black pixel near a white pixel into a white pixel. Specifically, for example, pixels around three pixels around the pixel of interest (a 7 × 7 pixel area centered on the pixel of interest) are checked (black and white determination), and if at least one pixel is a white pixel, the pixel of interest is converted to a white pixel. The conversion process is performed for all pixels on the image.
[0259]
First, binarization processing is performed on the data in the image memory.
[0260]
Next, by the above-mentioned dilation processing, only the data portion of the code image is entirely converted into white pixels, and the pattern portion of the marker is converted into an image smaller than the original size by the number of pixels that have been dilated.
[0261]
Next, the address in the image memory of the transition point from a white pixel to a black pixel on the image and the number of continuous black pixels from the pixel are counted, and the information is classified for each marker based on the information, and The center address and the marker existence range are detected. Then, the approximate center detection processing is performed.
[0262]
This makes it possible to quickly determine the marker and detect the marker existence range at a high speed.
[0263]
In the case of a code in which the marker is uniformly deformed with respect to the center of the marker, such as the dot gain and dot reduction described above, the temporary center address obtained in the marker determination can be used as the approximate center. .
[0264]
The processing of step S184 in FIG. 38A may be the above processing.
[0265]
When the above-described A / D conversion unit is performed by binarization using a comparator, the binarization processing can be omitted in the marker determination processing.
[0266]
Next, a light source-integrated image sensor applicable to the detection unit 184 of the playback device shown in FIGS. 15 and 20D will be described. FIG. 39 is a diagram showing the structure. For example, a light emitting cell 398 is formed on a chip next to the light receiving cell 396 by using a compound semiconductor such as an LED or an electroluminescent element. Between the light receiving cell 396 and the light emitting cell 398, there is provided an isolation (light shielding) portion 400 in which a cutter is actually formed on the wafer to form a groove, and a non-transmissive material such as a metal is embedded therein. With this isolation section 400, it is possible to eliminate the problem that light emitted from the light emitting cell 398 directly enters the light receiving cell 396.
[0267]
In such a configuration, light emission of the light emitting cell 398 is controlled according to a light emitting cell control pulse signal as shown in the timing chart of FIG. The light receiving cell 396 sends the accumulated charge to the adjacent vertical charge transfer register 402 by applying a charge transfer gate pulse signal to a charge transfer gate (not shown). The vertical charge transfer register 402 sends the accumulated charge to the horizontal charge transfer register 404 line by line with a vertical charge transfer pulse. The horizontal charge transfer register 404 outputs the stored charges one pixel at a time via the buffer amplifier 406 according to the horizontal transfer clock signal.
[0268]
Next, with reference to FIG. 40, a description will be given of an embodiment in which, of the circuits of the reproducing apparatus described above, up to the stage preceding the demodulation circuit is implemented by an analog circuit and is configured by one chip. In this embodiment, an XY address type imaging unit 408 represented by CMD as disclosed in, for example, Japanese Patent Application Laid-Open No. 61-4376 is used as an imaging unit, thereby eliminating the need for a memory. , It is possible to make up one chip. An X-decoder 410 and a Y-decoder 412 are provided for address-scanning the XY-address type imaging unit 408.
[0269]
In an ordinary XY address type imaging unit, unlike a CCD, after reading one line, this line is reset to read the next line. That is, while a certain line is being read, another line is exposed during the exposure period. It is common to adopt a readout method such as entering into. However, such a reading method has a disadvantage that when extraneous light enters during the imaging time, an extra portion is exposed. Therefore, in this embodiment, the XY address method is used, and In combination with the element shutter, an operation is performed such that exposure is performed only when external light enters, that is, when exposure is to be performed, and the other portions are not exposed.
[0270]
The imaging element scanning address generation and element shutter control section 414 generates an element shutter pulse for providing an element shutter operation in an XY address manner, and generates a reset pulse for resetting all pixels.
[0271]
The X-decoder 410 and the Y-decoder 412 are circuits for turning on one of the elements in response to the generation of the image-capturing-element scanning address and the X address and the Y address from the element shutter control unit 414. Normally, the selector is constituted by a shift register or the like. In this embodiment, however, the selector is a type in which any one of the elements can be turned on by a signal from the image sensor scanning address generation and the element shutter control unit 414.
[0272]
The reset pulse in the present embodiment is equivalent to the image sensor reset pulse in the timing chart of FIG. 16, and resets the image sensor before the exposure and sets the reset pulse high during this reset period. This causes the switch 416 to switch, drawing all of the charge toward the negative power supply 418.
[0273]
The element shutter pulse is generated in such a manner that the gate can be applied from the end of the reset pulse to the end of the exposure as shown by a broken line in FIG.
[0274]
For reading, as in the case of a normal pulse, each element is sequentially turned on, and the signal charge is amplified by the current / voltage conversion amplifier 420 via the reset selection switch 416 and then supplied to the marker detection unit 422. . The marker detection unit 422 is the same as that described above, and the data detected by the marker is stored in the register 424. The θ detection unit 426 calculates the inclination based on the contents of the register 424 as in the direction detection unit described above. For example, in the circuit shown in FIG. 20D, the θ detection unit 426 corresponds to the data array direction detection unit 218, and the next data interval control unit 428 and the imaging element scan address generation and element shutter control unit 414 operate at the address. It corresponds to the control unit 220.
[0275]
Then, the coefficient for interpolation generated by the coefficient generator 430 under the control of the data interval controller 428 is multiplied by the charge read by the multiplier 432, and all are added by the adder 434. That is, the output of the addition circuit 434 is sampled and held by a sample and hold (S & H) circuit 436 and returned to the addition circuit 434 via the switch 438. This operation is performed to perform data interpolation as shown in FIG. 5A when sampling data after the direction and the scanning line are determined. In FIG. 5A, interpolation is performed by multiplying D6, D7, D10, and D11 by coefficients in order to obtain Q data. The interpolated value is sampled and held by the S & H circuit 440, and the sampled and held value is binarized by the comparator 442 and the threshold value determination circuit 444.
[0276]
Each imaging element (pixel) of the XY address type imaging unit 408 will be described in more detail. Each pixel is composed of two CMD elements, as shown in FIG. 41A, and the element shutter pulse enters the first CMD element 446, and the capacitor 448 is stored for the element shutter. Where the charge accumulates. After that, the second CMD element 450 drives a read pulse from the Y decoder 412 to select a line, and reads the electric charge for each pixel from the horizontal selection switch 452.
[0277]
At the time of exposure, the first CMD element 446 is operated as an element shutter by an element shutter pulse, and charges are stored in the element shutter capacitor 448. When the electric charge is accumulated in this way, light is shielded, a read pulse is applied from the Y decoder 412 to select a line, and the second CMD element 450 is turned on by the horizontal selection switch 452 to read out one pixel at a time.
[0278]
When resetting the charge, the horizontal selection switches 454 are all turned on by a reset pulse output from the image sensor scanning address generation and element shutter control unit 414, and the reset selection switch 416 is set to the negative power supply 418 side. Since the source of the CMD element 450 has a negative voltage, the charges accumulated in the element shutter capacitor 448 and the gate of the CMD element 446 move to the negative power source and are reset.
[0279]
In addition to the above operation, the reset can be performed by simultaneously applying a slightly higher voltage to the element shutter pulse and the read pulse.
[0280]
In the case of a normal imaging device, dark current is a problem, but in the case of the present embodiment, the device shutter pulse shown in FIG. Since the reading is performed immediately, the time during which the dark current accumulates is actually very short. Therefore, the S / N ratio is more advantageous than the operation of other imaging devices. In the exposure, a sufficient amount of light is given even in this short exposure period, so that the signal level remains unchanged and the S / N level with respect to the dark current decreases, so by applying this embodiment, As for the gain of the output degree of the current-voltage conversion amplifier 420 at the subsequent stage, a considerably large gain can be set.
[0281]
In the present embodiment, the pixel configuration for performing the above-described element shutter operation is described. However, a CMD element capable of performing the element shutter operation as disclosed in JP-A-61-4376 may be used. is there.
[0282]
Next, an embodiment in which a circuit using the XY address type imaging unit 408 as described above is constructed as a three-dimensional IC will be described with reference to FIG. Note that the present embodiment is directed to a case of an audio information reproducing apparatus.
[0283]
This is because the CMD 408, the X-decoder 410, and the Y-decoder 412 have an imaging unit layer 454 on the sheet surface of the sheet 182 and a detection unit layer 456 that detects data formed by being stacked on the imaging unit layer 454. , And an output processing layer 458 formed by being stacked on the detection section layer 456. The output processing layer 458 includes a demodulation section 190, an error correction section 194, a decompression processing section 256, a data interpolation circuit 258, a D / A conversion section, an output buffer 266, and the like, and outputs decoded audio information to an audio output device 268 such as an earphone. To play as sound.
[0284]
Of course, as described above, the output processing layer 458 can be configured to reproduce multimedia information including image information.
[0285]
By using a three-dimensional IC in this manner, processing up to sound output can be performed with one chip, so that the circuit scale is extremely reduced and the cost is reduced.
[0286]
Next, various configuration examples of the pen-type multimedia information reproducing apparatus will be described.
[0287]
For example, a pen-type information reproducing apparatus can be provided with a switch for instructing a timing for taking in a dot code.
[0288]
FIG. 41 (B) shows an example of this. The pen-type information reproducing apparatus is a light source 198 and an image forming optical system 200 in the reproducing apparatus shown in FIG. 15 or FIG. 20 (D). , A spatial filter 202, an imaging unit 204, a preamplifier 206, and a detection unit 184 including an imaging unit control unit 212 are provided at the tip thereof, and a scanning conversion unit 186, a binarization processing unit 188, a demodulation unit 190, a data error correction unit 194, a decompression processing unit 256, a data interpolation circuit 258, and the like are incorporated as an image processing unit 460, a data processing unit 462, and a data output unit 464. And it has an earphone as the audio output device 268. Although only an audio information output device is shown in this figure, it is needless to say that an output device can be connected when a processing unit for an image, a character, a line drawing, or the like is built in. The same applies to the description of the pen-type information reproducing device).
[0289]
A touch sensor 466 is provided on a side surface of the pen-type information reproducing device. As the touch sensor 466, for example, a piezoelectric switch, a micro switch, a piezoelectric rubber, or the like can be used, and a switch having a small thickness of 0.6 mm or less is known. The control unit serving as the imaging unit control unit 212 starts capturing the dot code as described above in response to the touch of the touch sensor 466 by a finger. Then, when the finger is released from the touch sensor 466, the capturing ends. That is, the start and end of the dot code capture are controlled using the touch sensor 466.
[0290]
Reference numeral 468 in the figure is a battery as an operating power supply for each unit in the pen-type information reproducing apparatus.
[0291]
The touch sensor 466 can perform the same function not only in the form of being pressed by a finger but also in a configuration in which it is attached to the tip of a pen-type information reproducing device as shown in FIG.
[0292]
That is, when the user places the pen-type information reproducing apparatus on the sheet 182 in order to manually scan the dot code printed on the sheet 182, the touch sensor 466 is turned on, and the control unit 212 recognizes it. To start reading the dot code.
[0293]
In this case, the tip of the pen-type information reproducing apparatus moves while contacting the sheet surface during scanning. In this example, the tip of the touch sensor 466, that is, the surface contacting the sheet surface is coated with a smooth resin or the like. In addition, it is preferable that a smooth movement be performed during manual scanning (moving).
[0294]
Further, a mechanism for removing specular reflection may be further provided in the detection unit of the pen-type information reproducing device.
[0295]
FIG. 44A shows the configuration, in which a first polarizing filter (polarizing filter 1) 470 is arranged on the front surface of a light source (a light source such as an LED) 198, that is, on the side to be irradiated. A second polarizing filter (polarizing filter 2) 472 is arranged on the front surface of the system (lens) 200.
[0296]
For example, the first polarizing filter 470 is formed by cutting out a polarizing filter film 474 into a donut shape as shown in (B) of the same figure, and the second polarizing filter 472 is formed of another polarizing filter film. 476 can be used, or, for example, an inner portion of the polarizing filter film 474 cut out of the first polarizing filter 470 can be used as shown in FIG.
[0297]
The first and second polarization filters 470 and 472 thus formed have a pattern surface (polarization surface) of the second polarization filter 472 with respect to a pattern surface (polarization direction) of the first polarization filter 470. They are arranged orthogonally.
[0298]
As a result, the plane of polarization of the random light emitted from the illumination light source 198 is limited by the first polarizing filter 470, and, for example, a P-wave is irradiated. Then, the specular reflection component is returned as a P-wave from the sheet surface while the polarization plane is preserved as it is. However, since the polarization plane of the second polarization filter 472 is orthogonal to the first polarization filter 470, The reflection component is blocked by the second polarization filter 472. On the other hand, when light emitted from the first polarization filter 470 returns to actual dots, that is, light that has returned on the sheet surface as luminance information on the paper surface, the plane of polarization is random. Therefore, the signal once entering the paper and returning as black and white information or color information has both the P component and the S component. Among them, the P component is similarly cut by the second polarizing filter 472, but the S component orthogonal thereto is passed through the second polarizing filter 472 and actually passed through the lens 200. To form an image on the imaging unit 204. That is, the reflected light from which the specular reflection component has been removed is guided to the imaging unit 204.
[0299]
In this case, a ４λ plate 1230 is arranged on the front surface of the spatial filter 202, and converts the image light, which is once input as linearly polarized light, into circularly polarized light and inputs the circularly polarized light to the spatial filter 202. This is because the effect of the linearly polarized light cannot be obtained because the spatial filter normally uses birefringence of quartz. In this example, the λλ plate 1230 is arranged on the front surface of the spatial filter 202, but is not limited to this, and may be an arbitrary one between the second polarizing filter 472 and the spatial filter 202. What is necessary is just to arrange in the place which is easy to install.
[0300]
As a configuration for removing the specular reflection component as described above, a configuration as shown in FIG. 45 can be further considered. This is because, instead of disposing the first polarizing filter 470 in the vicinity of the light source 198, for example, the light from the light source 198 is extremely sheeted using a transparent resin optical waveguide material 480 provided with a surface mirror coat 478. The light guide 480 illuminates the sheet (dot code) by guiding the sheet (dot code) to a position close to the surface, and is arranged at the light emitting portion of the optical waveguide member 480. In this case, the first polarization filter 470 is arranged so that light orthogonal to the second polarization filter 472 is transmitted.
[0301]
Incidentally, the use of the transparent resin optical waveguide material 480 has the advantage that the outer shape of the light source 198 can be made as thin as possible, and the advantage that the specular reflection component can be reduced because the incident angle becomes shallow.
[0302]
However, since the specular reflection component still remains due to the swelling of the ink, the swelling of the sheet paper, and the like, a polarizing filter is provided in order to eliminate this more efficiently.
[0303]
Further, instead of the second polarizing filter 472, an electro-optical element shutter 1220 such as a liquid crystal shutter or a PLZT shutter may be provided. The electro-optical element shutter 1220 includes, as shown in FIG. 44D, a polarizer 1221 as a polarizing filter, an electro-optical element 1222 such as liquid crystal or PLZT, and an analyzer 1223 as a polarizing filter. In this case, by arranging the shutter 1220 so that the light distribution direction of the polarizer (polarizing filter) 1221 of the shutter 1220 is the same as that of the second polarizing filter 472, a regular reflection removing effect can be obtained. .
[0304]
Further, the shutter function enables frame reading with an image sensor such as an IT-CCD that supports field reading, or has the advantage that all pixels can be simultaneously exposed even with an XY address type image sensor such as CMD. .
[0305]
Next, an example in which the light source 198 is made more efficient and the device is made slimmer will be described.
[0306]
FIG. 46 (A) is a view showing the structure, and is provided with an acrylic transparent resin optical waveguide material 480 having a mirror coat 478 on the surface, similarly to the example of FIG. 45 (A). As shown in FIG. 46B, the acrylic transparent resin optical waveguide material 480 is formed in a truncated cone shape, and a screw portion 482 is provided on an upper portion (a wider end portion) thereof. It is adapted to be screwed and attached to the housing 484 of the pen-type information reproducing device. Further, a surface mirror coat 478 is not applied to an inner portion near the screw portion 482, and a light source 198 is provided at the portion 486. That is, the light source 198 is provided as an LED array in which LEDs are mounted on a thinly cut flexible substrate 488 and formed into a ring shape, and this is adhered and attached to the portion 486 without the surface mirror coat. . Then, as shown in (C) of the same figure, the lower portion (tip portion) of the acrylic transparent resin optical waveguide material 480 is cut to form a portion 490 where the surface mirror coat 478 is not applied. Therefore, the light from the light source 198 enters the transparent resin optical waveguide material 480 from the non-mirror coat portion 486, is reflected by the surface mirror coat 478, passes through the optical waveguide material 480, and passes through the surface mirror coat at the tip. The light exits from the non-portion portion 490 and is irradiated on the dot code on the sheet.
[0307]
In addition, as shown in (D) of the figure, the front end of the acrylic transparent resin optical waveguide material 480 is straightened, and the surface mirror coat 478 is applied only to the outer portion, thereby facilitating the manufacture. It may be a simple shape. In this case, it is more preferable that the tip is rounded to make it slippery.
[0308]
Next, an example of a pen-type information reproducing apparatus using a light source-integrated image sensor will be described (see FIG. 47).
[0309]
That is, in the present embodiment, the light source integrated type image sensor 492 described above with reference to FIG. 39 is used, and a rod lens (for example, a cell hoc lens, a convex lens, 494) and a thin glass plate 496 are arranged and formed. Here, the thin glass plate 496 has a role of a protective glass for the actual contact surface and a role of giving a certain distance to make the illumination as flat as possible.
[0310]
As described above, by using the light source-integrated image sensor 492, it is possible to reduce the size of the pen-type information reproducing apparatus, and also to shorten the pen-type information reproducing apparatus in the length direction.
[0311]
Next, a pen-type information reproducing apparatus for handling color multiplexed dot codes will be described.
[0312]
FIG. 48A is a diagram showing the configuration, in which the touch sensor 466 as shown in FIG. 41B and the first and second polarizing filters as shown in FIG. 470,472. Further, the pen-type information reproducing apparatus of the present embodiment reads a color multiplexed dot code which is color multiplexed by combining a plurality of dot codes of different colors as shown in FIG. In addition, a color liquid crystal 498 controlled by the control unit 212 is arranged on the pupil plane of the lens 200.
[0313]
Here, in order to explain a method of controlling the color liquid crystal 498 in the control unit 212, an example of using a color multiplex dot code will be described first.
[0314]
For example, as shown in (C) of the figure, a color multiplex dot code 502 is arranged on an A4 sheet 500, and the character "Good Morning" is written in correspondence with the color multiplex dot code 502. First, consider a case where an index 504 and an index code 506 are arranged. Then, when the color multiplex dot code 502 is reproduced by this pen-type information reproducing device, the pronunciation of "Good morning" in Japanese, the pronunciation of "Good morning" in English, or the pronunciation of "Good morning" in German, or In order to select whether or not to pronounce "Guten morgen", as shown in (D) of the figure, an index code 506 arranged corresponding to an index 504 indicating the option is scanned and recognized, and for example, Japanese is selected. After that, when the color multiple dot code 502 is scanned, the following description will be given for the purpose of producing an utterance such as “Good morning”.
[0315]
First, as shown in (B) of the figure, a dot code for generating a sound in Japanese is generated, and is assigned as code 1 to red (R). Similarly, a dot code to be pronounced in English is created as code 2 and assigned to green (G), and a dot code to be pronounced in German is created as code 3 and assigned to blue (B). The color multiplex dot code 502 is recorded on the sheet 500 as the color of the overlapping portion of each information is a color formed by the color addition method of each color. In this case, portions where colors do not overlap are recorded as black dots. That is, as described above, the dot code is composed of the marker and the data dot, but the marker is black, and the data dot is recorded in another color by the additive method. Recording with the color multiplex dot code 502 in this manner means that the recording density is increased.
[0316]
It should be noted that not only the three colors of RGB but also a plurality of different pieces of information may be assigned to colors of different narrow-band wavelengths. More information, such as types, can be multiplexed. In this case, the color ink may be a mixture of a dye (an ink that reflects light having only a narrow band wavelength) in addition to the conventional inks such as cyan, yellow, and magenta.
[0317]
The index code 506 is arranged in the underlined portion of the index 504 shown by characters or pictures so that the user can recognize and select the index code 506. The print can be read regardless of which color is selected. Is printed in black.
[0318]
The color liquid crystal 498 is formed by attaching an RGB light transmission mosaic filter in accordance with liquid crystal pixels, and separates information of each color of the color multiplex dot code 502. That is, the control unit 212 controls so that only the pixels corresponding to the color of the information selected by the scan of the index code 506 are in the transmission state. Further, the liquid crystal may not be in a mosaic shape, and may be configured to divide an optical path into planes. At this time, it is preferable to make the divided area ratio of each color inversely proportional to the sensitivity of the pixel because the sensitivity for each color becomes uniform. That is, when the sensitivity of B is low, the area is made larger than other colors. The color liquid crystal may be provided on the light source side.
[0319]
Next, an operation for reading the index code 506, selecting a color, and generating a color in a desired language will be described with reference to the flowchart in FIG.
[0320]
First, the control unit 212 controls the liquid crystal transmission portion of the color liquid crystal 498 in accordance with the color selection when the touch sensor 466 is pressed (step S204) if green is temporarily selected by the initial setting (step S202) (step S206). ). For example, since green is selected in the initial state, only dots with a green filter are made transparent. Next, the light source 198 is controlled by the control unit 212, and the dot code is read by the image processing unit 460 (step S208). Then, the code is decoded by the data processing unit 462 (step S210), and it is recognized whether or not all the codes have been completed, that is, whether all the codes have been read (step S212). Emit (step S214). Next, the control unit 212 determines whether the read result is the index code 506 or the sound information (color multiplex dot code 502) based on the decoded result (step S216). Then, the color indicated by the index code 506 is selected (step S218), and the process returns to step S204. If it is sound information, the sound is reproduced from the sound output device 268 by the data output unit 464 (step S220).
[0321]
Then, after the sound is reproduced in step S220, it is further determined whether or not the sound is repeatedly generated a predetermined number of times (step S222). If the number of times is preset by the repeat switch 467, the The predetermined number of times is repeated.
[0322]
Of course, the number of repetitions may be one, and may be appropriately set by various switches. Alternatively, the number of repetitions may be recorded in the index code 506 or the dot code 502 in advance.
[0323]
In this case, the repeat reproduction can be performed by repeatedly reading the data from the data memory unit 234 in FIG. 15 or (D) of FIG.
[0324]
The imaging unit 204 includes a monochrome image sensor and a color image sensor in which a color mosaic filter is generally mounted on the image sensor unit. Although the above example uses a black-and-white image pickup unit, it is possible to use a color image pickup device and separate the colors in the image processing unit 460 to reproduce the image in different colors. In such a case, the color liquid crystal 498 can be dispensed with.
[0325]
FIG. 49B is a diagram illustrating a configuration of an image memory unit of the image processing unit 460 when a color image sensor is used. That is, a signal input from the color image sensor is separated into respective colors by a color separation circuit 508 and stored in the memories 510A, 510B, and 510C, and is selected by the multiplexer (MPX) 512 to perform the subsequent processing. To do.
[0326]
Further, of the first and second polarizing filters 470 and 472 for the purpose of preventing regular reflection, the same polarizing filter is used in the polarizer portion of the color liquid crystal 498 for the second polarizing filter 472. Therefore, it is possible to use it also. Therefore, by combining with the polarization filter for the color liquid crystal 498, the second polarization filter 472 can be omitted. However, at this time, the angle of the color liquid crystal on the horizontal plane must be the same as the direction corresponding to the second polarizing filter 472, that is, must be rotated so as to cut components in the same direction.
[0327]
Also, as shown in FIG. 50A, the color liquid crystal 498 is removed, and instead of using a white light source as the light source 198, an RGB light source such as an LED as shown in FIG. The color multiplex dot code 502 can be read. That is, in the case of separating RGB and the above three colors, among the RGB light sources 198, when reading the code 1 corresponding to red, only the LED corresponding to red is turned on. In the case of code 3, only the blue LED may be turned on to reproduce.
[0328]
Instead of using the RGB LEDs, a color filter may be added to each part as a white light source to provide a light source of each color.
[0329]
In this way, by using light sources of different colors R, G, and B as the light source 198 and controlling lighting of the light source of the color selected by the index code 506, the same effect as the configuration of FIG. it can. Furthermore, by having a plurality of light sources that emit light of a plurality of narrow-band wavelengths, it is not necessary to have a color liquid crystal and a control circuit therefor, and the size can be reduced at low cost. In particular, some LEDs have a narrow band, for example, a wavelength of about ± 27 nm of a certain wavelength. If such an LED is used, a narrower band can be reproduced.
[0330]
Next, a stealth type dot code pen type information reproducing apparatus will be described.
[0331]
FIG. 51A shows a dot data sticker 516 with a title on which an infrared-emitting paint dot code 514 as a stealth-type dot code is printed. The dot data sticker 516 prints, for example, a title in a printing machine or a printer using normal color or black and white printing, and prints a dot code below this using an invisible paint. It was done. Of course, in the dot data seal 516, since the dot code 514 is invisible, that is, transparent printing, the dot code 514 is formed on the title of the visible information by using transparent ink as shown in FIG. Printing may be performed in an overlapping manner. For example, in the case of an inkjet printer or the like, this printing is realized by applying an infrared light-emitting paint ink as a fifth ink to four inks of cyan, magenta, yellow, and black, and printing the ink. it can.
[0332]
FIG. 51A shows an example in which a title is printed in the margin of a stealth-type dot code. Needless to say, a visible-light dot code is printed on the title-attached dot data sticker, and the title is printed in the margin. The title may be printed.
[0333]
As a pen-type information reproducing apparatus that reproduces the infrared-light-emitting paint dot code 514 as such a stealth-type dot code, for example, as shown in FIG. Since it is printed, an infrared light emitting element 518 is used as the light source 198, and an infrared bandpass optical filter 520 is arranged in front of the imaging unit 204.
[0334]
That is, when the infrared light emitting element 518 irradiates the infrared light paint dot code 514 with light in the infrared region, the light is reflected in the infrared region, that is, at a wavelength in a certain narrow wave band. In order for the intensity of the reflection to be detected by the imaging unit 204, the reflected light is guided through the infrared band-pass optical filter 520 and separated from visible light information.
[0335]
In addition, since several kinds of emission bands of the paint used for printing the infrared emission paint dot code 514 can be prepared, for example, by taking an image while changing the characteristics of the bandpass optical filter 520 little by little, this transparent printing can also be performed. Multiplexing is possible.
[0336]
Next, instead of configuring all the functions of the reproduction system in the pen-type information reproducing apparatus, various optional functions are provided for various devices such as an electronic notebook, a PDA, a word processor, a personal computer, a copier, a printer, and an electronic projector. A ROM card is generally used for adding. An example in which the functions are partially distributed to a card-type adapter that can be connected to a connector of a ROM card will be described.
[0337]
FIG. 52 shows an example in which an image processing unit 460 is provided in the pen-type information reproducing apparatus, and the output of the image processing unit 460 is supplied to the card-type adapter 524 via the output connector 522. . In this case, the card type adapter 524 includes a data processing unit 462, a data output unit 464, a signal processing unit 526 including a D / A, and an audio connection terminal 528, and outputs reproduced audio information from the audio output device 268 as sound. In addition, multimedia information such as reproduced images can be supplied to an external device 532 such as an electronic organizer via the I / F 530.
[0338]
In other words, by connecting to a ROM card connection terminal (not shown) of an external device 532 such as an electronic notebook which does not have a sound output mechanism such as a speaker, a dot-coded image or the like is output to a device that cannot output such sound. At the same time as inputting the multimedia information, an audio output device 268 such as an earphone is connected to the audio connection terminal 528 of the card type adapter 524 to listen to the dot-coded audio.
[0339]
Further, as the external device 532, it is possible to assume a TV game machine that has been widely used in each home in recent years. FIGS. 53A and 53B show the structure of a card type (in this case, a cassette type) adapter 524 for such a video game machine. In the case of FIG. This is a case where only the data processing unit 462 is configured in the apparatus, and FIG. 3B is a case where only the detection unit 184 is configured. The ROM 534 stores a control program executed by a CPU (not shown) built in the video game machine main body, and is loaded into the main body when a cassette is inserted. The RAM 536 is used to store the processing result of the data processing unit 462. The memory control unit 538 controls the ROM 534 and the RAM 536 according to an instruction from the CPU in the main body of the video game machine.
[0340]
Normally, a video game machine is equipped with a high-performance CPU. Therefore, rather than performing all the processing in the pen-type information reproducing apparatus, high-speed processing is performed by allowing the CPU of the game machine body to partially perform the processing. Becomes possible. Further, since the operation unit of the game machine can be used as various control input units, it is not necessary to provide a reading start instruction switch such as a touch sensor in the pen-type information reproducing apparatus, and the size can be reduced. In this case, a control program for processing performed by the CPU of the main body of the game machine, or a control program for controlling the pen-type information reproducing apparatus and the user interface function for operation by the main body CPU and the operation unit of the game machine, It is stored in the ROM 534. Furthermore, since the game machine is provided with a speaker, an audio output terminal, a monitor output terminal, and the like, these can be omitted from the pen-type information reproducing device and the card-type adapter, so that the cost can be reduced.
[0341]
Next, operation switches when using the card adapter 524 will be described.
[0342]
An electronic organizer as the external device 532 usually has a slit for mounting a card called a ROM card or an IC card, and when a card type adapter is inserted into the slit and mounted, a note is written on the surface of the card type adapter. The displayed characters and symbols can be seen through under the transparent touch panel 560 of the electronic organizer, and when touching the place written on the card type adapter, the function corresponding to it is activated, for example, an operation such as being displayed on the display 562. Some are made available.
[0343]
Therefore, in the case of such a card-type adapter 524 for an electronic organizer, as shown in FIG. 54A, a switch of a control system of the pen-type information reproducing device 564, for example, turning on / off the light source 198 and the like. Without providing such operation switches, letters and symbols representing those switches are simply written at predetermined positions on the surface.
[0344]
In addition, since the external device 532 such as a personal computer or a word processor has a built-in keyboard, when a pen-type information reproducing apparatus is connected to such a device, the card-type adapter 524 does not need to be provided with a control system switch. Can be controlled from the other side.
[0345]
However, in the case of an external device 532 which has a dedicated control switch for operating itself, such as a printer, but has no other control system switch, the card type adapter 524 is provided with a control system switch. It is necessary to provide. For example, as shown in FIG. 54 (B), the length of the card is made longer than the normal card length, and a necessary switch 566 is provided at a portion which protrudes outside the device when the card is mounted on the device 532. As the switch 566 in this case, for example, a tact switch or a touch panel can be used.
[0346]
Next, an apparatus for printing a dot code will be described.
[0347]
First, as shown in FIG. 55, a reel seal printing machine 572 for converting data edited by a personal computer or word processor 568 into a dot code by a multimedia information recording device 570 and printing the dot code on a reel sticker will be described.
[0348]
FIG. 56 is a diagram showing the internal configuration of this reel seal printing machine.
[0349]
The dot code from the multimedia information recorder 570 is temporarily stored in the dot pattern memory 574, and then the LED arrays 578 and 580 emit light based on the dot pattern by the LED driver 576. Light from these LED arrays 578 and 580 is guided onto a photosensitive paper extending from a photosensitive paper reel 584 by a rod lens 582 provided in close contact with each pixel. The timing of light emission is managed by the CPU 588 according to the speed and position of the photosensitive paper detected by the sensor 586. Similarly, the feed speed of the photosensitive paper is controlled by controlling a driver 594 of a rotary motor 592 that drives a roller 590 in an output stage.
[0350]
On the other hand, in order to protect the printed dot code, a surface coat seal 596 is added at the output stage, and the photosensitive paper and the surface coat seal are simultaneously output in a bonded state. Here, as the photosensitive paper, photographic paper, film, or the like can be used, and in this case, the back surface is provided with adhesiveness.
[0351]
When the photosensitive paper is a normal film or the like, two types of dot codes are multiplexed such that the LED array 578 is a red LED array and the LED 580 is a yellow LED array as shown in FIG. You may do it. For multiplexing, two types of LEDs may be shifted in position to form a two-color dot code, or two types of LEDs may emit light at the same position to create different colors, and further multiplexing may be performed. May be.
[0352]
Such a reel seal printing machine 572 has a feature that, by using photosensitive paper, the resolution is high and the cost is low. In addition, since the configuration of the exposed portion does not require expensive processing such as scanning with a laser or the like and is performed using a small LED array, the apparatus becomes very inexpensive. Furthermore, in the case of a laser or the like, the angle of the mirror or the precision of fine positioning is required. On the other hand, since the printing machine 572 has a close contact type optical path, such fine positioning precision is unnecessary, and the Problems can also be avoided.
[0353]
Although the arrangement direction of the LED arrays 578 and 580 and the rod lens 582 is shown as the traveling direction of the photosensitive paper in the drawing for convenience of drawing, it is actually in the direction perpendicular to the paper surface, that is, in the width direction of the photosensitive paper. They are arranged. Of course, a large number of dot codes may be formed at a time as a two-dimensional array arranged in the width direction.
[0354]
In the reel seal printing machine 572 as described above, the photosensitive paper on which the dot code is printed is output from the roller 590 in a form as shown in FIG. 55. In this case, a white border is formed at the boundary with the next data. It is preferable to insert a blank portion so that the user can see where the cutting process such as a cutter should be performed. Furthermore, since the code length that can be pasted changes depending on the size of the sheet on which the reel seal is to be pasted, that is, whether it is A4 or B4, the length of the dot code that can be printed is changed accordingly. You may do it. In such a case, a control method such as controlling the timing of reading the dot pattern on the dot pattern memory 574 to adjust the length adaptively according to the sheet size set manually, for example, is adopted. I do.
[0355]
FIG. 57 shows a configuration in which a function of recording a multimedia dot code is provided inside a word processor.
[0356]
In this configuration, the configuration other than the multimedia information recording processing unit 598 that generates a dot code for a text edited on a text is a general word processor configuration. That is, a bus 602 from the CPU 600 includes various ROMs 604 such as programs and character generators, a RAM 606 as a work area, a calendar 608, a bus control 610, a CRT control 616 for displaying data developed on a video RAM 612 on a CRT 614, and a keyboard 618. An I / O control 620, a disk control 624 for controlling the FDD 622, a printer control 628 for controlling the printer 626, various I / Fs 630 and the like are hanging.
[0357]
The multimedia information recording processing unit 598 can access the bus 602 exclusively, and has basically the same contents as the multimedia information recording device 570 in FIG. That is, the data supplied by the bus 602 via the bidirectional I / O 632 is separated into a character, a graph and a picture by the separation circuit 634, compressed appropriately by the compression circuits 636 and 638, and synthesized by the synthesis circuit 640. I do. On the other hand, layout information of characters, pictures, and graphs is directly input to the synthesis circuit 640. An error correction code is added to this combined data by an error correction code addition circuit 642, processing such as interleaving is performed on a memory 644, and a block address is added by an address addition circuit 646, and then the modulation circuit is added. At 648, modulation is applied. Thereafter, a marker is added by the marker adding circuit 650, a title of a dot code is synthesized by the editing and synthesizing circuit 652, and the size of the dot pattern is changed by the dot pattern shape conversion circuit 654, and the marker is added in both directions. Return it to bus 602 via I / O 632.
[0358]
Then, in accordance with the data returned to the bus 602, the printer control 628 controls the printer 626 to obtain a printout indicated by reference numeral 656 in the drawing.
[0359]
As shown in the figure, the basic printout 656 includes a sentence 658 written (input) on a word processor, and a picture 660 and a graph 662 added thereto, and the contents of the sentence 658, the picture 660, and the graph 662 are added. It is printed with a dot code 664 at a predetermined position, for example, below.
[0360]
By adopting such a printout 656, the user who has received the printout 656 directly or by facsimile reads the dot code 664 with the pen-type information reproducing apparatus as described above, thereby obtaining the corresponding document 658, 658. The picture 660 and the graph 662 can be taken into the word processor of the user, and there is a merit that they can be arbitrarily edited.
[0361]
The multimedia information recording processing unit 598 may be realized by software processing by the CPU 600.
[0362]
Further, the multimedia information recording processing unit 598 may be built in the printer 626 instead of being mounted on a word processor as described above. That is, when the printer 626 receives font or graph information or the like, a process may be performed in which such recording modulation is applied thereto and printing is performed. In that case, the printer may be supplied in the form of a card-type adapter without being built in the printer 626.
[0363]
The dot pattern shape conversion circuit 654 in the multimedia information recording processing unit 598 converts the print content by fax in addition to the conversion according to the resolution of the printer 626. Since the definition is determined as GII or GIII, a process of converting the resolution into a form adaptable to that resolution, that is, changing the size may be performed.
[0364]
FIG. 58 shows that the function of the multimedia information recording processing unit is built in the optical copier 666, and when a document is copied, the contents are copied onto a sheet and a dot code corresponding to the contents is printed at a predetermined position on the sheet. FIG. 3 is a diagram showing a configuration in a case where the operation is performed.
[0365]
That is, similarly to a normal copying machine, the document copying machine has a document table 668, an illumination 670, a mirror 672, a lens 672, a photosensitive drum 676, and the like, and copies an image on a document onto paper.
[0366]
In addition to this, the optical copier 666 of the present embodiment inserts a half prism 678 in front of the lens 674 in the optical path to split light, and transmits the light to the image sensor 682 such as a line sensor via the optical component 680. Lead. The signal from the image sensor 682 is amplified by an amplifier 684 and subjected to various analog processing, and then is converted to a digital signal by an A / D converter 686 and recorded in a memory 688. An image area determination and data character recognition circuit 690 performs image area determination and data character recognition on the data recorded in the memory 688. Here, for the image area determination, a method described in Japanese Patent Application No. 5-163635 by the present applicant can be used.
[0367]
Then, the data on which the image area determination, the data character recognition, and the like have been performed are compressed by the compression circuit 692. In this case, since the compression method differs depending on the type of character, picture, graph, etc., compression corresponding to each is performed, and then the data synthesis circuit 694 synthesizes the data including the layout information. Then, an error correction code is added to the combined data by an error correction code adding circuit 696, the data is stored in a memory 698, and processing such as interleaving is performed again, and an address is added by an address adding circuit 700. Then, modulation is performed by the modulation circuit 702. After that, a marker is added by the marker adding circuit 704 and the dot pattern shape is converted by the dot pattern shape converting circuit 706. Then, according to the dot pattern, the light emitting element driver 708 causes the light emitting element 710 to emit light, and the mirror shutter 712 is activated to guide the light from the light emitting element 710 to the lens 674 and the photosensitive drum 676.
[0368]
Further, as described above, when outputting to a facsimile or the like, the facsimile resolution selection unit 714 selects the facsimile resolution, and the dot pattern shape conversion circuit 706 changes the dot code pattern shape accordingly.
[0369]
Further, the image area determination and data character recognition circuit 690 may treat the character as a binary image and perform general binary image compression processing such as MR or MH, or a character. After recognizing and converting to codes used in ordinary word processors such as ASCII codes, compression may be performed by a compression method such as jibrempel. As described above, if the character recognition is performed and the ASCII code is converted and further compressed, the compression rate is considerably increased and a large amount of data can be recorded with a small dot code.
[0370]
The dot code is printed by writing a document image onto the photosensitive drum 676 once and exposing it to light, then setting the mirror shutter 712 and rewriting the image by the light emitting element 710 again on the drum due to the processing speed of the signal processing system. Printing. Alternatively, a dot code may be generated in the first document scan in the form of prescan, and the document image and the dot code may be written on the photosensitive drum 676 in the second document scan. If the processing speed of the signal processing system is improved in the future, the processing divided into a plurality of times may not be necessary. However, if the original is placed horizontally on the platen 668 or upside down, it is necessary to obtain a copy result in which a dot code is printed at the lower portion of the paper in the vertical direction as indicated by reference numeral 656. Also requires processing divided into multiple times.
[0371]
FIG. 59 shows a configuration when applied to a digital copying machine 716. 58, those having the same functions as in FIG. 58 are given the same numbers as in FIG. In addition, in the input portion, although it is described as if the optical mirror is moved, the original may be read by moving the line sensor.
[0372]
That is, in the digital copying machine 716, the edit / combination circuit 718 combines the dot code whose shape has been changed by the dot pattern shape conversion circuit 706 and the data of the original image fetched into the memory 688 as described above. It is printed out by the printer 720. Such a digital copying machine has the memory 688 without performing the processing divided into a plurality of times as described above, so that the dot code can be printed at any position on the paper by one scan. .
[0373]
Next, the flow of the broken line in the figure will be described. This is the opposite of reading the original image and dropping it into a dot code as described above, but reading only the dot code from the original with the dot code printed along with the text and picture and reproducing from the dot code This is the flow of contents such as printing out a document in which the written text or picture and the dot code are combined.
[0374]
That is, similarly, the dot code is read from the document by the image sensor 682, A / D converted, and recorded in the memory 688. The output of the A / D converter 686 is also input to the dot code reproducer 722. The dot code reproducer 722 includes, for example, a circuit configuration after the scan conversion unit 186 in FIG. 15, and can reproduce a sentence, a picture, and a graph from the dot code. The image of the dot code stored in the memory 688 is provided to the dot pattern shape conversion circuit 706 in the state of the dot code, and after being changed in size, is input to the edit / synthesis circuit 718. The edit / synthesis circuit 718 adds the dot code from the dot pattern shape conversion circuit 706 to the text, picture, graph, or the like reproduced by the dot code reproducer 722, inputs the result to the printer 720, and prints out.
[0375]
In this case, the time required to scan the document is only the time required to read the dot code portion, so that the time can be reduced. Furthermore, when texts, pictures, graphs, and the like are enlarged or reduced, the size of the dot code can be printed without change regardless of the enlargement or reduction.
[0376]
Next, FIG. 60 shows an example in which the pen-type information reproducing apparatus is used also as an input unit for character and picture data.
[0377]
That is, a signal from the image processing unit 460 of the pen-type information reproducing device is input to the multimedia information recording device 724. In the multimedia information recording device 724, the input, that is, the imaged data is input to the frame memory 728A or 728B via the selector 726. In this case, the selector 726 selects so that one screen is first taken into the frame memory 728A, and then the next one screen is taken into the frame memory 728B. Then, the image data taken into the frame memories 728A and 728B are subjected to lens distortion such as peripheral aberrations by distortion correction circuits 730A and 730B, respectively, and then input to a displacement detector 732. The shift amount detector 732 determines the correlation between the images captured in the frame memory 728A and the image captured in the frame memory 728B such that when the images captured in the frame memory 728B are combined in the subsequent stage, the overlapping portion of the two images overlaps as a picture. To calculate the direction and the amount of shift. As the shift amount detector 732, for example, those described in Japanese Patent Application Nos. 5-63978 and 5-42402 by the present applicant can be used. Then, one image, for example, the image captured in the frame memory 728B, is interpolated by the interpolation arithmetic circuit 734 according to the detected shift amount, and is enhanced by the enhancer 736. The image is combined with the image captured in the frame memory 728 </ b> A, and the result is stored in the image combining memory 740.
[0378]
Then, the next one screen is fetched into the frame memory 728A, and the same processing as described above is performed. This time, the image fetched into the frame memory 728A is interpolated.
[0379]
Thereafter, by repeating this alternately, the screen can be enlarged.
[0380]
That is, the pen-type information reproducing apparatus is originally intended to read a fine code called a dot code, and therefore has a very small imaging area. In order to use such a small imaging area as a scanner for taking in a character or picture image, it is necessary to take in the image in a plurality of times and attach them. Therefore, in the present embodiment, a plurality of frame memories are provided, the amount of displacement is detected, the displacement is corrected, and the images are pasted.
[0381]
The data recorded in the composite image memory 740 is subjected to image area determination and the like by an image area determination circuit 742, and is subjected to character recognition by a character recognition circuit 744 if it is a character. This is input to the multimedia information recording processing unit 598 as described above. Then, the multimedia information recording processing unit 598 performs a process such as compression and the like, converts the dot code into a dot code, and is guided to the reel seal printer 572 as described above. Alternatively, instead of inputting to the multimedia information recording processing unit 598, the input can also be input to an external device 532 such as a personal computer or a word processor via the I / F 746.
[0382]
In the pen-type information reproducing apparatus, an earphone terminal and two terminals for outputting an image may be provided as output terminals, or a system for manually outputting sound with one connector may be provided. And a system for outputting an image.
[0383]
FIG. 61 is a modification of FIG. FIG. 60 illustrates the case where the area of the imaging unit 204 when reading the dot code is the same as the imaging area when using as a scanner. In the case of this embodiment, the wide-angle is used when using as a scanner. When reading a dot code, the imaging optical system 200 is changed so as to perform macroscopic imaging.
[0384]
That is, the imaging optical system 200 is configured by a zoom or bifocal lens group used in a normal camera, and slides a lens barrel 748 to switch between a wide angle and a macro. A scanner switch 750 is provided so that the contact is closed and turned on when the lens barrel 748 is contracted. When the scanner switch 750 is turned on, the operation of the data processing unit 462 and the data output unit 464 is assumed to be used as a scanner. The control unit 212 is caused to perform a process of stopping the operation and operating them in order to perform a macro operation when it is off.
[0385]
When the imaging optical system 200 is set to the wide-angle side, the imaging area becomes large. Assuming that the focal depth at that time is ± 120 μ and the imaging magnification is 0.08, the depth of field is ± 19 mm. Even if there is a vertical camera shake, there is no problem if there is enough depth.
[0386]
In addition to sliding the lens barrel 748 in order to change between wide-angle and macro, the lens itself may be replaced, that is, a wide-angle lens may be used to mount a macro lens. It can be implemented similarly.
[0387]
FIG. 62 is a view for showing information corresponding to the dot code to an external device 532 such as a personal computer or a word processor when the dot code is read into the card type adapter 524 by the pen type information reproducing apparatus as shown in FIG. And a data processing unit for combining images and generating dot codes when a pen-type information reproducing apparatus as shown in FIG. 60 is used as a scanner for text and picture images. 2 shows an example in which the data processing unit is incorporated. That is, a card type adapter 524 having two built-in units, a data processing unit for a scanner and a data processing unit for reading a dot code, is shown.
[0388]
61, selectors 752 and 754 switch between a data processing unit for a scanner and a data processing unit for reading a dot code. The switching selection may be a manual operation, or FIG. May be linked with the on / off of the scanner switch 750 as shown in the above, or may be driven directly from the external device 532 side.
[0389]
The image synthesis processing circuit 756 includes a selector 726, frame memories 728A and 728B, distortion correction circuits 730A and 730B, a shift amount detector 732, an interpolation operation circuit 734, an enhancer 736, and an image synthesis circuit 738 as shown in FIG. The output processing circuit 758 is for adjusting the data to be output to the format of the external device 532.
[0390]
Next, an embodiment of outputting the read dot code information to the electronic projector will be described. That is, as shown in FIGS. 63 (A) and (B), the dot code is scanned by the pen-type information reproducing device 760, and the original information is returned by the output processing unit 762, and the RGB input terminal of the projector 764 or the electronic This is input to the video input terminal of the OHP 766 and projected on the screen 768.
[0391]
In this case, the pen-type information reproducing device 760 has a built-in configuration from the detection unit 184 to the data error correction unit 194 in the configuration of the reproduction system shown in FIG. 15 or FIG. The processing unit 762 includes a configuration after the data separation unit 196 and other processing circuits.
[0392]
The actual configuration of the output processing unit 762 is as shown in FIG. That is, the multimedia information from the pen-type information reproducing device 760 is separated into image, graph, character, audio, and header information by the separation unit 196, and the image, graph, and character are expanded by the expansion processing units 238, 242, and 248. After that, the image and graph are subjected to interpolation processing by the data interpolation circuits 240 and 244, and the PDL processing unit 246 performs PDL processing to characters. Then, the interpolated or PDL-processed image, graph, and character are combined by the combining circuit 250 and stored in the memory 770. The data stored in the memory 770 is data that can be projected onto the screen 768, and is thus D / A converted by the D / A converter 252 and output to the projector 764 and the electronic OHP 766. In this case, the memory 770 is controlled by the address control unit 772. On the other hand, the voice is directly decompressed by the decompression processing unit 256, interpolated by the data interpolation circuit 258, D / A converted by the D / A conversion unit 266, and built into the projector 764 and the electronic OHP 766 via the selector 774. Or output to an external speaker 776.
[0393]
Further, the speech synthesis coded data is converted into speech by the speech synthesis unit 260 and input to the D / A conversion unit 266.
[0394]
Further, for example, when a sentence can be read as needed during a presentation, the sentence recognition unit 271 recognizes the sentence from the character code for display as a sentence, converts the sentence to a speech by the speech synthesis unit 260, Finally, a sound is output from the speaker 776.
[0395]
In this case, there is no need to separately record the speech synthesis code for reading, so that more information can be stored in the dot code.
[0396]
In this case, a projector selecting means 778 is provided so as to be connectable with any electronic projector system. For example, the projector 764 is compatible with Hi-Vision, or is compatible only with NTSC. You can choose something like that. In other words, processing such as how to allocate characters on the memory 770 changes depending on the electronic projector system as an output system. Therefore, the processing in the data interpolation circuits 240 and 244 and the PDL processing unit 246 is changed according to the selection by the projector selection unit 778, or the clock supplied to the address control unit 772 and the D / A conversion unit 252. The signal CK is changed by the reference clock selection unit 780.
[0397]
In the use situation of an electronic projector such as the projector 764 and the electronic OHP 766, for example, as shown in FIG. There is a case where a user wants to perform selective projection such as wanting to project only a graph. In such a case, the output control unit 782 allows the user to select, or the dot code, such as projecting by text, projecting only a picture, projecting only a graph, or the like. Is written as header information, and the output control unit 782 can select a portion to be output according to the header information. Then, according to the selection in the output control section 782, the output editor section 784 performs a work of separating which part is to be projected, and causes the address control section 772 to access that part of the memory 770 to output projection data. Let it. In addition to the area division processing, the output editor unit 784 performs electronic zoom processing, that is, first projects the entire original, and then enlarges only a part of the text or the picture. It is also possible to perform processing and, at that time, edit processing in the form of focusing and enlarging only a part of a sentence or a part of a picture. When such processing is performed, an input section and a display section are provided in the output processing section 762, and processing such as a graphical user interface is performed so that an enlarged portion can be actually specified. preferable.
[0398]
In addition, the selector 774 can select not only the sound input from the D / A converter 266 and the sound output from the D / A converter 266, but also the sound from the external microphone 786.
[0399]
Note that the pen-type information reproducing apparatus 760 may include only the detecting unit 184, and the components from the scan converting unit 186 may be included in the output processing unit 762, or conversely, the pen-type information reproducing apparatus may include the separating unit 196. 760 may be provided so that the separated data is sent to the output processing unit 762 in some form. Actually, considering that the pen-type information reproducing device 760 is held by hand, it is preferable to make the pen-type information reproducing device 760 as small as possible. Therefore, it is assumed that only the detecting unit 184 is provided and the subsequent processing is performed by the output processing unit 762. Is preferred.
[0400]
FIG. 65 (A) shows a case where an image is output to a copying machine 788, a magneto-optical disk drive (MO) 790, and a printer 792 instead of the above-mentioned electronic projector. This shows a situation where the output of the output processing unit is supplied to the copier 788, the MO 790, and the printer 792 on an on-line basis or off-line via a floppy 796 or the like. FIG. 7B shows a case where the output processing unit is configured as a card type adapter 800 to be attached to the printer 792 or the electronic organizer 798.
[0401]
The actual configuration of the output processing unit 762 in this case is as shown in FIG.
[0402]
As in the previous embodiment of the projector, the multimedia information is input, the image, the graph, and the character are separated by the separation unit 196, and the images, graphs, and characters are expanded by the expansion processing units 238, 242, and 248, respectively. Graphs are interpolated by the data interpolation circuits 240 and 244, and characters are subjected to PDL processing by the PDL processing unit 246, and are synthesized by the synthesizing circuit 250 and stored in the memory 770. The memory 770 is controlled by the address control unit 772, and the read data is output to the edit monitor 804 via the interpolation unit 802 and the D / A conversion unit 252 to check the data actually output. Note that the editing monitor 804 may not be provided.
[0403]
The data read from memory 770 is also input to synthesis section 806. The synthesizing unit 806 converts the multimedia information from the pen-type information reproducing device 760 into a dot code again by the coding unit 808 and outputs the dot code by the output adaptive interpolation unit 810 according to the resolution of the printer 792 or the like to be output. The interpolation is performed, and the data is combined with the data from the memory 770. In other words, a dot code is added to a text or a picture, and output to the printer 792 or the copying machine 788 via the I / F 812.
[0404]
The output selection means 814 automatically sets the resolution if the printer 792 is connected to the output unit 762 and the model is known when the printer 792 is connected to the printer. Since the model is not known in the case of sending by, the manual switching is performed in such a case.
[0405]
In such a configuration, text and the like are copied or printed as they are, and the dot code can be output in accordance with the resolution of the output medium.
[0406]
In addition, when connecting to the electronic organizer 798, a dot code is not input, so that a system for recording the dot code becomes unnecessary. The configuration is almost the same as FIG.
[0407]
FIG. 67 shows an embodiment in which a format conversion unit 816 for converting the data format of each word processor into a format for each model is provided in order to cope with the fact that the data format of each word processor differs at present. The format conversion unit 816 has a word processor select switch as a model selection unit 818, reads the dot code by the pen-type information reproducing device 760, converts the data based on the selection, and inputs the data to the word processor 820.
[0408]
The format conversion unit 816 is actually configured as shown in FIG. That is, after being processed by the data interpolation circuits 240, 244, 258, the PDL processing section 246, and the voice synthesis section 260, the respective data are converted by the corresponding format conversion circuits 822, 824, 826, 828 by the model selection means 818. It is configured to convert the format according to the selection.
[0409]
FIG. 69 is a system diagram when a sheet on which dot codes are recorded (hereinafter, referred to as multimedia paper) is transmitted and received by facsimile. In this case, the dot code created by the facsimile multimedia information recording device 830 is printed out by the printer 792 and transmitted from the transmitting facsimile 832 to the receiving facsimile 834 via the telephone line 836. The receiving FAX 834 receives this, returns the information to paper information, and then reproduces the dot code using the pen-type information reproducing device 838.
[0410]
As shown in FIG. 70, the FAX multimedia information recording device 830 includes a multimedia information recording device 840, a dot pattern shape conversion circuit 842, a FAX selection unit 844, and a synthesis editing circuit 846. The multimedia information recording device 840 includes a configuration up to the marker adding unit 162 in the configuration of the recording system in FIG. 13, and the synthesizing and editing circuit 846 corresponds to the synthesizing and editing processing unit 164. The dot pattern shape conversion circuit 842 and the FAX selection unit 844 correspond to the dot pattern shape conversion circuit 706 and the FAX resolution selection unit 714 in FIGS.
[0411]
In this case, when a line is connected from the transmission-side FAX 832 to the reception-side FAX 834 via the telephone line 836, the status of the incoming call is returned from the reception-side FAX 834 to the transmission-side FAX 832. The dot pattern shape conversion circuit 842 selects the resolution of the facsimile, that is, the resolution of the facsimile, and changes the shape itself according to the size of the dot code pattern or the amount of data that can be written in one line. And prints out by the printer 792, thereby printing the multimedia paper to be transmitted by facsimile.
[0412]
FIG. 71 shows a facsimile built-in multimedia information recorder 848 in which all such processes are automated and the facsimile transmission / reception means is provided to the recorder from the beginning.
[0413]
In this case, the resolution information of the other party's FAX is confirmed when it is connected via the telephone line 836, the shape of the dot pattern is optimized using the information, and the information is combined with the paper surface information and transmitted.
[0414]
FIG. 72 (A) shows an overwrite type MMP card for recording and reproducing a card (hereinafter, referred to as a multimedia paper (MMP) card) on which dot codes are printed as shown in FIGS. 72 (B) and (C). FIG. 3 is a diagram illustrating a configuration of a recording / reproducing device.
[0415]
The recording / reproducing device 850 transports the MMP card 852 inserted in the card insertion slit (not shown) to the dot code detection unit 856 by the card transport roller unit 854, and reads the dot code already written on the back surface of the MMP card 852. The data is read and converted into the original multimedia information by the data code reproducing unit 858 and output to an I / F (not shown) or a data separating unit. That is, the dot code detection unit 856 corresponds to the detection unit 184 in the configuration as shown in FIG. 15 or (D) of FIG. 20, and the data code reproduction unit 858 also includes the scan conversion unit 186 and the data error correction unit. It has a circuit configuration up to 194. However, the dot code detection unit 856 is provided with imaging units on both sides of the card, and the one on the back surface of the card is used as the imaging unit 204 of the detection unit 184. Also, here, the MMP card 852 has a dot code recording area 852A on the back side of the card as shown in FIG. 72B, and the title, name, picture, etc. on the front side as shown in FIG. 72C. Shall be recorded.
[0416]
The recording / reproducing device 850 is supplied with information other than the information already written on the card via an I / F 860 from an external personal computer, a storage device, or the like. The information is supplied to the data synthesizing / editing unit 862 and is synthesized with the information reproduced by the data code reproducing unit 862. For example, when new information that does not exist in the conventional data is input from the I / F 860, for example, the address is changed to the next address. In the case where addresses are newly added or partially changed, the data is synthesized and edited in such a manner that only the part to be changed is replaced. The information thus synthesized and edited is input to the code pattern generation unit 864, and is converted into a dot code. The code pattern generation unit 864 has a configuration as shown in FIG. 13 and combines and edits the generated dot code with data to be printed other than the code from the I / F 860, and prints it on the printing unit 866. Pass the data to be. The printing unit 866 is also supplied with the picture data on the surface of the MMP card 852 from the dot code detection unit 856, and prints on both the front and back sides of the unprinted card fed from the paper feed cartridge 868 to print new data. The MMP card is conveyed to a card ejection slot (not shown) by the card conveying roller unit 870 and ejected. Note that the double-sided printing in the printing unit 866 may be a format in which after printing on one side of the card is completed, the card is reversed and printing on the other side is performed, or a format in which printing is performed on both sides simultaneously. .
[0417]
On the other hand, the old card passes through the dot code detection unit 856, and then, for example, is applied with black filling ink by the subsequent filling application roller 872, so that the code recording area 852A is painted black. Is discharged. As a result, the user can return the original card that has been filled, so that there is no danger that the old card will be misused.
[0418]
As described above, according to the overwrite-type MMP card recording / reproducing device 850 of the present embodiment, when a card that has already been recorded to some extent is inserted into the recording / reproducing device 850, the information is read and a new A new card is issued in combination with the information to be added to the old card. From the viewpoint of the user, it looks as if the card has come out as if the data was added to the old card. Then, since the old card still remains, the old card is returned to the user. Therefore, in the form of card exchange, it is made as if it were overwritten.
[0419]
FIG. 73 is a diagram showing another configuration of the overwrite-type MMP card recording / playback device. This recording / reproducing device 874 is basically the same as the recording / reproducing device 850 of FIG. 72A, but is a device for an application that does not require returning an old card to the user. Therefore, in the recording / reproducing device 874, a shredder 876 for cutting an old card is provided at the subsequent stage of the dot code detecting unit 856.
[0420]
FIG. 74 is a diagram showing still another configuration of the overwrite-type MMP card recording / reproducing apparatus. In the case of the recording / reproducing device 878, the configuration of the MMP card is different from that of the MMP card 852. That is, although the MMP card 852 described above was directly printed especially on the base of the card itself, the MMP card 880 of the present embodiment, as shown in FIG. A very thin code pattern recording thin paper (film) 884 having a dot code recorded thereon is attached to a card base 882. That is, a thin film-like sheet printed as shown in FIG. 3C is attached to the back surface of the card.
[0421]
In the recording / reproducing device 878 using such an MMP card 880, the data read by the dot code detection unit 856 is combined with data coming from a personal computer or the like in the same manner as before, and enters the printing unit 866 as a code pattern. . At this time, instead of printing on the back side of the card, the printing unit 866 prints the code pattern recording paper 888 from the paper feed cartridge 886 and newly attaches it to the card base 882. In this case, the code pattern recording paper 888 has, for example, an adhesive such as an adhesive on the side other than the printing surface 890 of the code pattern recording thin paper 884 that is actually printed, as shown in FIG. An adhesive surface 892 is provided, and a protective paper 894 for the adhesive surface 892 is provided thereon. Then, after printing, the pressure-sensitive adhesive surface protection paper 894 is peeled off by the pressure-sensitive adhesive surface protection paper peeling bar 896 and wound up on a used pressure-sensitive adhesive surface protection paper take-up reel 898. The code surface recording thin paper 884 from which the adhesive surface protection paper 894 has been peeled off has the adhesive surface 892 exposed, and is pressed and attached to the card base 882 by the card transport and code pattern recording thin paper pressing roller unit 900 to form a recorded card. to go out.
[0422]
In this case, since the code pattern recording thin paper 884 is a very thin film, it may be laminated and pasted on the card base 882. Therefore, an old code pattern recording thin paper peeling unit 902 is provided in the middle of the card transport path from the dot code detection unit 856 to the pressing roller unit 900 to peel the old code pattern recording thin paper. The stripped old code pattern recording thin paper may be discharged as it is or may be shredded.
[0423]
Note that the additional information adding unit 904 in FIG. 7A is, for example, information indicating the time relationship when the original card was recorded by the recording / reproducing device 878, or the recording / reproducing device 878 This is for adding information such as which terminal is used when the terminal is used as a terminal connected to. This makes it possible to know which recording / reproducing device 878 was used and how many blanks were recorded.
[0424]
FIG. 75 is a diagram showing still another configuration of the overwrite type MMP card recording / reproducing apparatus. This recording / reproducing apparatus 906 is basically the same as the recording / reproducing apparatus 850 shown in FIG. 72A, in which instead of being painted black, it is painted white, and it is made a new printing surface again. is there. For this reason, the ink cartridge 908 for filling in white and the ink application roller 910 for filling in white are arranged downstream of the dot code detection unit 856.
[0425]
As a result, the back side of the MMP card once becomes white, and the printing unit 866 newly prints on the back side. Although a new card may be issued, a paper feed cartridge 868 is provided, but this may not be provided.
[0426]
Next, a write-once MMP card recording / reproducing apparatus will be described. In the write-once type, old information is left as it is, and only new information is added to an unrecorded area as long as there is still an unrecorded area. In this case, it is not necessary to perform all of the dot code reproduction processing as in the above-described overwrite type apparatus, except when the purpose of card data reproduction is the purpose, that is, during recording.
[0427]
FIG. 76A is a diagram showing the configuration of a write-once MMP card recording / reproducing device 912. At the time of recording, the data code reproducing unit 858 reproduces only the marker information and the address information of the two-dimensional block, and the code pattern generating unit 864 generates the block address of the additionally recorded portion to create the additionally recorded dot code pattern. The recorded area detection unit 914 detects a recorded area of the card. Then, the printing unit 866 prints the pattern from the code pattern generation unit 864 on the unrecorded area (recordable area) of the card based on the information from the recorded area detection unit 914.
[0428]
The recorded area detection unit 914 includes a recording area detection unit 916, a marker detection unit 918, a rearmost marker coordinate calculation unit 920, and an additional writing start coordinate output unit 922, as shown in FIG. . That is, since the sizes of the marker and the block are known, the recording area detection unit 916 and the marker detection unit 918 can automatically detect how far the code recording area is written. Therefore, the coordinates of the start of additional writing are calculated by the rearmost marker coordinate calculating unit 920 and output from the additional writing start coordinate output unit 922.
[0429]
The recorded area detection section 914 may be configured as shown in FIG. In this case, however, it is necessary to record a recorded mark 924 indicating the extent of the recording in the margin of the card as shown in FIG.
[0430]
In the recorded area detecting section 914, the recorded mark is detected by the recorded mark detecting section 926, and how far is written is calculated by the last recorded mark coordinate calculating section 928, and the starting coordinates of the additional recording are calculated. Is output from the additional writing start coordinate output unit 922. In other words, even if it is not possible to see the marker of the fine dot code, it is easy to detect by detecting the larger recorded mark 924.
[0431]
Note that the recorded mark 924 can also be used for alignment in the printing unit 866. That is, in the above example, the dot code had to be read again for the alignment in the printing unit 866, but when the recorded mark 924 was used, the processing was performed only with the mark 924. it can. That is, by detecting the recorded mark 924, recording may be performed at a distance of, for example, about 1 mm between the recorded area and the additional recording portion, or about 1 mm in the vertical direction in the direction shown in FIG. Since it is OK to record with a shift, it is very easy to additionally record. However, if the block address of the recorded block is read depending on the added content, the block address of the portion to be added has continuity as one code by adding the block address next to the last block address. Can be made.
[0432]
FIG. 78A shows a business card card reading system as one application example using the above-described overwrite type or write-once type MMP card. In this system, an MMP business card card 930 in which multimedia information is described in dot code is read by an MMP business card card reader 932, an image is displayed on a CRT 936 of a personal computer or the like 934, and sound is generated from a speaker 938. The MMP business card card reader 932 is the same as the information reproducing apparatus described above, particularly in the configuration. The MMP business card card reader 932 is configured to be a stationary type rather than a pen type because it simply reads a business card card. Of course, as described above, the information may be provided in the form of a pen-type information reproducing apparatus and a card-type adapter, and may be displayed and reproduced in an electronic organizer or the like.
[0433]
The MMP business card card 930 is formed by printing a dot code on the back side of the card with the company name, affiliation, name, address, and telephone number on the front side, like the overwrite type or write-once type MMP card described above. Alternatively, in the case of a business card in which the back side is also written in English, the dot code is stealth-printed using an infrared-emitting ink or a fluorescent ink as described above, as shown in FIG. 940 may be used.
[0434]
Next, an MMP card formed by a semiconductor wafer etching method will be described. In this method, a very fine dot pattern is recorded on a semiconductor wafer by using a semiconductor etching technique. The reflectance of light differs between the mirror-finished wafer surface and the etched pattern portion, and the dot code can be read with the contrast. Here, in order to further increase the contrast and improve the S / N, aluminum or another member having a significantly different reflectance or color may be embedded in the etched dot code pattern.
[0435]
FIGS. 79 (A) and (B) and FIGS. 80 (A) to (C) show the configuration, in which a wafer portion 942 on which a dot code pattern is recorded is embedded in a base 946 of a card body 944. It is. In this case, since the dot code pattern is recorded with a dot size of several μm or a sub μm level, extremely high-density recording can be performed. Thus, for example, a gigabyte-unit ROM card can be obtained.
[0436]
Further, unlike the ROM-IC, it is not necessary to operate normally electrically, so even if a part of the pattern is defective, the pattern can be corrected by the error correction processing in the reproducing device. Because the number of processes is much smaller than that of an IC, there is an advantage that the supply can be performed at very low cost.
[0437]
However, since the pitch is extremely fine, attention must be paid to dirt such as small dust and fingerprints. To protect it, for example, as shown in FIGS. 79A and 79B, a plurality of slide-type protective covers 948 are attached to the surface of the wafer portion 942 of the card 944, or as shown in FIG. A single protective shutter 950 as shown in FIGS.
[0438]
In this case, the protective cover 948 is made up of, for example, four sheets, and it is possible to select several kinds of opening methods such as opening only necessary portions or opening a sliding door. You may open it.
[0439]
On the other hand, in the case of the protective shutter 950, it is configured such that it opens completely when a card is inserted, and closes when the card is removed. For example, as shown in FIGS. 80 (B) and (C), the wafer portion 942 is dropped into the card base 946, and the grooves 952 are cut on both sides of the card base 946, respectively. A protective shutter 950 is inserted in such a manner as to sandwich it. A stopper 956 is provided at the tip of the claw portion 954 on the side surface of the protective shutter 950, and the receiving card base 946 stops when the stopper 956 reaches the predetermined position so that the protective shutter 950 does not open beyond the predetermined position. Therefore, the depth of the groove 952 is shallow.
[0440]
When reproducing a dot code from an MMP card formed by such a semiconductor wafer etching method, a pen-type information reproducing apparatus as described above may be used, but at that time, the imaging optical system needs to be a microscope level. is there. Or you may make it the structure which does not move mechanically in the form of a line sensor.
[0441]
FIG. 81A shows a disk device 958 with a dot code decoding function, that is, a known disk device for recording and reproducing audio information such as music on a magneto-optical disk. Is attached. This is done by, for example, scanning a dot code on a sheet 960 as shown in FIG. 18B by the operation unit 962 to reproduce the code, and outputting the code to an information device 964 such as a personal computer or an electronic notebook or an earphone 966. Is what you do.
[0442]
As shown in FIG. 82, the disk device 958 has a spindle motor 968, an optical pickup 970, a feed motor 972, a head drive circuit 974, an address decoder 976, an RF amplifier 978, a servo control circuit 980, an EFM (Eight) as a known configuration. to Fourteen Modulation), ACIRC (Advanced Cross Interleave Read Solo Code) circuit 982, seismic memory controller 984, memory 986, display unit 988, key operation panel 990, system controller 992, compression / decompression unit 994, A / D converter 996 , An audio input terminal 998, a D / A converter 1000, and an audio output terminal 1002.
[0443]
Here, the EFM and ACIRC circuit 982 is a part that performs encoding and decoding at the time of writing and reading of the disk. The seismic memory controller 984 is for interpolating data using the memory 986 in order to prevent sound skipping due to vibration. The compression / decompression processing unit 994 performs compression / decompression processing using an audio efficient coding scheme called ATRAC (Adaptive Transform Acoustic Coding), which is a type of transform coding scheme that performs coding by converting from the time axis to the frequency axis. Do.
[0444]
The disk device 958 with the dot code decoding function receives the image signal from the operation unit 962 and performs processing such as the image processing unit 460 in FIG. 41B on such a conventional disk device. A connection terminal 1006 for the image processing unit 1004 and the information device 964 and an I / F 1008 thereof are provided. Since the compression / decompression processing unit 994 is constituted by an ASIC-DSP or the like, the dot code reproduction is performed there. It also includes functions of the data processing unit 462 such as demodulation and error correction for data, and processing for data compression and decompression for the information device 1008.
[0445]
The operation unit 962 includes, for example, the imaging optical system 200, the imaging unit 204, the optical system 1010 corresponding to the preamplifier 206, the imaging element 1012, the amplifier 1014, and the like in FIG.
[0446]
In an information reproducing apparatus that reproduces dot codes, reproduction of high-capacity information such as music usually requires a large-capacity memory. The capacity of the memory can be eliminated. In addition, a sound reproduction part, here, a sound compression / decompression processing unit 994, a D / A converter 1000, and the like can be commonly used, and a sound compression / decompression unit 994 is commonly used as a data processing part for code reproduction processing. By designing with an ASIC-DSP, cost reduction and size reduction can be achieved.
[0447]
The disk device 958 with the dot code decoding function having such a configuration can use functions such as sound recording and reproduction as a normal disk device, music selection, and the like, and can also be used as a dot code reproducing device. This switching is controlled by the system controller 992 by operating the key operation panel 990.
[0448]
When used as a dot code reproducing device, for example, the following usage is assumed. That is, as shown in FIG. 81 (B), a song selection index including a song name and a singer name is described in characters on a sheet 960 of A4, and a dot code corresponding to the song is recorded. In this case, since the music is information on the order of, for example, 3 minutes and 4 minutes, it becomes considerably long. Therefore, the dot code is divided into a plurality of rows, and in FIG. In other words, each music piece is divided into a plurality of rows of dot codes, and a block having a block address of, for example, an X address of 1 and a Y address of 1 is included in the dot code of each row as described above. Is recorded on a sheet with an address indicating the divided position in the music. At the time of reproduction, all of the dot codes in the plurality of stages are scanned and recorded on the disk 1016.
[0449]
At this time, even if the scanning order is randomly performed, the music can be written by considering the recording position of the disk 1016 by the address indicating the position in the music, that is, recorded in the correct order. For example, as shown in the figure, when one piece of music is divided into four rows of dot codes, even if the dot code of the second row is first scanned by the operation unit 962, the dot code of what number, that is, the second dot Since it is known from the address whether the code is a code, open the recording portion of the first dot code so that when the audio information reproduced from the dot code is recorded on the disk 1016, it is reproduced in the correct order at the time of reproduction. can do.
[0450]
In addition, for example, a user creates an original disc by recording music A and music C and then recording music D, and another audio player, such as a tape deck or a CD player, is used. You can do without it. For example, the user looks at the song selection index of dot codes of a plurality of music pieces recorded on the sheet 960 and scans the dot codes in the order of reproduction at the time of reproduction, so that, for example, the music pieces A, C, D,. , And if it is played back normally, it will be played back in that order. That is, programming can be performed.
[0451]
Note that an image output device can be used as the information device 964. For example, using the FMD, the compression / decompression processing unit 994 performs, for example, JPEG, MPEG, and three-dimensional image decompression processing as described in Japanese Patent Application No. 4-81673, and converts it into a video signal by the I / F 1008. By doing so, a three-dimensional image corresponding to the read dot code can be displayed. Thus, the present embodiment is not limited to audio information.
[0452]
Similarly, it is needless to say that the present invention can be applied to other digital recording / reproducing apparatuses such as a DAT.
[0453]
Next, an example in which the dot code recording function is incorporated in a silver halide camera will be described.
[0454]
FIGS. 83A and 83B are diagrams showing the configuration of the back cover 1018 of the camera supporting multimedia information dot code recording. This is a configuration in which date information such as the date is recorded using an LED array 1020 in the form of a conventional data back, and a two-dimensional LED array 1022 for recording a dot code is arranged beside the former. It has become. On the rear side of the data back, there is a circuit built-in section 1024, in which a circuit for controlling lighting of the LED array 1020, for example, is inserted, and further, a circuit system for recording multimedia information dot code is incorporated therein. Is printed on a silver halide film (not shown) by the LED array 1022 as a dot code. For example, a tie-pin type microphone 1026 is connected to the circuit built-in unit 1024, a sound is picked up from the microphone 1026, and the information is exposed to a film in the form of a dot code by a two-dimensional LED array 1022 for recording a dot code.
[0455]
In the data bag 1018, in addition to the LED arrays 1020 and 1022, an electric contact 1028 with the camera body of the main body is prepared because the control is performed using a CPU or the like of the camera main body. Further, the claw portion 1032 of the hinge portion 1030 slides, and can be detached from the camera body using the claw slide lever portion 1034. That is, the data bag 1018 can be attached in place of the camera's original back cover.
[0456]
This embodiment is an example in which a two-dimensional LED array 1022 records dot codes at once. On the other hand, in FIG. 84A, the dot code recording LED unit 1036 is moved to two-dimensionally record the dot code. The LED unit 1036 includes a linear LED array 1038 and a lens 1040 for converging or reducing the light from the linear LED array 1038, as shown in FIG. An electric signal electrode 1042 for receiving a control signal of the LED array 1038 extends on both sides thereof. The signal electrode 1042 moves as the LED unit 1036 moves, as shown in FIG. It is configured such that it always slides on the signal electrode plate 1044 on the data bag 1018 side and the data signal enters from there. The film holding plate 1046 of the data bag 1018 is provided with a scanning window 1048 made of transparent glass, acrylic, or the like, from which only the LED unit 1036 faces the film (not shown).
[0457]
When using a two-dimensional LED array, it is sufficient to electrically blink each necessary portion without physically moving it, but when using such a one-dimensional LED array 1038, , The LED unit 1036 must be moved. As the moving mechanism, for example, a mechanism as shown in FIG. That is, this is basically the same configuration as the well-known mechanism for moving the needle of the tuner. When the pulley 1052 is rotated by the motor 1050, the wire 1054 wound around the pulley 1052 is attached. The LED unit 1036 having both ends fixed moves right and left. The wire 1054 does not expand and contract, so that the LED unit 1036 can be accurately moved. Also, the pulley 1052 and the wire 1054 are configured on both sides with respect to the LED unit 1036 so as to translate accurately.
[0458]
As a moving mechanism of the LED unit 1036, an ultrasonic motor 1056 can be used as shown in FIG. The ultrasonic motor 1056 applies vibration to the vibration plate 1058 that transmits the ultrasonic wave while shifting the phase well, as if the wave moves rightward and leftward. The moving body 1060 moves to the right or left in a skewed manner. With the movement of the moving body 1060, the LED unit 1036 connected to the moving body 1060 also moves to the right or left. Go to
[0459]
FIG. 85 is a diagram showing the circuit configuration of the data bag 1018 shown in FIGS. 83A and 84A. In particular, the portion surrounded by a broken line is the structure of the data bag 1018.
[0460]
A CPU (for example, a one-chip microcomputer) 1062 provided in the camera body controls the entire camera. The exposure control unit 1064 performs exposure control based on photometric data from the photometric unit 1066. The shutter control unit 1068 and the aperture control unit 1070 adjust the shutter speed and / or aperture according to the purpose or Control is performed according to the mode, and control is performed so as to obtain an optimal exposure as appropriate.
[0461]
Further, the CPU 1062 calculates a lens control amount using the lens information held on the lens side or the main body side, and causes the lens control unit 1074 to perform necessary lens control. This includes focus control and zoom control. Further, the CPU 1062 performs the shutter operation in response to the operation of the focus lock button 1076 and the release button 1078 (usually, one button is mechanically shared and comes out independently). Control. Further, the CPU 1062 controls the motor 1082 for winding the film by the motor control unit 1080.
[0462]
Further, the CPU 1062 exchanges data with the multimedia information recording / reproducing unit 1084, the multimedia information LED controller 1086, and the date LED controller 1088 in the data back 1018 via the electrical contact 1028 with the camera body side. I can do it. The date LED controller 1088 controls the light emission of the date LED array 1020 and imprints the photographing date and time on the film. The data back 1018 includes a date for generating a time pattern for the date and time. Clock generator 1090 is built-in.
[0463]
The multimedia information recording / reproducing unit 1084 has a configuration from a voice input in the configuration of FIG. 13 to a portion for generating a pattern constituting a dot code, that is, immediately before code synthesis and editing in the configuration of FIG. The reproduction system has, for example, a configuration from the scan conversion unit 186 to the D / A conversion unit 266 in FIG. Then, the multimedia information LED controller 1086 controls light emission of the LDE array 1022 or 1038 according to the dot code pattern output from the multimedia information recording / reproducing unit 1084. In this case, in the example of FIG. 83A, since the two-dimensional LED array 1022 is used, the dot code pattern is exposed only with this configuration. On the other hand, in the example of FIG. 84A, since it is necessary to move the one-dimensional LED array 1038 further, the motor 1050 is driven by the motor controller 1092 for moving the LED array to move the LED unit 1036. Let it. The multimedia information LED controller 1086 gives the necessary code information to be recorded at that position to the LED array 1038 to emit light while adjusting the timing with the movement by the motor 1050 as needed.
[0464]
Note that a key 1094 for setting various modes is provided on the camera body side. This may be composed of a number of buttons, or may be separated into a mode switching button and a setting button. This may be provided on the data back side. In this case, the key operation signal is supplied to the CPU 1062 via an electric contact.
[0465]
In the above configuration, the dot code is exposed on the film as follows, for example. That is, when the operation signal of the focus lock 1076 button, which is one index for starting shooting, is activated, the CPU 1062 fetches audio from the microphone 1026 to the multimedia information recording / reproducing unit 1084, and records / records the multimedia information. A storage unit (not shown) inside the reproduction unit 1084 sequentially stores the data for a certain period of time. For example, this fixed time is determined in the form of 5 seconds or 10 seconds, and the maximum capacity of the memory (not shown) is adjusted to that, and the data is sequentially and cyclically stored in the same manner as a general voice recorder. . Then, when the release button 1078 is pressed, the CPU 1062 instructs the multimedia information recording / reproducing unit 1084 to, for example, a few seconds before (eg, 5 seconds) or before or after (eg, 1 second after, 3 seconds before). Second) to the dot code. This setting can be set by the user using the mode setting key 1094, for example. Then, the audio stored in the multimedia information recording / reproducing unit 1084 is actually encoded, and the encoded audio is printed on the film by the LED array 1022 or 1038. After the operation is completed, the CPU 1062 performs a film winding operation. Of course, it is also possible to synchronize the LED array moving motor controller 1092 and the film winding motor control unit 1080 with each other so that the film is wound up and, at the same time, the movement speed and timing are adjusted and recorded. In that case, it is possible to take measures such as high-speed continuous shooting. In addition, the LED unit 1036 may be fixed, and recording may be performed when the film is wound. At this time, there is an advantage that one motor is reduced.
[0466]
In addition to recording the sound as dot code information on the film as described above, naturally, information on various cameras provided from the CPU 1062, for example, what kind of lens is currently used or the shutter speed It is also possible to record information on how far and what aperture is set. That is, for example, it is possible to later understand under what condition the photograph was taken with respect to the completed photograph. Normally, such information is stored in the user's head. However, according to the present embodiment, the film code that is completed later or the dot code on the photographic paper on which it is printed can be used. By reproducing the multimedia information dot code with a reproducing apparatus, the information can be selectively displayed, and the conditions of the camera at the time of shooting can be understood. Therefore, for example, the same setting can be easily performed the next time the user wants to shoot under the same conditions. In particular, it is very useful when taking pictures on a routine basis, for example, taking a change in a specific landscape through the moon, or in such a case.
[0467]
FIG. 83C shows an example in which a film on which a dot code is printed as described above is printed. This is, for example, an example in which the dot code 1096 and the date code 1098 written on the film are printed as they are, together with other picture portions 1100. In this case, sound information or various camera information can be reproduced by scanning the dot code 1096 with the multimedia information dot code reproducing apparatus described above, for example, a pen-type information reproducing apparatus. In addition, if the DPE side, for example, removes only this dot code and prints on the back side, the front side becomes only a photograph and the same thing as a conventional photograph can be obtained. Further, as one of the camera information, trimming information in the DPE, for example, information on switching between zooming and panorama is recorded on the film, and the DPE scans the dot code on the film, By reading the information, it becomes possible to print a panorama in the form of a panorama or zooming.
[0468]
In the case where a dot code is printed on a film, double exposure with an actual scene is performed. Therefore, if external light is strong at that time, the dot code may not be captured properly. Therefore, for example, in a conventional panorama compatible camera, when switching to panorama, there is a light shielding plate above and below, and that part is configured so that the scenery is not captured, but a similar function may be added. . That is, the light-shielding plate may be automatically inserted, or if the device is compatible with the dot code from the beginning, the light-shielding plate may be fitted immediately before the film or after the lens. Further, the code may be recorded in a margin (unexposed portion) of the film.
[0469]
In FIG. 85, by connecting the pen-type information reproducing apparatus 1102 to the data bag 1018 and reproducing the dot code 1096 of FIG. 83 (C), camera information, that is, aperture, shutter information, lens information, and the like can be obtained. For example, the image may be displayed on the LCD mode display unit 1104 or the LED display unit 1106 in the viewfinder which is initially provided on the back side of the camera back or in the camera body. In addition, by scanning the dot code 1096, the mode may be set to the same condition as that. That is, when the user has a film or a photograph and scans the dot code 1096, each condition on the camera side is automatically set in the mode, and the same shutter speed, the same aperture, and the same lens magnification are used.
[0470]
【The invention's effect】
As described above in detail, according to the present invention, multimedia information including audio information, video information, digital code data, and the like recorded on a recording medium in a format that can be recorded inexpensively and with a large capacity and that can be repeatedly reproduced is reproduced. An information reproducing apparatus and an information reproducing method capable of outputting can be provided.
[Brief description of the drawings]
FIG. 1 is a block diagram of a recording device for recording dot-coded audio information according to a first embodiment of the present invention.
FIG. 2A is a diagram illustrating a recording format of a dot code, and FIG. 2B is a diagram illustrating a use situation of a reproducing apparatus according to the first embodiment.
FIG. 3 is a block diagram of a reproducing apparatus according to the first embodiment.
FIGS. 4A and 4B are explanatory diagrams of manual scanning, and FIGS. 4C and 4D are explanatory diagrams of scan conversion, respectively.
5A is a diagram for explaining data interpolation accompanying scan conversion, and FIGS. 5B and 5C are diagrams each showing an example of a recording medium. FIG.
FIG. 6 is an explanatory diagram of data string adjustment.
FIG. 7 is a diagram illustrating a configuration of a playback device according to a second embodiment.
FIG. 8 is a diagram illustrating a configuration of a playback device according to a third embodiment.
FIGS. 9A and 9B are external perspective views of a portable voice recorder, respectively.
FIG. 10 is a circuit configuration diagram of the portable voice recorder.
FIGS. 11A and 11B are diagrams showing examples of printing on a recording medium, and FIGS. 11C and 11D are external perspective views of another example of a portable voice recorder.
12 is a flowchart of a dot code printing process in the voice recorder of FIG.
FIG. 13 is a block diagram of a multimedia information recording device.
FIG. 14 is a conceptual diagram of a dot code.
FIG. 15 is a block diagram of a multimedia information reproducing apparatus.
16 is a light source emission timing chart in the multimedia information reproducing apparatus of FIG.
FIG. 17 is a diagram illustrating another configuration example of the multimedia information reproducing apparatus.
18A is a diagram illustrating a dot code applied to the reproducing device of FIG. 3 for explaining a data string adjusting unit in the multimedia information reproducing device of FIG. 15, and FIG. 18B is a diagram of FIG. FIG. 3C is a diagram illustrating a dot code linear marker, FIG. 3C is a diagram illustrating a scanning method, and FIG. 3D is a diagram illustrating a scan pitch of an image sensor.
FIG. 19 is a diagram illustrating an actual configuration of a data string adjusting unit.
FIGS. 20A to 20C are diagrams illustrating markers having arrangement direction detection dots, and FIG. 20D is a diagram illustrating still another configuration example of the multimedia information reproducing apparatus.
21A is a diagram illustrating a block address, FIG. 21B is a diagram illustrating a block configuration, FIG. 21C is a diagram illustrating a marker pattern example, and FIG. 21D is a diagram illustrating a magnification of an imaging system. FIG.
FIG. 22 is a block diagram of a marker detecting unit in the multimedia information reproducing apparatus.
FIG. 23 is a processing flowchart of a marker determination unit in FIG. 22;
FIG. 24 is a processing flowchart of a marker area detection unit in FIG. 22;
FIG. 25A is a diagram showing a marker area, FIG. 25B is a diagram showing a storage format of a table for storing a detected marker area, and FIGS. 25C and 25D are diagrams of FIG. FIG. 9 is a diagram showing the accumulated value of each pixel in FIG.
26A is a processing flowchart of the approximate center detecting unit in FIG. 22, and FIG. 26B is a flowchart of a gravity center calculation subroutine in FIG.
FIG. 27 is a block diagram of the approximate center detection unit.
28A is a diagram showing an actual configuration of a dot code data block, FIG. 28B is a diagram showing another configuration, and FIG. 28C is a diagram for explaining another arrangement of data inversion dots. FIG.
29A is a diagram showing another example of the actual configuration of a dot code data block, and FIG. 29B is a diagram for explaining selection of an adjacent marker.
FIG. 30 is a block diagram of a data array direction detecting unit in the multimedia information reproducing apparatus.
FIG. 31 is an operation flowchart of a data array direction detection unit.
32 (A) is a flowchart of an adjacent marker selection subroutine in FIG. 31, and (B) and (C) are diagrams for explaining adjacent marker selection, respectively.
FIG. 33A is an explanatory diagram of direction detection, and FIG. 33B is a diagram for explaining the relationship between m and n in FIG.
FIG. 34 is an explanatory diagram of another method of direction detection.
FIGS. 35A and 35B are a block configuration diagram and an explanatory diagram of a block address detection, error determination, and accurate center detection unit in the multimedia information reproducing apparatus, respectively.
FIG. 36 is an operation flowchart of a block address detection, error determination, and accurate center detection unit.
FIG. 37A is a diagram for explaining the operation of a marker and address interpolating unit in the multimedia information reproducing apparatus, and FIG. 37B is a block diagram of an address control unit in the multimedia information reproducing apparatus. It is a block diagram.
38A is a diagram for explaining another processing method of the marker judgment unit, FIG. 38B is a diagram for explaining a marker judgment formula, and FIG. 38C is a diagram for explaining marker alignment detection; It is.
FIG. 39 is a diagram showing a configuration of a light source integrated type image sensor.
FIG. 40 is a block diagram of a one-chip IC using an XY address type imaging unit.
41A is a circuit configuration diagram of a pixel of an XY address type imaging unit, and FIG. 41B is a diagram illustrating a configuration of a pen-type information reproducing apparatus having a dot code capture control switch.
FIG. 42 is a block diagram of a three-dimensional IC using an XY address type imaging unit.
FIG. 43 is a diagram illustrating another configuration of a pen-type information reproducing device having a switch for controlling dot code capture.
44A is a diagram illustrating a configuration of a pen-type information reproducing apparatus capable of removing regular reflection, FIG. 44B is a diagram illustrating a configuration of first and second polarizing filters, and FIG. FIG. 9 is a diagram illustrating another configuration example of the second polarization filter, and FIG. 9D is a diagram illustrating the configuration of the electro-optical element shutter.
FIG. 45 is a diagram showing another configuration of a pen-type information reproducing apparatus capable of removing regular reflection.
46A is a diagram showing a configuration of a pen-type information reproducing device using a transparent resin optical waveguide material as a light source, and FIG. 46B is an enlarged view of a connection portion between the optical waveguide material and a reproducing device housing; , (C) and (D) are diagrams showing the configuration of the tip portion of the optical waveguide material, respectively.
FIG. 47 is a diagram showing a configuration of a pen-type information reproducing apparatus using an image sensor integrated with a light source.
48A is a diagram showing a configuration of a pen-type information reproducing apparatus compatible with color multiplexing, FIG. 48B is a diagram for explaining a color multiplexing code, and FIG. (D) is a diagram showing an index code.
FIG. 49A is an operation flowchart of a color multiplexing compatible pen-type information reproducing apparatus, and FIG. 49B is a diagram showing a configuration of an image memory unit when a color imaging element is used.
50A is a diagram illustrating another configuration of a pen-type information reproducing apparatus that supports color multiplexing, and FIG. 50B is a diagram illustrating the configuration of a light source.
FIG. 51 (A) is a diagram showing a dot data sticker on which a stealth type dot code is written, FIG. 51 (B) is a diagram showing a configuration of a pen type information reproducing apparatus corresponding to a stealth type dot code, and FIG. 51 (C). FIG. 4 is a diagram showing a dot data seal in which a stealth type dot code is written in another mode.
FIG. 52 is a diagram illustrating a configuration of a card-type adapter including an audio output terminal.
FIGS. 53A and 53B are diagrams showing a configuration of a card type adapter for a video game machine.
FIG. 54A is a diagram showing an example of use of a card-type adapter for an electronic organizer, and FIG. 54B is a diagram showing an appearance and an example of use of a card-type adapter for a device having no input means.
FIG. 55 is a diagram for explaining how to use a reel seal printing machine for printing a dot code on a reel seal.
FIG. 56 is a diagram showing the internal configuration of a reel seal printing machine.
FIG. 57 is a diagram showing a configuration in a case where a function of recording a multimedia dot code is provided inside a word processor.
FIG. 58 is a diagram showing a configuration when the function of the multimedia information recording processing unit in FIG. 57 is incorporated in an optical copying machine;
FIG. 59 is a diagram showing a configuration in a case where the function of the multimedia information recording processing unit in FIG. 57 is incorporated in a digital copying machine.
FIG. 60 is a diagram showing a configuration in a case where the pen-type information reproducing apparatus is also used as an input unit for character or picture data.
FIG. 61 is a diagram showing another configuration in a case where the pen-type information reproducing apparatus is also used as an input unit for character and picture data.
FIG. 62 is a diagram showing a configuration of a scanner and a card type adapter compatible with data reading.
FIGS. 63A and 63B are diagrams showing a system in which a dot code is scanned by a pen-type information reproducing apparatus and projected on a screen by a projector, respectively.
FIG. 64 is a diagram showing a specific configuration of an output processing unit in (A) and (B) of FIG. 63;
FIG. 65 (A) is a diagram showing a case where an output is made to a copying machine, a magneto-optical disk device, and a printer instead of a projector, and FIG. It is.
FIG. 66 is a diagram showing a specific configuration of an output processing unit.
FIG. 67 is a diagram illustrating a configuration of an example in which a format conversion unit for converting a format into a format for each type of word processor is provided.
FIG. 68 is a diagram illustrating an actual configuration of a format conversion unit.
FIG. 69 is a system diagram when a sheet on which a dot code is recorded is transmitted and received by FAX.
FIG. 70 is a diagram illustrating a configuration of a FAX multimedia information recording device.
FIG. 71 is a diagram illustrating a configuration of a multimedia information recording device with a built-in FAX.
72A is a diagram showing a configuration of an overwrite type MMP card recording / reproducing device, and FIGS. 72B and 72C are diagrams showing a back surface and a front surface of the MMP card.
FIG. 73 is a diagram showing another configuration of the overwrite type MMP card recording / reproducing device.
74A is a diagram showing still another configuration of the overwrite type MMP card recording / reproducing apparatus, FIGS. 74B and 75C are diagrams showing the back and cross sections of the MMP card, and FIG. FIG. 3 is a diagram illustrating a configuration of a pattern recording sheet.
FIG. 75 is a diagram showing another configuration of the overwrite type MMP card recording / reproducing device.
76A is a diagram showing a configuration of a write-once MMP card recording / reproducing apparatus, and FIG. 76B is a block diagram of a recorded area detection unit in FIG.
77A is a diagram illustrating another configuration of a recorded area detection unit, and FIG. 77B is a diagram illustrating an MMP card on which a recorded marker is recorded.
78A is a diagram showing an MMP business card card system, and FIGS. 78B and 78C are diagrams showing a back surface and a front surface of the MMP business card card.
FIGS. 79 (A) and (B) are plan views of an MMP card formed by a semiconductor wafer etching method, where (A) shows a state where a protective cover is closed and (B) shows a state where it is opened.
80A is a plan view of an MMP card having another structure formed by a semiconductor wafer etching method, FIG. 80B is a side view, and FIG. 80C is a view for explaining the structure of a claw portion.
FIG. 81A is a diagram illustrating a disk device with a dot code decoding function, and FIG. 81B is a diagram illustrating a recording example of a dot code and an index.
FIG. 82 is a block configuration diagram of a disk device with a dot code decoding function.
83A is a diagram showing a configuration of a back cover of a camera capable of recording multimedia information dot code, FIG. 83B is a side view thereof, and FIG. 83C is a photographic paper on which multimedia information dot code is recorded. It is a figure showing the example of.
84A is a diagram illustrating another configuration of the back cover of the camera supporting multimedia information dot code recording, FIG. 84B is a diagram illustrating the configuration of the LED unit, and FIG. 84C is a diagram illustrating the data electrode on the data back side. It is a figure and (D) and (E) are figures which show the moving mechanism of an LED unit, respectively.
FIG. 85 is a block diagram of a camera capable of recording multimedia information dot code.
[Explanation of symbols]
36,170 dot code
36A, 36B Mark for manual scanning
38,172,304 blocks
38A, 174, 274, 310 marker
38B error correction code
38C audio data
38D x address data
38E address data
38F error judgment code
40 Pen-type information reproducing device
42 audio output device
44 Detector
46 Scan conversion and lens distortion correction unit
48 Binarization Circuit
50 threshold judgment circuit
54 demodulation circuit
56 Data string adjustment unit
58 De-interleave circuit
60 error correction circuit
62 decoding circuit
64,240,244,258 data interpolation circuit
66 D / A conversion circuit
70 Detector and Scan Converter
72 Interpolator
176, 272A, 306 block address
178 Address error detection and error correction data
180,314 data area
184 detector
186 Scan converter
188 Binarization Processing Unit
190 Demodulator
192 Data string adjustment unit
194 Data error correction section
196 Data separation unit
214 Image memory
216 Marker detector
218 Data array direction detector
220,232 Address control unit
222 interpolation circuit
224 Memory for lens aberration distortion correction
226 Threshold judgment circuit
228 Block address detector
230 Block address error detection and correction unit
238,242,248,256,262 Decompression processing unit
246 PDL (Page Description Language) Processor
250,264 synthesis or switching circuit
252,266 D / A converter
254 display device
260 Voice synthesis unit
268 Audio output device
270 page printer, plotter, etc.
272B Error correction data of block address
276A line address
276B Error detection data
278,316 dots
294A, 296A, 298A Dot for array direction detection
300 Block address detection, error judgment, accurate center detection
302 Marker and block address interpolation unit
306A Upper address code
306B Lower address code
308 Dummy marker
310A circular black marker
310B White part of marker
312 Error detection code
312A Upper address CRC code
312B Lower address CRC code
364 data margin

Claims (3)

An information reproducing apparatus for reproducing the data by optically reading the code from a recording medium including a portion where data is recorded as an optically readable code,
The code is
A data dot pattern in which a plurality of dots are two-dimensionally arranged according to the data;
A marker for setting a reading point of the dot, having a size larger than the size of the dot by a predetermined amount and having a pattern that is impossible in the data dot pattern;
At least,
Assuming that the code to be read is a code including a dot and a marker of the largest size among a plurality of types of readable codes having different dot sizes , reading of the code is started, and it is assumed that the assumption is correct. When it is determined that the code is not a code, the code is read assuming that the code to be read is a code including a dot and a marker having the next largest size among the readable codes. An information reproducing apparatus characterized by the above-mentioned. 2. The information reproducing apparatus according to claim 1, wherein the marker has a circular shape having a diameter larger than a diameter of the dot by a predetermined amount . An information reproducing method for reproducing the data by optically reading the code from a recording medium having a portion where data is recorded as an optically readable code,
The code is
A data dot pattern in which a plurality of dots are two-dimensionally arranged according to the data;
A marker for setting a reading point of the dot, having a size larger than the size of the dot by a predetermined amount and having a pattern that is impossible in the data dot pattern;
At least,
Assuming that the code to be read is a code including a dot and a marker of the largest size among a plurality of types of readable codes having different dot sizes , reading of the code is started, and it is assumed that the assumption is correct. When it is determined that the code is not the code, the code to be read is read again assuming that the code includes a dot and a marker having the next largest size among the readable codes. Information reproduction method.

Images