JP2001175822A - Recording medium, information reproducing device, and information reproducing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To record a large amount of data as optically readable codes. SOLUTION: On an A4 sheet 960 as a recording medium, data are divided into optically readable codes and recorded. A reproducing device reproduces the above data by reading all the codes out in order when the data are divided into the codes and recorded in this way.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention includes audio information such as voice and music, video information obtained from cameras and videos, and digital code data such as text data obtained from personal computers and word processors. A recording medium for reading the above-mentioned dot code from a sheet-like recording medium such as paper or various resin films, metal, etc., on which so-called multimedia information is recorded as an optically readable dot code, and reproducing and outputting the original multimedia information; The present invention relates to a reproducing apparatus and an information reproducing method.

[0002]

2. Description of the Related Art Conventionally, various media such as magnetic tapes and optical disks have been known as media for recording voice, music and the like.

[0003] However, even if a large number of copies of these media are made, the unit price is somewhat expensive, and a large space is required for storage.

[0004] Furthermore, when it is necessary to deliver the medium on which the voice is recorded to another person at a remote place, it is necessary to send the medium by mail or take it directly, and it takes time and effort. There was also the problem of this.

Therefore, it has been considered to record voice information on paper in the form of image information which can be transmitted by facsimile and can be copied in large quantities at low cost. For example, JP
As disclosed in Japanese Unexamined Patent Publication No. 244145/1992, there has been proposed an apparatus in which audio information is converted into image information by sending some audio into an optical code so that the image information can be transmitted by facsimile.

[0006]

However, in the apparatus disclosed in the above publication, the facsimile apparatus is provided with a sensor for reading the optically readable recorded voice, and according to the output of the sensor. Plays audio. Therefore, it is assumed that optically readable audio information transmitted by facsimile can only be heard at the place where the facsimile device is installed, and that the facsimile output paper is moved to another place to reproduce the sound. Had not been.

Therefore, if the recording capacity of the voice information is increased, it may affect other facsimile transmission / reception. If the content of the voice recording itself is difficult, a large amount of voice may be reproduced. It is possible to forget the first one. Furthermore, the recording capacity is limited by the recording density and the compression method, and only a few seconds of audio can be transmitted. Therefore, in order to transmit a large amount of audio information, a magnetic tape or an optical disk must be used.

Further, even for short-time audio information, the reproduction apparatus itself is built in the facsimile apparatus, so that it is inconvenient to repeat the reproduction of the audio information.

In addition to the audio information, the so-called multimedia information including video information obtained from a camera, a video, and the like, and digital code data obtained from a personal computer, a word processor, and the like, is inexpensive and has a large capacity. A recording / reproducing system has not been realized yet.

SUMMARY OF THE INVENTION The present invention has been made in view of the above points, and has been made in consideration of audio information, video information, audio information, video information,
It is an object of the present invention to provide a recording medium, an information reproducing apparatus, and an information reproducing method capable of reproducing and outputting multimedia information including digital code data and the like.

[0011]

In order to achieve the above object, a recording medium according to the present invention is a recording medium having a portion in which data is recorded as an optically readable code, and Is divided into a plurality of codes and recorded.

An information reproducing apparatus according to the present invention is an information reproducing apparatus for optically reading a code from a recording medium having a portion in which data is recorded as an optically readable code and reproducing the data. When the data is divided into a plurality of codes and recorded, a means for reproducing the data by sequentially reading all of the plurality of codes is provided.

An information reproducing method according to the present invention is an information reproducing method for optically reading a code from a recording medium having a portion in which data is recorded as an optically readable code and reproducing the data. When the data is divided into a plurality of codes and recorded, the data is reproduced by sequentially reading all of the plurality of codes.

That is, the recording medium of the present invention, the information reproducing apparatus,
According to the information reproducing method, the data is divided into a plurality of optically readable codes and recorded, and when the data is divided into a plurality of codes and recorded, The data is reproduced by sequentially reading all of the plurality of codes.

Therefore, it is possible to reproduce and output multimedia information including audio information, video information, digital code data, and the like recorded on a recording medium in a format that can be recorded at low cost, with a large capacity, and repeatedly reproduced. In particular, by dividing data into multiple codes and recording,
It becomes possible to record a large amount of data beyond the width of the paper.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the drawings. First, among multimedia information, embodiments relating to audio information such as voice and music will be described. .

FIG. 1 is a block diagram of an audio information recording apparatus for recording audio information such as voice and music on a paper as an optically readable digital signal in the first embodiment of the present invention. is there.

An audio signal input from the audio input device 12 such as a microphone or an audio output device is:
After being amplified by the preamplifier 14 (AGC is applied in the case of a microphone sound), the signal is converted into a digital signal by the A / D converter 16. The digitized audio signal is subjected to data compression in a compression circuit 18 and then an error correction code adding circuit 20 adds an error correction code.

Thereafter, the memory circuit 22 performs interleaving. This interleaving is to disperse the data array two-dimensionally in accordance with a predetermined rule, so that when the data is returned to the original array in the reproducing apparatus, bursty stains and scratches on the paper, that is, The error itself is dispersed, so that error correction and data interpolation become easier. This interleaving is performed by appropriately reading out and outputting data stored in the memory 22A by the interleaving circuit 22B.

The output data of the memory circuit 22 is then processed by a data adding circuit 24 in accordance with a predetermined recording format, which will be described in detail later, for each block, a marker and an x address indicating a two-dimensional address of the block. After adding the y address and the error determination code, the modulation circuit 26 performs modulation for recording. Then, after data such as image data recorded together with the output data of the audio information is superimposed by the synthesizing circuit 27, the printer system or the printing plate-making system 28 performs a process for printing.

Thus, for example, the image is recorded on the paper 30 as a recording medium in a format as shown in FIG. That is, digital sound data is printed as the recording data 36 together with the image 32 and the character 34. Here, the recording data 36 is composed of a plurality of blocks 38. Each block 38 includes a marker 38A, an error correction code 38B, audio data 38C, x address data 38D, y address data 38E, and an error determination code. 38F.

The marker 38A also functions as a synchronizing signal, and uses a pattern such as DAT which does not normally appear in recording modulation. The error correction code 38B is used for error correction of the audio data 38C. The audio data 38C corresponds to an audio signal input from the audio input device 12 such as the microphone or the audio output device. The x and y address data 38D and 38E are data indicating the position of the block 38, and the error determination code 38F is used for error determination of these x and y addresses.

The recording data 36 in such a format
Prints the data of "1" and "0" by the printer system or the printing plate-making system 28 in the same manner as, for example, a bar code, such that "1" has a black dot and "0" has no black dot. Be recorded. Hereinafter, such recording data is referred to as a dot code.

FIG. 2B shows a scene in which sound data recorded on the paper 30 as shown in FIG. 2A is read out by the pen-type information reproducing device 40. By tracing over the dot code 36 with the pen-type information reproducing device 40 as shown in FIG. 3, the dot code 36 can be detected, converted into sound, and heard by the audio output device 42 such as an earphone.

FIG. 3 is a block diagram of the information reproducing apparatus 40 according to the first embodiment of the present invention. In the information reproducing apparatus according to the present embodiment, parts other than the audio output device 42 such as headphones and earphones are housed in one portable pen-shaped housing (not shown). Of course, a speaker may be built in the housing.

The detection unit 44 basically has the same function as an imaging unit such as a television camera. That is, the light source 44A illuminates the dot code 36 on the paper surface, which is a subject, and reflects the reflected light through an imaging system 44B such as a lens and a spatial filter 44C by an imaging unit 44D including a semiconductor area sensor or the like. , And the signal is amplified and output by the preamplifier 44E.

Here, the pixel pitch of the area sensor is set to be smaller than the dot pitch of the dot code 36 on the imaging surface according to the sampling theorem. Further, the spatial filter 44C installed on the imaging surface also has a
It is inserted to prevent the moire phenomenon (aliasing) on the imaging surface. In addition, as shown in FIG. 4A, the number of pixels of the area sensor is determined by taking into account camera shake during manual scanning of the detection unit 44, and determining the number of pixels of the predetermined dot code 36 that can be read at one time. It is set to be larger than the width of.
That is, FIGS. 4A and 4B show the movement state of the imaging area in a certain cycle when the detection unit 44 is manually scanned in the direction of the arrow. In particular, FIG. The state of manual scanning when the vertical width of the code 36 falls within the imaging area (considering camera shake) is shown. (B) shows a case where the amount of the dot code 36 is large and the vertical width is one. The case where it does not fit in the imaging area is shown. In the latter case,
At the position where the manual scanning of the dot code 36 is started, a manual scanning mark 36A for indicating the position is printed.
Therefore, a large number of dot codes 36 can be detected by performing manual scanning a plurality of times along the manual scanning mark 36A.

The image signal detected by the detection unit 44 as described above is then input to a scan conversion and lens distortion correction unit 46. In the scan conversion and lens distortion correction section 46, the input image signal is first converted to an A / D converter 46A.
Is converted into a digital signal and stored in the frame memory 46B. The frame memory 46B has 8-bit gradation.

The marker detection circuit 46C scans the image information stored in the frame memory 46B as shown in FIG. 4C to detect the marker 38A. θ
The detection circuit 46D detects which marker 38A detected by the marker detection circuit 46C corresponds to which address value on the imaging surface, and from the address value, the inclination θ of the imaging surface with respect to the arrangement direction of the dot code. Is calculated. Note that the marker detection circuit 46C rotates by approximately 90 ° in the scan only in the direction as shown in FIG. 4C as shown in FIG. When the imaging of the code 36 is performed, the inclination θ may not be correctly obtained. That is, when scanning in the short direction of the block 38, there is a possibility that θ may not be obtained correctly. Therefore, the marker detection circuit 46C also performs scanning in the direction orthogonal to the direction as shown in FIG. The correct one of the results obtained in the two-way scanning is selected.

On the other hand, in the lens aberration information memory 46E,
It stores previously measured aberration information of the lens used in the imaging system 44B of the detection unit 44 for correcting lens distortion. The next time the address control circuit 46F reads out the data stored in the frame memory 46B, the value of the inclination θ calculated by the θ detection circuit 46D and the lens aberration stored in the lens aberration information memory 46E are used. The read address according to the information is stored in the frame memory 4.
6B, and performs scan conversion in the data array direction while performing data interpolation in the interpolation circuit 46G.

FIG. 5A shows the principle of data interpolation performed by the interpolation circuit 46G. Basically,
Interpolation data is created by a convolution filter and LPF using pixels around the position Q at which data is interpolated. The pixel pitch and the scan line pitch after the scan conversion are set to be equal to or smaller than the dot pitch of the dot code based on the sampling theorem, as in the case of imaging.

In the case of simple data interpolation using four pixels around the position Q to be interpolated, Q = (D6 × F6)
+ (D7 × F7) + (D10 × F10) + (D11 × F11),
In the case of relatively accurate data interpolation using 16 surrounding pixels, Q = (D1 × F1) + (D2 × F2
) +... + (D16 × F16) produces interpolation data. Here, Dn is the data amplitude value of pixel n, Fn
Is a coefficient of an interpolation convolution filter (LPF) determined according to the distance to the pixel n.

The image of the dot code 36 read from the frame memory 46B after being subjected to the scan conversion as described above is binarized by a binarization circuit 48 comprising a latch 48A and a comparator 48B. You. The threshold value at the time of performing this binarization is determined by the threshold value determination circuit 50 using the value of the histogram for each screen or for each block in the screen. That is, the stain on the dot code 36 and the paper 3
The threshold is determined according to the distortion of 0, the accuracy of the built-in clock, and the like. As the threshold value judgment circuit 50, it is preferable to use, for example, a circuit using a neural network disclosed in Japanese Patent Application No. 4-131051 filed by the present applicant.

In parallel with this, the frame memory 46
The image of the dot code 36 read from B is input to the PLL circuit 52 and generates a clock pulse CK synchronized with the reproduced data. The clock pulse CK is used for binarization and demodulation after scan conversion, and for a data string adjusting unit 56 to be described later.
Determination circuit 56A, x, y address detection circuit 56
It is used as a reference clock for B and the memory unit 56C.

The binarized data is demodulated by a demodulation circuit 54, and an error determination circuit 56A in a data sequence adjustment unit 56 is provided.
Is input to the x, y address detection circuit 56B. The error determination circuit 56A outputs the error determination code 38 in the block 38.
Using F, it is determined whether or not there is an error in the x, y address data 38D, 38E. If there is no error, the demodulated data from the demodulation circuit is transferred to the x, y address detection circuit 5.
According to the address detected in 6B, the data is recorded in the audio data string adjustment memory unit 56C. If there is an error, the audio data 38C of the block 38 is not recorded in the audio data string adjustment memory unit 56C.

The purpose of the data string adjusting unit 56 is to control the accuracy of the scan conversion (which depends on the accuracy of the reference clock and the S / N ratio of the image sensor) in the scan conversion and lens distortion correction unit 46 and the distortion of paper. Another object of the present invention is to correct a slight shift between the data arrangement direction and the scan direction after scan conversion. This will be described with reference to FIG. In the figure, dot codes D1, D2, and D3 indicate data for each block. After the scan conversion, the pitches of the scanning lines 1, 2, 3,.
As described above, it suffices that the dot pitch is set to be equal to or less than the data dot pitch based on the sampling theorem. In FIG.
For completeness, it is set to の of the dot pitch. Therefore, as apparent from the figure, the dot code D1 is detected without error on the scan line 3 after scan conversion. And D2
Is detected without error in the scan line 2 after the scan conversion, and D3 is similarly detected without error in the scan line 1 after the scan conversion.

Then, x, in each block 38,
According to the y addresses 38D and 38E, the data is stored in the data string adjusting memory unit 56C.

Next, as shown in FIGS. 4A and 4B, by manually scanning the detection unit 44, the voice dot code 36 on the paper 30 can be completely stored in the memory for data string adjustment. Unit 56C.

The voice dot code whose data string has been adjusted by the data string adjusting unit 56 is then processed by the PLL.
In accordance with a reference clock CK ′ generated by a reference clock generation circuit 53 different from the circuit 52, the data is read from the memory unit 56C for data string adjustment. Then, at this time, de-interleaving is performed by the de-interleaving circuit 58,
Converted to a formal data string. Next, error correction using the error correction code 38B in the block 38 is performed by the error correction circuit 60. Then, the data compressed by the decoding circuit 62 is decoded, and the interpolation of the audio data that cannot be corrected by the data interpolation circuit 64 is performed. After that, the signal is converted into an analog audio signal by the D / A conversion circuit 66, amplified by the amplifier 68, and converted into sound by the audio output device (earphone, headphone, speaker, etc.) 42.

As described above, audio information such as voice and music can be recorded on paper, and the reproduction device is a small portable device, so that it can be printed out or transmitted by facsimile. , Or printed in the form of a book by printing prepress,
You will be able to listen as many times as you want.

The memory section 56C for adjusting the data string in the data string adjusting section 56 is not limited to a semiconductor memory.
Other storage media, such as floppy disks, optical disks, magneto-optical disks, etc., can be used.

Various applications can be considered as application examples of the audio information recorded as described above. For example, for general use, language teaching materials, music scores, various textbooks such as correspondence courses, product specifications, manuals for repair, etc., dictionaries for foreign languages, encyclopedias, books such as picture books, product catalogs, travel guides, direct mail and guidance Letters, newspapers, magazines, flyers,
Albums, congratulations, postcards, etc. are possible. For business use, FAX (voice and fax) business instructions,
Minutes, electronic blackboards, OHPs, identification cards (voiceprints), business cards, telephone memos, sticky notes, supplies (consumables) made of high-quality paper rolls, and the like can be considered. Here, as shown in FIG. 5 (B), the consumables are provided on the back surface of the rolled paper 30A with an easily peelable paste such as a double-sided tape or a sticky note. The dot code 36 is recorded in the
It can be pasted on various things (hereinafter, this is called a reel seal). Further, as shown in FIG. 3C, the width of the paper 30A is increased so that a plurality of levels of dot codes 36 can be recorded, and a manual scanning mark 36B as a guideline for manual scanning of the detection unit 44 is provided. May be printed vertically and horizontally. The mark 36B can also be used as a guide for the recording position of the dot code 36 at the same time. That is, if a sensor is provided in the printer system 28, and the mark 36B is read by the sensor and a cue for printing is performed, the dot code 36 is always printed in the area surrounded by the mark 36B. Therefore, the recorded audio information can be surely reproduced by performing the manual scanning along the mark 36B. Of course, the mark 36B may be printed when the dot code 36 is printed.

The recording time of audio information is 20
In the case of a general facsimile of 0 dpi, for example, 1 inch × 7 inch (2.54 cm × 1
(7.78 cm), the total number of data is 280 kbits. From now on, a marker, an address signal, an error correction code, an error determination code (however, the error determination code in this case is the x, y addresses 38D, 38
E (the audio data 38C is also subject to error determination in addition to E), which is 196 kbits.
become. Accordingly, the recording time when audio is compressed to 7 kbit / s (bit rate of mobile communication) is 28 seconds. When recording on the entire back side of A4-size double-sided facsimile paper, 7 inch x 10 inch (17.78 cm x 2
(5.4 cm), so that 4.7 minutes of audio recording is possible.

In the case of a G4 facsimile of 400 dpi, the result of calculation in the same manner as described above shows that 7 inches × 10
18.8 minutes of audio recording is possible in the inch area.

5 mm for high-end printing at 1500 dpi
When printing is performed on an area of x30 mm, as a result of calculation in the same manner as above, voice recording for 52.3 seconds is possible. Also,
When printed on a tape-shaped area of 10 mm x 75 mm, high quality sound (compressed to 30 kbi
(t / s), 1 minute of audio recording is possible.

FIG. 7 is a diagram showing the configuration of the second embodiment of the present invention. The second embodiment is an example in which a memory and an xy-address type imaging unit such as a CMD that can be randomly accessed are used as an imaging device, and a detection unit 44 and a scan conversion and lens distortion correction circuit 46 of a reproducing apparatus are used.
Only the third embodiment differs from the first embodiment. That is,
The detection unit and the scan conversion unit 70 include the xy address type imaging unit 7.
In the same manner as in the first embodiment, the imaging data stored in the memory 0A is detected by a marker, and the four surrounding data to be interpolated at the time of reading are read by the decoder address generators 70B and x,
The signals are sequentially read out by the y decoders 70C and 70D and input to the interpolation unit 72. The interpolation unit 72 sequentially reads out coefficients from the coefficient generation circuit 70E and multiplies the input data by the multiplier 70F. The interpolation unit 72 further converts the input data into an analog cumulative addition circuit including an adder 70G, a sample and hold circuit 70H, and a switch 70I. The sample and hold is performed by the sample and hold circuit 70J, and the scan-converted dot code is converted into the binarization circuit 4 by the sample and hold circuit 70J.
8, the threshold value determination circuit 50 and the PLL circuit 52.

With such a configuration, the same function as that of the first embodiment can be performed, and the frame memory 46 can be omitted, so that cost reduction and size reduction can be realized. . Furthermore, the xy address type imaging unit 70A, the address generation unit 70B, the decoders 70C and 70D, and the interpolation unit 72 are formed on a single substrate to form an IC, so that the size can be further reduced.

FIG. 8 is a diagram showing the configuration of the third embodiment of the present invention. In the present embodiment, the dot code 36 is recorded on the paper 30 on which pictures and characters are printed by using a transparent paint (ink) 74 that is easily specularly reflected (total reflection). Then, the light source 44A and the imaging system 44 are provided in the detection unit 44.
By providing the polarizing filters 44F and 44G between B and aligning the polarizing planes of the polarizing filters 44F and 44G, the transparent paint 74 escapes according to the reflected light from the inside (the surface of the paper 30) and the code. The reflected light from the place where the hole 74A is opened has a different polarization direction, and a half of the light is cut by the polarization filter 44G.
Further, since the difference in light amount between the ordinary reflected light and the totally reflected light is originally large, the contrast of the dot code recorded with the transparent paint 74 is enhanced and the image is taken.

Further, the paper 30 is subjected to a surface treatment such as mirror finishing so that the surface thereof is easily specularly reflected, and the transparent paint 74 is made of a material having a refractive index higher than the refractive index of the surface-treated surface and １ ／ λ. If the film is made as thick as possible (in consideration of the change in the optical path length due to the incident angle, the optical path length in the transparent paint is reduced to 1/4), the light obliquely hit by the effect of the reflection amplification coat Is further amplified and easily reflected on the surface (specular reflection).

In this case, for example, the dot code is formed by
By performing fine chemical etching or the like, the portion of the hole corresponding to the dot is roughened to reduce the reflectance.

When the dot code 36 is recorded with the transparent paint 74 in this manner, it can be recorded on a character or a picture. The capacity can be increased.

In place of the transparent paint, a transparent fluorescent paint may be used, or a color may be multiplexed. In the case of this color, a normal color ink can be used, or a color can be obtained by mixing a dye with a transparent ink.

Here, as an example, the transparent ink may be an ink composed of a volatile liquid and a binder (for example, phenol resin varnish, linseed oil varnish, and alkyd resin), and the pigment may be a pigment.

Next, a portable voice recorder to which the audio information recording device is applied will be described. (A) and (B) of FIG. 9 are external views. The portable voice recorder includes a main body 76, a main body side and a detachable member (a surface fastener, a magic tape (registered trademark)) 78A,
A voice input unit 80 that can be attached to and detached from the main body 76 by 78B
Consists of A recording start button 82 and a print sheet discharge unit 84 are provided on the surface of the main body 76. Note that the main body 76 and the audio input unit 80 are connected by a cable 86. Of course, a signal may be transmitted from the voice input unit 80 to the main unit 76 by wireless or infrared rays.

FIG. 10 is a block diagram of such a portable voice recorder. The sound input from the microphone 88 is amplified by a preamplifier 90, converted to digital by an A / D converter 92, and compressed by a compression processing unit (ADPC).
M) 94. The compressed data is
The error correction code adding section 96 adds an error correction code, and the result is supplied to an interleave section 98, where each data is stored, and thereafter, an interleave process is performed. The data interleaved in this way is further processed by an address data adding unit 100 to the address of the block and an error determination code (CRC) for the address.
And the like, and the result is input to the modulation circuit 102. The modulation circuit 102 converts 8-bit data, such as 8-10 modulation, into another 10-bit data. Then, in the marker adding unit 104,
A marker is generated and added using a data string that is not included in the 256 data strings associated with the modulation circuit 102.

The data to which the marker has been added in this way is sent to the simple printer system 106, and the data shown in FIG.
As shown in (B), the print is printed on the reel seal 108 and discharged from the print sheet discharge unit 84. in this case,
The simple printer system 106 prints the date and time measured by the timer 110 on the reel sticker 108.

Each of the above-described units is provided with a recording start button 82.
Is controlled by the control unit 112 in accordance with the operation of. Also,
There is no particular limitation on which part of the above-mentioned components from the microphone 88 is configured in the audio input unit 80. For example, here, the microphone 88, the preamplifier 90, the A / D converter 92 are built-in.

FIG. 12 is an operation flowchart of the portable voice recorder having such a configuration. That is, the body 76
Is pressed (step S12), the recording start button 82 is pressed (step S1).
4) Processing from voice input to printing of the dot code 114 on the reel seal 108 is performed (step S1).
6). Then, when the pressing of the recording start button 82 is stopped, the recording start button 8 is again pressed within a predetermined time.
It is determined whether or not 2 has been pressed (step S18),
If it is determined that the button has been pressed, the process returns to step S14 to repeat the above processing. However, if the recording start button 82 has not been pressed within a certain period of time, the current date and time are referenced by the timer 110 (step S10).
20) While feeding the margin portion 116 on the reel seal 108, the date and time of the reference are printed (step S22).

In such a portable voice recorder, when the main body 76 and the voice input section 80 are connected as shown in FIG. 9A, the user holds the main body 76 by hand and holds the voice input section 80. Put the voice close to the mouth and dot code 114
Is recorded on the reel seal 108. Also, as shown in FIG. 9B, the main body 76 and the voice input unit 80 are separated, and the voice input unit 80 is attached to the receiver side of the telephone handset using the detachable member 78B, so that the telephone Instead of writing down the content, the other party's business can be directly recorded on the reel sticker 108 as a dot code 114. Moreover, in this case, as shown in FIGS. 11A and 11B, not only is the date and time printed on the reel seal 108, but also a blank portion 116 is formed. And write comments such as to whom.

It is to be noted that the voice input section 80 may have various modes other than the configuration in which the voice input section 80 is detachably attached to the main body by the detachable member as described above. For example, as shown in FIGS. 11C and 11D, an earphone type can be used. In the case of such an earphone type voice input unit 80, as shown in FIG.
6 and inserted into the user's ear, the voice can be recorded in the form of a dot code while listening to the other party's voice heard from the receiver side of the telephone handset.

In the above description, the recording start button 82
The dot code printing is performed only while the button is kept pressed. However, a separate recording end button is provided on the main body 76, and the dot code printing is performed after the recording start button 82 is pressed once until the recording end button is pressed. Printing may be performed.

The recording apparatus may be provided with a reproducing function as shown in FIG. 3 to form a recording / reproducing apparatus. At that time, the earphone type voice input section 80 may also have an earphone function.

In the above embodiment, audio information such as voice and music has been described as an example of information to be recorded. However, the present invention is not limited to audio information. For handling so-called multimedia information including video information, digital code data such as text data obtained from a personal computer (hereinafter, referred to as a personal computer), a word processor (hereinafter, referred to as a word processor), and the like. explain.

FIG. 13 is a block diagram of a multimedia information recording apparatus for recording such multimedia information.

Among the multimedia information, audio information is input from a microphone or an audio output device 120 and input to a preamplifier 122 as in the case of FIG.
After being amplified by the A / D converter 124, it is converted into a digital signal by the A / D converter 124 and supplied to the compression processing unit 126.

In the compression processing section 126, an input digital audio signal is selectively supplied to a voice compression circuit 130 such as an ADPCM circuit and a voice synthesis coding circuit 132 by a switch 128. The audio compression circuit 130 performs data compression by performing adaptive differential PCM on the input digital audio information. The speech synthesis coding circuit 132 recognizes one voice with respect to the input digital audio information and then converts it into a code. This is because the ADPCM encodes it in the form of audio information and reduces the amount of data, that is, processes it as it is, but once changes it to another synthesized code, it is relatively possible. It reduces the amount of data.
Regarding the switching of the switch 128, for example, the user manually switches according to the purpose, for example. Alternatively, for example, information of high sound quality such as information from an audio output device is passed through a voice compression circuit 130, and information such as a human voice or comment from a microphone is passed through a voice synthesis coding circuit 132. If determined in advance as described above, it is also possible to adopt a configuration in which the input audio information is recognized at the preceding stage of the switch and automatically switched.

Various kinds of data, which are already formed as digital code data and come from a personal computer, word processor, CAD, electronic organizer, communication, etc., are first transmitted through an interface (hereinafter referred to as I / F) 134 in a data format. The signal is input to the determination circuit 136. The data form determination circuit 136 basically determines whether or not compression can be performed by the compression processing unit 126 at the subsequent stage. The data has already undergone some compression processing. The compression processing unit 126
Is passed directly to the subsequent stage of the compression processing unit 126, and when the input data is uncompressed data,
It is sent to the compression processing unit 126.

The data determined to be uncompressed code data by the data form discriminating unit 136 is input to the compression processing unit 126, and the code data is optimized by a compression circuit 138 such as a Huffman, arithmetic code, or Jiblempel. Is performed. The compression circuit 138 also performs a compression process on the output of the speech synthesis coding circuit 132.

The speech synthesis coding circuit 132
May be converted to speech synthesis code by recognizing character information other than speech.

The image information of the camera or video output device 140 is supplied to the compression processing unit 126 after being amplified by the preamplifier 142 and A / D converted by the A / D converter 144.

In the compression processing unit 126, the image area determination and separation circuit 146 determines whether the input image information is a binary image such as a handwritten character or a graph or a multivalued image such as a natural image. . This image area determination and separation circuit 146
Separates binary image data and multi-valued image data using a discrimination image area separation method using a neural network as disclosed in Japanese Patent Application No. 5-163635 filed by the present applicant. Then, the binary image data is compressed by a binary compression processing circuit 148 such as a general MR / MH / MMR or the like by JBIG or the like as binary compression, and the multi-valued image data is a static image such as DPCM or JPEG. Is compressed by the multi-level compression processing circuit 150 by using the compression function.

The data that has been subjected to the compression processing as described above are appropriately synthesized by the data synthesis processing unit 152.

Note that it is not always necessary to provide all the information input and compression processing systems in parallel, and one or a plurality of systems may be appropriately combined according to the purpose. Therefore, the data synthesizing section 152 is not always necessary, and is omitted for those having only one type of data system,
A configuration in which the data is directly input to the next-stage error correction code adding unit 154 may be employed.

The error correction code adding section 154 adds an error correction code and inputs the code to the data memory section 156. Each data is stored in the data memory unit 156, and thereafter, an interleave process is performed. This will reduce any errors when actually recorded as a dot code and playing it back, for example
This is a process of dispersing continuous data strings to appropriately distant positions in order to improve the correction capability by eliminating block errors due to noise or the like. That is, an operation of reducing the risk of a burst error into a bit error unit is performed.

The interleaved data is further processed by an address data adding section 158 to the address of the block and an error determination code (CR) for the address.
C etc.), and the result is input to the modulation circuit 160. The modulation circuit 160 performs, for example, 8-10 modulation.

In the above-described embodiment, it goes without saying that a code for error correction may be added after interleaving.

After that, the marker adding section 162 generates and adds a marker using a data string which is not included in the 256 data strings associated with the modulation circuit 160. By adding the marker after the modulation as described above, there is an effect of solving the problem that even the marker is modulated, which makes it difficult to recognize the marker.

The data to which the marker has been added in this manner is sent to the synthesizing and editing processing unit 164, and is synthesized with, for example, images, titles, characters, etc., which are recorded on a recording paper other than the generated data, or The layout and the like are edited, and the data is converted into an output format to a printer and a data format compatible with printing and plate making, and is sent to the next printer system or printing plate making system 166. Then, the image is finally printed on a sheet, tape, printed matter, or the like by the printer system or the printing plate making system 166.

The editing processing in the synthesizing and editing processing section 164 is performed by setting the layout of the page information and the dot code, the dot size of the code to the resolution of a printing machine, a printer, etc. This includes editing operations such as changing the length as appropriate and changing the length, that is, changing the length of one row to the next line.

The printed matter thus printed is, for example, F
Sent by AX168. Of course, instead of printing the data generated by the combining and editing processing unit 164, the data may be directly transmitted by fax.

Here, the concept of the dot code 170 in the present embodiment will be described with reference to FIG. In the data format of the dot code 170 according to the present embodiment, one block 172 includes a marker 174, a block address 176, an address error detection / error correction data 178, and a data area 1 in which actual data enters.
80. That is, in the embodiment described with reference to FIG. 2A, one block is one-dimensionally configured in the line direction, but in the present embodiment, two blocks are two-dimensionally developed. It is formed in a shaped form. The blocks 172 are vertically, horizontally, and two-dimensionally arranged, and are collected to form a dot code 170.

Next, the configuration of the multimedia information reproducing apparatus will be described with reference to the block diagram of FIG. This information reproducing apparatus detects a dot code from a sheet 182 as a recording medium on which a dot code 170 is printed, and performs scanning for recognizing the image data supplied from the detection unit 184 as a dot code and normalizing the image data. A conversion section 186, a binarization processing section 188 for converting multi-level data into binary, a demodulation section 190, an adjustment section 192 for adjusting a data string, a data error correction section 194 for correcting a read error and a data error during reproduction, and a data The data separation unit 196 separates the data according to each attribute, a decompression processing unit for data compression processing according to each attribute, a display unit or a reproduction unit, or another input device.

In the detecting section 184, the dot code 170 on the sheet 182 is illuminated by the light source 198, and the reflected light is converted into an image forming optical system 200 such as a lens and a spatial filter 202 for removing moire and the like. The information is detected as an image signal by an imaging unit 204 such as a CCD or CMD that converts light information into an electric signal, and is amplified by a preamplifier 206 and output. The light source 198, the imaging optical system 200, the spatial filter 202, the imaging unit 204, and the preamplifier 20
Reference numeral 6 denotes an external light shielding unit 208 for preventing disturbance to external light.
Is configured within. The image signal amplified by the preamplifier 206 is converted into digital information by the A / D converter 210 and supplied to the next-stage scan converter 186.

The image pickup section 204 is controlled by the image pickup section control section 212. For example, when an interline transfer type CCD is used as the imaging unit 204,
The imaging unit control unit 212 stores a V blank signal for vertical synchronization, an imaging device reset pulse signal for resetting information charges, and a two-dimensionally arranged charge transfer accumulation unit as control signals for the imaging unit 204. Charge transfer gate pulse signal for sending the transferred charges to a plurality of vertical shift registers, and a horizontal charge transfer CLK which is a transfer clock signal for a horizontal shift register for transferring charges in the horizontal direction and outputting the charges to the outside.
And a vertical charge transfer pulse signal for transferring the plurality of vertical shift register charges in the vertical direction and sending the signals to the horizontal shift register. The timing of these signals is shown in FIG.

Then, the imaging section control section 212 supplies the light source with a light emitting cell control pulse for setting the light emission timing of the light source 198 in accordance with this timing.

Basically, the timing chart of FIG. 16 is a conceptual diagram for one field. The image data is read between the V blank of this one field and the V blank. The light source 198 performs pulse lighting instead of continuous lighting, and synchronizes with each field,
Subsequent pulse lighting is performed. In this case, the timing is controlled such that exposure is performed during the V blanking period, that is, while no image charge is output, so that clock noise during pulse lighting does not enter the signal output. That is, since the light emitting cell control pulse is a very thin digital clock pulse generated instantaneously and gives a large power to the light source, it is necessary to prevent noise due to the light from entering the analog image signal. It is necessary, and as a measure for this, the light source is pulsed during the V blanking period. By doing so, the S / N is improved.
In addition, the pulse lighting means that the light emission time is shortened, and thus has a great effect of eliminating the influence of the blur due to the shake and movement of the manual operation. This enables high-speed scanning.

Further, even if the reproducing apparatus is tilted and disturbance such as external light enters for some reason in spite of the presence of the external light shielding portion 208, the S / N deterioration is minimized. , Once before the light source 198 emits light during the V blanking period, an image sensor reset pulse is output to reset an image signal, and light emission is performed immediately thereafter.
Reading is performed.

Here, returning to FIG. 15, the scan conversion unit 186 will be described.
Will be described. The scan conversion unit 186 recognizes the image data supplied from the detection unit 184 as a dot code,
This is the part for normalizing. As a method, image data from the detection unit 184 is first stored in the image memory 214, read out therefrom once, and sent to the marker detection unit 216. The marker detector 216 detects a marker for each block. Then, the data array direction detection unit 218
Detects the rotation or tilt and the data arrangement direction using the marker. The address control unit 220 reads out image data from the image memory 214 based on the result so as to correct the image data and supplies it to the interpolation circuit 222.
At this time, lens aberration information is read from the memory 224 for correcting distortion of the lens in the imaging optical system 200 of the detection unit 184, and the lens is also corrected. Then, the interpolation circuit 222 performs an interpolation process on the image data to convert the image data into an original dot code pattern.

The output of the interpolation circuit 222 is output to the binarization processing unit 1
88. Basically, as can be seen from FIG. 14, the dot code 170 is a pattern of white and black, that is, binary information, and is therefore binarized by the binarization processing unit 188. At this time, the threshold value determination circuit 226 adaptively performs binarization while determining the threshold value in consideration of the influence of disturbance, the influence of signal amplitude, and the like.

Since the modulation described with reference to FIG. 13 is performed at the time of recording, the demodulation section 190 first demodulates the data, and then inputs the data to the data string adjustment section 192.

In the data sequence adjusting section 192, first, the block address of the above-described two-dimensional block is detected by the block address detecting section 228, and thereafter, the error detection and correction of the block address are performed by the block address error detecting and correcting section 230. After performing, the address control unit 23
2, the data is stored in the data memory unit 234 in block units. By storing data in units of block addresses in this way, data can be stored without waste even when data is lost or entered halfway.

Thereafter, the data read from data memory section 234 is subjected to error correction by data error correction section 194. The output of the error correction unit 194 is branched into two, one of which is sent to a personal computer, a word processor, an electronic organizer, or the like via the I / F 236 as digital data. The other is supplied to a data separation unit 196, where images, handwritten characters and graphs, characters and line drawings,
Sound (2 for the sound as it is and for the voice synthesized)
Types).

The image corresponds to a natural image and is a multi-valued image. In this case, a decompression process corresponding to JPEG at the time of compression is performed by the decompression processing unit 238, and further, data that cannot be error-corrected is interpolated by the data interpolation circuit 240.

Further, with respect to the binary image information such as handwritten characters and graphs, the decompression processing section 242 performs decompression processing on the compressed MR / MH / MMR and the like. Interpolation of data for which error correction is not possible is performed.

[0095] Characters and line drawings are converted into another display pattern via a PDL (page description language) processing unit 246. Note that, in this case, if the line drawing and the character are subjected to the code compression processing after being coded, they are subjected to decompression (Huffman, Jiblempel, etc.) processing by the corresponding decompression processing unit 248, and then PD
The data is supplied to the L processing unit 246.

The data interpolation circuits 240, 244 and P
The output of the DL processing unit 246 is
According to 0, the data is synthesized or selected, converted into an analog signal by the D / A converter 252, and displayed on a display device 254 such as a CRT (television monitor) or FMD (face mounted display). Note that the FMD is a spectacle-type monitor (handy monitor) for wearing on the face, and is effective, for example, for applications such as virtual reality or when viewing a large screen in a small place.

For audio information, the decompression processing unit 2
At 56, the decompression process for the ADPCM is performed, and further, at the data interpolation circuit 258, interpolation of data for which error correction cannot be performed is performed. Alternatively, in the case of speech synthesis, the speech synthesis unit 260 receives the speech synthesis code and actually synthesizes the speech from the code and outputs the synthesized speech. In this case,
When the code itself is compressed, as in the case of the character and the line drawing, the decompression processing section 262 performs decompression processing such as Huffman or Jibrempel, and then performs speech synthesis.

Further, as shown in FIG. 17, text information may be recognized by the text recognition unit 271 and then output as voice information by the voice synthesis unit 260.

The decompression processing unit 262 can also be used as the decompression unit 248. In this case, the data is expanded according to the attribute of the data to be decompressed by the switches SW1 and SW2.
2 and 3 are appropriately switched, and the PDL processing unit 24
6, or input to the speech synthesizer 260.

Data interpolation circuit 258 and speech synthesizer 26
The output of 0 is synthesized or selected by a synthesizing or switching circuit 264, converted into an analog signal by a D / A converter 266, and then output to a speaker, headphones, or other audio output device 268 equivalent thereto.

Also, characters and line drawings are output directly from the data separation unit 196 to a page printer or plotter 270, and the characters or the like are printed on paper as word processing characters. It can be done.

Of course, for images, CRT and FM
In addition to D, it is possible to print with a video printer or the like, and it is also possible to take a picture of the image.

Next, the data string adjusting section 192 will be described. Here, in order to apply the present invention to the above-described audio information reproducing apparatus (see FIG. 3), the dot code is a block address 272A indicated by reference numeral 272 and its error correction data 272B as shown in FIG.
Are arranged two-dimensionally, and a linear marker 274 as shown in FIG.
Are described in the vertical direction, and a line address 276A indicated by reference numeral 276 and error detection data 276B are arranged for each line of each block.

In the present embodiment, as shown in FIG. 18C, the pitch is doubled for each line and the center of the marker is further reduced as compared with the scanning method described with reference to FIG. Is detected, the space between the center lines of the markers is equally divided by twice the number of dots. That is, as shown in FIG.
In the first scan, the dot 278 is finely vertically
A horizontal half, that is, a quarter is taken. The pitch in that case is taken at the same interval as the dots 278,
Therefore, data is obtained every other dot. In this manner, data up to the CRC error detection data 276B, for example, if one block has 64 dots, 64 dots are taken in every other dot.

Then, first, it is confirmed whether or not the line address can be actually read by using the latter line address 276A and the CRC error detection data 276B for the line address. If the line address is readable, it is determined that the preceding data dot itself is also correctly readable. If it is determined to be wrong, a second scan is performed by shifting one dot, for example, to the right (the black circle in (D) in the figure). This is 6
All four dots are fetched, and it is similarly confirmed whether the line address has been actually read. If wrong, 1
The third scan, shifted one dot down from the first dot,
If it is still wrong, shift one dot to the right
A second scan is performed.

As described above, if the scanning of one line is repeated four times, it is considered that at least one of them can be correctly read. If it is determined that the data is correctly read, the data is written to the data memory unit 234. .

In this case, when the line address of the fetched line is, for example, "0" (start address), that is, when it is recognized as the first line, it is determined that the preceding data is the block address 272A and the error correction data 272B. . The error correction data 272B can be used for error detection of a block address, such as CRC, or error correction of Reed-Solomon of a block address in addition to error correction depending on the purpose.
Then, when the first address line 0 is recognized, the block address 272A is read first, and it is determined from this address data which block the block is in. On the other hand, since the actual data is entered from the next line, the data is read, and the data is written to the block of the data memory unit 234 corresponding to the block.

In the above description, when there is no error while scanning one line, the scanning is skipped to the scanning of the next line. However, the scanning is always repeated four times per line. You may do it. At that time, it is determined that there is no error a plurality of times, but the data memory unit 234 stores
There is no problem since the same data is only written at the same address. To simplify the processing, the scanning is repeated four times. When priority is given to speed, the former scanning method is adopted.

The actual configuration of the block address detecting section 228 and the block address error detecting / correcting section 230 for realizing the operation of the data string adjusting section 192 will be described with reference to FIG.

When 10 bits of the binary interpolation data enter the shift register 190A, the demodulation section 190 converts the binary data into 8 bits using a look-up table (LUT) 190B.

In the data string adjusting section 192, the demodulated data is temporarily stored in the buffer memory (all 64 dots are stored) 2 under the control of the write address control section 280.
82. Then, only the line address information and the CRC information for the address are read out by the data read address control unit 284, and the line address error detection circuit 286 detects an error. When the determination signal indicating the result of the error detection is true, that is, when there is no error, the data read address control unit 284 reads the information before the line address information from the buffer memory 282, that is, the actual data information.

On the other hand, start address detection circuit 288
Confirms whether or not the line address where the error detection is performed by the line address error detection circuit 286 is a start address. Upon detecting the start address, the start address detection circuit 288 informs the block address detection circuit 290 that the line is a line having a block address as information. 282
, A block address is detected from the data read out from the CPU, and an error detection circuit 292 performs error detection and correction. Then, the result is latched by the address control unit 232 of the data memory unit 234 as a block address.

It should be noted that only an error detection is added to the line address in order to obtain an accurate read position, but an error correction code is added to the block address because it is used as address information.

[0114] Since the subsequent lines become data lines sequentially, the data lines are written into the data memory section 234 as data. At that time, depending on the processing, a line address is output together if necessary. Alternatively, if there is an internal counter, the line address can be automatically counted up internally.

When the next start address "0" is detected, it is recognized as the next block, and the same operation is repeated for all the blocks.

On the other hand, the line address error detecting circuit 28
6 is also supplied to the address control unit 220 of the image memory 214. This is a signal necessary in the case of skipping to the next line when the data becomes true in order to shorten the time in four scans per line.

In the above example, the line address error detection circuit 286 performs the address detection on the interpolation data by using the same address information for four times until it becomes true. Then, when the data becomes true, the address is skipped once to the data line of the next dot of the new next line, interpolation data is created, and then four points in the interpolation data are read out. Therefore, for such control, a determination signal is passed to the address control unit 220 of the image memory 214, whereby the same address is generated four times to perform interpolation, reading is performed while changing the interpolation order, or A process is performed in which the address is rewritten to the next line, the data on that line is output, and the data is output four times while interpolating.

Although not shown, the address control section 232 of the data memory section 234 performs mapping to the data memory section 234. When reading further, the address control section 232 controls the de-interleaving. Also do. Again, using a look-up table, for example, when an address for each dot occurs,
From the data obtained by combining the block, the line, and the dot address, conversion is performed using a ROM or the like so as to become a memory data string actually appearing in a lookup table. That is the work of de-interleaving (de-shuffling), and the data is read out in the form of the original data sequence only after the processing is performed. Of course, this de-interleaving may be performed at the time of reading from the data memory unit 234, or at the time of writing, such conversion is performed once and data is written in a random order (mapping).
It may be so.

In this example, the marker 274 has a line shape, but may be a circle as shown in FIG. 14 or a square marker. Once a marker is detected, the rest of the block is read on a line, so that the marker need not necessarily be line-shaped. For example, as shown in FIGS. 20A to 20C, markers 294 and 29 of circle, square, and rectangle are used.
6,298 are conceivable.

If the printed code is substantially accurate without any partial bleeding or misalignment, it can be said that (approximate center = correct center). The processing can be performed only by the approximate center detection processing described later. However, in this case, in order to detect the arrangement direction, dots 294A,
296A and 298A are provided.

FIG. 20D shows another aspect of the multimedia information reproducing apparatus. This is the detection unit 18
4 is transferred to the scan conversion unit 186, and the block address detection unit 22 of the data string adjustment unit 192 is transferred.
8 and the function of the block address error detection and correction unit 230 are performed in the scan conversion unit 186.
The configuration after the data error correction section 194 is the same as that of FIG.

That is, in FIG. 20D, the most different point from the configuration shown in FIG.
6 and the data string adjusting unit 192. In this embodiment, the function of the data string adjusting unit 192 is
Are performed simultaneously from the marker detection unit 216 to the address control unit 220. That is, the marker is detected by the marker detecting unit 216, and the data array direction, that is, the tilt, rotation, and direction are detected by the data array direction detecting unit 218. Then, the block address detection, error determination, and accurate center detection unit 300 detects the block address, performs the error determination, and detects the correct center, that is, the true center depending on whether the block is erroneous or not. In this case, since the block address is detected when the true center is detected, the marker and block address are interpolated by the next marker and block address interpolation unit 302, and then the information of the block address is transferred to the data. It is also provided to the address control unit 232 of the memory unit 234.

As in the configuration of FIG. 15, address control is performed by the address control unit 220 based on the data of the interpolation processing of the block address, and the address, writing, and output are controlled in the image memory 214. Do.

Other than that, the function is not different from that of the embodiment of FIG.

In FIG. 15 and FIG. 20 (D), the detection unit 184 converts the data into, for example, 8-bit multi-valued digital data in the A / D conversion unit 210, and thereafter performs the processing. , The A / D conversion unit 210, and the binarization processing unit (comparator) 188 and the threshold value determination circuit 22
6 may be arranged at the A / D converter 210, and all subsequent processing may be performed using binary data.

In this case, the interpolation circuit 222 uses the pixel data around the interpolation address coordinates obtained from the address control unit 220 as shown in FIG. Instead of so-called interpolation processing, pixel data closest (near) to the interpolation address coordinates can be adopted as data.

By performing binarization and processing instead of A / D conversion, for example, compared with the case of 8 bits, 1 bit is obtained.
/ 8 signal lines and data amount. Therefore, the memory capacity of each of the image memory 214 and the data memory unit 234 is reduced to 1/8, and the processing of each unit is simplified. For example, the circuit scale is significantly reduced, the processing amount is significantly reduced, and the processing time is significantly reduced. This contributes to downsizing, low cost, and speedup of the apparatus.

It should be noted that the address output of the address control unit 220 is, in the case of FIG.
When the image data is output to the interpolation circuit 222, for example, four pixel addresses around the interpolation address coordinates are obtained.
Is distance information for calculating a weighting coefficient for each pixel address by a signal line (not shown). Alternatively, each pixel address and the interpolation address coordinate data may be sent, and the interpolation circuit 222 may calculate the distance from each pixel address to calculate the weighting coefficient.

Further, at the time of processing with binary data as described above, the address control section 220 outputs a pixel address near the interpolation address coordinates. Therefore, in this case, the data output from the image memory 214 is directly input to the demodulation unit 190.

Here, specific examples of the dot code shown in the conceptual diagram of FIG. 14 will be described with reference to FIGS.

The blocks 304 are two-dimensionally arranged as shown in the conceptual diagram of FIG. 14, and each has a block address 306 added thereto. The block address 306 has addresses corresponding to the X address and the Y address. For example, in FIG. 21A, the upper left block is (X address, Y address) = (1,
1). On the other hand, the block address of the block on the right side is (2, 1), and so on. In the same manner, the block address of which the X address is incremented toward the right and the block address of which the Y address is incremented toward the right are added. In all blocks 304, block address 3
06 is added.

Here, the lowermost marker and the rightmost marker are dummy markers 308. In other words, the block 304 corresponding to a certain marker 310 is the data at the lower right of the area surrounded by the four markers 310 including the marker, and the lowermost and rightmost markers are the second and lower right and second rows from the bottom. Auxiliary marker placed to define a block for the marker, ie, dummy marker 308
It is.

Next, the contents of the block 304 will be described. As shown in FIG. 21B, the block 304
The block address 306 and the error detection code 312 of the block address are added between the marker 310 and the marker below. Similarly, a block address 306 and its error detection code 312 are added between the marker 310 and the right marker. In the conceptual diagram of FIG. 14, there is a marker at the upper left of the block, and the block address is arranged at the lower right. However, in the present embodiment, the block address 306 is arranged at the left and upper sides, and the marker 310
In the upper left corner. Although the block address 306 is shown as an example where it is recorded at two locations in one block, it may be at one location. But,
By recording at two locations, even if an error occurs due to noise at one block address, it can be reliably detected by detecting the other address, so it is better to record at two locations. preferable.

The position of the data of the block with respect to a certain marker, the position of the block address, and the position of the dummy marker on the code determined by the block are not limited to the above example.

Next, an example of the pattern of the marker 310 will be described. As shown in FIG. 20C, in the present embodiment,
As the marker 310, a circular black pattern 310A having a diameter of 7 dots is adopted. And the black circle 31
The portion 310B around 0A is white, making it easy to determine the black portion of the marker. Reference numeral 310C in FIG. 21C is an auxiliary line for explanation.

The range of the white portion 310B is required to be as small as possible in order to increase the recording density, but is required to be large in order to perform the marker detection processing easily and at high speed. Therefore, the black pattern 310 when the rotation is 45 °
A range 310C for sufficiently determining A is a portion 310B.
It is set to enter.

The image magnification of the image forming optical system 200 in FIGS. 15 and 20 (D) is determined by the size of the data dot 316 in the data area 314 as shown in FIG. 21 (D). Under the conditions described below, it is assumed that an image is formed on 1.5 pixels. The pixel here means one pixel of the imaging element of the imaging unit 204. That is, one dot recorded on the sheet 182, for example, a dot of 30 to 40 μm,
It is assumed that an image is formed through an imaging lens on 1.5 pixels of pixels on the image sensor, which are usually 7 μm or 10 μm in size. According to the sampling theorem, the pixel pitch may be smaller than the dot pitch. However, in view of safety, the pixel pitch is set to 1.5 pixels hereafter. In the case of binarization in place of the above-mentioned A / D conversion, further safety will be considered.
Pixels.

The following advantages are obtained by adopting the two-dimensional block division method as described above. That is,
If the dot pitch of each dot is equal to or smaller than the resolution of the image sensor, a code (a set of unit data blocks) can be read even if the data dot size is different; even if the image pickup unit 204 is inclined with respect to the code. Can be read;
It can be reproduced even if there is local expansion and contraction of the sheet, and can be read even if it rotates. The unit block can be freely expanded two-dimensionally according to the total data amount.
As a result, the code size can be freely changed;
Since each block address is added, it is possible to reproduce even if reading is started in the middle of the code; if it is a block unit, the shape of the code can be freely adjusted according to other information on the paper surface, for example, characters, pictures, graphs, etc. Can be laid out,
Although a rectangular dot code is shown in FIG. 21 (A), for example, it may be key-shaped or slightly modified; a predetermined start code and a predetermined stop code such as a bar code. No code is required, and no clock code is required.

Also, by utilizing these characteristics, reproduction can be performed even if there is a camera shake. Therefore, it is very easy to handle a handy playback device.

That is, although the details will be described later, the playback device side
Since normalization is performed by detecting four adjacent markers and equally dividing the number of dots by the number of dots, there is an advantage that it is resistant to enlargement, reduction, deformation, and the like, and resistant to camera shake.

As for the dots 316 in the data area 314, for example, one dot has a size of several tens of μm. This can be up to several μm depending on the application and application, but is generally 40 μm.
Or 20 μm or 80 μm. The data area 314 has a size of, for example, 64 × 64 dots.
These can be freely expanded or reduced to a range in which the error caused by the above-mentioned equal division can be absorbed. Also,
The marker 310 has not only a function as a synchronization signal but also a function as a position index. This marker 310 has a size that is not included in the modulated data. In the present embodiment, the marker 310 has a round shape and a circle having a diameter of, for example, 7 dots or more or 7 × 7 dots relative to the dots in the data area 314. The black marker 310A is used.

Here, the inclination, rotation, and the like during reproduction will be described.

The inclination of the image pickup section 204 means that the reproducing apparatus is a sheet 182 on which dot codes are printed.
Is a state in which the user must hold the playback device obliquely, but is oblique to the sheet 182. In addition, the term “rotation” refers to a state in which the imaging area (see FIG. 4A) is not parallel to the dot code written on the sheet 182.

When the above inclination occurs, the image obtained by the image pickup unit 204 is reduced as compared with the image obtained when the image is vertically opposed. For example, if a 30-degree tilt occurs, the apparent projected image will be reduced to 86.5%. In other words, for example, if the block 304 is a square and is inclined 30 degrees in the horizontal direction with respect to the vertical direction, the horizontal portion becomes 0.865 times even in the vertical direction of 1: 1. It becomes a rectangle. With such an inclination, if the original internal synchronization clock is provided, each unit operates with the equally-spaced clock, so that the resulting data may not match the original data. .

The rotation is horizontal,
If the image is taken as vertical, the real data goes up diagonally or goes down diagonally, so that real information cannot be obtained. Furthermore, when a composite state of tilt and rotation occurs, the imaging result of the square block becomes a rhombus,
The condition that the horizontal and vertical data arrays are orthogonal is no longer satisfied.

Hereinafter, the marker detecting section 216 for solving these problems will be described. Marker detector 216
As shown in FIG. 22, a marker determination unit 318 that determines a marker by extracting it from a code, a marker area detection unit 320 that detects an area where the marker exists,
An approximate center detector 322 detects the approximate center.

The marker determination unit 318 searches for continuous black pixels of 7 or more and 13 or less, and recognizes a case where the continuous black pixels continue for seven consecutive lines as a circular black marker 310A.
As shown in FIG. 3, first, the image data read from the image memory 214 is binarized, and black and white are identified for each pixel (step S32). Then, black pixels continuous in the X-axis direction are detected on the image memory 214 (step S34). That is,
Consecutive black pixels of 7 to 13 pixels are detected. Next, it is checked whether or not a point shifted by one pixel in the Y-axis direction from the middle pixel of the first and last black pixels is black (step S36). Then, if this continues seven times in the Y-axis direction (step S38), it is determined as the circular black marker 310A (step S40). If the pixel is not detected in step S34 or is not a black pixel in step S36, it is not determined to be a marker (step S42).

That is, it is assumed that the marker is checked on the image memory, and there is a line in which, for example, seven black pixels continue. Then, it is checked whether the point shifted by one pixel in the Y-axis direction from the center of the first black pixel and the last black pixel is black, and if black, the left and right It is checked whether 13 consecutive pixels are black from 13 consecutive pixels, and the pixel is similarly shifted one pixel at a time in the Y-axis direction.
If it has been repeated a number of times, it is determined as the circular black marker 310A.

The minimum value 7 when checking continuous black in the X-axis and Y-axis directions is determined by discriminating the black portion of the marker 310 (circular black marker 310A) from the modulated data. This is a lower limit value set so that the data area 314 and the circular black marker 310A can be distinguished from each other even if there is a reduction due to paper shrinkage or inclination. The maximum value 13 is an upper limit value set in consideration of elongation of paper, bleeding of ink, and the like. This prevents noise such as dust or scratches larger than the marker from being erroneously detected as the marker.

Since the marker pattern 30A is circular, there is no need to consider rotation, so that the difference between the lower limit and the upper limit can be minimized, and false detection of markers can be reduced. Can be.

The marker area detecting section 320 determines that the range of the circular black marker 310A determined by the marker determining section 318 is
Some expansion and contraction due to changes in tilt, image magnification, etc.
Since it is deformed or the like, it is for detecting in which region the black range falls.

In this marker area detecting section 320, FIG.
As shown in FIG. 4, first, the provisional center pixel of the circular black marker 310A determined by the marker determination unit 318 is detected (step S52). That is, one pixel near the center of the range determined by the marker determination unit 318 is set as a temporary center pixel.

Then, it is checked from the temporary center pixel that the pixel is black in the upward direction (negative direction on the Y axis). If white, several pixels on the left and right are checked. The Y address is checked up to the Y address where no black exists, and the Y address is set in the Ymin register (see FIG. 25A) (step S5).
4). Similarly, it is checked that the pixel is black in the downward direction (positive direction on the Y axis) from the temporary center pixel. If white, the left and right pixels are checked. If black, the downward direction is checked in the same manner as above. It checks up to the Y address where black does not exist, and sets the Y address in the Ymax register (step S56).

Next, it is checked that the pixel is black in the left direction (negative direction on the X axis) from the temporary center pixel, and when it is white, it is checked that several upper and lower pixels are black. If there is, check the left direction in the same manner as above, check up to the X address where black does not exist,
It is set in the n register (step S58). Similarly,
Check that the pixel is black in the right direction (positive direction on the X axis) from the temporary center pixel. If white, check several upper and lower pixels. If black, check the right direction as above, and there is black. Until the X address is checked, the X address is set in the Xmax register (step S6).
0).

Xmin, Xmax, Y thus obtained
The marker area 324 is selected from the values of the min and Ymax registers as shown in the table of FIG. 25B (step S62). That is, not the area of the square including the circular black marker 310A, but the end of FIG.
The area indicated by hatching in FIG. The marker area 324 may be a square, but actually there is data around the white portion 310B of the marker 310, and the data is stored inside the white portion 310B due to the influence of a spatial filter or the like. It is conceivable that the user enters the marker area 324 for calculating the approximate center. In order to avoid this as much as possible, it is desirable to make the marker area 324 as small as necessary and in this case,
It is sufficient that a circular area having the same shape as the circular black marker 310A, that is, a circle and larger than the circular black marker 310A can be set, but in the present embodiment, the circular black marker 310A has a diameter of 7 mm.
Since it is a small circle composed of dots, it becomes a marker area 324 as shown in FIG.

The approximate center detecting section 322 is for finding the approximate center of the black circle of the marker in the marker area detected by the marker area detecting section 320 as described above. In general, in printing or the like, there is a phenomenon that a dot becomes wider than a target size due to ink swelling (this is called dot gain) or becomes smaller (this is called dot reduction). It is also assumed that the ink spreads around the periphery or the ink permeates to one side. The approximate center detecting unit 322 obtains the center of the image of the circular black marker 310A, that is, the so-called center of gravity, and processes the approximate center thereof in order to cope with such dot gain, dot reduction, or ink stain. I do. Here, the processing is for obtaining the center with an accuracy smaller than one pixel pitch.

First, for the marker area 324 on the image, the center line on the X axis and the center line on the Y axis of the image memory 214 are divided into two types in the X axis direction and the Y axis direction. By searching, the final center or approximate center is determined. FIGS. 25C and 25D are diagrams showing accumulated values of each pixel and each pixel in the vertical direction and the horizontal direction in FIG. The center of gravity is a half of the total cumulative value, that is, a portion where the upper, lower, left, and right cumulative values are equal.

First, in the case of (C) in the figure, for example, the result Sxl of each accumulation of the hatched portions in FIG. If it is not satisfied, and adding the next Sxc portion to it will exceed half the area, the column S
It can be determined that xc includes the center line X including the approximate center. That is, the X address at the approximate center accumulates the accumulated value of each column (Xk) from the left side (Xmin direction), and X ′ +
When one column is accumulated and exceeds half of the total accumulated value, there is an approximate center between the column of X 'and the column of X' + 1. X '
When the column of X ′ + 1 is divided into left and right so as to be added to the accumulated value up to and １ ／ of the entire area S, the division line includes the approximate center.

Therefore, the ratio of the portion excluding the portion accumulated from the area of 1/2 to the X-th column, that is, (1/2) S-Sxl, and the accumulated value Sxc of the middle column is Δx (approximately center = X '
+ Δx).

This will be described with reference to the flowchart of FIG.

First, normalization is performed (step S72).
That is, the white data portion is set to 0 so that the addition of the periphery to each data of the marker area 324 does not affect the accumulation.
Assuming that the black data is 1, the data in the image memory 214 is normalized as the data having the gradation of the multi-valued data. This is for the purpose of accurately recognizing the state because the periphery becomes blurred due to a spatial filter or the like and accurately and accurately detecting the center of gravity. Next, each column Xk (k
= Min, min + 1,..., Max) (step S74), and calls a gravity center calculation subroutine (step S76).

In the gravity center calculation subroutine, FIG.
As shown in the figure, the entire area S is obtained, and a half thereof is Sh.
And Sl is set to 0 (step S92), i = mi
n, that is, from the leftmost column (step S94),
It is obtained by calculating Sl '= Sl + Si (step S96). Initially, Sl = 0, so here Si
And Sl ′ = Smin. Next, Sl ′ is compared with Sh, that is, a size of の of the entire area (step S98). When Sl ′ does not exceed Sh, i is incremented (step S100), and S
By setting l ′ to S1 (step S102) and repeating from step S96, the next column is accumulated. Then, when the cumulative result exceeds half of the total area, Δ is obtained by subtracting Sl from S / 2 and dividing by S1.
x is obtained (step S104), and i, that is, X ′ is Δ
The sum of x is set as C (step S106), and the process returns to the upper routine.

In the higher-level routine, the value of C is set to X at the approximate center.
The coordinates are set (step S78).

Thereafter, the same processing is performed in each row direction in steps S80 to S84, the Y coordinate is obtained, and X and Y are set as the approximate centers of the markers (step S86).

The configuration for realizing such processing is as follows.
As shown in FIG.

The normalizing circuit 326 normalizes white data as 0 and black data as 1. The output of the normalization circuit 326 is accumulated by the accumulation section 328 so as to calculate the entire area S, is halved by the 掛 け multiplication section 330, and is latched by the latch circuit 332.

On the other hand, the output of the normalizing circuit 326 is delayed by delay circuits 334 and 336 for the block in the X-axis direction, and the accumulating section 338 accumulates the respective columns in the order from the left. Accumulation is performed for each column.
At the time of outputting the result, the central column Sxc is output.

The comparator 342 compares the half area latched by the latch circuit 332 with the accumulated value of each column accumulated by the accumulation section 338. The latch 344 stores the timing of the determination and the accumulation of the column up to that time. The X address calculation unit 346 outputs 1
/ 2 is determined to have exceeded the area, the latch circuit 33
2; the area Sxl latched by the latch 344; the cumulative value Sxc from the accumulator 340; and the X ′ supplied from the address controller 220 via the delay circuit 348. From the address corresponding to
The final X address of the approximate center of the marker is calculated.

Similarly, delay circuits 350 and 352, accumulators 354 and 356, comparator 358, latch 360 and Y
The Y address of the approximate center of the marker is calculated using the address calculation unit 362. In this case, the delay circuits 350, 3
52 is constituted by a line memory.

Here, the delay circuits 334, 336, 35
0, 352 are S / 2, Sxl, Sxc, Syl, Sy
This is a circuit for adjusting each output timing of c to the necessary timing of the X address calculation unit 346 and the Y address calculation unit 362.

Next, the data array direction detection unit 218 will be described. For convenience of description, the detailed arrangement of each block 304 of the dot code will be described first. The dot code blocks 304 are arranged as shown in FIG. 21B, but more specifically, FIG.
It is shown as follows. That is, the block address 30
6 is divided into an upper address code 306A and a lower address code 306B, and the error detection code 312 is also divided into an upper address CRC code 312A and a lower address CRC code 312B. And the marker 31
The lower address code 306B is arranged beside the 0, and the upper address code 306A is arranged beside the lower address code 306B in a size larger than the lower address code 306B. Next, a CRC code 312A for the upper address having the same size as the upper address code 306A is added, and further a CRC code 312B for the lower address having the same size as the lower address code 306B is added.

Below the marker 310, the block address and the error detection data are arranged in the above order toward the lower marker.

Here, the upper address code 306A and the upper address CRC code 312A are combined together in step 1
, The lower address code 306B and the lower address CRC code 312B are collectively referred to as step2 code.

When the lower address code 306B is disassembled, the upper and lower portions of the data of each dot (marker 3) indicating the lower address data are located on the right side of the marker 310.
The code which is inverted for the data is described in both (right and left in the case of 10 lower side). Further, a data margin portion 36 for distinguishing from the upper and lower data areas 314 is provided.
4 are provided. The data margin 364 may not be provided. The inversion code is added not only to the lower address but also to the upper address code. Here, in order to make the data easy to understand, dots are indicated by circles, but actually white circles indicate that there are no dots to be printed. That is, it is not to print a white circle. Hereinafter, white circles shown in the drawings indicate the same.

Here, assuming that the upper address and the lower address are, for example, all the addresses are composed of 12 bits, the first 4 bits are assigned to the upper address and the next 8 bits are assigned to the lower address. It's like hitting. The data length can be appropriately changed according to the device. Basically, for all the block addresses, there is a distinction as to how many of the block addresses from the beginning are to be the upper addresses, and from there to the lower addresses are to be the lower addresses.

By providing address codes in the horizontal and vertical directions as described above, there is an advantage that even if an address cannot be detected with a one-way address code, it can be detected with the other address code.

FIG. 29 shows another dot code arrangement.
This will be described with reference to FIG. This figure omits the vertical address code of FIG. Since the address code is only in one direction, the data area can be increased and the processing speed can be increased. If the address code is in one direction and the address code cannot be detected, the address of the block becomes unknown, but can be captured by the address interpolation processing described later.

In FIG. 29A, the block address code exists only between the markers in the horizontal direction, but a dot code having the block address code only in the vertical direction may be used.

Alternatively, as shown in FIG.
The upper address code 306A may be added between the lower address codes 306B, and the upper address CRC code 312A may be added between the lower address CRC codes 312B.

Hereinafter, the processing will be described based on the dot code shown in FIG. Only in the case of the process unique to the dot code in FIG.

FIGS. 30 and 31 are a block diagram of the data array direction detecting section 218 shown in FIG. 20D and a flowchart showing the operation thereof.

The data array direction detecting section 218 receives the data of the approximate center of the marker from the approximate center detecting section 322 of the marker detecting section 216, and the adjacent marker selecting section 366 selects an adjacent marker. That is, the approximate center detecting unit 32 has already been described.
The center address of each marker is mapped on one screen by the process of step 2, and a representative marker to be processed now, that is, a marker of interest is set (step S112). Next, an adjacent marker is selected to detect whether the approximate center is closest (step S114).

The process of selecting an adjacent marker is shown in FIG.
As shown in (1), the distance d between the representative marker and the adjacent marker is calculated, and the adjacent marker within the range of d ≦ dmax is specified (step S142). However, in this case, dmax is the length of the long side of the data block + α (α is determined by the expansion and contraction of paper, etc.). Then, the approximate center address is sent to the step 1 sample address generation circuit 368 in the order of shorter distance d from the designated adjacent markers (step S144).
For example, in FIG. 32B, the approximate center address at the distance D2 is closest to the representative marker, and the distance D
1 and D4, and then the approximate center address of D3 and D5. First, the approximate center address at the closest distance D2 is sent. If the distances d are the same, a marker is searched clockwise from the distance calculation start address, and direction detection is performed in the order in which the markers appear (step S146). That is, D1,
The approximate center addresses at the distances of D4, D3 and D5 are sequentially s
The signal is sent to the step1 sample address generation circuit 368 to detect the direction described later.

That is, the step 1 sample address generating circuit 368 generates a step 1 sample address centering on the approximate center of the representative marker and the selected adjacent marker (step S116), and generates a scanning line connecting the step 1 sample addresses. (Step S118), a read address is generated so as to sample data in the image memory 214 at a point where the scanning line is equally divided (step S1).
20). The address control unit 220 gives the address of the sample point to the image memory 214 as a read address, and reads data.

In the above description, the data at the sample point is approximated and output (from the image memory).
As shown in (A), when it is determined that the sample point is located between the data in the memory of the image, the sample point may be obtained by interpolation from the data of the surrounding four pixels.

After the read data, that is, the upper address code is detected by the error detection circuit 370 as an error, the upper block address calculation and center calculation circuit 372
Given to. The upper block address calculation and center calculation circuit 372 performs the next adjacent marker selection processing if there is an error as a result of the error detection in the error detection circuit 370. Since it is no longer necessary to detect the adjacent marker, the address calculation result is sent to the adjacent marker selection unit 366 to end the adjacent marker selection processing.

In the case where the dot code shown in FIG. 29A is used, the marker selection process ends when the upper address code in one direction is detected.

If the address calculation result indicates that there is an address error (step S
122), it is determined whether or not scanning of all sample points has been completed (step S124). If not, the process proceeds to step S118. If scanning of all sample points has been completed, the presence or absence of an unsearched adjacent marker is confirmed (step S124). Step S126),
If there is, the process proceeds to step S114; otherwise, the same process is performed for all markers. After the processing has been completed for all markers, the process proceeds to marker and address interpolation processing (step S128).

The error detection circuit 370 is provided in the Journal of the Institute of Television Engineers of Japan, Vol. 44, no. 11, p. 1549-
P. A general method such as error detection based on a cyclic code as disclosed in 1555 “Code Theory” may be used.

On the other hand, if there is no address error in step S122, it is determined whether or not scanning of all sample points has been completed (step S130). If not, the flow advances to step S118 to scan all sample points. If it has been completed, the upper address is determined (step S132),
Calculate the center address of step 1 (step S13
4), determined (step S136).

That is, the direction is detected from the marker closest to the representative marker (in FIG. 32B, the approximate center address is at the distance D2). The detection method determines in which direction there is a surrounding marker depending on whether an address recorded in a dot code (step 1 code) larger than the data dot for direction detection can be recognized. In the step 1 code, the upper block address and its CRC code are recorded, and it is assumed that if there is no error when the code is scanned, it is recognized.

When the direction is detected, the inclination of the data block can be predicted. The step 1 code has directionality, and the block address is normally recognized only when scanning is performed from the representative marker to the surrounding marker. Therefore, when a recognition error does not occur, a block address code in two directions is always detected. Processing is performed until a block address code in two directions is detected. Further, a data array can be estimated from the positional relationship in two directions (see FIG. 32C).

In the case of the dot code shown in FIG. 29A, an address code is detected only in one direction. At this time, the data area can be recognized from the detected line and the scanning direction (see FIG. 29B).

In the actual operation, the direction is detected from the distance D2 which is the shortest distance from the representative marker. If the address is not recognized, the search is performed clockwise.
The same operation is repeated at the next shorter distance D1. Detection is
If clockwise, detection continues with distances D4, D3, D5. Processing is performed until two directions are detected.

In the case of FIG. 29A, processing is performed until one direction is detected.

If one direction can be detected, the other direction can be predicted in some cases. For example, assuming that D4 and D5 are in the forward direction and D2 does not exist and the search is started from D4, if the address is confirmed at D4, it is predicted that the address can be recognized by either D3 or D5.

The above-described direction detection processing will be described in more detail with reference to FIG.

Approximate center detecting section 322 of marker detecting section 216
The approximate center of the representative marker detected in the above is defined as a dot A5 on the upper left side of the figure, and eight sample points A1 to 1.5 dots (which can be appropriately changed by processing) separated therefrom.
A4, A6 to A9 are generated by a step1 sample address generation circuit 368. Similarly, the marker whose direction is to be detected, for example, the approximate center of the distance D2 (dot B
A sample address is generated around 5).

Here, the reason why the 1.5 dot interval is used will be described.

In the processing for obtaining the approximate center of the marker, it has been described that the difference from the center is within one dot, but it is assumed that no problem such as ink bleeding occurs. Consider the ink bleeding etc. and set the detection range to ±
1.5 dots were used.

The address control section 220 draws a certain line between the addresses of both markers. First, a scanning line is drawn on the dots A1 and B1. Then, a sample clock is provided so that the upper address can be sampled,
A data sample of the image memory 214 is performed.

As shown in FIG. 28A, since the CRC code 312A is added to the upper address code 306A, if the data sample can be correctly read, the upper address code 306A is read. The error detection result of the error detection circuit 370 is detected in a form in which there is no problem, and if it cannot be read correctly, it is determined that there is an error.

Then, similarly, the dots A1 and B2,
A scanning line is sequentially drawn such as A1 and B3, A1 and B4, and it is checked whether an error is detected for each scanning line. In total, there are nine positions on the representative marker side and nine positions on the detection marker side, so that 81 kinds of processing are performed.

When an error occurs in all of the 81 processes, it is determined that there is no direction code in that direction, that is, the detection-side marker is a marker other than an array (a marker that has been erroneously detected).

For example, in FIG. 33A, the dot A1
When data is taken at each sample point on a scanning line (shown by a dotted line) drawn for and B7, the sample point indicated by a dashed circle in FIG. In particular, as described above, since an inversion code is provided on the upper and lower sides of the address data dot, an error always occurs.

On the other hand, when dots A5 and B5 are connected,
There is no detection error because data is properly collected,
Therefore, it is recognized that there is a code in this direction.

In order to facilitate error detection, inverted codes are provided on the upper and lower sides. However, it is not always necessary to provide inverted codes on the upper and lower sides. Can be a format in which black data continues for the latter half dots. In this case, the data at the end on the detection marker side always becomes black data, and the outside thereof becomes a white margin, so that a data error can be correctly detected. Also, when the inverted code is used, it is not necessary to provide the inverted code in the entire area of the inverted code part, and it may be provided in a part of both sides (FIG. 28C).

Now, the size of the dot will be described. As shown in FIG. 33B, the size of each dot of the upper address code 306A is n dots, step 1
If the width of the code is m dots, the relationship between m and n is s
At the inner end of the step 1 sample address, a width of 2 dots is provided with respect to the center, a diagonal line is drawn, and a width m determined by how much the upper address code 306A is provided.
Is the long side and the height of a rectangle having the diagonal as its diagonal is n. That is, once m is determined, n is necessarily determined. Even if the entire area between the inner edges of the sample address of step 1 is set to this address code, there are only 2 dots, so the n dots have a width of up to 2 dots. Further, the width of one dot is not determined, but is preferably a width that allows easy recognition of data.

[0209] Note that the above-mentioned two dots are, for example, a range in which a scan line connecting dots A5 and B5 hits, but a line connecting dots A6 and B4 and a line connecting A2 and B8 do not hit. It can be prescribed. If it is larger, for example, dot A
In the case of hits at 5 and B5, a hit occurs even when A2 and B8 are subtracted, and the detection as a center is spread. This value can also be changed according to the device.

In the example of FIG. 33A, the dot A
Hits for 5 and B5, but also for dot A4
For example, if a line connected to B4 is also hit, in the stage of the next center detection step 2, the same search is performed with the centers of the dots A4 and A5 as starting points. Processing will be performed.

Further, another method is also conceivable. This will be described with reference to FIG. Here, A4 and A5, B4 and B5 on one side
Is hit, the sample address (A4
1 to A45, A51 to A55, B41 to B45, B51
To B55) may be used as the sample address of the next step 2. In this case, since the number of sample address points in step 2 is increased from 9 to 10, the number of processes is also reduced from 81 to 1
00 (the number of scanning lines). However, A4 and A5
Since the process of deriving the midpoint and the use of a predetermined sample point, 9 steps 2 around the midpoint
No processing for generating the sample address is required. Overall, processing is likely to be reduced.

Further, assuming that there is a precise center of step 2 between A4 and A5, A42 to A44, A52 to
Assuming that the address detection processing is performed on the scanning lines connecting A54 with B42 to B44 and B52 to B54, the number of processings can be reduced from 81 to 36 (6 × 6).

In the above processing, a rough center in step 1 is obtained.

As described above, by detecting the CRC, it is detected whether the data blocks are properly arranged in that direction. FIG. 32 (B)
In this case, the marker located at the distance D2 is a marker that is erroneously detected. When looking at the direction of the data in that direction, there is no code of the upper address. Then, all errors will occur in that direction, and it will be determined that there is no direction.

When it is determined that there is no D2, the next closest distances are D1 and D4. However, since the marker turns clockwise with respect to the marker of interest, the next processing is performed on the distance D1. As described above, since it is possible to determine only from left to right and from top to bottom in the data arrangement, in this case, processing is performed in the direction from the representative marker to the marker at distance D1. , From the opposite direction, ie C
Since the RC code is read first and the address code is read next, this is naturally determined as an error.
Therefore, it is determined that there is no direction for the distance D1.

Next, the distance D4 is determined. When D4 is read along the distance D4 from the representative marker, the address code and the CRC code are read in this order, so that it is determined that D4 has directionality. That is, no error occurs.

Next, the objects to be judged are distances D3 and D5, which are equidistant. On the other hand, since it is clockwise, the processing is first performed from the distance D3. This D3
Also, since the CRC code is read first as described above, it is detected that there is no direction. Then, finally, by reading the distance D5, it is determined that there is a direction here.

As a result, since the distances D4 and D5 are read, the portions indicated by hatching in FIG.
It can be recognized that data corresponding to the block addresses described in the distances D4 and D5 are written. Eventually, if two directions are detected for one representative marker, the direction of that block can be detected. Therefore, processing is performed until two directions can be detected.

In the case of the dot code shown in FIG. 29A, only one direction is detected. The process is performed until one direction is detected (D5 in FIG. 29B).

If an error occurs when processing is performed for all of the above five directions, the above-described direction detection processing is performed for markers in the diagonal direction. In this case,
In order to prevent an increase in the number of processes, ones outside a certain range are not processed, and the address information etc.
Necessary information is obtained by marker and block address interpolation processing.

As described above, the block address is not modulated. However, if the block address is modulated, it is necessary to perform a process of demodulating after recognizing the block address code.

In the above description, whether or not there is a direction is determined by using error detection of the upper address. For example, instead of the upper address CRC code,
Use a method that uses a directional pattern such as “11100001” and recognizes that there is a directional marker in that direction when “11100001” is detected by pattern matching. Can also.

In the above direction detection, it is not necessary to search for an adjacent marker clockwise for all markers, and the next block is
An operation for recognizing the upper address code may be performed in that direction. That reduces the number of processes.
Also, when an abnormality occurs in the detection of the upper address, it may be recognized that the code exists in the direction obtained by detecting the peripheral direction.

Next, the block address detection, error determination, and accurate center detection unit 300 will be described with reference to the block diagram of FIG. 35A and the flowchart of FIG.

The upper block address calculation and center calculation circuit 372 of the data array direction detector 218 detects the upper block address when the upper address is detected, detects the next block address, determines an error, and detects the correct center. It is sent to the block address calculation and center calculation circuit 374 of the section 300. Further, since the rough center at the time of detecting the upper address can be found, this center address is set in step 2
It is led to the sample address generation circuit 376 (step S1).
52).

Step 2 Sample Address Generation Circuit 37
6 generates the approximate center sample address (step S154). That is, as shown in FIG. 35B, the rough center obtained earlier (the center of the direction detection)
In the same manner as above, sample addresses are placed outside of 8 points. Then, eight points or the like are provided for the markers for which the directionality has been found, and a scanning line is similarly drawn (step S156), and processing is performed to determine whether a lower address can be detected or not. In this case, the data interval for forming the sample address is defined every 0.5 dots in the present embodiment, but can be changed as appropriate according to the specifications of the apparatus.

The address control section 220 reads data from the image memory 214 based on the generated sample address, and derives data according to this sample point to the error detection circuit 378 (step S158). As in the direction detection (as shown in FIG. 5A), when the sample point is between the data in the image memory, 1
Instead of representing the data, the data may be interpolated and derived from surrounding data. If an error has occurred in the error determination (step S160), it is determined whether scanning of all sample points has been completed (step S162). If not, the process proceeds to step S156, and scanning of all sample points has been completed. If so, the process proceeds to marker / block address interpolation processing after addresses have been detected for all blocks (step S164).

On the other hand, if there is no address error in step S160, it is determined whether or not scanning of all sample points has been completed (step S166). If not, the flow advances to step S156 to scan all sample points. If it has been completed, the lower address is determined (step S168),
Determine the exact center (step 2 center) (step S
170).

That is, an error is detected by the error detection circuit 378, and if an error is detected in the error determination, the process proceeds to the next step. The block address calculation and center calculation circuit 374 receives a start and end address at the time of center detection from the address control unit 220, that is, a signal indicating which point is connected to which point. Determine whether or not it is possible. When there is no error detection, the block address calculation and center calculation circuit 374 combines the derived lower address with the upper address sent from the upper block address calculation and center calculation circuit 372 to generate a block address. To the next marker and address interpolation unit 302. Similarly, the center address is derived to the marker and block address interpolation unit 302.

In FIG. 35 (B), the reason why the dot is set to 0.5 dot is that the sample point is detected within the range of 0.5 dot and the center (final value) finally obtained by this processing is obtained. This is because the difference between the center of the direction detection) and the true center falls within the 1/4 dot range. If it falls within the 1/4 dot range, taking the sample points formed by the above process,
The data in the data area can be reproduced properly.

Since the smallest dot of the step 2 code is one dot, a data arrangement smaller than that is meaningless as data, so it is formed by one dot.

As in the case of the step 1 code,
Inversion codes may be provided above and below the address data dots, or black data may be provided in the last few dots, and the surrounding area may be a margin. A data margin 364 for distinguishing the address code from the data code.
Since the probability of being mistaken for a marker even when the area to be distinguished from the data area 314 is overlapped with black is very small, the data area 314 is not provided and the data area 314 is directly entered from the inversion layer. May be.

As shown in (B) of FIG. 35, as a result, the lower address and the upper address are almost half the data length of the entire data length, and the same size CR
C code is added. The reason for this is that the data length is set to this data length so that noise can be applied to the entire address length, ink can be applied, and a burst error in such a state can be detected. The ratio of the data length can also be changed as appropriate.

By the above-described tree search processing, that is, a detection method of obtaining a rough center and obtaining a finer center, an accurate center for sampling data in the data area 314 and a block address are recognized. It was done. That is, by performing a process called tree search, the processing is greatly reduced, and the processing amount and processing time are reduced as compared with the case where sampling is performed at a fine pitch from the beginning.
Further, by using the block address for the direction detection and the accurate center detection, the redundancy of the entire data amount can be reduced.

Next, the marker and address interpolation unit 302 will be described with reference to FIG. Now, it is assumed that the surrounding black marker portion has been detected in response to the error that the marker for the block B2 has not been detected or the address has not been detected.

In this case, a line connecting the marker of the block B1 and the center of the marker of the block B3 is drawn, and a line connecting the marker of the block A2 and the center of the marker of the block C2 is drawn. The prediction center. Then, address detection and processing can be performed further from the prediction center point toward the marker of block C2 and the marker of block B3. Also, even if address detection is not performed, since the arrangement is known, if the block B2 exists below the block B1, the address of the block B2 is set from the surrounding addresses. Can also be estimated. That is, it is possible to detect the address of the unpredictable block and the center of the marker that are currently focused on from the surrounding processing.

A marker and block address interpolation unit 302
, The address data and the center position, the interpolated address, and the information of the predicted center are combined and guided to the address control unit.

When the image data is fetched into the image memory 214 as shown in the figure and the scanning direction is the direction of the arrow, the upper left is set as the first representative marker, and the processing is performed on the first representative marker. The center is sequentially detected in the vertical direction,
By performing the first vertical detection, eight (blocks A1 to
The center of the marker of A4 and the markers of blocks B1 to B4) is obtained. When the center of the next column is detected, the centers of the markers of the blocks B1 to B4 are already known, so that the processing is not performed on the centers of the markers of the blocks B1 to B4. , The center of step 1 and the center of step 2 are determined. Therefore, as described above, 81 scanning lines are not necessary, and once the center is obtained, the processing may be performed so as to sample the subsequent nine points. Therefore, there are nine processings, and since the processing is more detailed, nine processings are performed. That is, 1
The center is determined by eight kinds of processing. in this way,
There is an advantage that the processing is performed only at the beginning but the processing after that is reduced.

In the case of the dot code shown in FIG. 29A, first, A1 is used as a representative marker at the upper left corner.
A direction detection process is performed in the horizontal direction with B1 and C1. Processing is A
Once the marker centers of 1 and B1 are determined, the center detection process of C1 may be performed in nine different processes. In order to determine that the block below A1 is A2, since there is no address code, processing is performed as described below.

That is, the size of the block may be determined from the lengths of the A1 marker and the B1 marker, and detection may be started from a marker located at an appropriate position based on the predicted block size, or the marker located immediately below A1 may be detected. May be performed as a representative marker first. Then, a block whose horizontal block address matches the detected block address may be set to A2. When the two-stage direction detection (stage A1 and stage A2 in the figure) is completed, the direction can be predicted in the process in the vertical direction (the process of selecting the marker A3), so that only the marker in that direction is detected. What is necessary is just to perform a process. Even if there is an erroneously detected marker, the processing can be performed excluding it.

Next, the address control section 220 of FIG. 20A will be described with reference to the block diagram of FIG.

First, in the address control section 220,
The address of the A / D converter 210 is stored in the image memory 214 by the address generated by the write address generator 380 that generates an address when writing data from the A / D converter 210 to the image memory 214. .

Then, as described above, the marker detecting section 2
16. It is necessary to generate an address in each of the data array direction detecting section 218, block address detection, error determination, accurate center detecting section 300, and marker / address interpolating section 302, and an address generating section 382 for that purpose.
To 388. In this case, the marker detecting address generator 382, the data array direction detecting address generator 384, the block address detection, the error determination,
In the accurate center detection address generation section 386, the corresponding marker detection section 216 (the internal marker determination section 31)
8. Marker area detector 320, approximate center detector 32
2), an address is generated by exchanging information with the data array direction detection unit 218, block address detection, error determination, and accurate center detection unit 300. Further, the interpolation processing address generation unit 388 calculates an address (hereinafter, referred to as a marker address) in which the exact center of each marker is associated with the image memory for a block in which four markers around the block exist, and Further, a memory read address of the interpolation address coordinate data obtained by equally dividing the inside of the block and pixel data in the vicinity thereof is generated.

The selection circuit 390 selects these address generation units 382 to 388 at respective timings and supplies them to the lens aberration distortion correction circuit 392. Then, the lens aberration distortion correction circuit 392 receives the lens aberration distortion information from the lens aberration distortion memory 224, and converts (corrects) the selectively supplied address.
The read address is given to the image memory 214 via the selection circuit 394.

Next, another embodiment of the marker judging section 318 in the marker detecting section 216 will be described with reference to FIGS. 38 (A) to 38 (C).

In the above-described embodiment, when the size of the dot code is determined, an image is formed by the imaging optical system 200 such that one dot corresponds to 1.5 pixels of the image pickup device of the image pickup section 204, The determination unit 318 finds a two-dimensionally continuous black pixel and determines it as a marker. On the other hand, in the present embodiment, when there are codes having different dot sizes, for example, a code having a dot size of 20 μm, a code having a dot size of 40 μm, and a code having a dot size of 80 μm, the image magnification in the imaging optical system 200 is not changed. To enable the reproduction of each code.

That is, in various applications, paper quality, sheet properties, ink, and printing level are different, and therefore, a code of a dot size corresponding to each application is used. For example, it is conceivable that 20 μm is used when the recording density can be greatly increased, and 80 μm is used depending on an application using a very rough low-cost sheet with poor sheet quality. In such a situation, judging its size,
The purpose is to play this code correctly.

That is, as shown in (B) of the figure, there are a marker having a circular dot size of 20 μm, a marker having a dot size of 40 μm, and a marker having a dot size of 80 μm.
The reproducing apparatus to which the present embodiment is applied is, for example, 20 μm.
It is assumed that the device is a device for efficiently reproducing the code of m, that is, a device having a magnification of an imaging system capable of decoding more information by one imaging. Then, in an apparatus in which the 20 μm dots are picked up at an image magnification of 1.5 times, the respective codes of 40 μm and 80 μm can be reproduced without changing the image forming system without changing the image magnification. That is the purpose. However, the size of the marker shown in (B) of the figure is 7 times the diameter of each dot size.

For this reason, as shown in (A) of the figure, first, the code of the maximum dot size to be selected is initialized (step S182). For example, 80 μm, 40
If there are μm and 20 μm codes and all of them are to be reproduced, the maximum size is set to 80 μm. This may be set by key input by the user, or if it is determined that there are three types, 80 μm, 40 μm, and 20 μm, and if it is possible to cope only with that size, the device itself will be the best. It may be set as a large size of 80 μm.

Then, the temporary center is obtained by making a determination using the marker determination formula in FIG. 18B (step S184).

That is, assuming that a code is created using seven dots of each dot size as markers, at that time, since the imaging optical system has an image magnification of 1.5 times, a code of 20 μm is used. Is 10.5 dots in diameter and 21 μm in diameter for a 40 μm code.
In the case of the code of, it is 42 dots. Therefore, if black pixels are two-dimensionally continuous from 7 pixels to 12 pixels, 20
Judgment as marker of μm code, 14 pixels or more and 24
Those below the pixel are judged as markers with a code of 40 μm,
Those having 29 pixels or more and 47 pixels or less are determined to be markers having a code of 80 μm.

The value of this pixel is calculated by the following equation.

R = s × d × mint (r × 0.7) ≦ R
≦ int (r × 1.1 + 1) where, r: number of pixels equivalent to the diameter of the marker (= 7) s: dot size (20 μm, 40 μm, 80 μm) m: imaging system image magnification (= 1.5) d: marker The number of dots having a diameter of R: the number of pixels of the diameter of a marker in a binary image 0.7: a reduction ratio due to inclination, dot rejection, etc. 1.1: an expansion ratio due to dot gain, etc.

Then, first, at step S182, 80
Since the marker is initially set to a μm code marker, in step S184, it is checked whether or not the marker is a 80 μm code marker by the marker determination formula, and a marker of that size (a marker composed of 80 μm dots) is determined. A temporary center is determined for the one determined to be present.

Next, the number of the markers is checked, and it is checked that there are four or more markers (step S18).
6). This means that a determination is made as to whether there is one or more blocks since one block is surrounded by four markers.

Then, it is confirmed whether or not the marker has a predetermined positional relationship with the adjacent marker as shown in FIG. 17C, that is, whether or not the marker is aligned (step S18).
8). That is, a marker B near the marker A of interest, a marker C near a position D away from the marker A of interest in a direction perpendicular to the direction connecting the markers A and B, and a marker B as a reference. A marker D located near a position separated by a distance D in the same direction as the direction from the markers A to C is detected.
If they exist, for example, it is determined that the code is 80 μm in this case.

In step S186, 8
If there are no four or more markers of the 0 μm code, or if it is determined in step S188 that they are not aligned, it is determined that this is not an 80 μm code, and one less code is used. 40 μm in this case
Is set again (step S190), and the process returns to step S184 to perform another marker determination.

If the smallest size cannot be determined, the process is terminated because the code is not a code or the code cannot be reproduced. In this case, it is preferable to proceed to a process of issuing a warning such as issuing an alarm.

Next, another embodiment of the marker determining section 318 will be described. That is, a method of determining a marker pattern and modulated data by dilation, which is general image processing, will be described. Here, the dilation process is a process of converting a black pixel near a white pixel into a white pixel. Specifically, for example, pixels around three pixels around the pixel of interest (a 7 × 7 pixel area centered on the pixel of interest) are checked (black and white determination), and if at least one pixel has a white pixel, the pixel of interest is converted to a white pixel. The conversion process is performed for all pixels on the image.

First, binarization processing is performed on the data in the image memory.

Next, only the data portion of the code image is converted into white pixels by the dilation process, and the pattern portion of the marker is converted into an image smaller than the original size by the number of dilated pixels. You.

Next, the address in the image memory of the transition point from the white pixel to the black pixel on the image and the number of continuous black pixels from the pixel are counted, and the information is classified for each marker based on the information. , The temporary center address and the marker existence range are detected. After that, the approximate center detection processing is performed.

As a result, it is possible to determine the marker and detect the marker existence range at high speed.

In the case of a code in which the marker is uniformly deformed with respect to the center of the marker, such as the dot gain and dot reduction described above, the temporary center address obtained in the above marker determination is used as the approximate center. You can also.

The processing of step S184 in FIG. 38A may be the above processing.

In the case where the above-described A / D conversion section is performed by binarization using a comparator, in the above-described marker determination processing,
Binarization processing can be omitted.

Next, a light source-integrated image sensor applicable to the detector 184 of the reproducing apparatus shown in FIGS. 15 and 20D will be described. FIG. 39 is a diagram showing the configuration. For example, a light emitting cell 3 is formed next to a light receiving cell 396 by a compound semiconductor such as an LED or an electroluminescent element.
98 is formed on-chip. Between the light receiving cell 396 and the light emitting cell 398, there is provided an isolation (light shielding) section 400 in which a cutter is actually formed on the wafer to form a groove, and a non-transmissive material such as a metal is embedded therein. With this isolation unit 400, it is possible to eliminate the problem that light emitted from the light emitting cell 398 directly enters the light receiving cell 396.

In such a configuration, the light emitting cell 39
8, light emission is controlled according to a light emitting cell control pulse signal as shown in the timing chart of FIG. The light receiving cell 396 sends the accumulated charge to the adjacent vertical charge transfer register 402 by applying a charge transfer gate pulse signal to a charge transfer gate (not shown). The vertical charge transfer register 402 sends the accumulated charge to the horizontal charge transfer register 404 line by line with a vertical charge transfer pulse.
The horizontal charge transfer register 404 outputs the accumulated charges one pixel at a time via the buffer amplifier 406 according to the horizontal transfer clock signal.

Next, in the circuit of the above-mentioned reproducing apparatus, up to the preceding stage of the demodulation circuit is implemented by an analog circuit.
An embodiment in the case where a chip is used will be described with reference to FIG. In the present embodiment, as the imaging unit,
For example, by using an XY address type imaging unit 408 represented by CMD as disclosed in Japanese Patent Application Laid-Open No. 61-4376, a memory is not required, and a circuit system can be reduced. It is possible to do. The X decoder 410 and the Y decoder 41 perform address scanning of the XY address type imaging unit 408.
2 are prepared.

In a normal XY address type imaging unit, CC
Unlike D, after reading out one line, this line is reset and the next line is read out. In other words, while a certain line is being read, another line enters an exposure period. It is a target. However, such a readout method has a disadvantage that when extraneous light enters during the imaging time, an extra portion is exposed, so in the present embodiment, the XY address type is used, and In combination with the element shutter, an operation is performed such that exposure is performed only when external light enters, that is, when exposure is to be performed, and the other portions are not exposed.

The image pickup element scanning address generation and element shutter control section 414 generates an element shutter pulse for providing an element shutter operation in an XY address manner, and generates a reset pulse for resetting all pixels. .

The X decoder 410 and the Y decoder 412 are circuits for turning on one of the elements in response to the X address and the Y address from the imaging element scanning address generation and element shutter control unit 414. Normally, the selector is constituted by a shift register or the like, but in the present embodiment, a selector of a type which can turn on any one of the elements by a signal from the image sensor scanning address generation and the element shutter control unit 414 is used.

The reset pulse in this embodiment corresponds to the image sensor reset pulse in the timing chart of FIG. 16. The image sensor is reset before the exposure, and during this reset period, the reset pulse is reset. By going high, the switch 416 is switched, drawing all of the charge toward the negative power supply 418.

The element shutter pulse is generated in such a manner that the gate can be applied from the end of the reset pulse to the end of the exposure as shown by the broken line waveform in FIG.

Reading is performed in the same manner as in a normal pulse.
Each element is sequentially turned on, and the signal charge is transferred to the current / voltage conversion amplifier 42 through the reset selection switch 416.
After amplification with 0, the signal is supplied to the marker detection unit 422. The marker detection unit 422 is the same as that described above, and the data detected by the marker is stored in the register 424. The θ detection unit 426 calculates the inclination based on the contents of the register 424 as in the direction detection unit described above. For example, in the circuit shown in FIG. 20D, the θ detection unit 426 corresponds to the data array direction detection unit 218, and the next data interval control unit 428 and the image sensor scan address generation and element shutter control unit 414 operate at the address. It corresponds to the control unit 220.

The coefficient for interpolation generated by the coefficient generator 430 under the control of the data interval controller 428 is multiplied by the charge read by the multiplication circuit 432,
All are added by the adder circuit 434. That is, the output of the addition circuit 434 is sampled and held by the sample and hold (S & H) circuit 436,
8 and is returned to the addition circuit 434. This behavior is
When data is sampled after the direction and the scanning line are determined, this is performed to perform data interpolation as shown in FIG. In FIG. 5A, interpolation is performed by multiplying D6, D7, D10, and D11 by coefficients in order to obtain Q data. The value thus interpolated is further added to the S & H circuit 440.
The comparator 442 and the threshold value determination circuit 444 binarize the sampled and held value.

Each image pickup element (pixel) of the XY address type image pickup section 408 will be described in more detail. Each pixel is composed of two CMD elements as shown in FIG. 41A, and the element shutter pulse is applied to the first CMD element 4.
46, the capacitor 4 stored for the element shutter
The charge is stored at 48. Then, the second CMD
The element 450 drives a read pulse from the Y decoder 412 to select a line, and reads the electric charge for each pixel from the horizontal selection switch 452.

At the time of exposure, the first CMD element 446 is operated as an element shutter by an element shutter pulse, and charges are stored in the element shutter capacitor 448. When the electric charge is accumulated in this way, light is shielded, a read pulse is applied from the Y decoder 412 to select a line, and the horizontal select switch 452 turns on the second CMD element 450 to read out one pixel at a time.

When resetting the electric charge, all the horizontal selection switches 454 are turned on by the reset pulse output from the image pickup element scanning address generation and element shutter control unit 414, and the reset selection switch 416 is set to the negative power supply 4
Set to 18 side. Since the source of the CMD element 450 has a negative voltage, the electric charges accumulated in the element shutter capacitor 448 and the gate of the CMD element 446 move to the negative power source and are reset.

In addition to the above operation, resetting can be performed by simultaneously applying a slightly higher voltage to the element shutter pulse and the read pulse.

In the case of a normal image pickup device, dark current is a problem.
In the state where the element shutter pulse is exposed only during the high period and the charge is immediately read out, the dark current accumulates in a very short time. The N ratio is advantageous as compared with the operation of other image sensors. In the exposure, a sufficient amount of light is given even in this short exposure period, so that the signal level remains unchanged and the S / N level with respect to the dark current decreases, so by applying this embodiment, A considerably large gain can be set for the output degree gain of the current-voltage conversion amplifier 420 in the subsequent stage.

In the present embodiment, the pixel configuration for performing the above-described element shutter operation is described.
It is also possible to use a CMD element capable of performing an element shutter operation as disclosed in Japanese Patent Application Laid-Open No. 6-204,199.

Next, referring to FIG. 42, X
A circuit using the Y-address type imaging unit 408 is a three-dimensional I
An embodiment constructed in a C-like manner will be described. Note that the present embodiment relates to a case of an audio information reproducing apparatus.

This is because the CM of the sheet 182 is
The imaging unit layer 454 including the D408, the X decoder 410, and the Y decoder 412, the detection unit layer 456 that detects data formed by being stacked on the imaging unit layer 454, and the detection unit layer 456 is stacked on the detection unit layer 456. The output processing layer 458 is formed. The output processing layer 458 includes the demodulation unit 19
0, an error correction unit 194, a decompression processing unit 256, a data interpolation circuit 258, a D / A conversion unit, an output buffer 266, etc., and the decoded audio information is reproduced as sound by an audio output device 268 such as an earphone.

Of course, this output processing layer 458 can be configured to reproduce multimedia information including image information as described above.

By using a three-dimensional IC as described above, processing up to sound output can be performed with one chip.
The circuit scale becomes extremely small, and also leads to cost reduction.

Next, various configuration examples of the pen-type multimedia information reproducing apparatus will be described.

For example, the pen-type information reproducing apparatus can be provided with a switch for instructing the timing for taking in the dot code.

FIG. 41B shows an example of such a pen type information reproducing apparatus. The pen type information reproducing apparatus shown in FIG. 15 or FIG. A detection unit 184 including the optical system 200, the spatial filter 202, the imaging unit 204, the preamplifier 206, and the imaging unit control unit 212.
Is provided at the tip thereof, and a scan conversion unit 186, a binarization processing unit 188, a demodulation unit 190, a data error correction unit 194,
Decompression processing unit 256, data interpolation circuit 258, etc.
It is incorporated as an image processing unit 460, a data processing unit 462, and a data output unit 464. Then, the audio output device 26
I have an earphone as 8. In this figure,
Although only an audio information output device is shown, when a processing unit for images, characters, line drawings, etc. is built in, it is needless to say that an output device corresponding to the device can be connected. The same applies in the description).

A touch sensor 466 is provided on the side of the pen-type information reproducing apparatus. As the touch sensor 466, for example, a piezoelectric switch, a micro switch, a piezoelectric rubber, or the like can be used, and a switch having a small thickness of 0.6 mm or less is known. The control unit as the imaging unit control unit 212 starts capturing the dot code as described above in response to the touch of the touch sensor 466 by the finger. And
When the finger is released from the touch sensor 466, the capturing ends. That is, the start and end of the dot code capture are controlled using the touch sensor 466.

Reference numeral 468 in the figure denotes a battery as an operating power source for each unit in the pen-type information reproducing apparatus.

The touch sensor 466 can perform the same function not only in the form of being pressed by a finger but also in a configuration in which it is attached to the tip of a pen-type information reproducing apparatus as shown in FIG. .

That is, when the user puts the pen-type information reproducing apparatus on the sheet 182 in order to manually scan the dot code printed on the sheet 182, the touch sensor 46
6 is turned on, the control unit 212 recognizes this and starts reading the dot code.

In this case, since the tip of the pen-type information reproducing apparatus moves in contact with the sheet surface during scanning, in this example, the tip of the touch sensor 466, that is, the surface in contact with the sheet surface is made of a smooth resin or the like. Is preferably configured to make smooth movement during manual scanning (moving).

[0295] A mechanism for removing specular reflection may be further provided in the detection unit of the pen-type information reproducing apparatus.

FIG. 44A is a view showing the structure, in which a first polarizing filter (polarizing filter 1) 470 is arranged on the front surface of a light source (light source such as LED) 198, that is, on the side to be irradiated. A second polarizing filter (polarizing filter 2) 472 is arranged on the front surface of the imaging optical system (lens) 200.

For example, the first polarizing filter 470 may be a polarizing filter film 474 as shown in FIG.
Is cut out in a donut shape, and the second polarizing filter 472 is different from another polarizing filter film 47.
6 can be used. For example, as shown in (C) of the figure, the inside of the polarizing filter film 474 cut out of the first polarizing filter 470 can be used.

Then, the first and second layers thus formed are formed.
Are arranged such that the pattern plane (polarization plane) of the second polarization filter 472 is orthogonal to the pattern plane (polarization direction) of the first polarization filter 470.

As a result, the plane of polarization of the random light emitted from the illumination light source 198 is limited by the first polarizing filter 470, and, for example, a P-wave is irradiated. Then, the specular reflection component returns as a P-wave from the sheet surface while the polarization plane is preserved as it is. However, since the polarization plane of the second polarization filter 472 is orthogonal to the first polarization filter 470, The reflection component is blocked by the second polarization filter 472. On the other hand, when light emitted from the first polarization filter 470 returns to actual dots, that is, light that returns on the sheet surface as luminance information on the paper surface, the plane of polarization is random. Therefore, the black-and-white information,
Alternatively, the signal returned as color information has both a P component and an S component. Among them, the P component is similarly cut by the second polarization filter 472, but the S component orthogonal thereto is passed through the second polarization filter 472 and actually passed through the lens 200. To form an image on the imaging unit 204. That is, the reflected light from which the specular reflection component has been removed is guided to the imaging unit 204.

In this case, a λλ plate 1230 is arranged on the front surface of the spatial filter 202, and converts the image light that has been input as linearly polarized light into circularly polarized light and inputs the circularly polarized image light. This is because, for linearly polarized light, the spatial filter usually utilizes the birefringence of quartz,
This is because the effect cannot be obtained. In this example,
The λλ plate 1230 is disposed in front of the spatial filter 202, but is not limited to this.
And the spatial filter 202 between the polarizing filter 472 and the spatial filter 202.

As shown in FIG. 45, a configuration for removing the specular reflection component can be considered. This is because the first polarizing filter 470 is connected to the light source 19.
8 instead of the surface mirror coat 4
The light from the light source 198 is guided to a position very close to the sheet surface to illuminate the sheet (dot code) using the transparent resin optical waveguide material 480 provided with the optical waveguide material 480. Are arranged at the light emitting portion of the light emitting device. In this case, the first polarizing filter 470 is arranged so that light orthogonal to the second polarizing filter 472 is transmitted.

Incidentally, here, the transparent resin optical waveguide material 480 is used.
Is advantageous in that the outer shape of the light source 198 can be made as small as possible, and that the regular reflection component can be reduced because the incident angle becomes shallow.

However, since the specular reflection component still remains due to the swelling of the ink and the swelling of the sheet of paper, a polarizing filter is provided in order to eliminate it more efficiently.

Further, instead of the second polarizing filter 472, an electro-optical element shutter 1220 such as a liquid crystal shutter or a PLZT shutter may be provided. As shown in FIG. 44D, the electro-optical element shutter 1220 includes a polarizer 1221 serving as a polarizing filter, a liquid crystal and a PL.
It comprises an electro-optical element 1222 such as ZT and an analyzer 1223 as a polarizing filter. In this case, the shutter 1
By arranging the shutter 1220 so that the light distribution direction of the 220 polarizer (polarizing filter) 1221 is the same as that of the second polarizing filter 472, a regular reflection removing effect can be obtained.

Further, the shutter function allows the IT-CC
There is an advantage that an image sensor capable of reading fields such as D can read a frame, or an image sensor of an XY address system such as CMD can realize simultaneous exposure of all pixels.

Next, an example will be described in which the light source 198 is made more efficient and the device is made slimmer.

FIG. 46A is a diagram showing the structure, and the mirror coat 4 is formed on the surface similarly to the example of FIG.
An acrylic transparent resin optical waveguide material 480 having an optical fiber 78 is provided. The acrylic transparent resin optical waveguide material 480 is formed in the shape of a truncated cone as shown in FIG. 46 (B), and a screw portion 482 is provided on the upper portion (extending end) thereof. It is adapted to be screwed and attached to the housing 484 of the pen-type information reproducing device. In addition, this screw portion 482
The surface mirror coat 478 is not applied to the inner portion in the vicinity, and a light source 198 is provided in the portion 486. That is, the light source 198 is provided as an LED array in which LEDs are mounted on a thinly cut flexible substrate 488 and formed into a ring shape, and this is adhered and attached to the portion 486 without the surface mirror coat. . Then, as shown in (C) of the same figure, the lower portion (tip) of the acrylic transparent resin optical waveguide material 480 is cut, and the portion 49 where the surface mirror coat 478 is not applied is provided.
0 is formed. Therefore, the light from the light source 198 enters the transparent resin optical waveguide material 480 from the non-mirror coat portion 486, is reflected by the surface mirror coat 478, passes through the optical waveguide material 480, and passes through the surface mirror coat at the front end. The light exits from the non-portion portion 490 and is irradiated on the dot code on the sheet.

The tip of the acrylic transparent resin optical waveguide material 480 is, as shown in (D) in the same figure, kept straight and extends a surface mirror coat 478 only on the outer part. The shape may be easily manufactured. In this case, it is more preferable that the tip is rounded to make it slippery.

Next, an example of a pen-type information reproducing apparatus using an image sensor integrated with a light source will be described (see FIG. 47).

That is, in the present embodiment, a light source integrated type image sensor 492 as described above with reference to FIG. 39 is used, and a rod lens (for example, a cell hoc lens) as an image forming system is provided on the exposure surface. 494 and a glass thin plate 496 are arranged and formed. Here, the thin glass plate 496 serves not only as a protective glass for the actual contact surface, but also for providing a certain distance to make the illumination as flat as possible.

As described above, the light source integrated type image sensor 4
The use of 92 makes it possible to reduce the size of the pen-type information reproducing device, and also to reduce the length in the length direction.

[0312] Next, a pen-type information reproducing apparatus for dealing with color multiplexed dot codes will be described.

FIG. 48A is a diagram showing the structure, and the touch sensor 466 as shown in FIG. 41B and the first and second sensors as shown in FIG. Of the polarization filters 470 and 472. Further, the pen-type information reproducing apparatus of the present embodiment reads a color multiplexed dot code which is color multiplexed by combining a plurality of dot codes of different colors as shown in FIG. In addition, a color liquid crystal 498 controlled by the control unit 212 is arranged on the pupil plane of the lens 200.

Here, in order to explain a method of controlling the color liquid crystal 498 in the control section 212, an example of using a color multiplex dot code will be described first.

For example, as shown in FIG.
A color multi-dot code 502 is arranged on the sheet 500, and "Good Morning"
Is written, and an index 504 and an index code 506 are arranged at a predetermined position, for example, at the lower right. Then, when the color multiplex dot code 502 is reproduced by this pen-type information reproducing apparatus, the pronunciation of "good morning" in Japanese, the pronunciation of "Good Morning" in English, or the pronunciation of "Good morning" in German, or In order to select whether to pronounce "Guten morgen", as shown in FIG. 3D, an index code 506 arranged corresponding to an index 504 indicating the option is scanned and recognized, and for example, Japanese is selected. , The color multiple dot code 502
The following explanation will be made for the purpose of scanning so that an utterance such as "Good morning" is uttered.

First, as shown in (B) of the figure, a dot code for sounding in Japanese is generated, and is assigned as code 1 to red (R). Similarly, create a dot code to be pronounced in English as code 2 and set the green (G)
And a dot code pronounced in German as code 3 is created and assigned to blue (B). The color multiplex dot code 502 is set on the sheet 500 by setting the color of the overlapping portion of each piece of information as the color formed by the additive method of each color.
Record above. In this case, portions where colors do not overlap are recorded as black dots. That is, as described above, the dot code is composed of a marker and a data dot, but the marker is black,
That is, the data dots are recorded in another color by the additive color method. Thus, the color multiple dot code 50
Recording at 2 means that the recording density is increased.

It is to be noted that a plurality of different pieces of information may be allocated to colors of different narrow-band wavelengths without being limited to the three types of colors of RGB. It is possible to multiplex more information, such as five types. In this case, the color ink may be a mixture of a dye (an ink that reflects light having only a narrow band wavelength) in addition to the conventional inks such as cyan, yellow, and magenta.

The index code 506 is arranged in the underlined portion of the index 504 shown by characters or pictures so that the user can recognize and select it. It is printed in black so that it can also be read.

The color liquid crystal 498 is formed by attaching an RGB light transmission mosaic filter in accordance with the liquid crystal pixels, and separates information of each color of the color multiplex dot code 502. That is, the control unit 212 sets only the pixels corresponding to the color of the information selected by the scan of the index code 506 to the transparent state.
Is controlled by Further, the liquid crystal may not be in a mosaic shape, and may be configured to divide an optical path into planes. that time,
It is preferable to make the divided area ratio of each color inversely proportional to the sensitivity of the pixel because the sensitivity for each color becomes uniform. That is, when the sensitivity of B is low, the area is made larger than other colors. The color liquid crystal may be provided on the light source side.

Next, the operation for reading the index code 506, selecting a color and generating it in a desired language will be described with reference to the flowchart in FIG.

First, if green is temporarily selected by initial setting (step S202) and the touch sensor 466 is pressed (step S204), the control unit 212 controls the liquid crystal transmitting portion of the color liquid crystal 498 according to the color selection. (Step S206). For example, since green is selected in the initial state, only dots with a green filter are made transparent. Next, the light source 198 is controlled by the control unit 212, and the dot code is read by the image processing unit 460 (step S208). Then, the code is decoded by the data processing unit 462 (step S2).
10) Recognize whether all the codes have been completed, that is, whether all the codes have been read (step S212). When the reading has been completed, a sound for notifying the user is emitted (step S21).
4). Next, the control unit 212 determines whether the read result is the index code 506 or the sound information (color multiplex dot code 502) based on the decoding result (step S216). Then, the color indicated by the index code 506 is selected (step S218), and the process returns to step S204. If it is sound information, the sound is reproduced from the sound output device 268 by the data output unit 464 (step S220).

After the sound is reproduced in step S220, it is further determined whether or not the sound is to be repeatedly generated a predetermined number of times (step S222). If the number is previously set by the repeat switch 467, it is determined. If
The predetermined number of times is repeated.

The number of repetitions may be one, of course.
The number of times can be appropriately set by various switches and the like. In addition, the number of times can be recorded in the index code 506 or the dot code 502 in advance.

[0324] In this case, the repeat reproduction is performed as shown in FIG.
This can be realized by repeatedly reading data from the data memory unit 234 in FIG.

[0325] The image pickup unit 204 includes a black-and-white image sensor,
Generally, there is a color image sensor in which a color mosaic filter is mounted on an image sensor unit. Although the above example uses a black-and-white image pickup unit, it is possible to use a color image pickup device and separate the colors in the image processing unit 460 to reproduce the image in different colors. In such a case, the color liquid crystal 498 can be dispensed with.

FIG. 49B is a diagram showing the configuration of the image memory unit of the image processing unit 460 when a color image sensor is used. That is, a signal input from the color image pickup device is separated into respective colors by a color separation circuit 508 and stored in the memories 510A, 510B, and 510C, which are selected by a multiplexer (MPX) 512, and the subsequent processing is performed. To do.

[0327] Of the first and second polarizing filters 470 and 472 for the purpose of preventing regular reflection, the same polarizing filter is used for the polarizer portion of the color liquid crystal 498 as the second polarizing filter 472. It is possible to use it as well. Therefore, the color liquid crystal 498
By combining with the other polarization filter, the second polarization filter 472 can be omitted. However, at this time, the angle of the color liquid crystal in the horizontal plane is the second angle.
Must be rotated in the same arrangement as the direction corresponding to the polarization filter 472, that is, so as to cut off components in the same direction.

Also, as shown in FIG. 50A, the color liquid crystal 498 is removed, and as the light source 198, an RGB light source such as an LED as shown in FIG. Even color multiple dot code 5
02 can be read. That is, in the case of separating RGB, the above three colors, among the RGB light sources 198, when reading the code 1 corresponding to red, only the LED corresponding to red is turned on. In the case of code 3, only the blue LED should be turned on to reproduce.

Also, instead of using RGB LEDs,
It is also conceivable to add a color filter to each part as a white light source to make each color light source.

As described above, by using light sources of different colors R, G, and B as the light source 198 and controlling the lighting of the light source of the color selected by the index code 506, the same effect as the configuration of FIG. Obtainable. Furthermore, by having a plurality of light sources that emit light of a plurality of narrow-band wavelengths, it is not necessary to have a color liquid crystal or a control circuit therefor, and the size can be reduced at low cost. In particular, LEDs have a narrow band,
For example, there is a material having a wavelength of about ± 27 nm of a certain wavelength. If such a material is used, narrower band reproduction can be performed.

Next, a pen-type information reproducing apparatus using a stealth-type dot code will be described.

FIG. 51A shows a dot data sticker 516 with a title on which an infrared-emitting paint dot code 514 as a stealth type dot code is printed.
The dot data sticker 516 prints, for example, a title in a printing machine or a printer using normal color or black and white printing, and then prints a dot code below this using an invisible paint. It was done. Of course, this dot data sticker 516 has a dot code 514 that is invisible, that is, transparent printing.
As shown in FIG. 13B, the dot code 514 may be printed over the title of the visible information using transparent ink. For example, in the case of an inkjet printer or the like, this printing is realized by applying an infrared light-emitting paint ink as a fifth ink to four inks of cyan, magenta, yellow, and black, and printing the ink. it can.

FIG. 51A shows an example in which a title is printed in the margin of a stealth type dot code. Needless to say, a visible light dot code is printed on the title dot data sticker. The title may be printed in the margin.

As a pen-type information reproducing apparatus for reproducing the infrared-light-emitting paint dot code 514 as such a stealth-type dot code, for example, as shown in FIG. Since it is printed with a luminescent paint, an infrared light emitting element 518 is used as the light source 198, and an infrared bandpass optical filter 520 is arranged in front of the imaging unit 204.

That is, when light in the infrared region is irradiated on the infrared light emitting paint dot code 514 from the infrared light emitting element 518, light is reflected in the infrared region, that is, a wavelength in a certain narrow band. In order for the intensity of the reflection to be detected by the imaging unit 204, the reflected light is guided by dividing it into visible light information through an infrared bandpass optical filter 520.

It should be noted that several kinds of light emission bands of paint used for printing the infrared light emitting paint dot code 514 can be prepared. For example, by changing the characteristics of the band-pass optical filter 520 little by little, an image can be obtained. Printing can also be multiplexed.

Next, instead of configuring all the functions of the reproducing system in the pen-type information reproducing apparatus, various devices such as an electronic notebook, a PDA, a word processor, a personal computer, a copier, a printer, an electronic projector, etc. A ROM card is generally used to add optional functions. An example in which the functions are partially distributed to a card-type adapter that can be connected to a connector of a ROM card will be described.

FIG. 52 shows an example in which an image processing unit 460 is provided in the pen type information reproducing apparatus, and the output of the image processing unit 460 is supplied to the card type adapter 524 via the output connector 522. Is shown. The card type adapter 524 in this case has a data processing unit 462, a data output unit 464, a signal processing unit 526 including a D / A, and an audio connection terminal 528, and outputs reproduced audio information from the audio output device 268 as sound. In addition, multimedia information such as reproduced images can be supplied to an external device 532 such as an electronic organizer via the I / F 530.

That is, a ROM (not shown) of the external device 532 which is not provided with a sound output mechanism such as a speaker like an electronic organizer.
At the same time, multimedia information such as a dot-coded image is input to a card connection terminal that cannot output such audio, and at the same time, audio data is input to an audio connection terminal 528 of the card type adapter 524 by an earphone or the like. Is connected to the audio output device 268 to listen to the dot-coded audio.

As the external device 532, it is also possible to assume a TV game machine that has been widely used in each home in recent years. FIGS. 53A and 53B show the configuration of a card type (in this case, a cassette type) adapter 524 for such a video game machine.
In the case of (A), the data processing unit 4 is provided in the pen-type information reproducing apparatus.
62 shows the case where the detection unit 184 is configured.
This is the case where only the configuration is made. The ROM 534 stores a control program executed by a CPU (not shown) built in the main body of the video game machine, and is loaded into the main body when a cassette is inserted. The RAM 536 is used to store the processing result of the data processing unit 462. Memory control unit 53
Reference numeral 8 controls the ROM 534 and the RAM 536 in accordance with an instruction from the CPU in the main body of the video game machine.

Normally, high-performance CPs are
U is mounted, and therefore, high-speed processing can be performed by causing the game machine main body CPU to partially perform the processing, rather than performing all processing in the pen-type information reproducing apparatus. Further, since the operation unit of the game machine can be used as various control input units, it is not necessary to provide a reading start instruction switch such as a touch sensor in the pen-type information reproducing apparatus, and the size can be reduced. In this case, a control program for processing performed by the CPU of the main body of the game machine, or a control program for controlling the pen-type information reproducing apparatus and the user interface function for operation by the main body CPU and the operation unit of the game machine, It is stored in the ROM 534. Furthermore, since the game machine is provided with a speaker, an audio output terminal, a monitor output terminal, and the like, these can be omitted from the pen-type information reproducing device and the card-type adapter, so that the cost can be reduced.

Next, operation switches for using the card type adapter 524 will be described.

An electronic organizer as the external device 532 usually has a slit for mounting a card called a ROM card or an IC card, and when a card type adapter is inserted into the slit and mounted, the card type adapter is inserted. Characters and symbols written on the front surface can be seen through under the transparent touch panel 560 of the electronic organizer, and when touching the place written on the card type adapter, the function corresponding to it works and it is displayed on the display 562, for example. There are also things that can be operated.

Therefore, in the case of such a card type adapter 524 for an electronic organizer, as shown in FIG. 54A, a control system switch of the pen type information reproducing device 564, for example, turning on the light source 198, Instead of providing an operation switch such as an off switch, a letter or a symbol representing the switch is simply written at a predetermined position on the front surface.

In addition, external devices 5 such as personal computers and word processors
Since the pen 32 has a built-in keyboard, when the pen-type information reproducing apparatus is connected to such a device, the information can be controlled from the card-type adapter 524 without providing a control system switch.

However, in the case of an external device 532 which has a dedicated control switch for operating itself, such as a printer, but has no other control system switch, the card type adapter 524 has a control system switch. Need to be provided. For example, as shown in FIG. 54 (B), the length of the card is made longer than the normal card length, and a necessary switch 566 is provided in a portion which protrudes outside the device when the card is mounted on the device 532. As the switch 566 in this case, for example, a tact switch or a touch panel can be used.

Next, an apparatus for printing a dot code will be described.

First, as shown in FIG. 55, a reel seal printing machine 572 for converting data edited by a personal computer or word processor 568 into a dot code by a multimedia information recording machine 570 and printing the dot code on a reel sticker will be described. I do.

FIG. 56 is a diagram showing the internal configuration of this reel seal printing machine.

[0350] The dot code from the multimedia information recording device 570 is temporarily stored in the dot pattern memory 574, and then the LED arrays 578 and 580 emit light based on the dot pattern by the LED driver 576. Light from the LED arrays 578 and 580 is guided onto photosensitive paper extending from a photosensitive paper reel 584 by a rod lens 582 provided in close contact with each pixel.
The timing of light emission is managed by the CPU 588 according to the speed and position of the photosensitive paper detected by the sensor 586.
Similarly, the feed speed of the photosensitive paper is controlled by controlling a driver 594 of a rotary motor 592 that drives a roller 590 in an output stage.

On the other hand, in order to protect the printed dot code, a surface coat seal 596 is added at the output stage, and the photosensitive paper and the surface coat seal are simultaneously output in a bonded state. Here, as the photosensitive paper, photographic paper, film, or the like can be used, and in this case, the back surface is provided with adhesiveness.

When the photosensitive paper is a normal film or the like, as shown in FIG. 56, the LED array 578 is a red LED array and the LED 580 is a yellow LED array. May be multiplexed. For multiplexing, two types of LEDs may be shifted in position to form a two-color dot code,
Further, two types of LEDs may emit light at the same position to create different colors, and further multiplexing may be performed.

[0353] Such a reel seal printing machine 572 has the feature that the use of photosensitive paper enables high resolution and low cost. Further, the configuration of the exposed portion does not require expensive processing such as scanning with a laser or the like, and is performed using a small-sized LED array, so that the apparatus is very inexpensive. Further, in the case of a laser or the like, the accuracy of the mirror angle or fine positioning is required. On the other hand, in the printing machine 572, such a fine positioning accuracy is unnecessary because the optical path is of a close contact type. Problems can also be avoided.

[0354] In the figure, for convenience of drawing, L
Although the arrangement direction of the ED arrays 578 and 580 and the rod lens 582 is shown as the traveling direction of the photosensitive paper, it is actually arranged in the direction perpendicular to the paper surface, that is, in the width direction of the photosensitive paper. Of course, a large number of dot codes may be formed at a time as a two-dimensional array arranged in the width direction as it is.

Also, the reel seal printing machine 5 as described above
At 72, the photosensitive paper on which the dot code is printed is output from the roller 590 in the form shown in FIG. 55. In this case,
It is preferable to insert a white blank portion at the boundary with the next data so that the user can see where the cutting process such as a cutter should be performed. Moreover,
The code length that can be attached changes depending on the size of the sheet to which the reel seal is to be attached, that is, A4 or B4, so that the length of the dot code that can be printed is changed in accordance with that. good. In such a case, for example, a control method of controlling the timing of reading the dot pattern on the dot pattern memory 574 in accordance with the manually set sheet size and changing the length adaptively is adopted. I do.

FIG. 57 shows the structure of a word processor provided with a function of recording multimedia dot codes.

In this configuration, the configuration other than the multimedia information recording processing unit 598 for generating a dot code for a text edited on a text is a general word processor configuration. That is, a bus 602 from the CPU 600 stores various ROMs 60 such as programs and character generators.
4. RAM 606 as work area, calendar 60
8, a bus control 610, a CRT control 616 for displaying data expanded on a video RAM 612 on a CRT 614, an I / O control 620 with a keyboard 618, a disk control 624 for controlling an FDD 622, a printer control 628 for controlling a printer 626, and various types. I / F630 etc. are hanging.

[0358] The multimedia information recording processing unit 598 includes:
It has a dedicated access to the bus 602, and has basically the same contents as the multimedia information recorder 570 in FIG. That is, bidirectional I / O
The data supplied via the bus 602 via the bus 632 is separated into a character, a graph and a picture by a separation circuit 634, subjected to appropriate compression by compression circuits 636 and 638, and synthesized by a synthesis circuit 640. On the other hand, layout information of characters, pictures, and graphs is directly input to the synthesis circuit 640. The error correction code adding circuit 642
To add an error correction code, perform processing such as interleaving on the memory 644, and perform an address addition circuit 646.
After adding a block address or the like, the modulation circuit 6
At 48, modulation is applied. Thereafter, a marker is added by the marker adding circuit 650, and the editing and synthesizing circuit 652 is added thereto.
Then, the size of the dot pattern is changed by the dot pattern shape conversion circuit 654, and is returned to the bus 602 via the bidirectional I / O 632.

Then, in accordance with the data returned to the bus 602, the printer control 628
6 to obtain a printout as indicated by reference numeral 656 in the figure.

[0360] As shown in the figure, the basic printout 656 is composed of a sentence 6 written (input) on a word processor.
58, a picture 660 and a graph 662 are added thereto, and the contents of the text 658, the picture 660, and the graph 662 are printed at a predetermined position, for example, a dot code 664 below.

With the printout 656 as described above, the user who has received the printout 656 directly or by facsimile reads the dot code 664 using the above-described pen-type information reproducing apparatus, and responds to the readout. Document 658, picture 660, graph 66
2 can be taken into the user's word processor, and they can be edited arbitrarily.

The multimedia information recording processing section 59
8 may be realized by software processing by the CPU 600.

Also, the multimedia information recording processing section 59
8 may be built in a printer 626 instead of being implemented in a word processor as described above. That is, when the printer 626 receives font or graph information or the like, it may perform processing of adding such recording modulation to the information and printing the information. In this case, the printer may be supplied in the form of a card-type adapter without being built in the printer 626.

Note that the dot pattern shape conversion circuit 654 in the multimedia information recording processing unit 598 performs conversion in accordance with the resolution of the printer 626.
When the printed content is transmitted by fax, the resolution or definition of the fax is also determined as GII or GIII, so it is converted into a form that can be adapted to the resolution of the fax. May be changed.

FIG. 58 shows that the function of the multimedia information recording processing section is built in the optical copying machine 666, and when an original is copied, the contents are copied onto a sheet and the dot code corresponding to the contents is printed on the sheet. FIG. 4 is a diagram illustrating a configuration in a case where printing is performed at a position.

That is, similarly to the ordinary copying machine, the document table 66
8, an illumination 670, a mirror 672, a lens 672, a photosensitive drum 676, and the like, and copies an image on a document onto paper.

In addition, in the optical copying machine 666 of the present embodiment, a half prism 678 is inserted in front of the lens 674 in the optical path to split the light, and the image is captured by a line sensor or the like via the optical component 680. Lead to element 682. Image sensor 6
The signal from the amplifier 82 is amplified by an amplifier 684 and subjected to various analog processing, and then is digitally converted by an A / D converter 686 and recorded in a memory 688. An image area determination and data character recognition circuit 690 performs data area recognition and data character recognition on the data recorded in the memory 688. Here, for the image area determination, a method described in Japanese Patent Application No. 5-163635 by the present applicant can be used.

The data on which image area determination, data character recognition, and the like have been performed are compressed by a compression circuit 692.
In this case, since the compression method differs depending on the type of character, picture, graph, etc., compression corresponding to each type is performed, and then the data synthesis circuit 694 performs data synthesis including layout information. Then, an error correction code is added to the combined data by an error correction code adding circuit 696, the data is stored in a memory 698, and processing such as interleaving is performed again, and an address is added by an address adding circuit 700. And the modulation circuit 702
Modulation is performed. After that, a marker is added by the marker adding circuit 704, and the dot pattern shape is converted by the dot pattern shape converting circuit 706. Then, according to the dot pattern, the light emitting element driver 708 causes the light emitting element 710 to emit light, and the mirror shutter 712 is activated to guide the light from the light emitting element 710 to the lens 674 and the photosensitive drum 676.

As described above, when outputting to a facsimile or the like, the facsimile resolution selection section 714 selects the facsimile resolution, and the dot pattern shape conversion circuit 7
At step 06, the shape of the dot code pattern is changed.

In the image area determination and data character recognition circuit 690, the character may be treated as a binary image, and may be subjected to general image compression processing such as MR or MH. Alternatively, after performing character recognition and converting the code into a code used in an ordinary word processor such as an ASCII code, the data may be compressed by a compression method such as Jibrempel. As described above, when the character recognition is performed, the ASCII code is converted, and the data is further compressed, the compression ratio is considerably increased, and a large amount of data can be recorded with a small dot code.

The printing of the dot code is performed by first copying the original image to the photosensitive drum 67 due to the processing speed of the signal processing system.
After writing and exposing 6, the mirror shutter 712 is set up and the light emitting element 710 is used to write again on the drum and print.
Alternatively, a dot code may be generated in the first document scan in the form of prescan, and the document image and the dot code may be written on the photosensitive drum 676 in the second document scan. If the processing speed of the signal processing system is improved in the future, the processing divided into a plurality of times may not be necessary. However, when the original is placed on the platen 668 horizontally or upside down, the reference numeral 656 is used.
In order to obtain a copy result in which a dot code is printed on the lower part of the printed paper in the vertical direction as described above, the processing also needs to be divided into a plurality of times.

FIG. 59 shows a configuration when applied to a digital copying machine 716. In FIG.
Those having the same functions as in FIG. 58 are given the same numbers as in FIG. In addition, although the description is made as if the optical mirror is moved in the input portion, the original may be read by moving the line sensor.

That is, in the digital copying machine 716, the edit / combination circuit 718 combines the dot code whose shape has been changed by the dot pattern shape conversion circuit 706 as described above, and the data of the original image fetched into the memory 688. The images are combined and printed out by the printer 720. Such a digital copying machine has the memory 688 without performing the processing divided into a plurality of times as described above, so that the dot code can be printed at any position on the paper by one scan. .

Next, the flow of the broken line in the figure will be described. This is the opposite of reading the original image and dropping it into a dot code as described above, but reading only the dot code from the original with the dot code printed along with the text and picture and reproducing from the dot code This is the flow of contents such as printing out a document in the form of a combined sentence or picture with a dot code.

That is, similarly, the dot code is read from the document by the image sensor 682, A / D converted, and recorded in the memory 688. The output of the A / D converter 686 is also input to the dot code reproducer 722. The dot code reproducer 722 includes, for example, a circuit configuration after the scan conversion unit 186 in FIG. 15, and can reproduce a sentence, a picture, and a graph from the dot code. Memory 68
The image of the dot code stored in 8 is given to the dot pattern shape conversion circuit 706 in the state of the dot code, and after being changed in size, is input to the edit / synthesis circuit 718. The edit / synthesis circuit 718 adds the dot code from the dot pattern shape conversion circuit 706 to the text, picture, graph, or the like reproduced by the dot code reproducer 722, inputs the result to the printer 720, and prints out.

In this case, the time required to scan the original is only the time required to read the dot code portion.
Time can be reduced. Further, when text, pictures, graphs, and the like are enlarged or reduced, the size of the dot code can be printed without change regardless of the enlargement or reduction.

Next, FIG. 60 shows an example in which the pen-type information reproducing apparatus is also used as an input section for character and picture data.

That is, the image processing section 4 of the pen-type information reproducing apparatus
The signal from 60 is input to the multimedia information recording device 724. In the multimedia information recording device 724, the input, that is, the imaged data is input to the frame memory 728A or 728B via the selector 726. In this case, the selector 726 selects so that one screen is first taken into the frame memory 728A, and then the next one screen is taken into the frame memory 728B. Then, the image data taken into the frame memories 728A and 728B are respectively subjected to the distortion correction circuit 730.
After lens distortion such as peripheral aberration is removed at A and 730B, it is input to a shift amount detector 732. The shift amount detector 732 determines the correlation between the images captured in the frame memory 728A and the image captured in the frame memory 728B so that when the images captured in the frame memory 728B are combined in the subsequent stage, the overlapping portions of the two images overlap as a picture. To calculate the direction and the amount of shift. This shift amount detector 7
32 is, for example, Japanese Patent Application No. 5-639 filed by the present applicant.
No. 78 and Japanese Patent Application No. 5-42402 can be used. Then, one of the images, for example, the image taken into the frame memory 728B, is interpolated by the interpolation arithmetic circuit 734 in accordance with the detected shift amount, and the image data is interpolated by the enhancer (Enha).
ncer) After the enhancer is applied in 736, the image combining circuit 7
At 38, the image is synthesized with the image captured by the other frame memory 728 </ b> A, and the result is stored in the image synthesis memory 740.

Then, the next screen is stored in the frame memory 72.
8A, the same processing as above is performed, and then the image captured in the frame memory 728A is interpolated.

Thereafter, by repeating this alternately, a large screen can be achieved.

That is, the pen-type information reproducing apparatus is originally intended to read a small code called a dot code, and therefore has a very small imaging area. In order to use such a small imaging area as a scanner for taking in a character or picture image, it is necessary to take in the image in a plurality of times and attach them. Therefore, in the present embodiment, a plurality of frame memories are provided, the amount of shift is detected, the shift is corrected, and the images are pasted.

The data recorded in the composite image memory 740 is subjected to image area determination and the like by an image area determination circuit 742. If the data is a character, the character recognition circuit 744 performs character recognition. The information is directly input to the multimedia information recording processing unit 598 as described above. Then, the multimedia information recording processing unit 598 performs a process such as compression to convert the dot code into a dot code, and is guided to the reel seal printing machine 572 as described above. Alternatively, instead of inputting to the multimedia information recording processing unit 598,
The data can also be input to an external device 532 such as a personal computer or a word processor via the I / F 746.

[0383] The pen-type information reproducing apparatus may be provided with two terminals such as an earphone terminal and an image output terminal, or a single connector for manually outputting sound. It is also possible to adopt a configuration in which the output system and the image output system are switched and used.

FIG. 61 is a modification of FIG. Figure 60
Describes the case where the area of the imaging unit 204 when reading the dot code is the same as the imaging area when using as a scanner, but in the case of the present embodiment, when using as a scanner, wide-angle, When reading the dot code, the imaging optical system 2 is used so as to perform macro imaging.
00 is changed.

That is, the imaging optical system 200 is composed of a zoom or bifocal lens group used in a normal camera, and slides a lens barrel 748 to switch between wide-angle and macro. I have. A scanner switch 750 is provided so that the contact is closed and turned on when the lens barrel 748 is contracted. When the scanner switch 750 is turned on, the operation of the data processing unit 462 and the data output unit 464 is assumed to be used as a scanner. The control unit 212 is made to perform processing such as stopping them and operating them to perform macro-like operations when they are off.

When the imaging optical system 200 is set to the wide-angle side, the imaging area becomes large, and the depth of focus at that time becomes ± 120 μm.
Assuming that the imaging magnification is 0.08, the depth of field is ±
19 mm. Even if there is a vertical camera shake, this depth is not a problem.

In addition to the configuration in which the lens barrel 748 is slid to change between a wide angle and a macro, the lens itself may be replaced, that is, a wide angle lens may be used to mount a macro lens. In the form, it can be similarly implemented.

FIG. 62 shows that the card type adapter 524 includes
When a dot code is read by a pen-type information reproducing apparatus as shown in FIG.
32, a data processing unit for outputting information corresponding to the dot code, and image pasting and dot joining when a pen-type information reproducing apparatus as shown in FIG. An example is shown in which both a data processing unit for generating a code and the like are incorporated. That is, a card type adapter 524 having two built-in data processing units for a scanner and a data processing unit for reading dot codes is shown.

In the figure, selectors 752 and 754
61 performs switching between a data processing unit for a scanner and a data processing unit for reading a dot code, and the switching selection may be a manual operation.
May be linked with the on / off of the scanner switch 750, or may be driven directly from the external device 532 side.

The image synthesizing processing circuit 756 operates as shown in FIG.
The selector 726 and the frame memory 728 shown in FIG.
A, 728B, distortion correction circuits 730A, 730B, displacement detector 732, interpolation operation circuit 734, enhancer 73
6. An output processing circuit 758 which performs the function of the image synthesizing circuit 738.
It is for conforming to the format.

Next, an embodiment will be described in which the read dot code information is output to the electronic projector. That is, as shown in FIGS. 63 (A) and (B), the pen-type information reproducing device 760 scans the dot code,
The output processing unit 762 restores the original information,
The data is input to the 64 RGB input terminals or the video input terminal of the electronic OHP 766 and projected on the screen 768.

In this case, the pen-type information reproducing device 760
The configuration from the detection unit 184 to the data error correction unit 194 in the configuration of the reproduction system shown in FIG. 15 or (D) of FIG. 20 is built in, and the output processing unit 762 is provided after the data separation unit 196. Built-in configuration and other processing circuits.

The actual configuration of the output processing unit 762 is shown in FIG.
become that way. That is, the multimedia information from the pen-type information reproducing device 760 is separated by the separation unit 196 into image, graph, character, voice, and header information.
After the characters are decompressed by decompression processing units 238, 242, and 248, data interpolation circuits 240, 2
At 44, an interpolation process is performed.
At 46, PDL processing is performed. Then, the interpolated or PDL-processed image, graph, and character are synthesized by the synthesis circuit 250,
It is stored in the memory 770. The data stored in the memory 770 is data that can be already projected on the screen 768. Therefore, the data is D / A converted by the D / A conversion unit 252, and the data is stored in the projector 764 or the electronic OHP 76.
6 is output. In this case, the memory 770 is controlled by the address control unit 772. On the other hand, the voice is directly decompressed by the decompression processing unit 256 and the data interpolation circuit 258
After that, the D / A conversion is performed by the D / A conversion unit 266, and the projector 764 and the electronic OHP are
The signal is output to a built-in or external speaker 776.

Further, the speech-synthesized coded data is converted to speech by speech synthesis section 260 and input to D / A conversion section 266.

For example, when a sentence can be read as needed during a presentation, the sentence recognition unit 271 recognizes the sentence from the character code for display as a sentence, and the speech synthesis unit 260 converts the sentence into speech. After the conversion, the sound is finally output from the speaker 776.

In this case, there is no need to separately record a speech synthesis code for reading, so that more information can be stored in the dot code.

[0397] In this case, the projector selecting means 7 is connected so that it can be connected to any electronic projector system.
78 is provided so that, for example, it is possible to select whether the projector 764 is compatible with Hi-Vision or is compatible only with NTSC. That is,
Depending on the electronic projector system as an output system, processing such as how to allocate characters on the memory 770 changes. Therefore, the processing in the data interpolation circuits 240 and 244 and the PDL processing unit 246 is changed according to the selection by the projector selection unit 778, or the clock supplied to the address control unit 772 and the D / A conversion unit 252. The signal CK is changed by the reference clock selection unit 780.

Also, the projector 764 and the electronic OHP7
In the use situation of the electronic projector such as 66, for example, as shown in the figure, in a document including text, pictures, graphs, etc., it is desired to project only sentences, only pictures, or only graphs There is a case where it is desired to perform selective projection such as wanting. In such a case, the output control unit 78
2 so that the user can select it, or write information as to the dot code as header information, such as whether to project by text, to project only a picture, or to project only a graph. The output control unit 782 can select a portion to be output according to the header information. Then, according to the selection in the output control section 782, the output editor section 7
Reference numeral 84 performs a task of separating which part is to be projected, and causes the address control unit 772 to access that part of the memory 770 to output projection data. The output editor unit 784 performs processing other than such area division such as electronic zoom processing, that is, first, the entire original is projected, and thereafter, a part of the text or only the picture is enlarged. It is also possible to perform processing and, at that time, editing processing in which only a part of a sentence or a picture is focused and enlarged. When such processing is performed, an input section and a display section are provided in the output processing section 762, and processing such as a graphical user interface is performed so that an enlarged portion can be actually specified. preferable.

In addition, the selector 774 can select not only the sound input from the D / A converter 266 and the sound input from the D / A converter 266, but also the sound from the external microphone 786.

[0400] The pen-type information reproducing apparatus 760 may include only the detection section 184, and the scanning conversion section 186 and the subsequent sections may be incorporated in the output processing section 762. The information reproducing apparatus 760 may be provided with the separated data and transmitted to the output processing unit 762 in some form. Actually, considering that the pen type information reproducing device 76 is held by hand,
Since it is preferable to set 0 to be as small as possible, it is preferable to provide only the detection unit 184 and perform the subsequent processing by the output processing unit 762.

FIG. 65A shows a copying machine 788 and a magneto-optical disk drive (MO) 79 in place of the electronic projector.
0, indicating the case of outputting to the printer 792. The output processing unit is built in hardware or software in a personal computer or the like 794, and the output of the output processing unit is copied online or offline by a floppy 796 or the like. Machine 7
88, MO790, and a printer 792. FIG. 17B shows a case where the output processing unit is configured as a card type adapter 800 to be attached to the printer 792 or the electronic organizer 798.

The actual configuration of the output processing unit 762 in this case is as shown in FIG.

As in the embodiment of the projector described above, multimedia information is input, images, graphs, and characters are separated by the separation unit 196.
38, 242, and 248, the image and the graph are interpolated by the data interpolation circuits 240 and 244, and the characters are subjected to PDL processing by the PDL processing unit 246.
The images are synthesized by the synthesis circuit 250 and stored in the memory 770. The memory 770 is controlled by the address control unit 772, and the read data is output to the edit monitor 804 via the interpolation unit 802 and the D / A conversion unit 252 to check the data actually output. Note that the editing monitor 804 may not be provided.

[0404] The data read from memory 770 is also input to synthesizing section 806. This combining unit 806
The printer 792 to output the multimedia information from the pen-type information reproducing device 760 to the dot code again by the coding unit 808 and output the dot code by the output adaptive interpolation unit 810
The output interpolation is performed in accordance with the resolution such as that described above, and the output interpolation is performed with the data from the memory 770. In other words, a dot code is added to a text or a picture, and output to the printer 792 or the copying machine 788 via the I / F 812.

The output selecting means 814, when outputting to the printer 792, connects the printer 792 to the output unit 76.
If you know the model when you connect to 2, you will automatically enter the resolution setting, and if you send offline with a floppy 796 etc., you will not know the model, so in such a case you have to switch manually. I do.

In such a configuration, text and the like are copied or printed as they are, and the dot code can be output in accordance with the resolution of the output medium.

When connecting to the electronic organizer 798, since a dot code is not input, a system for recording the dot code becomes unnecessary. The configuration is almost the same as FIG.

FIG. 67 shows an embodiment in which a format conversion unit 816 for converting the data format of each word processor into a format for each model is provided in order to cope with the fact that the data format of a word processor is currently different for each model. The format conversion unit 816 has a word processor select switch as a model selection unit 818, reads the dot code by the pen-type information reproducing device 760, converts the data based on the selection, and inputs the data to the word processor 820.

[0409] The format conversion unit 816 actually
It is configured as shown in FIG. That is, after processing in the data interpolation circuits 240, 244, 258, the PDL processing unit 246, and the speech synthesis unit 260, each data is converted into a corresponding format conversion circuit 822, 824, 826, 82.
At 8, the format is converted according to the selection by the model selection means 818.

[0410] Fig. 69 is a system diagram in the case of facsimile transmission / reception of a sheet (hereinafter, referred to as multimedia paper) on which a dot code is recorded. This is because the dot code created by the FAX multimedia information recorder 830 is printed out by the printer 792,
32 to the receiving-side FAX 834 via the telephone line 836. The receiving FAX 834 receives this,
After returning to the paper information, the dot code is reproduced using the pen-type information reproducing device 838.

[0411] FAX multimedia information recorder 830
Is a multimedia information recording device 8 as shown in FIG.
40, a dot pattern shape conversion circuit 842, a facsimile selection means 844, and a synthesis editing circuit 846. The multimedia information recording device 840 includes the configuration up to the marker adding unit 162 in the configuration of the recording system in FIG. 13, and the composition and editing circuit 846 corresponds to the composition and editing processing unit 164.
Then, the dot pattern shape conversion circuit 842 and the FAX
The selection means 844 corresponds to the dot pattern shape conversion circuit 706 and the FAX resolution selection section 714 in FIGS.

[0412] In this case, the transmitting-side FAX
When the line is connected from the FAX 832 to the FAX 834 on the receiving side, the receiving FAX 834 returns the state of the incoming call to the FAX 832 on the receiving side. This data is supplied to the FAX selecting means 844 manually or directly, and the FAX resolution, ie, The resolution is selected, the dot pattern shape conversion circuit 842 changes the size of the dot code pattern or the shape itself according to the amount that can be written in one line, and the synthesis and editing circuit 846 synthesizes it with the paper surface information, 79
By printing out in step 2, the multimedia paper to be faxed is printed.

[0413] Fig. 71 shows a FAX built-in multimedia information recorder 848 in which all such processes are automated and the facsimile transmission / reception means is provided to the recorder from the beginning.

[0414] In this case, the resolution information of the other party's FAX is confirmed at the time of connection via the telephone line 836, the dot pattern shape is optimized using the information, and the information is synthesized with the paper surface information and transmitted.

FIG. 72A shows a card on which dot codes as shown in FIGS. 72B and 72C are printed (hereinafter referred to as a multimedia paper (MMP) card).
1 is a diagram showing a configuration of an overwrite-type MMP card recording / reproducing apparatus for recording / reproducing data.

[0416] The recording / reproducing apparatus 850 controls the MMP card 852 inserted in the card insertion slit (not shown) by the card transport roller unit 854 and the dot code detection unit 856.
To read the dot code already written on the back surface of the MMP card 852,
At 58, it is converted to the original multimedia information,
/ F and output to the data separation unit. That is, the dot code detection unit 856 corresponds to the detection unit 184 in the configuration as shown in FIG. 15 or (D) of FIG. 20, and the data code reproduction unit 858 also includes the scan conversion unit 186 and the data error correction unit. It has a circuit configuration up to 194. However, the dot code detection unit 856 is provided with imaging units on both sides of the card, and the one on the back surface of the card is used as the imaging unit 204 of the detection unit 184.
Here, the MMP card 852 has a dot code recording area 852 on the back of the card as shown in FIG.
A, and an image such as a title, a name, and a picture is recorded on the surface as shown in FIG.

[0417] In the recording / reproducing device 850, information other than the information already written on the card is supplied from an external personal computer or a storage device via the I / F 860, and is written on the back of the card as a dot code. The power information is supplied to the data synthesizing / editing unit 862 and the data code reproducing unit 86
2 is combined with the information reproduced in step 2. For example, when new information not existing in the conventional data is input from the I / F 860, for example, the address is newly added as the next address, or In the case of a copy change, the data is synthesized and edited in such a manner that only the part to be changed is replaced. The information thus synthesized and edited is input to the code pattern generation unit 864, and is converted into a dot code. The code pattern generation unit 864 has a configuration as shown in FIG.
It also combines and edits data other than the code from F860 with the data to be printed, and passes the data to be printed to the printing unit 866. The printing unit 866 includes the dot code detecting unit 8.
The image data of the surface of the MMP card 852 is also supplied from the MMP card 852, and printing is performed on both sides of the unprinted card fed from the paper feed cartridge 868, and a new MM is printed.
The P card is conveyed to a card ejection slot (not shown) by the card conveying roller unit 870 and ejected. The printing unit 8
The double-sided printing at 66 may be a format in which after printing on one side of the card is completed, the card is turned over and printing on the other side is performed, or a format in which printing is performed on both sides simultaneously.

On the other hand, the old card passes through the dot code detection unit 856, and then is applied with black ink, for example, by the subsequent application roller 872, and the code recording area 852A is painted black. Is discharged in the form of As a result, the user can return the original card that has been filled, and there is no risk that the old card will be misused.

As described above, according to the overwrite-type MMP card recording / reproducing apparatus 850 of the present embodiment, a card which has already been recorded to some extent is recorded on the recording / reproducing apparatus 85.
When the value is set to 0, the information is read, and a new card is issued in combination with the newly added information. Appears to appear as if a card were added. Then, since the old card still remains, the old card is returned to the user.
Therefore, in the form of card exchange, the form is as if it were overwritten.

FIG. 73 is a diagram showing another configuration of the overwrite type MMP card recording / reproducing apparatus. This recording / reproducing device 874 is basically the same as the recording / reproducing device 850 of FIG. 72A, but is a device for an application that does not require returning an old card to the user. Therefore, this recording / reproducing device 874 is a shredder 8 for cutting old cards.
76 is arranged at the subsequent stage of the dot code detection unit 856.

FIG. 74 is a diagram showing still another configuration of the overwrite type MMP card recording / reproducing apparatus. In the case of this recording / reproducing device 878, the configuration of the MMP card is different from that of the MMP card 852. That is, although the MMP card 852 described above was directly printed especially on the card base itself, the MMP card 8
Reference numeral 80 denotes a very thin code pattern recording thin paper (film) 884 in which a dot code is recorded on a card base 882 such as cardboard or plastic, as shown in FIG.
Is attached. That is, a thin film-like sheet printed as shown in FIG. 3C is attached to the back surface of the card.

In the recording / reproducing apparatus 878 using such an MMP card 880, the data read by the dot code detecting section 856 is combined with data coming from a personal computer or the like in the same manner as before, and becomes a code pattern to the printing section 866. Come in. At this time, instead of printing on the back side of the card, the printing unit 866 prints the code pattern recording paper 888 from the paper feed cartridge 886 and newly attaches it to the card base 882. In this case, the code pattern recording paper 888 has, for example, an adhesive such as an adhesive on the side other than the printing surface 890 of the code pattern recording thin paper 884 that is actually printed, as shown in FIG. It has an adhesive surface 892, and the adhesive surface 89
2 is provided with a protective paper 894. And
After printing, the adhesive surface protection paper 894 is attached to the adhesive surface protection paper release bar 8.
The film is peeled off by a tape 96 and wound up on a used adhesive surface protection paper take-up reel 898. The code surface recording thin paper 884 from which the adhesive surface protection paper 894 has been peeled off has the adhesive surface 892 exposed, and is pressed and attached to the card base 882 by the card transport and code pattern recording thin paper pressing roller unit 900 to form a recorded card. to go out.

In this case, the code pattern recording thin paper 884
Is a very thin film, so it may be laminated on the card base 882,
Even though it is thin, the thickness comes out as many sheets are stacked.
An old code pattern recording thin paper peeling section 902 is provided in the middle of the card transport path up to 0 so that the old code pattern recording thin paper is peeled off. The peeled old code pattern recording thin paper may be discharged as it is or may be shredded.

The additional information adding section 90 shown in FIG.
Reference numeral 4 denotes, for example, information indicating the time relationship of when the recording / reproducing device 878 recorded the original card, or which terminal was used when the recording / reproducing device 878 was used as a terminal connected to a service center. Such information is added. This makes it possible to know which recording / reproducing device 878 was used and how many blanks were recorded.

FIG. 75 is a diagram showing still another configuration of the overwrite type MMP card recording / reproducing apparatus. This recording / reproducing device 906 is basically the same as the recording / reproducing device 850 shown in FIG. 72A, in which instead of being painted black, it is painted white, and it is made a new printing surface again. is there. Therefore, the dot code detection unit 856
In the subsequent stage, a white filling ink cartridge 908 and a white filling ink application roller 910 are arranged.

As a result, the back side of the MMP card temporarily turns white, and the printing unit 866 newly prints it there. Although a new card may be issued, a paper feed cartridge 868 is provided, but this may not be provided.

Next, a write-once MMP card recording / reproducing apparatus will be described. In the write-once type, old information is left as it is, and only new information is added to an unrecorded area as long as there is still an unrecorded area. In this case, it is not necessary to perform all of the dot code reproduction processing as in the above-described overwrite type apparatus, except when the purpose of card data reproduction is intended, that is, during recording.

FIG. 76A shows the structure of a write-once MMP card recording / reproducing device 912. At the time of recording,
The data code reproducing unit 858 reproduces only the marker information and the address information of the two-dimensional block, and the code pattern generating unit 864 generates the block address of the additional recording portion,
Create additional write dot code pattern. The recorded area detection unit 914 detects a recorded area of the card. Then, the printing unit 866 controls the recorded area detection unit 91.
4, the pattern from the code pattern generation unit 864 is printed in an unrecorded area (recordable area) of the card.

The recorded area detecting section 914 includes a recording area detecting section 916, a marker detecting section 918, a last marker coordinate calculating section 920, and an additional writing start coordinate output section 922, as shown in FIG. Have been. That is, since the sizes of the marker and the block are known, the extent to which the code is recorded automatically is determined by
It can be detected by the recording area detection unit 916 and the marker detection unit 918. Accordingly, the coordinates of the start of additional writing are calculated by the rearmost marker coordinate calculation unit 920 and output from the additional writing start coordinate output unit 922.

[0430] Also, the recorded area detection section 914 is configured as shown in FIG.
7 (A). In this case, however, it is necessary to record a recorded mark 924 indicating how far the recording has been made in the margin of the card, as shown in FIG.

[0431] In the recorded area detecting section 914, the recorded mark is detected by the recorded mark detecting section 926, and the last recorded mark coordinate calculating section 928 calculates how far the data has been written, and additionally records the data. Are output from the additional writing start coordinate output unit 922. In other words, even if it is not possible to see the marker of the fine dot code, it is easy to detect by detecting the larger recorded mark 924.

Note that the recorded mark 924 can also be used for alignment in the printing unit 866. That is, in the above example, the dot code had to be read again for the alignment in the printing unit 866, but when the recorded mark 924 was used, the processing was performed only with the mark 924. it can. In other words, by detecting the recorded mark 924, recording may be performed at a distance of, for example, about 1 mm between the recorded area and the additional recording portion, or 1 mm in the vertical direction in the direction shown in FIG.
Since the information may be recorded with a certain degree of deviation, it is possible to add the information very easily. However, depending on the contents to be added, if the block address of a recorded block is read, the block address of the part to be added has continuity as one code by adding the block address next to the last block address. Can be made.

FIG. 78 (A) shows a business card card reading system as one application example using the above-mentioned overwrite type or write-once type MMP card. This system reads an MMP business card card 930 on which multimedia information is described in dot code with an MMP business card card reader 932 and reads the CRT 93 of a personal computer or the like 934.
6 and an audio is generated from the speaker 938. The MMP business card card reader 932 is the same as the information reproducing apparatus described above, particularly in the configuration. The MMP business card card reader 932 is a stationary type rather than a pen type because it simply reads a business card card. of course,
As described above, the information may be provided in the form of a pen-type information reproducing device and a card-type adapter, and may be displayed and reproduced in an electronic organizer or the like.

[0434] The MMP business card card 930 has a dot code on the back side of the card with the company name, affiliation, name, address, and telephone number on the front side, like the overwrite type or write-once type MMP card described above. In the case of a business card in which the back side is also written in English, the dot code may be printed using infrared-emitting ink or fluorescent ink as described above, as shown in FIG. May be stealth printed 940.

Next, an MMP card formed by a semiconductor wafer etching method will be described. In this technique, a very fine dot pattern is recorded on a semiconductor wafer by utilizing a semiconductor etching technique. The reflectance of light differs between the mirror-finished wafer surface and the etched pattern portion, and the dot code can be read with the contrast. Here, in order to further increase the contrast and improve the S / N, aluminum or another member having a significantly different reflectance or color may be embedded in the etched dot code pattern.

FIGS. 79 (A) and (B) and FIGS. 80 (A) to (C) show the structure of the card body 9 in which the dot code pattern is recorded.
44 embedded in the base 946. In this case, since the dot code pattern is recorded with a dot size of several μm or sub μm level, extremely high density recording can be performed. Thus, for example, a gigabyte-unit ROM card can be obtained.

Further, unlike the ROM-IC, it is not necessary to operate normally electrically, so even if a part of the pattern is defective, it can be corrected by the error correction processing in the reproducing apparatus.
Since the yield is much higher than that of a ROM-IC, and the number of steps is much smaller than that of an IC, there is an advantage that it can be supplied at very low cost.

However, since the pitch is very fine,
Care must be taken against dirt such as small dust and fingerprints. In order to protect it, for example, as shown in FIGS. 79A and 79B, a plurality of slide-type protective covers 948 are attached to the surface of the wafer portion 942 of the card 944, or as shown in FIG. A single protective shutter 950 as shown in FIGS.

In this case, the protective cover 948 is, for example, 4
There are several types of opening methods, such as opening only necessary portions or opening a sliding door. The card may be opened on one side when a card is inserted.

On the other hand, in the case of the protective shutter 950, the protective shutter 950 is completely opened when a card is inserted, and is closed when the card is removed. This is because, for example, as shown in FIGS. 80 (B) and (C), the wafer base 9 is attached to the card base 946.
42 is dropped into the card base 946 and the groove 9
52 are cut on both sides, respectively, and a protective shutter 950 is inserted so as to sandwich them. Protection shutter 9
A stopper 956 is provided at the tip of the claw 954 on the side surface of the card 50, and the card base 946 side to receive the protection shutter 9
Stopper 95 so that 50 does not open beyond a predetermined position.
Groove 952 to stop there when 6 is in place
The depth is shallow.

When reproducing the dot code from the MMP card formed by such a semiconductor wafer etching method, the pen-type information reproducing apparatus as described above may be used. There is a need to. Or, in the form of a line sensor,
You may make it the structure which does not move mechanically.

FIG. 81A shows a disk device 958 with a dot code decoding function, that is, a known disk device for recording and reproducing audio information such as music on a magneto-optical disk. And a record function. This means that the dot code on the sheet 960 as shown in FIG.
The code is reproduced by scanning with the operation unit 962,
Information devices 964 and earphones 96 such as personal computers and electronic organizers
6 is output.

As shown in FIG. 82, the disk device 958 has a spindle motor 968, an optical pickup 970, a feed motor 972, a head drive circuit 974, an address decoder 976, an RF amplifier 978,
Servo control circuit 980, EFM (Eight to Fourteen Mo
dulation), ACIRC (Advanced Cross Interleave)
Read Solomon Code) circuit 982, seismic memory controller 984, memory 986, display unit 988, key operation panel 990, system controller 992, compression / decompression processing unit 994, A / D converter 996, audio input terminal 998, D / A converter 1000 and an audio output terminal 1002.

Here, the EFM and ACIRC circuit 982
Is a part for performing encoding and decoding at the time of writing and reading of the disk. The memory controller 984 for the earthquake resistance stores the memory 9 in order to prevent sound skipping due to vibration.
86 for interpolating the data. The compression / decompression processing unit 994 performs a compression / decompression process using an audio efficient coding method called ATRAC (Adaptive Transform Acoustic Coding), which is a type of transform coding method for performing coding by converting from the time axis to the frequency axis. Do.

The disk device 958 with the present dot code decoding function receives an image signal from the operation unit 962 in such a conventional disk device, for example, as shown in FIG.
An image processing unit 1004 that performs processing such as the image processing unit 460, a connection terminal 1006 for an information device 964 and an I / F 1008 thereof are provided, and the compression / decompression processing unit 994 is configured by an ASIC-DSP or the like. Therefore, the function of the data processing unit 462 such as the demodulation for dot code reproduction and error correction, and the processing for data compression and decompression for the information device 1008 are also included therein.

The operation unit 962 includes, for example, an imaging optical system 200, an imaging unit 204, an optical system 1010 corresponding to the preamplifier 206, and an imaging device 10 in FIG.
12, an amplifier 1014 and the like.

In an information reproducing apparatus for reproducing a dot code, reproduction of high-capacity information such as music is usually performed.
Although a large-capacity memory is required, a large-capacity memory can be eliminated by having a recording / reproducing unit for the disk 1016. In addition, a sound reproduction part, here, a sound compression / decompression processing unit 994, a D / A converter 1000, or the like can be commonly used.
And the data processing part of the code reproduction process
By designing with an IC-DSP, low cost and miniaturization can be achieved.

The disk device 958 with the dot code decoding function having such a configuration can use functions such as sound recording and reproduction as a normal disk device, and music selection.
It can also be used as a dot code reproducing device. This switching is controlled by the system controller 992 by operating the key operation panel 990.

When used as a dot code reproducing device, for example, the following usage is assumed. That is, as shown in FIG. 81 (B), the sheet 960 of A4
, A song selection index including a song name and a singer name is described in characters, and a dot code corresponding to the song is recorded. In this case, the music piece is information of an order of, for example, 3 minutes and 4 minutes, and therefore, becomes considerably long. Therefore, the dot code is recorded in a plurality of stages, that is, four stages in FIG. That is, each music piece is divided into a plurality of rows of dot codes, and a block having a block address of, for example, an X address of 1, and a Y address of 1 is included in the dot code of each row as described above. Is recorded on a sheet with an address indicating the divided position in the music. At the time of reproduction, all of the dot codes in the plurality of stages are scanned and recorded on the disk 1016.

At that time, even if the scanning order is randomly performed, the music can be written by considering the recording position of the disk 1016 by the address indicating the position in the music, that is, the music is recorded in the correct order. You.
For example, as shown in the figure, when one piece of music is divided into four rows of dot codes, even if the dot code of the second row is first scanned by the operation unit 962, the dot code of what number, that is, the second dot Since it is known from the address whether the code is a code, when the audio information reproduced from the dot code is recorded on the disc 1016, the recording portion of the first dot code is opened so that the audio information is reproduced in the correct order at the time of reproduction. can do.

For example, music A and music C are recorded,
Then, the user can make an original disc, such as recording the music D, without using another audio player, for example, a tape deck or a CD player.
For example, the user looks at the song selection index for the dot codes of a plurality of songs recorded on the sheet 960 and scans the dot codes in the order of reproduction at the time of reproduction, so that, for example, the songs A, C, D,. , And if it is played back normally, it will be played back in that order. That is, programming can be performed.

As the information device 964, an image output device can be used. For example, the FMD is used, and the compression / decompression processing unit 994 uses, for example, Japanese Patent Application No. 4-81.
No. 673, JPEG, MPEG, and a three-dimensional image decompression process are performed and converted into a video signal by the I / F 1008, whereby a three-dimensional image corresponding to the read dot code can be displayed. . Thus, the present embodiment is not limited to audio information.

Similarly, it is needless to say that the present invention can be applied to other digital recording / reproducing apparatuses such as DAT.

Next, an example in which the dot code recording function is incorporated in a silver halide camera will be described.

FIGS. 83A and 83B are views showing the structure of the back cover 1018 of the camera capable of recording multimedia information dot code. This is a configuration in which date information such as the date is recorded using an LED array 1020 in the form of a conventional data back, and a two-dimensional LED array 1022 for recording a dot code is arranged beside it. It has become. On the rear side of the data back, there is a circuit built-in section 1024, in which, for example, the LED array 102
The circuit for recording the multimedia information dot code is incorporated therein, and the data is printed as a dot code on a silver halide film (not shown) by the LED array 1022. For example, a tie-pin type microphone 1026 is connected to the circuit built-in unit 1024, a sound is extracted from the microphone 1026, and the information is exposed to a film in the form of a dot code by the two-dimensional LED array 1022 for recording a dot code.

In the data bag 1018, in addition to the LED arrays 1020 and 1022, an electric contact 1028 with the camera body of the main body is prepared because it is controlled using a CPU or the like of the camera main body. In addition, the claw portion 1032 of the hinge portion 1030 slides, and can be detached from the camera body using the claw slide lever portion 1034. That is, the data bag 1018 can be attached in place of the camera's original back cover.

This embodiment is an example in which a two-dimensional LED array 1022 records dot codes at once. On the other hand, in FIG. 84A, the dot code recording LED unit 1036 is moved to two-dimensionally record the dot code. This LED unit 1
036 is a line-shaped LE as shown in FIG.
It comprises a D array 1038 and a lens 1040 for converging or reducing the light from it. And LED
An electric signal electrode 1042 for receiving a control signal of the array 1038 extends on both sides thereof. The signal electrode 1042 moves along with the movement of the LED unit 1036, and a data bag 1018 as shown in FIG. It is configured so that it always comes into contact with the signal electrode plate 1044 on the side by sliding, and the data signal enters from there. The film holding plate 1046 of the data bag 1018 is provided with a scanning window 1048 made of transparent glass, acrylic, or the like.
Only 036 is configured to face the film (not shown).

When a two-dimensional LED array is used, it is only necessary to electrically blink each necessary part without physically moving the two-dimensional LED array.
When using the array 1038, the LED unit 1
036 must be moved. As the moving mechanism, for example, a mechanism as shown in FIG. That is, this is basically the same configuration as the well-known tuner needle moving mechanism. When the pulley 1052 is rotated by the motor 1050, the wire 1054 wound around the pulley 1052 is attached. The LED unit 1036 fixed at both ends moves left and right. The wire 1054 has no expansion or contraction, and
The unit 1036 can be moved with high accuracy. In addition, the pulley 1052 and the wire 1054 are configured on both sides with respect to the LED unit 1036 so that the translation is performed accurately.

The moving mechanism of the LED unit 1036 is, as shown in FIG.
56 can also be used. This ultrasonic motor 105
No. 6 applies vibration to the vibration plate 1058, which transmits the ultrasonic wave, as if the wave moves rightward and leftward while shifting the phase well, and moves while riding on the wave. The body 1060 moves to the right or to the left. With the movement of the moving body 1060, the LED unit 103 connected thereto is moved.
6 also moves right or left.

FIG. 85 is a diagram showing the circuit configuration of the data bag 1018 shown in FIGS. 83 (A) and 84 (A).
8.

A CPU (for example, 1
A chip microcomputer 1062 controls the entire camera. The exposure control unit 1064 performs exposure control based on photometric data from the photometric unit 1066. The shutter control unit 1068 and the aperture control unit 1070 adjust the shutter speed and / or aperture according to the purpose or Control is performed according to the mode, and control is performed so as to obtain an optimal exposure as appropriate.

The CPU 1062 calculates a lens control amount using the lens information held on the lens side or the main body side, and causes the lens control unit 1074 to perform necessary lens control. This includes focus control and zoom control. Further, the CPU 1062 performs the shutter operation in response to the operation of the focus lock button 1076 and the release button 1078 (usually, one button is mechanically shared and comes out independently). Control. Further, the CPU 1062 controls the motor control unit 108
0, a motor 1082 for winding the film
Control.

The CPU 1062 operates the data back 1018 via the electric contact 1028 with the camera body.
, A multimedia information recording / reproducing unit 1084, a multimedia information LED controller 1086, and a date LED controller 1088. The date LED controller 1088 controls the light emission of the date LED array 1020 and imprints the photographing date and time on the film. The data back 1018 includes a date and time for generating a time pattern for the date and time. Clock generator 10
90 is built-in.

[0464] Multimedia information recording / reproducing unit 1084
Has a configuration from a voice input in the configuration of FIG. 13 to a portion for generating a pattern constituting a dot code just before code synthesis and editing in the configuration of FIG. 13, for example. Scan conversion unit 18
6 to a D / A converter 266. Then, the multimedia information LED controller 108
Reference numeral 6 controls light emission of the LDE array 1022 or 1038 according to the dot code pattern output from the multimedia information recording / reproducing unit 1084.
In this case, in the example of FIG. 83A, since the two-dimensional LED array 1022 is used, the dot code pattern is exposed only with this configuration. On the other hand, in the example of FIG. 84A, it is necessary to further move the one-dimensional LED array 1038, so that the motor 1050 is driven by the
The ED unit 1036 is moved. The multimedia information LED controller 1086 is connected to the motor 105.
The code information required to be recorded at that position at any time while matching the timing with the movement by 0 is stored in the LED array 10.
38 to emit light.

[0465] Various mode setting keys 1094 are provided on the camera body side. This may be composed of a number of buttons, or may be separated into a button for mode switching and a button for setting. This may be provided on the data back side. In this case, the key operation signal is supplied to the CPU 1062 via an electric contact.

In the above configuration, the dot code is exposed on the film as follows, for example. That is, when the operation signal of the focus lock 1076 button, which is one index to start shooting, is activated, the CPU 1062 fetches audio from the microphone 1026 to the multimedia information recording / reproducing unit 1084, and records / records the multimedia information. The data is sequentially stored in a storage unit (not shown) inside the reproduction unit 1084 for a certain fixed time. For example,
This fixed time is decided in the form of 5 seconds or 10 seconds,
It is assumed that the maximum capacity of the memory (not shown) is adjusted to that, and the data is sequentially and cyclically stored in the same manner as a general voice recorder. Then, when the release button 1078 is pressed, the CPU 1062 instructs the multimedia information recording / reproducing unit 1084 to, for example, a few seconds before (for example, 5 seconds) or before or after (for example, 1 second after, 3 seconds before). Seconds) to the dot code. This setting
For example, a user can be set by a mode setting key 1094. Then, the audio stored in the multimedia information recording / reproducing unit 1084 is actually encoded, and the encoded audio is printed on the film by the LED array 1022 or 1038. After the operation is over, C
The PU 1062 performs a film winding operation. Of course, the LED array moving motor controller 1092
And the film winding motor control unit 1080, and it is also possible to record while adjusting the moving speed and timing while winding the film. In that case, it is possible to take measures such as high-speed continuous shooting. Also, the LED unit 1036 is fixed,
An operation of recording when the film is wound up is also possible. At this time, there is an advantage that one motor is reduced.

In addition to recording sound as dot code information on a film as described above, the CPU
It is also possible to record information on the various camera sides provided from 2, for example, information on what kind of lens the lens currently used is, or what the shutter speed is, and what the aperture is. . That is,
For example, it is possible to later understand under what conditions a photograph was taken with respect to the completed photograph. Normally, such information is stored in the user's mind, but according to the present embodiment,
By playing back the dot code on the film that was completed later or the photographic paper on which it was printed with a multimedia information dot code playback device, the information can be selectively displayed, and the camera at the time of shooting can be displayed. And so on can be understood. Therefore, for example, the same setting can be easily performed the next time the user wants to shoot under the same conditions. In particular, it is very useful when taking pictures on a routine basis, for example, taking a change in a specific scenery through the moon.

FIG. 83 (C) shows an example of printing a film on which a dot code has been printed as described above. This is, for example, an example in which the dot code 1096 and the date code 1098 written on the film are directly printed as a picture together with another picture portion 1100. In this case, sound information or various camera information can be reproduced by scanning the dot code 1096 with the multimedia information dot code reproducing apparatus described above, for example, a pen-type information reproducing apparatus. In addition, if the dot code is removed on the DPE side and printed on the back side, for example, the front side becomes only a photograph and the same thing as a conventional photograph can be obtained. Furthermore, as one of the camera information, DPE
If you record the trimming information, such as zooming and panorama switching information, on the film, the DPE scans the dot code on the film and reads the information. Or zooming and printing.

When a dot code is printed on a film, double exposure with the actual scenery is performed. If the external light is strong at that time, there is a possibility that the dot code may not be captured properly. Therefore, for example, in the conventional panorama compatible camera, when switching to panorama, the light shielding plates enter the upper and lower sides,
Some of the parts are configured so that the scenery is not reflected, but a similar function may be added. That is,
The light-shielding plate may be automatically inserted, or if the device is compatible with the dot code from the beginning, the light-shielding plate may be fitted immediately before the film or after the lens. Further, the code may be recorded in a margin (unexposed portion) of the film.

In FIG. 85, by connecting the pen-type information reproducing apparatus 1102 to the data back 1018 and reproducing the dot code 1096 of FIG.
Camera information, that is, aperture information, shutter information, lens information, and the like may be displayed on the LCD mode display unit 1104 or the LED display unit 1106 in the viewfinder, which is initially provided on the back of the camera back or in the camera body. Also, by scanning the dot code 1096,
The mode may be set to the same condition.
In other words, if the user has a film or photograph and scans the dot code 1096, each condition on the camera side is automatically set in that mode, and the same shutter speed, the same aperture, and the same lens magnification are used.

[0471]

As described in detail above, according to the present invention,
Recording medium, information reproducing apparatus, and information reproducing method capable of reproducing and outputting multimedia information including audio information, video information, digital code data, and the like recorded on the recording medium in a format that can be recorded at low cost and with large capacity and that can be repeatedly reproduced Can be provided.

[Brief description of the drawings]

FIG. 1 is a block diagram of a recording device for dot-coded audio information according to a first embodiment of the present invention.

FIG. 2A is a diagram illustrating a recording format of a dot code, and FIG. 2B is a diagram illustrating a use state of a reproducing apparatus according to the first embodiment.

FIG. 3 is a block diagram of a playback device according to the first embodiment.

FIGS. 4A and 4B are explanatory diagrams of manual scanning, and FIGS. 4C and 4D are explanatory diagrams of scan conversion, respectively.

FIG. 5A is a diagram for describing data interpolation accompanying scan conversion, and FIGS. 5B and 5C are diagrams illustrating examples of a recording medium, respectively.

FIG. 6 is an explanatory diagram of data string adjustment.

FIG. 7 is a diagram illustrating a configuration of a playback device according to a second embodiment.

FIG. 8 is a diagram illustrating a configuration of a playback device according to a third embodiment.

FIGS. 9A and 9B are external perspective views of a portable voice recorder, respectively.

FIG. 10 is a circuit configuration diagram of the portable voice recorder.

FIGS. 11A and 11B are diagrams showing examples of printing on a recording medium, and FIGS. 11C and 11D are external perspective views of another example of a portable voice recorder.

12 is a flowchart of a dot code printing process in the voice recorder of FIG.

FIG. 13 is a block diagram of a multimedia information recording device.

FIG. 14 is a conceptual diagram of a dot code.

FIG. 15 is a block diagram of a multimedia information reproducing apparatus.

FIG. 16 is a light source emission timing chart in the multimedia information reproducing apparatus of FIG. 15;

FIG. 17 is a diagram illustrating another configuration example of the multimedia information reproducing apparatus.

18A is a diagram illustrating a dot code applied to the reproducing device of FIG. 3 for explaining a data string adjusting unit in the multimedia information reproducing device of FIG. 15, and FIG. A diagram showing a dot marker of a dot code of the
(C) is a diagram for explaining a scanning method, and (D) is a diagram for explaining a scan pitch of an image sensor.

FIG. 19 is a diagram illustrating an actual configuration of a data string adjusting unit.

FIGS. 20A to 20C are views showing markers having arrangement direction detection dots, and FIG. 20D is a view showing still another configuration example of the multimedia information reproducing apparatus.

FIG. 21A is an explanatory diagram of a block address, and FIG.
Is a diagram showing a block configuration, (C) is a diagram showing an example of a marker pattern, and (D) is a diagram for explaining a magnification of an imaging system.

FIG. 22 is a block diagram of a marker detecting unit in the multimedia information reproducing apparatus.

FIG. 23 is a processing flowchart of a marker determination unit in FIG. 22;

FIG. 24 is a processing flowchart of a marker area detection unit in FIG. 22;

25A is a diagram showing a marker area, FIG. 25B is a diagram showing a storage format of a table for storing a detected marker area, and FIGS. 25C and 25D are diagrams of FIG. FIG. 7 is a diagram showing the accumulated value of each pixel in FIG.

26A is a flowchart of a process performed by the approximate center detecting unit in FIG. 22, and FIG. 26B is a flowchart of a gravity center calculation subroutine in FIG.

FIG. 27 is a block diagram of a general center detection unit.

28A is a diagram showing an actual configuration of a dot code data block, FIG. 28B is a diagram showing another configuration,
(C) is a diagram for explaining another arrangement of data inversion dots.

FIG. 29A is a diagram showing another example of the actual configuration of a dot code data block, and FIG. 29B is a diagram for explaining selection of an adjacent marker.

FIG. 30 is a block diagram of a data array direction detecting unit in the multimedia information reproducing apparatus.

FIG. 31 is an operation flowchart of a data array direction detection unit.

32A is a flowchart of an adjacent marker selection subroutine in FIG. 31, and FIGS. 32B and 32C are diagrams for explaining adjacent marker selection, respectively.

FIG. 33A is an explanatory diagram of direction detection, and FIG. 33B is a diagram for explaining the relationship between m and n in FIG.

FIG. 34 is an explanatory diagram of another method of direction detection.

FIGS. 35 (A) and (B) are a block configuration diagram and an explanatory diagram of a block address detection, error determination, and accurate center detection unit in the multimedia information reproducing apparatus, respectively.

FIG. 36 is an operation flowchart of a block address detection, error determination, and accurate center detection unit.

FIG. 37A is a diagram for explaining the operation of a marker and address interpolating unit in a multimedia information reproducing apparatus, and FIG. 37B is a block diagram of an address control unit in the multimedia information reproducing apparatus. It is a block diagram.

38A is a diagram for explaining another processing method of the marker judgment unit, FIG. 38B is a diagram for explaining a marker judgment formula, and FIG. 38C is a diagram for explaining marker alignment detection; It is.

FIG. 39 is a diagram showing a configuration of a light source integrated type image sensor.

FIG. 40 shows a one-chip IC using an XY address type imaging unit.
FIG. 2 is a block diagram of the configuration.

41A is a diagram illustrating a circuit configuration of a pixel of an XY address type imaging unit, and FIG. 41B is a diagram illustrating a configuration of a pen-type information reproducing apparatus having a dot code capture control switch.

FIG. 42 shows a three-dimensional IC using an XY address type imaging unit.
FIG. 2 is a block diagram of the configuration.

FIG. 43 is a diagram showing another configuration of a pen-type information reproducing apparatus having a switch for controlling dot code capture.

44A is a diagram illustrating a configuration of a pen-type information reproducing apparatus capable of removing regular reflection, FIG. 44B is a diagram illustrating a configuration of first and second polarization filters, and FIG. FIG. 4 is a diagram illustrating another configuration example of the second polarization filter, and FIG. 4D is a diagram illustrating a configuration of an electro-optical element shutter.

FIG. 45 is a diagram showing another configuration of a pen-type information reproducing apparatus capable of removing regular reflection.

46A is a diagram showing a configuration of a pen-type information reproducing device using a transparent resin optical waveguide material as a light source, and FIG. 46B is an enlarged view of a connection portion between the optical waveguide material and a reproducing device housing; , (C) and (D) are diagrams illustrating the configuration of the tip portion of the optical waveguide material, respectively.

FIG. 47 is a diagram showing a configuration of a pen-type information reproducing apparatus using an image sensor integrated with a light source.

48A is a diagram showing the configuration of a pen-type information reproducing apparatus compatible with color multiplexing, FIG. 48B is a diagram for explaining a color multiplexing code, and FIG. (D) is a diagram showing an index code.

FIG. 49 (A) is an operation flowchart of a color multiplexing compatible pen-type information reproducing apparatus, and FIG. 49 (B) is a diagram showing a configuration of an image memory unit when a color imaging element is used.

50A is a diagram showing another configuration of a pen-type information reproducing apparatus compatible with color multiplexing, and FIG. 50B is a diagram showing a configuration of a light source.

FIG. 51 (A) is a diagram showing a dot data sticker on which a stealth type dot code is written, FIG. 51 (B) is a diagram showing a configuration of a pen type information reproducing apparatus corresponding to a stealth type dot code, and FIG. FIG. 4 is a diagram showing a dot data seal in which a stealth type dot code is written in another mode.

FIG. 52 is a diagram illustrating a configuration of a card-type adapter including an audio output terminal.

FIGS. 53A and 53B are diagrams showing a configuration of a card type adapter for a video game machine.

FIG. 54A is a diagram showing an example of use of a card-type adapter for an electronic organizer, and FIG. 54B is a diagram showing an appearance and an example of use of a card-type adapter for a device having no input means.

FIG. 55 is a diagram for explaining how to use a reel seal printing machine for printing a dot code on a reel seal.

FIG. 56 is a diagram showing an internal configuration of a reel seal printing machine.

FIG. 57 is a diagram showing a configuration in a case where a function of recording a multimedia dot code is provided inside a word processor.

58 is a diagram showing a configuration in a case where the function of the multimedia information recording processing unit in FIG. 57 is incorporated in an optical copying machine.

FIG. 59 is a diagram showing a configuration when the function of the multimedia information recording processing unit in FIG. 57 is incorporated in a digital copying machine.

FIG. 60 is a diagram showing a configuration in a case where the pen-type information reproducing apparatus is used also as an input unit for character and picture data.

FIG. 61 is a diagram showing another configuration in a case where the pen-type information reproducing apparatus is also used as an input unit for character and picture data.

FIG. 62 is a diagram showing a configuration of a scanner and a card type adapter compatible with data reading.

FIGS. 63A and 63B are diagrams showing a system in which a dot code is scanned by a pen-type information reproducing apparatus and projected onto a screen by a projector, respectively.

FIG. 64 is a diagram showing a specific configuration of an output processing unit in (A) and (B) of FIG. 63;

FIG. 65A is a diagram showing a case where an image is output to a copier, a magneto-optical disk device, and a printer instead of the projector;
(B) is a diagram showing a case where the output processing unit is configured as a card type adapter.

FIG. 66 is a diagram showing a specific configuration of an output processing unit.

FIG. 67 is a diagram illustrating a configuration of an example in which a format conversion unit for converting a format into a format for each type of word processor is provided.

FIG. 68 is a diagram illustrating an actual configuration of a format conversion unit.

FIG. 69 is a system diagram when a sheet on which a dot code is recorded is transmitted and received by facsimile.

FIG. 70 is a diagram showing a configuration of a facsimile multimedia information recorder.

FIG. 71 is a diagram showing a configuration of a multimedia information recording device with a built-in FAX.

72A is a diagram showing a configuration of an overwrite-type MMP card recording / reproducing apparatus, and FIGS.
It is a figure showing the back and front sides of a P card.

FIG. 73 is a diagram showing another configuration of the overwrite type MMP card recording / reproducing device.

74A is a diagram showing still another configuration of the overwrite type MMP card recording / reproducing device, FIGS. 74B and 75C are diagrams showing the back surface and cross section of the MMP card, and FIG. FIG. 3 is a diagram illustrating a configuration of a pattern recording sheet.

FIG. 75 is a diagram showing another configuration of the overwrite type MMP card recording / reproducing device.

76A is a diagram showing a configuration of a write-once MMP card recording / reproducing apparatus, and FIG. 76B is a block diagram of a recorded area detection unit in FIG.

FIG. 77A is a diagram showing another configuration of a recorded area detection unit, and FIG. 77B is an MMP in which a recorded marker is described.
It is a figure showing a card.

78A is a diagram showing an MMP business card card system, and FIGS. 78B and 78C are diagrams showing a back surface and a front surface of the MMP business card card.

FIGS. 79A and 79B are plan views of an MMP card formed by a semiconductor wafer etching method, wherein FIG. 79A shows a state in which a protective cover is closed, and FIG.

80A is a plan view of an MMP card having another configuration formed by a semiconductor wafer etching method, FIG. 80B is a side view, and FIG. 80C is a view for explaining the configuration of a claw portion.

FIG. 81A is a diagram illustrating a disk device with a dot code decoding function, and FIG. 81B is a diagram illustrating a recording example of a dot code and an index.

FIG. 82 is a block configuration diagram of a disk device with a dot code decoding function.

83A is a diagram showing a configuration of a back cover of a camera capable of recording multimedia information dot codes, FIG. 83B is a side view thereof, and FIG. 83C is a photographic paper on which multimedia information dot codes are recorded. It is a figure showing the example of.

FIG. 84A is a diagram showing another configuration of the back cover of the camera supporting multimedia information dot code recording, and FIG. 84B is a diagram showing LE.
FIG. 3C is a diagram showing a configuration of a D unit, FIG. 4C is a diagram showing a data back side signal electrode, and FIGS.
FIG. 4 is a diagram illustrating a moving mechanism of the ED unit.

FIG. 85 is a block diagram of a camera capable of recording multimedia information dot code.

[Explanation of symbols]

36,170 dot code 36A, 36B mark for manual scanning 38,172,304 block 38A, 174,274,310 marker 38B error correction code 38C audio data 38D x address data 38E y address data 38F error judgment code 40 pen type information Reproduction device 42 Audio output device 44 Detection unit 46 Scan conversion and lens distortion correction unit 48 Binarization circuit 50 Threshold judgment circuit 54 Demodulation circuit 56 Data string adjustment unit 58 De-interleave circuit 60 Error correction circuit 62 Decoding circuit 64, 240, 244,258 Data interpolation circuit 66 D / A conversion circuit 70 Detector and scan converter 72 Interpolator 176, 272A, 306 Block address 178 Address error detection, error correction data 180, 314 Data area 184 Detector 86 Scanning conversion unit 188 Binarization processing unit 190 Demodulation unit 192 Data string adjustment unit 194 Data error correction unit 196 Data separation unit 214 Image memory 216 Marker detection unit 218 Data array direction detection unit 220, 232 Address control unit 222 Interpolation circuit 224 Lens aberration distortion correction memory 226 Threshold determination circuit 228 Block address detection unit 230 Block address error detection and correction unit 238, 242, 248, 256, 262 Decompression processing unit 246 PDL (page description language) processing unit 250, 264 Synthesis or Switching circuit 252, 266 D / A conversion unit 254 Display device 260 Audio synthesis unit 268 Audio output device 270 Page printer, plotter, etc. 272B Error correction data of block address 276A Line address 276B Error detection Data 278,316 dots 294A, 296A, 298A Dots for array direction detection 300 Block address detection, error determination, accurate center detection section 302 Marker and block address interpolation section 306A Upper address code 306B Lower address code 308 Dummy marker 310A Circular black Marker 310B Marker white part 312 Error detection code 312A Upper address CRC code 312B Lower address CRC code 364 Data margin

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) G10L 3/00 M (72) Inventor Shinzo Matsui 2-43-2 Hatagaya, Shibuya-ku, Tokyo Olympus Optical Inside the Industrial Co., Ltd. (72) Ken Takeshi Mori 2-43-2, Hatagaya, Shibuya-ku, Tokyo Olympus Optical Industrial Co., Ltd. (72) Seiichi Wakamatsu 2-43-2 Hatagaya, Shibuya-ku, Tokyo Olympus Optical Within Kogyo Co., Ltd. (72) Yoshikazu Akamine 2-43-2 Hatagaya, Shibuya-ku, Tokyo Olympus Optical Kogyo Co., Ltd. (72) Kazuhiko Morita 2-43-2 Hatagaya, Shibuya-ku, Tokyo Olympus Optical Industrial Co., Ltd.

Claims (9)

[Claims] 1. A recording medium having a portion in which data is recorded as an optically readable code, wherein the data is divided into a plurality of codes and recorded. 2. The recording medium according to claim 1, wherein each of the plurality of codes includes header information for identifying each of the codes. 3. Each of the codes includes at least a data dot pattern in which dots are arranged according to the data, and an address dot pattern representing an address for identifying each of the codes. 3. The recording medium according to claim 2, wherein the recording medium is header information. 4. An information reproducing apparatus for reproducing data by optically reading a code from a recording medium having a portion in which data is recorded as an optically readable code, wherein the data is a plurality of data. An information reproducing apparatus comprising: means for reproducing the data by sequentially reading all of the plurality of codes when the data is divided and recorded. 5. The plurality of codes each include header information for identifying each of the codes, and the means for reproducing the data reproduces the data based on the header information. The information reproducing apparatus according to claim 4, wherein: 6. Each of the codes includes at least a data dot pattern in which dots are arranged in accordance with the data, and an address dot pattern representing an address for identifying each of the codes. 6. The information reproducing apparatus according to claim 5, wherein the information is header information. 7. An information reproducing method for reproducing data by optically reading a code from a recording medium having a portion in which data is recorded as an optically readable code, wherein the data is a plurality of data. An information reproducing method characterized by reproducing the data by sequentially reading all of the plurality of codes when the data is divided and recorded. 8. The method according to claim 7, wherein each of the plurality of codes includes header information for identifying each of the codes, and reproduces the data based on the header information. Information reproduction method described. 9. Each of the codes includes at least a data dot pattern in which dots are arranged in accordance with the data, and an address dot pattern representing an address for identifying each of the codes. 9. The information reproducing method according to claim 8, wherein the information is header information.