JPH08212313A - Information reproduction system and recording medium - Google Patents

Abstract

PURPOSE: To improve the operability of a reproduction system for a dot code. CONSTITUTION: A reproduction processing part 26 reads the contents of a header written on a subset element supplied from an error correction part 24 and generates a subset according to the contents of the header. Then, the contents of the header written in the generated subset are read out and a file is generated according to the contents of the header. Data of the file which is thus generated are decoded and the decoded data are outputted to an output device 30 such as a CRT. At this time, every subset is displayed, and a scale bar display indicating which position of the dot code 12 each subset corresponds to, is made.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to so-called multimedia including audio information such as voice and music, video information obtained from cameras and video equipment, and digital code data obtained from personal computers and word processors. The present invention relates to a recording medium such as paper on which information is recorded as an optically readable two-dimensional code pattern, and an information reproducing system for optically reading the code pattern from the recording medium to reproduce original multimedia information.

[0002]

2. Description of the Related Art Conventionally, various media such as magnetic tapes and optical disks have been known as media for recording voice, music and the like. However, even if a large number of copies of these media are made, the unit price will be high to some extent, and a large amount of space will be required for their storage. Furthermore, when it is necessary to hand over a medium on which voice is recorded to another person in a remote place, it takes time and effort to send it by mail or bring it directly. There was also. In addition to audio information, video information obtained from cameras, video equipment, etc., and digital code data obtained from personal computers, word processors, etc.,
The same applies to the so-called multimedia information as a whole including the above.

As a solution to such a problem, Japanese Patent Laid-Open No. 6-231466 discloses that multimedia information including at least one of audio information, video information and digital code data can be transmitted by facsimile. In addition, a plurality of dots are arranged two-dimensionally as image information, that is, coded information, which enables large-scale copying at low cost.
A system for recording on an information recording medium such as paper in the form of a dimensional code pattern and a system for reproducing the same are disclosed.

[0004]

However, in the system disclosed in Japanese Unexamined Patent Publication No. 6-231466, the interface for the operator, that is, the user has not been sufficiently studied, and therefore, when reproducing information. There is still plenty of room to improve the operability of the.

The present invention has been made in view of the above points, and audio information such as voice and music, video information obtained from a camera, a video device and the like, digital code data obtained from a personal computer, a word processor and the like, A recording medium such as paper in which so-called multimedia information including the above is recorded as an optically readable two-dimensional code pattern, and the original multimedia information is obtained by optically reading the code pattern from such a recording medium. It is an object of the present invention to improve the operability in reproducing information in an information reproducing system for reproducing.

[0006]

To achieve the above object, the information reproducing system according to the present invention is capable of optically reading multimedia information including at least one of audio information, image information and text data. Reading means for optically scanning and reading the code from a recording medium recorded as a code, and processing means for performing a predetermined process on the code read by the reading means to restore the original multimedia information. And an output means for reproducing and outputting each multimedia information based on an output signal from the processing means, wherein the processing means responds to the code read by the reading means. The first control information, which is information regarding all parts of the code read by the reading means when performing predetermined processing by And control information detecting means for detecting at least one of the second control information, which is information relating to the restored part of the read code, and the output means is restored by the processing means. It is characterized by further comprising display means for displaying at least one of the first and second control information detected by the control information detecting means together with the multimedia information.

Further, the recording medium according to the present invention is a recording medium in which multimedia information including at least one of audio information, image information and text data is recorded as an optically readable code, and the code is At least one of layout information indicating the size and arrangement of the code with respect to the recording medium, scanning related information indicating the reading order of the code, and index information indicating an outline of data for each predetermined information unit of the code. The control information to be included is included together with the multimedia information.

[0008]

That is, according to the information reproducing system of the present invention, the control information detecting means of the processing means reads the code read by the reading means while the predetermined processing is performed on the code read by the reading means. The display means of the output means detects at least one of the first control information, which is information on all parts of the code, and the second control information, which is information on the restored part of the read codes. Thus, the multimedia information restored by the processing means and at least one of the first and second control information detected by the control information detecting means are displayed together.

Therefore, by displaying the control information together with the restored multimedia information, the correspondence between the code on the recording medium and the restored information becomes clear, so that the operability can be improved. it can.

Further, according to the recording medium of the present invention, the code includes layout information indicating the size and arrangement of the code with respect to the recording medium, scanning related information indicating the reading order of the code, and each predetermined information unit of the code. The control information including at least one of the index information indicating the outline of the data is included together with the multimedia information. Therefore, a code to which information necessary for display and operation is added is recorded, and operability at the time of reproducing information is improved.

[0011]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1A is a diagram showing an appearance of an information reproducing system according to an embodiment of the present invention. A two-dimensional code recorded on a paper surface of a recording medium 10 such as a sheet that a user (operator) holds by hand. A reading unit 14 having a pen-like shape capable of scanning the dot code 12 as a pattern, and the reading unit 14
It is composed of a processing unit 16 such as a personal computer for processing the dot code read in step 1 to output it as original multimedia information such as voice and image.

Here, the format of the dot code 12 is as disclosed in, for example, Japanese Patent Laid-Open No. 6-231466. That is, as shown in FIG. 2, one block 12A includes a marker 12B, a block address 12C, address error detection / correction data 12D, and a data area 1 in which actual data is stored.
It consists of 2E. The blocks 12A are arranged vertically, horizontally, and two-dimensionally, and they are gathered to form a dot code 12.

FIG. 1B is a block diagram of the information reproducing system, in which a detecting section 18 for reading a dot code and image data supplied from the detecting section 18 are recognized as a dot code and are actually used. Scan conversion unit 20 for converting into binary data, data string adjustment unit 22 for demodulating the binary data from the scan conversion unit 20 and adjusting a data string, and when reproducing data from the data string adjustment unit 22 Data error correction unit 2 that corrects reading errors and data errors
4. A reproduction processing unit 26 that separates and expands the data error-corrected by the data error correction unit 24 according to each attribute, and the detection unit 18 to the reproduction processing unit 26.
A system control unit 28 including a CPU for controlling the transmission and reception of data, and an output device 30 including a sound reproducing unit such as a display unit such as a CRT or a speaker.
The system control unit 28 has a memory 28M for storing various data given from each unit.

The reading unit 14 has the detection unit 18 built-in, and the processing unit 16 has other scan conversion units 20 to output devices 30 built-in. Of course, which part is to be incorporated in the reading unit 14 and the processing unit 16 is
It is optional.

FIG. 3 is a diagram showing the details of the reproduction processing unit 26. The reproduction processing unit 26 includes a header reading unit 32, a subset data unit generation unit 34, a header reading unit 36, and a file generation / management unit. 38, high efficiency code decoding unit 40, and file operation / information output unit 42 by application
Consists of

Here, in order to facilitate understanding of the present invention,
The subset will be explained. That is, Japanese Patent Application No. 6-121368 filed by the applicant of the present invention discloses that a dot code pattern is recorded and reproduced on an information recording medium such as paper as an example of a code pattern capable of optically reading multimedia information. Multimedia paper (M
As a hierarchical division of the information transfer protocol in the MP) system, a plurality of logical hierarchical structures of layers 1 to 5 are shown on both the recording side and the reproducing side.

On the recording side, first, an application process, generally an application program on a computer, audio information such as voice and music generated by a computer, video information obtained from a camera, a video device, and the like, and personal information. So-called multimedia information including digital code data obtained from a computer, a word processor, etc. is used as an information recording device via an application layer (layer 5) and a presentation layer (layer 4) similarly configured on the computer. MMP
Delivered to recording device. The MMP recording device records the received data as a dot code pattern optically readable by a data link layer (layer 3), a block data layer (layer 2), and a physical layer (layer 1) (information transmission (transmission) on paper or the like. ) Print and record on media.

The information recording (transmission) medium is passed to the reproducing side. Alternatively, the code pattern recorded on this medium may be transmitted to the reproducing side by facsimile and printed and recorded on an information recording medium such as paper on the reproducing side.

In the MMP reproducing apparatus, the code pattern recorded on such an information recording medium is imaged, and the data editing process is performed according to the restoration process from layer 1 to layer 3 or layer 5 contrary to the recording process. And pass the resulting data to the playback side. On the reproducing side, contrary to the recording side, the reproduced multimedia information is passed to the application process via the processing functions of layers 4 and 5 as necessary.

The layer 1 (physical layer) on the reproducing side corresponds to the detecting section 18 and the scan converting section 20, and optically captures a dot code pattern recorded on an information recording (transmission) medium such as paper. Then, a functional module that outputs an image signal (imaging system module) and a functional module that performs pre-processing (gain control, equalization processing) on the image signal and performs sampling / quantization (reproduction equalization module, quantization module) To have. Further, a functional module for converting the quantized value into digital data to generate image data, and structuring the image data, from the structure information (header or first processing information) and data (entity of image data) It has a functional module that converts the data into a predetermined data format and outputs it to an adjacent upper layer, that is, layer 2, a functional module that inputs and outputs state information related to processing, and control information.

Structured (image) data in image pickup frame units is passed as a service data unit (1-SDU1) from the layer 1 to the upper layer 2. In addition,
Here, N-SDUN is the N-layer service data unit n
No. (Nth LayerService Data Unit, No.n) (n = 1 is data, 2 is status information, 3
Indicates control information). In addition, N-PDU that will be described later
n is the N layer protocol data unit n (Nth Layer Pr
otocol Data Unit, No.n) and N-PCIn are Nth Layer Protocol Control Infor.
mation, No.n) (corresponding to various processing information), N-UD
n is Nth Layer User Data, No.
n), ADU is an application data unit (Appl
ication Data Unit) and ACH respectively indicate an application control header.

The layer 2 (block data layer) corresponds to the data string adjusting unit 22 and is structured (image) data (1-S) input from the adjacent lower layer, that is, layer 1.
DU1) is input as 2-PDU1 and structural information (2-
PCI1, that is, first processing information) and data entity (2-UD
1) is recognized and separated, and a functional module that converts a data entity into a conforming form of processing, and a data module that is transformed into a conforming form of processing are processed, and a plurality of blocks that are divided into predetermined information code units are processed. Functional module for extracting blocks (block unit dot detection point extraction (marker detection, pattern matching, etc.) module, dot detection (identification / identification /
(Determination) module) and a functional module (block ID data reproduction module, intra-block data reproduction module) that processes the extracted block and reproduces an information code in block units. Here, the block-based information code includes structured information for connecting a plurality of blocks, coded modulation information, and a data substance. Further, the layer 2 is a functional module (encoding and demodulating module) that reads the above-mentioned coded modulation information from the information in block units and demodulates the data substance according to this coded modulation information
And the structured information (block header, that is, second processing information) of the demodulated blocked information code and the data entity (user data) in the adjacent upper layer, that is, layer 3 to 2-SDU1.
It has a functional module for outputting as, a functional module for inputting and outputting state information related to processing, control information, and the like.

That is, in this layer 2, the block unit dot detection point, that is, the marker is detected from the image data for each block data which is the first predetermined unit, and the data dot is detected in block unit according to the detected marker. , Return to bit string data. Details of this process are described in detail in Japanese Patent Application No. 5-260464 filed by the applicant of the present invention. Then, for this data in block units, first the header or block ID data is reproduced, then the in-block data as user data is reproduced, and the demodulation of encoding is performed to obtain the data in block data units. It is passed to the upper layer, that is, layer 3.

The layer 3 (data link layer) corresponds to a part of the data string adjusting unit 22 and the error correcting unit 24, and is a blocking information code (2-SDU1) input from the adjacent lower layer, that is, the layer 2. Is input as 3-PDU1, structured information (3-PCI1 or the second processing information) is recognized and read from this, and a plurality of block-unit data entities (3-UD1) are concatenated according to this structured information. , A functional module (block link (macroblock generation) module) that generates (configures) a macroblock or a super macroblock.

That is, as shown in FIG. 4, from the layer 2, a block <A>, <B>, <C>, ... And a bit data string in block units (one-dimensional for easy visual understanding in the figure). 2D, i.e., a rectangle, instead of the column of 3).
The block header as PCI1 (second processing information) and the user data as 3-UD1 after that are recognized and separated, and the blocks are concatenated according to the information written in the block header to generate a macroblock. To do.
In the figure, one macroblock <A> is generated by four blocks <A> to <D>.

The macroblock generated in this way consists of incidental information (macroblock header, that is, one of the second processing information) distributed in the macroblock and a data entity (user data).

In the figure, since the information of the block header is no longer used (not referred to or removed), it is shown in outline (shown in outline in FIGS. 5 and 6 to be described later). The same meaning applies to certain parts). That is,
The processing information is hidden in the user data as a formal form of the header so that it can be understood only after being assembled in the next stage. For example, in the step of forming a macroblock,
You don't need to know the information of the macro block at all, and you only need to get the processing information from the block that the blocks should be structured and linked. Therefore, the block header contains only processing information about how to link the blocks to form a macro block, and the processing information after this is hidden in the user data. In other words, only the information necessary for linking the block (link information) is viewed as processing information, and the processing information that follows is regarded as user data and is not read. And if connected as a macroblock,
The processing information is truncated (shown in white in the figure), and the processing information necessary for the next processing is read as header information from the beginning of the user data. That is, only the processing information necessary for each processing is read.

Here, the macroblock header is structured information (one of the second processing information) for connecting (connecting) macroblocks to generate (configure) a supermacroblock.
And information relating to interleave processing and error correction processing that does not exceed the processing range in the super macroblock (third processing information), and configuration specification information of the subset element (subset element header, that is, third processing information). Of these, at least the information relating to the interleave processing and the error correction processing has an error correction capability independent of the user data entity.

Also, the layer 3 reads the interleave information from the macroblock header, deinterleaves the user data of the macroblock according to it, and then reads the error correction information from the macroblock header, and deinterleaves accordingly. It has a function module (macroblock header unit deinterleave / error correction module) that corrects the error in the processed user data.

Furthermore, the layer 3 reads the structured information for generating (configuring) a super macroblock from the macroblock header, connects a plurality of macroblocks accordingly, and generates a supermacroblock ( It has a functional module (macro block link (super macro block generation) module).

That is, as shown in FIG. 5, the macro blocks are concatenated according to the information written in the macro block header to generate a super macro block. In the figure, one super macroblock <A> is generated by three macroblocks <A> to <C>.

The super macroblocks thus generated are distributed and arranged in the super macroblock in a duplicated distribution (for example, after being combined as a macroblock header, a plurality of supermacroblocks are present in the supermacroblock.
In other words, in the reverse direction, one super macroblock header is arranged as it is in each of the three macroblocks (= superimposition), and each macroblock is divided into four (= dispersion). ) Attached information (macroblock header) and data entity (user data).

Here, generation information (second processing information) of the super macro block, header information such as corrections, de-interleaving, subset element configuration specifications that must be processed in units of super macro blocks (third processing information).
Process information) of multiple macro blocks,
In addition, the reason for interleaving, that is, arranging in a dispersed manner within the range of one macroblock, is to ensure that the header information, in particular, the generation information of the super macroblock can be restored as data. That is, the paper normally used as an information recording medium for recording a code pattern is not a stable medium such as a magnetic disk, and moreover, when the quality of the paper or the printing state changes, The frequency of errors increases. Therefore, even if the contents of the user data are somewhat incorrect, if the link information and the error correction method for processing cannot be restored as data, the subsequent processing will not be possible. The same information is recorded double or triple. Further, from such a meaning, it is stipulated that the processing information is independently corrected.

Further, the layer 3 reads the interleave information from the macroblock header and deinterleaves the user data of the super macroblock in accordance with the interleave information, and from the macroblock header. It has a functional module (super macroblock unit error correction module) for reading error correction information and correcting the user data after deinterleave processing in accordance therewith.

Furthermore, the layer 3 reads the configuration specification information of the subset element, that is, the subset element header from the macroblock header, and accordingly separates the subset element from the error-corrected user data of the super macroblock ( Subset element unit output processing module),
A functional module that outputs the separated subset element unit to the adjacent upper layer, that is, layer 4 as 3-SDU1 and a functional module that inputs / outputs status information and control information related to processing are included.

That is, this layer 3 has a multi-step function of first linking or concatenating blocks to generate a macroblock and then concatenating it into a super macroblock.

Here, in the macroblock header of the generated macroblock, the specification of interleaving in the super macroblock, the error correction specification (error correction in which size, in which method, by which method in the super macroblock) Information indicating whether or not to perform to some extent), and the configuration specification of the subset element (information about how the subset element is configured and present). And such a macroblock header is
They are distributed and interleaved in one macroblock. In addition, the macroblock header and the user data are subjected to error correction using a different method.

Then, the same macroblock header information is written in each of a plurality of macroblocks constituting one super macroblock. In other words, the information created by linking the super macroblocks, the specifications such as the interleaving method in the super macroblocks, the error correction specifications, the subset element configuration specifications, etc. are duplicated in the same unit. In addition, the small areas are dispersed and arranged.

Therefore, this macroblock header information (second processing information) is read, the macroblocks are first concatenated to form a supermacroblock, and then the information in the duplicated macroblock headers in the supermacroblock ( First, the interleave specification is read from the third processing information), and deinterleave is applied in units of this super macro block. After that, the error correction specification (the unit of error correction may be set freely) is read, and the error correction is applied in this super macroblock according to the specification.

After the error correction processing is completed, the subset configuration specification (third part) written in the macroblock header is
Processing information), divides the super macroblock into data of the concept of subset element, and outputs it. That is, as 3-SDU1, data is transferred to the upper layer in units of subset elements.

The layer 4 (presentation layer) corresponds to a part of the reproduction processing unit 26 (the header reading unit 32 and the subset data unit generation unit 34), and is a subset element input from the adjacent lower layer, that is, the layer 3. A functional module (sub-file link information reading module) that inputs the unit data (3-SDU1) as 4-PDU1 and reads structured information (4-PCI1 or fourth processing information) from this, and the read structured Data entity (4
-UD1) and has a functional module (subset element link (subset generation) module) for generating (configuring) a subset. Here, the data in units of subset elements is composed of structured information (subset element header) that creates (configures) a subset by linking the subset elements and a user data entity.

The layer 4 also reads, from the generated subset, additional information necessary for an existing or new interface with an adjacent upper layer, and performs interface matching with a functional module, some or all additional information of the subset. The data entity is 4-S in the adjacent upper layer, that is, layer 5.
It includes a functional module that outputs as DU1 and a functional module that inputs and outputs status information and control information related to processing.

That is, in the layer 4, the layer 3
Since data for each subset element (for example, the subset elements <A> and <B>) is delivered from, the subset elements are linked to form one subset (for example, the subset <A>). Therefore,
Information (fourth processing information) on how to make a subset by linking the subset elements is contained in the subset element as a subset element header.

In the linked subsets, header information of the subset itself and user data are written. In this case, some subsets are further combined in a higher hierarchy to form a file, and therefore, this is particularly shown in the first subset (eg, subset <A>) at the time of the combination. It contains special header information for.

The subset is a group of information that can be converted into information that can be recognized by humans as data by itself without forming a file. That is, if it is a sound, it is sound data, and since it is all completed in this subset, it can be returned to a sound in this subset unit. In other words, it is possible to reproduce and output in this unit without forming a file.

FIG. 5 shows an example in which three subsets can be formed only by connecting two super macroblocks. For example, like the subset <B>, these two super macroblocks <A >, <B> may have data.

The layer 5 (application layer) corresponds to a part of the reproduction processing unit 26 (the header reading unit 36 and the file generating / managing unit 38), and is a subset input from the adjacent lower layer, that is, the layer 4. Data (4-S
DU1) is input as 5-PDU1 and the file management information is read from the supplementary information (5-PCI1 or fifth processing information) or data entity (5-UD1) of this subset, and file management is performed according to the file management information. ,
A function module (file management system module) that creates a file by linking subsets or linking subsets, and reads the data in file units. A subset unit or file-based data unit created based on file management is used as 5-SDU1 for the application process. It includes a functional module for outputting and a functional module for inputting / outputting state information and control information related to processing.

That is, in this layer 5, file management is performed. As a file management function, it is possible to simply pass a subset and pass it to a higher application process. Of course, as shown in FIG. 6, a file may be formed in this layer 5. .
That is, the layer 5 has a function of passing data to the application process in units of files or subsets.

In the form of being actually combined with a file, a file with a combined subset is created, and therefore, a file header, that is, an application control header, and user data are included therein. In this case, the application control header contains various information such as information indicating what structure the user data has, decompression information of the user data, and the like.

The application process corresponds to a part of the reproduction processing unit 26 (the high-efficiency code decoding unit 40 and the file operation / information output unit 42 by the application), and basically realizes the application using the MMP system. Has a different role. This application process includes a shuffling method / structure of source sample data, a scrambling method / structure for encryption, a data compression method / structure, a sound / text / image data structure, and the like. The function required for this application process, that is, the service provided includes a shuffling method of the source sample data, a scrambling method, and the like. If necessary, a plurality of data compression methods / compression / decompression work It can include provision, confirmation of information type and selection of its data structure.

As described above, according to the above-mentioned Japanese Patent Application No. 6-121368, a subset is information of only sound if it is sound,
In the case of a picture, it is defined as each piece of data divided into pieces of data that can be recognized as one information unit, such as information only for a picture.

Now, returning to FIG. 3, the error correction unit 24
The data of the subset element supplied from the above is input to the reading unit 32 of the header. Reading unit 32 of this header
Reads the contents of the header written in this subset element, and the subset data unit generation unit 34
Generate a subset according to the contents of the header. Next, the header reading unit 36 reads the contents of the header written in the generated subset, and the file generation / management unit 38 generates a file according to the contents of the header. Then, the high efficiency code decoding unit 40 decodes the data of the file thus generated, and the file operation / information output unit 42 by the application outputs the decoded data to the output device 30. It should be noted that the respective units in the reproduction processing unit 26 are the same as the system control unit 2.
Controlled by 8.

As mentioned above, the subset is
Since this is a block of data that can be recognized as one information unit, that is, since it is possible to output even a subset unit, this subset is directly input to the high efficiency code decoding unit 40 without generating a file. It can be decrypted and output to the output device 30 via the file operation / information output unit 42 by the application.

Next, the operation in such a configuration will be described. In this embodiment, when the information obtained by scanning the dot code 12 is displayed on the CRT monitor screen, which is one of the output devices 30, the information about the entire portion of the dot code is actually read. The control information including the information about the dot code is also displayed together.

First, as an example of this control information, scanning-related information such as the actually scanned portion of the dot code 12, the unscanned portion of the dot code 12 and the dot code reading order will be described. In short, the scanning-related information means that when the dot code 12 recorded on the paper surface of the sheet 10 has a large capacity, that is, when the dot code 12 has a large area, such a dot code 12 has a small reading range. When the pen-type reading unit 14 scans and tries to read in, the user is informed of information as to what is unreadable during scanning. That is, the unread block is displayed so that the user can clearly determine where to scan, that is, to trace.

FIG. 7 is a control flow chart of the system control unit 28 for performing such an operation.
That is, when scanning is started, it waits for a block address to be input from the data string adjusting unit 22 (step S1).
2) If the block address is input, next, it is determined whether or not the input block address has already been input by comparing it with the block address stored in the memory 28M ( Step S
14). If the block address has not been input yet, the block address is stored in the memory 28M.
(Step S16).

Next, it is judged whether or not the block has acquired the data necessary for the layout display (step S18). This is determined based on the information recorded in the dot code 12 indicating how many blocks are formed in each of the vertical and horizontal directions. In this case, in order to scan a part of the dot code 12 so that the information can be obtained, it is preferable that the data is recorded so that it can be judged in a lower layer, but for each block. If the information is recorded, the amount of information will be considerably small, so it is preferable that the information is recorded in the header of the macro block or the super macro block. Further, in order to input the information for each block, it is possible to input only the reference code. For example, the reference code is a code for recognizing that "010" is a code having 4 × 30 blocks, if it is composed of 3 bits.
Therefore, the system control unit 28 can determine the layout relationship of the dot codes 12 recorded on the sheet 10 based on the information provided from the data string adjustment unit 22 or the error correction unit 24. it can.

Then, when the data necessary for the layout display is not available, the user is notified of it (step S20), and the process returns to step S12. For example, as shown in FIG. 8A, a warning display "trace shortage" is displayed as a window on the CRT screen of the processing unit 16 such as a personal computer. Alternatively, the LE simply installed in the pen-shaped reading unit 14
D or the like may be turned on, a vibrator provided in the reading unit 14 may be vibrated, or a warning sound may be issued.

When the data for the layout display can be obtained, for example, as shown in FIG. 8B, the acquired and unobtained blocks are displayed on the CRT screen in the processing unit 16 of the personal computer or the like. Is displayed in a window so that it can be identified (step S22). That is, the block addresses themselves are given in order, and the information indicating where the block address of the already-obtained block is stored in the memory 28M, that is, the dot code 12, is available. For example, it is possible to display the position of the acquired block in white and the position of the unacquired block in red or black so that the user can visually identify it.

In order to cope with the scanning blurring of the reading section 14, the dot code 12 has the same block overlapped as shown in Japanese Patent Application No. 6-241150 filed by the applicant of the present invention. There is. For example, in FIG. 8B, even if the same data is recorded in the upper 4 rows and the lower 4 rows and only the upper side or the lower side is scanned, the original multimedia information can be reproduced. There is. Therefore, if either one of the double-recorded blocks is available, it is necessary to display the other block in which the same data is recorded as indicating that it has been acquired.

Next, the header reading section 32 of the reproduction processing section 26.
Then, based on the information from the subset data unit generation unit 34, it is determined whether or not the subset is recognized from the data of the already acquired block (step S24), and if not recognized, the process returns to step S12. That is, even if the layout display becomes possible, the display of "trace shortage" is left as it is when the subset is not configured.

When a subset is recognized,
Perform the recognized subset display process (step S2).
6). This process is performed as shown in the flowchart of FIG. That is, first, it is determined whether to display the subset data (step S26A). This is determined depending on whether the preset mode is a mode in which the obtained subset is immediately displayed, or a mode in which the user is notified of the fact that the obtained subset is not displayed immediately. .

In the case of the mode in which the obtained subset is displayed immediately, the data of this subset is supplied from the subset data unit generation section 34 to the high efficiency code decoding section 40, and the file operation / information output section 42 by the application is set. It is reproduced and output by the output device 30 via the output device (step S26B). In this case, the position on the dot code of the subset is displayed on the scale bar as shown in FIG.

Further, in the case of the mode in which the user is informed that the subset has been obtained, a display informing that the reproduction is possible is performed (step S26C). Here, although not particularly shown, the reading unit 14 is provided with an operation switch, and the user scans the dot code 12 with the operation switch pressed, and the reproduction is performed after the operation switch is released. The processing for is started. Therefore, it is determined whether to display the obtained subset based on the state of the operation switch (step S26D). If reproduction is to be performed, the process proceeds to step S26B to perform the reproduction process, and if not to be reproduced, the process of this flowchart is ended and the process returns to the process of the flowchart of FIG.

When the thus-recognized subset display processing is completed, it is next judged whether or not all the data on the dot code have been reproduced (step S28). If not, the number of unacquired subsets is displayed. After (Step S
30) and returns to step S12. That is, as shown in FIG. 8B, the number of subsets on the code that cannot be reproduced is displayed.

In this way, if all the data on the dot code has been reproduced, the processing is ended. The display state at this time is as shown in FIG. That is, 3
Each subset (image, sound, text) is displayed in a window on the screen of the CRT of the processing unit 16 such as a personal computer, and the position on the dot code of the subset is displayed as a scale bar in each window. It

As described above, by displaying the position of the subset, for example, an image or the like remains as it is unless an operation such as deletion is performed, whereas in the case of sound, once it is reproduced and output, it ends. is there. Therefore, when the user wants to hear the voice again, if the approximate position is displayed in this manner, the dot code 12 can be reproduced by scanning only the indicated position without rescanning the entire position. You will be able to.

As the display of the subset position by the scale bar, for example, when interleaving is applied to the entire dot code 12, (C) in FIG.
As shown in, it indicates that all dot codes must be scanned. Further, the scale bar may be displayed not only in the window but also outside the window as shown in FIG. 10B to 10F each show an example of the scale bar. In particular, as shown in (E) of the same figure, it is possible to scan only a desired subset by displaying the number of blocks in each subset numerically or by displaying in millimeters. Also,
Depending on the way of interleaving, some blocks may contain data of a plurality of subsets. In such a case, as shown in (F) of FIG. It is necessary to display in a distinguishable manner such as changing the color.

Further, when a plurality of dot codes 12 are recorded on one sheet 10, as shown in FIG. 10G, what information is assigned to which dot code at which position subset. An icon may be displayed so that it can be shown whether or not is recorded.

Further, the dot code 12 may be provided with a control subset for operating the file, such as deleting the displayed information of the file or hiding it behind another window. In such a case, it operates as shown in FIG.

That is, first, when a subset is input (step S42), the subset is displayed (step S44), and it is determined whether the position information of the subset is displayed (step S46). If not displayed, it is determined whether all the data on the dot code has been reproduced (step S48). If not, the above step S4.
Return to 2.

On the other hand, when the positional information of the subset is displayed, the mark displayed on the scale bar is displayed together with the subset (step S50), and then it is determined whether the positional information of the control subset is displayed (step S52). ). When it is not displayed, the process proceeds to step S48, but when it is displayed, the control subset position on the medium such as paper is displayed (step S54), and then the above step is performed as shown in (H) of FIG. Proceed to S48.

Among the control subsets, the erase subset 44 in which the instruction information for erasing the corresponding subset is recorded is changed in color or the density of halftone dots is changed so as not to be erroneously scanned. It is preferable to make it easier to visually recognize.

Alternatively, a confirmation message may be displayed when the control subset is scanned. Here, as an example thereof, an example in which an erasing subset is input is shown. FIG. 12A shows a display example in such a case, and FIG. 12B shows an operation flowchart.

That is, it is assumed that the data dot code 12 including, for example, three subsets is recorded on the sheet 10, and the erase subset 44 corresponding to each subset is recorded. When one of the erase subsets 44 is scanned, the erase subset 44 is input (step S52), so that the corresponding data is displayed in a blinking manner so that it can be easily recognized and, for example, "the code just scanned is a data code. No. Is it okay to erase the blinking information? "Is displayed (step S54).

Then, for example, when an erase command is input by operating the keyboard of the processing device 16 such as a personal computer (step S56), or even when the erase command is not input, for example, blinking continues for 10 seconds or the like. When the condition of is satisfied (step S58),
The display of the corresponding subset is erased (step S6).
0).

Further, when the deletion subset 44 is operated while nothing is displayed, it is understood that the subset is not displayed on the file operation / information output section 42 by the application. As with 46, a message to that effect is displayed.

By the way, as described above, when the corresponding position of each subset is displayed and only a part of the dot code corresponding to the desired subset is rescanned to reproduce that subset, all the scanned codes are In the case of decoding and reproducing, it takes time from the scanning to the output as information such as voice, image and text. Therefore, the decrypted information is held in the memory for a predetermined period, and when the user scans a part of the dot code to be read again, the held information is used to perform the decoding without the decoding process. It is preferable to be able to output necessary information.

This is realized as follows. That is, as shown in FIG. 13A, when the dot code 12 is read (step S72), the subset data unit generation unit 34 generates a subset and the header portion of the subset is converted into the high efficiency code decoding unit 40. Supply to. The high-efficiency code decoding unit 40 decodes this header part and supplies the decoded data to the system control unit 28 (step S74).

Here, the system control section 28
It is determined whether or not the supplied data of the header portion, for example, the same data as the identification number is already stored in the memory 28M, that is, whether or not the subset is reproduced once (step S76). If the data does not exist in the memory 28M, the data unit of the subset is sent from the subset data unit generation unit 34 to the high efficiency code decoding unit 40, and the data unit is decoded (step S78). Then, the decoded data of the header part and the data part are stored in the memory 28M (step S80), and the file operation / information output part 42 by the application outputs the data of the decoded data part to the output device 30. , And output as voice, image, text data, etc. (step S82).

On the other hand, when the data of the header section decoded by the high efficiency code decoding section 40 exists in the memory 28M, the data of the subset is read from the memory 28M and the file operation / information output section 4 by the application is read.
2 (step S84), and the data of the data part is reproduced and output as voice, image, text data, etc. by the output device 30 (step S82). That is, since the time consuming decoding process of the data part of the subset is not performed, it becomes possible to quickly output information from the output device 30.

For example, as shown in FIG. 13B, the dot code 12 is logically the file header FH1 at the beginning, followed by the header section SSH1-1 and the data section of the subset 1 (eg image). SSD1-1, Subset 2
Header part SSH1-2 (for example, voice) and data part SSD
1-2, header parts SSH1-3 and data parts SSD1-3 of subset 3 (for example, text data) are described. Here, when the user rescans the subset 2, the data in the header parts SSH1-2 are first decoded, so the memory 28M is searched for the corresponding data. If it exists in the memory 28M, the corresponding data section SSD1-2 is read from the memory 28M and reproduced and output from the output device 30. If it does not exist in the memory 28, the data part SSD1-2 obtained by rescanning is decoded and reproduced and output from the output device 30.

Further, in the state where each subset is displayed on the screen like text data or an image, when the corresponding subset portion of the dot code 12 is rescanned, the screen shown in FIG. As shown, the data corresponding to the contents of the scanned header SSH1-2 is still windowed on the screen, so that window need only be activated. Here, to make active means, for example, displaying or blinking by making a frame of the window into a thick frame, or moving the window to the foreground of a plurality of windows.

The concept of utilizing data on the memory at the time of such rescanning can be easily extended not only to the above subset but also to the file unit as shown in FIG. 14B. For example, one dot code 12 may include a plurality of files, only one file, or three files. A file header is always added to the beginning of each file. Therefore, when the file is already read by scanning this portion, the file data is read from the memory 28M and reproduced.

In this case, since one file is a very closely related collection of subset data, by scanning only the head file header,
There is also an effect that a series of related subset data can be read.

Next, as the control information, layout information such as the size and arrangement of the dot code 12 and index information showing an outline of data will be described. FIG. 15A shows
The case where a plurality of dot codes 12 are arranged on the sheet 10 is shown. Here, the dot code arranged at the upper left is a dot code including layout information as control information, that is, a layout information dot code 48. The other four dot codes (dot codes 1 to 4) are dot codes obtained by coding general multimedia information.

The following information is coded in the layout information dot code 48. That is, when the layout information dot code 48 is scanned, the size and arrangement of each dot code on the sheet 10 are displayed as shown in FIG. In addition, information indicating the content of each dot code is displayed. Of course, for such a code outline, "The data of code 1 is ...
It is also possible to inform the user by voice such as "data of code 2 ...".

FIG. 16A shows the dot codes 1 to
4 is a diagram schematically showing the logical structure of a general dot code 12 such as 4 after error correction. First, there is a subset header of a general subset, and subsequently, information of the general subset is entered. There is. After this, there is a subset head of the instruction data subset, which contains information of the instruction data subset. Here, the instruction data subset is, for example, a coded voice or image or text data for issuing an instruction to scan which dot code next. For example, scan 1,
Characters like scan 2, scan 3, scan 4
Alternatively, the arrow indicates the order in which each dot code should be scanned. That is, when the layout information dot code 48 is scanned, the arrow 5 as shown in FIG.
0 is not displayed, and this arrow 50 is displayed when scanning this instruction data subset. Also, in addition to displaying such an arrow 50 in response to scanning the indicated data subset, "first scan code 1, then code 2, then code 3, Scan code 4 at the end. "
Of course, this instruction data subset may be written at the beginning instead of after the general subset.

Further, FIG. 16B is a diagram schematically showing the logical structure of the layout information dot code 48 after error correction. This layout information dot code 4
8 has an index data subset, and first has a subset header, and has a structure in which information of the index data subset is entered after that.

In the above-mentioned embodiment, the multimedia information is completed by the code existing in one sheet, but the code may be formed over sheets of a plurality of pages. In this case, it is possible to output as instruction information by voice such as "Please scan which code on what page." Or display it on the screen as characters.

Although the present invention has been described based on the embodiments, the present invention is not limited to the above-mentioned embodiments, and various modifications and applications are possible within the scope of the present invention. Here, the summary of the present invention is summarized as follows.

(1) Reading means for optically scanning and reading the code from a recording medium in which multimedia information including at least one of voice information, image information and text data is recorded as an optically readable code. When,
Processing means for performing a predetermined process on the code read by the reading means to restore the original multimedia information, and reproducing and outputting each multimedia information based on the output signal from this processing means In the information reproducing system, the processing means relates to all parts of the code read by the reading means while performing a predetermined process on the code read by the reading means. The control information detecting means for detecting at least one of the first control information, which is information, and the second control information, which is information regarding the restored part of the read code. The means includes the multimedia information restored by the processing means, and the first information detected by the control information detecting means.
An information reproducing system comprising: a display unit that also displays at least one of the second control information and the second control information.

That is, by displaying the control information together with the restored multimedia information, the correspondence between the code on the recording medium and the restored information becomes clear, so that the operability can be improved. it can.

(2) The code is recorded on a recording medium so that it can be divided into predetermined information units, and the first control information is layout information indicating the size and arrangement of the code with respect to the recording medium, The second control information includes index information indicating an outline of data for each of the predetermined information units, and the second control information includes an actually restored scanned portion, an unrestored unscanned portion, and a code reading order. The information reproducing system according to (1) above, further comprising scanning-related information indicating

That is, since the control information has various kinds of information, various kinds of information necessary for scanning the code on the recording medium can be obtained and the operability is improved. (3) The processing unit temporarily stores a determination unit that determines whether the code read by the reading unit is accurately restored, and a content that is determined by the determination unit to be at least accurately restored to multimedia information. Storage means for memorizing the code, and an instruction means for instructing rereading of the code when the determination means determines that the code read by the reading means has a portion that cannot be accurately restored, The information reproducing system according to (1) or (2) above, wherein the display unit displays re-reading instruction information by the instruction unit.

That is, when the code is not accurately restored to the multimedia information, the reading is instructed on the display means, so that the information can be read more reliably,
Operability is improved.

(4) The processing means determines the portion of the code read again by the reading means that corresponds to the portion that has been correctly restored by the determination means, and this determination means. With respect to the part of the code which is determined to correspond to the accurately restored part, the code stored in the storage means is output to the output means and is determined not to correspond to the correctly restored part. With respect to the part, a control means for performing a restoration process and then outputting the output to the output means,
The information reproducing system according to (3) above, further comprising:

That is, when the re-reading process is performed, the restoring process is not performed for the code read once and stored in the storage means, so that the processing speed can be improved.

(5) The information reproducing system as described in (1) or (2) above, wherein the display means outputs the first and second control information as audio information.

That is, by displaying the control information by voice, the operator can know the control information without paying attention to the display means. (6) The code is data obtained by encoding multimedia information including at least one of audio information, image information, and text data by a predetermined method, and a header for allowing the encoded data to be distinguished from each other. Information is recorded in the recording medium in a predetermined format as a code, and the processing unit decodes the content of the header information from the code read by the reading unit, and the reading unit. The data decoding means for decoding the data from the code read by the data, the data decoding means for storing at least a part of the data decoded by the header decoding means and the data decoding means, and the header decoding means. The data corresponding to the content of the decrypted header is searched from the data stored in the data storage means, and the search is performed. And (1) a data selecting means for selecting whether to decode the data by the data decoding means or read the data stored in the data storage means based on the result. Information reproduction system described.

That is, when the rereading process is performed, the restoring process is not performed for the code read once and stored in the storage means, so that the processing speed is improved. (7) The header information is a file header described at the beginning of the file, and the data is a series of files described over a part or the whole of the code. (6) Information reproduction system described in.

That is, when the rereading process is performed, the restoring process is not performed for the code read once and stored in the storage means, so that the processing speed is improved. In addition, since it is possible to reproduce in file units, it is possible to collectively reproduce a plurality of subsets of contents that are closely related to each other.

(8) The header information is a subset header described at the beginning of the subset, and the data is subset data described over a part or the whole of the code. 6)
Information reproduction system described in.

That is, when the rereading process is performed, the restoring process is not performed for the code read once and stored in the storage means, so that the processing speed is improved. Further, since the data can be reproduced in subset units, only the subset data desired by the user can be selectively reproduced.

(9) The display means has a plurality of display portions, and the window display means for selectively displaying the restored multimedia information in the plurality of display portions and the data selection means for reading When it is found that the displayed header indicates the data displayed on any one of the plurality of display units, an identification display unit (a window for activating the window that distinguishes this display unit from other display units) is displayed. The information reproducing system according to (6) above, further comprising an activating means).

That is, when a plurality of displays are made for each predetermined information unit, the display section corresponding to the read header can be immediately recognized, so that the operability is improved. (10) The processing unit includes an information unit restoration determination unit that determines whether or not the content of each of the predetermined information units (subsets) of the code read by the reading unit is accurately restored. The display means displays the restored multimedia information every time the information unit restoration judging means judges that a predetermined information unit (subset) is correctly restored. The information reproducing system according to any one of (2) to (4) above.

That is, since the correctly restored information is displayed without any particular operation, the operability is improved. (11) Regarding the information unit restoration judging means for judging whether or not the content of each of the predetermined information units of the code read by the reading means is accurately restored, and the code being read. A restoration state recognizing unit for recognizing a restoration state for each information unit, and the display unit, each time the information unit restoration determining unit determines that a predetermined information unit is accurately restored, The information reproducing system according to any one of (2) to (4) above, which displays the restoration state recognized by the restoration state recognizing means.

That is, since it is possible to confirm whether or not the information has been restored for each predetermined information unit, the operability is improved. (12) The display means displays the number of predetermined information units (subsets) that have not been accurately restored, based on the output from the information unit restoration determination means. Information reproduction system described in.

That is, since the number of unacquired items can be confirmed for each predetermined information unit, operability is improved. (13) On the basis of the output from the information unit restoration determination means, the display means also includes an arrangement relationship indicating at which position on the code the predetermined information unit (subset) that has not been accurately restored exists. The information reproducing system according to (11) above, which is displayed as

That is, since the layout relationship of the predetermined information units that have not been restored is also displayed, it serves as a mark for rereading, and the operability is improved. (14) The display unit has a plurality of display units, and displays the restored multimedia information for each of the predetermined information units (subsets) in the plurality of display units. The information reproducing system according to (2), further including an identification display unit for displaying any display unit in the display unit so as to be distinguishable from other display units.

That is, when a plurality of displays are made for each predetermined information unit, the desired display section can be immediately recognized, so that the operability is improved. (15) In a recording medium in which multimedia information including at least one of audio information, image information, and text data is recorded as an optically readable code, the code is the size of the code with respect to the recording medium and Control information including at least one of layout information indicating an arrangement, scanning-related information indicating a reading order of the code, and index information indicating an outline of data for each predetermined information unit of the code is included together with the multimedia information. A recording medium characterized in that it is a recording medium. That is, it becomes a code to which information necessary for display and operation is added, and operability at the time of reproducing information is improved.

[0112]

As described in detail above, according to the present invention,
A two-dimensional code capable of optically reading so-called multimedia information including audio information such as voice and music, image information obtained from a camera or video device, digital code data obtained from a personal computer or word processor, etc. To improve operability in information reproduction in a recording medium such as a paper recorded as a pattern and an information reproducing system which optically reads the code pattern from the recording medium to reproduce original multimedia information. You can

[Brief description of drawings]

FIG. 1A is a diagram showing an appearance of an information reproducing system according to an embodiment, and FIG. 1B is a block configuration diagram of the information reproducing system.

FIG. 2 is a diagram showing a dot code format.

FIG. 3 is a block configuration diagram showing details of a reproduction processing unit.

FIG. 4 is a diagram for explaining a part of functions of layer 2 and layer 3;

FIG. 5 is a diagram for explaining functions of layer 3 and layer 4;

FIG. 6 is a diagram for explaining the functions of layer 4 and layer 5;

FIG. 7 is a flowchart of an operation of displaying scanning-related information of a scanned portion that is actually read and an unscanned portion that is not read in the dot code.

8A to 8C are diagrams showing display examples of scanning-related information.

FIG. 9A is a flowchart of a recognized subset display process, and FIGS. 9B and 9C are diagrams showing display examples of scanning-related information.

10A to 10H are diagrams showing display examples of scanning-related information.

FIG. 11 is an operation flowchart when a control subset for manipulating a file is scanned.

FIG. 12A is a diagram showing a sheet on which an erase subset is recorded and a display example when the erase subset is scanned, and FIG. 12B is an operation flowchart when the erase subset is scanned.

13 (A) and 13 (B) are diagrams showing an operation flowchart at the time of rescanning of a subset and a relationship between dot codes and data on a memory.

FIG. 14A is a diagram showing a display example at the time of rescanning of a subset, and FIG. 14B is a diagram showing a relationship between a dot code and data on a memory at the time of rescanning a file.

FIG. 15A is a diagram showing a sheet on which a plurality of dot codes are arranged, and FIG. 15B is a diagram showing an example of monitor output after reading layout information.

16A and 16B are diagrams schematically showing the logical structures of a general dot code and layout information dot code after error correction, respectively.

[Explanation of symbols]

10 ... sheet, 12 ... dot code, 14 ... reading unit, 1
6 ... Processing unit, 18 ... Detection unit, 20 ... Scan conversion unit, 22 ...
Data string adjusting unit, 24 ... Data error correcting unit, 26 ... Reproduction processing unit, 28 ... System control unit, 28M ... Memory, 30 ... Output device, 32 ... Header reading unit, 34 ...
Subset data unit generation unit, 36 ... Header reading unit,
38 ... File generation / management section, 40 ... High efficiency code decoding section, 42 ... File operation / information output section by application, 44 ... Erase subset, 46 ... Confirmation message, 48 ... Layout information dot code, 50 ... Arrow.

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁶ Identification number Office reference number FI technical display location G06K 7/10 P 7623-5B H04N 1/00 Z 5/76 Z 5/91 // G11B 7 / 00 Q 9464-5D (72) Inventor Hiroyuki Fukuda 2-43-2 Hatagaya, Shibuya-ku, Tokyo Olympus Optical Co., Ltd.

Claims (15)

[Claims] 1. A reading unit which optically scans and reads the code from a recording medium in which multimedia information including at least one of voice information, image information and text data is recorded as an optically readable code. , A processing unit for performing a predetermined process on the code read by the reading unit to restore the original multimedia information, and reproducing each multimedia information based on an output signal from the processing unit. In an information reproducing system including output means for outputting, the processing means, while performing a predetermined process on the code read by the reading means, all parts of the code read by the reading means. The first control information, which is information about the read code, and the first control information, which is information about the restored part of the read code. Control information detecting means for detecting at least one of the control information of the control information detecting means, and the output means, together with the multimedia information restored by the processing means, the first and the first information detected by the control information detecting means. An information reproducing system comprising: a display unit that also displays at least one of the two control information. 2. The code is recorded on a recording medium so that it can be divided into predetermined information units, and the first control information is layout information indicating a size and an arrangement of the code with respect to the recording medium, and the first control information. The second control information includes index information indicating an outline of data for each predetermined information unit, and the second control information includes a scanned portion that is actually restored, an unscanned portion that is not restored, and a reading order of the code. The information reproducing system according to claim 1, further comprising: scan-related information shown. 3. The processing means comprises a judging means for judging whether or not the code read by the reading means has been correctly restored, and contents judged as at least correctly restored to the multimedia information by the judging means. A storage unit for temporarily storing the code, and an instruction unit for instructing re-reading of the code when the determination unit determines that the code read by the reading unit includes a portion that cannot be accurately restored. The information reproducing system according to claim 1 or 2, wherein the display unit displays re-reading instruction information by the instruction unit. 4. The discriminating means for discriminating a portion of the code read again by the reading means, the portion corresponding to a portion judged to be correctly restored by the judging means, and the discriminating means. Regarding the portion of the code that is determined to correspond to the accurately restored portion, the content stored in the storage unit is output to the output unit, and the code of the code determined not to correspond to the accurately restored portion is output. The information reproducing system according to claim 3, further comprising: a control unit that controls the portion to perform a restoration process and then output to the output unit. 5. The information reproducing system according to claim 1, wherein the display means outputs the first and second control information as audio information. 6. The code is data for encoding multimedia information including at least one of audio information, image information, and text data by a predetermined method, and the encoded data so as to be distinguishable from each other. And a header decoding means for decoding the content of the header information from the code read by the reading means, the header information being recorded in a predetermined format on the recording medium as a code, Data decoding means for decoding the data from the code read by the reading means; data storage means for storing at least part of the data decoded by the header decoding means and the data decoding means; and the header decoding Searching the data stored in the data storage means for data corresponding to the contents of the header decoded by the means. 2. A data selecting unit for selecting whether to decode the data by the data decoding unit or to read the data stored in the data storage unit based on the search result. Information reproduction system described in. 7. The header information is a file header described at the beginning of the file, and the data is a series of files described over a part or the whole of the code. 6. The information reproduction system according to item 6. 8. The header information is a subset header described at the beginning of the subset, and the data is subset data described over a part or the whole of the code. Information reproduction system described in. 9. The display means has a plurality of display portions, and window display means for selectively displaying the restored multimedia information in the plurality of display portions, and the data selection means for reading the window display means. When it is found that the header indicates the data displayed on any of the plurality of display units, the display unit further includes an identification display unit that displays this display unit so as to be distinguishable from other display units. The information reproducing system according to claim 6. 10. The processing unit has an information unit restoration judging unit for judging whether or not the contents of each of the predetermined information units of the code read by the reading unit are accurately restored, 3. The means for displaying the restored multimedia information each time the information unit restoration judging means judges that a predetermined information unit has been correctly restored. The information reproducing system according to any one of 4 above. 11. An information unit restoration judging unit for judging whether or not the contents of each of the predetermined information units of the code read by the reading unit has been accurately restored, and the processing unit Restoration state recognition means for recognizing a restoration state for each information unit with respect to the code, and each time the display means determines that the predetermined information unit has been accurately restored by the information unit restoration determination means. The information reproducing system according to any one of claims 2 to 4, wherein the restoring state recognized by the restoring state recognizing means is displayed. 12. The display unit according to claim 11, wherein the display unit displays the number of predetermined information units that have not been accurately restored, based on the output from the information unit restoration determination unit. Information reproduction system. 13. The display unit also includes an arrangement relationship indicating at which position on the code the predetermined information unit that has not been accurately restored is based on the output from the information unit restoration determination unit. The information reproducing system according to claim 11, which is displayed. 14. The display means has a plurality of display units, and displays the restored multimedia information for each of the predetermined information units in the plurality of display units. 3. The information reproducing system according to claim 2, further comprising identification display means for displaying any display unit in the unit so as to be distinguishable from other display units. 15. A recording medium in which multimedia information including at least one of audio information, image information and text data is recorded as an optically readable code, wherein the code has a size of the code with respect to the recording medium. Control information including at least one of layout information indicating a size and arrangement, scanning related information indicating a reading order of the code, and index information indicating an outline of data for each predetermined information unit of the code, the multimedia information. A recording medium characterized by being included with.