JPS62244099A - Sound wave information reproducer - Google Patents

Abstract

(57) [Summary] This bulletin contains application data before electronic filing, so abstract data is not recorded.

Description

Detailed Description of the Invention ■Technical Field The present invention relates to a sound wave information reproducing device that reproduces sound waves from a sheet on which digital sound wave information is recorded as visible dots, and particularly relates to, for example, text image information (character information), illustration information, and halftone images. The present invention relates to a reproducing device that reproduces digital sound wave information recorded on a sheet together with visually recognizable image information such as visible information into sound waves.

■Prior Art Records and magnetic tapes are well known as sound wave information recording media. However, these require special equipment (tape recorder) for recording and playback. ! &
Nearby coats cards and cards with a magnetic thin film,
Magnetic information can be written on the magnetic thin film, and it can also be used to write letters, pictures, photographs, etc.
Symbols, etc. are printed. In other words, one card or sheet carries both magnetic information and visible information. Magnetic information can also be converted into audio information. However, recording both visible information and magnetic information requires two devices: a printing device and a magnetic recording device. These two devices are
The principles of BJJR are completely different, and although the card or sheet transport mechanism may be shared, write heads and head drivers must be provided separately.

With the recent development of 0Ajjl devices, writing and editing (character information processing) are now widely done with word processors, and illustrations.

Input of halftone images, modification 2 creation, etc. (illustration information processing, halftone information processing) can now be easily performed using a scanner, input board, or input tablet, and if necessary, additional input means such as a mouse. Advanced editing processing that combines these information processes on one screen has also been put into practical use. However, audio information is recorded on magnetic media, and is recorded using a dictation machine (
(tape recorder) required. Therefore, even if visual information and audio information are recorded on one card or sheet, it is necessary to coat or paste a magnetic thin film on the card or sheet, and the recording means must be printed as a visible recording means. Two things are required: a machine (including a copier) or printer, and a magnetic recording device.

Therefore, the present inventor provided a printer for recording a visible image dot by dot on a sheet as a recording means, a sound/fR air conversion means for converting sound waves into electrical signals, and a sound/fR air conversion means for converting the electrical signals into digital data. a digital conversion means for storing the converted data of the digital conversion means; and a print instruction for giving the converted data to the storage means and storing it, and giving the data in the storage means to the printer to instruct printing. He invented an information recording device equipped with the following means and filed a patent application (Tokuko Sho 60-101084).

According to this information recording device, audio data is visibly recorded on paper or an equivalent sheet in the same way as ordinary characters or images are recorded. Although the recorded image of audio data is visible,
Normal people cannot understand the meaning. However, a widely used scanner, such as a scanner used in facsimiles, reads the image on the recording sheet to obtain audio data, and this data is reproduced into an audio signal using the reverse logic of the digital conversion described above. Activating the speaker with a signal replays the recorded audio.

In one embodiment, the level of an audio analog signal is A/D converted into digital data with a relatively large number of bits, e.g. 8 bits or more, and this digital data is further predictively encoded into a digital data with a comparatively large number of bits, e.g. 4 bits or less. compressed into digital data with fewer bits. According to this, digital processing of audio signals is performed using relatively simple hardware and relatively simple program processing, and the number of recording dots (bits) is small, so it is possible to perform digital processing on a piece of paper or similar. Sound can be recorded over a relatively long period of time on a sheet or card (hereinafter, paper and similar sheets or cards will be collectively referred to as sheets).

For example, a word processor is often used for shorthand or dictation recording, but if the manual input of the word processor is delayed for one dictation, you can switch from text input to voice recording by instructing voice recording using the keyboard, or switch from text input to voice recording. It is preferable to perform parallel processing of audio recording and audio recording. Furthermore, it may be preferable to record the author's (or dictator's) real voice in place of or together with the signature on the text typed out by the word processor.

Therefore, the CPU or the like of a word processor is commonly used as the printing means, and the hardware of the digital conversion means is connected to this CPU or the like. That is, the word processor incorporates audio signal digital conversion means. This allows a combination of text and audio data to be recorded on one sheet. In addition, sentences and audio data can be recorded for each sheet. The recording device is essentially a word processor and does not require an audio recording device such as a tape recorder.

Furthermore, since a sheet made of the same material is used for both text recording and audio data recording, a special audio data recording medium is not required.

Furthermore, for %CAD (Computer Aided Design), it is preferable to add the designer's explanatory voice or identification voice in addition to the recorded drawings or illustrations, and even when sending by facsimile, it is preferable to speak over the phone separately from sending the yK draft. Instead, it is desirable that the sender's voice be automatically reproduced from the data recorded on the original at the same time as the original is received, or by reproducing the audio signal from the received paper. It may also be entered or read with a keyboard, input tablet, mouse, and/or image scanner. In addition to recording graphs, illustrations, photographs, or pictures, it is preferable to record a combination of explanatory audio, background music, natural sounds, reading audio, and the like.

Thus, according to the sonic information recording and reproducing apparatus disclosed in the above patent application, various types of visually recognizable image information and sonic information are recorded on a sheet selectively or in combination.

In sound wave reproduction, it is necessary to detect the sound wave information recording area. In the embodiment of the above patent application, a special mark is recorded at the beginning of the sound wave information area, and this mark is optically detected during reproduction.

Since this mark substantially narrows the information recording area on the sheet, it is preferable to omit it or make it small in area. Therefore, it is preferable to automatically detect the sound wave information area based on the sound wave information on the sheet.

(1) Purpose An object of the present invention is to provide a reproducing device that automatically detects a digital sound wave information recording image on a sheet and reproduces the digital sound wave information into sound waves.

■Structure In order to achieve the above object, the present invention uses a scanner that converts sound waves into electrical signals and converts the electrical signals into digital data to read an image of a sheet on which bit information of the sound wave information is visually recorded; Memory means for writing: D/A conversion means for converting sound wave information into analog electric signals; and electric/sound wave conversion means for converting the analog electric signals into sound waves; In correspondence with the two-dimensional X and Y distribution, H or L bit information is accumulated in at least one direction of the X direction and the Y direction, and the accumulated value in the direction orthogonal to the one direction of the accumulated value is calculated. The sound wave information recording area detecting means detects the sound wave information recording area from the distribution of the sound wave information recording area; and the reading means reads out the sound wave information of the sound wave information recording area from the memory means.

According to this, a recorded image on a sheet is read by a scanner and stored in a memory means, a sound wave information area in the stored image is automatically detected, and the sound wave information is automatically read out from the memory means. , the sound wave information is automatically converted into sound waves.

Other objects and features of the invention will become apparent from the following description of an embodiment with reference to one drawing.

FIG. 1 shows the appearance of an embodiment of the present invention, and FIG. 2 shows its system configuration. In Figures 1 and 2, CR
T display 1161 and floppy disk!
Word processor body 100 equipped with 118 and 119
includes a microphone 11 and a speaker 21. keyboard 1
172. An image reading scanner 1171 and a laser printer 1173 are connected.

The combination of the word processor body 100, the keyboard 1172, and the laser printer 1173 is a so-called English-Japanese word processor.
2, write a composition and put the text on disk! ! 119 to record on a floppy disk, or use a laser printer 1.
173 to print out.

The combination of the word processor body lOO, the keyboard 1172, and the scanner 1171 is a so-called image processing device, which edits the image read by the scanner as necessary.
Record it on a floppy disk or print it out.

The word processor main body 100 is connected to a local network, and the word processor main body 100 and the keyboard 1172 . The scanner 1171 and the laser printer 1173 constitute a so-called facsimile machine.
It prints out images received from other stations (facsimile machines), and also prints out image data of originals set in a scanner, data recorded on a floppy disk, or data stored in the internal memory of the word processor main body 100. Transmit to other stations.

The combination of the scanner 1171 and the laser printer 1173 is configured as a so-called digital copying machine, but there is an image reading mode in which only the scanner operates and provides a video signal (digital) to the host (word processor body 100), and a video signal from the host. It operates in three modes: a print mode for printing out (digital) images, and a copy mode for reading original images with a scanner and printing them out.

In addition to the conventional functions described above, there are functions of storing, reproducing, and printing out the voice blown into the microphone, and the voice data is processed alone or in combination with image information.

The functions of the device whose external appearance is shown in FIG. 1 and whose system configuration is shown in FIG. 2 are summarized as follows.

a0 Document creation and editing functions: You can create and edit various documents. For example, in addition to standard Japanese/Roman word processor functions, you can use various fonts, input and edit images, forms, graphs, and numerical tables. It has functions for creating and processing images, compositing editing them, page layout, and document formatting.

b. Audio recording editing function...The audio captured by the microphone is converted into compressed data, and this compressed data is used alone or in the above a.
Processed in combination with text data.

C1 Audio print function: Prints out the compressed data in a above.

d. Audio playback function: Plays back compressed data in RAM and compressed data on floppy disk to play back audio. The compressed data read by the scanner is played back into audio. In addition, the audio captured by the microphone is simultaneously played back by the speaker.

e. Function to use commercially available programs: Equipped with a function to use commercially available programs.

f. Terminal function: Equipped with a function to search for files in devices connected via the communication station, use programs, etc.

g. Print function: Equipped with a function to print created documents, audio compressed data, etc.

h. Copying function: Equipped with a function for performing normal copying.

f. Storage function: Equipped with a function to record created documents, audio compressed data, etc. on a floppy disk.

g. Search function: Equipped with a function to search for files in a file station (not shown) connected to the local network.

h.Transmission function...Using the local network,
A function for sending and receiving documents, audio compressed data, etc. between other stations (not shown), and sending and receiving documents, compressed audio data, etc. between external devices via a communication station (not shown).
It has the function of transmitting and receiving compressed audio data, etc.

As shown in FIG. 2, the word processor main body 100 includes:
Its communication control unit 1CCU120.

It is connected to a local network cable 19 via a transceiver TR.

This cable 19 is 1, for example, Japanese Patent Application No. 57-230828.
This is the local network cable disclosed in the issue.
Various stations are connected to this. The word processor main body 100 is one workstation of this network.

Word processor body 100 which is a workstation
, mixed information of audio (compressed data), two sentences (text, graphics), and images (pixels), or a part thereof, can be input. Here, the compressed data is data obtained by A/D converting an audio analog signal into 8-bit digital data in the digital processing circuit 1, and compressed it into 4-bit data by pre-encoding processing in the CPU 2. A is a set of coded characters, and a graphic is coded graphical information.

For example, it is a collection of commands that draw straight lines, circles, arcs, etc. In addition, an image (pixel) is bit string information in which an image is divided into pixels (dot pixels) and black and white information, brightness and color information of the pixel are associated with bits rlJ and rOJ. scanner 1171
Input from It should be noted that 1-character 2-gradation information and photo (gradation) information can also be input from the scanner 1171, but at the time of input, these are treated as image information. The word processor main body 100 also has a function of creating and editing one document. That is, standard Japanese, European,
In addition to word processor functions, use of various fonts1
It has functions such as image editing, form creation, graph creation, illustration creation, creation and processing of numerical tables, composite editing of these, page layout, and document formatting. In these processes, audio compressed data is also processed in the same way as these data. It also has programming capabilities and can create programs using standard languages.

It also has a terminal function and can search for files on a host computer connected via a communication station, use programs, etc.

Furthermore, it has a storage function, and documents created with the main body 100 (
(including compressed audio data: the same applies below) or files,
and file station, host computer,
Documents or files transferred from fax machines, other workstations, etc. can be stored on floppy disk 1.
191. Note that image information can be stored after data compression according to specifications.

The main body 100 also has a search function. That is, it has a function of searching for floppy files in the main body 100, which is a file station and its own workstation.

The main body 100, which is a workstation, further has a transmission function. That is, using the resources of the network,
It has the function of transmitting and receiving documents or messages to and from other stations, such as image synthesis devices and facsimile devices. In addition, the image information may be changed depending on the specification.
Data can be compressed and transferred.

As a method of inputting data to the main body 100, the microphone 11. There are cases in which input is made from the keyboard 1172 and scanner 1171, cases in which it is input from the outside as a facsimile signal via a communication line, and cases in which code is input from the host computer.

Transfer the completed document to another workstation, send it via fax, or print it to a laser printer.
173, input processing is performed as pixel (image) information from the scanner 1171. In this case, the main body 100 handles all information in pixels (dot bits: bits in audio compressed data), compresses the data, and sends it to the network. If the recipient of the transmission is a workstation, it will be treated as an e-mail.
When the workstation is working, a message indicating that a mail has arrived is displayed on a part of the screen of the display device ff1161 to notify the operator. The operator can recall the document to the screen at an appropriate time. In this case, since the information is in pixels, the compressed data format is restored, density conversion is performed on pixels for screen display, and then the information is sent to the display 1161. Note that the original compressed information remains in memory, so depending on the operator's instructions,
Decide whether to save or delete.

Next, the first method of using a scanner is to read various images, and the second is to input a large amount of documents. There are three modes: when the entire image or document is audio compressed data (usually audio reproduction from recording paper), when a part is audio compressed data, and when the entire image or document does not include audio compressed data.

In the word processor main body 100, audio.

When creating a document containing a mixture of text, graphs (illustrations), and pictures, input audio from the microphone, text from the keyboard 1172, illustrations from the keyboard (graph processing input), and pictures from the scanner 1171.
synthesize them. In this case, by executing an image processing program in the main body 100, it is possible to freely edit the image, such as moving the position, enlarging, and reducing the image. To assist in this work.

The image on the display 1161 is capable of multi-window processing. In other words, for the image on one screen, you can choose either a completely divided image or an image made by stacking multiple sheets of paper shifted from each other. In the former, each image is reduced in size, while in the latter, the size of the image is The image remains the same, but some parts become invisible. In addition, the system status and currently available commands are also displayed in the system area on the display.

When the compound document created in this way is stored in memory, the code (text information, illustration information) and
Compressed pixels (halftone image).

stored in the form of pictures, sounds). Also, this compound document,
When sending the image information above to other workstations, the other workstations receive and receive the code and compressed pixel information that is sent to them.
In order to display this information on the display 1161, the code (characters) is generated by a character generator, the code (illustration) is generated by a graphic generator,
Also, by expanding the pixels (pictures, sounds), a pit stream is developed on the pit map memory.

If this pit stream information is DMA-transferred to the video RAM 116 of the display 1161, exactly the same information as that of the sending workstation will be displayed on the display 1161 of the receiving workstation. In the same way, the file station also develops the pit stream on the bitmap memory, and the subsequent processing is the same as that for the pixel information described above to print or store the pit stream.

Figures 3 to 14 each show the word processor body 1.
FIG. 2 is a configuration diagram of each processing device making up 00.

The interface for A/D converting the audio signal, that is, the digital processing circuit l shown in FIG. It is composed of a circuit and an A/D converter, converts the audio signal into 8-bit data, and provides it to the microprocessor 112 via the bus 1121. Microprocessor 112 compresses the 8-bit data to 4 bits using predictive encoding, processes the compressed data in the same manner as pixel information, and writes it to memory.

In the case of audio reproduction, the microprocessor decodes the audio pixel information (compressed data) to obtain 8-bit data and provides an interface, i.e. an analog processing circuit, for reproducing the audio signal (analog) via bus 4. Give to 2. The analog processing circuit 2 is composed of a D/A converter that converts 8-bit data into an analog signal, a bumper amplifier, a low-pass filter, and an output amplifier.
The speaker 21 is energized at a level according to the bit data.

As mentioned above, the word processor main body 100 is equipped with various functions and handles a huge amount of information such as image information and audio information, so multiple processors (CPUs) are arranged and Process. That is, as shown in FIG. 2, a main processor 111 and a sub-processor 112 are connected by a multipath 1110, and communication between them is performed via a memory l13. Connection between the two is performed by an interrupt signal or a status signal.

The image data is transferred from the processor 111 to the processor 112 by
This is done via the memory 113.

Local buses 1111, 1110 are connected to both processors 111, 112, respectively, and memories 114, 115, . Keyboard 1172 via Paramel I10. Scanner 117
1 and printer 1173, encoding compression, decoding Ia11
51. Image processing units 1152, 115
3. External memory 1 via controllers 118 and 119
181, 1191, CRT via controller 116
A display il161 and one communication control bag e120 are connected.

The communication control device 12G connects the word processor main body 100 to a communication line, and when connected to one communication line, when there is a call from the line and when the processor 111 calls the line (another station). The processor 111 is connected to the communication line.

The processor 111 (CPU1) functions as the main processor of the word processor and manages all tasks except for display tasks.

Therefore, the O5 (operating system) of the word processor 100 runs on this processor 111. In addition, when in the idle state, the diagnostic program (D
iagnostic Program) can be run. Others: parallel I10, serial I10
Contains ports, timers, and interrupt control circuits.

The processor 112 (CPυ2) is a subordinate entity of the processor 111 as described above, and operates for image processing for CRT display and audio data compression/reproduction processing. A/D conversion data sent from digital processing circuit 1 (treated the same as pixels) and processor txt
Using the character codes, pixels, vectors, etc. sent from the memory 113 from the
). Then, the completed picture mixed document bitmap is stored in the VRAM (10
2KB). During audio playback, compressed audio data from a bitmap on the RAM is extracted and decoded one word (4 bits) at a time to create 8-bit data, which is supplied to the analog processing circuit 2.

The CRT controller 116 generates horizontal and vertical synchronization signals and video signals for high resolution CRT displays. A VRAM is built in as a display memory, and data is transferred from the RAM in the processor 112. This controller 116 is a Japanese language landscape (Landscape).
e) Type CRT and portrait type for English text (resolution 945
It is possible to connect to a monochrome raster scan method (X 1260 dots).

Memory 113 is used to transfer image data (character codes, pixels, vectors) from processor 111 to processor 112. A character generator exists in a part of the memory area. Memory address space is 1024K
It is B.

Memory 114 is the main memory of word processor 100, and has a memory address space of 1.5 MB.

It also has dual port functionality, i.e. local bus 111
Interface with 1 and parallel 110 module 11
It has an interface with 7. This transfers scanner data directly from the parallel 11 module, as well as keyboard and mouse (cursor position instructions) codes.

The parallel I10117 has 12 ports (96 bits) as a parallel I10 interface, and transfers scanner data (keyboard, mouse, and scanner data) directly to the memory 114 without going through the local bus 1111.

The keyboard 1172 includes three types of character keys (for kana-kanji conversion, for tablet kanji input, and for alphabetic characters) and 16 function keys.

The scanner 1171 has a maximum reading size of A3, a resolution of 12 dots/m5 (300 DPI), and can read sheet-type originals.

FDCs 118 and 119 control FDDs (floppy disk drive units).

FDD 1181 and 1191 are single-sided double density (IMB/
DRIVr (7) Things are used. In addition to storing programs, local files, kana-kanji conversion dictionaries, and character generators, these are also used as logout memories. Once the floppy data has been read into the memory, another floppy disk for recording texts, etc. is attached to one of the disks, and written texts, etc., are recorded and recorded texts, etc. are read out.

Image processing unit (IPUI) 1151
teeth.

It has a function of binary DC11 (data compression, reproduction).

Image processing unit (IrO2) 1152
teeth.

It has the function of density conversion and enlargement/reduction. As for density conversion, 12 → 4 dots/+s, 12 → 6 dots/a
m.

There is a 12→8 dot III layer, 8→12 dots/my, and the enlargement/reduction is 0.1 between 0.5 and 2 times.
Can be set step by step.

Image processing unit (IrO3) 1153
has an image rotation function. +90' in 1 step
Rotate by increments.

The communication control device 1120 controls the exchange of data transmitted via the local network, and performs protocol control including layers up to at least the data link level. In other words, data link layer control includes data capsule disassembly/assembly (framing, addressing, error detection) and link management (channel allocation (collision avoidance), collision processing), and physical layer control includes: There is data encoding (preamble generation/removal (for synchronization), bit encoding/decoding) and channel access (bit transmission/reception, carrier sense, ?iJf sudden detection).

The transceiver TR is directly connected to the communication medium (coaxial cable) of the local network and is connected to the communication control device 1i1.
20 and transceiver TR are connected by a transceiver cable.

Next, the configuration of each of the above devices will be explained with reference to the drawings.

FIG. 4 is an internal configuration diagram of the processor 111 in FIG. 2.

Processor 111 is capable of controlling both local bus 1111 and multipath 111O. Local bus 1111 and multipath 1110 have
Bus arbiter 1130゜1 each manages bus usage
134, buffers 1131 and 1135 for temporarily storing control signals, address signal buffers/drivers, address bus buffers 1132 and 1136, data cover sofa/driver, and data bus transceiver 113.
3.1137 is connected, and the CPU 1 controls whether or not to output data accessing the bus from each buffer.
112,1113. This is performed by a bus control 1123, a bus select circuit 1125, and the like. both buses 111
When an interrupt signal is input from 0°1111, there are 7 levels of numbers that can be processed internally, so some of them are sent internally, to the local bus 1111, and to the multipath 111o.
It is allocated and used by interrupt multiplexers 1126 and 1127. Byte/word control circuit 1128.112
9 switches the set position depending on whether the data passing through the data bus transceivers 1133 and 1137 is a byte or a word.

On the other hand, parallel r101116, serial e10111
7 and a timer 1118 are arranged, and high-speed data can be accessed from the outside via a connector.

Timer tiis, which operates with the clock from the clock generator 1121, outputs a baud rate clock when the serial device 101117 needs it. The chip selection circuit 1115 is for selecting these Ilo and timer. In addition, the clock generator 1120
A clock is given when processing a command in U1112. CPU1112. NPU (cpυ for numerical calculation) 11
13 is.

By executing the program stored in the ROM 1124, the buffer in the processor 111, Il
o, directly manage multiplexers, etc.

FIG. 5 is an internal configuration diagram of the processor 112 in FIG. 2.

The processor 112 can also access both the local bus 1161 and the multipath 11114, and has an arbiter 1155 and 115 for each bus.
9, control buffers 1156, 1160. Address buffers 1157, 1162 and data buffer 1
158°1163 are connected. In addition, the processor 11
2 includes a RAM (320 KB) 1141 for forming picture and/or audio compressed data document bitmaps;
is provided, and data is written and read via an input buffer 1144 and an output buffer 1145 under the control of a memory controller 1142. RAM
Since one line is written to 1141 with 16 bits in total, 8 bits for upper and 8 bits for lower, controller 11
42 selects which of the upper drawers to access.

The ROM 1143 stores programs for the CPU 1140. The interrupt multiplexer 1154 is
Similar to the processor 111, when there are interrupts from the multipath 1110 and local bus 1161, these are accepted and assigned to each level.

Note that the timer, interrupt circuit, etc. are built into the CPU 1140.

FIG. 6 is an internal configuration diagram of the multipath memory 113 in FIG. 3.

RAM (256K [l or 512KB) 1180
has a word unit configuration, so when data is input in byte units, the memory controller 1166 identifies whether it is upper or lower and switches it. During input/output to the RAM 1180, the error detector 1167 checks the input/output data.

The multipath 1110 includes an address buffer 1175, a control buffer 1176, and a data buffer 117.
7 is connected to exchange address signals, control signals, and data. One memory board has 512
The memory capacity of KB is stored, but the processor 111,
Since a wider range of memory addresses from IM to 2 MB can be accessed from 112, multiple memory boards are used. The switch 1169 is a switch for specifying θ to 512KB, and the selector 1170 selects the buffer 1.
Select 176.1177. Memory designation of 512 KB to IMB is performed by a switch on another board. Further, the switch 1178 is the RAM controller 11
66 initial setting switch. switch 117
The controller 1166, which has read the code specified by the shift register 1179, performs the process specified by the code when the power is turned on.

FIG. 7 is an internal configuration diagram of the local bus memory 114 in FIG. 3.

This memory 114 is connected to both the local bus 1111 and the private bus 1174 connected to the parallel I 10117, and if it is accessed from the other bus while data from one is being processed, let That is, the RAM controller 1190
If a write request is received during reading from the IIAM 1189, control such as waiting instructions and switching is performed. Similar to memory 113, error detector 1193
and an initial switch 1198.

FIG. 8 is an internal configuration diagram of the CRT controller 116 in FIG. 3.

The bitmap data sent from the processor 112 via the local bus 1161 is stored in the address buffer 1.
207. It is received via a control transceiver 1208 and a data transceiver 1209, and is sent to the video RAM 1200 via a graphics controller 1199.
After temporarily storing data in
Since all data is sent in the form of a document bitmap mixed with picture and/or audio compressed data, it performs the function of displaying the contents of the video RAM 1200 in the refresh memory as is on the screen. Therefore, the graphic controller 1199 also has a built-in refresh counter, and the DRAM controller 1201 and address latch 1
The DRAM controller 1201 only controls the video RAM 1 of the dynamic MO5RAM.
200 periodically. The data transceiver I204 performs control such as reversing the input/output direction when transferring bitmap data in the opposite direction.

FIG. 9 is an internal configuration diagram of the parallel 10117 in FIG. 3.

Since this parallel I10117 board is versatile, it can have a parallel data interface function no matter what is connected to the connectors J1 to J4. In this example, scanner 1171. keyboard do 1172
, printer 1173 are connected. Processor 11
In response to the command 1, the parallel processor 1210 of the parallel I 10117 executes the program stored in the ROM 1224 and performs input/output operations for 8-bit parallel and 16-bit parallel data.

For example, when input data from keyboard 1172 is stored in memory 114, control transceiver 1221. The memory 114 is accessed from the address transceiver 1222 and the data transceiver 1223 via the private bus 1174, and data is sent out in parallel. Also, when sending input data from the scanner 1171 to the encoding processing unit 1151, the address transceiver 1215. control transceiver 1
216, the data is sent in parallel from the data transceiver 1217 to the processing unit (IPUI) 1151 via the local bus 1111.

The operation of each parallel I101230-1233 is controlled by a parallel I10 controller 1234.

FIG. 10 is an internal configuration diagram of the floppy disk controller (FDC) 118 in the third @.

Connector J1 has floppy disk drive 1181
However, connector J2. J3 has hard disk drive 1
191 and 1192 are connected, and each of these is controlled by a floppy disk controller 1237.

According to instructions from processor 111, IO processor 1
235 executes the program stored in the ROM 124/l and controls the floppy disk drive.

Figures 11, 12 and 13 respectively show the image processing unit (IPUI, 2°3) in Figure 2.
11'51, 1152, and 1153; FIG.

The IPU 1151 performs compression/expansion processing of image processing, the IPU 1152 performs density conversion, enlargement and reduction processing, and the IPU 1153 performs rotation processing.

That is, in order to send data to one communication line or to transfer it to a file station FC and store it, it is necessary to compress the data to save transmission time and storage capacity. or C
In order to display it on the RT display 1161, it is necessary to decompress the compressed data and return it to the original image (pixel) information.

The IPU 1151 transmits address signals, control signals, and data from the local bus 1111 to an address transceiver 1263 and a control transceiver 126, respectively.
4, and is received by the data transceiver 1265 and input to the input data buffer 12 by the address selection circuit 1262.
56 and temporarily store the data here. The status register 1261 identifies whether it is compression or expansion, and when the controller 1260 inputs it to the compression/expansion unit 1253, it is converted into serial data by the parallel/serial converter 1258 and output from the compression/expansion unit 1253. At that time, the data is returned to parallel data by serial-to-parallel conversion 91259, temporarily stored in buffer 1257, and sent to local bus 1111.

Next, as the need for density conversion, for example, the scanner 117
The image input from 1 has a line density of 12 lines/ma+, and when displayed on the CRT display 1161, the line density is 4 lines/ma+.
You can leave it as Book/+on+, but there may be cases in which only the photos are enlarged or reduced in size.
When transferring to station PS and printing.

When transferring the data to the communication stations DC5 and Fe2 for communication transmission, it is necessary to convert the data into 8/2 images. Further, when processing the data in the processor 111 and storing it in the memory 113, the data may be converted to 12 lines/ll11.

Next, regarding the need for image rotation, document data input on A3 size paper with horizontal writing is transferred to the CRT display 1161.
2, etc., if you want to display the document data vertically, or if you want to print document data input on A4 size paper in vertical writing at the print station PS.

II'U1152 for density conversion. IPU115 for rotation
3, the same control is applied using the same route except for the conversion processing circuits 1254 and 1255.

FIG. 14 shows the communication control unit (CCU) 1 in FIG.
20 is an internal configuration diagram.

CCU 120 relays data from local network cable 19 to local bus 1111 within the station, and from local bus 1111 to cable 19. In that case, the station communicates with other stations according to the protocols necessary for exchanging data on the local network. The ESI (interface) 1267 transmits and receives received signals (RD), transmitted signals (rx), and carrier detectors (CD). It constantly monitors whether or not data is flowing through the cable 19 by detecting the carrier detector (CO), and when there is no data, it sends out a transmission signal (rx), but it detects data different from the one it sent. A collision is detected by detecting the collision, and retransmission is performed at a different timing.In that case, by providing a random time, the transmission is performed after a random time has elapsed after the collision. others,
It is determined whether the data flowing through the cable 19 is destined for the own station or another station. Local bus 1111 has bus arbiter 1269. Bus controller 1270, control signals 1274. address latch 1271
．． Address 1-Lance 1273 and Data Transformer 1272 are connected, LANC (controller) 12
Serial data is output to 6g. LANC126
A maximum of 1500 bytes of packet data is temporarily stored in the buffer in a.

In the above-described audio, document, and image processing system, the present invention is mainly related to digital compression processing of audio in combination with text processing, or audio alone, and printing out of compressed data. Also, in relation to audio reproduction, there is reading of visible information on the sheet, extraction of audio compressed data from the read data, and audio reproduction processing. Text and illustrations that do not include compressed audio data.

Processes such as creation, editing, transfer, and printing of pictures, etc. are the same as in conventional devices, so a detailed explanation of the controls related to these will be omitted, and the controls related to audio input processing and audio playback processing will be described below with reference to FIG. 15a. This will be explained with reference to the following.

First, let me explain the outline of these processes.

The main body of processing control is the processor 112, which compresses the A/D converted data converted into 8-bit data by the digital processing circuit 1 into 4-bit data by preemptive encoding and stores it in the main memory 1.
13 in the same manner as the pixel information, but the audio compression processing instruction and write address are written to the microprocessor 111.
instructs 112. The information written to the main memory 113 is transferred to the processor 1 according to instructions from the keyboard.
11 to the printer 1173 or controller 119. Further, when reading compressed audio data from recording paper and reproducing audio, the processor 111 controls writing of image read data from the scanner 1171 to the memory 113. When the processor 112 receives a playback instruction from the processor 111, it extracts only audio compressed data from the data in the memory 113, decodes it into 8-bit data, and supplies it to the analog processing circuit 2.

Referring first to FIG. 15a. Microprocessor 111
or when the word processor main unit 100 is powered on and a menu is displayed.

Create a new text (enter text using the keyboard) or &
During Collection I (display of information received from other stations or scanners 1173 or read from a floppy and key manual editing of displayed information), the audio processing routine shown in FIG. 15a is executed substantially periodically. Proceeding to this audio processing routine, the processor 111 first detects that the "audio record" key on the keyboard 1172 has been operated (
key on) (Step 1: In the following, the word step is omitted in parentheses and only numbers are shown).
If the key is not operated, the presence or absence of the audio recording flag (a flag indicating that the audio recording key has already been turned on and the audio recording process has started in response to this) is checked (
19) If this flag is not present, there is no instruction for audio recording processing and the audio recording processing has not been started, so the process returns to the main routine. In other words, the recording processing routine is exited. In this aspect, since the recording processing routine is not substantially executed, the time from entering to exiting the recording processing routine is extremely short.

When the "audio record" key on the keyboard 1172 is operated.

The processor 111 sets the audio recording flag 2)
.

Display the "r Voice Recording Position Input Instruction" screen on the screen of the display 1161 (3). This screen includes a column for "Recording Start Page 1 Line", "Recording End Page 1 Line" column, and other additional information. There is a column for instructions. and waits for keyboard input.

When the operator places the cursor on the screen of the display 1161 on the page in the "Recording start page 1 line" column and enters a number using the numeric keypad, the input numeric keypad No. and the corresponding numeric data (12
digit) is read as page data. The same applies to other specifications (4 to 7). When the start key on the keyboard is pressed, the processor 111 finishes reading the instructions, erases the instruction screen, and returns to the previous screen. Note that, if there is only a penetration input and no line input by the time the start key is pressed, the processor 111 sets the entry address to the beginning of the first line of the designated page if the penetration input is a start address, and completes the one-page input. If it is an address, it is set to the end of the unlined page of the specified page.

If the start key is pressed without inputting a voice recording position and the previous process was text creation or editing, the beginning of the line where the cursor was located (
(if there is no information in that line) or the beginning of the next line (if there is information in that line) is the recording start position of compressed audio data.

If the previous process was menu display, the beginning of the first line of the first page is set as the recording start position. In any case, if there is no end position input, the end position address is not set (4 to 10), and the processor 111 then shifts the cursor in the Y direction from the recording start position and displays it (
10). That is, a four-dot empty band is set in the Y direction between the image and the immediately previous image. Processor 111 then transfers to processor 112.

Starting end address data (memory 1) indicating the position of the cursor
13) and recording end position address data (if set by input).
Give the write end address data to the memory 113,
It also instructs the processor 112 to record audio. Then, the audio recording start flag is set and the process returns to the main routine.

The processor 112 sets the recording start position address data (cursor position) in the write address register, and if transfer is being received, sets the recording end position address data in the end point register, and assigns it to audio data processing. One of the two buffer memories, buffer memory l, is set for writing, a synchronization counter is set to 1, and a channel counter is set to 1 (13). These are the default settings for audio processing. The processor 112 then sets the dt timer that determines the audio sampling period (14) to enable time-over interrupts;
The digital processing circuit 1 is instructed to perform A/D conversion and the converted data (8 bits) is read (15). Next, programmed predictive coding is executed to compress the 8-bit data into 4-bit data (16). Next, 4-bit data is written to a predetermined address of the buffer memory (buffer 1 or 2) set for writing by referring to the contents of the synchronization counter and the contents of the channel counter (17). When a predetermined amount of data is written to the buffer set for writing, the buffer is set for writing to the memory 113, and another buffer is set for writing data of the audio to be sampled from now on (18); After the processor 112 writes the compressed data (4 bits) of the audio sampled once into the buffer, it returns to the main routine that performs processing as a normal word processor, and when an interrupt occurs due to the timeout of the dt timer (20). and step 14 of the 15th all
18 is executed. That is, the voice storage process is executed at a substantially constant period (dt,).

22 with reference to Figures 16a and 16b.

Write control to buffer memory will be explained.

FIG. 16a shows an image 31 read by the scanner 1171.
In combination with text 32Ii concentration, audio recording is specified,
The printout sheet 3 is shown when compressed audio data 33 is written after that. 31 Haskiyana 1171 shows the area of the image read.

32 indicates an area where sentences are recorded, and 33 indicates an area where audio compressed data is recorded.

In this embodiment, standard characters are recorded with 24 dots vertically and 24 dots horizontally.

As mentioned above, one line is 24 bits wide.

Also, since the audio compressed data is 4 bits, simply
Six channels of compressed audio data can be recorded in one line. However, in order to minimize the possibility of information being erased or confused due to information reading errors when reading recorded data with a scanner, in this embodiment, 1 bit of audio compressed data (1 word, 4 bits) has 2 vertical dots, I am trying to allocate a record of 4 dots, 2 dots horizontally. Correspondingly, when writing to the buffer memory, 1 bit of audio compressed data is written as 2 bits in the main scanning direction X and 2 bits in the sub-scanning direction Y.
The data is enlarged to bits and written, and transferred and written to the memory 113 in that state.

Therefore, in this embodiment, compressed audio data is recorded in three channels in one line (24 dots), but as shown in FIG. 18b, sub-scanning Y feed of 4 bits is performed between lines.

As a result, the 1st to 8th dots of 24 dots per line width (Y direction) are placed in the first recording channel of audio compressed data, the 9th to 16th dots of the first order are placed in the second recording channel, and the next 17th dot is placed in the second recording channel.
~24 dots are assigned to the third recording channel, and the first
Compressed audio data (4 bits) is enlarged twice and recorded on each of the channels, the second channel and the third channel. The contents of the buffer memory have the same storage information distribution as the recording dot distribution of each row, but the storage data of the main memory 113 has the same actual recording dot distribution with an empty band of 4 dots between rows.

In the above-mentioned recording data creation shown in FIG. 15a, the buffer 1
The audio compressed data is enlarged twice and written in X and Y alternately. The write area of each buffer is set to 24 bits in the Y direction, and the width (area) in the X direction corresponds to when the audio data recording area is specified for each line by keyboard input. If there is none,
The number of bits corresponds to the text processing format setting at that time, or if there is no format setting, the number of bits corresponds to the standard format. At the start of storage, buffer l is set to write, the synchronization counter is set to 1, and the channel counter is set to 1 (13 in FIG. 15a). 1st 1
When a word (4 bits) of audio compressed data is obtained, the compressed data is expanded twice (8 bits) in the Y direction and stored in the first . The second bit is written to the first to eighth bits in the Y direction. Then, the synchronization counter is incremented by 2, and the word counter is incremented by 1. When the second 1 word (4 bits) of audio compressed data is obtained, the compressed data is expanded twice in the Y direction and transferred to the 3rd and 4th bits in the X direction of buffer 1.

It is written to the 1st to 8th focus points in the Y direction. Then, the synchronization counter is incremented by one count and the word counter is incremented by two. The same applies to the third and fourth words. When the contents of the synchronization counter reach the end point of the line in the X direction, the data (9 images of characters) of the original screen (screen memory) is written from there. When the contents of the synchronization counter again reach the in-line audio recording start point, audio data is written in the same manner as above.

When the content of the synchronization counter reaches one rod length, the word counter is cleared, the synchronization counter is set to 1, and the content of the channel counter is set to 2. This is the second
Writing to the channel is now specified, and writing to the second channel of the buffer memory is performed in the same way. When the content of the synchronization counter reaches one rod length, writing to the third channel is performed in the same way. Writing is performed. When the content of the synchronization counter becomes one rod length again, that is, when the buffer writing for the first line is completed, the content of the channel counter becomes 4. So buffer 1 reads - memory 113
For transfer to , buffer 2 is set to write, the synchronization counter is updated to 1, the channel counter is updated to 1, and the word counter is cleared. Then, writing similar to that described above is performed in the buffer 2. buffer 2
, that is, when the buffer writing for the second line is completed, buffer 2 is set to read/write transfer to memory 113, and buffer 1 is set to write audio sampling compressed data. Such write-transfer is continued until the end position of the audio data is set, if it is set, or until a stop input is received or the memory is overflowed if it is not set.

Through the above storage processing, data from which printing of line divisions as shown in FIG. 16b is obtained is written into the memory 113. Note that FIG. 16b is an enlarged plan view of a part of the region 33 in FIG. 16a.

When you write the audio compressed data to the memory 113 as described above, press the edit print key on the keyboard, then press the execute key, the memory data of Memo July 13 will be printed out on the bit/dot compatible recording paper. . If the above-mentioned compressed voice data is stored and a print instruction is given during editing of a text in which the image 31 is combined, a print shown in FIG. 16a is obtained.

31 is an image recording area, 32 is a text recording area, and 33 is an audio compressed data recording area.

Audio data is visibly recorded in the area 33 of this print, and the audio can be reproduced from this print as described later.

Data in the memory 113 can be registered on a floppy disk in the same way as in a normal word processor, and can also be transferred to or registered in other stations.

Also, facsimile transmissions may be made via the communication station.

What is most noteworthy is that it is possible to print a combination of visually recognized information such as text, pictures, illustrations, photographs, etc. and audio compressed data on one or several sheets and send it by mail or as a file as a letter or paper document. be.

Next, audio reproduction processing control will be explained with reference to FIG. 15b.

There are two modes for audio playback. One of them is to scan a recording paper on which compressed audio data is recorded, a copy thereof, or a printed paper, as shown in FIG. 16a, into a scanner 1171.
The first mode (scanner reading-audio playback) is to read the image information by setting it to 1, read the image information, restore the audio compressed data from it, and play the audio.
When a paper is set in the scanner 1171 and the "Original reading audio playback" key on the keyboard is pressed, the original image is read - written to the memory 113 - memory 113
Reading and audio reproduction are performed.

The other is a second mode (memory read audio playback) in which data is already displayed in the memory 113 (for example, text creation or editing, facsimile reception, file search, floppy text reading), and audio playback is instructed. ). When the "audio playback" key on the keyboard is pressed, the audio compressed data written in the memory 113 at that time is decoded and the audio is played back.

The first aspect is the aspect in which the greatest advantage can be obtained by the present invention. The first aspect differs from the second aspect in that document reading is added as preprocessing, but the processing after reading the image data into the memory 113 is the same in both cases. Therefore, the audio reproduction process from a state where image data is written in the memory 113 will be explained.

Referring to Figure 15b, the audio playback key is pressed (2
1), the processor 111 sets the audio reproduction flag 22), instructs the processor 112 to reproduce the audio, and returns to the process before key-on.

When the processor 112 is instructed to play audio, the processor 112 stores the memory 1
13, the memory data is read out and the audio data recording area is searched (24).

Here, the contents of the audio data recording area inspection m(24) will be explained with reference to FIGS. 16b and 15c. When audio signals (analog) and other sound wave signals are digitally converted, or when digital data is differentially encoded or predictively encoded, the probability that H will appear in the obtained digital data is high in the lower bits of the digital data. , lower in the upper bits. That is, H is concentrated in the lower bits. Therefore, as shown in FIG. 16b, compressed audio data distributed by channel division (the first
．． The second bit is the first and third lower bit of the audio compressed data.
．． The 4th bit is the lower 2nd bit of the compressed audio data, the 5th bit is
．． The 6th bit is the lower 3rd bit of the audio compressed data, the 7th
．． The 8th bit is the lower 4th bit of the audio compressed data.) When H of each bit is accumulated line by line in the main scanning direction X, the results are as shown by the solid line in the graph shown in the left column of FIG. 16b.

A mountain peak appears in the Y direction at the 1st dot, the 9th dot, and the 17th dot at an 8-bit period.

In the above embodiment, there is an empty band of four dots between the lines. [This means that when one row of data (channels 1 to 3) is stored in buffer 1.2, the data in the buffer is written to the memory 113, and then the data in the buffer is written in the memory 113 before writing the data in the same manner. , 4 lines (4 bits in the Y direction,
Total length in the X direction)rL=(Set by writing N.However, if there is other image information in this empty band area, it will be left as is.) In this empty band.

The cumulative value of H becomes 0. Compared to this, one character (24X
24 dots), the peak of the H accumulated value appears in the center of one line width, as shown by the two-dot chain line in the graph in the left column of Fig. 16b, and the peak of the H accumulated value in the X direction appears in the Y direction. The distribution is completely different from that of audio compressed data.

Similarly, in the case of a line drawing such as a one-gradation image or an illustration, this distribution has a gentle undulation, which is completely different from compressed audio data. Therefore, by detecting whether or not the Y-direction distribution of the X-direction H cumulative value has the above characteristics of audio compressed data, the audio compressed data area can be automatically determined.

Compressed audio data can also be automatically identified based on the X-direction distribution of the Y-direction H cumulative value. That is, in the audio compressed data, the X-direction distribution of the Y-direction H cumulative value is distributed at heights corresponding to the audio frequency, and has undulations corresponding to the audio frequency. On the other hand, for one sentence data, even in the X direction, the 16th
The distribution is in units of 24 dots, similar to that shown by the two-dot chain line in the left column of figure b. Therefore, between audio compressed data and text data, the audio compressed data can be automatically detected using the characteristics of the X-direction distribution of the Y-direction H cumulative values of the text data even if the X-direction distribution is present. However, similarly to halftone images and illustration images, the X-direction distribution of Y-direction H cumulative values has undulations, and this varies depending on the image characteristics. It is also conceivable that the image characteristics and the characteristics of compressed audio data tend to be similar.

After all, audio compressed data can be uniquely and automatically detected based on the Y-direction distribution of the X-direction H cumulative value.

Based on the X-direction distribution of the Y-direction H cumulative value, compressed audio data can be automatically identified only when there are only two types of data: compressed audio data and text data. Therefore, in the above embodiment of the present invention, audio compressed data is automatically and uniquely detected based on the Y-direction distribution of the X-direction H cumulative value. Note that when the data is limited to voice and text, the compressed voice data may be automatically detected based on the X-direction distribution of the Y-direction H cumulative value. Also, in any case,
Direction I (automatically detects various image areas in both the Y-direction distribution of cumulative values and the X-direction distribution of daily cumulative values in the Y-direction,
The distribution of various data on the screen may finally be specified based on the correlation of rain detection data.

Now, check m(2) of the audio data recording area shown in FIG. 15c.
In 4), audio compressed data is automatically detected based on the Y-direction distribution of the X-direction H cumulative value. That is, first, the search base point (
X5. YS) at the upper left corner, which is the starting point of the screen (33). Next, in steps 34 to 42, the base point (Xs,
Ys) and (Xs+23°Ys+23) are the diagonal points of the area (24X 24 dots), and H is divided into lines (X direction), counted in the X direction (35, 36), and each line j= The count value Nj of o to 23 is stored in the register Nj. As a result, the base point (Xs, Ys) and (Xs+
23. This area (24X
24 dots), the accumulated value of H in the X direction is stored in the register Njtj=
It is stored in 0-23. If this area exactly matches the first to third channels in FIG. 16b, the values in register Nj should be in the shape of a sawtooth wave as shown in the left column of FIG. 16b. Therefore, in step 43 of FIG. 15c, it is detected whether the curve represented by the contents of the register Nj has peaks at three points and the interval between the peaks is eight dots (audio compressed data pattern). If it is an audio compressed data pattern, the audio data flag is set (45), and the base point (Xs, Ys) at that time is written in the audio start register (46). If it is not an audio data pattern, or if the above step (46) is completed,
The base point is moved from (Xs, YS) to (Xs+1.Ys) (50). And similarly, the base point (Xs+1.Ys) and (
Xs+1+123. H in the area (24 x 24 dots) whose diagonal point is Ys+23) is divided into lines (X direction), and counted in the X direction (35°36), each line j =
The count value Nj of o to 23 is stored in the register Nj. As a result, the base point (Xs+1.Ys) and (Xs+1+
23. This area (24X
24 dots), the accumulated value of H in the X direction is stored in the register NjtJ.
= It is stored in O~23. If this area exactly matches the first to third channels in FIG. 16b, the values in register Nj should be in the shape of a sawtooth wave as shown in the left column of FIG. 16b. So the 15th c.
At step 43 in the figure, it is detected whether the curve represented by the contents of register Nj has peaks at three points and the interval between peaks is eight dots (audio compressed data pattern). If it is an audio compressed data pattern, check the presence or absence of the audio data flag, and if there is no audio data flag, set the audio data flag (45), then set the base point (Xs+1.Ys
) is written into the audio start register (46). If the audio data flag is already present, it means that the audio data continues, and the process proceeds from step 44 to step 50. If it is not an audio data pattern, check the presence or absence of the audio data flag47).If it is present, it means that the audio data has changed from presence to absence, so please clear the audio data flag48), Base point (Xs + 1.Ys) is written to the audio termination register (49).

In the above manner, until the end of the line in the X direction.

Shifting the base point one bit at a time in the X direction, the 24 x 24 dot area with the base point as the upper left corner is sequentially searched for whether or not it is audio compressed data, and when audio compressed data changes from non-detection to detected, the The current base point data is additionally stored in the audio data start register, and when audio compressed data is detected but is not detected, the current base point data is additionally stored in the previous data end register. As a result, even if the data area changes, such as changing from audio data to other image data and back to audio data, in the middle of one line, the data indicating the boundary will be stored in the audio start register and audio end register. It will be written in.

When the set base point crosses the end of the line in the X direction, the base point (
X s , Y s + 1) (52), and the above-mentioned audio compressed data detection process is executed over the entire length of one line (width is 24 dots).

When the set base point exceeds the end point in the Y direction (53), the first
Proceed to step 25 in Figure 5b. That is, the audio data recording area search (24) is ended.

As a result of the audio data recording area search (24) explained above, all the recording start and end points of compressed audio data on the reading screen are stored in the audio data start register and audio data end register. Become.

Referring again to Figure 15b. When the audio data recording area search (24) is executed as described above, the microprocessor 112 searches for the audio compressed data on the reading screen based on the start and end data stored in the audio data start and end registers. The area is calculated to be a straight line parallel to the X axis and the Y thin axis on the memory, and the start and end of the audio compressed data area are finally set. This is step 25 shown in Figure 15b,
The contents are shown in Fig. 15d.

That is, first, based on the starting edge data and ending edge data existing along the same row, the distance Lx in the X direction between the starting edge and the ending edge is calculated.
is calculated (55), and the maximum value of the distance Lx between the start end and the end of each row is searched (56 to 60). After finding the maximum value, calculate the ■direction address difference Yd between the starting end and the ending end that has the maximum value (5g), and calculate the tilt Yd/Lλ of the image plane (rotational shift around the upper left corner base point of the image memory). and check whether this is greater than or equal to the allowable value61).
If it is greater than the allowable value, calculate the X-direction distance Ld that causes a one-dot shift in the Y-direction (62), and correct the image data distribution (rotation correction) to make L space parallel to the X-axis of the image memory.
(63), this correction changes the image data on one image memory by 1 in the Y direction every time the address advances by Ld in the X direction.
Advances or delays the recording position by a dot (advance when Yd is positive, retard when Yd is negative), and each time the address is advanced by Ld in the Y direction, the recording position is advanced by one dot in the X direction. Along with the distribution correction (rotation correction) of this image data, which is performed by updating and writing to the image memory with a delay (when Yd is positive) or a delay (when Yd is negative), the audio data start end register and end The coordinate data of the register is similarly corrected (64), and the maximum area of the audio data recording area is searched based on the corrected coordinate data, the maximum area is divided into rectangular areas, and for each rectangular area, Y direction (count the accumulated values to detect the accumulated value distribution in the X direction, and from this accumulated value distribution, detect the starting and ending ends of the audio data in the Focusing on the fact that the cumulative value distribution in the X direction is relatively flat and has undulations, and the cumulative value is 0 immediately before the start and end of the audio data, the trapezoid is Set the edge as the X-direction start and end of the audio data in the rectangular area.The X-direction start and end addresses set in this way are set as the final X address of the audio data recording area in the audio data start and end registers. Update memory (67).The addresses in the Y direction are those that have been stored in the audio data start and end registers up to that point.

As already explained, the Y-direction distribution of the X-direction H cumulative value of audio compressed data has a sharp peak, as shown by the sawtooth-shaped curve in Figure 16b. The Y address of the data recording area is accurate. However, the X address detected at that time is the one when the sawtooth-shaped curve can be specified, and since the H cumulative value of 24 dots in the X direction is used to obtain this curve,
It does not necessarily indicate the exact start point (end point) of the compressed audio data. Therefore, with the X-direction distribution of the Y-direction H cumulative value mentioned above,
Accurate X-direction audio compressed data start and end points are determined (65-67).

Referring again to FIG. 15b, when the correction data is set to 0 or more (24, 25), the above-mentioned audio compression storage control (
Data reading and audio reproduction are performed which are logically inversely related to FIG. 15a).

When reading data, write data from the first row of data in the audio compressed data recording area to the first buffer,
Write the data from the second row onwards until it is all over, and then write the following data to the second buffer 2 (26
), and in this writing, the data read from one image memory is compressed to 172 in the X direction (sampled every other word) and compressed to 1/2 in the Y direction (sampled every other bit). The processor 112 then sets buffer 1 to read, sets the channel counter to 1, sets the word counter to 1 (27), and d
Set the t timer and enable the interrupt in response to the timer over of the dt timer28).
The data of the first word (4 bits) of the channel is read out, the programmed predictive decoding is executed to obtain 8 bit data (29), and the D/A converter (third
The output is set to 1), the word counter is incremented by 1 (30), and the process returns to the main routine where normal word processor processing is performed.

When an interrupt is generated due to the timeout of the di timer, the processor 112 proceeds to the flow shown in FIG. 15b and executes dt.

Set the timer 28), read the jth word of the first channel determined by the content l of the channel counter and the content J of the word counter, perform predictive decoding to obtain 8-bit data, and send it to the D/A converter. Output the update and increment the word counter by 1.

The value is compared with the number of words written in the 26th step, and if the contents of the word counter do not exceed the number of words, the process returns to the main routine. If the number of words is exceeded, the contents of the word counter are updated to 1, and the contents of the channel counter are incremented by 1. If the content of the channel counter is 3 or less, the process returns to the main routine. This means that the read channel has been updated. If the content of the channel counter is 4 or more, the channel counter is updated to 1, buffer 2 is set to read, buffer 1 is set to write, and the write to buffer l (next data from memory 113) is performed. Read and write to buffer 1: Read/write processing similar to step 26 described above) is set and started. After that, writing to buffer 1 and first channel data from buffer 2,
After reading the second channel data and third channel data, the next data is written to buffer 2 and the first channel data is read from buffer 1.

Writing to buffer 1 and reading from buffer 2 - writing to buffer 2 and buffer 1 in the form of reading second channel data and third channel data
Writing and reading are performed alternately.

Through the reading, decoding, and output processing of the audio compressed data from the image data memory 113, the audio data (8-bit data) is sequentially sent to the analog processing circuit at a period substantially equal to the audio sampling period dt (audio recording period). 2 (FIG. 3), and the recorded audio is played back.

Even during this recorded audio playback, if text editing is set before and after pressing the audio playback key, text input ZlIA collection is performed in response to keyboard input in the main routine.

Therefore, for example, an operator can key in (create sentences) as a sentence while listening to the voice.

In Figure 16a, the scanner 1171 reads a paper picture 31, creates a new sentence in the editing process or sets the Ii collection, creates a sentence in the area 32, and then records the audio 33 and prints it out. Indicates recording paper.

In addition to this, it is also possible to record audio first, then set text creation or editing to write the text next to the audio compressed data. You can also write text and audio alternately.

Scanner 1171 reads a paper picture, edits the data on memory 113 and the image on display 1161, leaves only part of it, erases the other parts, and sets the starting point of the image that remains as the audio recording start position. When audio recording is instructed by specifying , compressed audio data is written outside the remaining picture area.

Various usage modes of the embodiment of the present invention described above are as follows.

Usage mode 1: Print out only audio compressed data.

Usage mode 2: Print out compressed audio data in combination with text.

Usage mode 3: Print out compressed audio data in combination with illustrations.

Usage mode 4: Print out audio compressed data in combination with an image read by a scanner.

Usage mode 5: A combination of two or more of the above modes 2 to 4.

In the above embodiment, the configuration is such that audio recording/reproduction can be performed with a single unit, but an audio recording/playback system that does not include the scanner 1171, the analog processing circuit 2, and the speaker 21 is also available.
Correspondingly, a machine dedicated to audio reproduction (and text processing) without the microphone 11 and digital processing circuit 1 may be provided. However, since a relatively small amount of hardware and programs are omitted in connection with these, a scanner 1171. Analog processing circuit 2. Speaker 21. Preferably, a microphone 11 and a digital processing circuit 1 are provided.

■Effect Recently, various types of personal computers and word processors have become popular, ranging from extremely low-priced portable models to relatively high-priced dedicated machines.
As is well known, personal computers can also be used as word processors. However, most of this type of OA equipment is equipped with a printer capable of recording dots, and all dot printers can be connected. Therefore, this type of personal computer and word processor are equipped with a microphone, a digital processing circuit, an analog processing circuit, and a speaker as shown in FIG. By adding an editing program that expands and edits data into bitmaps in the same way as character data, OA
Audio processing, which has been excluded from the scope of
There is little hardware addition to the equipment, and since many parts of the processing program can be shared with the information processing program, there are few additions.

For example, in work that requires oral recording, such as interviews or meeting records, if it is possible to key in on the spot, text can be entered, and if this is difficult, it can be visually recorded on a sheet as an audio record. In addition, the written text (including audio compressed tape) is retained in memory and recorded on a floppy disk if necessary.

You can play audio on the spot. You can print it out and issue it on the spot. There is no need for a separate tape recorder, etc. After that, you can play the floppy disk or read the recording paper with a scanner, and while playing back the audio, you can convert it into text and key in.

Furthermore, for example, patent applications are usually filed in text information documents, which are specifications, and illustration information documents, which are drawings.
In order to understand the content, the invention of the application is understood by repeatedly reading the text of the specification and looking at the drawings, but at this time, it takes considerable effort to flip through the specification and each drawing. .

In particular, he often shifts his eyes between text and drawings.

The problem is even greater if the processing device of the present invention is used to create a specification as a combination of text and audio compressed data.

It becomes possible to understand the contents by looking only at the drawings while playing back the audio, which makes it easier to understand and I am sure that there will be less distractions, especially visual distractions.

Paper with compressed voice data recorded on it can be sent to remote locations in the same way as letters, and now that office automation has become commonplace in homes, plain paper with compressed voice data recorded on it can be sent as text +
It can be mailed as an audio message. This is because when you send a facsimile, audio information is sent at the same time as text information.

It is a text + voice email.

In addition to this, conventional picture books, educational books, manuals, instruction manuals, IF
Registers, catalogs, certificates, qualification cards, etc. can be made to have both visual and audio information recorded only on a visible recording medium.

Therefore, it can be directly applied to the fields of conventional visual information processing, transmission, storage, and utilization using plain paper. Since it does not require a special information medium, it is highly versatile and brings new scope to the information processing field.

However, according to the present invention, the sound wave compression data area on the sheet is automatically searched and the sound waves are automatically reproduced.
The operator's operation for sound wave reproduction is omitted, making it easy to use.

There is little need to provide special means for identifying sound wave data on the sheet, and the recording area of the sheet can be widely used for data memory.

[Brief explanation of drawings]

FIG. 1 is a perspective view showing the appearance of an embodiment of the present invention. FIG. 2 is a block diagram showing an outline of its internal configuration. FIG. 3 is an electrical circuit diagram showing the configuration of the digital processing circuit 1 and analog processing circuit 2 shown in FIG. 2. Figures 4, 5, 6, 7, 8, 9, 1O, 11, 12, 13 and 14 are shown in Figure 2, respectively. FIG. 2 is a block diagram showing the internal configuration of each block shown in FIG. FIG. 15a is a flowchart showing an overview of audio recording processing control by processors 111 and 112. FIGS. 15b, 15c, and 15d are flowcharts showing an overview of audio reproduction processing control by the processors 111 and 112. FIG. Fig. 16a is a plan view of a recording paper on which pictures, text, and audio data have been edited and printed out, and Fig. 16b is a plan view showing an enlarged part of Fig. 16a and an X It is a graph which shows direction H cumulative value distribution. l: Digital processing circuit 2: Analog processing circuit (D/A conversion means) 3: Recording paper (
Sheet) 31: Picture recording area 32: Text recording area 33: Audio compressed data recording area 11: Microphone 21: Speaker (fl! air/sound wave conversion means) 100: Word processor main body 111.112: Microprocessor (sound wave information recording area detection 113: Image data memory (memory means) 117:
I10 module 120: Communication control device 1161
: CRT display 1171 : Scanner

Claims (1)

[Claims] (1) A sheet that visually records bit information of the sound wave information obtained by converting sound waves into electric signals and converting the electric signals into digital data; A scanner that reads the image of the sheet; A memory means for writing the read image information; The image information is converted into two-dimensional X of the original image on the sheet,
Corresponding to the distribution of Y, accumulate bit information H or L in at least one direction of the X direction and the Y direction, and from the distribution of the accumulated value in the direction orthogonal to the one direction, Sound wave information recording area detection means for detecting the sound wave information recording area; Reading means for reading out the sound wave information in the sound wave information recording area from the memory means; D/D converting the read sound wave information into an analog electrical signal.
A sonic information reproducing device comprising: A conversion means; and an electric/sound wave conversion means that converts the analog electrical signal into a sound wave.