JPH01126882A - Transmitter for sound and image - Google Patents

Abstract

PURPOSE:To attain response and confirmation in a real time according to image information, a message or conversation by converting an image signal picked up by a television camera and a sound signal collected by a microphone to a digital signal storing in a memory and simultaneously transmitting image communication and a call. CONSTITUTION:The analog image signal pickedup by the television camera 2 is converted to the digital signal, stored in the video memory (V-RAM) 5, 6 and sound data collected by the microphone 23 is also converted to the digital signal and stored in a memory 13 for a sound. When a modem 19 is switched to the image communication side according to the command of the CPU 12 of a personal computer main body, the image signal stored in the V-RAM 5, 6 is fed to a remote personal computer through a communication line 20. When the sound data is transmitted in a real time at the time of transmitting this image data, the sound data is packeted, inserted between image data packets and fed. Thereby, the message or the conversation as well as the image information can be transmitted.

Description

DETAILED DESCRIPTION OF THE INVENTION [Field of Industrial Application] The present invention relates to a voice and image transmission device that allows images and voices to be transmitted to remote locations in service providing companies, security companies, and the like.

"Conventional technology" Conventionally, as a technology for transmitting images to a remote location using digital communication, the image is A/D converted, the obtained digital information is sent to the remote location via a telephone line, and the receiving side performs D/A conversion. There is a so-called facsimile machine that reproduces images.

``Problems to be solved by the invention'' Conventional facsimile machines have only two gradations, black and white, and cannot reproduce images with intermediate gradations. Second, the image can be reproduced using the received data, but the data cannot be stored in memory and used. Third, it is impossible to reproduce a good image.
There were problems, such as the fact that only image information could be transmitted, and it was not possible to transmit messages or conversations in real time.Fourth, it was only possible to transmit information that had been printed or filled out in advance on a flat sheet of paper.

The purpose of the present invention is to digitize audio, which is an analog signal, and import it into the memory of a personal computer, and to transmit the imported audio data even while image data is being transmitted, and to be able to receive it, restore it to analog, and play it back. That is.

"Means for Solving the Problems" The present invention provides digital processing and memory of image data captured by a television camera, an image memory for storing digital signals of received image data, and a microphone. an audio memory that digitally processes collected audio data and stores it in memory, and also stores a digital signal of the received audio data; a television receiver that performs analog processing on the data in the image memory and displays the audio; The device is equipped with a speaker that performs analog processing on the data in the memory for reproduction and reproduces it, and a personal computer that instructs reproduction of the contents of the image memory and audio memory and communication with the personal computer via a communication line.

"Operation" An analog image signal captured by a television camera is converted into a digital signal and stored in a video memory (V-RAM). At this time, the image signal is stored in memory by dividing each color signal of R, G, and B into four levels of luminance signal. Furthermore, the audio data collected by the microphone is also converted into a digital signal and stored in the audio memory. When the modem is switched to the image communication side by a command from the computer's CPU,
The image signal stored in the V-RAM is sent to a remote personal computer via a communication line. When audio data is also transmitted in real time when transmitting image data, the audio is converted into data packets and inserted between image data packets before being sent. However, in order to distinguish between image data packets and audio data packets, IDs unique to images and audio are added to the beginnings of the data packets, respectively. On the receiving side, only the sent image signals are sequentially stored in the V-RAM memory, sent to the palette circuit, further converted to analog signals by the D/A conversion circuit, and displayed on the television receiver, but the R, G , B are each divided into four levels of luminance signals, so in the case of black and white, a 16-gradation black and white image is displayed, which is a combination of four levels, and in the case of color, it is displayed in 4096 colors. Furthermore, image signal communication is performed using HDLC (Hi
gh Level Date Link Contr.

I Procedures method.

In addition, the audio signals are also sequentially stored in the audio memory,
It is D/A converted and played back from the speakers.

Note that, of course, when there is no audio, only the image signal is sent as a data packet.

"Example" An embodiment of the present invention will be described below with reference to FIG.

(1) is a television receiver, and a television camera (2) is connected to this television receiver (1), and A that converts the analog image signal captured by this television camera (2) into digital. /D conversion circuit (3), digitizing circuit (
4) First and second V-RAMs as video memories
(5) (6) are combined. This first and second
(7) V-RAM (5) (6) is a pallet circuit (7),
The television receiver (1) via the D/A conversion circuit (8)
is combined with

Next, (9) is a floppy disk that stores computer programs, and this disk (9) is a deck (1
0) to the deck controller (11);
This deck controller (11) is connected to the main CPU (12).
), main RAM (13), and serial controller (14). In addition, the main CP
U (12) and main RAM (13) are connected to the first and second V-R via a memory switching register (15).
AM (5) (6) and sub CPU (16) are combined, and this sub CPU (16) is connected to encoder (17).
via a keyboard (18).

Also, (23) is a microphone, and (24) is a speaker, which are connected to the main CPU (12) and main RAM (13) via an A/D conversion circuit (25) and a D/A conversion circuit (26), respectively. is combined with

The serial controller (14) is a modem for modulation and demodulation (
19) to the communication line (20);

A telephone set (21) is coupled to this modem (19).

The communication line (20) can be a private line as well as a public line such as a telephone line.

Next, the operation will be explained with reference to flowcharts shown in FIGS. 2 and 3.

In FIG. 2, the system starts by turning on the power, and performs initialization and internal settings for each device. Next, a menu is displayed on the television receiver (1), and the operator makes menu selections such as transmission and reception. When auto dial is selected using the keyboard (18), a call is made to the other party. That is, a command from the main CPU (12) controls the modem (19) via the serial controller (14) to auto-dial a pre-registered party. If you select maintenance, you can register or modify the other party's name, phone number, etc. When you select Send/Receive, the image signal captured by the TV camera (2) and/or
Alternatively, it transmits or receives an audio signal collected by a microphone (23).

The operation of this communication will be explained in more detail.

If the operator selects transmission using the keyboard (18), image capture by the television camera (2) and audio capture by the microphone (23) continue until the capture end key is pressed. The image signal from the television camera (2) is converted by the A/D conversion circuit (3) and sent to the first and second V-RAMs (
5) Note on (6)! , but at this time, the image signal is R, G as shown in FIG.

In addition to being decomposed into B, each brightness is decomposed into four levels (numbered 3, 2, and 1.0 in order from highest to lowest brightness) and stored in memory. That is, the first V-RA
M(5) includes B3. B2. R3, R2, G3. G2 is stored in memory, and the second V-RAM (6) stores Bl, BO,
R1, RO, GI.

GO is memorized. When the capture of one screen's worth of memory is completed and the capture end key is pressed and the result becomes YES, the process remains on standby unless the cancel key is pressed. The audio signal from the microphone (23) is sent to the AID conversion circuit (25).
) and stored in the main RAM (13). When the send key is pressed to enter the communication mode, the main CPU (12) of the personal computer commands to read the image signals from the first and second V-RAMs (5) and (6) for several lines (e.g. 8 lines). line) into data packets to create transmission data. At the same time, the audio signal is also sent to the main RA.
M 03) and converts it into data packets to create transmission data. A unique identification ID is added to the beginning of each data packetized image data and audio data, and the data packets are inserted alternately. The ratio of this image data to audio data is 2: in addition to the above-mentioned alternating case (1: 1).
You can also set it freely, such as 1.1:2. however,
No audio is sent when there is no audio. Main CPU (1
A control signal is output from the serial controller (14) according to the command from 2), and the modem (19) connects the communication line (20) to the main body of the personal computer for communication with the personal computer. The image data and audio data are then sent to the other party.

Next, when the operator presses the receive key of the send/receive keys, image and audio data are received from the communication line (20), and the modem (19) and serial controller (1
4), image data is written to the first and second (7) V-RAMs (5) and (6) through the main CPU (12), etc., and audio data is written to the main RAM (13). ,
Eight lines are displayed on the television receiver (1) and audible from the speaker (24). First and second V-RAM (5
) (6) When one screen worth of data is written, the writing ends.

At this time, the image data is transmitted to the television receiver (1) with a mark (22) indicating how far on the screen it has been transmitted, as shown in Fig.
) is displayed. If one screen has 152 lines, 8 lines at one time.
Since each line is sent, the landmarks for each 8 lines (
22) Display... 1 by sending 8 lines 19 times
When the screen transmission is completed, the end key is pressed to select YES, and the next menu is selected. Also, main RA
M (13) audio data is D/A at the same time as image playback.
The audio is converted by the conversion circuit (26) and reproduced from the speaker (24) in real time.

When playing the image, if the screen is black and white, R, G,
Of E, G3. G2. Only Gl and GO signals are sent. These four-stage signals are then sent to the palette circuit (
After being combined into a 16-gradation black and white image signal in step 7), the D/
It is converted into an analog signal by the A conversion circuit (8) and displayed in black and white on the television receiver (1). Furthermore, in the case of a color screen, all four levels of R, G, and B signals are sent and displayed on the television receiver (1) in 4096 colors.

Next, HDLC (Hi-Fi) is used to transmit image and audio data.
gh Level Date Link Control
1 Procedures) method is adopted.

The features of this HDLC are as follows.

(1) In the basic procedure, there are restrictions on the information to be transmitted, and there is a lack of independence between transmission control and terminal control. In contrast,
In HDLC, transmission is bit-oriented, and transmission control and information are completely independent, and information of any bit pattern can be transmitted by any number of bits.

(2) In the basic procedure, so-called alternate monitoring transmission is performed. On the other hand, in HDLC, numbers are assigned to frames corresponding to blocks in the basic procedure, and up to the next 7 (255 in extended mode) frames can be postponed before confirming the response to one frame. You can respond to them all at once. Furthermore, it is possible to add an acknowledgment response to the frame received from the other station to the information frame, resulting in extremely high transmission efficiency.

(3) In the basic procedure, response codes and supervisory codes (ACK) are used.
, NAK, ENQ, etc.), but in HDLC, a CRC (Cyclic Redundancy Ch.
eck) bit is added to ensure high reliability of transmission.

(4) Full-duplex communication cannot be performed on a branch line in the basic procedure, but it is possible in HDLC.

(5) In HDLC, the frame format is unified and conceptually simple.

Furthermore, regarding the frame structure of HDLC, the transmission unit in HDLC is called a frame. As shown in Figure 7, a frame consists of a flag sequence called F pattern for synchronization, an address field, a control field, an information (data) field, and a frame check sequence (Fe2) for error detection. It consists of

The F pattern is an 8-bit sequence of "01111110" and indicates the start/end of a frame. This flag sequence can serve both as the end of one frame and the start of the next frame.

In order to maintain the transparency of frame information, the sending side always sets a bit “0” to 1 immediately after five consecutive bits “1”.
Insert. The receiving side must automatically delete five consecutive bits "1'" if the value immediately after them is 0.The F pattern is prevented from appearing within such information.

The address field is a field for specifying a secondary station, and the control field is a field for setting control information such as command/response type and sequence number. Upper level information is set in the information field.

There are three types of control fields.

The information transfer format (U frame) is a frame for transferring information, and includes a sending sequence number, receiving sequence number,
Consists of P/F bit. The monitoring format (S frame) is for controlling the reception of U frames, requesting retransmission, suppressing - time, etc., and includes the reception sequence number, control function type,
Consists of P/F bit. The unnumbered format (U frame) is used to set the data link mode at the start of communication, disconnect at the end of communication, notify errors, etc., and consists of a control function type and a P/F bit.

"Effects of the Invention" Since the present invention is configured as described above, an image signal captured by a television camera and an audio signal collected by a microphone can be converted into digital signals, stored in a memory, and transmitted to a remote location. In addition, image communication and phone calls can be performed simultaneously, and real-time responses and confirmations can be made using image information, messages, and conversations.

Furthermore, the image data stored in the memory can be freely retrieved and displayed or copied later. Furthermore, it is not limited to what is printed or written on a flat sheet of paper in advance, and can also transmit three-dimensional objects or landscapes photographed with a television camera.

[Brief explanation of the drawing]

FIG. 1 is a block diagram showing an embodiment of the audio and image transmission device according to the present invention, FIGS. 2 and 3 are flowcharts, FIG. 4 is an explanatory diagram of V-RAM, and FIG. 5 is a data packet diagram. FIG. 6 is a front view of the television receiver, and FIG. 7 is a frame configuration diagram of the HDLC system. (1)...TV receiver, (2)...TV camera, (3)...A/D conversion circuit, (4)...digitizing circuit, (5)...117th) V- RAM, (61=second V-RAM, (7) ・=palette circuit, (8)・
...D/A conversion circuit, (9)...floppy disk, (10)...deck, (11)...deck controller, (12)...main CPU, (13)...
Main RAM, (14)... serial controller,
(15)...Memory switching register, (16)...
Sub CPU, (17)... Encoder, (18)...
・Keyboard, (19)...Modem, (20)...
Communication line, (21)...Telephone, (22)...Mark, (23)...Microphone, (24)...Speaker, (25)...A/D conversion circuit, (26)... )...D
/A conversion circuit. Applicant Fujitsu General Ltd.

Claims (1)

[Claims] (1) In addition to digitally processing image data captured by a television camera and storing it in memory, an image memory for storing digital signals of received image data and audio data collected by a microphone are digitally processed. an audio memory that stores digital signals of received audio data; a television receiver that performs analog processing on the data in the image memory and displays the data; and a television receiver that performs analog processing on the data in the audio memory and reproduces the data. 1. An audio and image transmission device comprising: a speaker for transmitting information; and a personal computer for instructing reproduction of the contents of the image memory and audio memory and communication with the personal computer via a communication line.