JPH0646029A - System and method for simultaneous processing of video, audio and data signals - Google Patents

Abstract

PURPOSE: To provide a digital compression and multiplex program which is used for a multi-media system. CONSTITUTION: A program delivery system utilizes a compression device, capable of compressing incoming video signals and non-video signals, audio signals and data signals for instance. The system is provided with a frequency modulator for modulating the incoming audio, data or other non-video signals and superimposing them on a selected video frequency. Fourier transformers 803-805 generate the set of cosine transformation components which are equivalent to the incoming video, audio, data or other non-video signals and selectors 807-809 to select the desirable Fourier cosine transformation components. Multiplexers 810-812 multiplex only the selected Fourier transformation components and prepare for a further processing.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION The present invention relates to video, voice and data (VA) in telecommunications systems such as cable, television, video, satellite, and in raster scanning devices.
D) A method and system for simultaneously digitally processing the signals.

[0002]

BACKGROUND OF THE INVENTION Currently, most video monitors and transmission systems utilize analog signals.

[0003]

The advent of computer and digital technologies will ultimately change the fate of video processing as the majority of video, voice and data signals are digitized.

The present invention provides a VAD that provides digital compression and multiplexing programs for use in multimedia systems.
The present invention relates to a system, and an object thereof is to provide a highly efficient video and non-video signal compression technique. For further purposes, VD of multimedia system with which computer can interface
A communication device is provided.

[0005]

In order to achieve the above object, in the present invention, a conversion means for receiving a video signal and emitting a conversion component therefrom, and a desired conversion component are selected and further processed. And selector means connected to the conversion means for preparing the above, and multiplexer means for multiplexing only the selected conversion component.

Further, in the present invention, the transforming means includes Fourier transformer means for emitting a sine transform component corresponding to a video signal, and the selector means selects the most desirable Fourier transform component, and the multiplexer means. Multiplexes only the selected Fourier transform components.

Further, in the present invention, modulator means for modulating a non-video signal to ride on a selected video frequency, and video conversion for receiving the video modulation signal and emitting a video conversion component therefrom. Means, video selector means for selecting the most desired video transform component, and multiplexer means for multiplexing only the selected transform component.

The invention also includes the steps of emitting transform components from the signal, selecting the desired transform components for further processing and multiplexing only the selected transform components.

The invention also includes the steps of emitting transform components from the signal, selecting the desired transform components for further processing, and multiplexing only the selected transform components. The invention also includes optical scanner means for scanning documents, graphics and similar text and characters to generate raster scan signals, which raster scan signals emit corresponding Fourier transform harmonics. Of said Fourier transformer means.

Further, in the present invention, modulator means for modulating a non-video signal to ride on a selected video frequency and video conversion for receiving the video modulation signal and emitting a video conversion component therefrom. Means, video selector means for selecting the most desirable video conversion component, and multiplexer means for multiplexing only the selected conversion component.

[0011]

The VAD system compresses an incoming video signal and non-video signals such as voice and data. The system includes a frequency modulator that modulates the VAD signal and places it on a selected video frequency. Fourier transformer is V
The conversion component corresponding to the AD signal is emitted. The selector selects the most desirable transform component. The multiplexer
Only the selected conversion component is multiplexed. The system can be used in storage media such as optical discs, compact discs and floppy discs and in ultrasonic medical technology.

[0012]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS First, a program delivery system (PDS) 800 of the present invention will be outlined to provide background. Figure 1
Shows the architecture of the PDS 800 of the present invention. It comprises a plurality of ground stations GS and a plurality of space stations SS. These are interconnected by conventional telecommunications links, such as cable, satellite or microwave links.

The purpose of the PDS 800 is to simultaneously transmit multi-channel video, voice and data (VAD) information at various degrees of compression through existing terrestrial and satellite transponders, including existing cable and television plants. Is to transmit. The PDS 800 is compatible with existing C and Ku band satellite transmission technologies.

FIG. 2 shows, as an example, three ground stations GS1 to GS.
3 is shown in detail. AC, VC and DC indicate an audio channel, a video channel and a data channel, respectively. Each station receives a combination of VAD channels,
It has the ability to be processed and compressed to the desired degree.

FIG. 3 shows the structure of the audio channels AC1 to AC3. Each channel receives one or more audio signals, A1-A4, coming from an independent signal source.
FIG. 4 shows a data channel DC1 which receives four incoming data signals D1 to D4.

FIG. 5 shows three incoming video signals V1.
~ Shows a video channel VC1 receiving V3. 6 and 7 show the ground station GS1 in greater detail and show the interdependence of the VAD channels VC1 -VC2, AC1 -ACP, DC1 -DCQ. These figures show that the VAD signal is compressed by selective allocation of video harmonic frequencies, and
FIG. 3 illustrates an important aspect of the present invention in which voice and data channels are modulated at video frequencies and processed as if they were video channels. The bandwidth of the video channels allows high quality compression of a significant number of voice and data channels. FIG. 6 illustrates a central video switching exchange (CV) for compression, modulation and multiplexing of VAD signals as shown in the marker channel (FIG. 7).
SE) 989 is shown.

Processing the Video Signal The video channel VC1 (FIG. 5) contains, by way of example, three incoming RGB type video signals V1 to V3. In this specification, a voice signal and a data signal are modulated to generate R, G, B.
Although described as riding on the video frequency, other frequencies in the video range can be used. Each signal V1 -V3 is a local video switching exchange (L) for applying the desired degree of compression to the incoming video signals and multiplexing these signals into a single video channel VC1.
VSE) 802. Incoming video signal V1
~ V3 is expressed as follows.

V1 = V1R + V1G + V1B (1) V2 = V2R + V2G + V2B (2) V3 = V3R + V3G + V3B (3) V1R, V1G, V1B, V2R, V2G, V2B, V3R, V3R, V3R, V3V, V3G, and V3G, V3G, and V3G and V3G and V3G,

FIG. 5 shows a video Fourier transformer (VFT).
803, 804 and 805, video frequency selectors (VFS) 807, 808 and 809 and video multiplexers (VMUX) 810, 811 and 81.
LVSE1, LVSE for processing video signals via 2
2 and LVSE3 are shown. Each RGB component is passed through VFT, and Fourier harmonics are derived as follows.

X (t) = a0 + (an.cos (nw0t) + bn.sin (nw0t)) (4) x (t) is a video signal function, for example, V1R, V1G, V1R. And a = (1 / T) .x (t) .dt (5) an = (2 / T) .x (t) .cos (nw0t) .dt (6) bn = (2 / T) .x (T) .sin (nw0 t) .dt (7) For simplification, a0 is not considered. However, this factor will be considered by those skilled in the art.

V1R = VR1 [φR1] + VR2 [φR2] + VR3 [φR3] + VR4 [φR4] + VR5 [φR5] + .. (8) V1G = VG1 [φG1] + VG2 [φG2] + VG3 [φG3 ] + VG4 [φG4] + VG5 [φG5] + .. (9) V1B = VB1 [φB1] + VB2 [φB2] + VB3 [φB3] + VB4 [φB4] + VB5 [φB5] + .. (10) [ φ] represents the sine angle component of the Fourier sine harmonic signal,
V [φ] represents a Fourier transform component.

The present invention accommodates different degrees of video signal compression by selecting only those of the Fourier components for which it is desirable to reproduce the original signal later. The selection method can be pre-programmed, as described in detail below, or it can be automatic.

Video channel VC1 is shown as consisting of three video bands (V1, V2, V3) with two marker channels MC1 and MC2 (FIG. 7). Each video band includes several sub-bands (ie, 901-912) that correspond to a particular video frequency (ie, R-901, G-902 or B-903). For purposes of illustration only, selecting the first and second transform components {VR1 [φR1], VR2 [φR2]} of the component signal V1R for processing by the Fourier selector 807 (sub-band 901) yields equation (8) It looks like this:

V1R = VR1 [φR1] + VR2 [φR2] (11) The sub-band 903 of the marker channel MC2 indicates that only the first conversion component VG1 [φG1] of the signal V1G is selected, and therefore the expression ( 9) is as follows.

V1G = VG1 [φG1] (12) In the marker channel MC2, the first, second and third conversion components {VB1 [φB1], VB2 [φB2] and VB3 [φB3]} of V1B are selected ( Sub-band 903), and thus equation (10), becomes:

V1B = VB1 [φB1] + VB2 [φB2] + VB3 [φB3] (13) By substituting equation (11), equation (12), and equation (13) into equation (1), V1 is as follows. become. V1T = VR1 [φR1] + VR2 [φR2] + VB1 [φB1] + VB2 [φB2] + VB3 [φB3] + VG1 [φG1] (14) Therefore, V1 is selectively compressed. V1T is the converted V1 signal after the selection of harmonic conversion components is complete.

V2 and V3 are treated the same as V1,
It is expressed as follows. V2T = VR1 [φR1] + VR2 [φR2] + VG1 [φG1] + VG2 [φG2] + VR3 [φR3] + VB1 [φB1] (15) V3T = VR1 [φR1] + VG1 [φG1] + VG2 [φG2] + VG3 [φG3] VB1 [φB1] + VB2 [φB2] + (16) The signal is selected by the selector (807, 808, 80 in FIG. 5).
9). The V1T, V2T, and V3T are multiplexed by the multiplexer 810.

VT1 = V1T + V2T + V3T (17) VT2 and VT3 are similarly derived. VC1 = VT1 + VT2 + VT3 (18) Channel VC1 can accept a larger number of signals.

FIG. 11 shows six exemplary VAD marker channels MC1 to MC6 (FIG. 7), subband 901.
~ 906 are further described. These simplify the description of various compression schemes and help design and maintain the PDS. Each sub-band contains 5 consecutive intervals shown as boxes.

Each interval indicates the order of harmonics. For example, it is desirable to process the first five harmonics. The sub-bands may be programmed independently or the programming may be continuously monitored and updated.

12 and 13 show sub-bands 901,
A compression scheme for continuously multiplexing the signals in 902 and 903 is shown. For example, the allocation of harmonic frequencies is as follows. V1R: first and second harmonic of R frequency V1G: third harmonic of R frequency V1B: fourth and fifth harmonic of R frequency and first harmonic of G frequency where: Unaccompanied harmonic frequencies and sub-bands can be assigned to video / non-video signals. The amplitude of the signal can be changed at the transmitter or the receiver. The signal should be coded so that it can be decoded by the receiver.

Automatic selection of harmonic frequencies. 8, 9 and 10 show two alternative compression methods. FIG. 8 represents the “horizontal compression technique”. The routine 950 sets the integer count value n to 0 (952). n is the number of Fourier harmonics. That is, if n = 1, the routine 95
0 selects the first Fourier component V1 [φ1] and reaches a predetermined component VA [φA], or if the amplitude component DVn is a predetermined value x, that is, zero or less,
Continue to select, store, and add subsequent ingredients.

Absolute value of DVn = (Vn−Vn + 1) (19) Therefore, each signal Vn [φn] is transferred to the next signal Vn + 1 [φ
n + 1] for the template. However, other signals than the next one may be compared. Ie D
Vn = Vn-Vn + 3. The compression techniques described herein can be used with analog or digital signals.

The subroutine begins by incrementing n to (n + 1) (953). The subroutine is
It is determined 954 whether n has reached or exceeded the preselected value A. If not, the subroutine determines whether DVn is less than or equal to x (955). If it is greater than x, the nth harmonic component Vn [φn] is selected and stored (957), and the subroutine Increases n by 1 (953).

The subroutine is step 9 if n <A.
55 is repeated, and if DVn is less than or equal to x, a flag is set (959) and a signal V is formed (960). If n reaches A, the subroutine sums all selected and stored harmonic components to form signal V.

FIG. 9 shows the "vertical compression technique" routine 10.
Indicates 00. This routine executes a predetermined component VA [φA]
Or until the amplitude component dVn reaches a predetermined value y
If it is (ie, zero) or less, continue to select, store, and add Fourier components. dVn is the absolute value of the derivative of Vn in angle or time, that is, the nth component and (n-
1) The difference with the 1st component.

The subroutine begins by incrementing n to (n + 1) (1003). The subroutine is
It is determined whether n has reached A or has exceeded A (1004). If not, the subroutine determines whether dVn is less than or equal to y (100
5). If y or less, Vn [φn] is selected and stored (1007), and n is incremented by 1 (1003).

If the subroutine determines that dVn is less than or equal to y, it sets a flag and forms V (96).
0). If n reaches A, the subroutine sums all selected harmonic components to form signal V.

The flowchart of FIG. 10 shows a routine 1010 that combines the vertical compression technique with the horizontal compression technique described above. This routine continues to select and store successive Fourier components as long as DVn> x or dVn> y (1017). n> = A, that is, DVn <x and d
If Vn <y, the subroutine returns all stored V
sum n.

Processing Non-Video Signals FIG. 2 shows a station GS1 which accepts several audio channels AC1 to ACP. FIG. 3 shows the audio channels AC1, A
C2 and AC3 are shown. Each audio channel has a compressor 9
Digitized by 75 and multiplexer 976,
It receives four audio signals A1 to A4 which are compressed and multiplexed. Audio channel AC1 is transmitted to CVSE 989 (FIG. 6), where the signal is selectively modulated by audio-video modulator 991 to a specific video frequency, R.
It is carried on the BG frequency. The modulated signal is sent to a Fourier transformer 990 to calculate the Fourier transform harmonics of the video modulated signal. The Fourier transform harmonics are multiplexed with the original incoming video signal by multiplexer 999 (FIG. 7).

FIG. 7 shows two marker channels MC3 and MC4 which are examples of marker channels for channels AC1 and ACP. CVSE 989 determines which video harmonic frequencies are unassigned and modulates the audio signal to ride on such frequencies. MC3 is CV
SE989 sets the harmonic component VR3 [φR3] to the sub-band 901.
Is assigned to. The component VG2 [φG2] is assigned to the sub-band 902. There is no intent to limit the marker channel architecture to RGB frequencies,
Other reference video frequencies may alternatively be selected.

The selection of sub-bands and their assignment to voice and data channels may be done automatically by defining the hierarchical order of each voice-data channel. It is possible to form various combinations of VAD signals by changing the allocation combination of the harmonic components.

The data channels DC1 to DCQ are similarly modulated and added to the video frequency, multiplexed as the video signal V10 (FIG. 6), and transmitted to the station GS4. In anticipation of contention for sub-band allocation, CVS
E989 "slides" the signal and then reassigns it to another subband. This feature is "sub-band re-allocation". The "sub-band contention prevention" feature assigns a predetermined priority to the signals to be reallocated. For example, the data signal may take precedence over the voice signal that is subject to reallocation.

Subroutine 975 allocates video harmonic components to audio and data signals (FIG. 8) and prepares for modulation (964, 972). VAD Mapping System FIG. 14 is a block diagram illustrating a VAD mapping system 1030. This system uses the incoming signal
It contains several memory registers 1032 for storing in a self-spaced matrix format for a given time. Selectively processes, retrieves, and stores signals stored in the memory register 1032.
To enable reconfiguration, memory register 10
32 is coupled to logic module 1035 via a bus that includes address bus 1037.

The logic module 1035 includes a number of logic ports and includes at least one memory register 10.
38. Signal processing in logic module 1035 is performed by the compression method described herein. The processed signals are stored in RAMs 1039 and 1040.
And is transmitted to the end user.

The VAD signal is separated into separate video channels and then separated again into different video bands. Such a video band is divided into video sub-bands containing harmonic components.

FIG. 15 shows a data encoding / decoding scheme 1025 for MC2 to MC6 (FIG. 7). For example, MC3
Is a marker channel of the audio channel AC1 and is "1".
Is inserted in the third box (register) of the sub-band 901, and indicates that the audio signal is modulated and placed on the third Fourier harmonic (R) frequency. As a result, when the VAD signal is reconstructed, the scheme 1025 can be used to select only the required harmonic frequencies.

The VAD marker channel 1027 combines the marker channel information of FIG. 7 to visually show the allocation in the sub-bands. FIG. 15 is a table of the VAD mapping system 1030, where the sub-band 901 is VA.
It is composed of D signals, and indicates that frequency allocation is clarified.

Medical, Imaging, and Other Applications The present invention has several applications in the field of imaging, particularly in medical ultrasound technology, as shown, for example, in US Pat. No. 4,612,937. The present invention allows greater control over the penetration and resolution of ultrasonic signals by controlling the harmonic frequencies of the ultrasonic signals. Furthermore, it is also possible to create a three-dimensional image of the diagnosis site and a reproducible video image thereof.

Two or more signals S1 and S2 of different frequencies
Is reflected and measured. Compare the Doppler shifts that have occurred. For example, S1 has a frequency F1 that is lower than the frequency F2 of S2, and S1 is used to control the resolution, while
S2 is used to control permeation.

The multiplexing of S1 and S2 allows pulsing two signals at the same time or within a predetermined delay period and allows for intermittent delay periods between two consecutive signals of the same frequency. , Preparing for the processing of the reflected signal are alternately performed.

Simultaneously transmit S1 and S2 to the body part to be imaged. Compare the Doppler shifts of S1 and S2 and weight each according to the following equation. SRW = SRR + SRP (20) SRR = a * S1r-b * S2r (21) SRP = p * S1r-q * S2r (22) SRW is the obtained weighted Doppler shift. SRR
Is the Doppler shift obtained by weighting the resolution. SRP is a Doppler shift obtained by weighting the degree of penetration.

Therefore, if SRW is within the tolerance range (or zero), then S1r and S2r are available. If SRW is outside the tolerance range, the coefficients a, b,
Adjustments must be made to p and q, the next step is SRR
Or determining whether the SRP differs from a predetermined tolerance value, and varying the corresponding weighting factors so that the Doppler shift SRR or SRP falls within the pre-assigned range of the corresponding tolerance value. This comparison test is performed periodically on a line-by-line or sector-scan basis.

It is desirable to use RF video frequencies. For example, three video signals, that is, frequencies of RGB are used. The signal combines with other signals at frequencies that are integer multiples of the frequency of the original signal. For example, SR (R frequency) is combined into two signals having frequencies 2R and R / 2, respectively. In this way, these three video signals can be processed as harmonic frequencies and combined to form a single signal. This process is called an inverse Fourier transform. These three signals are processed to better control penetration and resolution, as described above for ultrasound signals. The G signal and the B signal are processed in the same manner as the R signal.
Then, the reflected R, G, and B signals are processed to form an image.

In some cases, it is desirable to control the amplitude of the harmonic signal to increase or decrease it to the desired value. In other cases, the video signal may be processed with voice, data, infrared, ultrasound or other signals in accordance with the teachings above.

The present invention is also applicable to various recording and storage media utilizing the compression and multiplexing methods described above, such as optical discs, floppy discs, compact discs and cassettes of different sizes. Basically, an audio signal and / or a data signal are modulated, placed on a video frequency, modulated and stored as a video signal. The video signal can be emitted by a television monitor screen, an ultrasonic scanner, a scanner, a printer, a facsimile machine or other device capable of raster scanning.

The present invention is a sender-coded VAD.
Used for VAD mail applications where messages are left in the recorder (VCR). When a VAD message is retrieved,
They are separated, demodulated and decrypted according to the above teachings.

Although the compression technique above has been described with respect to the Fourier transform, other transforms may be used.

[0059]

The present invention can provide digital compression and multiplexing programs for use in multimedia systems.

[Brief description of drawings]

FIG. 1 is a block diagram showing a VAD system.

FIG. 2 is a block diagram showing a VAD system.

FIG. 3 is a block diagram showing a VAD system.

FIG. 4 is a block diagram showing a VAD system.

FIG. 5 is a block diagram showing a VAD system.

FIG. 6 is a block diagram showing a VAD system.

FIG. 7 is a diagram showing marker channels in a VAD system.

FIG. 8 shows a flow chart used in the VAD system.

FIG. 9 shows a flow chart used in the VAD system.

FIG. 10 is a diagram showing a flowchart used in the VAD system.

FIG. 11 is a diagram showing marker channels in a VAD system.

FIG. 12 is a diagram showing marker channels in a VAD system.

FIG. 13 is a diagram showing marker channels in a VAD system.

FIG. 14 is a block diagram showing a VAD system.

FIG. 15 is a diagram showing marker channels in a VAD system.

[Explanation of symbols]

800 ... Program Delivery System, 803, 80
4,805 ... Fourier transformer, 807,808,809
... frequency selectors, 810, 811, 812 ... multiplexers.

Claims (7)

[Claims] 1. A conversion means for receiving a video signal and emitting a conversion component therefrom, a selector means connected to the conversion means for selecting a desired conversion component for further processing. A system capable of compressing video signals and non-video signals, characterized by including multiplexer means for multiplexing only the converted components. 2. The transforming means includes Fourier transformer means for emitting a sine transform component corresponding to the video signal, the selector means selecting the most desirable Fourier transform component, and the multiplexer means being selected. The system of claim 1, wherein only the Fourier transform components are multiplexed. 3. A modulator means for modulating a non-video signal to ride on a selected video frequency, and a video converting means for receiving the video modulated signal and emitting a video conversion component therefrom, most preferred. 3. The system according to claim 1, further comprising video selector means for selecting a video conversion component, and multiplexer means for multiplexing only the selected conversion component. 4. A video signal compression method comprising the steps of emitting transform components from a signal, selecting desired transform components for further processing, and multiplexing only the selected transform components. 5. A non-video signal compression method comprising the steps of emitting transform components from a signal, selecting desired transform components for further processing, and multiplexing only the selected transform components. 6. Further comprising optical scanner means for scanning documents, graphics and similar text and characters to produce raster scan signals, said raster scan signals producing corresponding Fourier transform harmonics. 4. A system according to any of claims 1, 2, 3 which is passed through a Fourier transformer means. 7. A modulator means for modulating a non-video signal to ride on a selected video frequency, and a video converting means for receiving the video modulated signal and emitting a video conversion component therefrom, most preferred. A system capable of compressing a non-video signal, comprising video selector means for selecting a video conversion component, and multiplexer means for multiplexing only the selected conversion component.