JPH0276078A - Moving image transmission system - Google Patents

Abstract

PURPOSE:To synthesize images with high resolution and with fineness and beauty by obtaining a moving image with second resolution by increasing resolution by applying interpolation on the moving image sent with first resolution, and synthesizing it with an image with the second resolution prepared in advance. CONSTITUTION:A switch 225 switches a decoded image supplied from an interpolation circuit 21 via a line (h) and the image of sample pattern supplied from a sample pattern storage part 224 via a line (k) by a signal supplied from a selector 10 via a line (b) based on information supplied from a contour extraction part 223 via a line (j), and selects a designated image on one side, and supplies it to the encoding part of an encoder/decoder device 20 via a line (i). The encoder/decoder device 20 encodes and compresses a synthesized image at the encoding part, and supplies it to an encoder/decoder device 13 via a transmission path (d). The encoder/decoder device 13 decodes a supplied image, and displays it on a TV monitor 12 via a line (f). In such a way, it is possible to realize the transmission of the image in which the synthesis of the images with different resolution is attained and the resolution is improved.

Description

[Detailed description of the invention] [Industrial application field] The present invention relates to a moving image transmission system.

[Conventional technology]

Conventionally, this type of moving image transmission system has typically transmitted using a fixed resolution without changing the resolution during either transmission or reception.

[Problem to be solved by the invention]

The above-mentioned conventional video transmission system uses a resolution that is not necessarily as high as that of a normal television signal, both during transmission and reception, and therefore has the problem of not being able to synthesize high-resolution, fine-grained, beautiful images. Nine.

[Means to solve the problem]

The moving image transmission system of the present invention uses interpolation to reduce the resolution of a moving image sent at a first resolution to obtain a moving image at a second resolution, and obtains a moving image sent at the first resolution. Any one of the sample patterns included in a plurality of menu images having the second resolution prepared in advance using information representing the contour extracted from the second resolution and the moving image of the second resolution. The system generates a composite image having the above-mentioned first resolution and sends it to the source of the moving image sent at the first resolution.

[Effect]

In the present invention, a moving image sent at a first resolution is increased in resolution by interpolation, and a moving image at a second resolution is obtained.
The image is combined with an image having a second resolution prepared in advance.

〔Example〕

Hereinafter, embodiments of the present invention will be described in detail based on the drawings.

FIG. 1 is a block diagram showing one embodiment of the present invention.

In the figure, 1 indicates a terminal, and 2 indicates a central processing center.

In the terminal 1, 10 is a selector, 11 is a camera, 12 is a television monitor, and 13 is an encoding/decoding device.

20 in the central processing center 2 is an encoding/decoding device;
21 is an interpolation circuit, and 22 is a screen synthesis circuit.

Note that a and b indicate lines, c and d indicate transmission lines, and e.

f, g, h, l indicate lines.

Then, the resolution of the moving image sent at the first resolution is increased by interpolation to obtain a moving image at a second resolution, and information representing the contour extracted from the moving image sent at the first resolution is obtained. A composite image with the second resolution is generated from an arbitrary one of the sample buttons included in a plurality of menu images with the second resolution prepared in advance and a video image with the second resolution using It is configured to send the video image sent at the same resolution to the source.

Furthermore, when transmitting an image, the transmitting side encodes and compresses a moving image having a first resolution and transmits it, and the image obtained by decoding is used to create a composite image. .

Furthermore, when composing images, the sample button is deformed in accordance with the deformation of the outline extracted from the sent moving image, and then the sample button is combined.

Next, the operation of the embodiment shown in FIG. 1 will be explained.

First, a moving image taken by the camera 11 is supplied to the encoding section of the encoding/decoding device 13 via the line e.

Then, this encoding/decoding device 13 encodes and compresses the sent mourning image, for example, an image with a resolution similar to that of a normal TV signal, and sends it to the decoding section of the encoding/decoding device 20 via the transmission path C. supply

Next, the encoder/decoder 20 decodes the next encoded image that is sent and supplies it to the interpolation circuit 21 via the line g. In this interpolation circuit 21, the received normal TV
The number of samples and the number of lines, that is, the pixel density, of an image having a first resolution similar to that of a signal are increased by interpolation, the resolution is increased, and the image is supplied as a second resolution image to the screen synthesis circuit 22 via a line. do. Here, the method of the interpolation circuit 21 is not particularly limited, and any method may be used, such as -interpolation or high-order interpolation.

FIG. 2 shows details of the screen composition circuit 22.

In FIG. 2 showing an embodiment of the screen composition circuit 22 in FIG. 1, the same reference numerals as in FIG.
23 is a contour extraction section, 224 is a sample slam storage section, 2
25 is a switch. Note that a line is shown at 1j+.

The sample button storage unit 224 stores a large number of menu images of the second resolution prepared in advance. That is, there are groups of multiple types of menu images, and each group includes a large number of sample buttons that are slightly different from each other. As a storage function in the sample button storage section 224, a large-capacity magnetic disk or memory can be used. A signal specifying which group of sample buttons of this menu image is to be used to synthesize the sent moving image is inputted from the selector 10 and sent to the sample button storage unit 224 and the switcher via a wire. 225.

In the sample button storage unit 224, one group of the menu images determined to be the composite part is selected by this signal, and the sample button storage unit 224 selects one group of the menu images determined to be the composite part, and selects one group in that group by the signal inputted from the selector 10 and supplied via the line a. One sample slam image is selected.

Then, the switch 225 selects the good signal supplied from the selector 10 via the line k, and selects the decoded image supplied via the line from the interpolation circuit 21 and the sample pattern storage unit 224 via the line k. The supplied sample pattern images are switched based on the information supplied from the contour extraction unit 223 via line j, one of the specified images is selected, and the image is encoded and decoded via line j. The data is supplied to the encoding unit of the encoding device 20.

The contour extraction section 223 extracts the Y signal from the input composite color signal and differentiates this Y signal vertically and horizontally to obtain K-multiple contour information.

Next, transmission of the combined image to the transmission source will be explained.

In the encoding/decoding apparatus 20 shown in FIG. 1, this combined image is encoded and compressed in the encoding section, and is supplied to the decoding section of the encoding/decoding apparatus 13 via the transmission path d. The decoding unit of this encoding/decoding device 13 decodes the supplied image and displays it on the TV monitor 12 via the line f.

Next, a modification of the embodiment according to the present invention will be described.

During screen synthesis in the above embodiment, the signal from the contour extraction unit 223, that is, the contour information, usually includes deformation information that accompanies movement. The sample batons stored in the baton storage section 224 are deformed when they are synthesized and used.

FIG. 3 shows an example of the screen synthesis circuit at this time, that is, the screen synthesis circuit 22 having a screen transformation function.

In FIG. 3 showing another embodiment of the screen synthesis circuit 22 in FIG. 1, the same reference numerals as in FIG. 2 indicate corresponding parts, and 226 is a modified circuit. In addition, L, m,! 1 indicates a line.

The signal from the contour extraction unit 223 is sent to the deformation circuit 226 via the line t.
supply to. Using the deformation information from the contour extracting section 223, the image supplied via the horizontal line m to the sample slam storage section 224 is transformed and supplied to the switching device 225 via mn.

A specific method of deformation will be explained using the case of a human face as an example.

When assuming a face-to-face conversation, since most human faces are usually erect, this case will be explained.

Normalize both the sample slam image and the input video image,
Vertical and horizontal as shown in Figures 4 and 5.

Place a diagonal reference line (45 degrees with respect to the vertical and horizontal lines).

4, 5, and 6 are diagrams used to explain the operation of FIG. 3. FIG. 4 shows a reference line diagram of an input moving image when image is deformed using contour information, and FIG. A sample batan drawing (reference line diagram at 1' is shown) during image deformation.

The number of reference lines is not limited to eight; the more the reference lines are, the more precise the deformation becomes possible (the more the diagonal lines are divided into equal angular intervals, rather than just 45 angles).

Here, as an example, a case of eight reference lines will be described.

Place the center of the reference line at the midpoint of the vertical and horizontal lengths of both the sample slam image and the input video image. Then, the distance y from this center to the intersection A between the outline of the sample slam image and the reference line xl, and the distance y' from the center to the intersection A' between the outline of the input video image and the reference line x1' The ratio of the distance from the center to the intersection point in the input video image to the distance from the center to the intersection point in the sample slam image (y: y' = 1
: Find y'/y).

Similarly, scale ratios for all reference lines are obtained, and based on this, the sample batten image is reduced or enlarged in the direction of the reference line, and the sample batten image is transformed into the same shape as the input moving image. As a result, a composite image with added deformation as shown in FIG. 6, which is a diagram of a sample slam image after image deformation using contour information, is obtained. At this time, when reproducing a smooth contour, the method of scaling or enlarging the part that deviates from the reference line is, for example, dividing the difference in scale ratio between adjacent reference lines into equal intervals in stages. Hit the sheet.

〔Effect of the invention〕

As explained above, the present invention increases the resolution of a moving image sent at a first resolution by interpolation, obtains a moving image at a second resolution, and combines it with a previously prepared image at the second resolution. be able to. In other words, there is an effect that images of different resolutions can be combined and transmitted with improved resolution.

For example, in image processing services, even if the resolution of the input image is low, it is important to send back a finely processed image with a higher resolution than the original image, including composite images, in order to reduce the cost of the entire system. However, as mentioned above, if this invention is put into practical use, its effects will be extremely large.

[Brief explanation of the drawing]

FIG. 1 is a block diagram showing an embodiment of the present invention, FIG. 2 is a block diagram showing an embodiment of the screen synthesis circuit in FIG. 1, and FIG. 3 is a block diagram showing an embodiment of the screen synthesis circuit in FIG. 1. FIG. 4 is a block diagram showing an embodiment. 5 and 6 are diagrams for explaining the operation of FIG. 3. FIG. 1...Terminal, 2...Central processing center, 10...
...Selector, 11...Camera, 12...TV monitor, 13.20...Encoding/decoding device, 21...
...Interpolation circuit, 22...Screen synthesis circuit, 223...
. . . Contour extraction section, 224 . . . Sample slam storage section, 225 . . . Switcher, 226 .

Claims (1)

[Claims] The resolution of the moving image sent at the first resolution is increased by interpolation to obtain a moving image at a second resolution, and the information representing the contour extracted from the moving image sent at the first resolution is used. generating a composite image having the second resolution from any one of sample patterns included in a plurality of menu images having the second resolution prepared in advance and a moving image having the second resolution; A moving image transmission system characterized in that moving images sent at a resolution of 1 are sent to a source.