JPH0779440A - Transmitter and receiver for digital picture signal - Google Patents

Abstract

PURPOSE:To obtain a transmitter capable of reproducing a motion picture with smooth motion and high picture quality at a receiver side even in the case of a transmission medium at a low transmission rate. CONSTITUTION:Background plane information comprising a still picture of a background picture forming a pattern and one to plural sets of motion plane information comprising each still picture of a mobile object on the background are generated. The generated background plane information and each mobile object plane information are respectively stored individually in memories 23BG, 23Al-23An. A difference between a current frame of mobile plane of a digital picture signal and mobile object plane information in the memories 23Al-23An is obtained to detect change information with respect to the still picture stored as the mobile object plane information. Still picture information of plural sets of plane information and change information in the memories 23BG, 23Al-23An are sent.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital image signal transmitting apparatus and its receiving apparatus capable of transmitting at a low bit rate.

[0002]

2. Description of the Related Art Digital image data of a moving image contains a very large amount of information, and if it is transmitted as it is, the transmission bit rate becomes very high.
For this reason, when recording and reproducing digital image data using a magnetic tape or a magneto-optical disk, when transmitting using a low-rate transmission medium whose transmission bit rate is limited, conventionally, Generally, data is compressed by utilizing the fact that an image is spatiotemporal information.

For example, a difference between frames of digital image data is taken, and the difference is compressed by DCT (discrete cosine transform (discrete cosine transform)). This is conventionally done. Furthermore, in video conferencing, etc., in consideration of the fact that the image does not move much, it is necessary to thin out the amount of information, such as transmitting only one-field data instead of transmitting a full frame. And so on.

The number of fields to be transmitted is reduced rather than one field, but the time information is sacrificed and the spatial information is secured, so that the image is beautiful, but the motion may be jerky.

However, if the motion is jerky in this way, the goodness of the moving image is impaired. Therefore, the image data per frame is compressed as much as possible to transmit the full frame, but the spatial resolution is sacrificed. A method of enabling full-motion playback as a video is also being considered.

[0006]

As described above, the conventional digital image signal transmission method is devised to reduce the transmission rate by compressing image data in the time direction or the space direction.

However, when the transmission bit rate is reduced only by data compression, for example, when compressed in the time direction, the motion of the moving image becomes jerky and becomes an unnatural image. Further, when compressed in the spatial direction, the spatial resolution is deteriorated to that extent, so that the reproduced image is deteriorated.

That is, in the conventional method, since the bit rate is reduced only by the data compression, one or both of the data in the time direction and the data in the space direction is sacrificed, and the reproduced image is satisfactory. It was hard to get anything.

In view of the above points, it is an object of the present invention to provide a digital image signal transmitting apparatus and a receiving apparatus thereof, which are devised so that a reproduced image as beautiful as possible can be obtained and at the same time, the movement can be smooth. I am trying.

[0010]

In order to solve the above-mentioned problems, the digital image signal transmission apparatus according to the present invention has a background plane representing still image information of a digital image signal when corresponding reference numerals in the embodiments described later are made to correspond. Plane information generating means 22 for generating information and at least one moving object plane information representing the moving image information of the digital image signal.
And memory means 23BG, 23A1 to individually store the background plane information and the moving body plane information.
23An, change information detecting means 300 for detecting moving body plane change information which is a difference between moving body plane information of the current frame of the digital image signal and moving body plane information stored in the memory means, and the memory. The above-mentioned background plane information and moving object plane information of the means and transmitting means for transmitting the moving object plane change information are provided.

[0011]

According to the present invention having the above-mentioned structure, for example, when considering one scene composed of specific image contents,
The image of the scene can be considered to be composed of a background image which is considered to be a fixed still image and one to a plurality of moving objects each having a different motion.

That is, in the present invention, one
A two-dimensional image of a frame is regarded as an overlap of a two-dimensional plane composed of a background and still images of a plurality of moving objects. Then, with respect to the moving object, change information such as the moving direction of the moving object, the moving distance, and the shape change of the object is extracted. Then, as the moving image data, the background image plane and the moving object plane are transmitted, and the change information about the moving object plane is transmitted.

On the receiving side, the moving image is reproduced by superimposing the moving object of the moving object plane on the background image of the background plane according to the change information.

In this case, each of the background plane and the motion plane of the moving object is one still picture, and it is sufficient to transmit the information of this still picture at the very beginning of one scene. For one scene consisting of several seconds or more,
Since it is sufficient to transmit one still image each,
A large amount of data can be transmitted even at a low transmission rate. Therefore, the image quality is high. Since the change information may be several bits at most, it is possible to transmit the change information in real time with a margin even during the remaining time of transmitting the still image information in one scene.

[0015]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Several embodiments of a digital image signal transmitting apparatus and a digital image signal receiving apparatus according to the present invention will be described below with reference to the drawings, taking a case of an apparatus for recording and reproducing a digital image signal on a magneto-optical disk as an example. While explaining.

FIG. 1 shows a disk drive system and a block diagram of the apparatus of the first embodiment. The apparatus of this example is a system for controlling the video camera unit 1, a recording signal system 2 and the whole. It is composed of a controller 3 and a disk drive system 10, and an image pickup output signal of the video camera unit 1 is recorded via a recording signal system 2.

In the disk drive system 10, 11 is a magneto-optical disk. The magneto-optical disk 11 is housed in a cartridge 11A. Further, on the disk 11, a pregroove for tracking control is formed in advance, and in the case of this example, absolute address data is recorded on the pregroove by superimposing on a wobbling signal for tracking. . This absolute address data is used for recording track position control at the time of this recording, and for reproduction scanning track position control at the time of reproduction described later.

The disk 11 is rotated by a spindle motor 12. The rotation of the spindle motor 12 is controlled by the servo control circuit 15, and the disk 11 is controlled so as to rotate at a constant linear velocity, for example.

The disk 11 is provided with a shutter, and when the disk 11 is placed on the disk mounting tray and loaded in the apparatus, the shutter is opened. A magnetic head 13 for recording is arranged facing the upper part of the shutter opening of the disk 11, and an optical pickup 14 is arranged facing the lower part of the shutter opening of the disk 11.

The optical pickup 14 has a light emitting portion and a light receiving portion, and movement of the optical pickup 14 in the radial direction of the disk 11 is controlled by a feed motor 16. Further, the servo control circuit 15 controls focus and tracking of the optical pickup 14.

The system controller 3 is constructed by mounting a microcomputer and manages the entire operation. This system controller 3 has a key group 4
Gives a key input signal. The key group 4 includes an imaging / recording standby key, an imaging / recording start key, a playback key,
A stop key etc. are included.

The image pickup signal from the camera unit 1 is A
The signal is supplied to the / D converter 21, and for example, one pixel sample is converted into a digital image signal represented by 8 bits and then supplied to the signal processing circuit 22. In this signal processing circuit 22, the image of the scene captured by the camera unit 1 is divided into a plurality of background planes each including a stationary static background still image and a still image indicating each moving object moving on the background. Separate into individual animal planes.

When the picked-up image is a two-dimensional image 30 as shown in FIG. 2, for example, a fixed still image made of a stationary structure is extracted as the background plane 31 as shown in the figure. In the example of FIG. 2, an airplane, a monkey, and a car are recognized as moving objects, and they are separated as moving object planes 32, 33, and 34, respectively.

The signal processing circuit 22 writes the separated background plane in the background plane memory 23BG. Moreover, the separated n animal body planes are respectively written in the animal body plane memories 23A1 to 23An (n is a natural number). A specific example for separating the background plane and the moving object plane will be described later.

As described above, the plane memory 23 is separated into the background plane and the plurality of moving object planes.
In this example, the image information of each still image written in the BG and 23A1 to 23An is stored in advance in the disk 11 at the preparation stage before the image recording is actually started by the video camera.
Recorded in. That is, normally, at the time of starting the image recording, the standby mode is set prior to the start of the image recording, and the video camera unit 1 is set in the operating state, and the composition for image capturing by the viewfinder is determined. In this example, using this time,
A background plane and a moving object plane are separately generated, recorded, and transmitted.

That is, as shown in FIG. 3, in this example, one scene is recorded during the preparation period and the actual image-capturing recording period. Then, in the preparation period, the above-described plane separation processing and the recording processing of the separated plane information are performed.

In this case, each plane information is, for example, as shown in FIG.
As shown in FIG. 4, if the data of one pixel is composed of the luminance signal Y (8 bits) and the color information U, V (8 bits), the still image information of each plane is , Each having an information amount of about 5.6 Mbits. Although it is possible to record the data on the disc 11 without compressing it as it is, if the recording rate of the data on the disc is 1.2 Mbps, for example, it is possible to record in about 5 seconds per plane, and with four planes. It takes 20 seconds.

Therefore, in this example, the image information written in each plane memory 23BG and 23A1-23An is supplied to the compression circuit 24, and each plane information is appropriately compressed and supplied to the recording processing circuit 25. To be done. In the recording processing circuit 25, data processing conforming to the recording format of the disk 11 is performed, for example, the data has a sector structure. The output data of the recording processing circuit 25 is sequentially supplied to the recording magnetic head 13 via the head drive circuit 27 and is magneto-optically recorded on the disk 11 by the magnetic field modulation overwrite method.

In the compression circuit 24, the data compression rate is 1/1
If it is 0, the above-mentioned four pieces of plane information can be recorded with a preparation time of 2 seconds. In the case of transmitting a full frame of moving image data having the same information amount at 1.2 Mbps, the data compression rate is 1/100 or more. Therefore, compared with this, the deterioration of the image quality of the plane information is very small.

Then, in this example, in the image capturing / recording period after the actual image capturing / recording start key is operated in the video camera unit 1, the motion direction and the motion amount of the moving object registered in each moving object plane and A process of generating motion change information such as rotation and shape change and recording the generated motion change information on the disk 11 in real time is performed.

Therefore, the motion change information detection circuit 300 uses the information of the separated background plane and n moving object planes in the image recording mode to detect the movement of each moving object plane from the input digital image signal. Obtain information about movement change of an object. Then, this motion change information is supplied to the compression encoding circuit 26, compression encoding is performed at an appropriate compression rate, and the head drive circuit 2 is executed via the recording processing circuit 25.
Supply to 7. In this case, the recorded motion change information is
As will be described later, the number of bits is very small, 1.2 Mb
Even at a low transmission rate of ps, it is possible to transmit more than enough in real time. A specific example of the method of detecting the motion change information will be described later.

Data is recorded on the magneto-optical disk 11 as follows. That is, the head drive circuit 2
By being supplied to the recording magnetic head 13 via 7, the magnetic field modulated by the recording data is applied at a predetermined position of the disk 11. Further, the laser beam from the optical pickup 14 is applied to the same position on the disk 11. At the time of this recording, the recording track is irradiated with laser light having a constant power larger than that at the time of reproduction. Data is recorded on the disk 11 by thermomagnetic recording by this light irradiation and the modulation magnetic field by the magnetic head 13.
The magnetic head 13 and the optical pickup 14 are both configured to be able to move in the radial direction of the disk 11 in synchronization with each other.

At the time of recording, the output of the optical pickup 14 is supplied to the address decoder 29 via the RF amplifier 28 and the absolute address wobble-recorded in the pre-groove provided along the track of the disk 11. The data is extracted and decoded. Then, the detected absolute address data is transferred to the recording processing circuit 25.
Is supplied to the disc 11 and inserted into the recording data,
Recorded in. Further, the absolute address data is supplied to the system controller 3 and used for recognition of the recording position and position control.

Then, the TOC (Table) provided on the innermost circumference of the disc is provided with information on which track and in which sector the background plane information, moving object plane information and motion change information of each scene are recorded. Of C
It is recorded in a disc management area called an ontents area.

During this recording, the signal from the RF amplifier 28 is supplied to the servo control circuit 15, and the control signal for the constant linear velocity servo of the spindle motor 12 is formed from the signal from the pre-groove of the disk 11. The spindle motor 12 is speed-controlled.

FIG. 5 is a block diagram of an embodiment of the signal processing circuit 22 in the first embodiment. That is, the image data in which one pixel is represented by 8 bits from the A / D converter 21 through the input terminal 41 is stored in the frame memory 42.
Is supplied to the subtraction circuit 44 and the subtraction circuit 45.
Is supplied to. Further, the input image data is supplied to the moving object plane separation circuit 62 via the data selector 61.

The frame memory 42 stores 1-bit 8-bit data for one frame, and in the subtraction circuit 44,
Pixel data corresponding to the same sampling position in the previous frame is subtracted from the input pixel data. This subtraction circuit 4
The difference output of 4 is supplied to the absolute value conversion circuit 46, converted into an absolute value for each pixel, and supplied to the comparison circuit 47.

The threshold value θ1 is supplied to the comparison circuit 47 through the terminal 48, and becomes “1” when the absolute value of the difference output from the absolute value conversion circuit 46 is less than the threshold value θ1.
When it is equal to or greater than the threshold value θ1, a determination output that is “0” is obtained. This determination output is supplied to the weight coefficient control circuit 49.

In FIG. 5, 23BG is a background plane memory, and as will be described later, when the initial state has passed, a background plane image (still image) is stored in this background plane memory 23BG.

Reference numeral 50 is a weight coefficient memory in which weight coefficients for one frame are stored. The weighting coefficient memory 50 stores, for example, a 3-bit weighting coefficient.

The frame memory 42, the background plane memory 23BG, and the weighting coefficient memory 50 are commonly address-controlled by the address control signal supplied from the system controller 3 via the input terminal 43 so that the same address is designated. Has been

In the subtraction circuit 45, the image data stored in the background plane memory 23BG is subtracted from the input pixel data, and the difference output of this subtraction circuit 45 is converted into the absolute value conversion circuit 51.
And the absolute value of the difference output is obtained for each pixel.
The absolute value of the difference from the absolute value conversion circuit 51 is calculated by the comparison circuit 5
2 and is compared with the threshold value θ2 through the terminal 53, and becomes “1” when the absolute value of the difference output between the input pixel data and the background pixel data is less than the threshold value θ2, and is equal to or greater than the threshold value θ2. At this time, the judgment output which becomes “0” is obtained from the comparison circuit 52. The determination output from the comparison circuit 52 is supplied to the weight coefficient control circuit 49.

The difference output between the input pixel data and the background pixel data from the subtraction circuit 45 is also supplied to the multiplication circuit 54, and is multiplied by the weighting coefficient α generated from the weighting coefficient control circuit 49. The multiplication output of the multiplication circuit 54 is the addition circuit 5
5 and is added to the background pixel data stored in the background plane memory 23BG, and the addition output is written in the background plane memory 23BG.

The weight coefficient from the weight coefficient control circuit 49 is
It is written in the weight coefficient memory 50. The weight coefficient read from the weight coefficient memory 50 is supplied to the weight coefficient control circuit 49.

The weighting coefficient control circuit 49 determines whether or not the pixel data is a motion pixel from the determination outputs of the comparators 47 and 52.

In the above configuration, the background plane memory 23BG, the subtraction circuit 45, the multiplication circuit 54 and the addition circuit 5
Reference numeral 5 constitutes a digital filter using the background plane memory 23BG as a 1-frame delay element. That is, if the weighting factor is α, the input pixel data of the kth frame is Zk, and the background image data read from the background plane memory 23BG is X (k−1), the background pixel data of the kth frame (estimated value) ) Xk is expressed by the following equation.

Xk = α · (Zk−X (k−1)) + X (k−1) = (1−α) · X (k−1) + α · Zk In this example, one scene in which the background does not change In between, α is fixed at 1/16, for example. The white noise included in the input image is removed by repeating the calculation represented by the above equation over a plurality of frames, and the S / N of the background image stored in the background plane memory 23BG is improved.

In addition, like when the scene changes,
When the background is switched, that is, when the imaging scene is changed to another imaging scene, the weighting factor α is set so that the response time is shortened and the influence of colored noise is eliminated.
Double from 1/16 for each frame. That is, the background image is gradually updated by using the weighting coefficient α that increases exponentially as 1/16 → 1/8 → 1/4 → 1/2 → 1. Therefore, the weighting factor α is 5
There are types, and each is represented by 3 bits.
The weighting coefficient α is set to a power of 2 because the multiplication circuit 54
This is because the shift register or the selector is realized.

In this example, after the initial state has passed, the background still image data is stored in the background plane memory 23BG. The subtraction circuit 45 and the absolute value conversion circuit 51 detect the absolute value of the difference between the current pixel and the background pixel. The absolute value of this difference and the threshold value θ2 are compared by the comparison circuit 52. When the absolute value of the difference is less than the threshold value θ2, it is determined that the current pixel belongs to the background image, and Such processing is performed.

That is, at this time, the weighting coefficient α is 2 ^-4.
It is fixed at (= 1/16). Then, in the multiplication circuit 54, the output of the subtraction circuit 45 is multiplied by this weighting coefficient α, and the output of the background plane memory 23BG and the addition circuit 55.
Is added in. Then, the added output is written to the same address in the background plane memory 23BG, and the background plane memory is updated. The weight coefficient at this time is written in the weight coefficient memory 50.

When the comparison circuit 52 determines that the absolute value of the difference between the current pixel and the background pixel is greater than or equal to the threshold value θ2, the current pixel detected by the subtraction circuit 44 and the absolute value conversion circuit 46 Whether the absolute value of the difference from the corresponding pixel in the frame is less than the threshold value θ1 or more than the threshold value θ1 is examined as the output of the comparison circuit 47. When the output of the comparison circuit 47 is less than the threshold value θ1, the following processing is performed.

That is, when the value is less than the threshold value θ1, the background coefficient is changed due to a scene change or the like, and the weighting coefficient α (= 1/16) initially stored in the weighting coefficient memory 50. Is read out, and the weighting coefficient α is multiplied by the output signal of the subtraction circuit 45 by the multiplier 54. Therefore, the background pixel update made in this frame is similar to the one described above, where Xk = 15/16 · X (k−1) + 1/16 · Zk.

When the background pixel is updated, the weighting factor control circuit 49 doubles α, and it is determined whether or not the doubled new weighting factor is larger than 1. If it is smaller, this doubled weight coefficient α is stored in the weight coefficient memory 50. Starting with a weighting factor of 1/16, (1/8 → 1/4 → 1/2 →
1) and the weighting factor α changes for each frame.

The background is switched, the weighting coefficient α changes as described above, and the background pixel updating process similar to the above does not proceed until 5 frames after α = 1. Therefore, even if the colored noise is erroneously detected as a new background pixel and undergoes the process of changing the weighting coefficient, the correct background pixel is stored. The way of changing the weighting coefficient α is set so that the responsiveness at the time of updating the background pixel is improved and the colored noise can be removed.

When the comparison circuit 47 determines that the absolute value of the difference between the current pixel and the previous frame pixel is greater than or equal to the threshold value θ1, it is determined that the current pixel is a moving pixel. In this case, the background plane memory 23BG is not updated. The motion pixels are subjected to motion plane separation processing as described below.

In the weighting factor control circuit 49, the comparison circuit 52 detects that the absolute value of the current pixel and the background pixel is greater than or equal to the threshold value θ2, and the output of the comparison circuit 47 determines that the current pixel is the current pixel. The absolute value of the difference from the previous frame pixel is
When it is equal to or more than the threshold value θ1, it is detected as a moving pixel.

The motion pixel detection signal from the weighting coefficient control circuit 49 is supplied to the data selector 61, and the input digital pixel data from the input terminal 41 input to the data selector 61 is gate-controlled. This data selector 61 uses the input terminal 4 when the current pixel is a moving pixel.
It is switched to output the image data from 1.
Therefore, when the input pixel (current pixel) is not a moving pixel, the output of the data selector 61 is "0", and when the input pixel is a moving pixel, its pixel data (this is data that is not "0". The fact that it is not “0” is called non-zero) is output from this data selector 61.

Reference numeral 62 denotes a moving object plane separation circuit, which includes a difference memory (frame memory) 62M capable of storing pixel data for one frame, and the output of the data selector 61 is input to this memory 62M. This memory 62M is
An address control signal from the input terminal 43 receives the same address control as that of the frame memory 42, the background plane memory 23BG, and the weighting coefficient memory 50 described above.

Therefore, the background image is removed from the current image in the difference memory 62M, and a difference image consisting of only a plurality of images of a moving object consisting of a set of moving pixels consisting of non-zero data is stored. . And FIG.
As shown in, as data of pixels other than the non-zero pixel data of the moving object, “0” data is written in the memory 62M.

In this way, one 2
The pixel data of a plurality of moving objects in the three-dimensional image are
Written as non-zero pixel data having a level other than "0", the pixel data of the still image portion of the background image other than the pixels of the moving object is stored as all "0" data. Therefore, if a plurality of moving objects do not overlap each other, the pixel data in the difference memory 62M are sequentially scanned, and non-zero pixel data that is not "0" are associated and merged (integrated) by neighboring pixels. , It becomes possible to separate the moving object plane which consists of only each of the moving objects.

Reference numeral 63 denotes a microcomputer, which sequentially searches the difference memory 62M of the moving object plane separation circuit 62 in the direction of raster scan, separates planes for each moving object as follows, and separates the moving object planes. Information of each moving body plane memory 23 at the corresponding address.
A1 to 23An are written. Note that "0" is written in advance at all addresses of the moving object plane memories 23A1 to 23An, and only the pixels of each moving object have the same address as that of the difference memory 62M. It is written in memory.

8 and 9 are flowcharts of the process of the microcomputer 63 for separating the moving object plane. That is, in the process of separating a moving object in this case, first, in step 101, pixel data is searched according to a raster scan. Then, if the scanned pixel data is non-zero pixel data in step 102, the process proceeds to step 103 to check whether the pixel data around it is non-zero. In the case of this example, as shown in FIG. 7, the data of 8 pixels a to h on the upper, lower, left and right sides around the target pixel x is checked.

Then, in the next step 104, 8
When none of the data of the pixels a to h is non-zero, that is, when all the data are zero, the pixel of interest x
Is regarded as an isolated point, and steps 104 to 10 are considered.
Returning to 1, the next pixel data is searched. That is, since a moving object is not considered to be formed by only one pixel, it is considered to be due to noise in this case.

In step 104, if any one of the eight pixels a to h is a non-zero pixel, the process proceeds from step 104 to step 105, and the pixel d to the left of the target pixel x and above (one line before). It is checked whether or not the pixel b and the pixel b are non-zero pixels, and the process proceeds to the next step 106. Here, the pixel d on the left side and the pixel b on the upper side are checked in order to perform comparison with the already checked pixels in the raster scan order.

In the next step 106, it is determined whether the left and upper pixels d and b are both non-zero,
If both are not non-zero, that is, they are not motion pixels,
In step 107, a new number is set as the memory number of the moving object plane memory (hereinafter, simply referred to as the memory number). That is, the frame memory groups 23A1-23
A number indicating which of An is stored is set. Then, in step 108, the memory number is stored in the memory in the microcomputer 63 in correspondence with the address of the pixel.

After that, the routine proceeds to step 109, where it is judged whether or not the processing for all the pixels of the difference memory 62M is completed. When the processing for all the pixels is completed, this processing routine is ended. If all pixels have not been completed, the process returns to step 101 to start searching for the next motion pixel.

If it is determined in step 106 that at least one of the left and upper pixels d and b is a non-zero pixel, the process proceeds from step 106 to step 110, and both are non-zero. To be determined. When it is determined that both are non-zero, the process proceeds from step 110 to step 111, and the memory numbers stored in the memory of the microcomputer 63 for both pixels d and b are checked. Then, the process proceeds to the next step 112, and it is determined whether or not the memory numbers of both pixels d and b match.

As a result of the determination in step 112, when the memory numbers of both pixels d and b match, the process proceeds from step 112 to step 108, and the matched memory number corresponds to the address of the target pixel x. Then, it is stored in the memory of the microcomputer 63.

If it is determined in step 112 that the memory numbers of both pixels d and b do not match, the process proceeds from step 112 to step 113 to select the memory number of the left pixel d. Then, the memory number is stored in association with the address of the pixel of interest x, and the memory number of the left pixel d and the memory number of the upper pixel b are related to each other. Information indicating that it is a pixel of a moving object is sent to the microcomputer 63.
Stored in memory.

This is a pixel in a position where a moving object is skipped in data of a certain horizontal scanning line, but as a result of searching pixels in a subsequent line, it is found that the moving object is connected as a pixel of the same moving object. The case is shown.

As a result of the discrimination in step 110, when both are not non-zero, this step 110
From step S115 to step 115, it is determined whether or not the left pixel d is non-zero. As a result of the determination, when the left pixel d is non-zero, the procedure proceeds to step 116, the memory number of the pixel d is checked, and then step 10
In step 8, the same memory number as the pixel d is stored in the memory of the microcomputer 63 corresponding to the address of the pixel of interest x.

As a result of the determination in step 115, the left pixel d
Is not non-zero, that is, when it is determined that the upper pixel b is non-zero, the process proceeds to step 117, the memory number of the upper pixel b is checked, and then step 1
08, corresponding to the address of the target pixel x,
The same memory number as the pixel b is stored in the memory of the microcomputer 63.

As described above, after step 108, the routine proceeds to step 109, where it is judged whether or not the search for all the pixels of the difference memory 62M is completed,
If not, the process returns to step 101 and the above processing routine is repeated, and when the search for all pixels is completed,
This processing routine ends.

The above processing routine will now be described with reference to FIG.
0 and FIG. 11 will be further described.

FIG. 10 shows image data for one screen stored in the difference memory 63M, and the central portion, that is, the portion in which a number other than zero is described, is detected as a moving body by the moving body plane separation circuit 62. It is the part that was done.

The microcomputer 63 executes the above processing routine on the image data stored in the difference memory 62M according to the raster scan order. here,
Among the numbers shown in FIG. 11, “0” is image data stored in the still image plane, and “1” and “2” are pixel data stored in any one of the frame memories of the frame memory groups 23A1 to 23An. Represents

First, when scanning is performed according to the raster scanning order, it is detected in step 102 that the pixel data shown in FIG. 10 is a non-zero pixel. Then, in this pixel data, there are non-zero pixels in the peripheral pixels, and the pixel data on the left and above thereof, that is, the pixel data corresponding to the pixel b and the pixel d in FIG. Set a new memory number. In this case, since the above pixel data is the non-zero data detected first, the memory number "1" is set. The memory number "1" is stored in the corresponding pixel position of the memory 63M built in the microcomputer as shown in FIG.

The value of the next pixel data is "3", that is, non-zero, and the value of the pixel data on the left is "3".
That is, since the value of the non-zero pixel data is "0", the process proceeds to step 108 via step 116, and the memory number "1" is stored in the corresponding pixel position of the memory 63M. Similarly, when the above processing routine is performed, in the processing routine for the pixel data shown in FIG. 10, there is non-zero data around this pixel, and the left and upper pixel data are both zero. Since it is data, the process proceeds to step 108 via step 107, and the memory number “2” is stored in the memory 63.
It is stored in the corresponding pixel position of M.

Next, in the processing routine for the pixel data of the value "3" enclosed by Δ in FIG.
This pixel has non-zero pixels around it, and the data on the left is zero data and the data on it is non-zero. Therefore, the process proceeds to step 108 via step 117, and the memory number “1” corresponds to the pixel position of the memory 63M. Memorized in. That is, by detecting whether or not the pixel data on the left and above the pixel of interest is non-zero data, it is possible to combine the data of the same moving object when searching in the raster scan order. it can.

Further, in the processing routine for the pixel data of the value "3" enclosed by □ in FIG.
This pixel has non-zero data around it, and the left and upper pixel data are both non-zero data, and the memory numbers of the left and upper pixel data are different. Therefore, in step 114, the same memory as the left pixel data is stored. The number, that is, the memory number "1" is stored in the corresponding pixel position of the memory 63M, and the information indicating that it is related to the upper pixel, that is, the pixel having the memory number "2" is recorded.

That is, when the pixel data on the target pixel data which is non-zero and the pixel data on the right are both non-zero, it is highly possible that these three pixel data are the same moving object. However, if the above processing routine is performed in the raster scan order, different memory numbers are given as described above, even though the pixel data is the same for the same moving object.

Therefore, in this embodiment, there are non-zero pixel data around the pixel data of interest, the left and upper pixel data are both non-zero data, and the memory numbers of the left pixel data and the upper pixel data are , The memory numbers store data indicating that they are related to each other. As a result, both memory numbers are stored as different numbers in the memory 63M, but when pixel data is stored in the frame memory groups 23A1-23An, they are stored in the same frame memory.

As a result of the pixel search for the difference memory 62M described above, in the built-in memory 63M of the microcomputer 63, for each moving object, the memory number for the address of the pixel included in each moving object is the other memory. It is stored together with the information indicating the relationship with the number. The microcomputer 63 associates the memory numbers of the pixels recognized as the same moving object with the memory number No of one moving object plane memory. As a result, each moving object can be separated as separate moving object planes as follows.

That is, the microcomputer 63 uses the difference memory 6
The moving pixel data is sequentially read from 2M. The read output of the difference memory 62M is the moving object plane memory 2
3A1 to 23An are input. Further, the microcomputer 63 sets the read pixel as described above and supplies the write pixel address (which may be the same as the read pixel address) only to the moving object plane memory of the stored memory number No, and the movement thereof is performed. The pixel is written into the moving object plane memory with the memory number No.

Thus, the moving object plane memory 23A1
In each of 23-23An, each moving object is separated and stored separately.

In the moving object plane separating method described above, the difference memory 62M is searched for pixels horizontally and vertically in the same order as in television scanning, and pixels included in the same moving object are merged. When one motion pixel is detected, the surrounding pixels are sequentially searched for non-zero pixels, and the merged pixel data are simultaneously written to one moving object plane memory at the same time. In this way, the moving object plane memory for one moving object may be completed.

Even if two moving objects overlap each other at a certain point of time, the moving objects can be observed separately after a predetermined time elapses. By rewriting, the moving object plane information including only the moving objects can be stored in each moving object plane memory by the above method.

Next, a configuration example of a motion change information detection circuit for detecting motion change information of each moving object will be described with reference to FIG.

The motion change information includes the current plane information, the background plane memory 23BG, and the moving object plane memories 23A1-23A1.
It is generated using the data of 23An. The circuit of FIG. 12 operates from the time when the imaging / recording start key is operated after the above-described preparation period has elapsed. That is, in this example, the motion change information is recorded in real time.

The image pickup data is the signal processing circuit 22 described above.
The moving object plane separating circuit 62 separates the moving object into plane information for each moving object. Information on one frame of each moving object is stored in the frame memories 71A1 to 71An.
Written in. That is, the moving object plane separation circuit 62 shown in FIG. 5 is equivalent to each frame memory 71A shown in FIG.
1 to 71An are also connected, and the moving pixels are written in any of the frame memories 71A1 to 71An based on the writing pixel address from the microcomputer 63.

The frame memories 71A1 to 71An
Is composed of two frame buffers, and when the information of the moving object is being written to one of the frame memories, the information data of the moving object plane is read from the other frame memory and the data is read. Are used to generate motion change information.

That is, the frame memories 71A1 to 71A
The image information of each moving object from An is supplied to the motion change detection circuits 72A1 to 72An. Then, the moving body plane information stored in the moving body plane memories 23A1 to 23An during the preparation period is supplied to the movement change detection circuits 72A1 to 72An.

In the motion change detection circuits 72A1 to 72An, the moving objects stored in the moving object plane memories 23A1 to 23An and the frame memories 71A1 to 71A are stored.
By pattern matching with each moving object image from An, the motion vector, that is, the direction of motion and the amount of motion for that moving object are obtained. In this case, since the moving object is stored in the memory as a moving object plane in advance, if the shape of the moving object does not change, attention is paid to a specific representative point or representative block, and pattern matching is performed on the representative point or representative block. By performing the above, it is possible to extract the motion vector for the entire moving object, and it is possible to perform the matching process in a relatively short time.

When the moving object changes its direction or shape, the error in pattern matching becomes large.
Therefore, in this example, together with the motion vector, the error amount is transmitted as motion change information.

In this way, the motion change detection circuits 72A1 to 72A7
The motion vector and the information on the matching error for the moving object in each moving object plane memory obtained by 2An are supplied to the compression encoding circuit 26 and data compressed. As described above, the amount of data after compression is much smaller than that of image information, and it is possible to easily record the data on the disc in real time.

The post-movement position of the moving object in each moving object plane memory can be easily detected as an address on the memory by using the detected motion vector. Therefore, it is possible to recognize a state in which the moving objects overlap with each other by making the pixel addresses of the plurality of moving objects the same. As described above, when a plurality of moving objects are overlapped with each other, the depth between the moving objects is detected depending on which pixel of the moving object appears as the pixel of the part in the current image. Then, the depth information is transmitted together with the motion information. Note that the depth information is also obtained for the background image and the moving object.

As the motion change information for a moving object, a predicted motion vector as in the following example and object deformation information may be transmitted. That is, in the example of FIG. 13, the frame information of each moving object extracted from the input image information from the frame memories 71A1 to 71An is supplied to the difference calculation circuits 73A1 to 73An.

In addition, moving object plane memories 23A1-2A
The 3A moving object plane information is used as the prediction circuits 74A1 to 74A7.
4An, and is supplied to 4An, and the motion vector predictor generating circuit 75A1
Based on the predicted motion vector from ~ 75An, the frame image data of each predicted moving object after the movement is obtained from this. Then, the predicted frame image data of each moving object is converted into the difference calculation circuits 73A1 to 73A1.
73An and is supplied to the frame memories 71A1 to 71A1.
The difference from the frame information of each moving object extracted from the input image information from An is calculated.

The difference calculation circuits 73A1 to 73An output the difference of the image of the moving object to the compression encoding circuit 26 as output data. In addition, the difference calculation circuit 73A
1 to 73An obtain the difference of the motion vector from the difference of the image of the moving object and supply it to the compression encoding circuit 26 as output data and also to the predictive motion vector generating circuits 75A1 to 75An for the next frame. Generate a motion vector predictor for each moving object.

In the above example, the background image and the still image of the moving object are separated from the input image. However, when the background image and the moving object are separated in advance, it is possible to take a picture with the camera. It is possible to individually image this in advance, write it in the background plane memory 23BG and the animal plane memories 23A1 to 23An, and record it in the disk 11.

As described above, when a moving object is imaged to create a moving object plane in advance, the moving object is imaged in all directions from the center to obtain a development view of the moving object. Even when a moving object makes a rotating motion, it is possible to obtain a reproduced image according to the motion. That is, when the moving object is, for example, an object that rotates about the axis Z as shown in FIG. 14, a development view of its side is prepared in advance as a moving object plane as shown in FIG. By adding the rotation information to the change information and transmitting the change information, it is possible to obtain a reproduced image of the moving object in an arbitrary rotated state.

In the above embodiment, the preparation period is set before the actual image recording and recording, and the background plane and the moving object plane are separated and recorded on the disc during the preparation period. Since the amount of information is very small, it is possible to execute recording of still image plane information to recording of motion change information in real time without providing a preparation period. For example, if one scene is 10 seconds, in the above example, the still image plane and the moving object plane can be recorded in 2 seconds, so the motion change information is stored in the buffer memory for that 2 seconds. By doing so, real-time image recording can be performed without providing a preparation period.

FIG. 16 is a block diagram of an embodiment of the disc reproducing apparatus. In this example, the same parts as those of the disc recording apparatus of the example of FIG. 1 are designated by the same reference numerals, and the description thereof will be omitted. In this embodiment, the disc recording apparatus of FIG. 1 and the disc reproducing apparatus of FIG. 16 are shown separately, but the present invention is not limited to this, and a disc recording / reproducing apparatus capable of recording and reproducing is provided. You may apply.

When the disk 11 is loaded into the apparatus, the apparatus first takes in the TOC area of the disk, and the system controller 3 records the recording positions of the background plane and the moving object plane of each scene and its motion change information. Recognize position.

Then, the system controller 3 first reproduces the information of the background plane and the plurality of moving object planes of the scene to be reproduced from the TOC area information. The image information extracted from the disk 11 is supplied from the RF amplifier 28 to the reproduction processing circuit 81, where the data of a predetermined recording format such as a sector structure is decoded, and the decoded data is subjected to data expansion and plane separation. It is supplied to the circuit 82. And
In this circuit 82, each plane information compressed at a low compression rate is decompressed and separated for each plane information. The background plane information is stored in the background plane memory 83BG, and the animal body plane information is stored in the animal plane information. It is written in the body plane memories 83A1 to 83An, respectively. This completes the preparation for starting moving image reproduction.

Next, the motion change information, depth information, rotation information, etc. of the scene are extracted from the disc in real time by referring to the TOC area information, and the data is decompressed and decoded via the RF amplifier 28 and the reproduction processing circuit 81. It is supplied to the circuit 84. Then, the motion change information and the like are decompressed and decoded, and supplied to the signal processing circuit 85.

Further, the signal processing circuit 85 includes the background plane memory 83BG and the moving object plane memories 83A1 to 83A1.
Each still image information from 83An is also supplied. In the signal processing circuit 85, the background plane memory 8
In the background image from 3BG, the moving object plane memory 83A1
The images of the moving objects from .about.83An are combined using the motion change information and the depth information of the moving objects from the decompression decoding circuit 84.

The moving image data from the signal processing circuit 85 is returned to the original analog signal by the D / A converter 86 and is derived from the output terminal 87.

When the moving object is accompanied by the rotation as described above, the image content as the above-mentioned development view is stored in the corresponding moving object plane memory as the moving object plane information, and the rotation is performed. Since the information is obtained from the decompression decoding circuit 84, the portion to be displayed on the screen is read from the moving object plane memory according to the rotation information.

The information of the background plane and the moving object plane for each scene is first read from the disc, and then the motion change information is sequentially read from the disc, whereby the moving image of each scene can be reproduced. In this case,
Since the amount of motion change information for each scene is very small,
Rather than extracting motion change information for one scene from the disc in real time of a moving image, a buffer memory is provided, and motion change information is extracted after each plane information and stored in the buffer memory, and sequentially from that buffer memory. It is also possible to perform a process of reading out the motion change information according to the moving image.

Next, another embodiment of the present invention (hereinafter referred to as the second
(Referred to as the embodiment of FIG. 21) will be described with reference to FIGS. In the case of the second embodiment, the hardware is
The same disc recording device and disc reproducing device as in the first embodiment can be used. However, this second
In the case of this embodiment, the fixed background portion is registered in the background plane 23BG and recorded as a still image with the maximum image frame that can be considered at the time of shooting.

Similar to the first embodiment described above, the moving part is separated into each moving object and registered in each of the moving object plane memories 23A1 to 23An, which will be described later, and the still image of the moving object is stored. At the same time as the recording, the change information of the moving object on each moving object plane is also recorded.

In the case of the second embodiment, the moving object plane memories 23A1 to 23An can be constituted by a memory having a capacity capable of writing the still image information for one screen, but the background plane memory 23BG is As shown in FIG. 17, a large-capacity memory capable of storing pixel information for one screen or more, in this example, pixel information for a plurality of screens.
That is, the background plane memory 23 of the second embodiment.
The BG has a capacity capable of writing pixel sample data of (480 × a) lines in the vertical direction and (720 × b) pixels in the horizontal direction. In this example, a = 3, b = 3
It is said that.

Therefore, for example, when the background image at the center position in FIG. 17 is the center, the background that comes into the image frame when the camera angle is changed such as panning and tilting the camera around this center background image. Can be written in the background plane memory 23BG. Further, when the camera is zoomed at the background image at the center position, all the background images in the zoom range are written in the background plane memory 23BG.
An example of a method of writing background image information in a range wider than the image frame for one screen will be described below.

In the second embodiment, first, a predetermined key of the key group 4 is operated to photograph the background plane of the maximum image frame by the camera unit 1 and register it in the background plane memory 23BG. Set to mode. The operation in this mode will be described below.

The camera section 1 of the second embodiment is provided with a zoom lens (not shown), and first, this zoom is set to the widest angle side to photograph a wide background. In this example, this is the maximum image frame.

The image pickup signal from the camera unit 1 is supplied to the A / D converter 21, and for example, one pixel sample is converted into an 8-bit digital image signal, and the signal processing circuit 2
2 is supplied. The signal processing circuit 22 separates the image of the scene captured by the camera unit 1 into a static background stationary image that does not move and each moving object that moves on the background, and outputs the separated background image information. Register in the buffer memory. In this buffer memory, for example, as shown in FIG. 18, still image information captured with the background of the maximum image frame as one screen is obtained.

Next, with the zoom lens at the most telephoto end,
Shoot a part of the maximum image frame. In the signal processing circuit 22,
In the same manner as described above, only the fixed background portion obtained by separating the components of the moving object from the captured image (hereinafter, this is partially referred to as background image) is separated. Then, the separated partial background image is compared with the maximum image frame accumulated in the buffer memory to determine which part of the maximum image frame the background image is. In this case, assume that the size of the image frame of the partial background image is 1/9 of the maximum image frame (that is, the image frame on the most telephoto side is 1/9 of the image frame on the widest angle side). , Some background images are thinned by 1/3 in the vertical and horizontal directions,
The pattern matching is performed by comparing with the background image of the maximum image frame of the buffer memory.

Now, if it is recognized that the partial background imaged by pattern matching, for example, is the image in the upper left corner of the maximum image frame shown by hatching in FIG. 18, the diagonal line in FIG. Background plane memory 23BG attached
The partial background image portion is written in the corresponding partial screen address of. In this case, what is written is not the thinned-out image information but the original image information.

Then, the signal processing circuit 22 stores, in the background plane memory 23BG, the position of the partial background image for which writing has been completed from among the still images in the maximum image frame in FIG.

Next, while keeping the zoom lens on the most telephoto side, another partial background image within the maximum image frame is photographed. In the same manner as described above, the signal processing circuit 22 checks which part of the maximum image frame is the partial background image, and the background part which has not been written in the background plane memory 23BG corresponds to the background plane memory 23BG. Write to the address location.

The above processing is performed until all the background images of the maximum image frame are written in the background plane memory 23BG. When the writing of the maximum image frame is completed, the device notifies that by, for example, an alarm sound.

When the fixed background image of the maximum image frame is registered in the background plane memory 23BG, each of which has been recognized as a moving object during shooting at the maximum telephoto side and separated, for example, the airplane, monkey, automobile, etc. Still images of moving objects in
Each of the moving object plane memories 23A1 to 23An (n
Is a natural number).

As described above, the plane memory 23 is separated into the background plane and the plurality of moving object planes.
As described above, the image information of each still image written in the BG and 23A1 to 23An is recorded in the disk 11 in advance during the preparation period shown in FIG. 3 before the actual image pickup and recording by the video camera is started. .

In the second embodiment, for the background plane, the position of the image frame of the background image separated at the time of shooting / recording on the background plane memory 23BG is set to the background at the start of actual imaging / recording. Background of the picture frame Plane memory 2
The change information indicating the image frame position based on the position on the 3BG (hereinafter referred to as image frame position information) is included in the motion change information. Then, the motion change information and the image frame position information generated as described above are recorded on the disc 11 in real time.

Therefore, in the image pickup recording mode, the signal processing circuit 22 uses the information of the background plane and the n moving object planes separated at that time, from the input digital image signal, of each moving object plane. The motion change information of the moving object and the image frame position information of the background image are obtained. Then, the motion change information and the image frame position information are supplied to the compression encoding circuit 26, compression encoded at an appropriate compression rate, and supplied to the head drive circuit 27 via the recording processing circuit 25.

In this case, the motion change information and the image frame position information to be recorded have a small number of bits, as will be described later, and are sufficiently transmitted in real time even at a low transmission rate of 1.2 Mbps. it can.

Next, a configuration example of the image frame position information of the background image on the background plane and the motion change information of each moving object in the signal processing circuit 22 will be described with reference to FIG.

The image frame position information and the motion change information are generated from the current image information using the data of the background plane memory 23BG and the moving object plane memories 23A1-23An. The circuit of FIG. 19 operates from the time when the imaging / recording start key is operated after the above-described preparation period has elapsed. That is, in the second embodiment, the image frame position information and the motion change information are recorded in real time.

That is, the image pickup data from the A / D converter 21 is separated into the background plane information for one screen and the plane information for each moving object by the plane separation circuit of the signal processing circuit 22 described above. Information about one frame of the background image and each moving object is stored in the frame memory 7
1BG and 71A1 to 71An. The frame memories 71BG and 71A1 to 71An have a two-frame buffer configuration. When the background image and the information of the moving object are being written to one frame memory, the background plane from the other frame memory and The information data of the moving object plane is read out, and the data is used for generating the image frame position information and the motion change information.

That is, the background image information from the frame memory 71BG is supplied to the image frame position change detection circuit 72BG, and the image information of each moving object from the frame memories 71A1 to 71An is supplied to the motion change detection circuit 72A1.
~ 72An. Then, the background information of the maximum image frame from the background plane memory 23BG is supplied to the image frame position change detection circuit 72BG, and the moving object plane information stored in the moving object plane memories 23A1 to 23An during the preparation period moves. Change detection circuit 72A1
It is supplied to 72An.

In the image frame position change detection circuit 72BG, the background image of the maximum image frame is compared with the background image of the frame memory 71BG, and the image frame position on the background image of the maximum image frame of the background image of the frame memory 71BG is compared. Is detected, a change from the initial position is detected, and the change information is output as image frame position information and supplied to the compression encoding circuit 26.

In the motion change detection circuits 72A1 to 72An, the moving objects stored in the moving object plane memories 23A1 to 23An and the frame memories 71A1 to 71A are stored.
By pattern matching with each moving object image from An, the motion vector, that is, the direction of motion and the amount of motion for that moving object are obtained.

That is, the background image information from the frame memory 71BG is supplied to the image frame position change detection circuit 72BG, and the image information of each moving object from the frame memories 71A1 to 71An is supplied to the motion change detection circuit 72A1.
~ 72An. Then, the background information of the maximum image frame from the background plane memory 23BG is supplied to the image frame position change detection circuit 72BG, and the moving object plane information stored in the moving object plane memories 23A1 to 23An during the preparation period moves. Change detection circuit 72A1
It is supplied to 72An.

In the image frame position change detection circuit 72BG, the background image of the maximum image frame is compared with the background image of the frame memory 71BG, and the image frame position on the background image of the maximum image frame of the background image of the frame memory 71BG is compared. Is detected, a change from the initial position is detected, and the change information is output as image frame position information and supplied to the compression encoding circuit 26.

In the motion change detection circuits 72A1 to 72An, the moving objects stored in the moving object plane memories 23A1 to 23An and the frame memories 71A1 to 71A are used.
By pattern matching with each moving object image from An, the motion vector, that is, the direction of motion and the amount of motion for that moving object are obtained.

When the moving object changes its direction or shape, the error increases in the pattern matching.
Therefore, in this example, together with the motion vector, the error amount is transmitted as motion change information.

In this way, the motion change detection circuits 72A1-7A7
The motion vector and the matching error information for the moving object in each moving object plane memory obtained by 2An are supplied to the compression encoding circuit 26.

The compression encoding circuit 26 compresses the input data. As described above, the amount of data after compression is much smaller than that of image information, and it is possible to easily record the data on the disc in real time.

When the camera is zoomed,
The zoom ratio information is included in the change information, and the information of the background plane and the moving object plane is passed through a low-pass filter (data thinning) according to the zoom ratio for comparison with the image pickup signal. In addition, when the photographed background extends beyond the background plane memory 23BG, the difference from the background plane is recorded together with the image frame information.

Instead of the image frame position information of the background image,
Once the position of the initial background image is set, when you move the camera from that position by tilting or panning,
A sensor means for detecting the moving direction and the distance may be provided, and the information on the moving direction and the distance detected by the sensor means may be recorded.

As the motion change information about the moving object, the predicted motion vector as shown in FIG.
Object deformation information may be transmitted.

Next, still another embodiment of the present invention (hereinafter referred to as the third embodiment) will be described.

In the case of the third embodiment, the still image information of the background plane is not recorded as it is, but a natural object, a building, a structure, a living thing, etc., which is prepared in advance, is assumed to form an image. An approximate still image of the background plane is created based on typical image information of the element, and instead of recording the image information, the identification information of the image element forming the approximate still image and the information of the screen position thereof are recorded. .

The difference between the approximate still image and the correct background still image is recorded in the background change information. The background change information includes pan, tilt, and
It also includes background image information that changes when an operation is performed to change the image frame by zooming or the like.

The moving part is divided into moving objects, and moving object plane memories 23A1 to 23A to be described later are provided.
The information of a still image of the moving object is recorded in each of the n, and the change information about the moving object of each moving object plane is recorded. Also in this case, the still image information of the moving object plane is replaced with the approximate still image in the same manner as the background image, and the identification information is recorded.

Also for this moving part, the difference between the approximate still image and the still image of each moving object, the moving direction and moving amount of the moving object, and further the change of the image according to the motion are calculated as the moving part. It is recorded as change information regarding.

In the third embodiment described above, in the disk recording apparatus of the first embodiment shown in FIG. 1, the signal processing circuit 22 includes a background plane memory 23BG and moving object plane memories 23A1-23An. An approximate background plane memory and an approximate moving object plane memory are provided, and an image element memory that stores typical image information of image elements supposed to form an image is provided.

The signal processing circuit 2 according to the third embodiment.
A specific example of No. 2 will be described with reference to FIG. In FIG. 20, 64BG is an approximate background plane memory, and 64A1-6.
4An is an approximate moving object plane memory, and 65 is an image element memory.

In the image element memory 65, for example, as shown in FIG. 21, natural objects, buildings, structures, living things, etc.
A lot of typical image information of image elements supposed to form an image is stored. The image of the image element stored in the image element memory 65 includes a standard equipment prepared in advance and an image captured and stored by the user.

However, each image element is the identification information given in correspondence with the address of the image element memory 65,
Can be read. For example, in the example of FIG. 21, a number is assigned to each image element, and the identification and reading can be performed by the number.

In the third embodiment, the signal processing circuit 22
Then, in this preparation period, the still images of the background plane and the moving object plane are separated from the input image signal, and the separated still images are written in the background plane memory 23BG and the moving object plane memories 23A1 to 23An. Further, an approximate still image using the image elements of the image element memory 65 is generated from the still images of the memories 23BG and 23A1-23An.

The signal processing circuit 22 writes the separated background plane in the background plane memory 23BG. Also,
The separated n moving object planes are written in the moving object plane memories 23A1 to 23A (n is a natural number), respectively.
Since the specific embodiment for separating the background plane and the moving object plane is the same operation as the example shown in FIG. 5, the description thereof will be omitted.

Similarly to the example of FIG. 5, when the still images of the background plane and the moving object plane are separated from the input image signal and stored in the memories 23BG and 23A1-23An, the signal processing circuit 22 Then, the process of replacing these still images with the image elements of the image element memory 65 is performed, and the approximate still images are generated by the replacement.

That is, the signal processing circuit 22 first creates an approximate still image for the background still image in the background plane memory 23BG. Although there are various methods, for example, one image element is read from the image element memory 65, a comparison search is performed between the image element and each part of the still image in the memory 23BG, and a comparison error is detected as a threshold value. When it is smaller than the value, the still image portion is replaced with the image element. At this time, the position of the replaced still image portion on the screen is also stored.

Each image element of the image element memory 65 stores an enlarged image of a typical image of the image element in a relatively high definition state. Then, this image element memory 6
When reading from 5, the size can be specified so as to correspond to the size of the corresponding portion of the background image to be replaced. That is, when reading in a state larger than the stored image, the data is read while interpolating, and when reading in a state smaller than the stored image,
Decimate the data and adjust the size.

In this case, as the image element read out from the image element memory 65 and replaced with the background plane, for example, all the image elements in the image element memory 65 are scroll-displayed in a viewfinder (not shown) of the camera unit 1, and in the case of this example. It is advisable to select and specify by number. Of course, it is possible to automatically perform the above-described search for all image elements. The approximate background still image thus generated is the approximate background plane memory 64B.
Written to G.

In addition, each moving object plane memory 23A1 to 23A1
Also for the still image of the moving object of 23An, the similar moving image still image is generated using the image element of the image element memory 65 in the same manner as described above, and the approximate still image information is the approximate moving object plane memories 64A1 to 64An. Written in.

As described above, the approximate still image is generated, and the approximate plane memories 64BG and 64A1 to 64A are generated.
When the approximate still image is written in n, the compression circuit 24
Instead of using the image information of the approximate still image as the recorded information,
The identification information of the image elements forming the approximate still image, for example, the identification number in this example, and the information indicating the position on the screen occupied by the image element are used as the recording information. In addition,
In the case of an approximate moving object still image, the position information on the screen can be included in the change information by recording only the image information of the still image of the moving object. It need not be included in the information.

The recording information on the still image from the compression circuit 24 is supplied to the recording processing circuit 25. The output data of the recording processing circuit 25 is sequentially output to the head drive circuit 27.
Is supplied to the recording magnetic head 13 via the
1 is magneto-optically recorded.

In the third embodiment, even in the image pickup recording period after the actual image pickup recording start key is operated in the video camera unit 1, first, in the signal processing circuit 22, in the same manner as the above-mentioned preparation period. , A background image and a still image of each moving object are separated from the image pickup signal. Then, the separated still image is compared with the approximate background still image and the approximate moving object still image information registered in the approximate background plane memory 64BG and each of the approximate moving object plane memories 64A1 to 64An, and the change as described above is performed. Generate information.

Next, still another embodiment of the present invention (hereinafter referred to as the fourth embodiment) will be described. In this example, as shown in FIG. 22, recording of one scene includes a separation period Ra of plane information of a still image, a generation period and recording period of change information and an update period Rb of plane information, and a recording period Rc of plane information. Divide into and.

During the separation period Ra, the plane information is not recorded. As will be described later, the plane information is separated and the plane memories 23BG and 23B for the separated plane information.
Writing to A1 to 23An is performed.

In the period Rb, the plane memory 23BG,
Change information is generated from the plane information of 23A1 to 23An and the input image signal as described later, and the change information is recorded. At the same time, the change information is used to update the plane information of the memories 23BG and 23A1 to 23An, and the plane information of the memory is rewritten to the updated one.

The period Rc is a period after the end of the image signal of one scene. That is, in the period Rb, the change information is recorded almost in real time according to the input image signal. Then, in the period Rc, after the recording of the change information is finished, each updated plane information stored in the plane memory is recorded. Since this period Rc is a period after the real-time recording of the input signal, the recording can be performed for a sufficient time. Therefore, the plane information can be recorded without compression or at a low compression rate.

In this case, the plane information for one screen is composed of 480 lines × 720 pixels as shown in FIG. 23, for example. In this example, the moving object plane memory 23A
1 to 23An can be configured with a memory having a capacity capable of writing the still image information for one screen.

However, the background plane memory 23BG is
In consideration of the pan, tilt, and zoom of the camera, as shown in FIG. 23, a large-capacity memory capable of storing pixel information for one screen or more, in this example, pixel information for a plurality of screens. That is, for example, the background plane memory 23BG
As shown in FIG. 23, has a capacity capable of writing pixel sample data of (480 × a) lines in the vertical direction and (720 × b) pixels in the horizontal direction. a and b
Is a numerical value of 1 or more.

Since the background plane memory 23BG has a large capacity as described above, the background image is, for example, as shown in FIG.
When the background image BGs of the image frame BGs at the center position is centered, the background that comes into the image frame when the camera shooting image frame position is changed such as panning and tilting the camera around this central background image This can be written in the background plane memory 23BG. That is, the background image written in the entire area of the background plane memory 23BG has a wide range of a times in the vertical direction and b times in the horizontal direction with respect to the image frame displayed as one screen. Becomes

Therefore, this background plane memory 23B
Even when the camera is zoomed to the wide angle side at the background image of the image frame for one screen at the center position when the background image is written in the entire range of G, the values of a and b above Within the wide-angle range corresponding to, all the background images in the zoom range are written in the background plane memory 23BG.

In the period Ra, as will be described later, the image frame BGs of the address substantially in the center of the background plane memory 23BG.
23, the information of the background image for one screen obtained by the separation is written (hereinafter, referred to as an initial background plane) at the position of, and is stored in the moving object plane memories 23A1 to 23An. A still image for one screen of each moving object obtained by separation is written in each.

The plane separation and storage operation during this period Ra are the same as those in the above-mentioned embodiment, and therefore the explanation thereof is omitted.

Here, the initial plane information separated as described above has the following problems.

Considering the background plane BG, for example, as shown in FIG. 24A, the background portion hidden by the moving object M at a certain time appears when the moving object completely moves its position. . However, the period R
In a, since the complete movement period of the moving object in which the hidden portion appears is short, part of the moving object is included in the initial background plane. This problem can be solved by obtaining the change in the background according to the change in the motion of the moving object M and updating the background plane. Therefore, the next period R
In b, the contents of the background plane memory BG are rewritten with the updated contents.

Considering the moving object plane,
The moving object M is separated as a set of moving pixels as described above. Therefore, when the movement is slow, there may be a portion where the movement does not appear in a short time. That is, for example, as shown in FIG. 24B, when the moving object M is an automobile and it moves slowly and moves from the solid line position to the broken line position during the period Ra, the hatched portion of the side door sd is It is not captured as a moving part, it is captured as a background. However, this problem can also be solved by rewriting the moving object plane according to the change of the moving object. Therefore, the content of the moving object plane is updated in the next period Rb.

Also in this period Rb, first, similarly to the above-mentioned period Ra, the signal processing circuit 22 separates the background image and the still image of each moving object from the image pickup signal. Then, the separated still image and the background plane memory 23B
G and the initial background plane and moving object plane information registered in each moving object plane memory 23A1 to 23An are compared to generate change information.

As for the background still image, as shown in FIG. 23, with reference to the position on the background plane memory 23BG of the image frame BGs of the still image of the initial background plane, the change direction and the change amount (pan, Information Vs of tilt direction and amount, further zoom ratio, etc.) and image information ΔPs of the background still image change are generated as change information for the background plane. Further, for each moving object, the image information ΔPm of the difference between the moving direction and the moving amount Vm of the moving object and the moving object plane due to the movement change such as rotation or shape change is generated.

Then, the change information generated as described above is recorded on the disk 11 in real time. As a result, as shown in the time chart of FIG. 25A, the change information ΔP about the background image is displayed on the disk 11.
s and Vs and change information ΔPm1 for each moving object
.About..DELTA.Pmn and Vm1 to Vmn are what are recorded.

With this recording, in the signal processing circuit 22, the image information of the change of the background still image, that is, the image frame B
The amount of change in Gs is calculated, the still image information in this image frame BGs is updated and corrected, and the image information including the area increased as a background due to panning, tilting, etc. is added to the background plane memory 23BG. It also writes to. For example, when the image frame position changes due to panning, tilting, etc. and the background still image of the captured portion becomes the still image BGp shown by the alternate long and short dash line in FIG. 23, the image information shown by hatching in FIG. 23 is stored in the memory 23BG. Added to.

Similarly, the moving object plane memories 23A1 to 23A1 to
Rewrite the contents of 23An.

In this way, the still image information in the background plane memory 23BG and each moving object plane memory 23A1-23An is rewritten, and the information of the background plane stored in the background plane memory 23BG becomes more appropriate than that of the initial background plane. At the same time, the background image information is spread over a wider area than one screen.

Then, the next change information is generated based on the rewritten plane information. However, the basis for generating the change information about the background is the information for one screen at the image frame position BGs of the initial background plane.

Generation of change information and background plane memory 23BG and moving object plane memories 23A1-2A23.
Rewriting of still image information of 3An is performed until the end of the one scene.

After the recording of the change information for one scene is completed as described above, the background plane memory 23BG and the moving object plane memory 2 which are sequentially updated in the period Rb.
Recording of still image information of 3A1 to 23An is performed in the period Rc.

The background plane memory 23BG stores all the background images used in the scene by panning, tilting, and zooming, as described above. However, on the disk 11, as the change information of the background plane, changed still image information (increase information) for the still image BGs of the initial background plane is recorded.

Here, if the contents of the background plane memory 23BG after recording is used as the background plane information instead of the initial background plane as the criterion for obtaining the change information of the background plane, the image frame position in the background plane information is shown. By recording the information as background information for each image frame,
It is possible to easily form the background still image of each frame on the reproducing side. In such a case, it is not necessary to record the image change information of the background plane, and the amount of recorded data can be reduced accordingly. Moreover, there is no deterioration of the reproduced image.

In this example, in consideration of the above points, the information recorded on the disk 11 is reproduced and re-recorded.

That is, as shown in FIG. 25B, when this re-recording is performed, a re-recording period is provided after the period Rc. In this case, in the period Rc before the re-recording period, the background plane information is separated as the information of the background plane memory 23BG after the recording, that is, a good fixed background image, and is enlarged in this example. The still image information BGL of the frame is recorded, and n after the end of one scene is recorded.
The still image information of the moving object plane memories 23A1 to 23An that is appropriate for each moving object is recorded.

During the re-recording period, the recorded signal (change information) is reproduced and the image is reproduced by the reproducing device described later. Then, the reproduction signal and the memories 23BG and 23A
New change information is generated from the information of 1 to 23An, and the change information is recorded. In this recording, the changed image information ΔPs for the background plane is not recorded, but the changed position for the image frame position BGs of the initial background plane is detected,
Generate and record only this information.

That is, first, the image frame position BGs of the initial background plane on the recorded enlarged background plane BGL.
The information ST of is recorded. This is the background plane memory 2
For example, the address information of the upper left corner of the still image of the enlarged background plane on 3BG may be used. Next, the changed image frame position information FLs obtained from the information Vs of the image frame position change direction and amount of change of the background image of each reproduced frame is recorded as the background image information of the frame. The image frame position information FLs may also be address information of the upper left corner of the image frame in the still image on the enlarged background plane in the background plane memory 23BG.

However, in the case where the reproducing side is configured to obtain the image frame position information of the background image of the frame from the information Vs, the information Vs of the changing direction and the changing amount may be re-recorded as it is. Good.

By re-recording as described above,
With respect to the background image, it is not necessary to record the information Ps corresponding to the image change of each frame (or field), and the amount of recorded information can be reduced. Moreover, even in the case of re-recording, there is no deterioration of the image quality of the image, unlike the case of the recording of the copy in the VTR, for example.

Similarly, the change information regarding the moving object plane is updated based on the updated plane information and re-recorded, whereby the recording data amount can be further reduced.

As for the moving object, it is also possible to reduce the motion information by recording, as the still image plane information, a plurality of pieces of still image information having different image contents, instead of the information of the enlarged image frame.

That is, for example, when a moving image of a car is assumed, still images of the front view, side view, and rear view of the car are prepared as car planes, and plane numbers are given to the respective planes.
Then, in obtaining the change information about the car in the captured and input current image, by recording the plane number with a small difference (change amount) from the car plane and the change amount, the record data as the change information is recorded. The amount can be reduced.

The image frame position of the background image at the time of reproduction is changed vertically and horizontally with respect to the recorded image frame position information by operating the image frame position changing key of the key group 4 shown in FIG. can do. That is, when the image frame position change key is operated, the image frame position is changed in the direction specified by the change key with respect to the image frame position determined by the reproduced image frame position information, and the changed image is displayed. The background image at the frame position is read from the background plane 83BG. That is,
By using the image frame position changing key, the image frame position of the background image at the time of reproduction can be changed to an arbitrary position within the range of the background plane.

Further, a reproduction zoom key is provided, and when the reproduction zoom key is operated, the background image of the image frame enlarged or reduced according to the zoom ratio is read from the memory 83BG.
At this time, the data is interpolated or thinned according to the zoom ratio so as to fit the data of one screen of 720 pixels × 480 lines. In this way, regardless of the image frame position at the time of image capturing, the user can also enjoy making a desired picture on the reproducing side.

The moving image data from the signal processing circuit 85 is returned to the original analog signal by the D / A converter 86, is derived from the output terminal 87, and the reproduced image is displayed on the image monitor device connected to this output terminal. Is projected.

As described above, the information of the background plane and the moving object plane for each scene is first read from the disc, and then the change information is sequentially read from the disc, whereby the moving image of each scene can be reproduced. it can. In this case, since the amount of change information of each scene is very small, the change information of one scene is not extracted from the disk in time with the real time of the moving image, but a buffer memory is provided and the change information of each scene follows each plane information. It is also possible to take out the motion change information, store it in the buffer memory, and perform a process of sequentially reading out the motion change information from the buffer memory in accordance with the moving image.

In such a case, since the moving image reproduction process and the extraction of the reproduction signal from the disc can be separated, the plane information of the next scene is recorded on the disc during the reproduction of the previous scene. Can be extracted from and stored in another plane memory. By doing so, it is possible to continuously reproduce a plurality of scenes without interruption.

As described above, according to the present invention, the input image is divided into the background image and the moving object plane, which is recorded with high image quality, and at the same time, the change of the background image and the motion change of the moving object plane are performed together. Since recording and synthesizing are performed at the time of reproduction, it is possible to record a moving image with high image quality and smooth motion even in the case of a recording medium having a low recording transmission rate.

For example, conventionally, a so-called MPEG compression method of image data is known. In this method, the image information of one frame (still image) is sent first, and then the first. This is a method of taking the difference from the image frame of and recording the residual by compressing the data. The number of bits of the image data of the first one frame in this MPEG is, for example, 400 K bits when the data is compressed. This 400 K-bit image has a relatively high image quality.

Since this 400 K-bit image is one frame of information, if this is expressed in bps, one second is:
Since it consists of 30 frames, it corresponds to 12 Mbps.
Therefore, a fairly high quality image is obtained. MP
In the EG, since only the residual information is recorded as the subsequent information, the reproduced image is deteriorated,
The image of the first one frame itself has a good image quality.

On the other hand, according to the above-described configuration of the present invention, the information of the plurality of image planes of the background plane and the moving object plane is recorded as the image data of 12 Mbps equivalent to MPEG, and the number of bits is small. The moving image plane is moved based on the motion change information recorded by the number and is combined with the background plane to reproduce the moving image, so the image quality is good and the motion vector Since the information is real-time information, the movement is not jerky and is good.

It should be noted that the motion information separated from the background plane is not recorded separately in a moving object plane composed of still images of a plurality of moving objects as in the above example, but is recorded in a plurality of moving objects. The present invention can also be applied to an apparatus for compressing motion information including the data and recording the data separately from the background plane.

In the above example, the magneto-optical disk is used as the image data transmission medium. However, the image data is transmitted via a tape or another recording medium, and further, a cable or a transmission path using radio waves. Needless to say, the present invention is applicable.

[0206]

As described above, according to the present invention, an image is divided into a background plane and a moving object plane even with a transmission medium having a low transmission rate, and information of these plural image planes is compressed. Without transmitting or at a low compression rate that can maintain high image quality at low speed, motion change information is transmitted at high speed with a small number of bits.
The moving image plane is moved based on the motion change information and is combined with the background plane to reproduce the moving image, so the image quality is good, and the movement is also smooth and smooth. It is possible to obtain a reproduced image that is unique.

When the change information on the moving object plane information is compressed and transmitted, the amount of transmission data can be further reduced.

Further, as the background plane information is transmitted as a background image in a range wider than the image frame for one screen of the digital image signal, even when the motion change exceeds the image frame for one screen. The background image can be cut out from the background plane information according to the movement of the moving object. Therefore, an object moving in a range wider than one screen can be reproduced by combining it with the background image without missing the image of the object.

Also, when the change information about the background plane information is also transmitted, the background plane information memory means can store a background image in a range wider than the image frame for one screen. In plain memory,
By storing the sequentially updated background image, the change information of the background image detected as the difference between the background image in the background plane memory and the current image data becomes small,
The amount of transmitted data is small.

Further, when transmitting a background image in a range wider than an image frame for one screen as the background plane information, data indicating the position on the background plane is added to the moving object plane change information and transmitted. Since this is done, it is easy to properly compose the moving object plane on the background plane.

The information about the background plane and the moving object plane is obtained by forming the approximate background plane information and the approximate moving object plane information using information selected from typical image elements prepared in advance, and transmitting them as transmission information. The background plane and the moving object plane can be reconstructed by using the image element memory provided on the receiving side only by transmitting the identification information of the selected image element and the position information indicating the screen position thereof. Compared with the case where the information of the plane and the moving body plane is transmitted as it is, the information can be transmitted with a smaller amount of information.

[Brief description of drawings]

FIG. 1 is a block diagram of a disk recording apparatus as an embodiment of a digital image signal transmission apparatus according to the present invention.

FIG. 2 is a diagram for explaining an essential part of the present invention.

FIG. 3 is a diagram for explaining a signal recording timing in the example of FIG.

FIG. 4 is a diagram for explaining the example of FIG. 1.

FIG. 5 is a block diagram of an embodiment of the signal processing circuit 22 of the first embodiment of the digital image signal according to the present invention.

6 is a diagram for explaining the operation of the signal processing circuit 22 of FIG.

FIG. 7 is a diagram for explaining the operation of the signal processing circuit 22 of FIG.

8 is a diagram showing a part of a flowchart of the operation of the signal processing circuit 22 of FIG.

9 is a diagram showing a continuation of the flowchart of the operation of the signal processing circuit 22 of FIG.

10 is a diagram for explaining the operation of the signal processing circuit 22 of FIG.

11 is a diagram for explaining the operation of the signal processing circuit 22 of FIG.

FIG. 12 is a motion change information detection circuit 300 according to the embodiment of FIG.
It is a block diagram which shows one Example.

13 is a block diagram showing another embodiment of the motion change information detection circuit 300. FIG.

FIG. 14 is a diagram for explaining another embodiment of the digital image signal transmission device according to the present invention.

FIG. 15 is a diagram for explaining another embodiment of the digital image signal transmission device according to the present invention.

FIG. 16 is a block diagram of an embodiment of a digital image signal receiving apparatus according to the present invention.

FIG. 17 is a diagram for explaining an example of the background plane memory 23BG in one embodiment according to the present invention.

FIG. 18 is a diagram showing an example of a background image.

19 is a block diagram showing another embodiment of the motion change information detection circuit 300. FIG.

FIG. 20 is a block diagram of an example of a signal processing circuit 22 according to another embodiment of the present invention.

FIG. 21 is a diagram for explaining approximate background image information and approximate moving object still image information according to the present invention.

FIG. 22 is a diagram for explaining the timing of signal recording of another embodiment of the present invention.

FIG. 23 is a diagram for explaining an example of a background plane memory 23BG of another embodiment of the present invention.

FIG. 24 is a diagram for explaining changes in a still image of a background and a moving object.

FIG. 25 is a diagram for explaining the timing of signal recording of another embodiment of the present invention.

[Explanation of symbols]

 22 signal processing circuit 23BG background plane memory 23A1-23An animal body plane memory 24 compression circuit 26 compression encoding circuit 31 background plane 32-34 animal body plane memory 62 animal body plane separation circuit 62M difference memory 63 microcomputer 64BG approximate background plane memory 64A1 -64An Approximate moving object plane memory 65 Image element memory 300 Motion change information detection circuit

Claims (12)

[Claims] 1. Plane information generating means for generating background plane information representing still image information of a digital image signal and at least one moving object plane information representing moving image information of the digital image signal, and the background plane. Memory means for individually storing information and moving body plane information, moving body plane change which is a difference between the moving body plane information of the current frame of the digital image signal and the moving body plane information stored in the memory means An apparatus for transmitting a digital image signal, comprising: change information detecting means for detecting information; and transmitting means for transmitting the background plane information and moving object plane information in the memory means and the moving object plane change information. 2. A change information compressing means is provided between the change information detecting means and the transmitting means, and an output of the change information detecting means is compressed by the change information compressing means and supplied to the transmitting means. The transmission device for a digital image signal according to claim 1, wherein: 3. The digital image signal transmission device according to claim 2, further comprising plane information compression means for compressing the background plane information and the moving object plane information of the memory means and supplying the compressed information to the transmission means. An apparatus for transmitting digital image signals, wherein the compression rate of the plane information compression means is set to be lower than the compression rate of the change information compression means. 4. The digital image signal transmitting apparatus according to claim 1, wherein the memory means for storing the background plane information has a background in a range wider than an image frame for one screen of the digital image signal. A digital image signal transmission device characterized in that it stores an image. 5. The digital image signal transmission device according to claim 1, wherein the memory means for storing the background plane information has a background in a range wider than an image frame for one screen of the digital image signal. The change information detecting means also detects background plane change information which is a difference between the background plane information of the current frame of the digital image signal and the background plane information stored in the memory means. In addition, the digital image signal transmission device is provided with control means for updating the background plane information of the memory means based on the background plane change information detected by the change information detection means. 6. The digital image signal transmission device according to claim 5, wherein the control means re-creates the background plane change information detected by the change information detection means based on the updated background plane information. A digital image signal transmission device characterized by being formed. 7. The digital image signal transmission device according to claim 6, wherein said transmission means transmits updated background plane information as said background plane information and said re-formed background plane change information. A digital image signal transmission device, characterized in that it is adapted to transmit. 8. The digital image signal transmission device according to claim 5, wherein the control means adds data indicating a position on the background plane to the moving object plane change information. Image signal transmission device. 9. Plane information generating means for generating background plane information representing still image information of a digital image signal and at least one moving object plane information representing moving image information of the digital image signal, and a plurality of plane information generating means. Typical image storage means for storing typical image information, memory means for individually storing the background plane information and moving object plane information, and background plane information or moving object plane stored in the memory means For the information, the most similar typical image information is selected from the typical image information of the typical image storage means, the identification information corresponding to the selected typical image information and the screen position of the typical image information are selected. Means for obtaining position information indicating the moving object plane information of the current frame of the digital image signal, and the variation that is the difference between the typical image information. An apparatus for transmitting a digital image signal, comprising: change information detecting means for detecting conversion information, the identification data, the position information, and a transmitting means for transmitting the change information. 10. The digital image signal transmission device according to claim 1, wherein depth information indicating a front-back relation between the background plane and the moving body plane is transmitted. 11. The digital image signal transmitting apparatus according to claim 1, wherein the moving object is obtained so that the moving object plane information is the same as that obtained by shooting the moving object from all directions by a video camera. A digital image signal transmission device in which an image signal obtained by imaging is stored in the memory means and transmitted. 12. A receiving device for a digital image signal transmitted by the transmitting device for a digital image signal according to claim 1, wherein the still image information of the background plane information and the moving object plane information is stored respectively. A digital image signal receiving apparatus, comprising: a memory unit that performs the above operation, and a synthesizing unit that synthesizes the moving object plane information with the background plane information of the memory unit based on the change information to obtain an output digital image signal.