JP3277925B2 - Image processing apparatus and method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and method, and more particularly, to a process for inserting other image data into intra-picture and inter-picture encoded image data.

[0002]

2. Description of the Related Art A digital video tape recorder (VTR) is known as an image recording apparatus for digitally compressing a moving image and recording it on a recording medium such as a magnetic tape. The compression method includes a fixed-length coding compression method and a variable-length coding compression method. Compared with the fixed-length coding compression method, the variable-length coding compression method can achieve a high compression ratio of about 1/10 to 1/20 without significantly deteriorating the image quality. The amount of compressed data is undefined, and editing (such as link records), search,
There is a disadvantage that trick play (random access, fast forward play, reverse play, etc.) becomes difficult.

[0003] Therefore, MPEG (Moving Pic)
The true Expert Group uses intra-frame (or field) encoding and predictive encoding with a future and / or past frame (or field) as a reference screen, and uses an intra-frame encoding screen (hereinafter, I-frame). ) Are periodically arranged, and a screen between I frames is set as a prediction coding screen. In this recording method,
The compressed data of the backward or bidirectional inter-frame predictive coding screen is recorded on the recording medium after the compressed data of the prediction reference screen.

[0004]

In such a recording method, for example, in the insert recording (joint recording), there is a restriction on the joining position of the images. For example, even if an attempt is made to connect another screen immediately after the backward or bidirectional interframe predictive coding screen, the image data of the screen necessary for decoding the reverse or bidirectional interframe predictive coding image is recorded on the recording medium. It is necessary to save the information, and at the joint portion, the prediction relationship between the old screen to be inserted and the new screen to be inserted becomes discontinuous, and the reproduced screen is disturbed.

[0005] An object of the present invention is to provide an image processing apparatus and a method therefor which have solved such disadvantages.

[0006]

An image processing apparatus according to the present invention inserts second image data into first image data after being encoded using intra-picture encoding and inter-picture encoding. A synthesizing means, and a control means for controlling the synthesizing means such that an insert point of the second image data is immediately after the screen of the first image data encoded in the screen. .

[0007] An image processing method according to the present invention is an image processing method in which second image data is inserted into first image data after being encoded using intra-picture encoding and inter-picture encoding. , The insert point of the second image data is
It is characterized in that the control is performed such that it is immediately after the screen of the first image data encoded in the screen.

[0008]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing the configuration of a digital VTR according to an embodiment of the present invention.

In FIG. 1, reference numeral 10 denotes an analog input terminal of a moving image signal to be recorded, 12 denotes an A / D converter for digitizing an analog image signal from the input terminal 10, and 14 denotes an A / D converter. This is a blocking circuit that blocks raster-scanned image data output from 12 into blocks of horizontal i pixels × vertical j pixels. Reference numeral 16 denotes a digital input terminal for a moving image signal to be recorded,
Reference numeral 8 denotes a buffer for image data from the input terminal 16. It is assumed that image data to be input to the input terminal 16 has already been blocked. Reference numeral 20 denotes a switch for selecting the output of the blocking circuit 14 or the output of the buffer 18.

Reference numeral 22 denotes a subtractor for subtracting the predicted value from the output of the switch 20, and reference numeral 24 denotes a switch for selecting the output of the switch 20 (a contact) or the output of the subtractor 22 (b contact). The switch 24 is connected to a contact when performing intra-frame coding, and is connected to a contact when performing inter-frame predictive coding.

Reference numeral 26 denotes a DCT circuit for transforming the data selected by the switch 24 into a frequency domain by discrete cosine transform, and reference numeral 28 denotes a quantizer which quantizes an output (frequency coefficient) of the DCT circuit 26 in a quantization step for each frequency coefficient. This is a quantization circuit to be converted.

Reference numeral 30 denotes an inverse quantization circuit for inversely quantizing the output of the quantization circuit 28; 32, an inverse DCT circuit for converting the output of the inverse quantization circuit 30 into a time domain; and 34, an inverse DCT circuit 32. The adder adds 0 to the output during intra-frame encoding and a predicted value during inter-frame predictive encoding. The output of the adder 34 is the local decoded value of intra-frame or inter-frame predictive coding.

A motion vector detecting circuit 36 for detecting a motion of an image between two screens (normally, a current screen and a previous screen);
Reference numeral 38 denotes a motion compensation frame prediction circuit that performs motion compensation on the output of the added value 34 in accordance with the detection value of the motion vector detection circuit 36, and the output is a prediction value. Reference numeral 40 denotes a switch which is opened in intra-frame coding and closed in inter-frame coding. The prediction value output from the motion compensation frame prediction circuit 38 is applied to the subtractor 22,
The voltage is applied to the adder 34 via the switch 40.

Reference numeral 42 denotes a variable length coding circuit for performing variable length coding on the output of the quantization circuit 28, and reference numeral 44 denotes a variable length coding circuit 42.
Is a buffer memory for buffering the output of.
The quantization characteristics of the quantization circuit 28 are controlled according to the amount of data stored in the buffer 44. Reference numeral 46 denotes an additional circuit for adding an error correction code, a synchronization code Sync, an ID signal, and identification signals for intra-frame coding and inter-frame coding to the output of the buffer 44. Reference numeral 48 denotes a modulation circuit that performs low-frequency suppression modulation on the output of the additional circuit, and reference numeral 50 denotes a recording amplifier that amplifies the output of the modulation circuit 48 to a predetermined level.

Numeral 52 is a magnetic head for recording and reproduction, and numeral 54 is a magnetic tape as a recording medium.

Reference numeral 56 denotes a reproduction amplifier for amplifying the reproduction output of the recording / reproduction head 52, 58 a demodulation circuit for demodulating the output of the reproduction amplifier 56, and 60 a data from the output of the demodulation circuit 54 in accordance with the synchronization code Sync and the ID signal. Play,
A data reproducing circuit for performing error correction using an error correction code, 62
Is a buffer memory for buffering playback data output from the data playback circuit 60, and 64 is a buffer memory.
A variable length decoding circuit for performing variable length decoding on the output data of
66 is an inverse quantization circuit for inversely quantizing the output of the variable length decoding circuit 64, and 68 is an inverse DCT for the output of the inverse quantization circuit 66.
This is an inverse DCT circuit for conversion.

Reference numeral 70 denotes an adder for adding the predicted value to the output of the inverse DCT circuit 68, and reference numeral 72 denotes the output (a
This is a switch for selecting the contact (contact) or the output of the adder 70 (contact b). The switch 72 is connected to the contact a in the case of intra-frame coding and to the contact b in the case of inter-frame coding according to the coding identification signal detected by the data reproducing circuit 60.

Reference numeral 73 denotes a motion compensation frame prediction circuit which calculates a motion compensation frame prediction value from the reproduced image data selected by the switch 68. The motion compensation frame prediction circuit 73 includes a motion compensation frame prediction circuit 38 of a recording system.
Although the same circuit is also used as above,
Different reference numerals are used.

Reference numeral 74 denotes an inverse blocking circuit for returning the reproduced image data selected by the switch 72 to raster scanning.
6 is a D / A converter for converting output data of the inverse blocking circuit 74 into an analog signal, and 78 is a D / A converter 76
Is an analog playback image output terminal for outputting the output of the above to the outside. A buffer 80 buffers the reproduced image data selected by the switch 72, and a buffer 80
Is a digital reproduced image output terminal for outputting the output of the digital reproduction to the outside.

Reference numeral 84 denotes a switch for transferring image data necessary for inter-frame coding of an image to be inserted from the recorded images to the motion compensation frame prediction circuit 38 during insert recording. Reference numeral 86 denotes a control circuit for controlling the whole, and in particular, the switches 20, 24, 40, 84
Is controlled.

FIG. 2 is a detailed circuit diagram of the motion compensation frame prediction circuit 38, and FIG. 3 is a detailed circuit diagram of the motion compensation frame prediction circuit 73. Two frame memories 100 and 102 connected in series, a forward prediction circuit 104, a backward prediction circuit 106, the forward prediction circuit 104, an adder 108 for adding the outputs of the backward prediction circuit 106, and the forward prediction circuit 104 , A switch 110 for selecting the output of the backward prediction circuit 106 or the adder 108.

As shown in FIG. 2, in the recording system, the motion vector detected by the motion vector detection circuit 36 is applied to the forward prediction circuit 104 and the backward prediction circuit 106, and the forward prediction circuit 104 and the backward prediction circuit 106
Outputs a motion-compensated predicted value for each direction.

The switching of the switch 110 is controlled by the control circuit 86 according to the compression effect, image quality, special reproduction function, and the like.

FIG. 4 shows an intra-frame coded picture (I-frame), a unilateral prediction coded picture (hereinafter referred to as a P-frame) using one of the future or past I-frame as a reference picture.
In addition, an example of a recording order of a bi-prediction encoded screen (hereinafter, referred to as a B frame) in which an I frame and a P frame are bi-predicted as a reference screen will be described. The appearance frequency and order of the I, P, and B frames are adaptively adjusted according to the compression ratio, image quality, and the like.

First, a normal recording / reproducing operation will be described. In a normal recording / reproducing operation, the control circuit 86 turns off the switch 84.

In the case of an analog input, the A / D converter 12 digitizes the analog image signal from the input terminal 10 and the blocking circuit 14 blocks the output image data of the A / D converter 12. The switch 20 is connected to the a contact. In the case of digital input, the input image data of the input terminal 16 is applied to the b contact of the switch 20 via the buffer 18, and the switch 20 is connected to the b contact.

On the screen for intra-frame coding, the control circuit 86 connects the switch 24 to the contact a and turns off the switch 40. As a result, the output of the switch 20 (the output of the blocking circuit 14 or the output of the buffer 18) becomes DC
DCT transformation and quantization are performed by the T circuit 26 and the quantization circuit 28.

The output of the quantization circuit 28 is the inverse quantization circuit 30
The decoded value is passed through an adder 34 and applied to a motion vector detection circuit 36 and a motion compensation frame prediction circuit 38. The motion vector detection circuit 36 detects a motion vector of the image from the output of the adder 34 and the current image data from the switch 20,
It is applied to the motion compensation frame prediction circuit 38. The motion-compensated frame prediction circuit 38 sequentially stores the output of the adder 34 in the frame memories 100 and 102, and outputs a predicted value that has been motion-compensated according to the motion vector detected by the motion vector detection circuit 36.

On the screen for inter-frame encoding, the control circuit 86 connects the switch 24 to the contact "b" and turns on the switch 40. The subtractor 22 subtracts the prediction value from the motion compensation frame prediction circuit 38 from the output of the switch 20, and outputs a prediction error. The prediction error is applied to the DCT circuit 26 via the switch 24, and is DCT-transformed and quantized by the DCT circuit 26 and the quantization circuit 28.

The output of the quantization circuit 28 is the inverse quantization circuit 30
And decoded by the inverse DCT circuit 32. The adder 34 adds the predicted value to the output of the inverse DCT circuit 32. Adder 3
The output of 4 is the local decoded value of the inter-frame coded data. The output of the adder 34 is a motion compensation frame prediction circuit 38.
, The frame memories 100 and 102
Is not remembered.

The data encoded in the frame or between the frames is subjected to variable-length encoding by the variable-length encoding circuit 42. The output of the circuit 42 is applied to an addition circuit 46 via a buffer 44, and is added with an error correction code, a synchronization code Sync for synchronizing blocks, an ID signal for identifying a synchronization block, and an encoding identification signal. Output in a synchronous block of size. The encoded identification signal is
It is supplied from the control circuit 86.

The modulation circuit 48 performs low frequency suppression modulation on the output of the additional circuit 46. The output of the modulation circuit 48 is the recording amplifier 5
0 is applied to the magnetic head 52 via the magnetic tape 54.
Will be recorded.

At the time of normal reproduction, the recording signal of the magnetic tape 54 is reproduced by the magnetic head 52, and the head output is applied to the demodulation circuit 58 via the reproduction amplifier 56 and demodulated. The data reproducing circuit 60 detects the ID, the compressed data, the error correction code and the coding identification signal from the output of the demodulation circuit 58 using the synchronization code Sync, corrects the recording / reproducing error with the error correction code, and detects the detected coding identification. The switch 72 is controlled by a signal.

Output of the data reproducing circuit 60 (reproduced data)
Is applied to the variable length decoding circuit 64 via the buffer 62. The variable length decoding circuit 64 decodes the variable length code portion of the compressed data, and the output is subjected to inverse quantization and inverse DCT by an inverse quantization circuit 66 and an inverse DCT circuit 68.

The adder 70 adds the predicted value to the output of the inverse DCT circuit 68. The output of the inverse DCT circuit 68 is connected to the contact a of the switch 72, and the output of the adder 70 is connected to the contact b of the switch 72.
Supplied to the contacts. The switch 72 is connected to the data reproduction circuit 6
Under the control of 0, the connection is made to the a-contact for the intra-frame coded screen and to the b-contact for the inter-frame coded screen. Therefore, the output of the switch 72 is reproduced image data obtained by appropriately decoding the intra-frame encoded data and the inter-frame encoded data.

The motion-compensated frame prediction circuit 73 outputs a predicted value of the motion-compensated frame prediction from the output of the switch 72, similarly to the motion-compensated frame prediction circuit 38.

The deblocking circuit 74 returns the output of the switch 72 to raster scanning, and outputs the output to the D / A converter 76.
Is converted to an analog signal by the analog output terminal 7
8 to the outside. The output of switch 72 also
The rate is adjusted by the buffer memory 76 and output from the digital output terminal 82 to the outside.

Next, with reference to FIG. 5, an operation of insert recording (joining recording) for recording a new image from the middle of an existing recorded image so as to be connected will be described. It is assumed that an image to be inserted is input from the input terminal 10 or the input terminal 16. However, for the sake of simplicity, it is assumed that the inter-frame prediction coding screen is only a B frame that uses the past and future intra-frame coding screens (I frames) as reference screens. Also, the coded data of the intra-frame coded screen is indicated by adding i to the frame number, and the coded data of the inter-frame coded screen is indicated by b (k1, k
2) is shown. k1 and k2 are frame numbers of the reference screen.

FIG. 5A shows a prediction relationship between the input order (or reproduction order) of the video signal to be insert-edited and inter-frame coding, and FIG. 5B shows the recording order (coding order). FIG.
(A) corresponds to the output of the switch 20. FIG. 6 (c)
Is the input order of the video signal to be inserted, (d) is the prediction relationship and the encoding method of the video signal to be inserted according to the present embodiment, and (e) is the recording order after the insertion (coding order). Is shown.

Here, after frame # 3, FIG.
Assume that the image after frame # 50 shown in (c) is insert-recorded. In this case, since frame # 3 is inter-frame encoded using frames # 1 and # 4 as reference frames, encoded data I4 of frame # 4 cannot be deleted.

Therefore, in the present embodiment, the compressed data 4i of the frame # 4 necessary for decoding the frame # 3 is left, and the position after the data 3b (0, 4) where the intra-frame coded screen is to be arranged. Therefore, recording of the image to be inserted (from frame # 50) is started.

Also, the image to be inserted (frame # 50 and thereafter) is left as it is in frame # 50, frame # 50.
# 54 is an I frame, frames # 51, # 52, # 53
Is a B frame with frames # 50 and # 54 as reference frames, but in this embodiment, in order to maintain the period of the I frame, the frames # 51, # 52, and # 52 are used as reference frames instead of frame # 50. To use frame # 2.

In the process of searching for the recording start point of the insert recording, the switch 84 is turned on, and the reproduction data of the I frame (frame # 4 in this embodiment) immediately after the insert point of the existing recording is recorded. The data is transferred to the motion compensation inter-frame prediction circuit 38. This allows frame # 2 to be
Frames # 51 and # 5 of the image to be inserted
2, # 53 can be used as a reference frame at the time of inter-frame predictive coding.

When the recording-system motion-compensation inter-frame prediction circuit 38 and the reproduction-system motion-compensation inter-frame prediction circuit 73 are also used, the storage of the frame memories 100 and 102 is preserved during insert recording. What should I do?

Therefore, in this embodiment, the frames # 51,
The frames # 52 and # 53 are inter-frame predictive encoded using the frame # 4 and the frame # 54 as reference frames, and the recording order of the encoded data on the magnetic tape 54 after the insert recording is shown in FIG. Become like

By recording in this way, not only the arrangement rules of intra-frame coding and inter-frame coding are maintained before and after insertion, but also the relationship between reference frames for inter-frame prediction is maintained, so that reproduction is possible. The operation can be simplified, and the load on the reproduction process can be reduced.

When recording is performed as shown in FIG. 5 (e), the reproduction output sequence is that frames # 51, # 2, # 3, and # 4 are reproduced and output after frame # 51. In other words, this is the same as insert recording of frame # 51 and subsequent frames after frame # 4, but the shift of one frame is not so problematic.

FIG. 6 shows an example of a recording track pattern according to this embodiment.

Next, a description will be given of an embodiment in which the I frame of the recorded image after the insertion point is stored and the first frame of the image to be inserted is deleted. FIG. 7A shows a prediction relationship between the input order (or reproduction order) of the video signal to be insert-edited and the inter-frame coding, and FIG. 7B shows the recording order (coding order). FIG. 7C shows the input order of the video signal to be inserted, FIG. 7D shows the prediction relationship and the encoding method of the video signal to be inserted according to the present embodiment, and FIG. 7E shows the recording order after the insertion. (Coding order),
(F) shows the playback screen order of the recorded image after insertion.

Assume that frame # 50 and subsequent frames are inserted immediately before frame # 3. In this case, frames # 3 and # 4 become unnecessary, but since frame # 2 is inter-frame coded using frames # 1 and # 4 as reference frames,
The encoded data 4i of frame # 4 cannot be deleted.

Therefore, in this embodiment, the compressed data 4i of the frame # 4 necessary for decoding the frame # 2 is left, and the data 3b (0, 4) is also left to maintain regularity. Then, after the data 4i, an insert flag indicating the actual insertion point is recorded, and the image to be inserted (from frame # 50) is recorded after the data 3b (0, 4). For an image to be inserted (from frame # 50), frame # 4 is set as the first screen, and is coded in a predetermined order. That is, frames # 50, # 51, and # 52 are inter-coded using frames # 4 and # 53 as reference frames.

As in the case of FIG. 5, in the process of searching for the recording start point of the insert recording, the switch 84 is turned on, and the I frame immediately after the insert point of the existing recording (frame # 4 in this embodiment) ) Is transferred to the motion compensation inter-frame prediction circuit 38 of the recording system. Thus, frame # 2 can be used as a reference frame for inter-frame predictive coding of frames # 50, # 51, and # 52 of the image to be inserted.

Of course, in the case where the motion compensation inter-frame prediction circuit 38 of the recording system and the motion compensation inter-frame prediction circuit 73 of the reproduction system are also used, the storage of the frame memories 100 and 102 is preserved during insert recording. What should I do?

After the insert recording, the recording order of the encoded data on the magnetic tape 54 is as shown in FIG. 7E. When this is reproduced, the frame # 3 is skipped by the insert flag, and the frame is read. After # 2, frames # 4, # 50,... Follow.

Also in FIG. 7, before and after insertion, not only the arrangement rules of intra-frame coding and inter-frame coding are maintained, but also the relationship between reference frames for inter-frame prediction is maintained, thereby simplifying the reproducing operation. Yes, the load of the reproduction process is reduced.

FIG. 8 shows an example of a recording track pattern corresponding to FIG.

Next, an embodiment in which a frame after the I frame before the insert point is deleted from the recorded image will be described. FIG. 9A shows a prediction relationship between the input order (or reproduction order) of the video signal to be insert-edited and the inter-frame coding, and FIG. 9B shows the recording order (coding order). FIG.
(C) shows the input order of the video signal to be inserted,
(D) shows the prediction relationship and the encoding method of the video signal to be inserted according to this embodiment, and (e) shows the recording order (encoding order) after insertion.

Here, frame # 8 which is an I frame
Immediately before the frame # 50 shown in FIG. 7C. In the present embodiment, the frame immediately before the first I frame (frame # 4 in FIG. 9) is deleted from the insert point. That is, frames # 5 and #
6, delete # 7. In addition, the first few frames of the image to be inserted (from frame # 50 onward) are inter-frame encoded using the first I frame past the insertion point as a reference frame.

As in the case of FIG. 5, in the process of searching for the recording start point of the insert recording, the switch 84 is turned on, and the I-frame immediately before the insert point of the existing recording (frame # 4 in this embodiment) ) Is transferred to the motion compensation inter-frame prediction circuit 38 of the recording system and stored. Thus, frame # 4 can be used as a reference frame for inter-frame predictive coding of frames # 50, # 51, and # 52 of the image to be inserted.

Of course, in the case where the motion compensation inter-frame prediction circuit 38 of the recording system and the motion compensation inter-frame prediction circuit 73 of the reproduction system are also used, the storage of the frame memories 100 and 102 is preserved during insert recording. What should I do?

After the insert recording, the recording order of the encoded data on the magnetic tape 54 is as shown in FIG. 9E. When this is reproduced, the frames # 50 and thereafter are reproduced after the frame # 4. . That is, it is the same as connecting frame # 50 and subsequent frames after frame # 4.

Also in FIG. 9, before and after insertion, not only the arrangement rules of intra-frame coding and inter-frame coding are maintained, but also the relationship between reference frames for inter-frame prediction is maintained, thereby simplifying the reproducing operation. Yes, the load of the reproduction process is reduced.

FIG. 10 shows an example of a recording track pattern for FIG.

In the above description, a frame is used as a coding unit. However, it is needless to say that a compression method that uses both intra-field coding and inter-field coding with a field as a coding unit may be used. Further, the arrangement period of the intra-frame (or field) encoded screen is not limited to the above example, and the distribution of bilateral prediction and unidirectional prediction is not limited to the above example. D
It goes without saying that compression methods other than the combination of CT and variable length coding can also be applied to the present invention.

If the image data to be insert-recorded is encoded and recorded on the recording medium in the same manner as the image data to be insert-edited, the data portions that do not need to change the reference frame and the like are transferred in a compressed state. Needless to say, recording is preferable.

Although an example has been described in which a magnetic tape is used as a recording medium, the use of other recording media such as a magnetic disk, an optical disk, a magneto-optical disk, and a solid-state memory is also included in the scope of the present invention.

[0068]

As can be easily understood from the above description, according to the present invention, image data coded by using intra-picture coding and inter-picture coding so that a reproduced picture is not disturbed. , Other image data can be inserted.

[Brief description of the drawings]

FIG. 1 is a schematic block diagram of an embodiment of the present invention.

FIG. 2 is a schematic configuration block diagram of a motion compensation frame prediction circuit 38.

FIG. 3 is a schematic configuration block diagram of a motion compensation frame prediction circuit 73.

FIG. 4 is an explanatory diagram of a prediction direction.

FIG. 5 is a timing chart of the first insert recording in the present embodiment.

FIG. 6 is an example of data arrangement on a recording track pattern with respect to FIG. 5;

FIG. 7 is a timing chart of the second insert recording in the embodiment.

8 is an example of data arrangement on a recording track pattern with respect to FIG. 7;

FIG. 9 is a timing chart of the third insert recording in the present embodiment.

FIG. 10 is an example of data arrangement on a recording track pattern with respect to FIG. 9;

[Explanation of symbols]

 10: Analog input terminal 12: A / D converter 14: Blocking circuit 16: Digital input terminal 18: Buffer 20: Switch 22: Subtractor 24: Switch 26: DCT circuit 28: Quantization circuit 30: Inverse quantization circuit 32: inverse DCT circuit 34: adder 36: motion vector detection circuit 38: motion compensation frame prediction circuit 40: switch 42: variable length coding circuit 44: buffer memory 46: additional circuit 48: modulation circuit 50: recording amplifier 52 : Recording / reproduction magnetic head 54: Magnetic tape 56: Reproduction amplifier 58: Demodulation circuit 60: Data reproduction circuit 62: Buffer memory 64: Variable length decoding circuit 66: Inverse quantization circuit 68: Inverse DCT circuit 70: Adder 72 : Switch 73: compensation frame prediction circuit 74: inverse blocking circuit 76: D / A converter 78 Analog output terminal 80: buffer 82: Digital Output terminal 84: switch 86: control circuit 100, 102: frame memory 104: forward prediction circuit 106: backward prediction circuit 108: Adder 110: Switch

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁷ Identification code FI H04N 7/32 G11B 27/08

Claims (2)

(57) [Claims] A synthesizing unit that inserts second image data into first image data after being encoded using intra-screen encoding and inter-screen encoding; and an insertion point of the second image data. A control unit for controlling the synthesizing unit so as to be immediately after the screen of the first image data encoded in the screen. 2. An image processing method for inserting second image data into first image data which has been encoded using intra-screen encoding and inter-screen encoding, wherein the second image data Is the first point encoded in the screen.
An image processing method comprising controlling the image data to be immediately after the screen of the image data.