JPH11308618A - Image signal processor and method therefor, and image signal reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a conventional image-pickup element to enable panorama photographing. SOLUTION: This processor encodes an image signal, consisting of a plurality of moving photographing area images for coding into a bit stream conforming to the MPEG 2 standards and is provided with a motion vector detector 17 that detects a motion vector among a plurality of photographing areas and with a control section 18 that sums the motion vectors detected by the motion vector detector 17 and controls the coding of the image, when the summed motion vector exceeds a prescribed threshold level.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to MPEG2 (Movi).
ng Picture Experts Group Phase2) The bitstream syntax (bitstream sy) of the motion vector of the whole frame used for the panorama generation processing using the video sequence of the bitstream of the standard (video sequence)
The present invention relates to an image signal processing apparatus and method for an expression method and an image signal reproducing apparatus.

[0002]

2. Description of the Related Art MPEG2 (Moving Pictures Experts)
Group Phase 2) is an encoding method used for broadcasting, AV equipment, and the like, and has been widely used as an information compression technique for images / audio / data.

In a recording / reproducing apparatus for recording / reproducing an image signal, a single large-screen high-definition still image is formed by joining images sequentially taken by one recording / reproducing apparatus, such as panoramic photographing. May be expressed as a so-called panoramic composite image.

[0004]

However, the conventional recording /
Since the playback device can only express a large-screen still image of a size determined in the MPEG2 video standard,
There was no freedom of expression size.

[0005] For example, MP @ ML (main profile /
At the main level), there is a limit to the expression size, such as the resolution of 720 (H) × 576 (V) pixels.

[0006] A panoramic composite image is recorded by a recording / reproducing apparatus, sequentially photographed by one recording / reproducing apparatus, compressed and recorded on a recording medium such as a disk. At the time of reproduction, they are connected, for example, 1408 (H) × 72.
It is reproduced as one large-screen high-definition still image such as 0 (V).

Accordingly, the present invention relates to a bitstream syntax expression of a video sequence of an MPEG2 standard bit stream for realizing a panoramic composite image which cannot be expressed in a frame determined by the MPEG2 video standard. It is an object of the present invention to provide an image signal processing device and method, and an image signal reproducing device.

[0008]

In order to solve the above-mentioned problems, an image signal processing apparatus according to the present invention is directed to a bit stream in which an image signal composed of images of a plurality of moving photographed areas is encoded. At least encoding is performed, and a moving amount detecting means for detecting a moving amount between the plurality of photographing areas and a moving amount detected by the moving amount detecting means are added, and the added movement is calculated. Control means for controlling the image to be encoded when the amount exceeds a predetermined threshold.

[0009] The image signal processing method according to the present invention comprises:
A moving amount detecting step of performing at least encoding on an encoded bit stream of an image signal composed of images of a plurality of photographing regions to be moved, and detecting a moving amount between the plurality of photographing regions; A control step of adding the movement amounts detected by the movement amount detection means, and controlling to encode the image when the added movement amount exceeds a predetermined threshold. .

The image signal reproducing apparatus according to the present invention adds, to an image signal composed of images of a plurality of moving photographing regions, the amount of movement between the moving photographing regions, and adds the added amount. When the moving amount exceeds a predetermined threshold, an image signal is reproduced from a bit stream obtained by encoding the image signal, and is written as identification information in a unique information area in a predetermined recording unit of the bit stream. Identification information reading means for reading the added movement amount obtained by adding the movement amounts between the plurality of photographing areas, and the image data based on the added movement amount read by the identification information reading means. When reproducing a signal, the control means controls to combine images of a plurality of photographing areas obtained by decoding the bit stream into one image.

That is, in the present invention, when a plurality of still images are sequentially photographed and connected to form a single panoramic composite image, for example, an I frame or the like which is an intra-coded image is used. the motion vector amount is the amount of movement between frames is detected by the movement amount detecting means, only when the motion vector amount exceeds a predetermined value (mvx _ref), so as to compression, efficiently One panorama composite image is generated. As a result, panoramic photography by a recording / reproducing apparatus employing a normal CCD solid-state imaging device becomes possible.

[0012]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, as an embodiment of the present invention, an MPEG encoder for encoding an image signal into an MPEG2 standard bit stream and an MPEG decoder for decoding an MPEG2 standard bit stream into an image signal will be described. This will be described in detail with reference to the drawings.

The MPEG encoder and MPEG shown here
For the sake of convenience of description of the embodiments of the present invention, the decoder schematically shows the configuration by extracting a characteristic part of the present embodiment from a normal MPEG encoder and MPEG decoder. .

As shown in FIG. 1, the MPEG encoder has an input processing unit 11 for performing predetermined processing on an input image signal.
, A frame memory 12 for storing image data processed by the input processing unit 11 for each frame, a changeover switch 19, and a discrete cosine transform (discrete cosine transf).
The DCT includes a discrete cosine transform unit 13 that performs discrete cosine transform (COT) and outputs a discrete cosine coefficient, and a quantization unit 14 that quantizes the discrete cosine transform coefficient from the discrete cosine transform unit 13.

The input processing unit 11 performs A / D conversion of a video signal supplied from the outside, assigns an I picture, which is an intra-picture coded image, to sequentially obtained frame data, and then divides the frame data into macroblock units. Divide and output.

In the present embodiment, since a still image is recorded, an image to be allocated to frame data is an I picture. However, when a moving image is shot, a P picture which is a forward prediction coded image or a bidirectional prediction code is used. B, which is a chemical image
A picture is also used, and of course, a configuration such as a local decoder and motion prediction is used for this purpose.

In the frame memory 12, for example, an image photographed by a recording / reproducing apparatus, for example, 704 (H) × 480
(V) An image having a pixel resolution is stored in frame units.

The switch 19 is controlled to turn on when the amount of motion from the control unit 18 exceeds a certain value, to encode the frame of the I picture, and to otherwise turn off.

The discrete cosine transform unit 13 performs a discrete cosine transform process on the macroblock fetched from the frame memory 12, converts the macroblock into a discrete cosine transform coefficient, and sends it to the quantization unit 13. The quantization unit 14 quantizes the discrete cosine transform coefficients.

The MPEG encoder has a motion vector detector 17 for detecting a motion vector which is a moving amount between images.
And a control unit 18 for controlling each unit of the MPEG encoder.
And a variable-length encoding unit 15 that performs variable-length encoding on the data quantized by the quantization unit 14, and a buffer 16 that temporarily stores data from the variable-length encoding unit 15. .

The variable-length coding unit 15 adds user data (user_data), which is specific information described later, to the quantized data obtained from the quantization unit 14 for each recording unit of the MPEG2 bit stream, and changes the data in a predetermined manner. Perform long encoding.
As this recording unit, for example, a video sequence (vide
o sequence).

The buffer 16 temporarily holds data from the variable length coding unit 15. The encoded data stored in the buffer 16 is sequentially output to a recording / reproducing device (not shown).

The motion vector detector 17 detects a motion vector, which is a vector indicating the motion and movement amount of the imaging area over the entire screen, based on the macroblocks from the input processing unit 1 and the frame memory, and controls the motion vector. Send to 18.

That is, the motion vector detector 17 obtains a motion vector for the amount of movement between macro blocks. As the motion vector detector 17, those used for motion vector detection of a P picture which is a forward prediction coded image and a B picture which is a bidirectional prediction coded image can be used.

The control section 18 is a section for controlling each section of the MPEG encoder. The control unit 18 includes, for example, a CPU,
It is configured as a microcomputer including a ROM, a RAM, and the like.
The control unit 18 controls, for example, the opening and closing of the switch 19 and the processing of variable-length encoding in the variable-length encoding unit 15 based on the motion vector from the motion vector detector 17.

As shown in FIG. 2, the MPEG decoder includes a buffer 21 for temporarily storing input encoded data.
A variable length decoding unit 22 that performs variable length decoding of the encoded data from the buffer 21, an inverse quantization unit 23 that inversely quantizes the data from the variable length decoding unit 22 to obtain a discrete cosine transform coefficient, And an inverse discrete cosine transform unit 24 for performing an inverse discrete cosine transform of the discrete cosine transform coefficient from the quantization unit 23.

The buffer 21 temporarily stores encoded data input from a recording / reproducing device (not shown). The variable length coding unit 22 decodes the coded data from the buffer 21 into macroblock coded information. The variable length decoding unit 22 reads the identification information written in the unique information area for each recording unit of the encoded data.

The inverse quantization unit 23 inversely quantizes the data decoded by the variable length decoding unit 22 to obtain discrete cosine transform coefficients. The inverse discrete cosine transform unit 24 includes the inverse quantization unit 2
The inverse discrete cosine transform is performed on the discrete cosine transform coefficient from No. 3 to convert it into pixel space data.

The MPEG decoder includes a control section 26 for controlling each section of the MPEG decoder, a display control section 25 for controlling display of an image, and a memory for storing an image under the control of the display control section 25. 28, and an output processing unit 27 that performs a predetermined process on the image from the display control unit 25.

The control section 26 is a section for controlling each section of the MPEG decoder. The control unit 26 controls a predetermined process for displaying an image in the display control unit 25 based on the motion vector given from the variable length decoding unit 22.

In the control section 26, the variable length decoding section 2
2, user data (user_data), which is unique information, is extracted and sent to the frame memory.

The display controller 25 determines the positions of a plurality of images such as f0 to f15 based on the user data and pastes them to synthesize one still image. That is, an image capturing area of an image is determined based on a motion vector that is a moving amount written as identification information in user data, and one screen is synthesized from a plurality of images according to the image capturing area. This image composition will be described later.

As a result, it is possible to realize a panoramic composite image that cannot be expressed in a frame defined by the conventional MPEG2 video standard. The memory 28 includes a display control unit 25
The image is stored under the control of.

The output processing unit 27 performs D / A conversion on the image signal from the display control unit 25 and outputs it as an original output signal to the outside.

Subsequently, the above-described MPEG encoder and MP
Processing of an image signal in the EG decoder will be described.
These MPEG encoder and MPEG decoder perform encoding / decoding of an image signal bit stream of the MPEG standard.

In MPEG2, input image / audio / input
Data such as data is encoded based on the bit rate. For an image, the image is divided into m × n blocks, converted by an orthogonal function to concentrate signal power, and compress the entire information amount.

Image data encoded into a bit stream according to the MPEG2 standard has a hierarchical structure from a sequence layer to a block layer.

That is, a bit stream according to the MPEG2 standard is common to a sequence layer of a series of screen groups having the same attribute, a GOP (Group of Pictures) layer of a minimum unit of a screen group serving as a unit of random access, and one screen. Picture layer, a slice layer of information common to small screens obtained by arbitrarily dividing one screen, a macroblock layer of information common to pixel blocks (macroblocks) obtained by further dividing the slice layer, and the conversion coefficient itself Composed of a block layer.

Here, regarding the picture layer, the main layer
704 (H) × 480 for an NTSC television signal according to the level main format
(V) Target an image.

Each picture (picture) includes an I (Intra) picture, which is an intra-coded picture, and a forward predictive coded picture P (Pred) which is predictively coded in the forward direction in the display order.
ictive) picture, B (Bidi), which is a bidirectional coded image that is predictively coded bidirectionally in the forward and reverse directions in the display order
There is a picture type of rectionally predictive (picture), and these pictures are collectively referred to as a GOP (Group
of Pictures) layer.

An MPEG2 video sequence (video se
quence) is a recording unit in which the resolution or the like cannot be changed. MPE which is this recording unit
As shown in FIG. 3, the video sequence of G2 starts with a sequence header (sequence header), ends with a sequence end (sequence end), and B, B, I, B,
B, P pictures... The video sequence, which is the minimum unit for changing the resolution, represents one moving image between start and end.

As shown in FIG. 3, a moving image is represented using a moving image sequence defined as a set of video sequences, that is, a movie sequence. A still image is represented by defining a set of discontinuous frames of a video sequence (such as an I-picture) and defining the set as a set of still images. A set of video sequences for a still image is a still image sequence, that is, a still sequence.

By utilizing a video sequence in this manner, a plurality of types of reproduction modes for an image signal and a plurality of modes including a relationship with another video sequence, that is, a moving image and a still image are realized.

The reproduction mode which is the mode of the image signal is MP
It is identified by referring to user data (user_data) which is unique information of the bit stream of EG2.

More specifically, as shown in FIG.
2 bit stream video sequence (video sequ
The user data (user_data) of the sequence header (sequence_header) of the ence) is used. That is, byte 1 of the user data area that can be defined for each sequence
(Byte 1) and newly defined byte 2 (byte 2)
Is written with the identification information.

The user data of the sequence header is shown in FIG.
Is defined as shown below.

Byte 1 of the user data has a start ID (start ID) of the seventh bit b7 and an end ID (end).
The sixth bit b6 and the bit stream ID (Bit st
The third bit b3 and the fourth bit b4 are used for (reamID), and the second bit b2, the first bit b1, and the 0th bit b0 are used for the sequence ID (Sequence ID). Note that the fifth bit b5 is undefined.

If the start ID is "1", it is defined as the first video sequence of the moving picture or still picture sequence, and if the end ID is "1", it is defined as the last video sequence of the moving picture or still picture sequence. . Note that "b" at the end of the numeral indicates that the display is in binary.

If the bit stream ID is "00", it is defined as the first video sequence of the moving picture or still picture sequence, and if the end ID is "1", it is defined as the last video sequence of the moving picture or still picture sequence. I do. If the bit stream ID is “00”,
It is defined as MPEG2 (MD DATA2), and if "01", it is defined as MPEG2 (MP @ ML).

That is, the bit stream ID “00”
A frame rate of 30Hz means two frames or MP
It is expressed in the range defined by EG2, and is "0
"0" is expressed when the time interval is arbitrarily opened outside the MPEG2 standard frame.

In the moving image mode, if the sequence ID is “000”, a movie sequence (Movie sequence)
quence) and the shot mode (Shot mode)
1 ", the normal mode (No
rmal mode), and if it is “010”, the movie sequence is set to the long play mode.

Here, regarding the movie sequence,
Shot mode that does not require real-time playback (Shot m
ode), normal mode (N
ormal mode), and progressive (Progressive)
It has a long play mode (Long play mode) which is a long time recording mode on the premise of encoding an image.

The shot mode is used, for example, when compressing at a high bit rate using a memory. The bit rate in the shot mode is 15 Mbps.

In the normal mode, the MPEG @ MP @ M
L (main profile / main level) is not completely compliant. The average mode bit rate is 4 Mbps on average. The long play mode is a long time mode corresponding to a progressive image, and has an average bit rate of 1 Mbps or less.

As described above, the mode of the image signal is MPE
It is identified by the user data of the G2 bit stream.

Next, the so-called panorama composition will be described. The panorama composition is to compose a large screen from a plurality of screens having different photographing areas.

To generate a panoramic composite image by connecting a plurality of images f ₀ , f ₃ , f ₆ , f _9, etc., which are sequentially photographed by the recording / reproducing apparatus, an overlapped portion is detected. One still image is generated.

The motion vectors of f ₀ , f ₃ , f ₆ , f ₉ ,... Which are a plurality of 704 × 360 frames shown in A of FIG. 6 are detected, and as shown in B of FIG. , These f ₀ ,
The positions of f ₃ , f ₆ , f ₉ ,... are determined to determine the positions.

[0059] Here x, if the movement amount in the y direction is found, pasted to determine the position of the f ₃ relative to the f ₀ of B in FIG. At this time, a predetermined overlap occurs between f _{0 and} f ₃ . By subtracting these overlaps, from the set of f ₀ , f _3, f _{6 ,} f ₉ .
For example, one still image of 1408 (H) × 720 (V) is synthesized.

Alternatively, a still image having a size indicated by a broken line is extracted by storing it in a memory in accordance with a motion vector representing a moving amount between frames.

That is, the plurality of frames f ₀ , f ₃ , f ₆ , f ₉ ,... Are synthesized on a large screen of 1408 × 720 as shown by C in FIG.

[0062] For this reason, a video input continuously to the video sequence is treated as a moving image. Then, as shown at A in FIG. 7, f ₀ , which is input at, for example, 30 frames / second,
The motion vectors (MV ₀ , MV ₁ ) between the f ₁ and f ₂ frames are calculated. When the motion is stopped, the inter-frame motion vector (MV ₀ , MV ₁ ) is “0”. Then, a still image is extracted as indicated by B in FIG.

The extraction of a still image is performed under the condition that the sum of the motion vectors between a plurality of images exceeds a predetermined threshold. For example, a still image that satisfies the conditional expression | mvx ₀ + mvx ₁ + mvx ₂ | ≧ mvx _ref is extracted.

Specifically, in the MPEG encoder shown in FIG. 1, the control unit 18 closes the switch 19 when the above conditional expression is satisfied, and controls so as to extract the still image.

By slightly moving the recording / reproducing apparatus for photographing an image, a motion vector (MV ₂ ) between f ₂ and f ₃ frames is detected. The motion vector of the entire screen is detected in the x and y directions. The motion vector does not correspond to the subject but to the motion of the recording / reproducing apparatus itself.

Then, it is detected for each frame how much the entire screen has moved, and it is compared with a predetermined mvx _ref. If there is no motion, the video is discarded, and if there is motion, the I picture is encoded. .

The predetermined mvx _ref is determined by a value indicating how much the positions of a plurality of frames f ₀ , f ₃ , f ₆ , f ₉ ,... Is done.

[0068] For example, the first of f ₀ frame most uses as it is. The next f ₁ frame and did not move almost. Further, (a total of from f ₀ frame) next f ₂ frame also and did not move. and f ₃ frame and was moving, to adopt a f ₃ frame. Between f ₀ frames and f ₃ frames in this example becomes irregular.

In this way, the detected motion vector is written to a portion of the video sequence after the user data (user_data) byte 2 (byte 2). This user data is defined as follows.

That is, in the user data shown in FIG. 8, byte 1 (byte 1) has a start ID (start I
D), a seventh bit b7, an end ID (end ID), a sixth bit b6, a bit stream ID (Bit stream ID), a third bit b3 and a fourth bit b4, and a sequence ID.
The second bit b2, the first bit b1, and the zeroth bit b0 are used for (Sequence ID). Note that the fifth bit b5
Is undefined. Since the byte 1 has been described above, the description is omitted. Note that the sequence ID according to the present embodiment is “110”.

A new byte 2 (byte) of the user data
2) Assign 12 bits ranging from byte 3 (byte 3) to define mvx, assign 12 bits ranging from byte 4 (byte 4) to byte 5 (byte 5), and assign mvx
Is defined.

Then, a horizontal motion vector value is input to mvx [11: 0], and a vertical motion vector value is input to mvy [11: 0].

That is, the 0th bit b0 to the 7th bit b7 of the byte 3 and the 8th bit b8 to the 11th bit b11 of the byte 2 are mvx. Also, the 0th bit b0 to the 7th bit b7 of the byte 5 and the 8th bit b8 to the 11th bit b11 of the byte 4 are represented by m
Assign to vy.

Then, a horizontal motion vector value is input to mvx [11: 0], and a vertical motion vector is input to mvy [11: 0].

As described above, when a plurality of still images are sequentially photographed, the motion vector amount between each frame is detected, and the motion vector amount is defined in the user data in the MPEG video sequence. It is.

Next, the operation of the above-described recording / reproducing apparatus will be described based on a flowchart.

That is, in a series of steps of the present invention, as shown in FIG. 9, after detecting a motion vector for each frame in step SP1, the equation in step SP2 is checked.
That is, the respective x and y components are added, and x, y
If any of y exceeds mvx _ref and mvy _ref ,
It is determined that the condition is satisfied.

If the condition of step SP2 is not satisfied (No), the process ends at step SP3 without performing the processing relating to the frame.

If the condition of step SP2 is satisfied (Yes), at step SP4, an I picture encoding process for the frame is performed.

At step SP5, the motion vector amount indicating the actual moving image
The data is written in the user data (user_data) area, which is the unique information of the standard bit stream, and the process is terminated.

The present invention is not limited to the above embodiment. The present invention can be applied to, for example, a bit stream other than the MPEG2 standard.

[0082]

As described above, according to the present invention,
A single panoramic composite image is generated by sequentially photographing a plurality of still images and joining them, so that panoramic photographing using an ordinary CCD solid-state imaging device becomes possible.

Further, a motion vector amount which is a movement amount between frames such as an I frame which is an intra-frame coded image is detected, and encoding processing is performed only when the motion vector amount exceeds a predetermined value. Therefore, the processing efficiency when generating a panoramic composite image can be improved as compared with the case where all the frames are adopted.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an MPEG encoder.

FIG. 2 is a block diagram illustrating a configuration of an MPEG decoder.

FIG. 3 is a diagram illustrating a movie sequence composed of a plurality of video sequences.

FIG. 4 is a diagram showing a configuration of a video sequence.

FIG. 5 is a diagram showing a definition of user data.

FIG. 6 is a diagram illustrating panorama synthesis.

FIG. 7 is a diagram illustrating a motion vector.

FIG. 8 is a diagram showing a definition of user data for a motion vector.

FIG. 9 is a flowchart showing a series of steps of panorama synthesis. [Brief Description of the Drawings] 12 frame memories, 17 motion vector detectors, 1
5 variable length coding unit, 18 control unit, 22 variable length decoder, 25 display control unit, 26 control unit

Claims (16)

[Claims] 1. An image signal processing apparatus for performing an encoding process of encoding an image signal composed of images of a plurality of moving imaging regions into a bit stream, wherein a moving amount between the plurality of imaging regions is detected. Moving amount detecting means; controlling means for adding the moving amounts detected by the moving amount detecting means, and controlling to encode the image when the added moving amount exceeds a predetermined threshold. An image signal processing device comprising: 2. The bit stream includes an intra-coded image, a forward predictive coded image predictively coded in the forward direction in display order, and a bidirectional coded image in the forward and reverse directions in the display order. 2. The image signal processing apparatus according to claim 1, wherein an image group composed of the prediction coded images is used as a unit. 3. An identification information writing unit for writing the added movement amount as identification information in a unique information area of a predetermined recording unit of the bit stream, wherein the control unit determines that the added movement amount is 2. The method according to claim 1, wherein when the threshold value is exceeded, the image is encoded, and the identification information writing means is controlled to write the added movement amount as identification information in the bit stream. Image signal processing device. 4. An identification information reading means for reading the added movement amount written as identification information in a unique information area in a predetermined recording unit of the bit stream; When reproducing the image signal based on the added movement amount,
4. The image signal processing device according to claim 3, further comprising control means for controlling to combine images of a plurality of photographing areas obtained by decoding the bit stream into one image. 5. An image according to claim 4, wherein said control means is capable of setting an arbitrary number of images in said plurality of photographing regions controlled to be combined into one image. Signal processing device. 6. The bit stream is MPEG2 (Motion)
2. The image signal processing apparatus according to claim 1, wherein the recording unit is a video sequence conforming to the MPEG2 standard, according to the ving Pictures Experts Group Phase 2) standard. 7. An image signal processing method for performing an encoding process for encoding an image signal composed of images of a plurality of moving imaging regions into a bit stream, wherein a movement amount between the plurality of imaging regions is detected. A moving amount detecting step, and a controlling step of adding the moving amounts detected by the moving amount detecting means, and controlling to encode the image when the added moving amount exceeds a predetermined threshold. An image signal processing method comprising: 8. The bit stream includes an intra-picture coded image, a forward prediction coded image predicted and coded forward in display order, and a bidirectional coded image forward and backward in display order. 8. The image signal processing method according to claim 7, wherein an image group composed of predictive coded images is used as a unit. 9. An identification information writing step of writing the added movement amount as identification information in a unique information area of a predetermined recording unit of the bit stream, wherein the control step comprises: The method according to claim 7, wherein when the threshold value is exceeded, the image is encoded, and the added amount of movement in the identification information writing step is controlled to be written as identification information in the bit stream. Image signal processing method. 10. An identification information reading step for reading out the added movement amount written as identification information in a unique information area in a predetermined recording unit of the bit stream, and read in the identification information reading step. When reproducing the image signal based on the added movement amount,
10. The image signal processing method according to claim 9, further comprising a control step of performing control such that images of a plurality of photographing regions obtained by decoding the bit stream are combined into one image. 11. The image according to claim 10, wherein said control means can set an arbitrary number of images in said plurality of photographing areas controlled to be combined into one image. Signal processing method. 12. The bit stream is MPEG2
10. The image signal processing method according to claim 9, wherein the method is based on (Moving Pictures Experts Group Phase2) standard, and the recording unit is the video sequence of the MPEG2 standard. 13. An image signal comprising a plurality of images of a plurality of photographed areas to be moved, the moving amount between the moving photographing areas is added, and the added moving amount exceeds a predetermined threshold value. An image signal reproducing apparatus for reproducing an image signal from a bit stream obtained by encoding the image signal, wherein the plurality of photographing areas written as identification information in a unique information area in a predetermined recording unit of the bit stream. Identification information reading means for reading the added movement amount obtained by adding the movement amount between, when reproducing the image signal based on the added movement amount read by the identification information reading means,
An image signal reproducing apparatus, comprising: control means for controlling images of a plurality of photographing areas obtained by decoding the bit stream to be combined into one image. 14. The bit stream includes an intra-coded image, a forward predictive coded image predictively coded in the forward direction in the display order, and a bidirectional predictive coded image in the forward and reverse directions in the display order. 14. The image signal reproducing apparatus according to claim 13, wherein an image group composed of predicted encoded images is used as a unit. 15. The image according to claim 13, wherein said control means can set an arbitrary number of images in said plurality of photographing regions controlled to be combined into one image. Signal playback device. 16. The bit stream is MPEG2
14. The image signal reproducing apparatus according to claim 13, wherein the recording unit is based on the (Moving Pictures Experts Group Phase2) standard, and the recording unit is the video sequence of the MPEG2 standard.