JP2000078524A - Image processor, image processing method and provision medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To record s still image in a way that the still image inserted in a moving picture can be reproduced with high image quality. SOLUTION: A pre-processing section 22 reads image data that are stored in a storage section 21 and photographed by a photographing section 31 according to an instruction of a still picture control section 23 and stores the read data to a buffer 24. A still picture control section 23 controls a read operation of a pre-processing section 22 so that the buffer 24 can reserve a data amount by which a picture designated for a still picture can be reproduced with high image quality when a still picture button provided to an operation section 32 is depressed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and method, and a providing medium, and more particularly, to a method for recording a still image into a moving image so that the still image has a high image quality when inserted into the moving image. Image processing apparatus and method for performing processing,
In addition, it relates to a providing medium.

[0002]

2. Description of the Related Art FIG. 10 is a block diagram showing a configuration of an example of a conventional video camera image compression encoding apparatus 10. The image data input to the image compression encoding apparatus 10 is converted by the encoder unit 1 into MPEG (Moving Picture Exper
ts Group) and output to the buffer 2. The buffer 2 is provided to make the data amount of an image output to an external device constant. That is, the buffer 2 temporarily stores the input data and outputs the stored data so as not to lose the balance between the input and output of the data, in other words, not to cause an overflow or an underflow. .

The rate controller 3 checks the amount of data in the buffer 2 and instructs the encoder 1 to increase or decrease the amount of data to be encoded according to the result. The input image data (original image) and the encoded and output image data have a relationship as shown in FIG. B represents a B picture, I represents an I picture, and P represents a P picture, and the number attached after each alphabet is a number indicating the order of reproduction at the time of reproduction.

When the input image data is encoded (encoded) by the encoder unit 1 in the order shown in FIG. 11A, as shown in FIG. . The data encoded by the encoder unit 1 is written to the buffer 2 and is read out from the buffer 2 so as to be able to connect and display images.
It changes as shown in FIG.

[0005] The image data output from the image compression encoding device 10 is recorded on a video cassette tape (not shown) or transmitted to another device. For example, the user can play back image data recorded on a video cassette tape by using a dedicated playback device and enjoy moving images. It is also possible to pause the reproduced image, in other words, to make it a still image and enjoy it. In this way, the still image can be printed by a printing machine such as a printer.

[0006]

However, when a user captures a moving image and records it on a video cassette tape or the like, for example, with a video camera provided with the above-mentioned image compression encoding device 10, the image compression encoding device 10 is used. Even if the user wants to view a predetermined image of the recorded moving images as a still image, he cannot specify that he wants to reproduce the still image at the time of imaging. As a result, one frame captured as a moving image cannot be reproduced as a still image, and it has been difficult to obtain a high-quality still image.

When a desired image is designated as a still image, the user searches for the desired image while looking at the reproduced moving image. Therefore, it is possible to designate a still image without looking at the moving image. Did not. For this reason, it was not possible to enjoy a still screen continuously as in a photograph.

SUMMARY OF THE INVENTION The present invention has been made in view of such a situation, and allows a moving image to be handled as a still image while capturing a moving image so that a specified image can be specified. It is to be recorded with image quality.

[0009]

An image processing apparatus according to claim 1, further comprising: an instruction unit for indicating a picture to be treated as a still image; and a setting unit for setting a still image additional bit indicating that the picture is a still image. Storage means for storing picture data; and control means for controlling the amount of picture data stored in the storage means when a picture to be treated as a still image is instructed by the instruction means.

According to a fifth aspect of the present invention, there is provided an image processing method, comprising: an instruction step of designating a picture to be treated as a still image; a setting step of setting a still image additional bit indicating that the picture is a still image; It is characterized by including a storing step of storing, and a control step of controlling a data amount of the picture stored in the storing step when a picture to be treated as a still image is specified in the specifying step.

According to a sixth aspect of the present invention, the providing medium stores an instruction step of specifying a picture to be treated as a still image, a setting step of setting a still image additional bit indicating that the picture is a still image, and data of the picture. A computer-readable program for executing a process including a storage step of performing a process of controlling a data amount of a picture stored in the storage step when a picture to be treated as a still image is specified in the instruction step. It is characterized by the following.

An image processing apparatus according to claim 1, wherein
In the image processing method described in the item (1) and the providing medium described in the item (6), a picture to be treated as a still image is designated, a still image additional bit indicating that the picture is a still image is set to 1, and When a picture to be handled is specified, the data amount of the stored picture is controlled.

[0013]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below. In order to clarify the correspondence between each means of the invention described in the claims and the following embodiments, each means is described. When the features of the present invention are described by adding the corresponding embodiment (however, an example) in parentheses after the parentheses, the result is as follows. However, of course, this description does not mean that each means is limited to those described. In addition, the same reference numerals are given to portions corresponding to the conventional case, and the description thereof will be omitted as appropriate.

An image processing apparatus according to a first aspect of the present invention includes an instructing means for instructing a picture to be treated as a still image (for example, step S1 in FIG. 2), and a still image additional bit indicating that the picture is a still image. (For example, step S6 in FIG. 2), a storage unit for storing picture data (for example, the storage unit 21 in FIG. 1), and a case where a picture to be treated as a still image is instructed by the instructing unit. Control means for controlling the data amount of the picture stored in the storage means (for example, step S8 in FIG. 2).

FIG. 1 is a block diagram showing a configuration example of an image compression encoding apparatus 20 to which the present invention is applied. Imaging unit 31
Is input to the storage unit 21 and stored. The image data stored in the storage unit 21 is read by the preprocessing unit 22. Pre-processing unit 21
Corresponds to the still image control unit 23 for the input image data.
In response to the instruction, for example, a process such as applying a smoothing filter is performed, and the processed data is output to the encoder unit 24. The encoder unit 24 converts the input image data into an MPEG
The data is encoded by the system and output to the buffer 25.

The buffer 25 notifies the suppression image control unit 23 of the amount of image data to be stored corresponding to the difference between the writing amount and the reading amount. The stop image control unit 23 controls the encoder unit 24 in response to this notification so that the buffer 25 does not cause overflow or underflow.
When a still image button (not shown) provided on the operation unit 32 operated when the user gives an instruction regarding imaging is operated, the still image control unit 23 stores the image data in the storage unit 21 and the buffer 25. Of the pre-processing unit 22 and the encoder unit 24 in accordance with the result.

When the user wants to capture a still image while capturing a moving image using the video camera provided with the image compression / encoding device 10, Operate the button. Image compression encoding device 1
When the still image button is operated, 0 is set so that the amount of data to be encoded is larger than the amount of moving image being captured at that time so that an image to be treated as a still image can be recorded with high image quality. Next, each part is controlled.

Referring to the flowchart of FIG. 2, the operation when the still image button of the image compression / encoding device 20 is operated will be described. First, in step S1, the still image control unit 23 determines whether a still image button has been operated. Step S1 until the still image button is operated
Is repeated. If it is determined in step S1 that the still image button has been operated, the process proceeds to step S2.

In step S2, the still image control unit 22
Predicts future encoding and checks the amount of data in the buffer 25. That is, the still image control unit 22
From the image data stored in 1, how much the capacity of the buffer 25 is occupied by the image to be encoded in the future is predicted. Further, the current remaining capacity of the buffer 25 is checked. Then, in step S3, it is determined whether or not the capacity of the storage unit 21 is large (whether or not sufficient time can be secured for performing the process of increasing the code amount of the still image without overflowing the buffer 25). Is determined. If the storage unit 21 is, for example, a storage unit capable of storing pictures for 15 frames, the capacity is determined to be large, and the process proceeds to step S6. If the storage unit 21 is 15 frames or less, the capacity is determined to be small, and step S4 is performed. Proceed to.

Of course, the size of the storage unit 21 may be determined on the basis of a unit other than 15 frames. If the capacity of the storage unit 21 is known, the process in step S3 can be omitted.

If it is determined in step S3 that the capacity of the storage unit 21 is not large, the flow advances to step S4 to determine whether the still image button is operated at a position other than the B picture, in other words, at the I picture or the P picture. It is determined whether or not. If it is determined that the still image button has been operated at the B picture, the process proceeds to step S6. If it is determined that the still image button has been operated at a position other than the B picture, the process proceeds to step S5. In step S5, the B picture immediately following the I picture or P picture when the still picture button is operated is set as a picture to be processed as a still picture.

When the capacity of the storage unit 21 is small, the number of pictures that can be stored as reference image data is reduced, and there is no time difference between the picture currently being encoded and the picture when the still image button is operated. So
It is conceivable that the time for performing the process of suppressing the amount of generated information described below cannot be sufficiently taken. Therefore, when the capacity of the storage unit 21 is small, the processing in steps S4 and S5
If the still image button has been operated on something other than a B picture, the B picture immediately after that is used as the target image for processing as a still image.

This is because, in the case of encoding using MPEG, I-pictures and P-pictures are encoded in the same order as the input order, but B-pictures are encoded at the time of input (see (I picture or P picture). This is because the time difference corresponds to the time for performing the process of suppressing the amount of generated information.

On the other hand, in step S3, the storage unit 21
If it is determined that the capacity of is large, the process of suppressing the amount of generated information is not always necessary, in other words,
Even if the amount of generated information is not suppressed, the data amount of a picture to be treated as a still image can be processed, so that the processing in steps S4 and S5 is omitted and the process proceeds to step S6. In step S6, the still image control unit 23 sets the still image addition BIT of the image of the target frame to 1. This still image added BIT
Is a flag provided for distinguishing between a moving image and a still image. The flag 1 indicates that the picture is an image captured as a still image.

As shown in FIG. 3, for example, the still image additional BIT is set to the first bit of user data existing in the picture layer of the bit stream when MPEG coding is applied. The picture layer includes a picture header in which the display order and coding type of images in a GOP (Group of Picture) are described, and a picture coding in which data specifying a motion vector range in the front-back direction, the horizontal and vertical directions is described. It is composed of extended data such as extension and quantization matrix settings, extended user data in which user data is described, and picture data in which data of the picture itself is described. The user data area of this extended user data is composed of 8 bits, and the first bit is used as a still image additional BIT.

As described above, when the picture recorded with the still image additional BIT is reproduced later by setting the still image additional BIT, the reproducing apparatus searches for a picture in which the still image additional BIT is 1. This makes it possible to reproduce only a still image. Of course, even if the still image addition BIT is 1, a moving image including the picture can be reproduced.

If the still image addition BIT is set to 1 in step S6, the process proceeds to step S7, where it is determined whether or not to perform preprocessing. The pre-processing is processing performed by the pre-processing unit 22. In order to prevent data stored in the buffer 25 from overflowing, a predetermined process is performed on data read from the storage unit 21 to reduce the data amount. And outputs the result to the encoder unit 24. The pre-processing performed by the pre-processing unit 22 may be a process of lowering the resolution or a process of deleting a frame.

When the resolution is reduced, for example, the storage unit 21
The data read from is subjected to arithmetic processing using a filter as shown in FIG. In the filter shown in FIG. 4, the place where the value of 2 at the center is set corresponds to the target pixel. By performing such a filtering process, the resolution can be reduced, and the data to be encoded by the encoder unit 24 can be reduced.

When a frame is dropped, all frames are normally read out as shown in FIG.
(A)), for example, frames are read every other frame (FIG. 5 (B)). By doing so, the amount of data encoded by the encoder unit 24 can be reduced.

The pre-processing unit 22 performs the above-described pre-processing in accordance with an instruction from the still image control unit 23. The still image control unit 23
In step S2, the capacity of the buffer 25 necessary for encoding the data stored in the storage unit 21 is predicted, and the remaining amount of the buffer 25 at that time is also checked. If the data amount is of the order, it is possible to predict whether the buffer 25 will not overflow. Then, according to this prediction, one of the above two pre-processes is selected, and the selected pre-process is performed on the data read from the storage unit 21, and the encoder unit 24
Output to

Specifically, when it is not necessary to greatly suppress the amount of generated information, the amount of generated information is suppressed by applying a filter. When it is necessary to significantly reduce the amount of generated information, the frame is dropped. The amount of generated information is reduced.

If it is determined in step S7 that preprocessing is to be performed, the process proceeds to step S8, and the above preprocessing is performed. If it is determined in step S7 that it is not necessary to perform the pre-processing, in other words, even if the data of the picture to be treated as a still image is stored in the buffer 25 without causing the amount of generated information to be suppressed, an overflow may occur. If it is determined that there is not, the process of step S8 is omitted, and the process proceeds to step S9.

In step S9, the encoder unit 24
Encodes the data supplied from the preprocessing unit 22,
Output to the buffer 25. In this way, when the still image button is operated, the buffer 25 is controlled so as not to cause an overflow, and the data amount for obtaining high image quality can be encoded.

With reference to FIGS. 6 and 7, the processing of the above-described flowchart will be further described. 6, image data captured by the imaging unit 31, in the order as shown in FIG. 6 (A), stored in the storage unit 21, the picture B ₆ is the storage unit 2
1 shows a case where the still image button of the operation unit 32 is operated when stored in the “1”.

[0035] In this case, regardless of the determination in step S3, in step S6, the first bit of the user data of the picture layer of the picture B ₆ is set to 1. Then, in step S7, it is determined whether or not preprocessing needs to be performed. In FIG. 6 (C), the pre-process is performed, how the amount of data of the previous picture of the picture B ₆ is suppressed is shown.

In FIG. 6C, the two-dot chain line indicates the amount of information generated when the still image button is not operated and preprocessing is not performed. On the other hand, the solid line indicates that buffer 2
5 shows the amount of data stored. When the still image button is operated at the picture B _6, the still image control section 23, data read from the memory unit 21 at that time, to preprocess the picture B _3, reduce the amount of data. By doing so, it becomes possible to encode the picture B ₆ to be treated as a still image so as to have a larger data amount than other pictures, as shown in FIG. 6C.

FIG. 7 is similar to FIG.
FIG. 7 is a diagram showing a change in the amount of data stored in the storage device. This example shows a case where a still image button is operated at the picture I _5. In such a case, when it is determined in step S3 that the capacity of the storage unit 21 is not large, the process proceeds from step S4 to step S5. In step S5, a B-picture immediately after the picture I _5, picture B ₆ is set to the target still image.

As described above, when the still image button is operated at the I-picture or the P-picture in order to obtain the time for performing the pre-processing necessary to increase the data amount of the picture to be treated as a still image, Assuming that the immediately following B picture is a still image, the amount of data up to picture I ₅ , picture B ₃ , picture B ₄ , and picture P ₈ can be reduced as shown in FIG.

FIG. 8 is a flowchart for explaining another operation example of the image compression / decoding device 20. First, step S
In 21, the still image control unit 23 determines whether the still image button has been operated. Until the still image button is operated, the process of step S21 is repeated. And
If it is determined in step S21 that the still image button has been operated, the process proceeds to step S22.

In step S22, the still image control unit 2
Reference numeral 3 controls the encoder unit 24 to stop encoding of moving image data. Since no new image data is supplied from the encoder unit 24, the data amount stored in the buffer 25 decreases and approaches zero. Thus, by making the stored data amount close to 0,
The storage capacity enough to handle the still image generation information amount is secured.

In step S23, it is determined whether or not the picture when the still image button is operated is an I picture. If it is determined that the picture is an I picture, the process proceeds to step S24. If it is determined that the picture is not an I picture, the process proceeds to step S25. In step S24, as a picture when the still image button is operated, an I picture existing after the operation is performed is set as a picture to be treated as a still image.

When an I picture to be treated as a still picture is set, 1 is set to the still picture additional bit added to the header of the I picture. Then, in step S26,
The encoder unit 24 encodes an I picture stored as a still image in the storage unit 21. Step S
At 27, it is determined whether the time during which the moving image is not encoded has expired. This determination is made by checking whether or not the storage unit 21 has sufficient capacity to store a picture to be handled as a moving image, or by determining whether or not a preset time has elapsed.

In step S27, the process of step S27 is repeated until it is determined that the moving image stop time has ended. If it is determined that the moving image stop time has ended, the process of this flowchart ends.

Referring to FIG. 9, each process shown in the flowchart of FIG. 8 will be described. Operation of the still image button at the picture B ₄ shown in FIG. 9 (A) is (step S21). By operating the still image button, in step S22, the encoding processing of the moving image by the encoder unit 24 is stopped. Thus, the buffer 25
9 is stopped by stopping the data supplied to
As shown in (B), the amount of data stored in the buffer 25 decreases to zero.

When the amount of data stored in the buffer 25 becomes 0, the preprocessing unit 22 reads out from the storage unit 21 the data of the picture to be treated as a still image. At this time, the operation of the still image button in step S23
Although it not whether a picture is determined, in this case, the button is operated, so when the B-picture, are set in the picture in which picture I ₅ present in the subsequently I squeezed as a still image. With this setting, as shown in FIG. 9 (B), the buffer 25 has a sufficient amount of data to store a sufficient amount of data that can be reproduced as a still image.

The data stored in the buffer 25 in this way is supplied to the encoder 24 in step S26.
Is encoded by In step S27, there is no data to be supplied to the buffer 25 until it is determined that the moving image stop time has ended, so the stored data amount is read out as shown in FIG.
become. If it is determined in step S27 that the moving image stop time has ended, data to be handled as a moving image is read from the storage unit 21 by the preprocessing unit 22 and supplied to the encoder unit 24.

As described above, when the user designates a picture to be treated as a still image, the storage unit 21 is controlled so that a large amount of data can be obtained, so that the still image can be reproduced beautifully. .

In the present specification, a providing medium for providing a user with a computer program for executing the above processing includes an information recording medium such as a magnetic disk and a CD-ROM, and a network such as the Internet and a digital satellite. Transmission media is also included.

[0049]

As described above, according to the image processing apparatus according to claim 1, the image processing method according to claim 5, and the providing medium according to claim 6, a picture to be treated as a still image is specified. The still image addition bit indicating that the picture is a still image is set to 1, and when a picture to be treated as a still image is designated, the data amount of the stored picture is controlled. It is possible to reproduce beautifully and to reproduce only still images continuously.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an embodiment of an image compression encoding apparatus to which the present invention has been applied.

FIG. 2 is a flowchart illustrating an operation of the image compression encoding device.

FIG. 3 is a diagram illustrating still image additional bits.

FIG. 4 is a diagram illustrating a filter.

FIG. 5 is a diagram illustrating frame dropping.

FIG. 6 is a diagram illustrating the amount of data in a buffer.

FIG. 7 is a diagram illustrating the amount of data in a buffer.

FIG. 8 is a flowchart illustrating another operation of the image compression encoding apparatus.

FIG. 9 is a diagram illustrating the amount of data in a buffer.

FIG. 10 is a block diagram illustrating a configuration of an example of a conventional image compression encoding device.

FIG. 11 is a diagram illustrating the amount of data in a buffer.

[Explanation of symbols]

Reference Signs List 20 image compression encoding device, 21 storage unit, 22
Pre-processing unit, 23 still image control unit, 24 encoder unit, 25 buffer, 31 imaging unit, 32 operation unit

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 7/24 (72) Inventor Eiji Ogura 6-35 Kita Shinagawa, Shinagawa-ku, Tokyo Sony Corporation (72) Inventor Daisuke Hiranaka 6-7-35 Kita-Shinagawa, Shinagawa-ku, Tokyo F-term within Sony Corporation (reference) 5C023 AA34 AA37 CA01 DA04 EA10 5C053 FA07 FA23 FA23 GB06 GB08 GB21 GB30 GB37 JA21 KA01 KA11 KA24 LA01 5C059 KK35 LB07 MA00 MA04 MA05 PP01 PP05 PP06 PP07 RC31 RC33 SS14 SS15 SS20 UA02 UA12 UA32 UA39

Claims (6)

[Claims] An instructing unit that designates a picture to be treated as a still image; a setting unit that sets a still image additional bit indicating that the picture is a still image; a storage unit that stores data of the picture; An image processing apparatus comprising: a control unit that controls a data amount of a picture stored in the storage unit when a picture to be treated as a still image is specified by the instruction unit. 2. The control means filters the picture data stored in the storage means,
2. The image processing apparatus according to claim 1, wherein a data amount of a picture stored in the storage unit is controlled. 3. The method according to claim 2, wherein the control unit controls a data amount of the picture stored in the storage unit by deleting a predetermined frame of the data of the picture stored in the storage unit. Item 2. The image processing device according to Item 1. 4. The control device according to claim 1, wherein the control unit controls the storage unit to temporarily store the image data designated by the designation unit after the data amount stored in the storage unit is once reduced. The image processing apparatus according to claim 1. 5. An instructing step of instructing a picture to be treated as a still image; a setting step of setting a still image additional bit indicating that the picture is a still image; a storing step of storing data of the picture; A control step of controlling a data amount of the picture stored in the storing step when a picture to be treated as a still image is specified in the specifying step. 6. An instructing step of instructing a picture to be treated as a still image; a setting step of setting a still image additional bit indicating that the picture is a still image; a storing step of storing data of the picture; And a control step of controlling a data amount of the picture stored in the storage step when a picture to be treated as a still image is specified in the instruction step. A providing medium characterized by the above-mentioned.