JP2006217158A - Image coding apparatus and imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow an optimum intra prediction mode to be easily selected. <P>SOLUTION: A coding section for applying compression coding to an image signal acquires the image signal to be encoded and photographing information related to the image signal and selects the prediction mode by using the acquired photographing information (panning, tilt, zoom, blur) in the case of predicting pixel values in a frame using pixel values in the same frame. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image encoding apparatus and an imaging apparatus, The present invention relates to a technique for selecting an optimal intra prediction mode when the H.264 encoding method is employed.

  Encoding methods such as Motion JPEG and MPEG1, 2 have been established as techniques for highly efficient encoding of moving images. Manufacturers have developed and commercialized imaging devices such as digital cameras and digital video cameras or DVD recorders that can store moving images using these encoding methods, and users can use these devices or personal computers, It is possible to easily view a moving image using a DVD player or the like.

  By the way, the digitized moving image has a huge amount of data. In view of this, moving picture coding systems that can achieve higher compression than MPEG1 and MPEG2 have been studied, and recently ITU-T (International Telecommunication Union Telecommunication Standardization Sector) and ISO (International Organization for Standardization). H. H.264 / MPEG4 part 10: AVC encoding method (hereinafter referred to as H.264) has been standardized.

  H. H.264 requires a large amount of computation for encoding or decoding compared to conventional encoding methods such as MPEG1 and MPEG2, but is known to realize higher encoding efficiency. H. The configuration of the H.264 arithmetic processing is disclosed in Patent Document 1, for example.

H. H.264 has a prediction method called “intra prediction” in which pixel values in the same frame are predicted using pixel values in the frame. In this intra prediction, there are a plurality of intra prediction modes, and it is specified that these are selectively used. At this time, by selecting an intra prediction mode suitable for the input image, encoded data with little deterioration is generated even when high-level compression is performed.
JP 2004-56827 A

  In order to improve the accuracy of prediction with respect to the intra prediction described above, In H.264, nine types of intra prediction modes are prepared. As a method of selecting one optimal intra prediction mode from among a plurality of intra prediction modes, an optimal result is obtained based on the result of trialing all intra prediction modes on the input image. A method of selecting the intra prediction mode to be performed is common.

  The background will be described with reference to FIG. FIG. 11 is an image of a frame. The outer squares indicate the entire screen, and the inner five squares indicate blocks for performing intra prediction. The blocks are set over the entire screen, but only five representative ones are shown for the sake of simplicity. Furthermore, FIG. 11 is an example in which the prediction direction indicated by the intra prediction mode that is optimized as a result of the calculation is indicated by arrows for each block. In this way, even within the same screen, the subject differs depending on the position, so the optimal intra prediction mode for each block varies and is not fixed to a specific mode. From such a background, when performing intra prediction, the prediction accuracy is obtained for all intra prediction modes for each block, and a mode that can be optimally predicted is selected to be used as the prediction mode of the block.

  However, in order to select an optimal intra prediction mode from among a plurality of intra prediction modes, when the method of selecting after calculating all intra prediction modes as described above is used, This leads to an increase in the amount of computation in the H.264 encoding process, which in turn leads to excess encoding processing time and waste of power consumption.

  The present invention has been made in view of the above problems, and an object thereof is to make it possible to easily select an optimal intra prediction mode for an input image by using information at the time of shooting the input image. To do.

  Another object of the present invention is H.264. It is to reduce the arithmetic processing in the image encoding apparatus using H.264 and realize efficient encoding.

  In order to solve the above-described problem, the image coding apparatus of the present invention selects any one of a plurality of prediction modes and predicts a pixel value in the same frame using a pixel value in the frame according to the selected prediction mode. In the image encoding device for generating the predicted pixel value, the image signal to be encoded is input, the image acquisition information related to the image signal is acquired, and the input image signal is encoded in the frame. And a means for selecting a prediction mode using the photographing information when predicting a pixel value in the same frame using the pixel value.

  Further, the imaging apparatus of the present invention is an imaging unit that outputs an image signal obtained by imaging, and an encoding unit for compressing and encoding the image signal, and selects any one of a plurality of prediction modes, In an imaging apparatus comprising: an encoding unit that performs a process of predicting a pixel value in the same frame using a pixel value in the frame according to the selected prediction mode and generating a predicted pixel value; When a pixel value in the same frame is predicted using a pixel value in the frame, a prediction mode is selected based on an operation state of the photographing unit.

  According to the present invention, it is possible to easily select an optimal intra prediction mode from among a plurality of intra prediction modes by using information at the time of shooting without trying all intra prediction modes. The calculation processing at the time of encoding in H.264 can be reduced.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

<First Embodiment>
FIG. 8 is a block diagram showing the configuration of the image encoding device 600 according to this embodiment. The image encoding apparatus 600 includes a subtractor 601, an integer transform unit 602, a quantizer 603, an entropy encoder 604, an inverse quantizer 605, an inverse integer transform unit 606, an adder 607, frame memories 608 and 611, a loop. It comprises a filter 610, an inter prediction unit 612, a motion detection unit 613, a switch 614, and an intra prediction unit 615, which encodes input image data and outputs encoded data.

  Next, the encoding process of the image encoding device 600 in FIG. 8 will be described.

  The image encoding device 600 is an H.264 format. The encoding process is performed according to the H.264 encoding method. Also, the input image data is divided into blocks, and processing is performed for each block.

  First, the subtractor 601 subtracts the predicted image data from the image data (input image data) input to the image encoding device 600, and outputs image residual data. The generation of predicted image data will be described later.

  The integer conversion unit 602 performs integer conversion processing on the image residual data output from the subtractor 601 and outputs a conversion coefficient. Then, the quantization unit 603 quantizes the transform coefficient using a predetermined quantization parameter.

  The entropy encoding unit 604 receives the transform coefficient quantized by the quantization unit 603, entropy encodes it, and outputs it as encoded data.

  On the other hand, the transform coefficient quantized by the quantization unit 603 is used to generate predicted image data for encoding the subsequent block. The inverse quantization unit 605 performs inverse quantization on the transform coefficient quantized by the quantization unit 603. Further, the inverse integer transform unit 606 performs inverse integer transform on the transform coefficient inversely quantized by the inverse quantization unit 605 and outputs it as decoded residual data. The adder 607 adds the decoded residual data and the predicted image data, and outputs the result as reconstructed image data.

  The reconstructed image data is stored in the frame memory 608 and also stored in the frame memory 611 via the loop filter 610. Among the reconstructed image data, data that may be referred to in the subsequent prediction is stored in the frame memory 608 or 611 for a period of time. The loop filter 610 is used to remove block noise.

  The intra prediction unit 615 performs intra-frame prediction processing using the reconstructed image data stored in the frame memory 608, and generates predicted image data. In addition, the inter prediction unit 612 performs inter-frame prediction processing based on the motion vector information detected by the motion detection unit 613 using the reconstructed image data stored in the frame memory 611, and generates predicted image data. . The motion detection unit 613 detects a motion vector in the input image data, and outputs the detected motion vector information to the inter prediction unit 612 and the entropy encoding unit 604.

  The switch 614 is a selection unit for selecting whether to use intra prediction or inter prediction in units of macroblocks. One of the output from the intra prediction unit 615 and the output from the inter prediction unit 612 is selected, and the selected predicted image data is output to the subtracter 601 and the adder 607.

  Here, supplemental description will be given of intra prediction performed by the intra prediction unit 615 with reference to FIGS. 9 and 10.

  In intra prediction, the value of the adjacent pixel already encoded within the same screen is used as a predicted value. When the encoding target block has a 4 × 4 pixel size (pixels from a to p) as shown in FIG. 9, prediction is performed using pixel values from A to M around the block. At this time, the prediction direction is specified, and only necessary pixel values are used for the prediction. However, since nine types of intra prediction modes having different prediction directions and contents are prepared, the optimal prediction among them is prepared. Predict by selecting the mode.

  The prediction directions of each prepared intra prediction mode are shown in FIG. For example, in the mode 0 vertical (vertical direction) prediction mode, the value of an adjacent vertical pixel (corresponding to each pixel of A, B, C, and D in FIG. 9) is used as a predicted value, and this pixel value Is predicted to be continuous in the vertical direction. Accordingly, it is predicted that the pixel value of A continues for each of the pixels a, e, i, and m in FIG. 9, and similarly, the pixel value of B for each of the pixels b, f, j, and n. Is expected to continue. The same applies hereinafter. Then, as a predicted result, after obtaining a difference value of each pixel, that is, aA, eA, iA, mA, etc., integer conversion and quantization are performed.

  In addition to the above-described Vertical prediction mode of Mode 0, intra prediction modes of Modes 1 to 8 as shown in FIG. 10 are prepared. The DC prediction mode of Mode 2 is a prediction mode using an average value of the left and upper pixel values. Details of each intra prediction mode are described in H.264. Since it is disclosed in H.264-related standards and the like, description thereof is omitted here. H. In H.264, nine types of intra prediction modes are prepared in this way, so that it is possible to select the optimal prediction mode for the encoding target pixel, improve the prediction accuracy, and the residual data value is small. I am trying to do it.

  Further, the normal intra prediction mode selection processing in the intra prediction unit 615 is performed according to the procedure shown in the flowchart of FIG. In FIG. 12, when intra prediction of a target block is started, a counter i indicating a prediction mode is prepared, and i = 0 is set (step S1201). Next, intra prediction is performed according to the prediction mode indicated by the value of i (step S1202), the accuracy of the intra prediction is evaluated, and an optimum one is selected as compared with the other prediction modes evaluated so far ( Step S1203). Next, i is incremented (step S1204), and the procedure from S1202 is repeated within a range where i does not exceed the maximum value 9 of the prediction mode (step S1205). As a result, the optimal intra prediction mode can be selected by calculating all (9 types) of intra prediction modes for each encoding target block.

  Further, the intra prediction unit 615 can execute the intra prediction mode selection process in a procedure different from the above-described normal selection process in accordance with the input control signal. This content will be described later. The above is the description of the image encoding device 600 and the intra prediction unit 615.

  Next, the configuration of the imaging apparatus 100 equipped with the above-described image encoding apparatus 600 will be described, and further operations of the intra prediction unit 615 will be described in conjunction with the operations of the imaging apparatus 100.

  FIG. 1 is a block diagram illustrating the configuration of the imaging apparatus 100 according to the present embodiment. The imaging apparatus 100 includes a photographing lens unit 101 including a plurality of lens groups (including zoom lenses 101a and 101b and a focus lens 101c), an imaging element 102 such as a CCD or a CMOS, a camera signal processing unit 103, and an encoding unit 104. , A camera control unit 105, a focus detection unit 106, a focus motor (Mo) 107, a zoom motor (Mo) 108, a motion sensor 109, and an operation unit 110 having various functions. After the image is converted into an image signal, The encoded data is output after compression encoding according to the H.264 encoding method. Note that the encoding unit 104 corresponds to the image encoding device 600 described above. The imaging apparatus 100 causes the image encoding apparatus 600 to perform image H.264. It is installed as a H.264 encoder.

  Next, a photographing process of the imaging device 100 in FIG. 1 will be described.

  When the photographing operation is started, the optical image incident from the photographing lens unit 101 is converted into an electric signal by the image sensor 102. At this time, the focus lens 101c is moved by the focus motor (Mo) 107 to perform focus adjustment, and the zoom lenses 101a and 101b are moved by the zoom motor (Mo) 108 to perform optical zoom adjustment. Furthermore, according to the motion information detected by the motion sensor 109, an optical anti-shake mechanism (not shown) or an electronic anti-shake function is operated to correct motion (camera shake correction).

  The electric signal output from the image sensor 102 is subjected to necessary luminance signal processing and color signal processing in the camera signal processing unit 103 as an image signal. Further, the image data output from the camera signal processing unit 103 is subjected to encoding processing in the encoding unit 104, and is output as encoded data. The encoding process here is as already described with reference to FIG. The encoded data can be recorded on a recording medium such as a disk by recording means (not shown).

  The camera control unit 105 controls the operation of each unit. When there is a user instruction through the operation unit 110, each unit is controlled according to the instruction.

  During autofocus, the focus detection unit 106 detects the focus state based on a signal obtained from the image sensor 102 and transmits the focus state to the camera control unit 105 as focus information. The camera control unit 105 sends a control signal to the focus motor (Mo) 107 according to the focus information, and performs focus control so that an optimal focus state is obtained. During manual focus, the camera control unit 105 sends a control signal to the focus motor (Mo) 107 in accordance with an instruction input from the operation unit 110 to perform focus control so that a desired focus state is achieved.

  In addition, the camera control unit 105 sends a control signal to the zoom motor (Mo) 108 in accordance with the zoom instruction input from the operation unit 110 to perform zoom control so that a desired zoom position is obtained.

  The motion sensor 109 uses an acceleration sensor or the like, and can detect movement of the imaging apparatus 100 in addition to motion detection for camera shake correction. Specifically, it detects a shooting operation such as panning or tilting. Then, the information is transmitted to the camera control unit 109.

  Here, a control operation of the camera control unit 105 when panning or tilting is detected by the motion sensor 109 will be described.

  FIG. 2 shows a captured image when a panning operation is performed during shooting. When the screen is panned in the direction of the white arrow as shown in FIG. 2, the entire captured image flows in the direction of the white arrow (horizontal direction). Therefore, when the encoding unit 104 performs intra prediction on the captured image, it can be estimated that the horizontal direction is the optimal prediction direction. At this time, it can be assumed that the direction of intra prediction, which is different in each block on the screen in the image of FIG. 11, becomes a regular direction in which each block matches the panning direction as shown in FIG. Therefore, as a result, if the intra prediction in the horizontal direction (Horizontal prediction mode of mode 1) is selected uniformly in each block, the optimal or near-optimal intra prediction mode can be efficiently selected. For vertical tilt, the mode 0 vertical prediction mode may be selected in the same manner. Further, when pan or tilt is inclined in an oblique direction, any one of the oblique prediction modes may be selected in consideration of the oblique component.

  Based on such an idea, the camera control unit 105 selects an intra prediction mode according to a shooting operation such as panning or tilting with respect to the intra prediction unit 615 in the encoding unit 104 (that is, the image encoding device 600). It is characterized by sending a control signal for this purpose. Also, the intra prediction unit 615 changes the normal intra prediction mode selection process described above according to the received control signal, and uniquely selects the intra prediction mode according to the pan and tilt directions. Depending on the tilt direction, nine options are narrowed down to a few, and then the optimal intra prediction mode is selected. Thereby, when selecting an intra prediction mode, the optimal intra prediction mode can be selected much more efficiently than trying all intra prediction modes.

  FIG. 3 is a flowchart illustrating an operation flow of the intra prediction unit 615 when performing the intra prediction mode selection process according to the pan and tilt directions as described above.

  When pan or tilt is detected by the motion sensor 109 with respect to the image to be subjected to intra prediction (step S301), information on the detected pan or tilt direction and speed is acquired from the camera control unit 105 (step S302). ). When pan or tilt is not detected by the motion sensor 109 (step S301), the normal intra prediction mode selection process as shown in FIG. 12 is performed, and the intra prediction is performed after determining the optimal intra prediction mode. (Step S307).

  Based on the information about the pan or tilt direction and speed acquired in step S302, a predicted direction that roughly matches the pan or tilt direction is automatically selected (step S303). In step S303, when Vertical (vertical direction) is selected, intra prediction is performed in the vertical prediction mode of mode 0 (step S304). When Horizontal (horizontal direction) is selected, horizontal prediction mode of mode 1 Intra prediction is performed (step S305), and when Down-Right (downward rightward) is selected, intra prediction is performed in Mode 4 Down-Right prediction mode (step S306).

  As for the prediction in the oblique direction, if the detection accuracy of the motion sensor 109 is increased so that other oblique prediction modes (modes 3, 5, 6, 7, and 8) can be selected, the prediction accuracy is further increased. Can be enhanced.

  In FIG. 3, when panning or tilting is performed, the intra prediction mode is uniquely selected according to the direction. However, according to the panning and tilting direction and speed, nine types of prediction modes are divided into two or three types. After narrowing down or excluding the prediction modes that are clearly judged to have different prediction directions, the number of options may be reduced, and the optimal prediction mode may be obtained by calculation from the remaining candidates.

  As described above, according to the present embodiment, by using information at the time of shooting such as pan and tilt when selecting the intra prediction mode, it is possible to easily select the optimal intra prediction mode and to reduce the processing load for encoding. it can.

<Second Embodiment>
Next, a second embodiment of the present invention will be described with reference to FIGS.

  In the present embodiment, the control operation of the camera control unit 105 and the operation of the intra prediction unit 615 when the imaging apparatus 100 described in the first embodiment performs a zoom operation will be described.

  When a zoom operation is performed during shooting, the shot image being zoomed is an image that flows radially from the center of the screen for both zoom-in and zoom-out. Therefore, in the case where the encoding unit 104 performs intra prediction on the captured image, in consideration of which direction the encoding target block is located with respect to the center of the screen and performing prediction that matches the direction, The prediction efficiency will be good.

  At this time, it can be inferred that the intra prediction direction, which is different in each block on the screen in the image of FIG. 11, shows the prediction direction as in each block of FIG. 4 by zooming. That is, in the upper left block of the screen, the image flows in an oblique direction toward the center of the screen, so the mode 4 Down-Right prediction mode can be said to be optimal. Similarly, in the block in the upper right part of the screen, the mode 3 Down-Left prediction mode can be said to be optimal. Here, H. In the H.264 intra prediction, since the prediction direction is limited to the value of the adjacent left or upper block, the mode 3 Down-Left prediction mode can be said to be optimal in the lower left block of the screen. Similarly, it can be said that the mode 4 Down-Right prediction mode is optimal in the lower right block of the screen.

  Based on this idea, the camera control unit 105 controls the intra prediction unit 615 in the encoding unit 104 (that is, the image encoding apparatus 600) to select an intra prediction mode according to the zoom operation. It is characterized by sending a signal. In addition, the intra prediction unit 615 changes to the above-described normal intra prediction mode selection process according to the received control signal, and for the image being zoomed, the intra prediction unit 615 corresponds to the position of the encoding target block. The prediction mode is uniquely selected, or the optimum intra prediction mode is selected after narrowing down the nine types of options to a few types. Thereby, when selecting the intra prediction mode, the optimal intra prediction mode can be selected much more efficiently than trying all the intra prediction modes.

  FIG. 5 is a flowchart illustrating an operation flow of the intra prediction unit 615 when the intra prediction mode selection process is performed on the zoomed image as described above.

  When a zoom operation such as moving the zoom lenses 101a and 101b in response to a zoom instruction from the operation unit 110 is performed on an image to be subjected to intra prediction (step S501), information indicating that the zoom is being performed and information regarding the zoom speed Is acquired from the camera control unit 105 (step S502). When the zoom operation is not performed (including the time of ultra-low speed zoom) (step S501), the normal intra prediction mode selection process as shown in FIG. 12 is performed to determine the optimum intra prediction mode. Then, intra prediction is performed (step S506).

  When information indicating that the zoom is being performed and information regarding the zoom speed are acquired in step S502, a region on the screen where the block to be encoded is located is determined, and a prediction direction corresponding to the region is automatically selected (step S503). ). That is, if the block is in the upper left area or the lower right area of the screen, the mode 4 Down-Right prediction mode is selected. If the block is in the upper right area and the lower left area of the screen, the mode 3 Down-Left prediction mode is selected. In addition, since the prediction mode cannot be determined if the block is in the center vicinity region (Center), the normal intra prediction mode selection process is performed to determine the optimal intra prediction mode (step S506). ). In Step S503, when the Down-Left prediction mode is selected, intra prediction is performed in the Mode 3 Down-Left prediction mode (Step S504), and when the Down-Right prediction mode is selected, the Mode 4 Down is selected. -Intra prediction is performed in Right prediction mode (step S505).

  By subdividing and classifying the area on the screen, mode 0 vertical prediction mode is selected directly above or below the center of the screen, and mode 1 horizonal prediction is on the left or right side when viewed from the center of the screen. It is more effective to select the mode. Further, if the region is subdivided so that other oblique prediction modes (modes 5, 6, 7, and 8) can be selected, the prediction accuracy can be further improved.

  Also, in FIG. 5, when zooming is performed, the intra prediction mode is uniquely selected when it is not near the center according to the area where the block to be encoded is located. By narrowing down to two or three types, or excluding prediction modes that clearly determine that the prediction direction is different, and reducing the number of options, the optimal prediction mode can be calculated from the remaining candidates. May be.

  As described above, according to the present embodiment, by using information at the time of shooting such as zooming at the time of selecting an intra prediction mode, it is possible to easily select an optimal intra prediction mode and to reduce the processing load for encoding.

<Third Embodiment>
Next, a third embodiment of the present invention will be described with reference to FIGS.

  In the present embodiment, the control operation of the camera control unit 105 and the operation of the intra prediction unit 615 when the imaging apparatus 100 described in the first embodiment performs a focusing operation will be described.

  When a focus operation is performed during shooting, the entire screen of the shot image is out of focus when not in focus. And when performing intra prediction with respect to the photographic image blurred by the encoding part 104, there is no specific direction and the prediction efficiency of DC prediction mode using the average value of a pixel is good.

  At this time, since the image in FIG. 11 is in a focused state, the direction of intra prediction that indicates the direction of disparity in each block on the screen is as shown in FIG. 6 over the entire screen when the image is in a blurred state. It can be estimated that DC prediction is shown in FIG.

  Based on such a concept, the camera control unit 105 controls the intra prediction unit 615 in the encoding unit 104 (that is, the image encoding apparatus 600) to select an intra prediction mode according to the focus state. It is characterized by sending a signal. Further, the intra prediction unit 615 uniquely selects the DC intra prediction mode for a blurred image instead of the above-described normal intra prediction mode selection processing according to the received control signal. Thereby, when selecting the intra prediction mode, the optimal intra prediction mode can be selected much more efficiently than trying all the intra prediction modes.

  FIG. 7 is a flowchart illustrating an operation flow of the intra prediction unit 615 when the intra prediction mode selection process is performed on the above-described blurred image, particularly an image photographed in an out-of-focus state.

  Focus information indicating whether the focus is captured in an in-focus state or an out-of-focus state is acquired from the camera control unit 105 with respect to an image to be subjected to intra prediction (step S701). When it is determined from the focus information that the focus is in focus (step S702), the normal intra prediction mode selection process as shown in FIG. 12 is performed, and the optimum intra prediction mode is determined. Intra prediction is performed (step S704).

  On the other hand, when it is determined from the focus information that the focus is out of focus (blurred image) (step S702), the DC prediction mode is automatically selected, and intra prediction is performed in the mode 2 DC prediction mode (step S703). ).

  As described above, according to the present embodiment, by using information at the time of shooting such as focus at the time of selecting an intra prediction mode, it is possible to easily select an optimal intra prediction mode and to reduce a processing load related to encoding.

  In addition, although the Example of this invention demonstrated by the 1st-3rd embodiment may each be used independently, you may comprise so that it may be used combining each Example. By using the embodiments in combination, it is possible to efficiently select an optimal intra prediction mode corresponding to various shooting states and to reduce the processing load for encoding.

<Other embodiments>
Another object of the present invention is to supply a storage medium storing software program codes for implementing the functions of the above-described embodiments to a system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the storage medium. Needless to say, this can also be achieved by reading and executing the program code stored in. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an operating system (OS) running on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included. Examples of the storage medium for storing the program code include a flexible disk, hard disk, ROM, RAM, magnetic tape, nonvolatile memory card, CD-ROM, CD-R, DVD, Blu-ray disk, optical disk, and magneto-optical disk. , MO, etc. are conceivable.

  Furthermore, after the program code read from the storage medium is written into a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer, the function is determined based on the instruction of the program code. It goes without saying that the CPU or the like provided in the expansion card or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  When the present invention is applied to the above-described storage medium, the program code corresponding to the flowchart described above is stored in the storage medium.

1 is a block diagram illustrating a configuration of an imaging apparatus 100. FIG. It is the figure which showed the example of the intra prediction direction with respect to the image in panning. It is the flowchart which illustrated the selection process of the intra prediction mode according to the direction of pan or tilt. It is the figure which showed the example of the intra prediction direction with respect to the image in zoom. It is the flowchart which illustrated the selection process of the intra prediction mode according to zoom. It is the figure which showed the example of the intra prediction with respect to a blurred image. It is the flowchart which illustrated the selection process of the intra prediction mode according to a focus. 2 is a block diagram illustrating a configuration of an image encoding device 600. FIG. It is explanatory drawing of the pixel used for intra prediction. It is a figure of each prediction mode in intra prediction. It is the figure which showed the example of the intra prediction direction in a normal image. It is the flowchart which illustrated the selection process of normal intra prediction mode.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Photographic lens part 102 Image pick-up element 103 Camera signal processing part 104 Encoding part 105 Camera control part 106 Focus detection part 107 Focus motor 108 Zoom motor 109 Motion sensor 110 Operation part 601 Subtractor 602 Integer conversion part 603 Quantization part 604 Entropy code Conversion unit 605 Inverse quantization unit 606 Inverse integer conversion unit 607 Adder 608 Frame memory 610 Loop filter 611 Frame memory 612 Inter prediction unit 613 Motion detection unit 614 Switch 615 Intra prediction unit

Claims (12)

In an image encoding device that selects any one of a plurality of prediction modes and predicts a pixel value in the same frame using a pixel value in the frame according to the selected prediction mode, and generates a predicted pixel value,
Means for inputting an image signal to be encoded;
Means for acquiring shooting information relating to the image signal;
And means for selecting a prediction mode using the photographing information when predicting a pixel value in the same frame using a pixel value in the frame in encoding of the input image signal. Image encoding device.   The image encoding apparatus according to claim 1, wherein the acquisition unit acquires information related to an imaging state when the image signal is captured.   The image encoding apparatus according to claim 2, wherein the information regarding the photographing state includes one or more of information obtained by an acceleration sensor, information regarding a zoom operation, and information regarding a focus operation.   The information related to the shooting state includes information indicating that the image signal was shot when the image signal is in one or more of pan, tilt, zoom, and blur. The image encoding device described.   The means for obtaining the photographing information obtains information on movement in the photographing direction when the image signal is photographed, and the means for selecting the prediction mode uses the information on movement in the photographing direction in the moving direction. The image encoding apparatus according to claim 1, wherein a prediction mode that is a related prediction direction is selected.   The means for obtaining the photographing information obtains information relating to zoom when the image signal is photographed, and the means for selecting the prediction mode uses the information relating to zoom to obtain an image photographed during zooming. 2. The image encoding apparatus according to claim 1, wherein a predetermined prediction mode is selected.   The means for selecting the prediction mode divides the screen into a plurality of areas for an image taken during zooming, and selects a prediction mode having the same prediction direction in each area. The image encoding device described.   The means for obtaining the photographing information obtains information relating to the focus when the image signal is photographed, and the means for selecting the prediction mode determines that the focus is in an out-of-focus state using the information relating to the focus. 2. The image encoding apparatus according to claim 1, wherein a predetermined prediction mode is selected for an image that is sometimes captured. Photographing means for outputting an image signal obtained by photographing;
An encoding means for compressing and encoding the image signal, selecting any one of a plurality of prediction modes and predicting a pixel value in the same frame using a pixel value in the frame according to the selected prediction mode In an imaging device including an encoding unit that performs processing for generating a predicted pixel value,
The image pickup apparatus, wherein the encoding unit selects a prediction mode based on an operation state of the photographing unit when predicting a pixel value in the same frame using a pixel value in the frame.   Further, a sensor for detecting the movement of the photographing means is provided, and the encoding means uses the information output from the sensor to move the photographing means in the moving direction when the image is taken while moving the photographing means. The imaging apparatus according to claim 9, wherein a prediction mode that is a related prediction direction is selected.   The image processing device further includes control means for controlling a zoom operation in the photographing means, and the encoding means uses the information output from the control means to select a predetermined prediction mode for an image photographed during zooming. The imaging apparatus according to claim 9.   And a control means for controlling a focusing operation in the photographing means, wherein the encoding means is an image photographed when the focus is determined to be out of focus using information output from the control means. 10. The imaging apparatus according to claim 9, wherein a predetermined prediction mode is selected.

Images