WO2010150470A1 - 動画像符号化方法、動画像符号化装置、プログラム、および集積回路 - Google Patents
動画像符号化方法、動画像符号化装置、プログラム、および集積回路 Download PDFInfo
- Publication number
- WO2010150470A1 WO2010150470A1 PCT/JP2010/003812 JP2010003812W WO2010150470A1 WO 2010150470 A1 WO2010150470 A1 WO 2010150470A1 JP 2010003812 W JP2010003812 W JP 2010003812W WO 2010150470 A1 WO2010150470 A1 WO 2010150470A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- resolution
- image
- encoded
- frame rate
- encoding
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Definitions
- the present invention relates to an image coding method and an image coding apparatus, and more particularly, to an MPEG (Moving Picture Experts Group) -4 AVC system, that is, ITU-T H.264.
- the present invention relates to an image coding method and an image coding apparatus that adaptively switch between resolution and a frame rate according to a target bit rate in the H.264 system.
- multimedia In recent years, with the age of multimedia handling voice, images and other pixel values in an integrated manner, the means by which information is transmitted to people, such as newspapers, magazines, televisions, radios and telephones, can be multimedia. It has come to be taken as a target.
- multimedia means to simultaneously represent not only characters but also graphics or sounds, in particular images, etc. simultaneously.
- the amount of information possessed by each information medium is estimated as the amount of digital information
- the amount of information per character is 1 to 2 bytes.
- voice 64 Kbits (telephone quality) per second
- an information amount of 100 Mbits (second current television reception quality) or more is required per second. Therefore, it is not realistic to handle the vast amount of information as it is in digital form in the above information media.
- videophones have been put to practical use by the Integrated Services Digital Network (ISDN), which has a transmission rate of 64 Kbit / s to 1.5 Mbit / s.
- ISDN Integrated Services Digital Network
- MPEG Motion Picture Experts Group
- ISO / IEC International Organization for Standardization International Electrotechnical Commission
- MPEG-1 is a standard for compressing moving picture signals up to 1.5 Mbit / s, that is, information on television signals to about one hundredth.
- the MPEG-1 standard satisfies the requirement for higher image quality based on the target quality being medium quality, that is, the quality that the transmission speed can be realized mainly at about 1.5 Mbit / s.
- MPEG-2 has been standardized to In MPEG-2, TV broadcast quality is realized at 2 to 15 Mbit / s for moving image signals.
- MPEG-4 has been standardized, which enables encoding, decoding, and manipulation, and realizes new functions necessary for the multimedia age. MPEG-4 achieves compression rates over MPEG-1 and MPEG-2, and also enables object-by-object encoding, decoding and manipulation.
- MPEG-4 was initially promoted to standardize low bit rate coding methods, it was extended to more general-purpose coding including high bit rate coding methods including interlaced images.
- MPEG-4 AVC ISO / IEC and ITU-T.
- An image signal can be considered to be a series of pictures (also called frames or fields) which are a set of pixels at the same time.
- compression is performed using the correlation of pixels in a picture based on the strong correlation between the pixels and neighboring pixels in the picture.
- compression is also performed using correlation of pixels between pictures based on strong correlation of pixels between consecutive pictures.
- inter coding compression using the correlation of pixels between pictures and the correlation of pixels within a picture.
- intra coding compression using only the correlation of pixels in a picture without using the correlation of pixels between pictures. Since this inter coding utilizes correlation between pictures, it can realize a higher compression rate than intra coding.
- MPEG-1 MPEG-2, MPEG-4, and MPEG-4 AVC (H.264)
- a high-speed network using ADSL or optical fiber is not an expensive band-guaranteed dedicated network for companies, but an inexpensive best effort network jointly used by a plurality of users.
- the upper limit of the sum of bit rates used by each user at that time is fixed. For this reason, the available bit rate per user is low when the number of users used is large, and the available bit rate per user is high when the number of users is small. That is, there is a feature that the usable bit rate is largely converted depending on the time.
- moving images include images that are very easy to compress, such as single-color solid images (images with the same color and the same brightness on the entire screen).
- images that are very easy to compress, such as single-color solid images (images with the same color and the same brightness on the entire screen).
- image which is very difficult to compress such as white noise, which has no correlation between pixels at all.
- it is important to be able to perform stable image coding without significant image quality degradation even for moving images that differ greatly in ease of compression.
- FIG. 24 is an explanatory diagram of a conventional moving picture coding apparatus.
- the left column of FIG. 24 is the image size (resolution) of the encoding target image to be encoded from now on, and indicates the resolution that is actually encoded.
- the right-hand column in FIG. 24 indicates the display image size displayed on the display device after enlarging the image size after decoding the corresponding encoding target image.
- the image to be encoded includes an image that is relatively easy to compress and an image that is relatively difficult to compress.
- encoding is performed without changing the resolution of the image to be encoded, and a display image obtained by decoding with the image decoding device is displayed as it is. There is.
- the number of pixels (resolution) of the image to be encoded is reduced to 3/4 (middle in FIG. 24) or 1/2 (lower in FIG. 24) Encode the image to be encoded with a small number of pixels (small resolution). Further, the display image decoded by the image decoding apparatus is enlarged in resolution by 4/3 or 2 ⁇ in both vertical and horizontal directions, and is displayed with the same number of pixels (resolution) as the original moving image.
- FIG. 25 is a block diagram showing a conventional image coding apparatus with dynamic change of resolution, frame rate and quantization step.
- the conventional image coding apparatus has a resolution changing circuit 501, a frame rate changing circuit 502, a moving image coding circuit 503, a quantization step control circuit 506, and a frame rate control circuit 507. And a resolution setting circuit 508 mainly.
- the resolution setting circuit 508 determines the resolution to be encoded according to the difficulty of image compression as in Patent Document 1, and notifies the resolution change circuit 501 of the resolution of the image to be encoded as a resolution signal S64.
- the resolution changing circuit 501 converts the moving image signal S60 input from the moving image input terminal 500 at a predetermined resolution into the resolution notified from the resolution setting circuit 508.
- the frame rate control circuit 507 notifies the frame rate change circuit 502 of the frame rate of the image to be encoded as a frame rate signal S67.
- the frame rate changing circuit 502 changes the frame rate of the moving image signal S61 whose resolution has been changed to the frame rate notified from the frame rate control circuit 507.
- the quantization step control circuit 506 notifies the moving picture coding circuit 503 of the quantization step to be quantized by the moving picture coding circuit 503 as a quantization step signal S66.
- the moving picture coding circuit 503 quantizes and codes the moving picture signal S62 whose frame rate has been changed in the quantization step notified from the quantization step control circuit 506, and outputs a bit stream S63 to the bit stream output terminal 504. .
- the quantization step control circuit 506 determines the quantization step on the basis of the target coding bit rate, the code amount of the bit stream S63 output from the moving picture coding circuit 503, and the value of the frame rate signal S64. . Also, the frame rate control circuit 507 determines the frame rate in accordance with the value of the quantization step signal S66 determined by the quantization step control circuit 506.
- the resolution is determined by the resolution setting circuit 508 in accordance with the difficulty of image compression.
- the frame rate and the quantization step are dynamically controlled to operate at the target bit rate.
- the resolution setting circuit 508 is set to the maximum resolution. Notice.
- the quantization step becomes large and blurring or block distortion occurs.
- frame thinning is increased to reduce the frame rate, the correlation between the remaining frames is reduced, so that the compression effect by the frame thinning is reduced.
- the image may be unsightly unless the resolution is lowered.
- bit rate that can be transmitted fluctuates greatly depending on the time when it is congested (it may be a bit rate of a few parts).
- PC personal computer
- bit rate available to the image encoding device decreases sharply. As soon as the PC operation is interrupted, there are many situations where rapid changes such as an increase in bit rate occur.
- the resolution is frequently switched in conjunction with the bit rate, resulting in poor image quality.
- the present invention solves the problems of the prior art as described above, and the image quality does not feel unnatural even if the degree of difficulty in compression of the input moving image or the target encoding bit rate changes significantly. It is an object of the present invention to provide a moving picture coding method that enables coding.
- a moving picture coding method codes an input image to generate a coded bit stream, and transmits the coded bit stream to a transmission path.
- an image conversion step of changing at least one of the resolution and the frame rate of the input image and outputting the image to be encoded according to the degree of difficulty of encoding the input image, and the image conversion A moving image encoding step of encoding the image to be encoded output in a step to generate the encoded bit stream and transmitting the encoded bit stream onto the transmission path; and transmitting the encoded bit stream onto the transmission path
- the resolution range selecting step determines a lower limit value of the resolution of the image to be encoded according to the encoding bit rate determined in the bit rate determining step, and the resolution of the image to be encoded is the resolution
- the change in the image conversion step may be controlled so as not to fall below the lower limit value.
- the code is changed until at least one of a predetermined time has elapsed and a predetermined number of the input image has been processed after changing the resolution of the image to be encoded.
- the resolution of the conversion target image may not be changed. Since the image to be encoded immediately after the resolution change is encoded using intra prediction, the encoding efficiency temporarily decreases. Therefore, it is desirable not to change the resolution of the coding target image again until a predetermined time required for the coding efficiency to stabilize and / or until a predetermined number of input images (frames) are processed.
- the coding bit rate may be determined based on the transmittable bit rate of the transmission path obtained by measuring the amount of coded bit stream actually transmitted and received between the transmitting device and the receiving device. .
- the code amount that can be actually transmitted and received can be acquired by notifying the number of data received from the receiving device to the transmitting device or the number of data not received.
- the method of determining the encoding bit rate is not limited to this, and may be, for example, a fixed value designated by the user.
- the moving picture coding method calculates and calculates a quantization step such that the coded bit stream becomes a code amount that can be transmitted at the coding bit rate determined in the bit rate determination step.
- the image conversion step determines the degree of difficulty in encoding the input image based on the quantization step average value calculated in the average value calculation step, and the resolution of the image to be encoded and An image quality determination step of determining a frame rate, a resolution change step of changing the input image to the resolution determined in the image quality determination step, and a frame rate of changing the input image to a frame rate determined in the image quality determination step And a change step.
- the “average value of quantization steps calculated in a predetermined time” may be, for example, an average value from the first frame of the image to be encoded to the present. Furthermore, since the value of the quantization step becomes unstable in the predetermined period after changing the resolution, it may be excluded from the calculation process of the average value.
- the image quality determination step may hold in advance at least one of a first resolution smaller than the resolution determined immediately before and a large second resolution. Then, when the quantization step average value calculated in the average value calculation step is larger than a predetermined first threshold and the first resolution held is equal to or more than the lower limit, the resolution The resolution of the input image is changed to the first resolution in the changing step, and the quantization step average value calculated in the average value calculating step is smaller than a predetermined second threshold and held. When the second resolution is less than or equal to the upper limit value, the resolution changing step may change the resolution of the input image to the second resolution.
- the image quality determination step may hold in advance at least one of a first frame rate smaller than a frame rate determined immediately before and a larger second frame rate.
- the frame rate changing step changes the frame rate of the input image to the second frame rate, and the resolution is changed.
- the frame rate changing step may change the frame rate of the input image to the first frame rate.
- Resolution has a greater impact on coding efficiency and image quality than frame rate. Therefore, by changing the frame rate in accordance with the reduction in resolution and reducing the frame rate in accordance with the increase in resolution, it is possible to suppress abrupt fluctuations in coding efficiency and image quality.
- the image quality determination step may hold in advance at least one of a first frame rate smaller than a frame rate determined immediately before and a larger second frame rate. And, when the quantization step average value calculated in the average value calculation step is larger than a predetermined first threshold and the first resolution held is lower than the lower limit value, the frame rate The frame rate of the input image is changed to the first frame rate in the changing step, and the quantization step average value calculated in the average value calculating step is smaller than a predetermined second threshold and held.
- the frame rate changing step may change the frame rate of the input image to the second frame rate when the second resolution exceeds the upper limit value.
- the resolution can be changed within the range of the upper limit value and the lower limit value, and the resolution is further changed If this is not possible, the frame rate can be changed and adjusted.
- the parameter for determining “the degree of difficulty in encoding the input image” in the image conversion step is not limited to the quantization step, but may be any numerical value necessary for deriving the quantization step. Other numbers may be used.
- quantization parameters may be used.
- the quantization step is a set of a plurality of numerical values which are different for each frequency component. Then, the quantization step calculation step holds a plurality of sets (for example, 32 sets) by changing the magnification. Therefore, a numerical value corresponding to this magnification may be used as a parameter for determining the "degree of difficulty of encoding of the input image".
- a moving picture coding apparatus codes an input image to generate a coded bit stream, and transmits the coded bit stream to a transmission path. Specifically, according to the degree of difficulty in encoding the input image, at least one of the resolution and the frame rate of the input image is changed to output an encoding target image, and the image conversion A video encoding unit for encoding the encoding target image output from the unit to generate the encoded bit stream, and transmitting the encoded bit stream onto the transmission path; A bit rate determination unit that determines a coding bit rate that is a bit rate of a coded bit stream, and an upper limit value of the resolution of the image to be coded according to the coding bit rate determined by the bit rate determination unit And a resolution range selection unit configured to control the image conversion unit such that the resolution of the image to be encoded does not exceed the upper limit value.
- a program causes a computer to encode an input image to generate a coded bit stream, and send the coded bit stream to a transmission path.
- an image conversion step of changing at least one of the resolution and the frame rate of the input image and outputting the image to be encoded according to the degree of difficulty of encoding the input image, and the image conversion A moving image encoding step of encoding the image to be encoded output in a step to generate the encoded bit stream and transmitting the encoded bit stream onto the transmission path; and transmitting the encoded bit stream onto the transmission path
- An integrated circuit encodes an input image to generate a coded bit stream, and transmits the coded bit stream to a transmission path. Specifically, according to the degree of difficulty in encoding the input image, at least one of the resolution and the frame rate of the input image is changed to output an encoding target image, and the image conversion A video encoding unit for encoding the encoding target image output from the unit to generate the encoded bit stream, and transmitting the encoded bit stream onto the transmission path; A bit rate determination unit that determines a coding bit rate that is a bit rate of a coded bit stream, and an upper limit value of the resolution of the image to be coded according to the coding bit rate determined by the bit rate determination unit And a resolution range selection unit configured to control the image conversion unit such that the resolution of the image to be encoded does not exceed the upper limit value.
- the present invention can be realized not only as a moving picture coding method or a moving picture coding apparatus, but also as an integrated circuit for realizing these functions or as a program for causing a computer to execute such functions. You can also Needless to say, such a program can be distributed via a recording medium such as a CD-ROM and a transmission medium such as the Internet.
- the moving picture coding method and the moving picture coding apparatus of the present invention an image which can be easily compressed even if the degree of difficulty in compression of the input moving picture or the target coding bit rate changes significantly
- encoding at a low bit rate encoding at a large resolution can be prevented.
- FIG. 1A is a block diagram of a video encoding apparatus according to a first embodiment.
- FIG. 1B is a block diagram showing a minimum configuration of the moving picture coding apparatus according to Embodiment 1.
- FIG. 1C is a flowchart showing the operation of the moving picture coding apparatus of FIG. 1B.
- FIG. 2 is a detailed block diagram of the resolution changing circuit of FIG.
- FIG. 3 is a diagram showing the relationship between an image (a) before resolution change processing and images (b) to (d) after resolution change processing.
- FIG. 4 is a detailed block diagram of the frame rate changing circuit of FIG.
- FIG. 5 is a time chart of the frame rate change process.
- FIG. 6 is a detailed block diagram of the moving picture coding circuit of FIG. FIG.
- FIG. 7 is a flowchart showing the operation of the quantization step control circuit of FIG.
- FIG. 8 is a flowchart showing the operation of the quantization step averaging circuit of FIG.
- FIG. 9 is a diagram showing the relationship between the bit rate held by the resolution range selection circuit of FIG. 1 and the resolution range.
- FIG. 10 is a flow chart showing the operation of the resolution and frame rate selection circuit of FIG.
- FIG. 11 is a diagram showing an example of state transition performed by the resolution / frame rate selection circuit.
- FIG. 12 is a diagram illustrating a specific example of state transition.
- FIG. 13 is a diagram showing the resolution, the frame rate, the transition condition, and the transition destination state ID in each state of FIG.
- FIG. 14 is a diagram illustrating another specific example of state transition.
- FIG. 15A is a diagram showing an example of a physical format of a magnetic disk which is a recording medium main body.
- FIG. 15B is a front view, a cross-sectional view, and a view showing the magnetic disk of a case for holding the magnetic disk.
- FIG. 15C is a diagram showing a configuration for recording and reproducing the program on a flexible disk.
- FIG. 16 is a schematic view showing an example of the entire configuration of a content supply system for realizing content distribution service.
- FIG. 17 is a view showing the appearance of a mobile phone.
- FIG. 18 is a block diagram showing a configuration example of a mobile phone.
- FIG. 19 is a schematic view showing an example of the entire configuration of the digital broadcasting system.
- FIG. 20 is a block diagram showing a configuration example of a television.
- FIG. 21 is a block diagram showing an example of the configuration of an information reproduction and recording unit that reads and writes information on a recording medium, which is an optical disk.
- FIG. 22 is a view showing an example of the structure of a recording medium which is an optical disc.
- FIG. 23 is a block diagram showing a configuration example of an integrated circuit for realizing the image coding method and the image decoding method according to each embodiment.
- FIG. 24 is a diagram showing the relationship between a conventional encoding target image and a display image.
- FIG. 25 is a block diagram of a conventional moving picture coding apparatus.
- FIG. 1A is a block diagram showing the configuration of a moving picture coding apparatus 10 according to Embodiment 1 of the present invention.
- the moving picture coding apparatus 10 includes a resolution changing circuit (resolution changing unit) 101, a frame rate changing circuit (frame rate changing unit) 102, a moving picture coding circuit (moving picture coding unit) 103, and a bit rate determination.
- a resolution / frame rate selection circuit image quality determination unit
- the resolution changing circuit 101 changes the resolution of the moving image signal S10 acquired from the moving image input terminal 100 to the resolution notified by the resolution selection signal S18.
- the frame rate change circuit 102 changes the frame rate of the moving image signal S11 whose resolution has been changed to the frame rate notified from the frame rate selection signal S19.
- an input image (corresponding to "moving image signal S10") is encoded with an image to be encoded ("moving image signal S12") by the resolution changing circuit 101 and the frame rate changing circuit 102 described above and the resolution / frame rate selecting circuit 109 described later.
- Image conversion unit 110 that converts The image conversion unit 110 changes at least one of the resolution and the frame rate of the input image according to the degree of difficulty in encoding the input image, and outputs the image to be encoded.
- the moving picture coding circuit 103 acquires the quantization step (or quantization parameter) notified by the quantization step signal S16 and the resolution change occurrence signal S20 indicating the presence or absence of resolution change, and the moving picture whose frame rate is changed.
- the signal S12 is encoded to generate a bit stream S13. It is assumed that the information on the resolution of the image and the information on the frame rate necessary for encoding by the video encoding circuit 103 are included in the video signal S11 or the video signal S12. Then, the moving picture coding circuit 103 sends the generated bit stream S13 onto the transmission path via the bit stream output terminal 104.
- the quantization step control circuit 106 obtains the coding bit rate signal S14, the frame rate selection signal S19, and the bit stream S13 to determine the quantization step.
- the quantization step control circuit 106 may receive the number of bits of the bit stream S13 instead of the bit stream S13.
- the quantization step averaging circuit 107 obtains the quantization step signal S16 and the resolution change occurrence signal S20, and obtains a quantization step average value which is an average value of quantization steps at the same resolution within a predetermined time.
- a quantization step average value is not specifically limited, For example, it can calculate by index weighted moving average calculation.
- the bit rate determination circuit 105 determines the encoding bit rate of the bit stream S13 output from the moving picture encoding circuit 103. Although a specific determination method of the coding bit rate is not particularly limited, it may be determined based on, for example, a transmittable bit rate in a transmission path. Alternatively, an input of a coding bit rate specified by the user may be accepted.
- the resolution range selection circuit 108 obtains the coding bit rate signal S14, and determines a resolution selection range including the upper limit value and the lower limit value of the resolution of the image to be coded from the coding bit rate.
- the resolution and frame rate selection circuit 109 obtains the quantization step average value signal S17 and the resolution selection range signal S15, and determines the resolution and frame rate of the image to be encoded. Then, the resolution / frame rate selection circuit 109 outputs a resolution selection signal S18, a frame rate selection signal S19, and a resolution change generation signal S20.
- the moving picture coding apparatus 10 includes an image conversion unit 20, a moving picture coding unit 30, a bit rate determination unit 40, and a resolution range selection unit 50.
- the moving picture coding apparatus 10 codes an input image to generate a coded bit stream, and transmits the coded bit stream to a transmission path.
- the image conversion unit 20 has the image conversion unit 110 of FIG. 1A
- the moving image encoding unit 30 has the moving image encoding circuit 103, the quantization step control circuit 106, and the quantization step averaging circuit 107 of FIG.
- the rate determination unit 40 corresponds to the bit rate determination circuit 105 in FIG. 1A
- the resolution range selection unit 50 corresponds to the resolution range selection circuit 108 in FIG. 1A.
- the image conversion unit 110 acquires the input image, changes at least one of the resolution and the frame rate of the acquired input image to generate the encoding target image, and generates the encoding target image to the moving image encoding circuit 103.
- Output (Step 11).
- the resolution and frame rate of the image to be encoded are determined based on the degree of difficulty in encoding the input image acquired from the quantization step averaging circuit 107 and the upper limit value of the resolution acquired from the resolution range selection circuit 108. It is determined.
- the moving picture coding circuit 103 acquires an encoding target image from the image conversion unit 110, encodes the acquired encoding target image to generate a coded bit stream, and transmits the generated coded bit stream to a transmission path. Do it (Step 12).
- the moving picture coding circuit 103, the quantization step control circuit 106, and the quantization step averaging circuit 107 calculate the next input image based on the result of the coding process of the coding target image coded up to the present time. The degree of difficulty in encoding is estimated and notified to the image conversion unit 110.
- the bit rate determination circuit 105 determines a coding bit rate which is a bit rate of the coded bit stream sent on the transmission path, and notifies the resolution range selection circuit 108 of the determined coding bit rate (Step 13).
- the resolution range selection circuit 108 determines the upper limit value of the resolution of the image to be encoded according to the encoding bit rate determined in the bit rate determination step, and notifies the image conversion unit 110 of the determined upper limit value of resolution.
- the processing in the image conversion unit 110 is controlled so that the resolution of the encoding target image does not exceed the upper limit value (Step 14).
- FIG. 2 is a block diagram of the resolution changing circuit 101 of FIG. Further, (a) to (b) of FIG. 3 are diagrams showing a write address and a read address corresponding to the pixel position of the frame memory.
- the resolution changing circuit 101 includes a horizontal LPF circuit 301, a vertical LPF circuit 302, a frame memory 303, and a write / read control circuit 305.
- the resolution change circuit 101 acquires the moving image signal S10 from the moving image input terminal 300 and the resolution selection signal S18 from the resolution selection signal input terminal 304, and changes the resolution of the moving image signal S10 to the moving image output terminal 306. Output.
- the horizontal direction LPF circuit 301 applies low-pass filter processing in the horizontal direction to the moving image signal S10 to output a moving image signal S31.
- the vertical LPF circuit 302 applies a low pass filter process in the vertical direction to the moving image signal S31 to output a moving image signal S32.
- the frame memory 303 stores one frame of the moving image signal S32.
- the write and read control circuit 305 controls writing and reading of the frame memory 303.
- the horizontal direction LPF circuit 301 and the vertical direction LPF circuit 302 perform averaging processing of the input image, and switch the low-pass characteristics according to the resolution selection signal S18 input from the resolution selection signal input terminal 304.
- the passband of the low pass filter is narrow so that only low frequency components are passed, and the resolution reduction ratio is small (medium When changing to an image with a certain degree of resolution), the passband of the low pass filter is broadened to pass low and middle frequency components.
- the low-pass filter process is a process for suppressing aliasing noise generated in downsampling due to the reduction process.
- the moving image signal S10 input from the moving image input terminal 300 is subjected to low-pass filter processing in the horizontal direction and the vertical direction of the appropriate pass band in accordance with the resolution selection signal S18.
- the moving image signal S32 subjected to the low pass filter processing is sequentially written to the write address position of the frame memory 303 by the write and read control circuit 305.
- (A) of FIG. 3 is an example of the moving image signal S10.
- the pixels are arranged at addresses in a two-dimensional space from left to right on the memory, and the address of one row lower in the horizontal direction is increased by H.
- the write / read control circuit 305 controls the write address and the read address of the image after reduction in accordance with the reduction ratio of the resolution selection signal S 18 acquired from the resolution selection signal input terminal 304.
- FIG. 3 outputs the read address of the corresponding pixel of the moving image signal S10 in the case of output at a reduction ratio of 3/4, and (d) in FIG. It is a figure which shows the read-out address of the applicable pixel of animation signal S10, respectively.
- the write and read control circuit 305 sequentially reads out the extracted address from the frame memory 303, and outputs it as a moving image signal S11 to the moving image output terminal 306.
- FIG. 4 is a block diagram of the frame rate change circuit 102 of FIG.
- FIG. 5 is a time chart showing the operation of the frame rate change circuit 102.
- the frame rate change circuit 102 has a moving image input terminal 200 to which a moving image signal S11 whose resolution is changed is input, and a frame rate selection signal input terminal 201 to which a frame rate selection signal S19 is input. It includes a frame memory 202 for storing the acquired moving image signal S11, a write / read control circuit 203 for controlling writing and reading of the frame memory 202, and a moving image output terminal 204 for outputting a moving image signal S12 having a changed frame rate.
- the moving image signal S11 input from the moving image input terminal 200 is written to the frame memory 202.
- the write / read control circuit 203 performs write control of the frame memory 202 as shown in the write frame number of the time chart (uppermost stage) shown in FIG. 5, and sequentially writes the moving image signal S11 in the frame memory.
- the write / read control circuit 203 causes the read frame numbers of the time chart (second to fifth stages) shown in FIG. Similarly, the frame is thinned out from the frame memory 202 and intermittently read, and is output as a moving image signal S12. This makes it possible to change the frame rate.
- FIG. 6 is a block diagram showing the configuration of the moving picture coding circuit 103.
- the moving picture coding circuit 103 deciphers the input image memory 401, the difference operation circuit 402, the orthogonal transformation circuit 403, the quantization circuit 404, the variable length coding circuit 405, and The circuit 408, the inverse orthogonal transformation circuit 409, the addition operation circuit 410, the reference image memory 411, the motion vector detection circuit 412, the motion compensation circuit 413, the in-plane prediction circuit 414, and the coding mode selection control circuit 415 And a predictive image selector circuit 416.
- the video encoding circuit 103 acquires a video signal S12 from a video input terminal 400, a quantization step signal S16 from a quantization step input terminal 407, and a resolution change generation signal S20 from a resolution change generation signal input terminal 417. , And outputs the bit stream S13 to the bit stream output terminal 406.
- the input image memory 401 changes the pixel order of the input moving image signal S12 and converts it into a moving image signal S41 in units of blocks.
- the difference calculation circuit 402 calculates the difference between the block-divided moving image signal S41 and the predicted image signal S48, and outputs a difference signal S42.
- the orthogonal transformation circuit 403 orthogonally transforms the difference signal S42 and outputs a coefficient signal S43.
- the quantization circuit 404 quantizes the coefficient signal S43 with the quantization step signal S16, and outputs a quantization value S44.
- the variable-length coding circuit 405 performs variable-length coding on the quantization value S44.
- the inverse quantization circuit 408 inversely quantizes the quantization value S44 with the quantization step signal S16, and outputs an inverse quantized coefficient signal S46.
- the inverse orthogonal transformation circuit 409 performs inverse orthogonal transformation on the dequantized coefficient signal S46, and outputs the inverse orthogonal transformed moving image signal S47.
- the addition operation circuit 410 adds the inverse orthogonal transform-completed moving image signal S47 and the predicted image signal S48 to generate reference image data S49.
- the reference image memory 411 temporarily stores reference image data S49.
- the motion vector detection circuit 412 compares the reference image data S50 read from the reference image memory 411 with the block-divided moving image signal S41, detects a motion vector of the block-divided moving image signal S41, and outputs a motion vector signal S52. Output.
- the motion compensation circuit 413 reads the reference image data S50 from the reference image memory 411 corresponding to the motion vector signal S52, performs motion compensation using the read reference image data S50, and outputs the generated motion predicted image data S51. .
- the in-plane prediction circuit 414 performs in-plane prediction by comparing the image data in the vicinity of the encoding target block read from the reference image memory 411 with the block-divided moving image signal S41 to generate in-plane predicted image data S53. Do.
- the coding mode selection control circuit 415 obtains the block-divided moving image signal S41, the motion prediction image data S51, the in-plane prediction image data S53, and the resolution change generation signal S20, and based on these, the mode selection signal Output S54.
- the specific determination method is not particularly limited, for example, the difference absolute value sum of the moving image signal S41 divided into blocks and the motion predicted image data S51, and the difference absolute between the moving image signal S41 divided into blocks and the in-plane predicted image data S53 Compare with the value sum. Then, if the former value is small, inter-screen prediction may be selected, and if the latter value is small, intra-frame prediction may be selected. On the other hand, when it is the first frame in which the resolution change has occurred, the intra prediction is always selected.
- the prediction image selector circuit 416 selects one of the in-plane prediction image data S53 and the motion prediction image data S51 in accordance with the mode selection signal S54, and outputs a prediction image signal S48.
- the moving picture coding circuit 103 orthogonally transforms the difference signal S42 between the block-divided moving picture signal S41 and the predicted picture signal S48, and inputs the obtained coefficient signal S43 from the quantization step input terminal 407.
- a quantization step signal S16 is used for quantization, the obtained quantization value S44 is subjected to variable length coding, and a bit stream signal is output.
- the generated code amount decreases as the value of the quantization step signal S16 increases, and conversely, increases as the value of the quantization step signal S16 decreases. That is, the generated code amount is controlled using the quantization step signal S16.
- FIG. 7 is a flowchart showing the operation of the quantization step control circuit 106.
- the quantization step control circuit 106 first determines whether the input frame is the first frame to be encoded (Step 100). If it is not the first frame of the stream (No in Step 100), the quantization step control circuit 106 waits for the end of encoding of the frame in the quantization step determined in Step 103 to Step 106 (Step 102). Note that since the encoding of a frame is performed by the moving image encoding circuit 103, the quantization step control circuit 106 only operates to wait for the end of encoding of the frame.
- the quantization step control circuit 106 resets the accumulated difference code amount (TBD) to 0, and performs the initial quantization step determined in advance as the current frame. Step of quantization (step 101). Then, it waits for the end of encoding of the frame (Step 102).
- the quantization step control circuit 106 sets the target using Equation 1 based on the acquired target bit rate (TBR) and frame rate (FR) when encoding of the frame is completed.
- An average code amount (AFB) per frame is obtained (Step 103).
- AFB TBR / FR (equation 1)
- the quantization step control circuit 106 counts the code amount of the bit stream S13. Then, the quantization step control circuit 106 uses the equation 2 to calculate the accumulated difference code amount (TBD) based on the resultant generated code amount (FBT) of one frame and the target code amount (AFB) of one frame. ) Is obtained (Step 104).
- TBD + FBT-AFB (Equation 2)
- the quantization step control circuit 106 uses Equation 3 to calculate the target code amount (TFB) of the next frame based on the average code amount (AFB) per frame and the accumulated difference code amount (TBD). Determine (Step 105).
- the quantization step control circuit 106 calculates the quantization step (QS (n-1)) of the current frame, the generated code amount of one frame (FBT), and the target code amount (TFB) of the next frame. Based on the equation (4), the quantization step (QS (n)) of the next frame is obtained, and the value is output (Step 106).
- the quantization step control circuit 106 determines whether or not encoding of all the frames is completed (Step 107). If a frame to be encoded remains (No in Step 107), the above process (Step 100 to Step 106) is performed on the next frame. On the other hand, when the encoding of all the frames is completed (Yes in Step 107), the process ends. That is, the above process is repeatedly performed until encoding of all frames is completed.
- the value obtained by adding the difference between the code amount (FBT) generated when encoding of one frame is completed and the average code amount (AFB) to the accumulated difference code amount (TBD) is the current frame.
- FIG. 8 is a flowchart showing the operation of the quantization step averaging circuit 107. Note that FIG. 8 shows an example in which the quantization step average value is calculated using the exponential weighted moving average calculation.
- the quantization step averaging circuit 107 first determines whether the input frame is the first frame to be encoded (Step 200). When it is not the first frame of the stream (No in Step 200), the quantization step averaging circuit 107 waits for the end of encoding of the frame (Step 202). Note that since the encoding of a frame is performed by the moving image encoding circuit 103, the quantization step averaging circuit 107 only operates to wait for the end of encoding of the frame.
- the quantization step averaging circuit 107 initializes the quantization step average value (Step 201), and waits for the encoding of the frame to end (Step 202). ).
- the quantization step averaging circuit 107 determines whether a predetermined number of frames has elapsed from the first frame to be encoded (Step 203) and whether a predetermined number of frames has elapsed since a change in resolution has occurred. (Step 204). If both of the two conditions hold (Yes in both Step 203 and Step 204), the quantization step averaging circuit 107 calculates the quantization step value (QS (n)) of the current frame and the quantization step average of the previous frame. Based on the value (QSema (n-1)) and the weighting factor W, the quantization step average value (QSema (n)) of the current frame is obtained using Equation 5 (Step 205).
- Equation 5 The weighting factor W in Equation 5 is a constant calculated using Equation 6.
- the weight coefficient W controls the degree of fluctuation of the quantization step average value, and the larger the weight coefficient W, the less the fluctuation, and the smaller the fluctuation, the more easily the fluctuation.
- the weighting factor W may be a fixed value designated at the time of design or the like, or may be a variable value which can be changed according to the situation.
- the quantization step averaging circuit 107 determines whether or not encoding of all the frames is completed (Step 206). If a frame to be encoded remains (No in Step 206), the above process (Step 200 to Step 205) is performed on the next frame. On the other hand, when the encoding of all the frames is completed (Yes in Step 206), the process ends. That is, the above process (Step 200 to Step 205) is repeatedly performed until encoding of all the frames is completed.
- FIG. 9 is a reference table for explaining the operation of the resolution range selection circuit 108.
- the resolution range selection circuit 108 associates and holds the bit rate and the lower limit value and the upper limit value of the resolution of the image to be encoded.
- threshold Rth 0 or more referred to as “high bit rate”
- threshold Rth 1 or more and less than threshold Rth 0 referred to as “medium bit rate”
- less than threshold Rth 1 The lower limit value and the upper limit value of the resolution of the image to be encoded are set for each of the cases of “described as“ low bit rate ”).
- the resolution range selection circuit 108 compares the value of the encoded bit rate signal S14 acquired from the bit rate determination circuit 105 with the threshold Rth0 and the threshold Rth1. Then, according to the result, the resolution range selection circuit 108 outputs a resolution selection range signal S15 composed of the upper limit value and the lower limit value of the resolution of the image to be encoded.
- FIG. 10 is a flowchart showing the operation of the resolution / frame rate selection circuit 109.
- the resolution and frame rate selection circuit 109 determines the resolution and frame rate of the image to be encoded according to the flow of FIG. 10 based on the acquired quantization step average value signal S17 and the resolution selection range signal S15. is there.
- the resolution and frame rate selection circuit 109 first determines whether the input encoding target frame is the first frame (Step 300). If the frame to be encoded is not the first frame (No in Step 300), the resolution / frame rate selection circuit 109 waits for the frame to be encoded with the currently set resolution and frame rate (Step 302) . Note that since encoding of a frame is performed by the moving image encoding circuit 103, the resolution / frame rate selection circuit 109 only operates to wait for the end of encoding of the frame.
- the resolution / frame rate selection circuit 109 sets an initial state ID determined in advance as the state ID. Further, the resolution indicated by the initial state ID is output as a resolution selection signal S18, and the frame rate indicated by the initial state ID is output as a frame rate selection signal S19 (Step 301). Then, the resolution / frame rate selection circuit 109 waits for the end of the encoding of the frame with the resolution and the frame rate (Step 302).
- the resolution / frame rate selection circuit 109 determines whether a predetermined number of frames has elapsed from the beginning of the stream (Step 303), or after a change in resolution occurs. Number of frames and / or whether a predetermined time has elapsed (Step 304). When one of these two conditions does not hold (No in Step 303 or Step 304), the resolution / frame rate selection circuit 109 changes the current state ID and the resolution and frame rate indicated by the ID. Hold without. On the other hand, when both of the two conditions are satisfied (Yes in both Step 303 and Step 304), the resolution and frame rate to be used in the encoding of the next frame are determined.
- the resolution and frame rate selection circuit 109 determines the resolution and frame rate of the image to be encoded according to the degree of difficulty in encoding the input image.
- the “degree of difficulty in encoding” in the first embodiment is determined based on the quantization step average value signal S17. That is, it is determined that the larger the quantization step average value signal S17, the more difficult the encoding is, and the smaller the smaller the quantization step average value signal S17, the easier the encoding.
- the resolution of the image to be encoded is selected within the range of the upper limit value and the lower limit value of the resolution indicated by the resolution selection range signal S15. Specifically, it is determined according to the state transition diagram as shown in FIG.
- FIG. 11 shows a generalized combination of resolution and frame rate.
- a state ID (S 11 to S 44 ) is assigned to each combination of resolution and frame rate.
- Each state ID holds transition conditions for transitioning from the current state ID to another state ID.
- the current state ID and another state ID are in contact with each other in the vertical direction (resolution change), not only in the horizontal direction (frame rate change) but also in an oblique direction (resolution and frame rate) Changes) may also be included.
- they do not necessarily have to be adjacent to each other. However, in many cases, only a limited combination of these combinations is used, and the transition condition to a state that does not actually transition is always “False”.
- FIG. 12 is a diagram illustrating an example of state transition.
- any state ID is always set.
- the threshold value of the quantization step average value signal S17 is held as a transition condition for transitioning from the current state ID to another state ID.
- FIG. 13 is a table showing resolutions, frame rates, transition conditions 1 and 2, and state transition destinations 1 and 2 in each state ID.
- transition condition 1 indicates the upper limit (QpUth) of quantization step average value signal S17
- transition condition 2 indicates the lower limit (QpLth) of quantization step average value signal S17.
- Transition condition 1 is a condition for reducing one of the resolution and the frame rate
- transition condition 2 is a condition for increasing one of the resolution and the frame rate.
- transition is made only from the current state ID to another state ID adjacent in the vertical direction (resolution) and the horizontal direction (frame rate).
- FIG. 14 is a diagram illustrating another example of state transition.
- state transition is performed also when transition conditions 3 and 4 are satisfied.
- Transition condition 3 indicates a second upper limit (QpUth2) larger than the upper limit (QpUth) of transition condition 1, and transition condition 4 a second lower limit (QpLth2) smaller than the lower limit (QpLth) of transition condition 2 Point to.
- QpUth2 a second upper limit
- QpLth2 second lower limit
- FIG. 12 and FIG. 14 there are cases where the transition conditions are different even if the state transition is the same.
- the resolution / frame rate selection circuit 109 reads transition condition 1, transition condition 2, state transition destination 1, and state transition destination 2 corresponding to the current state ID (Step 305). Assuming that the current state ID is S11, the first line of FIG. 13 is read.
- the resolution / frame rate selection circuit 109 compares the quantization step average value signal S17 with the transition condition 1 (Step 306). Further, it is determined whether the resolution of the state transition destination 1 is included in the resolution selection range (Step 307).
- the resolution / frame rate selection circuit 109 The table is searched to output the resolution value indicated by the state ID of the state transition destination 1 as the resolution selection signal S18, and the frame rate value as the frame rate selection signal S19 (Step 308). Further, the state ID is changed to the state ID of the state transition destination 1 (Step 309). Furthermore, when there is a change in resolution due to a change in status ID (Yes in Step 320), the resolution change occurrence signal S20 is set valid (Step 322), and when there is no change in resolution (No in Step 320) The signal S20 is set to be invalid (Step 321).
- the resolution selection range signal S15 in the following description is assumed to indicate the resolution selection range in the case of a high bit rate.
- the state transition destination 1 when the transition condition 1 is satisfied is S 21.
- the resolution of S 21 is 1280 ⁇ 720, included within the resolution selection in the case of high bit-rate (Fig. 9). In other words, it is possible to state transition from S 11 to S 21.
- the state transition destination 1 when the transition condition 1 is satisfied it is S 22.
- This resolution in S 21 is, coincides with the lower limit of resolution in the high bit rate, because there is no room to decrease the resolution. Therefore, the state is transitioned from S 21 to S 22 without changing the resolution.
- the state transition destination when transition condition 1 is satisfied is determined in advance, but the present invention is not limited to this, and other methods can be used. For example, even if the state transition in the direction to decrease the resolution (the downward direction in FIG. 12) does not fall below the lower limit value of the resolution selection range, the state transition in the direction is made. On the other hand, when the value is lower than the lower limit value, the state transition may be made in the direction of decreasing the frame rate (right direction in FIG. 12).
- the resolution selection range signal S15 in the following description is assumed to indicate the resolution selection range in the case of a high bit rate.
- the state transition destination 1 when the transition condition 1 is satisfied it is S 21. That is, the example of FIG. 14 differs from the example of FIG. 12 in that the frame rate is increased as the resolution is reduced. This is because compression is facilitated by reducing the resolution, so that even if the frame rate is slightly increased, the image quality does not deteriorate compared to the state immediately before the high resolution.
- transition condition 1 in order to further reduce the frame rate (ie, the transition from S 22 to S 23 ), transition condition 1 must be satisfied with respect to quantization step average value rather than transition condition 1, as shown in FIG. Different from the example. This is because better to reduce the resolution is not noticeable image quality degradation than to reduce the frame rate, in order to facilitate a transition to S 31 is smaller resolution.
- the condition of the quantization step average value earlier than the transition condition 3 corresponds to the transition condition 1 and the transition to the small resolution S 31 is made.
- the process proceeds to S 23 frame rate is less by a transition condition 3.
- the resolution / frame rate selection circuit 109 compares the quantization step average value signal S17 with the transition condition 2 (Step 310). Further, it is determined whether the resolution of the state transition destination 2 is included in the resolution selection range (Step 311).
- the resolution / frame rate selection circuit 109 performs state transition The table is searched and the resolution value indicated by the state ID of the state transition destination 2 is output as the resolution selection signal S18, and the frame rate value is output as the frame rate selection signal S19 (Step 312). Further, the state ID is changed to the state ID of the state transition destination 2 (Step 313). Furthermore, when there is a change in resolution due to a change in status ID (Yes in Step 320), the resolution change occurrence signal S20 is set valid (Step 322). When there is no change in resolution (No in Step 320), the resolution change occurrence signal Is set to be invalid (Step 321).
- the resolution selection range signal S15 in the following description is assumed to indicate the resolution selection range in the case of the medium bit rate.
- the state transition destination 2 when the transition condition 2 is satisfied is S 22.
- the resolution of S 22 is 1280 ⁇ 720, included within the resolution selection range for medium bit rate (Fig. 9). In other words, it is possible to state transition from S 32 to S 22.
- the present invention is not limited to this, and other methods can be used. For example, even if the state transition in the direction to increase the resolution (upper direction in FIG. 12) does not exceed the upper limit value of the resolution selection range, the state transition in the direction is made. On the other hand, when it exceeds the upper limit value, the state transition may be made in the direction of increasing the frame rate (left direction in FIG. 12).
- the resolution selection range signal S15 in the following description is assumed to indicate the resolution selection range in the case of the medium bit rate.
- the example of FIG. 14 differs from the example of FIG. 12 in that the frame rate is reduced in accordance with the increase in resolution. This is because compression becomes rapidly difficult by increasing the resolution, and by reducing the frame rate to make compression a little easier, it is possible to alleviate the possibility of the image quality deteriorating sharply.
- the state transition destination 1 when the transition condition 2 is satisfied it is S 21, common to the example of FIG. 12.
- the transition condition 4 of the quantization step average value must be satisfied more than the transition condition 2. Since the image quality improving effect than if it increases the resolution to increase the frame rate is significant, in order to easily transition to S 33 is greater resolution.
- the resolution / frame rate selection circuit 109 outputs the value of the resolution indicated by the current state ID as the resolution selection signal S18.
- the value of the rate is output as a frame rate selection signal S19. Further, since there is no change in resolution, the resolution change occurrence signal S20 is set to be invalid.
- the resolution and frame rate selection circuit 109 determines whether or not encoding of all the frames is completed (Step 323). If a frame to be encoded remains (No in Step 323), the above process (Step 300 to Step 322) is performed on the next frame. On the other hand, when the encoding of all the frames is completed (Yes in Step 323), the process ends. That is, the above-described processing from Step 300 to Step 322 is repeatedly performed until encoding of all frames is completed.
- the moving picture coding apparatus 10 configured as described above has an initial state preset in the resolution / frame rate selection circuit 109 when the first frame of the moving picture signal S10 input to the moving picture input terminal 100 is coded.
- the resolution indicated by the ID is output as a resolution selection signal S18
- the frame rate indicated by the initial state ID is output as a frame rate selection signal S19.
- the resolution change circuit 101 changes the acquired moving image signal S10 to the resolution specified by the resolution selection signal S18, and outputs a moving image signal S11.
- the frame rate changing circuit 102 changes the moving image signal S11 to the frame rate specified by the frame rate selection signal S19, and outputs the moving image signal S12. Further, when the frame to be encoded is the first frame, the quantization step control circuit 106 outputs the initial quantization step value as the quantization step signal S16.
- the moving image signal S12 is encoded by the moving image encoding circuit 103 and output to the bit stream output terminal 104 as a bit stream S13. At this time, the moving picture coding circuit 103 selects the intra prediction mode if the frame to be coded is the first frame.
- the quantization step control circuit 106 determines the quantization step value of the next frame from the target bit rate information contained in the coding bit rate signal S14 and the frame rate information contained in the frame rate selection signal S19.
- the target bit rate information included in the coding bit rate signal S14 is the bit rate set by the user or the device manager at the start of communication, or the moving picture coding apparatus 10 actually transmits the coded bit stream It may be a value obtained from the maximum bit rate that can be transmitted by the network, which is sent out on the road and calculated from the packet loss rate notified from the image decoding apparatus.
- the quantization step value of the next frame is input to the quantization step averaging circuit 107.
- the calculation of the quantization step average value and the quantization step average value output Do not update the This is because the first frame of the stream is encoded by in-plane prediction, and the amount of generated code is larger than in the case of using intra-frame prediction and inter-frame prediction adaptively used other than at the beginning of the stream . Therefore, it is necessary to process a predetermined number of frames before the quantization step value output from the quantization step control circuit 106 is stabilized.
- the resolution / frame rate selection circuit 109 outputs the resolution indicated by the initial state ID as the resolution selection signal S18 until the predetermined number of frames elapses from the beginning of the stream, and the initial state ID indicates The frame rate is output as a frame rate selection signal S19. Therefore, only the code amount adjustment by the quantization step is continued until the predetermined number of frames elapses from the beginning.
- resolution / frame rate selection circuit 109 compares transition condition 1 or transition condition 2 with the quantization step average value included in quantization step average value signal S17. This enables state transition.
- the quantization step average value when the quantization step average value is larger than transition condition 1 and the resolution of the transition destination is within the resolution selection range, a state transition occurs in the direction in which the frame rate decreases or the resolution decreases.
- the quantization step average value is smaller than transition condition 2 and the resolution of the transition destination is within the resolution selection range, the frame rate increases or state transition in the direction of increasing resolution occurs.
- the resolution selection range is the resolution range selection circuit 108 determining the upper limit value and the lower limit value of the resolution according to the encoding bit rate value. In the case of a high bit rate, a high resolution range is specified, and in the case of a low bit rate, a low resolution range is specified.
- the resolution does not temporarily decrease to the low resolution even at the high bit rate.
- the resolution does not temporarily increase to a high resolution although the bit rate is low. As a result, stable resolution change operation is possible.
- the resolution change generation signal S20 becomes valid.
- the moving picture coding circuit 103 selects the intra prediction mode for the first frame whose resolution has been converted. This is a measure resulting from the difficulty in referring to the previous frame based on the change in resolution.
- the quantization step averaging circuit 107 calculates the quantization step average value and outputs the quantization step average value until the predetermined number of frames and / or the predetermined time elapses after the resolution change occurs. Do not update and. Further, the resolution / frame rate selection circuit 109 prohibits state transition until a predetermined number of frames and / or a predetermined time elapses after the change of resolution occurs, and immediately after the change of resolution occurs. Hold the state ID. That is, the resolution immediately after the resolution conversion occurs and the frame rate are maintained, and only the code amount control by the quantization step is continued.
- the moving picture coding apparatus 10 includes a resolution changing circuit 101 that dynamically changes the resolution of an input moving picture, and a frame that adaptively thins out the number of frames of the moving picture output from the resolution changing circuit 101. It includes a rate change circuit 102 and a moving picture coding circuit 103 that codes a moving picture output from the frame rate change circuit 102 to generate a bit stream of a required coding bit rate.
- the dynamic resolution changing process selects the maximum resolution and the minimum resolution from the plurality of resolutions according to the encoding bit rate, and the resolution changing circuit 101 from the plurality of resolutions from the maximum resolution to the minimum resolution. Select the output resolution of. That is, when the degree of difficulty of compression of the input moving image or the target encoding bit rate changes significantly, within the range of the maximum resolution and the minimum resolution of the resolution according to the encoding bit rate, The correct resolution is selected.
- the present invention is not only realized as the moving picture coding apparatus 10 and the moving picture coding method as in the first embodiment, but is a program for causing a computer to execute the moving picture coding method according to the first embodiment. It may be realized as
- FIGS. 15A to 15C are explanatory diagrams in the case of being implemented by a computer system using the flexible disk FD storing the moving picture coding method according to the first embodiment.
- FIG. 15A shows an example of the physical format of the magnetic disk MD, which is a recording medium main body.
- FIG. 15B shows a front view, a cross-sectional view, and a magnetic disk MD of a case F holding the magnetic disk MD.
- FIG. 15C shows a configuration for recording and reproducing the program on the flexible disk FD.
- the flexible disk FD is composed of a magnetic disk MD as a recording medium main body and a case F for holding the magnetic disk MD.
- a plurality of tracks Tr are formed concentrically from the outer periphery toward the inner periphery, and each track Tr is divided into 16 sectors Se in the angular direction. Therefore, in the flexible disk FD storing the above-described program, the moving picture coding method as the above-described program is recorded in the area allocated on the magnetic disk MD.
- the moving image coding method as the program is written from the computer system Cs via the flexible disk drive FDD.
- the program is read from the flexible disk FD by the flexible disk drive FDD and transferred to the computer system Cs.
- the recording medium is not limited to this, and any recording medium such as an IC card, a ROM cassette, and the like can be used as long as the program can be recorded.
- some or all of the components constituting the video encoding device 10 may be configured from one system LSI (Large Scale Integration).
- the system LSI is a super multifunctional LSI manufactured by integrating a plurality of components on one chip.
- only the means for storing data to be encoded may be separately configured without being integrated into one chip.
- the storage medium may be a magnetic disk, an optical disk, a magneto-optical disk, an IC card, a semiconductor memory, or the like as long as the program can be recorded.
- FIG. 16 is a diagram showing an overall configuration of a content supply system ex100 for realizing content distribution service.
- the area for providing communication service is divided into desired sizes, and base stations ex106 to ex110, which are fixed wireless stations, are installed in each cell.
- This content supply system ex100 includes a computer ex111, a personal digital assistant (PDA) ex112, a camera ex113, a mobile phone ex114, and a game machine via the Internet ex101, the Internet service provider ex102 and the telephone network ex104, and the base stations ex106 to ex110. Each device such as ex115 is connected.
- PDA personal digital assistant
- each device may be directly connected to the telephone network ex104 without passing through the base stations ex106 to ex110, which are fixed wireless stations.
- the devices may be directly connected to each other via near field communication or the like.
- the camera ex113 is a device capable of shooting moving images such as a digital video camera
- the camera ex116 is a device capable of shooting still images and moving images such as a digital camera.
- the mobile phone ex114 is a GSM (Global System for Mobile Communications) system, a CDMA (Code Division Multiple Access) system, a W-CDMA (Wideband-Code Division Multiple Access) system, or an LTE (Long Term Evolution) system, HSPA ( It may be a High Speed Packet Access mobile phone, a PHS (Personal Handyphone System), or the like.
- live distribution and the like become possible by connecting the camera ex113 and the like to the streaming server ex103 through the base station ex109 and the telephone network ex104.
- live distribution encoding processing is performed on content (for example, video of music live, etc.) captured by the user using the camera ex113 as described in the above embodiment, and the encoded content is transmitted to the streaming server ex103.
- the streaming server ex 103 streams the content data transmitted to the requested client.
- the clients include the computer ex111, the PDA ex112, the camera ex113, the mobile phone ex114, the game machine ex115 and the like capable of decoding the above-mentioned encoded data.
- Each device that has received the distributed data decrypts and reproduces the received data.
- encoding processing of captured data may be performed by the camera ex 113, may be performed by the streaming server ex 103 that performs data transmission processing, or may be performed sharing each other.
- the decryption processing of similarly distributed data may be performed by the client, may be performed by the streaming server ex 103, or may be performed sharing each other.
- not only the camera ex113 but also still images and / or moving image data captured by the camera ex116 may be transmitted to the streaming server ex103 via the computer ex111.
- the encoding process in this case may be performed by any of the camera ex 116, the computer ex 111, and the streaming server ex 103, or may be performed sharing each other.
- the encoding process and the decoding process are generally performed by a computer ex 111 and a large scale integration (LSI) ex 500 included in each device.
- the LSI ex 500 may be a single chip or a plurality of chips.
- Software for image coding and image decoding is incorporated in any recording medium (CD-ROM, flexible disk, hard disk, etc.) readable by computer ex111 etc., and the coding process and decoding process are performed using the software. May be Furthermore, when the cellular phone ex114 is equipped with a camera, moving image data acquired by the camera may be transmitted. The moving image data at this time is data encoded by the LSI ex 500 included in the mobile phone ex 114.
- the streaming server ex103 may be a plurality of servers or a plurality of computers, and may process, record, or distribute data in a distributed manner.
- the client can receive and reproduce the encoded data.
- the client can receive, decode, and reproduce the information transmitted by the user in real time, and even a user who does not have special rights or facilities can realize personal broadcasting.
- the image coding method shown in the above-mentioned embodiment may be used for coding of each device constituting the content supply system.
- the mobile phone ex114 will be described as an example.
- FIG. 17 is a diagram showing a mobile phone ex114 using the image coding method described in the above embodiment.
- the cellular phone ex114 is an antenna ex601 for transmitting and receiving radio waves to and from the base station ex110, a video such as a CCD camera, a camera unit ex603 capable of taking a still image, a video shot with the camera unit ex603, and the antenna ex601.
- a display unit ex602 such as a liquid crystal display for displaying data obtained by decoding a received video or the like, a main body unit including operation keys ex604, an audio output unit ex608 such as a speaker for audio output, and audio input Voice input unit ex605 such as a microphone, captured moving or still image data, received mail data, moving image data or still image data, etc.
- the recording medium ex 607 stores a flash memory element, which is a type of EEPROM, which is a non-volatile memory that can be electrically rewritten and erased, in a plastic case such as an SD card.
- a mobile phone ex114 is provided with a power control circuit ex710, an operation input control unit ex704, an image encoding, and a main control unit ex711 that is configured to integrally control each unit of the main unit including the display unit ex602 and the operation key ex604.
- Unit ex712, camera interface unit ex703, LCD (Liquid Crystal Display) control unit ex702, image decoding unit ex709, demultiplexing unit ex708, recording / reproduction unit ex707, modulation / demodulation circuit unit ex706, and audio processing unit ex705 are mutually connected via synchronization bus ex713 It is connected.
- the power supply circuit unit ex710 activates the camera-equipped digital mobile phone ex114 to an operable state by supplying power from the battery pack to each unit when the end of the call and the power key are turned on by the operation of the user. .
- the mobile phone ex114 converts the audio signal collected by the audio input unit ex605 into digital audio data by the audio processing unit ex705 based on the control of the main control unit ex711 including CPU, ROM, RAM, etc. This is spread spectrum processing in the modulation / demodulation circuit unit ex706, subjected to digital / analog conversion processing and frequency conversion processing in the transmission / reception circuit unit ex701, and then transmitted through the antenna ex601.
- the cellular phone ex114 amplifies the reception data received by the antenna ex601, performs frequency conversion processing and analog-to-digital conversion processing, performs spectrum despreading processing in the modulation / demodulation circuit unit ex706, and performs analog sound processing in the sound processing unit ex705. After conversion into data, the data is output via the audio output unit ex 608.
- text data of the electronic mail input by the operation of the operation key ex604 of the main unit is sent to the main control unit ex711 via the operation input control unit ex704.
- the main control unit ex711 performs spread spectrum processing on the text data in the modulation / demodulation circuit unit ex706, performs digital / analog conversion processing and frequency conversion processing in the transmission / reception circuit unit ex701, and transmits the data to the base station ex110 via the antenna ex601.
- the image data captured by the camera unit ex603 is supplied to the image coding unit ex712 via the camera interface unit ex703.
- the image data captured by the camera unit ex603 can be directly displayed on the display unit ex602 via the camera interface unit ex703 and the LCD control unit ex702.
- the image coding unit ex712 is configured to include the image coding apparatus described in the present invention, and uses the image data supplied from the camera unit ex603 for the image coding apparatus shown in the above embodiment.
- the compression image data is converted into encoded image data by compression coding, and this is sent to the demultiplexing unit ex 708.
- the cellular phone ex114 simultaneously transmits the sound collected by the audio input unit ex605 during imaging by the camera unit ex603 to the demultiplexing unit ex708 as digital audio data via the audio processing unit ex705.
- the demultiplexing unit ex708 multiplexes the encoded image data supplied from the image coding unit ex712 and the audio data supplied from the audio processing unit ex705 according to a predetermined method, and the multiplexed data obtained as a result thereof is converted to a modulation / demodulation circuit unit
- the spread spectrum processing is performed in ex706, the digital analog conversion processing and the frequency conversion processing are performed in the transmission / reception circuit unit ex701, and then transmission is performed via the antenna ex601.
- the reception data received from base station ex110 via antenna ex601 is subjected to spectrum despreading processing by modulation / demodulation circuit unit ex706, and the resulting multiplex is obtained Integrated data to the demultiplexing unit ex 708.
- the demultiplexing unit ex708 divides the multiplexed data into a bit stream of image data and a bit stream of audio data, and performs synchronization bus synchronization.
- the encoded image data is supplied to the image decoding unit ex709 via the ex 713, and the audio data is supplied to the audio processing unit ex705.
- the image decoding unit ex 709 has a configuration including an image decoding apparatus, and decodes the bit stream of the image data by the decoding method corresponding to the encoding method described in the above embodiment, thereby reproducing reproduced moving image data. It is generated and supplied to the display unit ex602 via the LCD control unit ex702, whereby, for example, moving image data included in a moving image file linked to a home page is displayed.
- the audio processing unit ex 705 simultaneously converts the audio data into analog audio data, and supplies this to the audio output unit ex 608, whereby the audio data included in, for example, the moving image file linked to the home page is reproduced. Ru.
- At the broadcast station ex201 audio data, video data, or a bit stream in which the data is multiplexed is transmitted to the communication or broadcast satellite ex202 via radio waves.
- the broadcast satellite ex202 receiving this transmits a radio wave for broadcasting
- the antenna ex204 of the home having a satellite broadcasting reception facility receives this radio wave
- the device decodes the bitstream and reproduces it.
- an image decoding apparatus is also mounted on a reader / recorder ex 218 that reads and decodes image data recorded on recording media ex215 and ex216 such as CD and DVD, which are recording media, and a bit stream in which audio data is multiplexed. Is possible.
- the reproduced video signal is displayed on the monitor ex 219.
- the image decoding apparatus is mounted in the set top box ex217 connected to the cable ex203 for cable television or the antenna ex204 for satellite / terrestrial broadcast, and this is reproduced by the monitor ex219 of the television.
- the image decoding apparatus may be incorporated in the television instead of the set top box.
- a car ex210 having an antenna ex205 can also receive a signal from the satellite ex202 or a base station and reproduce a moving image on a display device such as a car navigation system ex211 set in the car ex210.
- the image coding apparatus shown in the above-described embodiment can also be implemented in a reader / recorder ex 218 that encodes and stores the following data as multiplexed data.
- the reproduced video signal is displayed on the monitor ex 219.
- other devices and systems can reproduce video signals.
- the other reproduction device ex212 can reproduce the video signal on the monitor ex213 using the recording medium ex214 to which the encoded bit stream is copied.
- the image decoding apparatus may be mounted in the set top box ex217 connected to the cable ex203 for cable television or the antenna ex204 for satellite / terrestrial broadcast, and this may be displayed on the monitor ex219 of the television.
- the image decoding apparatus may be incorporated in the television instead of the set top box.
- FIG. 20 is a diagram showing a television (receiver) ex300 that uses the image coding method described in the above embodiment.
- the television ex300 acquires or outputs a bit stream of video information via the antenna ex204 or the cable ex203 which receives the broadcast, and demodulates or generates received encoded data.
- a modulation / demodulation unit ex302 that modulates data to be transmitted to the outside, a multiplexing / demultiplexing unit ex303 that separates the demodulated video data and audio data, or multiplexes encoded video data and audio data Equipped with Further, the television ex300 decodes the audio data and the video data, or an audio signal processing unit ex304 that encodes each information, a signal processing unit ex306 having the video signal processing unit ex305, and the decoded audio signal. It has a speaker ex307 for outputting, and an output unit ex309 having a display unit ex308 such as a display for displaying a decoded video signal.
- the television ex300 includes an interface unit ex317 including an operation input unit ex312 and the like that receive an input of a user operation. Furthermore, the television ex300 includes a control unit ex310 that centrally controls each unit, and a power supply circuit unit ex311 that supplies power to each unit.
- the interface unit ex317 is, besides the operation input unit ex312, a bridge ex313 connected to an external device such as a reader / recorder ex218, a slot unit ex314 for enabling attachment of a recording medium ex216 such as an SD card, external recording such as a hard disk It may have a driver ex 315 for connecting to a medium, a modem ex 316 connected to a telephone network, and the like. Note that the recording medium ex216 can electrically record information by a nonvolatile / volatile semiconductor memory element to be stored.
- the components of the television ex300 are connected to one another via a synchronization bus.
- the television ex300 decodes data acquired from the outside with the antenna ex204 and the like and reproduces the data.
- the television ex300 receives the user operation from the remote controller ex220 and the like, and demultiplexes the video data and audio data demodulated by the modulation / demodulation unit ex302 by the multiplexing / demultiplexing unit ex303 based on the control of the control unit ex310 having a CPU etc. .
- the television ex300 decodes the separated audio data by the audio signal processing unit ex304, and decodes the separated video data by the video signal processing unit ex305 using the decoding method described in the above embodiment.
- the decoded audio signal and video signal are output from the output unit ex309 to the outside.
- these signals may be temporarily stored in the buffers ex318, ex319, etc. so that the audio signal and the video signal are reproduced synchronously.
- the television ex300 may read the encoded bit stream not from the broadcast or the like, but from the recording media ex215 and ex216 such as a magnetic / optical disc and an SD card.
- the recording media ex215 and ex216 such as a magnetic / optical disc and an SD card.
- the television ex300 encodes an audio signal in the audio signal processing unit ex304 based on the control of the control unit ex310, and the video signal processing unit ex305 in the above embodiment. Encoding is performed using the described encoding method.
- the encoded audio signal and video signal are multiplexed by multiplexer / demultiplexer ex303 and output to the outside. At the time of multiplexing, these signals may be temporarily stored in the buffers ex320, ex321, etc. so that the audio signal and the video signal are synchronized.
- a plurality of buffers ex318 to ex321 may be provided as illustrated, or one or more buffers may be shared.
- data may be stored in a buffer as a buffer material to avoid system overflow and underflow, for example, between the modulation / demodulation unit ex302 and the multiplexing / demultiplexing unit ex303.
- television ex300 In addition to acquiring audio data and video data from broadcasts and recording media, etc., television ex300 is also configured to receive AV input from a microphone and a camera, and even if data acquired from them is encoded. Good.
- television ex300 is described as a configuration capable of the above encoding processing, multiplexing, and external output, but all of these processing can not be performed, and the above reception, decoding processing, and external processing can not be performed. Only one of the outputs may be possible.
- the encoding process may be performed by any of the television ex300 and the reader / recorder ex218, or with the television ex300.
- the reader / recorder ex 218 may share with each other.
- FIG. 21 shows a configuration of an information reproducing / recording unit ex400 in the case of reading or writing data from an optical disc.
- the information reproducing / recording unit ex400 includes elements ex401 to ex407 described below.
- the optical head ex401 irradiates a laser spot on the recording surface of the recording medium ex215 which is an optical disk to write information, detects reflected light from the recording surface of the recording medium ex215, and reads the information.
- the modulation recording unit ex402 electrically drives the semiconductor laser incorporated in the optical head ex401 and modulates the laser light according to the recording data.
- the reproduction / demodulation unit ex403 amplifies the reproduction signal obtained by electrically detecting the reflected light from the recording surface by the photodetector incorporated in the optical head ex401, separates and demodulates the signal component recorded in the recording medium ex215, and Play back information.
- the buffer ex 404 temporarily holds information to be recorded on the recording medium ex 215 and information reproduced from the recording medium ex 215.
- the disk motor ex405 rotates the recording medium ex215.
- the servo control unit ex406 moves the optical head ex401 to a predetermined information track while controlling the rotational drive of the disk motor ex405, and performs the laser spot tracking process.
- the system control unit ex407 controls the entire information reproducing / recording unit ex400.
- the system control unit ex407 uses various information held in the buffer ex404, and generates and adds new information as necessary.
- the modulation recording unit ex402, reproduction demodulation This is realized by performing recording and reproduction of information through the optical head ex401 while cooperatively operating the unit ex403 and the servo control unit ex406.
- the system control unit ex 407 is configured of, for example, a microprocessor, and executes the processing of reading and writing by executing the program.
- the optical head ex401 may be configured to perform higher-density recording using near-field light.
- FIG. 22 shows a schematic view of a recording medium ex 215 which is an optical disc.
- a guide groove (groove) is formed in a spiral shape on the recording surface of the recording medium ex215, and in the information track ex230, address information indicating the absolute position on the disc is recorded in advance by the change of the groove shape.
- This address information includes information for specifying the position of the recording block ex231, which is a unit for recording data, and the apparatus which performs recording and reproduction specifies the recording block by reproducing the information track ex230 and reading the address information. be able to.
- the recording medium ex215 includes a data recording area ex233, an inner circumference area ex232, and an outer circumference area ex234.
- An area used to record user data is data recording area ex233, and inner circumference area ex232 and outer circumference area ex234 arranged on the inner circumference or outer circumference of data recording area ex233 are used for specific applications other than user data recording. Used.
- the information reproducing / recording unit ex400 reads / writes encoded audio data, video data, or encoded data obtained by multiplexing those data from / to the data recording area ex233 of such a recording medium ex215.
- an optical disc such as a single layer DVD or BD has been described as an example, but the optical disc is not limited to these, and may be an optical disc having a multilayer structure and capable of recording other than the surface.
- multi-dimensional recording / reproduction such as recording information in the same place of the disc using light of colors of different wavelengths, recording layers of information different from different angles, etc. It may be an optical disc.
- the configuration of the car navigation system ex211 may be, for example, a configuration in which a GPS reception unit is added, and the same may be considered for the computer ex111, the mobile phone ex114, and the like.
- the terminal such as the above-mentioned mobile phone ex114 is, like the television ex300, in addition to a transceiving type terminal having both an encoder and a decoder, a transmitter terminal of only an encoder and a receiver terminal of only a decoder.
- the implementation style of can be considered.
- Embodiment 4 The image coding method and apparatus described in each of the above embodiments are typically realized by an LSI which is an integrated circuit.
- FIG. 23 shows a configuration of an LSI ex 500 formed into one chip.
- the LSI ex 500 includes elements ex 501 to ex 509 described below, and the elements are connected via a bus ex 510.
- the power supply circuit unit ex505 starts up to an operable state by supplying power to each unit when the power is on.
- the LSI ex500 receives an AV signal from the microphone ex117 and the camera ex113 by the AV I / O ex 509 based on the control of the control unit ex 501 having the CPU ex 502, the memory controller ex 503, the stream controller ex 504, and the like.
- Accept The input AV signal is temporarily stored in an external memory ex 511 such as an SDRAM.
- the accumulated data is appropriately divided into a plurality of times according to the processing amount and the processing speed, and the like, and is sent to the signal processing unit ex507.
- the signal processing unit ex 507 performs coding of an audio signal and / or coding of a video signal.
- the coding process of the video signal is the coding process described in the above embodiment.
- the signal processing unit ex 507 further performs processing such as multiplexing of encoded audio data and encoded video data as needed, and outputs the multiplexed data from the stream I / O ex 506 to the outside.
- the output bit stream is transmitted to the base station ex 107 or written to the recording medium ex 215. Note that data may be temporarily stored in the buffer ex 508 so as to be synchronized when multiplexing.
- the LSI ex 500 is obtained by reading from the encoded data obtained by the stream I / O ex 506 via the base station ex 107 or from the recording medium ex 215 under the control of the control unit ex 501.
- the encoded data is temporarily stored in the memory ex 511 or the like.
- the accumulated data is appropriately divided into a plurality of times according to the processing amount and the processing speed and sent to the signal processing unit ex507.
- the signal processing unit ex ⁇ b> 507 decodes audio data and / or video data.
- each signal is temporarily store in a buffer ex508 or the like so that the decoded audio signal and the decoded video signal can be reproduced synchronously in some cases.
- the decoded output signal is output from each output unit such as the mobile phone ex114, the game machine ex115, the television ex300 and the like via the memory ex511 and the like as appropriate.
- the memory ex 511 has been described as an external configuration of the LSI ex 500, but may be included in the LSI ex 500.
- the buffer ex 508 is not limited to one, and may have a plurality of buffers.
- the LSI ex 500 may be integrated into one chip or a plurality of chips.
- LSI LSI
- IC system LSI
- super LSI ultra LSI
- the method of circuit integration is not limited to LSI's, and implementation using dedicated circuitry or general purpose processors is also possible.
- a programmable FPGA or a reconfigurable processor capable of reconfigurable connection and setting of circuit cells in the LSI may be used after the LSI is manufactured.
- the maximum resolution and the minimum resolution are set in the resolution range selection circuit 108 according to the first embodiment, if an image which is very difficult to compress and which may have a very small resolution is not input. You may set only the maximum resolution.
- the maximum resolution and the minimum resolution are set by the resolution range selection circuit 108 according to the bit rate derived by the bit rate determination circuit 105, the present invention is not limited thereto, and the user explicitly sets the bit rate
- the maximum resolution and the minimum resolution may be set by the resolution range selection circuit 108 according to the bit rate set by the user.
- the present invention is advantageously used in a moving picture coding apparatus and a moving picture coding method for coding a moving picture and transmitting it on a transmission path.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
図1Aは、本発明の実施の形態1に係る動画像符号化装置10の構成を示すブロック図である。
次に、量子化ステップ制御回路106は、ビットストリームS13の符号量をカウントする。そして、量子化ステップ制御回路106は、その結果得られた1フレームの発生符号量(FBT)と1フレームの目標符号量(AFB)とに基づいて、式2を用いて累積差分符号量(TBD)を求める(Step104)。
次に、量子化ステップ制御回路106は、1フレーム当たりの平均符号量(AFB)と累積差分符号量(TBD)とに基づいて、式3を用いて次のフレームの目標符号量(TFB)を求める(Step105)。
次に、量子化ステップ制御回路106は、現フレームの量子化ステップ(QS(n-1))と、1フレームの発生符号量(FBT)と、次のフレームの目標符号量(TFB)とに基づいて、式4を用いて次のフレームの量子化ステップ(QS(n))を求め、その値を出力する(Step106)。
そして、量子化ステップ制御回路106は、全フレームの符号化が終了したか否かを判定する(Step107)。符号化すべきフレームが残っている場合(Step107でNo)、次フレームについて上記の処理(Step100~Step106)を実行する。一方、全てのフレームの符号化が終了した場合(Step107でYes)、当該処理を終了する。つまり、上記の処理は、全フレームの符号化が終了するまで繰り返し実行される。
式5における重み係数Wは、式6を用いて算出される定数である。この重み係数Wは、量子化ステップ平均値の変動の程度を制御するものであり、重み係数Wが大きい程変動しにくく、小さい程変動しやすくなる。なお、重み係数Wは、設計時等に指定される固定値であってもよいし、状況に応じて変更可能な可変値であってもよい。
また、2つの条件のうち、どちらか一つでも成り立たない場合(Step203、Step204の一方でNo)は、量子化ステップ平均値(QSema)の演算は行わず、前回の量子化ステップ平均値(QSema)を保持する。
また、本発明は、実施の形態1のように、動画像符号化装置10および動画像符号化方法として実現できるだけではなく、実施の形態1の動画像符号化方法をコンピュータに実行させるためのプログラムとして実現してもよい。
上記実施の形態で示した画像符号化方法の構成を実現するためのプログラムを記憶メディアに記録することにより、上記実施の形態で示した処理を独立したコンピュータシステムにおいて簡単に実施することが可能となる。記憶メディアは、磁気ディスク、光ディスク、光磁気ディスク、ICカード、半導体メモリ等、プログラムを記録できるものであればよい。
上記各実施の形態で示した画像符号化方法および装置は、典型的には集積回路であるLSIで実現される。一例として、図23に1チップ化されたLSIex500の構成を示す。LSIex500は、以下に説明する要素ex501~ex509を備え、各要素はバスex510を介して接続している。電源回路部ex505は電源がオン状態の場合に各部に対して電力を供給することで動作可能な状態に起動する。
20 画像変換部
30 動画像符号化部
40 ビットレート決定部
50 解像度範囲選択部
100,200,300,400,500 動画入力端子
101,501 解像度変更回路
102,502 フレームレート変更回路
103,503 動画像符号化回路
104,406,504 ビットストリーム出力端子
105 ビットレート決定回路
106,506 量子化ステップ制御回路
107 量子化ステップ平均回路
108 解像度範囲選択回路
109 解像度・フレームレート選択回路
110 画像変換部
201 フレームレート選択信号入力端子
202,303 フレームメモリ
203,305 書き込み読み出し制御回路
204,306 動画出力端子
301 水平方向LPF回路
302 垂直方向LPF回路
304 解像度選択信号入力端子
401 入力画像メモリ
402 差分演算回路
403 直交変換回路
404 量子化回路
405 可変長符号化回路
407 量子化ステップ入力端子
408 逆量子化回路
409 逆直交変換回路
410 加算演算回路
411 参照画像メモリ
412 動きベクトル検出回路
413 動き補償回路
414 面内予測回路
415 符号化モード選択制御回路
416 予測画像セレクター回路
417 解像度変更発生信号入力端子
507 フレームレート制御回路
508 解像度設定回路
ex100 コンテンツ供給システム
ex101 インターネット
ex102 インターネットサービスプロバイダ
ex103 ストリーミングサーバ
ex104 電話網
ex106,ex107,ex108,ex109,ex110 基地局
ex111 コンピュータ
ex112 PDA
ex113,ex116 カメラ
ex114 カメラ付デジタル携帯電話(携帯電話)
ex115 ゲーム機
ex117 マイク
ex200 デジタル放送用システム
ex201 放送局
ex202 放送衛星(衛星)
ex203 ケーブル
ex204,ex205,ex601 アンテナ
ex210 車
ex211 カーナビゲーション(カーナビ)
ex212 再生装置
ex213,ex219 モニタ
ex214,ex215,ex216,ex607 記録メディア
ex217 セットトップボックス(STB)
ex218 リーダ/レコーダ
ex220 リモートコントローラ
ex230 情報トラック
ex231 記録ブロック
ex232 内周領域
ex233 データ記録領域
ex234 外周領域
ex300 テレビ
ex301 チューナ
ex302 変調/復調部
ex303 多重/分離部
ex304 音声信号処理部
ex305 映像信号処理部
ex306,ex507 信号処理部
ex307 スピーカ
ex308,ex602 表示部
ex309 出力部
ex310,ex501 制御部
ex311,ex505,ex710 電源回路部
ex312 操作入力部
x313 ブリッジ
ex314,ex606 スロット部
ex315 ドライバ
ex316 モデム
ex317 インターフェース部
ex318,ex319,ex320,ex321,ex404,ex508 バッファ
ex400 情報再生/記録部
ex401 光ヘッド
ex402 変調記録部
ex403 再生復調部
ex405 ディスクモータ
ex406 サーボ制御部
ex407 システム制御部
ex500 LSI
ex502 CPU
ex503 メモリコントローラ
ex504 ストリームコントローラ
ex506 ストリームI/O
ex509 AV I/O
ex510 バス
ex603 カメラ部
ex604 操作キー
ex605 音声入力部
ex608 音声出力部
ex701 送受信回路部
ex702 LCD制御部
ex703 カメラインターフェース部(カメラI/F部)
ex704 操作入力制御部
ex705 音声処理部
ex706 変復調回路部
ex707 記録再生部
ex708 多重分離部
ex709 画像復号部
ex711 主制御部
ex712 画像符号化部
ex713 同期バス
Claims (11)
- 入力画像を符号化して符号化ビットストリームを生成し、当該符号化ビットストリームを伝送路上に送出する動画像符号化方法であって、
前記入力画像の符号化の困難さの程度に応じて、前記入力画像の解像度およびフレームレートの少なくとも一方を変更して符号化対象画像を出力する画像変換ステップと、
前記画像変換ステップで出力される前記符号化対象画像を符号化して前記符号化ビットストリームを生成し、当該符号化ビットストリームを前記伝送路上に送出する動画像符号化ステップと、
前記伝送路上に送出される前記符号化ビットストリームのビットレートである符号化ビットレートを決定するビットレート決定ステップと、
前記ビットレート決定ステップで決定された前記符号化ビットレートに応じて前記符号化対象画像の解像度の上限値を決定し、前記符号化対象画像の解像度が前記上限値を上回らないように前記画像変換ステップでの変更を制御する解像度範囲選択ステップとを含む
動画像符号化方法。 - 前記解像度範囲選択ステップは、さらに、前記ビットレート決定ステップで決定された前記符号化ビットレートに応じて、前記符号化対象画像の解像度の下限値を決定し、前記符号化対象画像の解像度が前記下限値を下回らないように前記画像変換ステップでの変更を制御する
請求項1に記載の動画像符号化方法。 - 前記解像度変換ステップでは、前記符号化対象画像の解像度を変更した後、所定の時間が経過するまで、および所定数の前記入力画像を処理するまでの少なくとも一方の条件を満たすまで、前記符号化対象画像の解像度を変更しない
請求項1または2に記載の動画像符号化方法。 - 前記符号化ビットレートは、送信機器と受信機器との間で実際に送受信できた符号化ビットストリーム量を計測して得られる前記伝送路の伝送可能ビットレートに基づいて決定される
請求項2または3に記載の動画像符号化方法。 - 該動画像符号化方法は、さらに、
前記符号化ビットストリームが、前記ビットレート決定ステップで決定された前記符号化ビットレートで伝送可能な符号量となるような量子化ステップを算出し、算出した前記量子化ステップで前記動画像符号化ステップに前記符号化対象画像を量子化させる量子化ステップ算出ステップと、
所定の時間内に前記量子化ステップ算出ステップで算出された前記量子化ステップの平均値である量子化ステップ平均値を算出する平均値算出ステップとを含み、
前記画像変換ステップは、
前記平均値算出ステップで算出された前記量子化ステップ平均値に基づいて前記入力画像の符号化の困難さの程度を判断し、前記符号化対象画像の解像度およびフレームレートを決定する画質決定ステップと、
前記入力画像を前記画質決定ステップで決定された解像度に変更する解像度変更ステップと、
前記入力画像を前記画質決定ステップで決定されたフレームレートに変更するフレームレート変更ステップとを含む
請求項2~4のいずれか1項に記載の動画像符号化方法。 - 前記画質決定ステップは、直前に決定された解像度より小さい第1の解像度および大きい第2の解像度の少なくとも一方を予め保持し、
前記平均値算出ステップで算出された前記量子化ステップ平均値が予め定めた第1の閾値より大きく、かつ保持している前記第1の解像度が前記下限値以上である場合に、前記解像度変更ステップに前記入力画像の解像度を前記第1の解像度に変更させ、
前記平均値算出ステップで算出された前記量子化ステップ平均値が予め定めた第2の閾値より小さく、かつ保持している前記第2の解像度が前記上限値以下である場合に、前記解像度変更ステップに前記入力画像の解像度を前記第2の解像度に変更させる
請求項5に記載の動画像符号化方法。 - 前記画質決定ステップは、さらに、直前に決定されたフレームレートより小さい第1のフレームレートおよび大きい第2のフレームレートの少なくとも一方を予め保持し、
前記解像度変更ステップで前記入力画像の解像度が前記第1の解像度に変更された場合に、前記フレームレート変更ステップに前記入力画像のフレームレートを前記第2のフレームレートに変更させ、
前記解像度変更ステップで前記入力画像の解像度が前記第2の解像度に変更された場合に、前記フレームレート変更ステップに前記入力画像のフレームレートを前記第1のフレームレートに変更させる
請求項5に記載の動画像符号化方法。 - 前記画質決定ステップは、さらに、直前に決定されたフレームレートより小さい第1のフレームレートおよび大きい第2のフレームレートの少なくとも一方を予め保持し、
前記平均値算出ステップで算出された前記量子化ステップ平均値が予め定めた第1の閾値より大きく、かつ保持している前記第1の解像度が前記下限値を下回る場合に、前記フレームレート変更ステップに前記入力画像のフレームレートを前記第1のフレームレートに変更させ、
前記平均値算出ステップで算出された前記量子化ステップ平均値が予め定めた第2の閾値より小さく、かつ保持している前記第2の解像度が前記上限値を上回る場合に、前記フレームレート変更ステップに前記入力画像のフレームレートを前記第2のフレームレートに変更させる
請求項6または7に記載の動画像符号化方法。 - 入力画像を符号化して符号化ビットストリームを生成し、当該符号化ビットストリームを伝送路上に送出する動画像符号化装置であって、
前記入力画像の符号化の困難さの程度に応じて、前記入力画像の解像度およびフレームレートの少なくとも一方を変更して符号化対象画像を出力する画像変換部と、
前記画像変換部から出力される前記符号化対象画像を符号化して前記符号化ビットストリームを生成し、当該符号化ビットストリームを前記伝送路上に送出する動画像符号化部と、
前記伝送路上に送出される前記符号化ビットストリームのビットレートである符号化ビットレートを決定するビットレート決定部と、
前記ビットレート決定部で決定された前記符号化ビットレートに応じて前記符号化対象画像の解像度の上限値を決定し、前記符号化対象画像の解像度が前記上限値を上回らないように前記画像変換部を制御する解像度範囲選択部とを備える
動画像符号化装置。 - コンピュータに、入力画像を符号化して符号化ビットストリームを生成させ、当該符号化ビットストリームを伝送路上に送出させるプログラムであって、
前記入力画像の符号化の困難さの程度に応じて、前記入力画像の解像度およびフレームレートの少なくとも一方を変更して符号化対象画像を出力する画像変換ステップと、
前記画像変換ステップで出力される前記符号化対象画像を符号化して前記符号化ビットストリームを生成し、当該符号化ビットストリームを前記伝送路上に送出する動画像符号化ステップと、
前記伝送路上に送出される前記符号化ビットストリームのビットレートである符号化ビットレートを決定するビットレート決定ステップと、
前記ビットレート決定ステップで決定された前記符号化ビットレートに応じて前記符号化対象画像の解像度の上限値を決定し、前記符号化対象画像の解像度が前記上限値を上回らないように前記画像変換ステップでの変更を制御する解像度範囲選択ステップとを、コンピュータに実行させる
プログラム。 - 入力画像を符号化して符号化ビットストリームを生成し、当該符号化ビットストリームを伝送路上に送出する集積回路であって、
前記入力画像の符号化の困難さの程度に応じて、前記入力画像の解像度およびフレームレートの少なくとも一方を変更して符号化対象画像を出力する画像変換部と、
前記画像変換部から出力される前記符号化対象画像を符号化して前記符号化ビットストリームを生成し、当該符号化ビットストリームを前記伝送路上に送出する動画像符号化部と、
前記伝送路上に送出される前記符号化ビットストリームのビットレートである符号化ビットレートを決定するビットレート決定部と、
前記ビットレート決定部で決定された前記符号化ビットレートに応じて前記符号化対象画像の解像度の上限値を決定し、前記符号化対象画像の解像度が前記上限値を上回らないように前記画像変換部を制御する解像度範囲選択部とを備える
集積回路。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201080002454.2A CN102138327B (zh) | 2009-06-23 | 2010-06-08 | 运动图像编码方法、运动图像编码装置以及集成电路 |
JP2011519520A JP5479470B2 (ja) | 2009-06-23 | 2010-06-08 | 動画像符号化方法、動画像符号化装置、プログラム、および集積回路 |
US13/061,216 US8559503B2 (en) | 2009-06-23 | 2010-06-08 | Moving image coding method, moving image coding apparatus, program, and integrated circuit |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2009-149199 | 2009-06-23 | ||
JP2009149199 | 2009-06-23 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010150470A1 true WO2010150470A1 (ja) | 2010-12-29 |
Family
ID=43386260
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2010/003812 WO2010150470A1 (ja) | 2009-06-23 | 2010-06-08 | 動画像符号化方法、動画像符号化装置、プログラム、および集積回路 |
Country Status (4)
Country | Link |
---|---|
US (1) | US8559503B2 (ja) |
JP (1) | JP5479470B2 (ja) |
CN (1) | CN102138327B (ja) |
WO (1) | WO2010150470A1 (ja) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013214894A (ja) * | 2012-04-03 | 2013-10-17 | Mitsubishi Electric Corp | 画像符号化装置 |
WO2014103131A1 (ja) * | 2012-12-26 | 2014-07-03 | パナソニック株式会社 | 画像監視システム |
JP2016039553A (ja) * | 2014-08-08 | 2016-03-22 | 株式会社リコー | 通信装置、通信システム、通信方法およびプログラム |
US10148989B2 (en) | 2016-06-15 | 2018-12-04 | Divx, Llc | Systems and methods for encoding video content |
KR101928910B1 (ko) * | 2011-08-30 | 2018-12-14 | 쏘닉 아이피, 아이엔씨. | 복수의 최대 비트레이트 레벨들을 사용하여 인코딩된 비디오를 인코딩하고 스트리밍하기 위한 시스템들 및 방법들 |
US10708587B2 (en) | 2011-08-30 | 2020-07-07 | Divx, Llc | Systems and methods for encoding alternative streams of video for playback on playback devices having predetermined display aspect ratios and network connection maximum data rates |
US10798143B2 (en) | 2011-08-30 | 2020-10-06 | Divx, Llc | Selection of resolutions for seamless resolution switching of multimedia content |
US11638033B2 (en) | 2011-01-05 | 2023-04-25 | Divx, Llc | Systems and methods for performing adaptive bitrate streaming |
US11785066B2 (en) | 2012-12-31 | 2023-10-10 | Divx, Llc | Systems, methods, and media for controlling delivery of content |
JP7435208B2 (ja) | 2020-04-24 | 2024-02-21 | サクサ株式会社 | 画像処理装置及びプログラム |
Families Citing this family (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9171350B2 (en) * | 2010-10-28 | 2015-10-27 | Nvidia Corporation | Adaptive resolution DGPU rendering to provide constant framerate with free IGPU scale up |
US9215466B2 (en) * | 2011-01-31 | 2015-12-15 | Apple Inc. | Joint frame rate and resolution adaptation |
US9071841B2 (en) * | 2011-05-17 | 2015-06-30 | Microsoft Technology Licensing, Llc | Video transcoding with dynamically modifiable spatial resolution |
JP5853458B2 (ja) * | 2011-07-21 | 2016-02-09 | ソニー株式会社 | マーク情報記録装置及びマーク情報提示装置 |
JP5843631B2 (ja) * | 2012-01-26 | 2016-01-13 | 日本電信電話株式会社 | フレームレート制御方法,フレームレート制御装置およびフレームレート制御プログラム |
JP2013179572A (ja) * | 2012-02-08 | 2013-09-09 | Canon Inc | 画像符号化装置および画像符号化方法 |
US20150022626A1 (en) * | 2012-02-10 | 2015-01-22 | Ibrahim Nahla | Data, Multimedia & Video Transmission Updating System |
ITTO20120986A1 (it) | 2012-11-14 | 2014-05-15 | St Microelectronics Srl | Procedimento per l'estrazione di informazioni distintive da un flusso di frame video digitali, sistema e prodotto informatico relativi |
JP6204655B2 (ja) * | 2012-11-22 | 2017-09-27 | キヤノン株式会社 | 撮像装置、撮像装置の制御方法、及びプログラム |
JP6203515B2 (ja) * | 2013-03-29 | 2017-09-27 | 株式会社メガチップス | 画像処理装置 |
CN104427342A (zh) * | 2013-09-06 | 2015-03-18 | 聚晶半导体股份有限公司 | 视频编码方法及装置 |
JP6333019B2 (ja) * | 2014-03-28 | 2018-05-30 | キヤノン株式会社 | 撮像装置、撮像方法及びプログラム |
US9313508B1 (en) | 2014-10-29 | 2016-04-12 | Qualcomm Incorporated | Feeding intra-coded video frame after port reconfiguration in video telephony |
JP6603984B2 (ja) * | 2014-11-07 | 2019-11-13 | セイコーエプソン株式会社 | 画像供給装置、画像供給方法およびプログラム |
US10008177B2 (en) * | 2016-03-09 | 2018-06-26 | Panasonic Liquid Crystal Display Co., Ltd. | Display device |
US20180063549A1 (en) * | 2016-08-24 | 2018-03-01 | Ati Technologies Ulc | System and method for dynamically changing resolution based on content |
WO2018068239A1 (zh) * | 2016-10-12 | 2018-04-19 | 深圳市大疆创新科技有限公司 | 码率控制的方法、计算机系统和装置 |
US10979744B2 (en) * | 2017-11-03 | 2021-04-13 | Nvidia Corporation | Method and system for low latency high frame rate streaming |
US10659514B2 (en) * | 2018-03-28 | 2020-05-19 | Arlo Technologies, Inc. | System for video monitoring with adaptive bitrate to sustain image quality |
WO2020137437A1 (ja) * | 2018-12-28 | 2020-07-02 | ソニー株式会社 | 通信装置及び通信方法 |
JP7238441B2 (ja) * | 2019-02-04 | 2023-03-14 | 富士通株式会社 | 動画像符号化装置、動画像符号化方法及び動画像符号化プログラム |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000083253A (ja) * | 1998-07-08 | 2000-03-21 | Nec Corp | 画像処理装置 |
JP2003308277A (ja) * | 2002-04-17 | 2003-10-31 | Sony Corp | 端末装置、データ送信装置、データ送受信システム及びデータ送受信方法 |
JP2004040517A (ja) * | 2002-07-04 | 2004-02-05 | Hitachi Ltd | 携帯端末および画像配信システム |
JP2005020731A (ja) * | 2003-06-14 | 2005-01-20 | Lg Electronics Inc | 移動通信端末機の映像データ処理方法 |
JP2005073218A (ja) * | 2003-08-07 | 2005-03-17 | Matsushita Electric Ind Co Ltd | 画像処理装置 |
WO2006003808A1 (ja) * | 2004-07-06 | 2006-01-12 | Matsushita Electric Industrial Co., Ltd. | 符号化または復号化装置、および記録再生端末 |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0841820A3 (en) * | 1996-11-08 | 2005-11-09 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for encoding, multiplexing and transmitting a video signal |
US6625322B1 (en) * | 1999-06-08 | 2003-09-23 | Matsushita Electric Industrial Co., Ltd. | Image coding apparatus |
JP2001359096A (ja) * | 1999-06-08 | 2001-12-26 | Matsushita Electric Ind Co Ltd | 画像符号化装置 |
JP2001160969A (ja) * | 1999-12-01 | 2001-06-12 | Matsushita Electric Ind Co Ltd | 動画像符号化装置、動画像伝送装置、および動画像記録装置 |
-
2010
- 2010-06-08 WO PCT/JP2010/003812 patent/WO2010150470A1/ja active Application Filing
- 2010-06-08 JP JP2011519520A patent/JP5479470B2/ja not_active Expired - Fee Related
- 2010-06-08 CN CN201080002454.2A patent/CN102138327B/zh not_active Expired - Fee Related
- 2010-06-08 US US13/061,216 patent/US8559503B2/en not_active Expired - Fee Related
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000083253A (ja) * | 1998-07-08 | 2000-03-21 | Nec Corp | 画像処理装置 |
JP2003308277A (ja) * | 2002-04-17 | 2003-10-31 | Sony Corp | 端末装置、データ送信装置、データ送受信システム及びデータ送受信方法 |
JP2004040517A (ja) * | 2002-07-04 | 2004-02-05 | Hitachi Ltd | 携帯端末および画像配信システム |
JP2005020731A (ja) * | 2003-06-14 | 2005-01-20 | Lg Electronics Inc | 移動通信端末機の映像データ処理方法 |
JP2005073218A (ja) * | 2003-08-07 | 2005-03-17 | Matsushita Electric Ind Co Ltd | 画像処理装置 |
WO2006003808A1 (ja) * | 2004-07-06 | 2006-01-12 | Matsushita Electric Industrial Co., Ltd. | 符号化または復号化装置、および記録再生端末 |
Cited By (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11638033B2 (en) | 2011-01-05 | 2023-04-25 | Divx, Llc | Systems and methods for performing adaptive bitrate streaming |
US10931982B2 (en) | 2011-08-30 | 2021-02-23 | Divx, Llc | Systems and methods for encoding and streaming video encoded using a plurality of maximum bitrate levels |
US10645429B2 (en) | 2011-08-30 | 2020-05-05 | Divx, Llc | Systems and methods for encoding and streaming video encoded using a plurality of maximum bitrate levels |
US10708587B2 (en) | 2011-08-30 | 2020-07-07 | Divx, Llc | Systems and methods for encoding alternative streams of video for playback on playback devices having predetermined display aspect ratios and network connection maximum data rates |
KR101928910B1 (ko) * | 2011-08-30 | 2018-12-14 | 쏘닉 아이피, 아이엔씨. | 복수의 최대 비트레이트 레벨들을 사용하여 인코딩된 비디오를 인코딩하고 스트리밍하기 위한 시스템들 및 방법들 |
KR20180135087A (ko) * | 2011-08-30 | 2018-12-19 | 쏘닉 아이피, 아이엔씨. | 복수의 최대 비트레이트 레벨들을 사용하여 인코딩된 비디오를 인코딩하고 스트리밍하기 위한 시스템들 및 방법들 |
KR102020764B1 (ko) | 2011-08-30 | 2019-09-11 | 디브이엑스, 엘엘씨 | 복수의 최대 비트레이트 레벨들을 사용하여 인코딩된 비디오를 인코딩하고 스트리밍하기 위한 시스템들 및 방법들 |
KR20190105136A (ko) * | 2011-08-30 | 2019-09-11 | 디브이엑스, 엘엘씨 | 복수의 최대 비트레이트 레벨들을 사용하여 인코딩된 비디오를 인코딩하고 스트리밍하기 위한 시스템들 및 방법들 |
KR20200014940A (ko) * | 2011-08-30 | 2020-02-11 | 디브이엑스, 엘엘씨 | 복수의 최대 비트레이트 레벨들을 사용하여 인코딩된 비디오를 인코딩하고 스트리밍하기 위한 시스템들 및 방법들 |
US10798143B2 (en) | 2011-08-30 | 2020-10-06 | Divx, Llc | Selection of resolutions for seamless resolution switching of multimedia content |
US11611785B2 (en) | 2011-08-30 | 2023-03-21 | Divx, Llc | Systems and methods for encoding and streaming video encoded using a plurality of maximum bitrate levels |
US11457054B2 (en) | 2011-08-30 | 2022-09-27 | Divx, Llc | Selection of resolutions for seamless resolution switching of multimedia content |
KR102163151B1 (ko) | 2011-08-30 | 2020-10-08 | 디빅스, 엘엘씨 | 복수의 최대 비트레이트 레벨들을 사용하여 인코딩된 비디오를 인코딩하고 스트리밍하기 위한 시스템들 및 방법들 |
KR102074148B1 (ko) | 2011-08-30 | 2020-03-17 | 엔엘디 엘엘씨 | 복수의 최대 비트레이트 레벨들을 사용하여 인코딩된 비디오를 인코딩하고 스트리밍하기 위한 시스템들 및 방법들 |
JP2013214894A (ja) * | 2012-04-03 | 2013-10-17 | Mitsubishi Electric Corp | 画像符号化装置 |
WO2014103131A1 (ja) * | 2012-12-26 | 2014-07-03 | パナソニック株式会社 | 画像監視システム |
US11785066B2 (en) | 2012-12-31 | 2023-10-10 | Divx, Llc | Systems, methods, and media for controlling delivery of content |
JP2016039553A (ja) * | 2014-08-08 | 2016-03-22 | 株式会社リコー | 通信装置、通信システム、通信方法およびプログラム |
US10148989B2 (en) | 2016-06-15 | 2018-12-04 | Divx, Llc | Systems and methods for encoding video content |
US11483609B2 (en) | 2016-06-15 | 2022-10-25 | Divx, Llc | Systems and methods for encoding video content |
US11729451B2 (en) | 2016-06-15 | 2023-08-15 | Divx, Llc | Systems and methods for encoding video content |
US10595070B2 (en) | 2016-06-15 | 2020-03-17 | Divx, Llc | Systems and methods for encoding video content |
JP7435208B2 (ja) | 2020-04-24 | 2024-02-21 | サクサ株式会社 | 画像処理装置及びプログラム |
Also Published As
Publication number | Publication date |
---|---|
CN102138327A (zh) | 2011-07-27 |
CN102138327B (zh) | 2014-09-24 |
JP5479470B2 (ja) | 2014-04-23 |
US20110164679A1 (en) | 2011-07-07 |
JPWO2010150470A1 (ja) | 2012-12-06 |
US8559503B2 (en) | 2013-10-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5479470B2 (ja) | 動画像符号化方法、動画像符号化装置、プログラム、および集積回路 | |
JP5588438B2 (ja) | 画像符号化方法及び画像符号化装置 | |
JP5574345B2 (ja) | 符号化方法、エラー検出方法、復号方法、符号化装置、エラー検出装置及び復号装置 | |
EP2495973B1 (en) | Decoding method, decoder apparatus, encoding method, and encoder apparatus | |
WO2010087157A1 (ja) | 画像符号化方法及び画像復号方法 | |
WO2010061607A1 (ja) | 動画像復号方法、動画像符号化方法、動画像復号装置、動画像符号化方法、プログラム、及び集積回路 | |
WO2010026770A1 (ja) | 画像符号化方法、画像復号方法、画像符号化装置、画像復号装置、システム、プログラム、及び集積回路 | |
WO2010050156A1 (ja) | 画像符号化方法、画像復号方法、画像符号化装置、画像復号装置、集積回路およびプログラム | |
WO2010113524A1 (ja) | 動画像符号化方法、動画像復号方法、動画像符号化装置および動画像復号装置 | |
WO2011004577A1 (ja) | 画像復号装置、画像符号化装置、画像復号方法、画像符号化方法、プログラムおよび集積回路 | |
JP5659160B2 (ja) | 動画像復号装置、動画像符号化装置、動画像復号回路及び動画像復号方法 | |
WO2010143427A1 (ja) | 画像符号化方法、画像復号方法、およびそれらの装置 | |
WO2011052217A1 (ja) | 画像復号方法、画像符号化方法、画像復号装置、画像符号化装置、プログラム、及び集積回路 | |
JPWO2010070897A1 (ja) | 動画像符号化方法、動画像復号方法、動画像符号化装置、動画像復号装置、プログラム、及び集積回路 | |
RU2441340C1 (ru) | Способ кодирования, способ декодирования, устройство кодирования, устройство декодирования, программа и интегральная схема | |
JP5679980B2 (ja) | 画像符号化方法、画像復号方法、画像符号化装置及び画像復号装置 | |
JP5546044B2 (ja) | 画像復号装置、画像符号化装置、画像復号回路及び画像復号方法 | |
JP5499035B2 (ja) | 画像符号化方法、画像符号化装置、プログラムおよび集積回路 | |
JP5468604B2 (ja) | 画像復号装置、集積回路、画像復号方法及び画像復号システム | |
WO2011089865A1 (ja) | 画像符号化方法、画像復号方法、それらの装置、プログラムおよび集積回路 | |
JP2011182132A (ja) | 画像符号化装置、画像復号装置、画像符号化方法、画像復号方法、集積回路およびプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201080002454.2 Country of ref document: CN |
|
ENP | Entry into the national phase |
Ref document number: 2011519520 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13061216 Country of ref document: US |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10791796 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 10791796 Country of ref document: EP Kind code of ref document: A1 |