CN107257490A - Method for encoding images and picture coding device - Google Patents

Abstract

The present invention provides method for encoding images and picture coding device.Method for encoding images includes the first generation step, generates burst restricted information, and the burst restricted information is shown for whether the filtering process of the slice boundaries of burst adjacent in multiple bursts obtained from picture segmentation is restricted；First storage step, sequence parameter set is stored in by the burst restricted information；Second generation step, for each generation filtering information of multiple slice boundaries, the filtering information shows whether perform filtering process for the slice boundaries；And second storage step, multiple filtering informations are stored in image parameters collection；In second generation step, in the case of the burst restricted information shows that the filtering process is conditional, generation shows the multiple filtering information of identical content, and the identical content is to perform the filtering process and do not perform any one party in the filtering process.

Description

Method for encoding images and picture coding device

It is January 24, Application No. 201380006479.3, entitled " image in 2013 applying date that the application, which is, The division of the application for a patent for invention of coding method, picture decoding method, picture coding device and picture decoding apparatus ".

Technical field

The present invention relates to method for encoding images and picture decoding method.

Background technology

As conventional Image Coding mode, known having is referred to as ITU-T standard H.26x or is referred to as MPEG-x ISO/IEC standards (for example, with reference to non-patent literature 1).

In addition, as new standard discussing HEVC (High Efficiency Video Coding) mode (for example, With reference to non-patent literature 2).

(prior art literature)

(non-patent literature)

Non-patent literature 1：ISO/IEC 14496-10「MPEG-4Part 10Advanced Video Coding」

Non-patent literature 2：Joint Collaborative Team on Video Coding(JCT-VC)of ITU-T SG16WP3and ISO/IEC JTC1/SC29/WG117th Meeting∶Geneva,CH,21-30November,2011, JCTVC-G1103, " Working Draft 5of High Efficiency Video Coding ", http:// phenix.it-sudparis.eu/jct/doc_end_user/documents/7_Geneva/wg11/JCTVC-G1103- v2.zip

Brief summary of the invention

Problems to be solved by the invention

So, in method for encoding images and picture decoding method, 1 image is divided into multiple regions, and it is right Divided region carries out parallel processing.

The content of the invention

Then it is an object of the invention to provide a kind of method for encoding images that can simply realize parallel processing and Picture decoding method.

The means used to solve the problem

In order to reach the purpose, stream is encoded, wrapped by the method for encoding images that a scheme of the invention is related to Include：First generation step, generates burst restricted information, and the burst restricted information is shown for will be multiple obtained from picture segmentation Whether the filtering process of the slice boundaries of adjacent burst is restricted in burst；First storage step, the burst is limited and believed Breath is stored in sequence parameter set；Second generation step, for each generation filtering information of multiple slice boundaries, filtering letter Breath shows whether perform filtering process for the slice boundaries；And second storage step, multiple filtering informations are deposited It is put into image parameters collection；In second generation step, show that the filtering process is conditional in the burst restricted information In the case of, generation shows the multiple filtering information of identical content, the identical content be perform the filtering process and Any one party in the filtering process is not performed.

In addition, these all or specific embodiments, can use system, method, integrated circuit, computer program or calculating The recording mediums such as the CD-ROM that machine can be read are realized, can also be combined system, method, integrated circuit, computer program And recording medium is realized.

Invention effect

The present invention can provide the method for encoding images and picture decoding method for simply realizing parallel processing.

Brief description of the drawings

Fig. 1 is the figure of one for representing the scanning sequency that embodiment is related to.

Fig. 2 is the figure of one for representing the scanning sequency that embodiment is related to.

Fig. 3 be represent burst (tile) that embodiment is related to and cut into slices (slice) split example figure.

Fig. 4 be represent burst (tile) that embodiment is related to and cut into slices (slice) split example figure.

Fig. 5 is the flow chart for representing the decoding process that embodiment 1 is related to.

Fig. 6 be embodiment 1 comparative example be related to judgement processing flow chart.

Fig. 7 is the flow chart for the judgement processing that embodiment 1 is related to.

Fig. 8 is the figure for the syntax (syntax) for representing the section head that embodiment 1 is related to.

Fig. 9 is the figure for the configuration example for representing the stream that embodiment 1 is related to.

Figure 10 is the figure for the configuration example for representing the stream that the comparative example of embodiment 1 is related to.

Figure 11 is the flow chart for the decoding process that embodiment 1 is related to.

Figure 12 is the block diagram for representing the picture decoding apparatus that embodiment 1 is related to.

Figure 13 is the block diagram for representing the picture coding device that embodiment 2 is related to.

Figure 14 is the flow chart of decoding process that is related to of comparative example of embodiment 3.

Figure 15 is the flow chart for the decoding process that embodiment 3 is related to.

Figure 16 is the figure for the syntax for representing the sequence parameter set that embodiment 3 is related to.

Figure 17 is the figure for the syntax for representing the image parameters collection that embodiment 3 is related to.

Figure 18 is the figure of one for representing the mark that embodiment 3 is related to.

Figure 19 A are the flow charts for the decoding process that embodiment 3 is related to.

Figure 19 B are the flow charts for the decoding process that embodiment 3 is related to.

Figure 19 C are the flow charts for the decoding process that embodiment 3 is related to.

Figure 19 D are the flow charts for the decoding process that embodiment 3 is related to.

Figure 20 A are the figures for the configuration example for representing the section head that the comparative example of embodiment 4 is related to.

Figure 20 B are the figures for the configuration example for representing the section head that embodiment 4 is related to.

Figure 21 is the flow chart for the decoding process that embodiment 4 is related to.

Figure 22 is to represent the concept map that the data that embodiment 5 is related to are constituted.

Figure 23 is the coding that embodiment 5 is related to and the flow chart of decoding process.

Figure 24 is the coding that embodiment 6 is related to and the flow chart of decoding process.

Figure 25 is all pie graphs for the content providing system for realizing content distribution service.

Figure 26 is all pie graphs of digital broadcasting system.

Figure 27 is the block diagram for the configuration example for representing television set.

Figure 28 be denoted as laser disk recording medium enter row information read-write information regeneration/record portion configuration example Block diagram.

Figure 29 is the figure of the configuration example for the recording medium for being denoted as laser disk.

Figure 30 A are the figures of one for representing portable phone.

Figure 30 B are the block diagrams for the configuration example for representing portable phone.

Figure 31 is the figure for the composition for representing multiplexed data.

Figure 32 is to represent respectively to flow the ideograph how to be multiplexed in multiplexed data.

Figure 33 is to represent the how stored figure of video flowing in PES packets are arranged in further detail.

Figure 34 is the figure for the construction for representing TS packets and source data packet in multiplexed data.

Figure 35 is to represent the figure that PMT data are constituted.

Figure 36 is the figure for the Inner Constitution for representing multiplexed data information.

Figure 37 is the figure for the Inner Constitution for representing stream attribute information.

Figure 38 is figure the step of representing to recognize image data.

Figure 39 is the integrated electricity for representing to realize the dynamic image encoding method of each embodiment and dynamic image decoding method The block diagram of the configuration example on road.

Figure 40 is the figure for the composition for representing switching driving frequency.

Figure 41 is figure the step of representing to recognize image data, switching driving frequency.

Figure 42 is the figure of one of the list for representing to make the standard of image data corresponding with driving frequency.

Figure 43 A are represented the figure of one of the shared composition of the module of signal processing part.

Figure 43 B are represented other figure of the shared composition of the module of signal processing part.

Embodiment

(the basic opinion for turning into the present invention)

The problem of present inventor can produce following on conventional scientific discovery.

In the ITU-T standard being referred to as H.26x or be referred to as in MPEG-x ISO/IEC standards, 1 picture signal with Raster scan order shown in Fig. 1 is processed.In addition, 1 picture signal is divided into the multiple units for being referred to as section.Each section Include continuous signal on described raster scan order.Moreover, with unit of cutting into slices, being encoded.

In addition it is also contemplated that sliced fashion in HEVC modes.In the sliced fashion, 1 picture signal is divided into length Square multiple units (burst).Moreover, according to divided each rectangle, the signal included in the rectangle is with grating Scanning sequency is handled and (refers to Fig. 2).This sliced fashion, can be with vertical direction divided frame, so use can be reduced Family line memory.

For example, in example as shown in Figure 3, representing burst with the part of solid line corral, being represented with the part of dotted line corral Section, the section is obtained by splitting burst.The examples of slice boundaries is not spanned across in addition, Fig. 3 is slice boundaries, but, such as Shown in Fig. 4 sometimes slice boundaries across the inside of section.

However, the inventors have found that in the mode, when carrying out parallel processing respectively to the region for being divided into burst, In the presence of such problem, it is difficult to find out the beginning part of the burst of the beginning in region as parallel processing object.

It is described in more detail, in order to judge whether picture decoding apparatus can parallel be located to the bit stream of decoder object Manage (parallel decoding), it is necessary to pre-processed.According to the pretreatment, processing time increase, thus realize that high speed processing is present It is difficult.Or there is the problem that increase circuit scale is needed to be carried out at high speed the pretreatment.

Picture decoding apparatus is described as follows in the present embodiment, and the picture decoding apparatus is can to carry out parallel decoding processing Device, the picture decoding apparatus can judge that the bit stream of decoder object is that can carry out parallel decoding processing at a high speed Stream, and in the case where parallel decoding processing can be carried out, judge to carry out at parallel decoding respectively from which point at a high speed Reason.

The method for encoding images that one scheme of the present embodiment is related to, including：Restricted information generation step, generation burst limit Information processed, and the burst restricted information is encoded, the burst restricted information shows whether have for the processing of multiple bursts Limitation, the multiple burst has been split picture and obtained；And deciding step, processing is shown in the burst restricted information In the case of conditional, the filtering of filtering process whether is performed according to a slice boundaries for showing to be directed in multiple slice boundaries Information, to determine whether perform filtering process for the multiple slice boundaries.

According to this, the execution/non-execution of filtering process can be switched according to each slice boundaries.So, the image is compiled Code method can simply realize parallel processing.

For example, in the restricted information generation step, the burst restricted information is generated by each picture, and to every The burst restricted information of individual picture is encoded.

For example, described image coding method also includes coding step, in the coding step, limit and believe in the burst In the case of breath shows that processing is conditional, to showing to compile the filtering information whether a slice boundaries perform filtering process Code, and skip the coding to following information, the information show in the multiple slice boundaries except one burst side Whether the slice boundaries beyond boundary perform filtering process.

For example, described image coding method also includes coding step, in the coding step, limit and believe in the burst In the case of breath shows that processing is conditional, the every of the filtering information of identical content and the multiple slice boundaries will be shown One is accordingly encoded.

In addition, the picture decoding method that a scheme of the present embodiment is related to, including：Restricted information decoding step, to dividing Piece restricted information is decoded, and the burst restricted information shows whether the processing for being directed to multiple bursts is restricted, the multiple point Piece has been split picture and obtained；And deciding step, in the case of the burst restricted information shows that processing is conditional, According to the filtering information for showing whether to perform a slice boundaries in multiple slice boundaries filtering process, to determine to be directed to institute State whether multiple slice boundaries perform filtering process.

According to this, the execution/non-execution of filtering process can be switched according to each slice boundaries.So, the image solution Code method can simply realize parallel processing.

For example, in the restricted information decoding step, entering to the burst restricted information set by each picture Row decoding.

For example, described image coding/decoding method also includes decoding step, in the decoding step, limit and believe in the burst In the case of breath shows that processing is conditional, to showing to solve the filtering information whether a slice boundaries perform filtering process Code, and skip the decoding to following information, the information show in the multiple slice boundaries except one burst side Whether the slice boundaries beyond boundary perform filtering process.

For example, described image coding/decoding method also includes decoding step, in the decoding step, limit and believe in the burst In the case of breath shows that processing is conditional, multiple filtering informations are decoded, multiple filtering informations are and the multiple point Each of sheet border is corresponding, show the information of identical content.

In addition, the picture coding device that a scheme of the present embodiment is related to, possesses：Coding unit, generation burst limitation letter Breath, and the burst restricted information is encoded, the burst restricted information shows whether the processing for being directed to multiple bursts is restricted, The multiple burst has been split picture and obtained；And determination section, show that processing is restricted in the burst restricted information In the case of, the filtering information of filtering process whether is performed according to a slice boundaries for showing to be directed in multiple slice boundaries, To determine whether perform filtering process for the multiple slice boundaries.

According to this composition, the execution/non-execution of filtering process can be switched according to each slice boundaries.So, the figure As code device can simply realize parallel processing.

In addition, the picture decoding apparatus that a scheme of the present embodiment is related to, possesses：Lsb decoder, to burst restricted information Decoded, the burst restricted information shows whether the processing for being directed to multiple bursts is restricted, and the multiple burst is segmentation Picture and obtain；And determination section, in the case of the burst restricted information shows that processing is conditional, according to showing to be directed to Whether a slice boundaries in multiple slice boundaries perform the filtering information of filtering process, to determine to be directed to the multiple burst Whether border performs filtering process.

According to this composition, the execution/non-execution of filtering process can be switched according to each slice boundaries.So, the figure As decoding apparatus can simply realize parallel processing.

In addition, the arrangement for encoding that a scheme of the present embodiment is related to possesses described image code device and described Picture decoding apparatus.

In addition, these all or specific embodiments, can use system, method, integrated circuit, computer program or calculating The recording mediums such as the CD-ROM that machine can be read are realized, can also be combined system, method, integrated circuit, computer journey Sequence and recording medium are realized.

Below, embodiments of the present invention are described with reference to the attached figures.

In addition, examples set forth below is all to show all or specific example.Shown in following embodiment Numerical value, shape, material, inscape, the allocation position of inscape and type of attachment, step, the order of step etc., all It is the example of the present invention, purport is not the limitation present invention.Also, in the inscape of following embodiment, show most upper There is no the inscape recorded in the independent claims of position concept, it may be said that bright is arbitrary inscape.

(embodiment 1)

In the present embodiment, illustrate to carry out the parallel decoding processing in the picture decoding apparatus of parallel decoding processing. In the present embodiment, bit stream includes the information for making picture decoding apparatus easily carry out parallel processing.

First, the decoding process started in the case of being necessarily configured with section head in burst as shown in Figure 3 is illustrated.

Picture can be equably divided into oblong-shaped (rectangular) in sliced fashion, so can make after segmentation The width of the transverse direction in region diminishes.So, sliced fashion has the advantage that, for the big image (example of the width of transverse direction Such as it is referred to as the image of 4k or 8k resolution ratio), required memory-size is few.Furthermore it is possible to simply to burst area Pixel data in domain carries out impartial segmentation, so parallel processing is also easily carried out.Therefore, the parallel solution since the beginning of burst Code, it is critically important to effectively carrying out parallel decoding processing.

In addition, the beginning location of section head is the composition that entropy decoding portion can easily be held so that entropy decoding portion is advance only Search section head, with regard to header can be obtained.Therefore, constructed by being defined to this, so that certain on the beginning location of burst In the presence of section head.Thus, picture decoding apparatus, using the section head, can simply determine the initial point of burst, i.e. parallel solution The beginning place of code processing.In addition, the information required for decoding process is included in this section head, is also not necessarily in decoding The information of the head of buffering section in advance.

In addition, on easily realizing this method constituted, illustrating in embodiment 3.

Fig. 5 is the flow chart for the flow for representing the parallel decoding processing in the case of this composition.First, picture decoding apparatus Decoding section head (S101).Below, picture decoding apparatus judges whether this section is located at the beginning (S102) of burst.Example Such as, in the case of section head X as shown in Figure 3, the section is not at the beginning ("No" in S102) of burst, image decoding Device carries out the decoding (S101) of next section head.On the other hand, in the case of section head Y as shown in Figure 3, the section Positioned at the beginning ("Yes" in S102) of burst, so picture decoding apparatus proceeds by parallel decoding processing from the position (S103).In addition, a series of processing is repeated untill terminating to the processing of 1 picture.In addition, picture decoding apparatus The function in the parallel decoding portion having all by use in the case of, picture decoding apparatus is waited, until parallel decoding portion Untill can using.In the case of beyond it, obtaining for next section head is performed in parallel with the decoding process inside section .So by obtaining section head, to set the beginning of parallel decoding processing.

Then, to judging whether the method for the beginning for being located at burst is illustrated section head.

Illustrate the determination methods in the comparative example of the present embodiment first with Fig. 6.In the determination methods, first, image solution Code device, obtains the positional information (S201) for the slice position for showing to be included in section head.In addition, picture decoding apparatus, in advance Burst segmentation information is obtained, memory is stored in, memory represents how burst is divided.Moreover, picture decoding apparatus is utilized Burst segmentation information, obtains the beginning location (S202) of next burst.Finally, picture decoding apparatus, compares process object In the case of the beginning location of slice position (beginning location of section) and burst, two position identicals, it is determined as section head and exists Burst starts.On the other hand, in the case that two positions are different, it is judged as that section head does not start (S203) in burst.

So, in the determination methods that this comparative example is related to, many steps are needed in order to start parallel decoding：Often grasp The processing of position in processing, accesses the processing of memory, and compare the processing of two positions etc..So, the determination methods In, occur processing leeway.

Below, the determination methods that the present embodiment is related to are illustrated using Fig. 7.In the present embodiment, 1 is included in section head The mark of bit, the mark represents whether this section is located at the beginning of burst.As shown in fig. 7, picture decoding apparatus is obtained The mark (S111), confirms the value (S112) of the mark, so as to judge to cut into slices whether be located at the beginning of burst.So, The picture decoding method that the present embodiment is related to, can interpolate that whether section is located at the beginning location of burst with few treating capacity.

Fig. 8 is the figure for the syntax for representing section head.1 described bit flag is, for example, the start_tile_ shown in Fig. 8 in_slice_flag.In the case that start_tile_in_slice_flag is " 1 ", position of the section from the burst upper left corner (beginning of burst) starts.(start_tile_in_slice_flag is the situation of " 0 "), the section in the case of in addition Not since the position in the upper left corner of burst.In addition, here it is shown that this mark be configured in section head beginning example, But, the position of the mark is not limited solely to this.But, the position of this mark, more can be at a high speed closer to the beginning of section head Ground starts parallel decoding processing.

Fig. 9 is the figure for the configuration example for representing the stream in the case of this.Figure 10 is in the case of representing to indicate without using this Stream configuration example figure.Represent positional information (or the burst segmentation information) configuration of position of section in section head Section.Thus, picture decoding apparatus is in order to obtain this positional information, and the picture decoding apparatus is in section not in the beginning of burst In the case of (situation about being handled from the beginning of section without parallel decoding), then obtain useless information.Thus without the mark In the case of will, the processing of redundancy is produced.On the other hand, as shown in Figure 9 in the beginning of section head, or close to the part of beginning The mark of 1 bit is configured, so that picture decoding apparatus, can start parallel decoding processing at once.

Explanation is as shown in figure 4, be not at the situation of the beginning of burst in section head below., can in sliced fashion Picture is equably divided into oblong-shaped, so as before, parallel decoding is handled since the beginning of burst, to effective It is critically important that ground carries out parallel decoding processing.

In this composition, the beginning of burst not necessarily just has the beginning of section, thus need obtain burst beginning location, And obtain the information of the section head needed to start the decoding process of burst.Therefore, it is identical with Fig. 3 situation, it is necessary to Scan slice head.

Illustrate the flow of this processing using Figure 11.First, picture decoding apparatus decoding section head (S121).At this In, such as in the case of section head A as shown in Figure 4, the beginning location of head of cutting into slices is consistent with the beginning location of burst (in S122 "Yes"), so picture decoding apparatus start to this burst carry out parallel decoding processing (S123).

On the other hand, in the case of the section head B shown in Fig. 4, because the beginning of the beginning location and burst of section head Position is inconsistent ("No" in S122), so processing enters step S124.

Below, picture decoding apparatus is confirmed whether comprising the positional information (S124) untill burst.This positional information, table Show 1 cut into slices in include multiple bursts in the case of from the burst to the distance of next burst.There is positional information In the case of ("Yes" in S124), picture decoding apparatus decodes the positional information (S125), according to passing through position obtained from decoding Confidence is ceased, and ff (search) is carried out untill next burst, carries out parallel decoding processing (S126).On the other hand, exist In the case of not having positional information ("No" in S124), picture decoding apparatus decodes the head (S121) of next section.Separately Outside, a series of processing is repeated untill terminating for the processing of 1 picture.In addition, picture decoding apparatus has Parallel decoding portion function all by use in the case of, picture decoding apparatus is waited, until parallel decoding portion can Untill use.

So, in the case that section head is not necessarily located in the beginning of burst, compares and first be positioned at opening for burst with section The situation of head compares the processing, it is necessary to complicated.Even if in that case, by the start_tile_in_ shown in foregoing Fig. 8 Slice_flag is configured to the beginning of section, can reduce the treating capacity of the complicated processing.In such manner, it is possible to realize more high speed Decoding process.

In addition, the parallel decoding processing that the present embodiment is related to, is carried out, the picture decoding apparatus is pair by picture decoding apparatus The device decoded by the coded image data of compressed encoding.Figure 12 is to show the picture decoding apparatus that the present embodiment is related to The block diagram of one of 400 composition.In addition, the parallel decoding processing shown in Fig. 5, Fig. 7 or Figure 11, by entropy decoding portion 410 Carry out.

Picture decoding apparatus 400, solution is generated to being decoded by the coded image data (input signal) of compressed encoding Code signal.For example, in picture decoding apparatus 400, coded image data is transfused to by each piece as input signal.Image Decoding apparatus 400 to input signal by carrying out variable-length decoding, re-quantization and inverse transformation, so as to recover view data.

As shown in figure 12, picture decoding apparatus 400 possesses：Entropy decoding portion 410, re-quantization and inverse transformation portion 420, adder 425th, de-blocking filter 430, memory 440, infra-frame prediction portion 450, within the frame/frames dynamic compensating unit 460, switching switch 470.

Entropy decoding portion 410 to input signal (inlet flow) by carrying out variable-length decoding, so as to recover quantization parameter.Separately Outside, here, input signal (inlet flow) is decoder object signal, equivalent to the data of each block of coded image data.In addition, Entropy decoding portion 410, exercise data is obtained from input signal, and the exercise data of acquisition is output into dynamic compensating unit 460.

Re-quantization and inverse transformation portion 420, re-quantization is carried out to the quantization parameter restored by entropy decoding portion 410, from And restore conversion coefficient.Moreover, re-quantization and inverse transformation portion 420, by carrying out reciprocal transformation to the conversion coefficient restored, from And restore predicated error.

Adder 425, by being added to the predicated error and prediction signal that are reconditioned, so as to generate decoding image.

De-blocking filter 430, block elimination filtering processing is carried out for the decoding image being generated.Block elimination filtering processing is carried out Decoding image, exported as decoded signal.

Memory 440 is the memory for being stored in the reference picture used in motion compensation.Specifically, memory 440 storages have carried out the decoding image of block elimination filtering processing.

Infra-frame prediction portion 450 is by carrying out infra-frame prediction, so as to generate prediction signal (infra-frame prediction signal).It is specific and Speech, infra-frame prediction portion 450, with reference to by adder 425 generate decoding image, around decoder object block (input signal) Image carries out infra-frame prediction, so as to generate infra-frame prediction signal.

Dynamic compensating unit 460, according to the exercise data exported from entropy decoding portion 410, carries out motion compensation, so as to generate pre- Survey signal (Inter prediction signals).

Switching switch 470, selects some of infra-frame prediction signal and Inter prediction signals, will select within the frame/frames Signal as prediction signal be output to adder 425.

Composition more than, the picture decoding apparatus 400 that the present embodiment is related to, to the coding for being carried out compressed encoding View data is decoded.

As described above, picture decoding apparatus and picture decoding method that the present embodiment is related to, can simply judge with The processing starting point of the corresponding bit stream of composition of picture decoding apparatus.That is, the picture decoding apparatus and picture decoding method, Can simply judge section head carry out Perth (analysis) position whether be burst beginning.In such manner, it is possible to realize image The high speed of decoding apparatus.

Further, according to these configurations, processing time can easily be estimated.So, high-resolution image is for example passed through The high-speed computation circuit used in instant regeneration treatment etc., can realize picture decoding apparatus.

(embodiment 2)

Explanation is filled by the method for encoding images and Image Coding for encoding generation code string and transmitting in the present embodiment Put, the code string is can to easily perform the code string of parallel decoding.The picture coding device by represent cut into slices head position be The information of the no beginning in burst, is transferred to picture decoding apparatus.So, the picture coding device, can generate to improve The bit stream of the degree of parallelism of decoding process.

The picture coding device that the present embodiment is related to, when coded slice head, the position for judging section head is The beginning location of burst.In the case that the position of section head is the beginning of burst, for example, by the start_tile_ shown in Fig. 8 In_slice_flag is documented in section head.

By above-mentioned, the picture coding device is that embodiment 1 such as illustrates the ability to the picture decoding apparatus of parallel decoding, can Generation simply starts the code string of parallel decoding.

Figure 13 is the block diagram of the configuration example for the picture coding device for showing the present embodiment.Image Coding dress shown in Figure 13 200 are put to possess：Subtracter 205, conversion and quantization unit 210, entropy code portion 220, re-quantization and inverse transformation portion 230, adder 235th, de-blocking filter 240, memory 250, infra-frame prediction portion 260, motion detecting section 270, dynamic compensating unit 280, frame in/frame Between switching switch 290.

Subtracter 205 calculates the difference of input signal and prediction signal, i.e. predicated error.

Conversion and quantization unit 210 are by the predicated error in transformation space region, so as to generate the conversion coefficient of frequency domain.Example Such as, conversion and quantization unit 210, carry out DCT (Discrete Cosine Transform) to predicated error and convert, so as to generate Conversion coefficient.In addition, conversion and quantization unit 210, by quantifying to conversion coefficient, so that generating quantification coefficient.

Entropy code portion 220, by carrying out Variable Length Code to quantization parameter, so as to generate encoded signal.In addition, entropy code Portion 220, is encoded to the exercise data (for example, motion vector) detected by motion detecting section 270, included in encoded signal It is upper to be exported.

Re-quantization and inverse transformation portion 230 to quantization parameter by carrying out re-quantization, so as to be restored to conversion coefficient.Plus It, re-quantization and inverse transformation portion 230 carry out inverse transformation, so as to restore predicated error by the conversion coefficient to recovery.In addition, The predicated error being reconditioned is because quantified, and information is lost, so inconsistent with the predicated error of the generation of subtracter 205.That is, The predicated error being reconditioned includes quantization error.

Adder 235, by being added to the predicated error and prediction signal that are reconditioned, so as to generate local decoding figure Picture.

De-blocking filter 240, block elimination filtering processing is carried out to the locally decoded picture being generated.

Memory 250 is the memory for being stored in the reference picture used in motion compensation.Specifically, memory Storage implements the locally decoded picture of block elimination filtering processing in 250.

Infra-frame prediction portion 260 is by carrying out infra-frame prediction, so as to generate prediction signal (infra-frame prediction signal).It is specific and Speech, infra-frame prediction portion 260, with reference in the locally decoded picture generated by adder 235, coded object block (input signal) The image of surrounding carries out infra-frame prediction, so as to generate infra-frame prediction signal.

Motion detecting section 270 detects the exercise data (example between the reference picture deposited in input signal and memory 250 Such as, motion vector).

Dynamic compensating unit 280, carries out motion compensation, so as to generate prediction signal (interframe according to detected exercise data Prediction signal).

Switching switch 290, selects some of infra-frame prediction signal and Inter prediction signals, will select within the frame/frames Signal as prediction signal, be output to subtracter 205 and adder 235.

Composition more than, the picture coding device 200 that the present embodiment is related to is compressed coding to view data.

In addition, differentiate the processing for the beginning that section head is burst and the mark by entropy code portion 220 Coded treatment.

As described above, picture coding device and method for encoding images that the present embodiment is related to, will be with decoding process order Related information transfer is to picture decoding apparatus.So, the picture coding device and method for encoding images, can be generated in figure As decoding apparatus can carry out the encoded signal (bit stream) of high speed processing.

(embodiment 3)

In the present embodiment, illustrate that the beginning shown in Fig. 3 as the aforementioned in burst must be in the case of head of cutting into slices, can Easily carry out the composition of the code string of parallel processing.

Illustrate the processing of the comparative example of the present embodiment with Figure 14 first.First, picture decoding apparatus obtains SPS (sequences Parameter set) (S231).Then, picture decoding apparatus is decoded to the mark A included in SPS, and mark A is used to easily carry out Parallel processing (S232).Then, picture decoding apparatus is decoded to the mark B included in PPS (image parameters collection), the mark B is used to easily carry out parallel processing (S233).In addition, picture decoding apparatus is decoded to the mark C included in PPS, the mark Will C is used to easily carry out parallel processing (S234).

These marks A~C is entirely the parameter for being used to easily carry out parallel processing.Then picture decoding apparatus, judges Whether these parameters meet the parallel processing condition (also referred to as constraint_tile collection) that the picture decoding apparatus has (S235).In other words, picture decoding apparatus, uses these parameters to judge whether the picture decoding apparatus has to process object Stream carry out parallel decoding processing function.If these parameters, meet the parallel processing condition that the picture decoding apparatus has In the case of ("Yes" in S235), picture decoding apparatus judge process object stream be that can carry out parallel decoding, to the stream Carry out parallel decoding processing (S236).Herein, parallel decoding processing specifically refers to the processing shown in embodiment 1.

On the other hand, (S235 in the case that these parameters do not meet the parallel processing condition that the picture decoding apparatus has In "No"), picture coding device is handled without parallel decoding, carries out common decoding process (S237).

But, it is above-mentioned in order to judge whether that the mark required for can carrying out parallel decoding is more.Further, manage corresponding The parameters relationship of parallel decoding can be carried out, is had difficulties.Then, in the present embodiment, in SPS plus mark, the mark is represented The such conditions required in parallel decoding of constraint_tile_flag.

Figure 15 is the flow chart for the image decoding processing that the present embodiment is related to.

As shown in figure 15, picture decoding apparatus obtains SPS, and the mark included in SPS is decoded (S131). In the case that this mark illustrates the ability to parallel decoding ("Yes" in S132), picture decoding apparatus setting easily carries out pre- prerequisite The parameter set (S133) of fixed parallel decoding processing, performs parallel decoding processing (S134).

On the other hand, the mark shows ("No" in S132), picture decoding apparatus in the case of being unable to parallel decoding Parameter (mark A~C) (S135~S137) is obtained in the same manner as Figure 14, is judged (S138) using the parameter of acquisition.In addition, In this judgement, only when stream meets picture decoding apparatus, being just judged as being capable of parallel decoding.Moreover, same with Figure 14 According to judged result, parallel decoding processing (S134) or common decoding process (S139) are performed.

In addition, instead of the mark for being capable of parallel decoding, index (index) can be used, with 0,1,2,3 shape representation The rank of degree of concurrence.In the case of this, in step S132, as the value shown by the index, represent and picture decoding apparatus In the case that corresponding degree of concurrence is inconsistent, into step S133, in that case of not being, into step S135.

Figure 16, Figure 17 and Figure 18 show to indicate A, B, C concrete example.In addition, parameter in the case of being not particularly illustrated Implication is as described in non-patent literature 2.

Herein, loop_filter_across_tile_flag, loop_filter_across_slice_flag, with And tile_boundary_independence_flag, represent whether be filtered on burst or slice boundaries.Carrying out , it is necessary to store decoding image above, the parallel processing of improper high speed on a memory in the case of filtering.In addition, in phase Whether switching performs filtering by the border of each burst in same picture, then parallel processing becomes more difficult.

In addition, dependence is not present between making burst, so that parallel processing becomes easier to carry out.In addition, dividing Section head is placed in the beginning of piece, so that the state for the coded treatment that counts can also reset, so according to this composition, can realize height Fast parallel decoding.

Figure 19 A show the processing example in the case of this.(the S141 in the case where SPS has constraint_tile_flag In "Yes"), picture decoding apparatus (or picture coding device), skip tile_boundary_independence_flag, Loop_filter_across_tile_flag, loop_filter_across_slice_flag decoding process are (or at coding Reason) (S142).On the other hand, ("No" in S141), image decoding in the case that SPS does not have constraint_tile_flag Device (or picture coding device) carries out tile_boundary_independence_flag, loop_filter_across_ The decoding process (or coded treatment) (S143) of tile_flag, loop_filter_across_slice_flag parameter.

Herein, tile_boundary_independence_flag is the information being shown below：Whether forbid with reference to super The more information of slice boundaries.Loop_filter_across_tile_flag is to show whether perform at filtering for slice boundaries The information of reason.Loop_filter_across_slice_flag is the letter for showing whether to perform filtering process for slice boundaries Breath.

This way it is not necessary to useless code be encoded or decode, so as to cut down encoding amount.

As described above, the picture coding device that the present embodiment is related to, generation burst restricted information (constraint_tile_ Flag), the burst restricted information is encoded, the burst restricted information shows the coded treatment or decoding process for multiple bursts Whether restricted, the multiple burst has been split picture and obtained.In addition, the picture coding device, limits in burst and believes In the case of breath shows that coded treatment or decoding process are conditional, filtering information (loop_filter_across_ is skipped Tile_flag coded treatment) or decoding process, the filtering information show whether perform filtering for multiple slice boundaries Processing.

Herein, in the case that the coded treatment or decoding process of filtering information are skipped, picture coding device with And in picture decoding apparatus, to each of multiple slice boundaries, it is impossible to switch execution/non-execution filtering process.In other words, it is right Multiple slice boundaries use identical processing (execution/non-execution filtering process).So, by forbidding the places of each slice boundaries The switching of reason, can reduce treating capacity.

Figure 19 B show the work of the picture coding device or picture decoding apparatus in the case of this.As shown in Figure 19 B, The picture coding device that the present embodiment is related to, generates burst restricted information, encodes the burst restricted information, the burst restricted information Show whether the processing for being directed to multiple bursts is restricted, and the multiple burst is to have split picture and obtained (S140A).Burst Restricted information show processing it is conditional in the case of ("Yes" in S141A), picture coding device to multiple slice boundaries carry out Identical handles (execution/non-execution filtering process) (S142A).On the other hand, burst restricted information shows to handle and not limited In the case of ("No" in S141A), picture coding device carries out identical or different processing to multiple slice boundaries and (holds Row/do not perform filtering process) (S143A).

In addition, picture decoding apparatus decodes burst restricted information, the burst restricted information shows the place for multiple bursts Whether reason is restricted, and the multiple burst is to have split picture and obtained (S140A).Show that processing has in burst restricted information In the case of limitation ("Yes" in S141A), picture decoding apparatus multiple slice boundaries are carried out identical processing (perform/no Perform filtering process) (S142A).On the other hand, in the case where burst restricted information shows to handle and do not limited (in S141A "No"), picture decoding apparatus carries out identical or different processing to multiple slice boundaries (at execution/non-execution filtering Reason) (S143A).

In addition, identical processing, picture coding device or picture decoding apparatus so are carried out to multiple slice boundaries, The whole coded treatments or decoding process skipped to multiple filtering informations of multiple slice boundaries are can not be, but it is only right One filtering information of some slice boundaries is encoded or decoded.In other words, in that case, picture coding device Or picture decoding apparatus, according to a filtering information, to determine whether perform filtering process to multiple slice boundaries.Specifically For, picture coding device or picture decoding apparatus show to perform at filtering for slice boundaries in a filtering information In the case of reason, filtering process is performed to the whole of multiple slice boundaries.On the other hand, picture coding device or image decoding Device, in the case where a filtering information shows not perform filtering process for slice boundaries, to multiple slice boundaries All do not perform filtering process.

Figure 19 C show the work of the picture coding device or picture decoding apparatus in the case of this.As shown in fig. 19 c, Burst restricted information show processing it is conditional in the case of ("Yes" in S141A), picture coding device or image decoding dress Put, according to the filtering information for showing whether to perform a slice boundaries in multiple slice boundaries filtering process, to determine pair Whether multiple slice boundaries perform filtering process (S142B).In addition, burst restricted information shows to handle in the case of not limiting ("No" in S141A), picture coding device or picture decoding apparatus, according to showing to one point in multiple slice boundaries Whether sheet border performs multiple filtering informations of filtering process, to determine whether perform filtering process to multiple slice boundaries (S143B)。

In other words, picture coding device, in the case of burst restricted information shows that processing is conditional, coding shows one Whether slice boundaries perform the filtering information of filtering process, skip the coding to following information, and the information is shown to multiple points Whether the slice boundaries beyond one slice boundaries in sheet border perform the information of filtering process.In addition, image decoding Device, in the case of burst restricted information shows that processing is conditional, decoding shows whether a slice boundaries are performed at filtering The filtering information of reason, skips the decoding to following information, and the information is to show one burst in multiple slice boundaries Whether the slice boundaries beyond border perform the information of filtering process.

Or or the wholes of multiple filtering informations be set to same value.In other words, picture coding device, In the case of burst restricted information shows that processing is conditional, it will show that (filtering process is carried out/do not entered identical content Filtering information OK), is accordingly encoded with each of multiple filter edges.

Figure 19 D show the work of the picture coding device or picture decoding apparatus in the case of this.As shown in Figure 19 D, In the case of burst restricted information shows that processing is conditional ("Yes" in S141A), picture coding device will show identical The filtering information of content, is accordingly encoded (S142C) with each of multiple slice boundaries.On the other hand, in burst Restricted information shows to handle do not limit in the case of ("No" in S141A), picture coding device will show identical or not The filtering information of same content, is accordingly encoded (S143C) with each of multiple slice boundaries.

In addition, picture decoding apparatus, in the case of burst restricted information shows that processing is conditional (in S141A "Yes"), multiple filtering informations are decoded, the plurality of filtering information shows each corresponding identical with multiple slice boundaries Content (S142C).On the other hand, in the case where burst restricted information shows to handle and do not limited ("No" in S141A), figure As the multiple filtering informations of decoding apparatus decoding, the plurality of filtering information shows each corresponding phase with multiple slice boundaries Same or different content (S143C).

In addition, burst restricted information can be set by each picture.In other words, picture coding device is given birth to by each picture Encoded into burst restricted information, and to the burst restricted information of each picture.In addition, picture decoding apparatus is to by each Picture and the burst restricted information that sets are decoded.

In addition, described handle the coding unit that is possessed by picture coding device and determination section, or picture decoding apparatus possesses Lsb decoder and determination section are carried out.For example, the coding unit and determination section are included in the entropy code portion 220 shown in Figure 13.In addition, Lsb decoder and determination section are included in the entropy decoding portion 410 shown in Figure 12.

(embodiment 4)

In the present embodiment, the situation that start_tile_in_slice_flag is recorded on section head is described in more detail Under, cut down the composition of information content.

Figure 20 A are the figures of the configuration example of the section head in the comparative example for represent the present embodiment.On the other hand, Figure 20 B are tables Show in the present embodiment section head configuration example figure.In addition, Figure 21 is the flow of work for showing to be related in the present embodiment Flow chart.

First, picture coding device (or picture decoding apparatus), the section to showing process object is first and cut The mark (Figure 20 B first_slice_in_pic_flag) of piece is encoded (or decoding) (S151).Then, in the mark Will is not (first_slice_in_pic_flag in the case of 0！=0), i.e. the section of process object is first section In the case of ("Yes" in S152), picture coding device (or picture decoding apparatus), skip later section positional information or The coded treatment (or decoding process) (S153) of the initial position message of person's burst etc..

On the other hand, in the case of being 0 in this mark (first_slice_in_pic_flag=0), that is, deal with objects Section be not first section in the case of ("No" in S152), picture coding device (or picture decoding apparatus), to showing Go out process object section be burst beginning information (start_tile_in_slice_flag) encoded (or Decoding) (S154).

Then, in the case of being 1 in this mark (start_tile_in_slice_flag=1), i.e., process object is cut Piece be burst beginning in the case of ("Yes" in S155), picture coding device (or picture decoding apparatus), to show processing The burst of object is that the information (tile_idx_minus1) of which burst is encoded (or decoding) (S156).

On the other hand, in the case of being 0 in this mark (start_tile_in_slice_flag=0), i.e. processing pair The section of elephant be not burst beginning in the case of ("No" in S155), picture coding device (or picture decoding apparatus), because Not know the position of this section, so the positional information (slice_address) to section is encoded (or decoding) (S157)., can be effective by doing so it is possible, picture coding device (or picture decoding apparatus), it is not necessary to the information of transmitting redundancy Ground carries out coded treatment (or decoding process), it is possible to increase degree of parallelism and improve compression ratio.In addition, picture decoding apparatus can Correctly decode the stream.

In addition, the information relevant with the segmentation of burst, such as be configured in the overall information of management stream is referred to as sequence The part of parameter set.In addition, this information can be shown in number and horizontal direction in such as vertical direction of segmentation frame Number.Or, this information can show frame being divided into several processing units.But, it is pre- prerequisite in encoding and decoding side Fixed divided each burst is processed according to pre-determined scanning sequency (such as raster order).Therefore, process object is cut In the case that piece is the beginning of burst, by knowing which burst the burst of process object is, process object is able to know that The positional information spatially of the frame in of section.In such manner, it is possible to cut down the address information of section.

In addition, in the case that process object section is the beginning of picture, the numbering of burst must be No. 1, the address of section It is also (0,0), so these information can be without coding.By in such manner, it is possible to cut down information content.

(embodiment 5)

The slice header of the information (tile_idx_minus1) of the order of burst will be kept in the present embodiment, as showing point The information of the beginning of piece is used.

Figure 22 is to represent the concept map that the data in the present embodiment are constituted.The information of the beginning of burst is represented as shown in figure 22 Slice header be always disposed on section head it is tight before.Figure 23 is to show picture coding device (or the image solution in the case of this Code device) work flow flow chart.

First, picture coding device (or picture decoding apparatus), slice header (tile_header ()) is encoded (or Person decodes) (S161).So, picture coding device (or picture decoding apparatus), burst is obtained from foregoing sequence parameter set The information of beginning location, it is determined that the position of the burst in frame in.

Below, picture coding device (or picture decoding apparatus), couple section relevant with this burst head (slice_ Header ()) encoded or decoded (S162).So, because the information required for the decoding of burst is included in section head In, so can judge how picture decoding apparatus carries out the decoding of this burst immediately.Thus, picture decoding apparatus is able to carry out High-speed parallel processing.In addition, so tile_header () configurations slice_header () it is tight before in the case of, for example The beginning code of section head can be omitted.

Generally, tile_header () is different heads from slice_header (), is assigned with different beginning codes.Separately On the one hand, as in the present embodiment, in the case of the tight head of always configuration section afterwards of slice header, opening for section head can be omitted Beginning code.Generally start code using fixed long special code, start code by omitting this, can significantly cut down superfluous Long code.In addition, in the case that search starts code in the loading of head, it is not required that this unnecessary search.Cause And processing high speed can be made.

(embodiment 6)

Situation is also described as follows in the present embodiment, according to the situation of the encoding and decoding of profile_idc change parameters. Profile_idc is profile information, its show convection current encoded or decoded in the case of composition.

Figure 24 is the flow chart for the flow for showing the work in the case of this.For example, this profile information is shown with limit In the case of burst processed ("Yes" in S171), picture coding device (or picture decoding apparatus) skips point in process object Piece is the coding (or decoding) of the information (relevant parameter) of relevant limitation used in the case of limiting burst, arrange parameter from And carry out the limitation (S172).Herein, limitation refers to：On border without filtering process, and in burst coding (or Person decode) in without reference to information of other bursts etc..

Profile information do not shown using ("No" in S171) in the case of limiting burst, picture coding device (or image Decoding apparatus), (or decoding) is encoded to information (relevant parameter), the information shows which information is limited Information (S173).

In addition, picture coding device (or picture decoding apparatus), for example, some profile informations, show not utilize burst In the case of, skip whole sequence parameter sets, image parameters collection and in the first-class head of cutting into slices, information about burst Coded treatment (or decoding process).In such manner, it is possible to the coded treatment or decoding process of the information of redundancy be cut down, so can Realize high speed processing and high compressed capability.

Picture coding device and picture decoding apparatus that embodiment is related to are this concludes the description of, but the present invention is not by this A little embodiments are limited.

In addition, each processing unit that picture coding device and picture decoding apparatus that the embodiment is related to are included is typically It can be realized as the LSI of integrated circuit.A chip each can be made in these, can also be by a part or complete A chip is made in portion.

Further, the method for integrated circuit is not limited to LSI, can also be with special circuit or general processor come real It is existing.Programmable field programmable gate array (FPGA: the Field Programmable after LSI manufactures can also be utilized Gate Array) or dynamically reconstruct LSI inside circuit unit connection and setting reconfigurable processor.

In each described embodiment, each inscape can be constituted with special hardware, or be adapted to respectively by performing The software program of inscape is realized.Each inscape, is read by the program execution department of CPU or processor etc. and performed hard The software program that is recorded in the recording medium such as disk or semiconductor memory is realized.

In addition, the present invention can be the non-computer for the moment that the software program or described program are recorded The recording medium that can be read.In addition, described program can circulate via the transmission medium of internet etc..

In addition, the numeral used is provided to specifically describe the example of the present invention, the number that the present invention is not exemplified Word is limited.

In addition, the segmentation of functional block in a block diagram is one, multiple functional blocks can be regard as One function block To realize, either One function block is divided into multiple or part of functions is transferred to other functional blocks.In addition, will The function of multiple functional blocks with similar function, is handled with single hardware or software parallel or timesharing.

In addition, in described method for encoding images or picture decoding method comprising the step of the order that performs, be in order to Specifically describe example shown in the present invention order or it is described beyond order.In addition, a part for the step It can be performed with simultaneously (parallel) the step of other.

More than, picture coding device and picture decoding apparatus that one or more schemes for the present invention are related to, root It is illustrated according to embodiment, but, the present invention is not limited by these embodiments.Without departing from the ancestor of the present invention Purport, the then various modifications example that operator finds out implements the example in each embodiment, and the inscape in not be the same as Example is entered The example that row is combined and constructed also is included in the scope of one or more scheme of the present invention.

(embodiment 7)

By for realizing dynamic image encoding method (method for encoding images) or motion diagram that each described implementation is exemplified As the program of the composition of coding/decoding method (picture decoding method) recorded storage media, so that the place that each described implementation is exemplified Reason, can simply implement in independent computer system.Recording medium can be disk, CD, magneto-optic disk, IC-card, partly lead Body memory etc., as long as being able to record that program just can be with.

In addition illustrate herein, dynamic image encoding method (method for encoding images) and fortune that each described implementation is exemplified The application examples of moving picture decoding method (picture decoding method) and use the system of those.The system is characterized in image Coding and decoding device, the arrangement for encoding is by the picture coding device using method for encoding images and utilizes image decoding side The picture decoding apparatus composition of method.On its outer composition in system, can rightly it be changed according to situation.

Figure 25 is all pie graphs for showing to realize the content providing system ex100 of content distribution service.By communication service Offer region division be desired size, be respectively arranged with each unit as fixed wireless office base station ex106, ex107、ex108、ex109、ex110。

In content providing system ex100, computer ex111, PDA (personal digital assistant：personal digital Assistant) the various equipment such as ex112, video camera ex113, portable phone ex114, game machine ex115 are taken by internet Be engaged in provider ex102 and telephone network ex104 and base station ex106~ex110, is connected with internet ex101.

However, content providing system ex100 is not limited to the composition shown in Figure 25, arbitrary key element can also be carried out Connected after combination.And it is possible to not by as fixed wireless office base station ex106 to ex110, but each equipment directly with Telephone network ex104 is connected.And or each equipment wirelessly etc. is connected to each other directly by near field.

Video camera ex113 is the equipment that digital camera etc. can shoot moving image, and video camera ex116 is Digital photographic Machine etc. can shoot the equipment of rest image and moving image.And portable phone ex114 is GSM (registration mark) (Global System for Mobile Communications：Global system for mobile communications) mode, CDMA (Code Division Multiple Access：CDMA) mode, W-CDMA (Wideband-Code Division Multiple Access：WCDMA) mode, LTE (Long Term Evolution：Long Term Evolution) mode, HSPA (High-Speed Packet Access：High-speed packet is accessed) portable phone, or PHS (Personal Handy- phone System：Personal handhold telephone system) etc., can be any of which.

In content providing system ex100, video camera ex113 etc. passes through base station ex109, telephone network ex104 and stream broadcasting Server ex103 connections, so as to carry out live distribution etc..In fact distribution, shot for user using video camera ex113 Coded treatment of content (such as the live image of the music) progress illustrated by above-mentioned each embodiment is (i.e. as the present invention's Picture coding device plays a role), and it is sent to stream broadcasting server ex103.In addition, stream broadcasting server ex103 is directed to The client filed a request, the distribution flowed to the content-data sent.As client, including it can decode above-mentioned It is encoded computer ex111, PDAex112, video camera ex113, portable phone ex114 and the game machine of the data of processing Ex115 etc..Each equipment for the data being distributed is being have received, the data to reception carry out decoding process and regenerate (i.e. conduct The picture decoding apparatus of the present invention plays a role).

Also, the coded treatment of the data shot can be carried out in video camera ex113, the transmission of data can also carried out The stream broadcasting server ex103 of processing is carried out, and can also mutually share progress.Equally, the decoding process for the data being distributed can To be carried out by client, it can also be carried out in stream broadcasting server ex103, can also mutually share progress.Also, it is not limited only to Video camera ex113, by the video camera ex116 Still image datas shot and/or motion image data, can also pass through meter Calculation machine ex111 and be sent to stream broadcasting server ex103.Coded treatment now can be in video camera ex116, computer Carried out in any one of ex111, stream broadcasting server ex103, can also mutually share progress.

Also, the LSI that these coded treatments and decoding process generally have in computer ex111 and each equipment (Large Scale Integration：Large scale integrated circuit) handle in ex500.LSIex500 can be by a chip structure Into can also be made up of multiple chips.Alternatively, it is also possible to by moving image encoding with and moving picture decoding software pacify Being attached to can be in certain recording medium (CD-ROM, floppy disk, hard disk etc.) of the readings such as computer ex111, and utilizes the software To carry out coded treatment and decoding process.Moreover, in the case where portable phone ex114 is to be accompanied with camera, can also Send the motion image data obtained by the camera.Motion image data in this case is by portable phone ex114 The LSIex500 being had carries out the data after coded treatment.

Also, stream broadcasting server ex103 is multiple servers or multiple computers or data is disperseed Ground processing, record, the device of distribution.

As previously discussed, in content providing system ex100, client can receive and regenerate data encoded. In such content providing system ex100, it can in real time be received in client and decode the information sent by user and energy Enough regeneration, so, even the user without special rights or equipment can also realize personal broadcasting.

Also, content provider system ex100 example is not limited only to, as shown in figure 26, in digital broadcasting system ex200 On can also assemble dynamic image encoding device (picture coding device) and the moving image solution shown in each above-mentioned embodiment Any one in code device (picture decoding apparatus).Specifically, multiplexed on broadcasting station ex201, image data The multiplexed data of music data is communicated or is transferred to satellite ex202 by electric wave.This image data is according to institute The dynamic image encoding method data encoded that each embodiment illustrates is stated (to be compiled according to the picture coding device of the present invention The data of code).It has received these broadcasting satellite ex202 and send electric wave for broadcast, these electric waves are by that can carry out satellite The antenna ex204 of the family of broadcast reception is received.The multiplexed data of reception is by television set (receiver) ex300 or machine top The devices such as box (STB) ex217 are decoded and regenerate (the picture decoding apparatus performance being related to as the scheme of the present invention Effect).

Also, many recorded in the recording medium ex215 such as DVD, BD (Blu-ray Disc) for reading and decoding Road multiplex data or reader/note that signal of video signal is encoded and then entered sometimes with the laggard row write of music signal multiplexing Record on device ex218, the moving image decoding apparatus or dynamic image encoding device shown in each above-mentioned embodiment can be also installed. In this case, the signal of video signal being reproduced can be displayed on monitor ex219, and can be by have recorded multiplexing The recording medium ex215 of data regenerates signal of video signal in other devices or system.Also, can also be by moving picture decoding Device is installed to the set top box ex217 being connected with the cable ex203 of cable television or the antenna ex204 of satellite/ground wave broadcast It is interior, and shown on the monitor ex219 of television set.At this point it is possible to be not assembled into set top box, and by moving image decoding apparatus It is assembled into television set.

Figure 27 shows the dynamic image decoding method and motion diagram that make use of and illustrate in each above-mentioned embodiment As television set (receiver) ex300 of coding method.Television set ex300 includes：Tuner ex301, by receiving above-mentioned broadcast Antenna ex204 or the acquisition such as cable ex203 or image output data on multiplexed the multiplexing number of voice data According to；Modulating/demodulating portion ex302, demodulates the multiplexed data received, or in order to by multiplexed data be sent to it is outside and It is modulated；And multiplexing/separation unit ex303, image data and voice data are divided into the multiplexed data of demodulation, Or multiplexed in the signal processing part ex306 image datas encoded and voice data.

Also, television set ex300 has signal processing part ex306 and output section ex309, the signal processing part ex306 With the sound signal processing for being decoded or being encoded respectively to each information to voice signal and signal of video signal respectively Portion ex304 and signal of video signal processing unit ex305 (are played as the picture coding device or picture decoding apparatus of the present invention and made With)；The output section ex309 has a loudspeaker ex307 exported to the voice signal that is decoded, and to being decoded The display part such as display that signal of video signal is shown ex308.And then, television set ex300 has interface portion ex317, the interface Portion ex317, which has, receives operation inputting part ex312 of operation input of user etc..And then, television set ex300, which has, is all together control The control unit ex310 in each portion, and to each portion provide electric power power circuit part ex311.Interface portion ex317, which is removed, to be had Have beyond operation inputting part ex312, there can also be the electric bridge being connected with the external equipment such as reader/writer ex218 Ex313, the socket ex314 for installing the recording medium such as SD card ex216, for what is be connected with the external recording medium such as hard disk The driver ex315 and modem ex316 that is connected with telephone network etc..Also, recording medium ex216 can be by depositing The semiconductor memery device of non-volatile/volatibility of storage enters the electrographic recording of row information.Television set ex300 each portion passes through Synchronous bus is connected with each other.

First, television set ex300 from the multiplexed data that obtains of outside decode by antenna ex204 etc. and again Raw composition is illustrated.Television set ex300 receive the user from remote controllers ex220 etc. operation, and according to CPU etc. control unit ex310 control, the multiplexed data that will be demodulated in modulating/demodulating portion ex302, multiplexing/point Separated from portion ex303.Also, television set ex300 is solved the voice data of separation in sound signal processing portion ex304 Code, using the coding/decoding method illustrated in the above embodiments, the image data of separation is carried out in signal of video signal processing unit ex305 Decoding.The voice signal and signal of video signal of decoding are output to outside from output section ex309 respectively.When being exported, in order to Make voice signal and signal of video signal synchronizing regeneration, and can temporarily accumulate these signals in buffer ex318, ex319 etc..And And, television set ex300 can not read multiplexed data from broadcast etc., but from recording mediums such as magnetic/CD, SD cards Multiplexed data is read in ex215, ex216.The composition that will be discussed below is, television set ex300 to voice signal and Signal of video signal is encoded, and is sent to composition that is outside or being written to recording medium etc..Television set ex300 receives from long-range The operation of controller ex220 etc. user, and according to control unit ex310 control, utilize what is illustrated in the above-described embodiment Coding method, in sound signal processing portion, ex304 is encoded to voice signal, and in signal of video signal processing unit ex305 to shadow As signal is encoded.The voice signal and signal of video signal being encoded are multiplexed in multiplexing/separation unit ex303, and It is output to outside.When being multiplexed, in order that voice signal and signal of video signal are synchronous, and can be temporary by these signals When accumulation to buffer ex320, ex321 etc..In addition, on buffer ex318 to ex321, can have as shown in the figure The composition of standby multiple or shared more than one buffer.Moreover, in addition to those shown in the figures, for example can modulation/ Between demodulation section ex302 and multiplexing/separation unit ex303 etc., as the overflow and the buffer portion of underflow of avoidance system, Accumulation data in buffer.

Also, television set ex300 is removed with voice data and image number of the acquisition from broadcast and recording medium etc. According to composition beyond, can also have a composition for the AV inputs for receiving microphone and video camera, and can also to from these The data of acquisition carry out coded treatment.Although also, above-mentioned coded treatment, multichannel can be carried out to television set ex300 herein The composition of multiplexing and outside output is illustrated, but can also, without above-mentioned whole processing, and only carry out Above-mentioned reception, decoding process and the outside composition exported.

Also, in the case where reader/writer ex218 reads from recording medium or writes multiplexed data, Above-mentioned decoding process or coded treatment can also enter in some of television set ex300 and reader/writer ex218 Row or television set ex300 and reader/writer ex218 share progress each other.

As an example, Figure 28 show from CD carry out data reading or write-in in the case of information regeneration/ Record portion ex400 composition.Information regeneration/record portion ex400 include will be discussed below key element ex401, ex402, ex403、ex404、ex405、ex406、ex407.Laser is irradiated to the recording medium ex215 as CD by optical head ex401 Recording surface and write information, and detect the recording surface from recording medium ex215 reflected light and read information.Modulation note Record portion ex402 carries out electric drive to the semiconductor laser for being built in optical head ex401, and carries out laser according to record data Modulation.Demodulation section ex403 is regenerated to the photodetector by being built in optical head ex401 to the reflected light from recording surface Regenerated signal obtained from carrying out electro-detection is amplified, the signal component for being recorded in recording medium ex215 is separated, Demodulation, and regenerate necessary information.Buffer ex404 is to in the recording medium ex215 information recorded and from note The information of recording medium ex215 regeneration is temporarily kept.Disc type electric machine ex405 rotates recording medium ex215.Servo control portion Optical head ex401 is moved to defined code by ex406 while the rotation driving to disc type electric machine ex405 is controlled Road, carries out the tracking process of the luminous point of laser.Systems control division ex407 carries out overall control to information regeneration/record portion ex400 System.Above-mentioned reading and write-in are handled and can realized by following method, i.e.,：Systems control division ex407 is utilized and protected The various information in buffer ex404 are held, and as required while carrying out the generation of new information and be additional, on one side Make modulation record portion ex402, regeneration demodulation section ex403 and servo control portion ex406 co-ordinations, while passing through optical head Ex401 enters the record regenerating of row information.Systems control division ex407 is for example constituted with microprocessor, by perform read and The program of write-in is handled to perform these.

More than, it is illustrated by taking optical head ex401 irradiation laser spots as an example, but near field optic can also be utilized (near-field optical) carries out highdensity record.

Figure 29 is the ideograph of the recording medium ex215 as CD.On recording medium ex215 recording surface, guide groove (groove) is formed helical form, on code track ex230 in advance be recorded shown according to the change of the shape of groove it is exhausted on disk To the address information of position.The address information includes being used to determine the information of record block ex231 position, record block ex231 It is the unit of record data, can be by regenerating code track ex230 and reading address in the device for being recorded and being regenerated Information, to determine record block.Also, recording medium ex215 includes：Data recording area ex233, inner region ex232 and Outer region ex234.Area for recording user data is data recording area ex233, is configured in data recording area It is special beyond the record of user data that ex233 inner circumferential or the inner region ex232 of periphery and outer region ex234 are used for Purposes.Information regeneration/record portion ex400 is directed to this recording medium ex215 data recording area ex233, is encoded Voice data, the read-write of image data or the multiplexed data after being multiplexed to these data.

It is illustrated, but is not limited by this by taking the CDs such as DVD, BD with a Rotating fields as an example above, can also It is the CD that can be recorded beyond surface of sandwich construction.Also, utilization can also be recorded on the same position of disk The information of the light of the color of various different wave lengths, or can be having from the layer of the different information of various angle recordings etc. Carry out the CD of the composition of the recording/reproducing of multidimensional.

, can be in the vehicle ex210 with antenna ex205 from satellite ex202 in addition, in digital broadcasting system ex200 Moving image is regenerated Deng reception data, and in the display device of the vehicle ex210 grades of Vehicular navigation system 211 having.In addition, closing It can contemplate into Vehicular navigation system ex211 composition and GPS receiving unit added in the composition shown in Figure 27, equally can also Consider on computer ex111 and portable phone ex114 etc..

Figure 30 A are to show to make use of in the dynamic image encoding method illustrated by the above embodiments and moving image solution The portable phone ex114 of code method figure.Portable phone ex114 has：Antenna ex350, for base station ex110 it Between carry out electric wave transmitting-receiving；Camera unit ex365, being capable of filmed image and rest image；Display part ex358, is to be used to show Camera unit ex365 shoot image and by antenna ex350 images received etc. be decoded after data liquid crystal display Device etc..Portable phone ex114 also has：Main part with operated key portion ex366, audio output unit ex357, are for defeated Go out loudspeaker of sound etc.；Sound input unit ex356, is for inputting microphone of sound etc.；Memory portion ex367, is used for Image, rest image, mail of the image shot, rest image, the sound of recording or reception etc. is preserved to be encoded or solved The data of code；Or equally be preserve data recording medium between interface socket ex364.

Further portable phone ex114 configuration example is illustrated using Figure 30 B.In portable phone ex114, For the master control part in each portion for being all together main part of the control with display part ex358 and operated key portion ex366 Ex360, power circuit part ex361, operation input control unit ex362, signal of video signal processing unit ex355, camera interface portion ex363、LCD(Liquid Crystal Display：Liquid crystal display) control unit ex359, modulating/demodulating portion ex352, multichannel Multiplexing/separation unit ex353, sound signal processing portion ex354, socket ex364 and memory portion ex367 are via bus Ex370 is connected with each other.

Power circuit part ex361 turns into conducting state in the operation by user as end of conversation and power key Under, by providing electric power from battery pack to each portion, so as to start portable phone ex114, become the shape that can be worked State.

Portable phone ex114 is according to the control by the master control part ex360 constituted such as CPU, ROM and RAM, in sound During call mode, digital sound will be converted in the sound input unit ex356 voice signals collected by sound signal processing portion ex354 Message number, and (Spread Spectrum) processing is spread in modulating/demodulating portion ex352, enter in transmission/reception unit ex351 After line number mould conversion process and frequency conversion process, sent via antenna ex350.Also, portable phone ex114 is in sound During sound call mode, go forward side by side line frequency conversion process and modulus are amplified to the reception data received by antenna ex350 Conversion process, in modulating/demodulating portion, ex352 carries out the inversely processing of spread processing, is converted to by sound signal processing portion ex354 After analoging sound signal, it is exported from audio output unit ex356.

Also, in the case of sending Email in data communication mode, pass through operated key portion ex366 of main part etc. The text data of Email that is transfused to of operation be sent to master control part ex360 via operation input control unit ex362. Master control part ex360, carries out spread processing to text data by modulating/demodulating portion ex352, is carried out in transmission/reception unit ex351 After digital-to-analogue conversion processing and frequency conversion process, base station ex110 is sent to via antenna ex350.Receiving Email In the case of, for reception data carry out with above-mentioned almost opposite processing, be sent to display part ex358.

In data communication mode in the case of transmission image, rest image or image and sound, signal of video signal processing unit Ex355, the signal of video signal that will be provided from camera unit ex365, the dynamic image encoding method represented according to each embodiment To be compressed coding (that is, being played a role as the picture coding device that is related to of a mode of the present invention), and it will be compiled The image data of code is sent to multiplexing/separation unit ex353.In addition, sound signal processing portion ex354, to camera unit In ex365 filmed images, rest image etc., encoded by the sound input unit ex356 voice signals collected, and will be encoded Audio data transmitting be sent to multiplexing/separation unit ex353.

In a prescribed manner, that comes to being provided from signal of video signal processing unit ex355 is compiled multiplexing/separation unit ex353 The image data of code and the voice data being encoded come from sound signal processing portion ex354 offers are multiplexed, will be logical Multiplexed data is carried out at spread spectrum in modulating/demodulating portion (modulation/demodulation circuit portion) ex352 obtained from crossing multiplexing Reason, and after transmission/reception unit ex351 carries out digital-to-analogue conversion processing and frequency conversion process, sent out via antenna ex350 Send.

In data communication mode, in the case of the data for receiving the motion pictures files for being linked at homepage etc., or In the case of receiving the Email for being added to image and/or sound, in order to decode the multichannel received via antenna ex350 Multiplex data, multiplexing/separation unit ex353 is divided into the bit stream harmony of image data by splitting multiplexed data The bit stream of sound data, signal of video signal processing unit ex355 is supplied to via synchronous bus ex370 by the image data being encoded, And the voice data being encoded is supplied to sound signal processing portion ex354.Signal of video signal processing unit ex355 according to it is described The corresponding dynamic image decoding method of dynamic image encoding method for respectively implementing to exemplify is decoded to decode signal of video signal (that is, being played a role as the picture decoding apparatus of the present invention), example is shown by LCD control units ex359 in display part ex358 Image, the rest image included in the motion pictures files for being such as linked at homepage.In addition, sound signal processing portion ex354 is solved Code voice signal, sound is exported from audio output unit ex357.

It is to have to compile except being considered that also, the terminals such as above-mentioned portable phone ex114 are same with television set ex300 Beyond the form of the transmitting-receiving letter type terminal of code device and decoder both sides, it is also contemplated that to being that only the transmission with encoder is whole End, and only totally three kinds of forms of the receiving terminal with decoder.Also, foregoing describe in digital broadcasting system Ex200, receives and is sent in the multiplexed data that music data etc. has been multiplexed on image data, but can remove Multiplexed beyond voice data about the lteral data of image etc. data or image data in itself, without It is multiplexed data.

So, above-mentioned appoint can be applied in the method for encoding images or picture decoding method shown in the above embodiments One equipment and system, in such manner, it is possible to the effect illustrated in the above-described embodiment.

In addition, the present invention is not limited by embodiment described above, the scope of the present invention can not departed from and carried out each Plant deformation or change.

(embodiment 8)

Can suitably switch as required dynamic image encoding method or device shown in each above-mentioned embodiment with The dynamic image encoding method or device of the standard different according to MPEG-2, MPEG4-AVC, VC-1 etc., to generate image number According to.

Herein, in the case where the respective different standard of basis generates multiple image datas, it is necessary to be selected in decoding Select coding/decoding method corresponding with respective standard.However, the image data to be decoded can not be recognized according to which standard Data, so problem as appropriate coding/decoding method can not be selected by producing.

Can be multiplexed data that voice data etc. has been multiplexed on image data to solve this problem Composition comprising identification information, the identification information represents which standard image data is according to.Explanation is included by above-mentioned below Each embodiment shown in dynamic image encoding method or device generation image data multiplexed data specific structure Into.Multiplexed data is the digital stream of mpeg 2 transport stream form.

Figure 31 is the figure for the composition for representing multiplexed data.Multiplexed data as shown in figure 22 is by such as flowing down In more than one multiplexed obtained from data：Video flowing, audio stream, caption stream (presentation graphics：PG), interactive graphic stream (interactive graphics stream).Video flowing represents the main image of film And subpictures, audio stream (IG) represents the master voice part of film and the secondary sound that mix with master voice, and caption stream represents electric The captions of shadow.Herein, main image represents the common image shown in picture, and subpictures refer in main image with small picture The image of display.Further, interactive graphic stream shows the dialogue by configuring graphical user interface elements on picture and being made Picture.Video flowing, dynamic image encoding method or device according to each above-mentioned embodiment, and conventional MPEG- 2nd, the dynamic image encoding method or device of the standard such as MPEG4-AVC, VC-1 are encoded.Audio stream, according to Dolby AC-3, The mode such as Dolby Digital Plus, MLP, DTS, DTS-HD or linear PCM is encoded.

Each stream included in multiplexed data is identified by PID.For example, for the video flowing of the image for film 0x1011 is distributed, for audio stream distribution from 0x1100 to 0x111F, is matched somebody with somebody for subtitle stream from 0x1200 to 0x121F, for Interactive graphic stream distribute from 0x1400 to 0x141F, for the subpictures for film video flowing distribution from 0x1B00 to 0x1B1F, for the secondary sound for being mixed with master voice audio stream distribution from 0x1A00 to 0x1A1F.

Figure 32 is to represent the ideograph how multiplexed data is multiplexed.First, it is made up of multiple frame of video Video flowing ex235, the audio stream ex238 being made up of multiple audio frames, be transformed to respectively PES packet row ex236 and Ex239, is transformed to TS packets ex237 and ex240.Similarly by caption stream ex241 and interactive graphics ex244 number According to being transformed to PES packet row ex242 and ex245 respectively, be further transformed to TS packets ex243 and ex246.It is many These TS packets are multiplexed in 1 stream and are above configured by road multiplex data ex247.

Figure 33 is to represent the how stored figure of video flowing in PES packets are arranged in further detail.The first of Figure 33 Section shows the frame of video row of video flowing.Second segment shows that PES packets are arranged.Such as Figure 33 arrow yy1, yy2, yy3, shown in yy4, As the I pictures of multiple Video Presentation Unit in video flowing, B pictures, P pictures are divided by each picture Cut, store into the pay(useful) load of PES packets.Each PES packet possesses to be stored as picture in PES heads, PES Show PTS (the Presentation Time-Stamp at moment：Presentation Time Stamp), be used as picture decoding the moment DTS (Decoding Time-Stamp：Decoded time stamp).

Figure 34 shows to be eventually written the form of the TS packets in multiplexed data.TS packets are that have identification The 188Byte that the 4Byte of the PID of stream etc. information TS heads and the 184Byte of data storage TS pay(useful) loads are constituted The packet of fixed length, the PES packets are stored in TS pay(useful) loads.In the case where being BD-ROM, TS data Coating assigns 4Byte TP_Extra_Header, constitutes 192Byte source data packet, is written to multiplexed data. ATS (Arrival_Time_Stamp) etc. information is described on TP_Extra_Header.ATS represents the TS packets to solution The transmission start time of the pid filter of code device.Source data packet is arranged as shown in Figure 25 hypomere in multiplexed data, The increased numbering of beginning from multiplexed data is referred to as SPN (source packet number).

In addition, in addition to except image, sound, captions etc., each flows in the TS packets included in multiplexed data, also There are PAT (Program Association Table：Program Association Table), PMT (Program Map Table：Program map Table), PCR (Program Clock Reference：Timer reference of programs) etc..Pat table shows what is utilized in multiplexed data What PMT PID is, PAT itself PID is registered as 0.PMT has the image included in multiplexed data, sound, captions Deng each stream PID and the attribute information of stream corresponding with each PID, and with relevant with multiplexed data each Plant descriptor.Descriptor has copy control information etc., and the copy control information indicates the copy permission, no of multiplexed data License.PCR is in order that the ATC (Arrival Time Clock) of time shaft as ATS and the time shaft as PTS, DTS STC (System Time Clock) is synchronous, with the STC times corresponding with the ATS that the PCR data bag is transferred to decoder Information.

Figure 35 is to explain the figure that PMT data are constituted.PMT beginning is provided with PMT heads, for recording the PMT In the length of data that includes etc..After which there is provided multiple descriptors relevant with multiplexed data.Above-mentioned duplication control Information processed etc. is described as descriptor.There is provided multiple have with each stream that included in multiplexed data after descriptor The stream information of pass.Stream information, the compression coding and decoding in order to recognize stream etc., by the attribute letter for describing stream type, the PID of stream, stream The flow descriptors of breath (frame rate, aspect ratio etc.) are constituted.The quantity of flow descriptors present in multiplexed data with flowing Quantity it is identical.

Recording medium etc. record in the case of, above-mentioned multiplexed data together with multiplexed data message file by Record.

Multiplexed data message file as shown in figure 36 is the management information of multiplexed data, with multiplexed data 1 pair of 1 ground correspondence, it is made up of multiplexed data information, stream attribute information and item mapping (entry map).

Multiplexed data information as shown in figure 36, by system velocity, regenerates start time, regeneration ending moment institute's structure Into.System velocity represents multiplexed data towards the peak transfer rate of the pid filter of System Target Decoder described later. The ATS included in multiplexed data interval, is set to be below system velocity.Regeneration start time is multiplexing number According to beginning frame of video PTS, the regeneration ending moment is set to, in the PTS of the frame of video of the tail end of multiplexed data Plus the regeneration intervals of 1 frame.

Stream attribute information as shown in figure 37, the attribute for each stream being included in multiplexed data is registered by each PID Information.Attribute information is according to each video flowing, audio stream, caption stream, interactive graphic stream, with different information.Video flowing Attribute information has following information：The video flowing is compressed, constituted each picture number of video flowing with what kind of compression coding and decoding According to resolution ratio be how many, aspect ratio be how many, the frame rate information such as be how many.Audio stream attribute information, with following information： The channel number that the audio stream is compressed with what kind of compression coding and decoding, included in the audio stream is how many, it is corresponding with what language, The information such as sample frequency is how many.These information, for initialization of the decoder before player regenerates etc..

In the present embodiment, the stream type included in the PMT in the multiplexed data is utilized.In addition, in recording medium In have recorded multiplexed data in the case of, utilize the video flowing attribute information included in multiplexed data information.Specifically For, in the dynamic image encoding method or device that each above-mentioned embodiment is represented, for the stream type that is included in PMT or The step of video flowing attribute information, information for setting setting intrinsic or unit, the intrinsic information are represented by each above-mentioned implementation The image data that the dynamic image encoding method or device exemplified is generated.According to this composition, can recognize by it is described each The image data that the dynamic image encoding method or device that embodiment is represented are generated and the image data according to other standards.

In addition, Figure 38 is represented the step of the dynamic image decoding method of the present embodiment.In step exS100, answered from multichannel With the video flowing attribute information that the stream type included in PMT is obtained in data or is included in multiplexed data information.Connect , in step exS101, judge that stream type or video flowing attribute information indicate whether the fortune represented by each described embodiment The multiplexed data that moving picture encoding method or device are generated.Moreover, being judged as stream type or video flowing attribute information In the case that expression is the data that the dynamic image encoding method or device represented by each described embodiment is generated, in step ExS102, the dynamic image decoding method that each embodiment is represented is decoded.In addition, stream type or video flowing attribute information In the case that expression is the data of conventional MPEG-2, MPEG4-AVC, VC-1 etc. standard, in step exS103, according to The dynamic image decoding method of the conventional standard of institute's foundation is decoded.

So, by setting new eigenvalue in stream type or video flowing attribute information, so as in decoding, can interpolate that Whether the dynamic image decoding method or device represented according to each described embodiment can decode that.So as to be transfused to immediately During multiplexed data according to different standards, appropriate coding/decoding method or device can be also selected, therefore, it is possible to not produce Mistakenly decoded.In addition, dynamic image encoding method or device that the present embodiment is represented, or dynamic image decoding method Or device, above-mentioned any one equipment and system can be used in.

(embodiment 9)

Dynamic image encoding method and device, dynamic image decoding method and dress shown in each above-mentioned embodiment Put, can typically be realized using the LSI as integrated circuit.As an example, Figure 39, which is shown, is made into a chip LSIex500 composition.LSIex500 includes the key element ex501 to ex509 that will be discussed below, and each key element passes through bus Ex510 connections.Power circuit part ex505 is in the case where power supply is open mode, by providing electric power to each portion, so as to open Move the state for that can work.

For example, in the case where carrying out coded treatment, LSIex500, according to CPUex502, Memory Controller Ex503, stream controller ex504, driving frequency control unit ex512 etc. control unit ex501 control, according to AV input and output Ex509 inputs AV signals from microphone ex117 and video camera ex113 etc..The AV signals being transfused to arrive SDRAM etc. by temporary transient accumulation Outside memory ex511.According to control unit ex501 control, the data of storage are appropriate according to treating capacity and processing speed Ground be divided into it is multiple be sent to signal processing part ex507, signal processing part ex507 by the coding of carry out voice signal and/or The coding of signal of video signal.Herein, the coded treatment of signal of video signal is the coded treatment that each described embodiment illustrates.In signal Processing unit ex507 to the voice data being encoded and the image data being encoded multiplex etc. always according to situation Reason, outside is output to from stream input and output ex506.The multiplexed data being output is sent to base station ex107, or by It is written to recording medium ex215.Also, in order to can synchronously be carried out in multiplexing, and data can temporarily be accumulated Buffer ex508.

Although being illustrated in addition, being constituted above to memory ex511 as LSIex500 outside, but can also It is included in LSIex500 inside.Buffer ex508 can also be not limited to one, can possess multiple buffers.Also, LSIex500 can be made into a chip or multiple chips.

In addition, in the above description, control unit ex501 has CPUex502, Memory Controller ex503, stream controller Ex504, driving frequency control unit ex512 etc., but, control unit ex501 composition are not limited to this composition.For example, it may be Signal processing part ex507 is also equipped with CPU composition.By being also provided with CPU in signal processing part ex507 inside, place can be made Speed is managed to improve.In addition, can be that CPUex502 possesses signal processing part ex507 or possesses signal as other examples The composition in a processing unit ex507 part such as sound signal processing portion.In this case, control unit ex501 is that possess Signal processing part ex507 or the composition with part thereof of CPUex502.

Herein, although exemplified with LSI, but according to the difference of integrated level, be referred to as IC, system LSI, super LSI, Extremely super LSI.

Further, the method for integrated circuit is not limited to LSI, can also be with special circuit or general processor come real It is existing.Programmable field programmable gate array (FPGA: the Field Programmable after LSI manufactures can also be utilized Gate Array) or dynamically reconstruct LSI inside circuit unit connection and setting reconfigurable processor.It is such can Programmed logic device, typically loads or is read in from memory etc. the program for constituting software or firmware, so as to hold Dynamic image encoding method or dynamic image decoding method that each described implementation of row is exemplified.

Moreover, progress or derivative other technologies with semiconductor technology, if LSI collection can be replaced by occurring in that Into circuit technology, naturally it is also possible to functional block is carried out using these technologies integrated.It is possible to be applicable biotechnology Deng.

(embodiment 10)

The image data generated in the dynamic image encoding method or device to being represented according to each described embodiment enters Row decoding in the case of, it is contemplated that with to the image data according to standards such as conventional MPEG-2, MPEG4-AVC, VC-1 Situation about being decoded is compared, treating capacity increase.Therefore, setting ratio decoder is needed in LSIex500 according to conventional standard The high driving frequency of the driving frequency of CPUex502 during image data.But driving frequency is high, then produce power consumption it is high this The problem of sample.

In order to solve this problem, if the moving image decoding apparatus such as TV ex300, LSIex500 is following composition, know Other image data is according to which standard, according to the composition of standard switching driving frequency.Figure 40 represents the composition in the present embodiment ex800.Driving frequency switching part ex803, is the dynamic image encoding method represented by each described embodiment in image data Or in the case that device is generated, set high driving frequency.Moreover, to performing the moving image that each described embodiment is represented The decoding process portion ex801 of coding/decoding method is indicated, to decode image data.On the other hand, image data be according to Toward standard image data situation in the case of, each implement the moving image encoding side that exemplifies by described with image data The situation that method or device are generated is compared, and sets low driving frequency.Moreover, indicating the decoding process portion according to conventional standard Ex802, is decoded to image data.

More specifically, driving frequency switching part ex803 by Figure 39 CPUex502 and driving frequency control unit ex512 institute Constitute.In addition, the decoding process portion ex801 for the dynamic image decoding method that each described implementation is exemplified is performed, and foundation The decoding process portion ex802 of conventional standard, the signal processing part ex507 equivalent to Figure 39.CPUex502 recognizes image data According to which standard.Moreover, according to the signal from CPUex502, driving frequency control unit ex512 setting driving frequencies.This Outside, according to the signal from CPUex502, signal processing part ex507 carries out the decoding of image data.Herein, it may be considered that The identification information for example recorded in embodiment 8 is utilized in the identification of image data.Relevant identification information, is not limited only in embodiment 8 information recorded, just can be with according to the information of which standard as long as can recognize that image data is.For example, according to identification Whether image data is used for TV, if for the external signal of disk etc., which standard can recognize image data is according to In the case of, it can be identified according to such external signal.In addition, the selection of the driving frequency in CPUex502, Ke Yikao Worry carries out the corresponding list of standard and driving frequency of image data according to for example as Figure 33.List is pre- In the built-in storage for being first stored in buffer ex508 and LSI, this list is referred to by CPUex502, driving can be selected Frequency.

The step of Figure 41 shows the method for implementing the present embodiment.First, in step exS200, by signal processing part Ex507 obtains identification information from multiplexed data.Then, in step exS201, CPUex502 knows according to identification information The data that the coding method or device whether other image data is exemplified by each described implementation are generated.It is in image data Under the data cases that the coding method or device exemplified by each described implementation is generated, in step exS202, it will set The signal of high driving frequency, driving frequency control unit ex512 is sent to by CPUex502.Moreover, in driving frequency control unit Ex512 sets high driving frequency.On the other hand, showing it is according to conventional MPEG-2, MPEG4-AVC, VC-1 etc. Standard image data in the case of, in step exS203, the signal of low driving frequency will be set, sent out by CPUex502 It is sent to driving frequency control unit ex512.Moreover, in driving frequency control unit ex512, setting is with image data by each described reality Apply the situation that the coding method exemplified or device generated and compare low driving frequency.

In addition, linked with the switching of driving frequency, by changing to LSIex500 or the device comprising LSIex500 applies Voltage, power saving effect can be improved.For example, in the case where setting low driving frequency, therewith with setting high driving frequency Situation is compared, it may be considered that the voltage that to LSIex500 or the device comprising LSIex500 applies is set as low-voltage.

In addition, the establishing method on driving frequency, as long as in the case that treating capacity in decoding is big, setting high drive Dynamic frequency, in the case that treating capacity in decoding is small, setting low driving frequency just can be to be not limited to above-mentioned setting side Method.The treating capacity for example decoded to the image data according to MPEG4-AVC standards, more than to by each described embodiment In the case of the treating capacity that the image data that the dynamic image encoding method or device shown is generated is decoded, it may be considered that The setting of driving frequency is carried out on the contrary with above-mentioned situation.

In addition, the establishing method of driving frequency is not limited to the composition for making driving frequency be set to low.For example, it may be considered that knowing Other information show be the image data generated by described each dynamic image encoding method for exemplifying of implementation or device feelings Under condition, to LSIex500 or the device comprising LSIex500 apply voltage be set as high voltage, showing be according in the past MPEG-2, MPEG4-AVC, VC-1 etc. standard image data in the case of, to LSIex500 or include LSIex500 Device apply voltage be set as low voltage.In addition, being used as other examples, it may be considered that identification information show be by In the case of the image data that the dynamic image encoding method or device that each described implementation is exemplified are generated, do not stop CPUex502 driving, show be standard according to conventional MPEG-2, MPEG4-AVC, VC-1 etc. image data In the case of, because processing has surplus, CPUex502 driving can be temporarily ceased.Show it is by described each even in identification information In the case of the image data that the individual dynamic image encoding method or device for implementing to exemplify is generated, if processing has surplus, It is also contemplated that temporarily ceasing CPUex502 driving.In the case of this, it may be considered that show it is according in the past with identification information MPEG-2, MPEG4-AVC, VC-1 etc. the situation of image data of standard compare, dwell time sets shorter.

So, switching driving frequency is carried out according to the standard of image data foundation, so as to reach power saving.In addition, In the case of device using battery power LSIex500 or comprising LSIex500, as power saving can also extend the longevity of battery Life.

(embodiment 11)

The above-mentioned equipment and system such as TV and portable phone, are transfused to multiple images according to various criterion sometimes Data.So, it can also be decoded in the case of multiple image datas according to various criterion have been transfused to, so that LSIex500 signal processing part ex507 needs corresponding with multiple standards.But, signal processing part corresponding with each standard When ex507 is not utilized, LSIex500 circuit scale is become big, also produce the such problem of cost increase.

Can be following composition to solve above-mentioned problem, by for performing the motion diagram that each described implementation is exemplified Decoding process portion and the decoding process of the standard according to conventional MPEG-2, MPEG4-AVC, VC-1 etc. as coding/decoding method Portion, carries out a part shared.Figure 43 A ex900 shows this composition example.For example, the moving image that each described implementation is exemplified Coding/decoding method and the dynamic image decoding method according to MPEG4-AVC standards, entropy code, re-quantization, deblock and wave filter, In the processing such as motion compensation, a part of process content is common.On common process content, it may be considered that it is shared with The corresponding decoding process portion ex902 of MPEG4-AVC standards, it is distinctive on the present invention not corresponding with MPEG4-AVC standards Other process contents, are constituted using as special decoding process portion ex901.Especially in a scheme of the invention, entropy Decoding has feature, as follows so as to consider, such as special decoding process portion ex901 is utilized in entropy decoding, in addition Re-quantization, deblocking filter, decoding process portion is shared in the processing of any or all of motion compensation.For decoding process Sharedization in portion, on common process content, shares for performing the moving picture decoding side that each described implementation is exemplified The decoding process portion of method, on the distinctive process content of MPEG4-AVC standards, uses special decoding process portion.

In addition, Figure 43 B ex1000 shows the other examples of the partial sharing of processing.In the composition of this example It is, using special with the distinctive corresponding special decoding process portion ex1001 of process content of the invention and other standards in the past The corresponding special decoding process portion ex1002 of some process contents, the dynamic image decoding method with the present invention and it is other with Toward the corresponding shared decoding process portion ex1003 of the common process content of the dynamic image decoding method of standard.Herein, Special decoding process portion ex1001, ex1002, is not necessarily the present invention or other conventional distinctive process content institutes of standard are special Have, can be the portion for being able to carry out other general procedures.In addition it is also possible to be the structure that the present embodiment is installed in LSIex500 Into.

So, a scheme on the present invention is related to ground dynamic image decoding method and the moving image of conventional standard The common process content of coding/decoding method, by sharing decoding process portion, can make LSI circuit scale diminish, and can subtract Few cost.

Industrial applicibility

The present invention can be applied to method for encoding images, picture decoding method, picture coding device and picture decoding apparatus. In addition, the present invention can be used in the various uses such as the storage, transmission, communication of data.For example, the present invention can be used in TV The presentation of information such as machine, digital VTR, auto-navigation system, portable phone, digital picture camera and digital camera are set Standby and picture pick-up device.

Symbol description

200 picture coding devices

205 subtracters

210 conversion and quantization unit

220 entropy code portions

230,420 re-quantizations and inverse transformation portion

235,425 adders

240,430 de-blocking filters

250,440 memories

260,450 infra-frame prediction portions

270 motion detecting sections

280,460 dynamic compensating units

290,470 switch switch within the frame/frames

400 picture decoding apparatus

410 entropy decoding portions

Claims (2)

1. a kind of method for encoding images, stream is encoded, including：

First generation step, generates burst restricted information, and the burst restricted information is shown for will be many obtained from picture segmentation Whether the filtering process of the slice boundaries of adjacent burst is restricted in individual burst；

First storage step, sequence parameter set is stored in by the burst restricted information；

Second generation step, for each generation filtering information of multiple slice boundaries, the filtering information is shown for described Whether slice boundaries perform filtering process；And

Multiple filtering informations are stored in image parameters collection by the second storage step；

In second generation step, in the case of the burst restricted information shows that the filtering process is conditional, generation The multiple filtering information of identical content is shown, the identical content is to perform the filtering process and do not perform the filter Any one party in ripple processing.

2. a kind of picture coding device, stream is encoded, including：

First generating unit, generates burst restricted information, and the burst restricted information is shown for will be multiple obtained from picture segmentation Whether the filtering process of the slice boundaries of adjacent burst is restricted in burst；

First storage part, sequence parameter set is stored in by the burst restricted information；

Second generating unit, for each generation filtering information of multiple slice boundaries, the filtering information is shown for described point Whether sheet border performs filtering process；And

Multiple filtering informations are stored in image parameters collection by the second storage part；

Second generating unit, in the case of the burst restricted information shows that the filtering process is conditional, generation is shown The multiple filtering information of identical content, the identical content is to perform the filtering process and do not perform at the filtering Any one party in reason.