CN100518304C - Decoding method related to audio information packet loss - Google Patents
Decoding method related to audio information packet loss Download PDFInfo
- Publication number
- CN100518304C CN100518304C CN 200510030220 CN200510030220A CN100518304C CN 100518304 C CN100518304 C CN 100518304C CN 200510030220 CN200510030220 CN 200510030220 CN 200510030220 A CN200510030220 A CN 200510030220A CN 100518304 C CN100518304 C CN 100518304C
- Authority
- CN
- China
- Prior art keywords
- video information
- vop
- information packets
- mentioned
- packets
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Abstract
To decode currently inputted packet, the decode method comprises: 1) deciding if the header of video packet has HEC (header extension code); 2) if yes, then saving the HEC; 3) using a fixed value of the HEC, deciding if the currently inputted packet and the previously inputted packet belong to same frame; 4) according the result, decoding the currently inputted packet by using a frame same with the previous packet or a new frame.
Description
Technical field
The present invention be about with the technology of audio information packet loss corresponding decoding method, be meant a kind of corresponding MPEG-4 (the Motion Picture Experts Group-4) invention that coding/decoding method is relevant of video request program (the VOD:Video On Demand) service that utilizes wireless Internet especially with audio information packet loss.
Background technology
Fig. 1 is the schematic diagram that roughly constitutes of the VOD service system of the existing wireless Internet of expression utilization, and Fig. 2 is the schematic diagram of expression at the VOD agreement formation of VOD service.
At first, above-mentioned VOD service is the abbreviation of Video On Demand, according to user's requirement, provides the images serve project of the novel notion of image basis services such as film or news by telephone wire or cable.Above-mentioned VOD service is the digitlization of video frequency program boil down to, is stored in video server, utilizes high-speed communicating network, provides desired service to the user.The user can operate selection, broadcast, control, index, search, the query of program
Recently, the wireless Internet by CDMA1x and EVDO (Evolution Data Only) and so on provides above-mentioned VOD service in real time.
If with reference to Fig. 1 explanation, the VOD service system of utilizing existing wireless Internet is that the most terminating machines 140 that join wireless internet network 120 constitute with the VOD server 100 that the VOD service is provided with for providing of above-mentioned VOD service is provided.
Here, for the VOD that utilizes wireless Internet is provided by above-mentioned VOD server 100 service, utilize the MPEG-4 encoder, image or moving video conversion that above-mentioned server 100 is made are the bit stream (bitstream) of compression, move packetized (packetization) process afterwards to above-mentioned bit stream, after appending heading message, be transferred to packet network at packet network (being wireless internet network) transmission.
Promptly, if with reference to Fig. 2 explanation, aspect the VOD server, after mobile (Streaming) content of MPEG-4 encoder encodes, to by the bit stream of its compression, utilize realtime transmission protocol RTP (Real-timeTransport Protocol), behind the operation packetized, utilize user datagram protocol UDP (User DatagramProtocol) and IP (Internet Protocol), be transferred to terminal.
To above-mentioned situation, aspect above-mentioned receiving terminal machine, eliminate IP, UDP, RTP title, and packetize and MPEG-4 decoding are separated in operation with its inverted order.
In addition, real-time streaming protocol RTSP (Real-time Streaming Protocol) is for the selection of this content, the control of playing, stop, recording and so on, by transmission control protocol TCP (Transmission ControlProtocol), IP communicates with terminating machine.
Fig. 3 a and Fig. 3 b are exemplary plot of expression MPEG-4 packet infrastructure and MPEG-4 video information pack arrangement.
At first, common MPEG-4 packet infrastructure like that, flows formation with fail to be sold at auction topic (VOS/VO/VOL/VOP) and MPEG-4 of RTP title and MPEG-4 shown in Fig. 3 a.
Here, being included in the fail to be sold at auction video object plane VOP (Video Object Plane) of topic of above-mentioned MPEG-4 and being meant all information that are intended to represent a frame, is to constitute with VOP title and VOP data.
Have in the above-mentioned VOP title and be intended to represent a frame and the information of needs, an above-mentioned frame is with the unit of the 16*16 size that is called macro block (Macro block) separately.
Such as, the QCIF form of 176*144 size is to be divided into 11*9 macro block, can have the macro block numbering between the 0-98.
In general, MPEG-4 stream is that a frame information is divided into more than one packets of information, transmit, if but constitute average information bag generation loss in a plurality of packets of information of a frame, process in decoding, which macro block data is the packets of information packets of information afterwards that just can not understand fully above-mentioned loss belong to, and therefore will abandon.
In order to prevent such phenomenon, the MPEG-4 specification has proposed video information packets, and it constitutes shown in Fig. 3 b.
The video information packet header has macro block numbering (macro block_number), therefore, even the intermediate video packets of information generation loss in a plurality of video information packets of formation-individual frame, also can know macro block data that next video information packets has on earth from where, can be with the data representation frame of packets of information after it with this.
But, just there is such problem, i.e. two phenomenons that the frame video information packets is decoded with a frame if use said method.
When frame is divided into a plurality of packets of information transmission, if belong to the packets of information of same number of frames, be problem not to take place just, but the packets of information that belongs to mutual different frame is judged as same number of frames with the same number of frames above-mentioned packets of information of decoding, and when decoding with same number of frames, the generation problem.
Promptly, if successional audio information packet loss takes place between two frames, loss video information packets before takes place do not have repetition with the macro block numbering (macro block_number) that loss video information packets afterwards takes place, only stating two video information packets just decodes with a frame, finally cause its whole frame number to reduce, and image quality is low.
Even above-mentioned two frames are when belonging to diverse picture, and two half pictures have diverse shape.To this situation be described by Fig. 4.
That is the schematic diagram that may go wrong when, Fig. 4 is expression use video information packets.When the picture on picture on the T frame and the T+1 frame is different,, just as shown in the figure, just as blackening partly, represent the field of video information packets generation loss in the middle of its picture if decode with a frame.
Therefore, carry out MPEG-4 when decoding, need be intended to prevent that two frame video information packets causing because of such audio information packet loss are with a frame the decode processing and the handled means of phenomenon.
Summary of the invention
The objective of the invention is to address the above problem, provide such coding/decoding method: the mpeg decode mistake that causes for the audio information packet loss of dealing with when using the VOD service of wireless Internet, with the video information packet header together information transmitted be used for MPEG-4 decoding, correct the MPEG-4 decoding error that the continuity audio information packet loss causes, can improve a kind of of image quality and audio information packet loss corresponding decoding method with this.
To achieve these goals, of the present invention and audio information packet loss corresponding decoding method are as described in the coding/decoding method of the video-on-demand service of utilizing wireless internet network, comprise the steps to be characteristics: the step that the packets of information of present input is unpacked; Unpack by above-mentioned, confirm whether the video information packet header exists header extension codes information, if there is HEC, with regard to the step that stores; The certain value that utilizes above-mentioned HEC information to possess judges whether the packets of information of the packets of information of input now and input before this belongs to the step of same number of frames; According to above-mentioned judged result, the step of packets of information same number of frames that the packets of information of above-mentioned present input is decoded as and imports before this or new frame.
Here, the certain value that possesses of above-mentioned HEC information is vop_time_incremcnt value and/or vop_coding_type value.
In addition, what judge whether the packets of information of the packets of information of above-mentioned present input and input before this belong to same number of frames is to depend on whether the vop_time_increment value of video information packets of above-mentioned present input and/or vop_coding_type value are all characteristics mutually with packets of information vop_time_increment value and/or the vop_coding_type value imported before this.
Promptly, if the video information packets of above-mentioned present input and the comparison value (vop_time_increment value, vop_coding_type value) of the video information packets of input is identical before this, just with the decode video information packets of above-mentioned present input of the video information packets same number of frames of importing before this;
If the video information packets of above-mentioned present input and the comparison value (vop_time_increment value, vop_coding_type value) of the video information packets of input is inequality before this, just the video information packets with the different new above-mentioned present input of frame decoding of the video information packets imported before this is characteristics.
The present invention is the invention about the MPEG-4 corresponding with audio information packet loss on the video-on-demand service of utilizing wireless Internet (Motion Picture Experts Group-4) coding/decoding method, its characteristics are, in order to deal with the MPEG-4 decoding error that audio information packet loss causes, the vop_time_increment that above-mentioned video information packets heading message is comprised, the category information of vop_coding_type is used for the MPEG-4 decoding, correct the MPEG-4 decoding error, deal with the coding/decoding method of the audio information packet loss that can improve image quality with this.
When the wireless environment generation packets of information loss of wireless Internet and so on of video-on-demand service is provided, the tendency that exists above-mentioned packets of information loss to recur.
The present invention is when above-mentioned successional audio information packet loss takes place, in order to understand fully that it is the video information packets that belongs to different frame that loss video information packets and generation loss video information packets afterwards before takes place, still the video information packets that belongs to same number of frames utilizes the HEC information of video information packet header to be characteristics.
Effect of the present invention:
According to of the present invention and audio information packet loss corresponding decoding method, when the VOD service that utilizes wireless Internet is provided, the image quality that audio information packet loss is caused lowly is reduced to minimum, has such strong point with this, promptly not only the MPEG-4 decoder is used for VOD image and the telephone service terminating machine of packets of information for the basis, also make its MPEG-4 decoder that is used for using VOD player and so on, can enlarge the strong point of the scope of application based on the computer of the Internet.
For further specifying above-mentioned purpose of the present invention, design feature and effect, the present invention is described in detail below with reference to accompanying drawing.
Description of drawings
Fig. 1 is the schematic diagram that roughly constitutes of the VOD service system of the existing wireless Internet of expression utilization.
Fig. 2 is the schematic diagram of expression at the VOD agreement formation of VOD service.
Fig. 3 a and Fig. 3 b are exemplary plot of expression MPEG-4 packet infrastructure and MPEG-4 video information pack arrangement.
The schematic diagram that Fig. 4 may go wrong when being expression use video information packets.
Fig. 5 is the schematic diagram of an embodiment of HEC structure of the video information packet header in the expression MPEG-4 video information pack arrangement.
Fig. 6 is the embodiment of the invention and the precedence diagram audio information packet loss corresponding decoding method of expression.
Embodiment
Be elaborated with the embodiment audio information packet loss corresponding decoding method to of the present invention below with reference to accompanying drawings.
Fig. 5 is the schematic diagram of an embodiment of the HEC structure of the video information packet header in the expression MPEG-4 video information pack arrangement.
During essential video object plane (VOP) the heading message generation loss that arrives, the purposes of the video object plane heading message of above-mentioned header extension codes HEC (Header Extension code is hereinafter to be referred as HEC) the above-mentioned as an alternative generation loss of information was used when each frame began.At this moment, above-mentioned video object plane is as by Fig. 3 a explanation, be included in the MPEG-4 topic of failing to be sold at auction, be meant all information that are intended to represent a frame, it constitutes with video object plane title and video object plane data, above-mentioned video object plane title has and is intended to represent a frame and required information, an above-mentioned frame be with the 16*16 size than the subsection macro block separately.
Constitute in the factor of above-mentioned HEC, vop_time_increment represent 1 second at interval in, the value of the incremental time that each frame has.
The above-mentioned vop_time_increment value that all frames of representing in the interval in promptly 1 second have is all different.
In addition, constitute in the factor of above-mentioned HEC, it is to belong to the I-frame that vop_coding_type plays the present frame of expression, still belongs to the effect of P-frame.
That is, if belong to the video information packets of same number of frames, (vop_time_increment vop_coding_type) should be identical for above-mentioned two information.
The present invention is to use above-mentioned information, an even difference in above-mentioned two values of information that two video information packets that compare are guaranteed respectively, also be judged as above-mentioned two video information packets and have different frame information mutually, be decoded as characteristics with mutual different frame.
When a frame is divided into the transmission of a plurality of packets of information, if belong to the packets of information of same number of frames, be what problem not to take place just, but the packets of information that belongs to mutual different frame is judged as same number of frames with the same number of frames above-mentioned packets of information of decoding, when decoding with same number of frames, the generation problem.These characteristics are in order to overcome this problem.
Promptly, when successional audio information packet loss takes place between two frames, relatively to the loss video information packets before and the above-mentioned information (vop_time_increment of the video information packets after the generation loss take place, vop_coding_type), confirm to belong to the situation of mutual different frame, can overcome the problem that relates to above with this.
Fig. 6 is the embodiment of the invention and the precedence diagram audio information packet loss corresponding decoding method of expression.
Just at the wireless environment of wireless Internet that the VOD service is provided and so on, more successional video information packets to the video information packets of the present input of above-mentioned comparison and video information packets before this, is used the HEC information of video information packet header respectively.
Illustrate with reference to Fig. 6:
ST600, at first the MPEG-4 decoder input MPEG-4 encoder by receiving terminal machine aspect carries out the information encoded bag, and unpacks the above-mentioned information encoded bag that carries out.
ST610 unpacks by above-mentioned, confirms whether the packet header in the MPEG-4 video information pack arrangement has HEC information.
ST 620, if having HEC information, just store these HEC.
Here, the factor that constitutes above-mentioned HEC have vop_time_increment and vop_coding_type, this factor play a part respectively incremental time that expression 1 second has with interior each frame at interval and now frame be to belong to the I-frame, still belong to the P-frame.
That is, if the video information packets of the video information packets of present input and input before this is the video information packets of same number of frames, (vop_time_increment, value vop_coding_type) should be identical for above-mentioned two information.
ST630, therefore, if store above-mentioned HEC information, whether the video information packets vop_time_increment value of just more above-mentioned input afterwards is identical with the video information packets vop_time_increment value of input before this.
ST640, if identical to the vop_time_increment value of above-mentioned two video information packets, just relatively whether the vop_coding_type value to each video information packets is identical afterwards.
ST650, afterwards, if above-mentioned vop_coding_type value is identical, just being considered as above-mentioned two video information packets is the frames that belong to identical, with the video information packets of the identical above-mentioned present input of frame decoding of the video information packets of input before this.
ST680, if but judge the vop_time_increment or the vop_coding_type value of above-mentioned two video information packets different mutually among above-mentioned ST630, the ST640, just be judged as each video information packets and belong to different frames, with the video information packets of the different new above-mentioned present input of frame decoding of the video information packets of input before this.
ST660, ST670, in addition, judge when the title of the video information packets of input does not have HEC information now among the above-mentioned ST610, also with above-mentioned steps ST680 same treatment, before the video information packets of above-mentioned present input is decoded with new frame, frame is hidden now, also has to form new frame the step that is hidden till certain macro block numbering of video information packet header.
Those of ordinary skill in the art will be appreciated that, above embodiment is used for illustrating the present invention, and be not to be used as limitation of the invention, as long as in connotation scope of the present invention, all will drop in the scope of claims of the present invention variation, the modification of the above embodiment.
Claims (4)
1, a kind of and audio information packet loss corresponding decoding method, described coding/decoding method is decoded to the video-on-demand service of utilizing wireless internet network, it is characterized in that comprising the steps:
Step 1 unpacks the video information packets of present input;
Step 2 unpacks by above-mentioned, confirms that whether the video information packet header has header extension codes information, if there is header extension codes information, just stores above-mentioned header extension codes information;
Step 3, the definite value of utilizing above-mentioned header extension codes information to possess judges whether the video information packets of the video information packets of input now and input before this belongs to same number of frames; The definite value that above-mentioned header extension codes information possesses is vop_time_increment value and/or vop_coding_type value;
Step 4 is according to the judged result of above-mentioned steps 3, with the video information packets of the identical frame of video information packets of input before this or the new above-mentioned present input of frame decoding.
2, as claimed in claim 1 and audio information packet loss corresponding decoding method, it is characterized in that: describedly judge whether the video information packets of the video information packets of above-mentioned present input and input before this belongs to same number of frames and be, the vop_time_increment value with the video information packets of input before this is identical to depend on the vop_time_increment value of video information packets of above-mentioned present input, and whether the vop_coding_type value of the video information packets of above-mentioned present input is identical with the vop_coding_type value of the video information packets of importing before this.
3, as claimed in claim 2 and audio information packet loss corresponding decoding method is characterized in that:
The vop_time_increment value of the video information packets of above-mentioned present input, vop_coding_type value respectively with the vop_time_increment value of the video information packets of input before this, when the vop_coding_type value is identical, with the video information packets of the identical above-mentioned present input of frame decoding of the video information packets imported before this.
4, as claimed in claim 2 and audio information packet loss corresponding decoding method is characterized in that:
When the vop_time_increment value of video information packets of the vop_time_increment value of the video information packets of above-mentioned present input and input before this is inequality, when perhaps the vop_coding_type value of video information packets of the vop_coding_type value of the video information packets of above-mentioned present input and input before this is inequality, with the video information packets of the different new above-mentioned present input of frame decoding of the video information packets of input before this.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200510030220 CN100518304C (en) | 2005-09-29 | 2005-09-29 | Decoding method related to audio information packet loss |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200510030220 CN100518304C (en) | 2005-09-29 | 2005-09-29 | Decoding method related to audio information packet loss |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1941893A CN1941893A (en) | 2007-04-04 |
| CN100518304C true CN100518304C (en) | 2009-07-22 |
Family
ID=37959614
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200510030220 Expired - Fee Related CN100518304C (en) | 2005-09-29 | 2005-09-29 | Decoding method related to audio information packet loss |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100518304C (en) |
-
2005
- 2005-09-29 CN CN 200510030220 patent/CN100518304C/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN1941893A (en) | 2007-04-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6342457B2 (en) | Network streaming of encoded video data | |
| JP5788101B2 (en) | Network streaming of media data | |
| JP6027291B1 (en) | Switching between adaptive sets during media streaming | |
| JP5937275B2 (en) | Replace lost media data for network streaming | |
| EP3491827B1 (en) | Retrieving and accessing segment chunks for media streaming | |
| JP5964972B2 (en) | Stream multimedia data from multiple sources | |
| JP2016154348A (en) | Switching between representations during network streaming of coded multimedia data | |
| JP6254291B2 (en) | DASH robust live operation | |
| US8831402B2 (en) | Media stream processing | |
| US20150095450A1 (en) | Utilizing multiple switchable adaptation sets for streaming media data | |
| TW202037177A (en) | Service description for streaming media data | |
| US20180176278A1 (en) | Detecting and signaling new initialization segments during manifest-file-free media streaming | |
| CN112771876B (en) | Method and apparatus for retrieving media data and method and apparatus for transmitting media data | |
| US20140321556A1 (en) | Reducing amount of data in video encoding | |
| JP4544640B2 (en) | Data reproducing apparatus and data reproducing method | |
| CN100518304C (en) | Decoding method related to audio information packet loss | |
| US11943501B2 (en) | Dynamic resolution change hints for adaptive streaming | |
| US20240098130A1 (en) | Mixed media data format and transport protocol | |
| US20240098307A1 (en) | Automatic generation of video content in response to network interruption | |
| CN100474923C (en) | MPEG-4 coding mode selection method for real-time stream transmission service | |
| JP2024509416A (en) | Camera control data for virtual cameras in virtual interactive scenes defined by streamed media data | |
| JP2024509524A (en) | Object collision data for virtual cameras in virtual interactive scenes defined by streamed media data | |
| CN116918338A (en) | Object collision data for virtual cameras in virtual interaction scenarios defined by streaming media data | |
| KR20050099078A (en) | Mpeg-4 coding mode selection method for real-time streaming service | |
| KR20050089458A (en) | Packet loss error resilient decoding method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090722 Termination date: 20130929 |