WO2012079402A1

WO2012079402A1 - Method, system and apparatus for transmitting multimedia data

Info

Publication number: WO2012079402A1
Application number: PCT/CN2011/079998
Authority: WO
Inventors: 陈光亮; 谢文军; 张建强
Original assignee: 中兴通讯股份有限公司
Priority date: 2010-12-15
Filing date: 2011-09-22
Publication date: 2012-06-21
Also published as: CN102098542A

Abstract

Disclosed are a method, a system and an apparatus for transmitting multimedia data, which are used for transmitting differentiated video streams of different qualities of service in a CMMB system. The method for transmitting multimedia data comprises: encoding a video stream in a video service, generating a code stream of a base layer and at least one code stream of an enhancement layer, separately encapsulating the generated code stream of the base layer and each generated code stream of the enhancement layer in the same multiplexing sub-frame of a broadcast channel frame, encapsulating decoding information of a code stream of each layer in the multiplexing sub-frame, and transmitting the broadcast channel frame. In the embodiment of the present invention, the code stream of the base layer and the at least one code stream of the enhancement layer are transmitted in the multiplexing sub-frame, thereby transmitting an SVC video stream in the CMMB system.

Description

Method, system and device for multimedia data transmission

The present invention relates to the field of mobile multimedia broadcast technologies, and in particular, to a method, system and apparatus for multimedia data transmission. Background technique

With the development of communication technology, the application of mobile multimedia broadcasting technology has become wider and wider. At present, the China Mobile Multimedia Broadcasting (CMMB) system standard specifies the frame structure, channel coding and modulation of the broadcast channel transmission signal of the mobile multimedia broadcasting system within the frequency range of the broadcasting service. The composition of the broadcast channel frame is as shown in FIG. 1. The broadcast channel frame K includes multiple multiplexing frames, and the multiplexing frame 0 is used for transmitting control information, and the multiplexing frame 1 multiplexing frame n is used for transmitting service data. . The multiplexing frame of each transmission service data includes: a multiplexing frame header, a multiplexing frame payload, and a padding, and the multiplexing frame payload includes one or more multiplexing subframes; each multiplexing subframe includes: Use sub-frame headers, video segments, audio segments, and data segments.

It can be seen that, according to the CMMB standard, a multiplex subframe can be used to encapsulate streaming media such as video and audio for transmission.

Scalable Video Coding (SVC) is a video grading coding method. The method can encode a video content source to generate a plurality of levels of code streams, including: a basic layer code stream and at least one enhancement layer code stream. The base layer code stream can be separately decoded, and the enhanced layer code stream includes additional information for improving the quality of the lower layer code stream, and needs to be decoded together with the lower layer including the base layer code stream.

It can be seen that the SVC technology can provide scalable video services, realize video services with differentiated service quality, and achieve capability adaptation of various terminals, and has many advantages. However, at present, only multiplexed sub-frames can be used to encapsulate streaming media data such as video and audio for transmission. The quality of the transmitted video streaming media data is fixed, and the SVC video service cannot be transmitted in the CMMB system, that is, the existing CMMB. The system cannot provide a video stream with a distinction in quality of service. Summary of the invention

In view of this, embodiments of the present invention provide a method, system, and apparatus for multimedia data transmission, for implementing transmission of a video stream with differentiated quality of service in a CMMB system.

An embodiment of the present invention provides a method for transmitting multimedia data, including:

Encoding the video stream in the video service to generate a base layer code stream and at least one enhancement layer code stream;

And the generated base layer code stream and each enhancement layer code stream are respectively encapsulated in a same multiplex subframe of a broadcast channel frame, and the decoding information of each layer code stream is encapsulated in the multiplex subframe;

Transmitting the broadcast channel frame.

An embodiment of the present invention provides a device for transmitting multimedia data, including:

a coding unit, configured to encode a video stream in a video service, to generate a base layer code stream and at least one enhancement layer code stream;

An encapsulating unit, configured to encapsulate the generated base layer code stream and each enhancement layer code stream in a same multiplex subframe of a broadcast channel frame, and encapsulate decoding information of each layer code stream in the multiplexing In the sub-frame;

And a sending unit, configured to send the broadcast channel frame.

An embodiment of the present invention provides a method for receiving multimedia data, including:

Receiving a broadcast channel frame, where a multiplexed subframe of the broadcast channel frame encapsulates a base layer code stream generated by encoding a video stream in a video service and each enhancement layer code stream;

And decoding, according to decoding information of each layer code stream in the multiplexed subframe, the multiplexed subframe to obtain a corresponding video stream; The video stream is output.

An embodiment of the present invention provides an apparatus for receiving multimedia data, including:

a receiving unit, configured to receive a broadcast channel frame, where a multiplexed subframe of the broadcast channel frame encapsulates a base layer code stream and each enhancement layer code stream generated by encoding a video stream in a video service;

a decoding unit, configured to decode the multiplex subframe according to decoding information of each layer code stream in the multiplex subframe, to obtain a corresponding video stream;

An output unit, configured to output the video stream.

The embodiment of the invention provides a multimedia data transmission system, comprising: the above-mentioned transmitting device and receiving device.

In the embodiment of the present invention, the video stream in the video service is encoded to generate a base layer code stream and at least one enhancement layer code stream; and the generated base layer code stream and each enhancement layer code stream are respectively encapsulated in a broadcast channel frame. In the same multiplex subframe, the decoding information of each layer code stream is encapsulated in the multiplex subframe; the broadcast channel frame is sent, so that in the CMMB system, the SVC video stream is transmitted.

And after receiving the broadcast channel frame, decoding the multiplex subframe according to the decoding information of each layer code stream in the multiplex subframe of the broadcast channel frame, to obtain a corresponding video stream, where the broadcast channel frame is complex The base layer code stream generated by encoding the video stream in the video service and each enhancement layer code stream are encapsulated in the subframe, so that video images of different qualities can be presented, and the differentiated video service with different quality of service is realized. DRAWINGS

The drawings are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:

1 is a schematic structural diagram of a structure of a broadcast channel frame in the prior art; 2 is a flowchart of multimedia data transmission in an embodiment of the present invention;

3 is a schematic structural diagram of a structure of a broadcast channel frame according to an embodiment of the present invention;

4 is a flowchart of receiving multimedia data in an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a structure of a broadcast channel frame according to an embodiment of the present invention; FIG.

6 is a structural diagram of an apparatus for transmitting multimedia data according to an embodiment of the present invention;

FIG. 7 is a structural diagram of an apparatus for receiving multimedia data according to an embodiment of the present invention. detailed description

In the embodiment of the present invention, the video stream in the video service is subjected to hierarchical video coding, and the base layer code stream and the at least one enhancement layer code stream are generated, and each layer code stream is separately encapsulated into the same multiplex subframe of the CMMB broadcast channel frame. And, the decoding information of each layer code stream is encapsulated into the multiplex subframe, so that after the multiplex subframe carried by the CMMB broadcast channel frame arrives at the receiving end, the receiving end receives the layer code stream in the CMMB broadcast channel frame. The multiplexed subframe, the receiving end decodes the multiplexed subframe according to decoding information of each layer of the code stream in the multiplexed subframe, and obtains a corresponding video stream and outputs the multiplexed subframe.

The receiving end may determine, according to its processing capability, that only the base layer code stream is processed, and decode the base layer code stream in the multiplexed subframe according to the decoding information of the base layer code stream in the multiplexed subframe. a basic video stream; or, when determining, according to its processing capability, processing the base layer code stream and the at least one enhancement layer code stream, according to decoding information of the base layer code stream and the corresponding enhancement layer code stream in the multiplex subframe, Decoding the base layer code stream in the multiplex subframe and the corresponding enhancement layer code stream to obtain an enhanced video stream.

It can be seen that the receiving end can select to process the base layer code stream according to its own condition, or process the base layer code stream and the at least one enhancement layer code stream, thereby obtaining video streams of different qualities.

FIG. 2 is a process of transmitting multimedia data according to an embodiment of the present invention. As shown in FIG. 2, the process includes the following steps:

Step 201: Encoding a video stream in a video service, generating a base layer code stream and at least one Enhanced layer code stream.

The video stream in the video service is coded by using the SVC method, and is encoded to generate a basic layer code stream and one or more enhancement layer code streams. The base layer code stream includes a basic video data stream, and audio and data information in the video service; the base layer code stream is directed to an ordinary receiving end, and the receiving end can obtain a basic video service by decoding the base layer code stream. However, the picture quality of the basic video service obtained is general. The enhancement layer code stream is optimized for the video picture in the video service, and needs to be optimized on the basis of decoding the data of the base layer code stream. For the receiver supporting advanced video processing, in addition to processing the base layer code stream In addition, the corresponding enhancement layer code stream can be processed, and the base layer code stream and its corresponding enhancement layer code stream are decoded at the same time, and a video service with high quality video picture is obtained, thereby reflecting the quality of the video service.

Step 202: Encapsulate the generated base layer code stream and each enhancement layer code stream in the same multiplex subframe of the broadcast channel frame, and encapsulate the decoding information of each layer code stream in the multiplex subframe.

Here, the basic layer code stream and each enhancement layer code stream are carried in the video segment in the same multiplex sub-frame in the broadcast channel frame according to the layer to which it belongs, thus ensuring the timeliness and synchronization of the video segment reception. Sex and reliability.

Moreover, in order to facilitate the correct decoding of the receiving end, here, the decoding information of each layer of the code stream is also encapsulated in the multiplexed subframe. The decoding information of each layer code stream includes: a decoding dependency of each layer code stream, and timestamp synchronization information of each layer code stream.

Here, the decoding dependency of each layer code stream may be encapsulated in a multiplex subframe header of the multiplex subframe, and the timestamp synchronization information of each layer code stream may be encapsulated in a multiplex subframe header of the multiplex subframe and In the video segment header.

In the embodiment of the present invention, a schematic diagram of a structure of a broadcast channel frame encapsulating each layer of code streams may be as shown in FIG. 3, and the base layer code stream and each enhancement layer code stream are respectively encapsulated in a multiplex subframe of a broadcast channel frame. In the video segment of the multiplex subframe, the base layer code stream, the enhancement layer code stream 1 enhancement layer code stream m-1, and the video segment header are encapsulated. And the multiplex subframe header of the multiplex subframe 1 includes a sub Frame header parameters, and decoding dependencies for each layer of code streams. The decoding dependencies of the code streams of each layer are specifically expressed as: a base layer code stream parameter, an enhancement layer code stream 1 parameter enhancement layer code stream m-1 parameter. The sub-frame header parameters and the time slot synchronization information of each layer of the code stream are encapsulated in the video segment header. The sub-frame header parameter encapsulates the basic time information, and the video segment header encapsulates the relative time information of each layer of the code stream; where m represents the number of layers of the enhancement layer, and the maximum value is 8.

Step 203: Send the encapsulated broadcast channel frame.

A broadcast channel frame carrying each layer of code streams is modulated to form a broadcast signal, which is then transmitted.

According to the above transmission process, in the CMMB system, the transmission of the SVC video stream is realized, that is, the video service with the difference in quality of service is provided.

In the embodiment of the present invention, the generated base layer code stream and each enhancement layer code stream must be encapsulated in the same multiplex subframe. Therefore, before encoding the video stream in the video service, the size of the multiplex subframe in the broadcast channel frame must also be configured. That is, the size of the multiplex subframe of the broadcast channel frame must be determined according to the size of the video stream in the video service. That is, it must be ensured that the multiplex subframe of the broadcast channel frame can carry the base layer code stream and each enhancement layer code stream generated according to the video stream.

After the broadcast channel frame carrying the code stream of each layer is sent, the receiving end can receive the broadcast channel frame and decode the video stream to obtain a video stream with different quality of service differentiation, as shown in FIG. 4, which is an embodiment of the present invention. The process of receiving multimedia data, the process comprising the following steps:

Step 401: Receive a broadcast channel frame carrying each layer of the code stream.

The multiplexed subframe of the broadcast channel frame sent by the sender encapsulates the base layer code stream generated by encoding the video stream in the video service and each enhancement layer code stream, that is, the broadcast channel frame carries the layer code streams. The receiving end receives the broadcast channel frame.

Step 402: Decode the multiplex subframe according to the decoding information of each layer code stream in the multiplex subframe to obtain a corresponding video stream.

The multiplexed subframe of the broadcast channel frame not only encapsulates the base layer code stream and each enhancement layer code stream, Moreover, the decoding information of each layer of the code stream is also encapsulated. The decoding information of each layer code stream includes: a decoding dependency relationship of each layer code stream, and timestamp synchronization information of each layer code stream.

In this way, the receiving end determines to process only the base layer code stream according to its own video stream processing capability, or processes the base layer code stream and the at least one enhancement layer code stream, and then decodes the multiplexed subframe to obtain a corresponding video stream. Specifically include:

When the receiving end is an ordinary receiving end, it indicates that only the base layer code stream can be processed. Therefore, the base layer code stream in the multiplexed subframe is decoded according to the decoding information of the base layer code stream in the multiplexed subframe. Get the basic video stream. That is, according to the decoding dependency of the base layer code stream in the multiplex subframe and the timestamp synchronization information of the base layer code stream, the base layer code stream in the multiplex subframe is decoded to obtain a basic video stream.

When the receiving end is a receiving end supporting high-definition video processing, it indicates that the basic stream code stream and the corresponding enhancement layer code stream can be processed, and therefore, decoding according to the base layer code stream and the at least one enhancement layer code stream in the multiplex subframe Information, decoding the base layer code stream in the multiplex subframe and the corresponding enhancement layer code stream to obtain an enhanced video stream. That is, according to the decoding dependency of the base layer code stream in the multiplex subframe, the decoding dependency of at least one enhancement layer code stream, the timestamp synchronization information of the base layer code stream, and the timestamp synchronization information corresponding to the enhancement layer code stream, Decoding the base layer code stream in the multiplex subframe and the corresponding enhancement layer code stream to obtain an enhanced video stream.

Step 403: Output the decoded video stream.

The decoded video stream is outputted, so that a video picture of a corresponding quality can be presented, and a video service having a differentiated quality of service is realized.

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments in order to make the present invention. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

In this embodiment, the video service V is a television service including one channel of video data and one channel of audio. The video stream of the video service V is SVC coded, and a basic layer code stream B and one are generated after encoding. Road enhancement layer code stream S. FIG. 5 is a schematic structural diagram of a structure of a broadcast channel frame according to an embodiment of the present invention. As shown in FIG. 5, there are 40 time slots on a certain frequency point F, wherein time slot 0, that is, multiplex frame 0 is used for transmitting control information, and time slot 1 to time slot 39 are used for transmitting service information.

The video base layer code stream B, the enhancement layer code stream S, the audio segment data, and other data segments of the video service V are encapsulated in the multiplex subframe 1 of the multiplex frame 1, occupying slot 1 to slot 8. Specifically include:

Acquiring the base layer code stream B of the video service V, encapsulating into the video segment of the multiplex subframe 1 of the multiplex frame 1, acquiring the enhancement layer code stream S of the video service V, and also encapsulating the multiplexer of the multiplex frame 1 In the video segment of frame 1.

The audio stream and the data segment information of the video service V are respectively added to the audio segment and the data segment of the multiplexing subframe 1 of the multiplex frame 1.

Obtaining the decoding dependency information of the basic layer code stream B of the video service V, and packing it into the multiplexing frame

The base layer B parameter is formed in the multiplex subframe header of the multiplex subframe 1 of 1; the decoding dependency information of the enhancement layer code stream S of the video service V is obtained, and is also encapsulated into the multiplex subframe 1 of the multiplex frame 1. In the multiplex sub-frame header, an enhancement layer code stream S parameter is formed. In this way, the decoding dependency of each layer of the code stream can be indicated by the above parameters, so that the receiving end can decode the video service V.

The base layer code stream B of the video service V and the timestamp synchronization information of the enhancement layer code stream S are obtained and encapsulated into the multiplex subframe header and the video segment header of the multiplex subframe 1. The basic time information is encapsulated into the multiplex subframe header of the multiplex subframe 1 of the multiplex frame 1, forming a subframe header parameter, and the relative time information of each layer code stream is encapsulated into the multiplexing of the multiplex frame 1. The video segment of the video segment of subframe 1 is in the header. The time unit in the sub-frame header parameter is seconds, and the time unit in the video segment header is milliseconds.

In this way, after the broadcast channel frame broadcast is transmitted, the receiving end can receive the broadcast channel frame.

When the receiving end is a normal receiving end, the multiplex subframe 1 of the multiplex frame 1 according to the broadcast channel frame is used. The sub-frame header parameter in the multiplex sub-frame header and the video segment header in the video segment determine the timestamp synchronization information of the base layer code stream B, and then, according to the time-stamp synchronization information of the base layer code stream B, The base layer code stream in the video segment of the multiplex subframe 1 of the multiplex frame 1 is multiplexed with the decoding dependency of the base layer code stream B in the base layer B parameter in the subframe header by the multiplex subframe 1 of the frame 1. B performs decoding, obtains a basic video stream, and outputs the basic video stream.

When receiving the receiving end to support the high-definition video processing, determining the basic sub-header parameters of the multiplexed sub-frame header and the video segment header in the video segment in the multiplex subframe 1 of the multiplex frame 1 in the broadcast channel frame The timestamp synchronization information of the layer code stream B, and the timestamp synchronization information of the enhancement layer code stream S, and then multiplexing the frame 1 according to the timestamp synchronization information of the base layer code stream B and the enhancement layer code stream S Decoding the decoding dependency of the base layer code stream B in the base layer B parameter in the subframe header with subframe 1 and the enhancement in the base layer S parameter in the multiplex subframe 1 multiplex subframe header of the multiplex frame 1 The decoding dependency of the layer code stream S is used to decode the base layer code stream B and the enhancement layer code stream S in the multiplex subframe 1 video segment of the multiplex frame 1, to obtain an enhanced video stream, and output the enhanced video stream.

Through the above process, the transmission of video services with different quality of service differentiation in the CMMB system is realized.

According to the method for transmitting multimedia data, a device for transmitting multimedia data can be constructed. As shown in FIG. 6, the method includes: an encoding unit 610, a packaging unit 620, and a sending unit 630;

The coding unit 610 is configured to encode the video stream in the video service, and generate a base layer code stream and at least one enhancement layer code stream.

The encapsulating unit 620 is configured to encapsulate the generated base layer code stream and each enhancement layer code stream in the same multiplex subframe of the broadcast channel frame, and encapsulate the decoding information of each layer code stream in the complex Use in a sub-frame.

The sending unit 630 is configured to send the broadcast channel frame.

Moreover, the encapsulating unit 620 includes: And a decoding encapsulation unit, configured to encapsulate a decoding dependency of each layer code stream in a multiplex sub-frame header of the multiplex subframe.

And a time encapsulation sub-unit, configured to encapsulate timestamp synchronization information of each layer code stream in a multiplex sub-frame header and a video segment header of the multiplex sub-frame.

Of course, in the embodiment of the present invention, the device further includes:

And a configuration unit, configured to determine, according to the size of the video stream, a size of a multiplex subframe of the broadcast channel frame.

Thus, it is ensured that the multiplex subframe of the broadcast channel frame can carry the base layer code stream and each enhancement layer code stream generated from the video stream.

According to the above method of receiving multimedia data, a device for receiving multimedia data can be constructed. Referring to FIG. 7, the method includes: a receiving unit 710, a decoding unit 720, and an output unit 730.

The receiving unit 710 is configured to receive a broadcast channel frame, where the multiplexed subframe of the broadcast channel frame encapsulates a base layer code stream generated by encoding a video stream in a video service and each enhanced layer code stream.

The decoding unit 720 is configured to decode the multiplex subframe according to decoding information of each layer code stream in the multiplex subframe to obtain a corresponding video stream.

The output unit 730 is configured to output the video stream.

The decoding unit 720 is specifically configured to: decode, according to the decoding information of the base layer code stream in the multiplexed subframe, the base layer code stream in the multiplexed subframe to obtain a basic video stream; or, according to the Decoding the base layer code stream in the subframe and the decoding information of the at least one enhancement layer code stream, and decoding the base layer code stream and the corresponding enhancement layer code stream in the multiplex subframe to obtain an enhanced video stream.

In addition, an embodiment of the present invention further provides a multimedia data transmission system, including the transmitting device shown in FIG. 6, and the receiving device shown in FIG.

In the embodiment of the present invention, a video stream in a video service is encoded to generate a base layer code stream and At least one enhancement layer code stream; the generated base layer code stream and each enhancement layer code stream are respectively encapsulated in a same multiplex subframe of a broadcast channel frame, and the decoding information of each layer code stream is encapsulated in the In the multiplex subframe; transmitting the broadcast channel frame, so that in the CMMB system, the SVC video stream is transmitted.

And after receiving the broadcast channel frame, decoding the multiplex subframe according to the decoding information of each layer code stream in the multiplex subframe of the broadcast channel frame, to obtain a corresponding video stream, where the broadcast channel frame is complex The base layer code stream generated by encoding the video stream in the video service and each enhancement layer code stream are encapsulated in the subframe, wherein only the base layer code stream in the multiplex subframe is decoded to obtain the basic video. Streaming; or, decoding the base layer code stream in the multiplex subframe and the corresponding enhancement layer code stream to obtain an enhanced video stream. In this way, video images of different qualities can be presented, and video services with differentiated quality of service are realized.

Industrial applicability

In the present invention, the video stream in the video service is encoded to generate a base layer code stream and at least one enhancement layer code stream; and the generated base layer code stream and each enhancement layer code stream are respectively encapsulated in the same broadcast channel frame. Transmitting, in the multiplex subframe, the decoding information of each layer code stream in the multiplex subframe; and transmitting the broadcast channel frame, in the CMMB system, implementing the transmission of the video stream with the service quality difference distinction .

The above description shows and describes a preferred embodiment of the present invention, but as described above, it should be understood that the present invention is not limited to the form disclosed herein, and should not be construed as being Other combinations, modifications, and environments are possible and can be modified by the teachings of the above teachings or related art within the scope of the inventive concept described herein. The modifications and variations made by those skilled in the art are intended to be within the scope of the appended claims.

Claims

Claim

A method for transmitting multimedia data, the method comprising: encoding a video stream in a video service, generating a base layer code stream and at least one enhancement layer code stream;

Transmitting the broadcast channel frame.

The method according to claim 1, wherein before the encoding the video stream in the video service, the method further includes:

Determining a size of the multiplex subframe of the broadcast channel frame according to the size of the video stream.

The method according to claim 1, wherein the encapsulating the decoding information of each layer code stream in the multiplex subframe is:

Encapsulating a decoding dependency of each layer code stream in a multiplex subframe header of the multiplex subframe; encapsulating timestamp synchronization information of each layer code stream in a multiplex subframe header of the multiplex subframe In the video segment header.

A device for transmitting multimedia data, the device comprising: an encoding unit, configured to encode a video stream in a video service, generate a base layer code stream, and generate at least one enhancement layer code stream;

And a sending unit, configured to send the broadcast channel frame.

The device according to claim 4, further comprising: a configuration unit, configured to determine a size of the multiplex subframe of the broadcast channel frame according to the size of the video stream.

The apparatus according to claim 4, wherein the encapsulating unit further comprises: a decoding encapsulation subunit, configured to encapsulate a decoding dependency of each layer code stream in a multiplexer of the multiplex subframe In the frame header;

A method for receiving multimedia data, characterized in that the method comprises:

And decoding, according to decoding information of each layer code stream in the multiplexed subframe, the multiplex subframe to obtain a corresponding video stream;

The video stream is output.

The method according to claim 7, wherein the decoding the multiplexing subframe to obtain a corresponding video stream is:

Decoding a basic layer code stream in the multiplexed subframe according to decoding information of a base layer code stream in the multiplexed subframe to obtain a basic video stream; or

Decoding the base layer code stream and the corresponding enhancement layer code stream in the multiplex subframe according to the base layer code stream and the decoding information of the at least one enhancement layer code stream in the multiplex subframe to obtain an enhanced video stream. .

9. A device for receiving multimedia data, the device comprising:

An output unit, configured to output the video stream.

10. Apparatus according to claim 9 wherein:

The decoding unit is specifically configured to: decode, according to decoding information of a base layer code stream in the multiplexed subframe, a base layer code stream in the multiplexed subframe to obtain a basic video stream; or, according to the Decoding the base layer code stream in the subframe and the decoding information of the at least one enhancement layer code stream, and decoding the base layer code stream and the corresponding enhancement layer code stream in the multiplex subframe to obtain an enhanced video stream.

A multimedia data transmission system, comprising: the transmission device according to any one of claims 4 to 6, and the reception device according to any one of claims 9 to 10.