CN100442846C - Moving multi-point monitoring technique utilizing SMIL technique and moving stream media technique - Google Patents

Moving multi-point monitoring technique utilizing SMIL technique and moving stream media technique Download PDF

Info

Publication number
CN100442846C
CN100442846C CNB2006100181661A CN200610018166A CN100442846C CN 100442846 C CN100442846 C CN 100442846C CN B2006100181661 A CNB2006100181661 A CN B2006100181661A CN 200610018166 A CN200610018166 A CN 200610018166A CN 100442846 C CN100442846 C CN 100442846C
Authority
CN
China
Prior art keywords
mobile
flow medium
smil
portable terminal
script
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2006100181661A
Other languages
Chinese (zh)
Other versions
CN1812571A (en
Inventor
黄治华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Northern Fiberhome Technologies Co Ltd
Original Assignee
Beijing Northern Fiberhome Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Northern Fiberhome Technologies Co Ltd filed Critical Beijing Northern Fiberhome Technologies Co Ltd
Priority to CNB2006100181661A priority Critical patent/CN100442846C/en
Publication of CN1812571A publication Critical patent/CN1812571A/en
Application granted granted Critical
Publication of CN100442846C publication Critical patent/CN100442846C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The present invention relates to mobile and multipoint monitoring technology by utilizing synchronized multimedia integration language (SMIL) technology and mobile streaming media technology. A plurality of direct broadcasts are sent from an SMIL script to a streaming media server and are connected, and the multiple pictures are displayed on a single screen. According to the monitoring requirement of a mobile terminal, a management platform dynamically generates the SMIL script, the mobile terminal downloads the SMIL script, a plurality of direct broadcast requests to the direct broadcast are sent according to the description in the SMIL script, and thus, the mobile and multipoint monitoring is realized. According to the self characteristic of a wireless network, the present invention adopts the most advanced H. 264 video coding algorithm, utilizes the SMIL script to describe the characteristics of the time synchronization relationship and the spatial editing relationship among media, and realizes the mobile and multipoint monitoring by the mobile streaming media server technology.

Description

A kind of mobile multiple spot method for monitoring that utilizes SMIL technology and mobile flow medium technology
Technical field
The present invention adopts the mobile flow medium technology to realize that mobile multiple spot monitors, is specifically related to video/audio encoding and decoding technique, mobile flow medium technology and SMIL technology.
Background technology
The mobile flow medium technology
The mobile flow medium technology is exactly that continuous image and acoustic information are put on the webserver after overcompression is handled, mobile phone users can be watched, listen to while downloading, and do not need whole multimedia file download by the time to finish the technology that just can watch immediately.In fact the mobile flow medium technology is the product that network audio-video technology and mobile communication technology develop into certain phase, it is to merge the technology that is produced after a lot of network technologies, and it can relate to the multinomial technology such as collection, compression, storage, transmission and network service of stream medium data.
The network transmission protocol of supporting is: real-time fluidisation agreement (RTSP), real-time transport protocol (rtp) and RTCP Real-time Transport Control Protocol (RTCP).The video coding algorithm of supporting: H.263, MPEG4 and H.264; The audio coding algorithm of supporting: AMR, AAC etc.
1, video/audio encoding and decoding technique
H.263 video coding algorithm at present commonly used in the world has, MPEG4 and H.264.Wherein H.264 compare, have following advantage with other existing video encoding standard:
Low code stream (Low Bit Rate): compare with compression technology such as MPEG2 and MPEG4 ASP, under equal picture quality, adopt the data volume after the technique compresses H.264 to have only 1/8 of MPEG2,1/3 of MPEG4.
High-quality image: H.264 continuous, smooth high quality image (DVD quality) can be provided.
Fault-tolerant ability is strong: H.264 wrong essential tool such as solving under the unstable network environment incidental packet loss is provided.
Network-adaptive is strong: H.264 network-adaptive layer (Network Adaptation Layer) is provided, has made H.264 file transmission on heterogeneous networks easily (for example the Internet, CDMA, GPRS, WCDMA, CDMA2000 etc.).
2, SMIL technology
SMIL is a synchronous multimedia integrate language, and it is a mark that a cover has provided and very simple.It is used for regulation multimedia segment (scope that comprises of multimedia has here: audio files, video file, animation, picture, literal etc.) when, somewhere, play in which type of mode.Time synchronizing relation and the space layout of adopting SMIL can describe easily between the various medium concern, be to be used for the integrated multimedia program on the Internet, especially the main language tool of Streaming Media, it can realize the title of video/audio, navigation area and electronic script three synchronously.
Have following advantage: avoid using unified containing file format, simultaneously play multimedia segment at different local (on the servers), layout, multilingual selection support, many bandwidth carried out in whole demonstration select to support.
3, video monitor
Video monitor is digital video, computer network communication technology, multimedia technology, the compress technique of uses advanced, realizes the telemonitoring of image, sound.Difference according to the signal of gathering can be divided into analog signal supervision and digital signal supervision.
Along with the development and the arrival in 3G epoch of mobile technology, carry out mobile monitoring by wireless environment and become a kind of trend.Because the mobile environment its own particularity proposes new requirement to code efficiency, network self-adapting etc., need also simultaneously to realize that split screen shows.H.264 compression efficiency is higher at present, at aspects such as low code check environment and network fault tolerances many advantages are arranged, so mobile monitoring adopts H.264 video coding algorithm; In order to realize the versatility of portable terminal, consider to utilize the split screen control of SMIL, the player of any support SMIL can both realize that remote multi-point shows.
Present existing method is: each acquisition terminal acquired signal is also carried out the video/audio compressed encoding to signal, and the code stream with compression is transferred to central monitoring position then, is presented on the terminal by the split screen technology at central monitoring position.
The shortcoming of existing method is:
1, operating personnel can only monitor at central monitoring position, can't accomplish the visit in any time, any place, can not make fast reaction to some accidents.
2, need in Surveillance center that the medium of configure dedicated receive, processing server, receive the data of acquisition terminal and data are shown.
3, need to realize that split screen shows that software for display is special-purpose, lack versatility and flexibility.
4, the general encoding and decoding technique incompatibility portable terminal that adopts and the transmission of wireless environment.
Summary of the invention
The object of the present invention is to provide the mobile multiple spot method for monitoring of a kind of SMIL of utilization technology and mobile flow medium technology, can solve the constraint that monitors the place, anyone can both carry out multiple spot by portable terminal at any time and any place and monitor.
Technical scheme of the present invention is: the mobile multiple spot method for monitoring of a kind of SMIL of utilization technology and mobile flow medium technology, it is characterized in that: acquisition terminal is gathered vision signal, and adopt H.264 algorithm that video is encoded, then the code stream that compresses is packaged into the RTP bag and sends to the mobile flow medium server, use for portable terminal; Acquisition terminal can be disposed flexibly, and the multi pass acquisition terminal can simultaneously send the RTP bag to the mobile flow medium server, thereby provides video source for the multiple spot of portable terminal monitors; Portable terminal is initiated to a plurality of live connection of mobile flow medium server in the SMIL script simultaneously, and the many pictures that are implemented on the single screen show; According to the supervision demand of portable terminal, management platform dynamically generates the SMIL script, and portable terminal is downloaded this script, and according to the description in the SMIL script, initiates a plurality of live requests to the mobile flow medium server, thereby realizes that mobile multiple spot monitors.
Aforesaid mobile multiple spot method for monitoring is characterized in that:
1. each acquisition terminal acquired signal, and carry out compressed encoding, video adopts H.264 encryption algorithm; Then the code stream of encoding compression is packaged into the RTP bag and sends to the mobile flow medium server;
2. each acquisition terminal will be gathered, live information is published to comprehensive management platform;
3. mobile terminal accessing comprehensive management platform need to select the place that monitors, and display frame is proposed demand;
4. comprehensive management platform dynamically generates the SMIL script according to the demand of portable terminal, and this script has comprised the live request to the mobile flow medium server, and the SMIL script is passed to portable terminal;
5. mobile terminal playing SMIL script is initiated to the live request of mobile flow medium server on portable terminal, realizes that mobile multiple spot monitors.
Aforesaid mobile multiple spot method for monitoring is characterized in that:
The acquisition terminal acquisition step is as follows:
1., acquisition terminal is initiated registration (comprising username and password) to the mobile flow medium server;
2., the mobile flow medium server carries out access-in management to acquisition terminal, and the result is returned to acquisition terminal;
3., acquisition terminal analysis registration response; If success then sends session description file (SDP information) to the mobile flow medium server, information such as encryption algorithm, mobile flow medium server reception RTP bag port have been described wherein;
4., the mobile flow medium server is opened receiving port according to the port information in the SDP information, and is circulated a notice of the online acquisition end message to comprehensive management platform;
5., the mobile flow medium server is to acquisition terminal transmit operation result;
6., the acquisition terminal analysis result, if success then starts collection, coding, package process, send the RTP bag to the mobile flow medium service;
It is as follows that portable terminal initiates to play step:
1., portable terminal login comprehensive management platform;
2., select online acquisition terminal, can select a plurality of (so just having realized multiple spot) simultaneously, and each online acquisition terminal is specified the viewing area from comprehensive management platform;
3., comprehensive management platform dynamically generates the SMIL script according to the selected information of portable terminal;
4., portable terminal is downloaded the SMIL script from comprehensive management platform;
5., portable terminal start to support the player of SMIL script to play, player is initiated live request according to the Src information in the SMIL script to the mobile flow medium server, receives the RTP bag, decoding also shows in the zone of appointment.
Principle of the present invention is:
The SMIL technology can realize that many pictures show that portable terminal is initiated to a plurality of live connection of mobile flow medium server in the SMIL script, and the many pictures that are implemented on the single screen show.Portable terminal can be specified the relative position of display frame number and each picture in the SMIL script, when playing the SMIL script, player on the portable terminal adopts distinct methods to show successively according to the displaying contents attribute at first according to frame numbers in the script and location parameter divided frame then.Content displayed can be video, audio frequency, also can be FLASH and text; Content displayed can derive from local file, also can derive from the mobile flow medium server.
Content sources in the SMIL script is in the mobile flow medium server, by being initiated to the live request of mobile flow medium server in the SMIL script, thereby utilizes SMIL technology and mobile flow medium technology to realize that mobile multiple spot monitors.
The present invention is according to the wireless network self-characteristic, adopted state-of-the-art H.264 video coding algorithm, utilize SMIL can conveniently describe the characteristics of time synchronizing relation and space layout relation between the various medium,, realize that mobile multiple spot monitors by means of the mobile flow medium server.
Advantage of the present invention is:
1, solved the constraint that monitors the place, anyone can both carry out multiple spot by portable terminal at any time and any place and monitor.
2, do not need that specialized media receives, processing server, can be shared and use existing general streaming media server, thus reduce cost.
3, do not need design specialized split screen software for display on portable terminal, the software for display of any support SMIL script can.
4, video coding adopts H.264 encryption algorithm, can obtain satisfied video quality under wireless and low code check environment.
Description of drawings
Fig. 1 is the system framework figure of the embodiment of the invention.
Fig. 2 is the acquisition terminal of the embodiment of the invention and streaming media server, comprehensive management platform interaction figure.
Fig. 3 is the portable terminal of the embodiment of the invention and streaming media server, comprehensive management platform interaction figure.
Embodiment
Describe embodiments of the invention in detail below in conjunction with accompanying drawing.
System framework is as shown in Figure 1: whole system is made up of four parts:
Acquisition terminal (101,102 etc.): gather vision signal, and signal is carried out compressed encoding; The code stream of encoding is packaged into the RTP bag sends to the mobile flow medium server.
Mobile flow medium server (110): realize RTSP, RTP, rtcp protocol; Receive the RTP bag that acquisition terminal (101,102 etc.) sends; The live request of mobile terminal receive (130,131 etc.).
Comprehensive management platform (120): the access-in management of acquisition terminal; The acquisition terminal Information Statistics; The generation of SMIL script.
Portable terminal (130,131 etc.): support the SMIL script to play; Support RTSP, RTP, rtcp protocol; Support H.264 video decode algorithm.
The acquisition terminal gatherer process is as shown in Figure 2:
1, acquisition terminal (201) is initiated registration (comprising username and password) to mobile flow medium server (210).
2, mobile flow medium server (210) carries out access-in management to acquisition terminal (201), and the result is returned to acquisition terminal.
3, acquisition terminal (201) is analyzed the registration response; If success then sends session description file (SDP information) to mobile flow medium server (210), information such as encryption algorithm, mobile flow medium server reception RTP bag port have been described wherein.
4, mobile flow medium server (210) is opened receiving port according to the port information in the SDP information, and to comprehensive management platform (220) circular online acquisition terminal (201) information.
5, mobile flow medium server (210) is to acquisition terminal (201) transmit operation result.
6, acquisition terminal (201) analysis result if success then starts collection, coding, packing process, sends the RTP bag to mobile flow medium service (210).
Portable terminal (301) is initiated playing process as shown in Figure 3:
1, portable terminal (301) login comprehensive management platform (320).
2, select online acquisition terminal from comprehensive management platform (320), can select a plurality of (so just having realized multiple spot) simultaneously, and each online acquisition terminal is specified the viewing area.
3, comprehensive management platform (320) dynamically generates the SMIL script according to the selected information of portable terminal (301).
4, portable terminal (301) is downloaded the SMIL script from comprehensive management platform (320).
5, portable terminal (301) startup supports the player of SMIL script to play, player is initiated live request according to the Src information in the SMIL script to the mobile flow medium server, receive the RTP bag, decoding also shows in the zone of appointment, reaches the purpose that multiple spot monitors.
The session description file content is as shown in table 1:
Table 1
v=0
o=-143397144?2257390873?IN?IP4?192.168.3.185
s=EES
c=IN?IP4?192.168.3.2
t=0?0
m=video?5566?RTP/AVP?96
b=AS:500
a=rtpmap:96H264/90000
a=fmtp:96?profile-level-id=674200;
sprop-parameter-sets=ZOIAFZZmFiZCAAADAAIAAAMAMwg=,aM48gA==;packetization-mode=1
Wherein keynote message is as follows:
1, o=-143397144 2257390873 IN IP4 192.168.3.185: the IP address of indicating acquisition terminal is 192.168.3.185.
2, c=IN IP4 192.168.3.2: the IP address of having specified streaming media server is 192.168.3.2.
3, m=video 5566 RTP/AVP 96: indicate that streaming media server receives the port of the RTP bag of acquisition terminal transmission: 5566.
4, a=rtpmap:96 H264/90000: the form of having indicated the RTP bag.
5, sprop-parameter-sets=ZOIAFZZmFiZCAAADAAIAAAMAMwg=, aM48gA==; Indicated H.264 coding parameter information.
The SMIL script example is as shown in table 2:
Table 2
<smil>
<head>
<layout>
<root-layout?height=″480″width=″640″background-color=″black″/>
<region?id=″region_01″left=″0″top=″0″height=″144″width=″176″/>
<region?id=″region_02″left=″353″top=″289″height=″144″width=″176″/>
</layout>
</head>
<body>
<par>
<video?src=″rtsp://192.168.3.2/cap1.sdp″region=″region_01″/>
<video?src=″rtsp://192.168.3.2/cap2.sdp″region=″region_02″/>
</par>
</body>
</smil>
Wherein keynote message is explained as follows:
1,<root-layout height=" 480 " width=" 640 " background-color=" black "/:,<root-layout〉defined the size of player main window.
2,<region id=" region_01 " left=" 0 " top=" 0 " height=" 144 " width=" 176 "/: the id of first viewing area of appointment, position and size.
3,<region id=" region_02 " left=" 353 " top=" 289 " height=" 144 " width=" 176 "/: id, position and the size of second viewing area of appointment.
4,<video src=" rtsp: // 192.168.3.2/cap1.sdp " region=" region_01 "/: specify the URL address information of initiating live connection, and live result is shown in first zone.
5,<video src=" rtsp: // 192.168.3.2/cap2.sdp " region=" region_02 "/: specify the URL address information of initiating live connection, and live result is shown in second zone.
In the above description, acquisition terminal can send to different mobile flow medium servers with the RTP bag of encapsulation, simultaneously, portable terminal also can be initiated the live request to different mobile flow medium servers in same SMIL script, can increase the flexibility of portable terminal and mobile flow medium server so greatly.

Claims (3)

1, a kind of mobile multiple spot method for monitoring that utilizes SMIL technology and mobile flow medium technology is characterized in that:
Each acquisition terminal is gathered vision signal, and adopts H.264 algorithm that signal is encoded, and then the code stream of compression is packaged into the RTP bag and sends to the mobile flow medium server, uses for portable terminal;
Portable terminal is initiated to a plurality of live connection of mobile flow medium server in the SMIL script, the many pictures that are implemented on the single screen show; According to the supervision demand of portable terminal, comprehensive management platform dynamically generates the SMIL script, and portable terminal is downloaded this script, and according to the description in the SMIL script, initiates a plurality of live requests to the mobile flow medium server, thereby realizes that mobile multiple spot monitors.
2, mobile multiple spot method for monitoring as claimed in claim 1 is characterized in that:
1. each acquisition terminal acquired signal, and carry out compressed encoding, video adopts H.264 encryption algorithm; Then the code stream of encoding compression is packaged into the RTP bag and sends to the mobile flow medium server;
2. each acquisition terminal will be gathered, live information is published to comprehensive management platform;
3. mobile terminal accessing comprehensive management platform need to select the place that monitors, and display frame is proposed demand;
4. comprehensive management platform dynamically generates the SMIL script according to the demand of portable terminal, and this script has comprised the live request to the mobile flow medium server, and the SMIL script is passed to portable terminal;
5. mobile terminal playing SMIL script is initiated to the live request of mobile flow medium server on portable terminal, realizes that mobile multiple spot monitors.
3, mobile multiple spot method for monitoring as claimed in claim 2 is characterized in that:
The acquisition terminal acquisition step is as follows:
1., acquisition terminal initiates registration to the mobile flow medium server, comprises username and password;
2., the mobile flow medium server carries out access-in management to acquisition terminal, and the result is returned to acquisition terminal;
3., acquisition terminal analysis registration response; If success then sends session description file SDP information to the mobile flow medium server, encryption algorithm, mobile flow medium server reception RTP bag port information have been described wherein;
4., the mobile flow medium server is opened receiving port according to the port information in the SDP information, and is circulated a notice of the online acquisition end message to comprehensive management platform;
5., the mobile flow medium server is to acquisition terminal transmit operation result;
6., the acquisition terminal analysis result, if success then starts collection, coding, package process, send the RTP bag to the mobile flow medium service;
It is as follows that portable terminal initiates to play step:
1., portable terminal login comprehensive management platform;
2., select online acquisition terminal, can select a plurality ofly simultaneously, and each online acquisition terminal be specified the viewing area from comprehensive management platform;
3., comprehensive management platform dynamically generates the SMIL script according to the selected information of portable terminal;
4., portable terminal is downloaded the SMIL script from comprehensive management platform;
5., portable terminal start to support the player of SMIL script to play, player is initiated live request according to the Src information in the SMIL script to the mobile flow medium server, receives the RTP bag, decoding also shows in the zone of appointment.
CNB2006100181661A 2006-01-16 2006-01-16 Moving multi-point monitoring technique utilizing SMIL technique and moving stream media technique Expired - Fee Related CN100442846C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2006100181661A CN100442846C (en) 2006-01-16 2006-01-16 Moving multi-point monitoring technique utilizing SMIL technique and moving stream media technique

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2006100181661A CN100442846C (en) 2006-01-16 2006-01-16 Moving multi-point monitoring technique utilizing SMIL technique and moving stream media technique

Publications (2)

Publication Number Publication Date
CN1812571A CN1812571A (en) 2006-08-02
CN100442846C true CN100442846C (en) 2008-12-10

Family

ID=36845192

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2006100181661A Expired - Fee Related CN100442846C (en) 2006-01-16 2006-01-16 Moving multi-point monitoring technique utilizing SMIL technique and moving stream media technique

Country Status (1)

Country Link
CN (1) CN100442846C (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101854529B (en) * 2010-04-30 2012-01-11 第一视频通信传媒有限公司 Multi-picture network broadcast method for audience segmentation
CN102547875B (en) * 2010-12-30 2015-12-02 中国移动通信集团公司 A kind of implementation method of business of broadcasting of gathering and editing, equipment and system
CN103139599B (en) * 2011-11-29 2016-08-24 人民网股份有限公司 Network multi-image live broadcast system
CN103945174A (en) * 2013-01-23 2014-07-23 苏州市伏泰信息科技有限公司 Environmental sanitation operation stream media network video monitoring system
WO2016127471A1 (en) * 2015-02-10 2016-08-18 沈玉将 Data stream control system, data stream control device and terminal

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003055219A2 (en) * 2001-12-11 2003-07-03 Telefonaktiebolaget Lm Ericsson (Publ.) Method of rights management for streaming media
CN1650631A (en) * 2002-05-06 2005-08-03 摩托罗拉公司 Image content reconfiguration for different device capabilities and methods therefor

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003055219A2 (en) * 2001-12-11 2003-07-03 Telefonaktiebolaget Lm Ericsson (Publ.) Method of rights management for streaming media
CN1620810A (en) * 2001-12-11 2005-05-25 艾利森电话股份有限公司 Method of rights management for streaming media
CN1650631A (en) * 2002-05-06 2005-08-03 摩托罗拉公司 Image content reconfiguration for different device capabilities and methods therefor

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
SMIL在移动流媒体内容分发网络中的应用. 何孝富,张培君,俞时权.计算机时代,第2003 No.8期. 2003
SMIL在移动流媒体内容分发网络中的应用. 何孝富,张培君,俞时权.计算机时代,第2003 No.8期. 2003 *

Also Published As

Publication number Publication date
CN1812571A (en) 2006-08-02

Similar Documents

Publication Publication Date Title
US20190104326A1 (en) Content source description for immersive media data
WO2016138844A1 (en) Multimedia file live broadcast method, system and server
US20200221159A1 (en) Multiple decoder interface for streamed media data
US20140219634A1 (en) Video preview creation based on environment
EP3679717A1 (en) Personalized content streams using aligned encoded content segments
CN102790921B (en) Method and device for choosing and recording partial screen area of multi-screen business
WO2008061416A1 (en) A method and a system for supporting media data of various coding formats
WO2014193996A2 (en) Network video streaming with trick play based on separate trick play files
US20190014165A1 (en) Processing media data using a generic descriptor for file format boxes
CN102131106A (en) Method, device and system for playing streaming media contents
CN101282454A (en) Video communication system based on IP set-top box
CN100442846C (en) Moving multi-point monitoring technique utilizing SMIL technique and moving stream media technique
CN103986945A (en) Hybrid network system, channel content replay method and hybrid set top box
US11178453B2 (en) Signaling and reporting interactivity usage in streaming services
KR20120133006A (en) System and method for providing a service to streaming IPTV panorama image
CN104079870A (en) Video monitoring method and system for single-channel video and multiple-channel audio frequency
KR102518817B1 (en) Broadcast signal transmission apparatus, broadcast signal reception apparatus, broadcast signal transmission method, and broadcast signal reception method
JP2005198313A (en) Digital real-time interactive program system
WO2015180446A1 (en) System and method for maintaining connection channel in multi-device interworking service
CN101009685A (en) A stream media playing system
CN100531379C (en) Mobile terminal adapting system of streaming media
CN205230019U (en) System for realize video seamless handover between many screens
US11388427B2 (en) Multiple decoder interface for streamed media data
WO2015039477A1 (en) Information system, information delivery method and iptv system based on multi-screen interaction
CN102447950A (en) Method and equipment for video play

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20081210

Termination date: 20150116

EXPY Termination of patent right or utility model