CN107888946A - 一种流媒体服务器混流合屏方法 - Google Patents

一种流媒体服务器混流合屏方法 Download PDF

Info

Publication number
CN107888946A
CN107888946A CN201711179564.6A CN201711179564A CN107888946A CN 107888946 A CN107888946 A CN 107888946A CN 201711179564 A CN201711179564 A CN 201711179564A CN 107888946 A CN107888946 A CN 107888946A
Authority
CN
China
Prior art keywords
stream
yuv
output
video
pcm
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711179564.6A
Other languages
English (en)
Inventor
李观培
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Johnsen Shilian Digital Technology (beijing) Co Ltd
Chuangsheng Shilian Digital Technology Beijing Co Ltd
Original Assignee
Johnsen Shilian Digital Technology (beijing) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Johnsen Shilian Digital Technology (beijing) Co Ltd filed Critical Johnsen Shilian Digital Technology (beijing) Co Ltd
Priority to CN201711179564.6A priority Critical patent/CN107888946A/zh
Publication of CN107888946A publication Critical patent/CN107888946A/zh
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365Multiplexing of several video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233Processing of audio elementary streams
    • H04N21/2335Processing of audio elementary streams involving reformatting operations of audio signals, e.g. by converting from one coding standard to another
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368Multiplexing of audio and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/6437Real-time Transport Protocol [RTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明涉及一种基于流媒体服务器的混流合屏方法,通过在流媒体服务器上对多个主播推送的直播流进行混合和合屏,最终输出一路直播流供观看端观看。本发明由于在上述方案中将多路主播推送的直播流进行了合并,最终输出一路直播流,相比传统的直播拉多路流进行观看,节省了大量的带宽,同时终端采用rtmp进行推送,对推流终端的兼容性较好,同时也实现了多个画面混合,多个声音混合的效果,观看体验得以优化。

Description

一种流媒体服务器混流合屏方法
技术领域
本发明涉及一种流媒体服务技术领域,具体涉及一种流媒体服务器混流合屏方法。
背景技术
现有的音视频直播技术,一般是由推流客户端推送单路基于rtmp协议的媒体流到流媒体服务器,流媒体服务器再转发到分发系统服务器,观众通过访问分发系统服务器观看到主播发布的音视频内容。
现有的音视频直播技术,有二个方面的缺点,第一:主播和观众是一对多的关系,即所有观看端只能看到该主播的内容,直播形式较为单一;第二:如果有直播内容存在多个主播画面,在观看端需要拉取每个主播的直播流,存在带宽等资源方面的浪费。
发明内容
本发明的目的是针对现有技术中的不足,提供一种基于流媒体服务器的混流合屏方法,通过在流媒体服务器上对多个主播推送的直播流进行混合和合屏,最终输出一路直播流供观看端观看。
为实现上述目的,本发明公开了如下技术方案:
一种流媒体服务器混流合屏方法,包括如下步骤:
S1多个直播终端推送基于RTMP协议的直播流至同一台流媒体服务器,推流名字分别定义为stream_1,stream_2,…,stream_n;
S2将流stream_1,stream_2,…,stream_n转码成相同视频分辨率的流,视频输出流即为视频分辨率大小,假设视频分辨率为s,视频宽度为w,视频高度为h,则s=w*h;
S3将流stream_1,stream_2,…,stream_n进行转码,固定音频采样率,声道数;
S4将RTMP格式的媒体流stream_1,stream_2,…,stream_n进行解协议,解为flv格式的音视频tag封装格式数据;分别定义为stream_flv_1,stream_flv_2,…,stream_flv_n;
S5将步骤S4产生的flv tag解封装为h264格式的视频码流,分别定义为stream_h264_1,stream_h264_2,…,stream_h264_n;
S6将步骤S4产生的flv tag解封装为aac格式的音频码流,分别定义为stream_aac_1,stream_aac_2,…,stream_aac_n;
S7将步骤S5产生的h264视频码率进行解码,解码成yuv视频像素数据,分别定义为stream_yuv_1,stream_yuv_2,…,stream_yuv_n;yuv视频像素数据包括Y、U、V分量,分别定义为stream_yuv_1[Y],stream_yuv_1[U],stream_yuv_1[V],…,stream_yuv_n[Y],stream_yuv_n[U],stream_yuv_n[V];
S8将步骤S6产生的aac音频码率进行解码,解码为pcm音频采样数据,分别定义:stream_pcm_1,stream_pcm_2,…,stream_pcm_n;
S9将步骤S7产生的各路yuv视频像素数据分别进行混合,混合后输出一路YUV视频像素数据,定义为stream_output_yuv,其YUV分量分别为stream_output_yuv[Y],stream_output_yuv[U],stream_output_yuv[V],当前流混合算法为YUV分量累加,即:
stream_output_yuv[Y]=stream_yuv_1[Y]+stream_yuv_2[Y]+…+stream_yuv_n[Y];
stream_output_yuv[U]=stream_yuv_1[U]+stream_yuv_2[U]+…+stream_yuv_n[U];
stream_output_yuv[V]=stream_yuv_1[V]+stream_yuv_2[V]+…+stream_yuv_n[V];
stream_output_yuv[Y],stream_output_yuv[U],stream_output_yuv[V]分量构成stream_output_yuv视频像素数据;一帧YUV420P像素数据一共占用w*h*3/2Byte的数据。其中前w*h Byte存储Y,接着的w*h*1/4Byte存储U,最后w*h*1/4Byte存储V,该步骤最终实现视频混屏效果;
S10将步骤S8产生的各路pcm音频像素数据分别进行混合,混合后输出一路音频PCM采样数据,定义为stream_output_pcm,stream_output_pcm=stream_pcm_1+stream_pcm_2+…+stream_pcm_n;该步骤会实现各路左右声道数据互相混合的效果;
S11将步骤S9和步骤S10产生的yuv和pcm数据进行音视频编码,输出一路编码数据为stream_output_h264和stream_output_aac;
S12将步骤S11产生的stream_output_h264和stream_output_aac进行封装,封装成flv格式数据,定义为stream_output_flv;
S13将步骤12输出的stream_output_flv封装成基于rtmp协议的媒体流,转发到分发网络服务器。
本发明公开的一种流媒体服务器混流合屏方法,具有以下有益效果:
由于在上述方案中将多路主播推送的直播流进行了合并,最终输出一路直播流,相比传统的直播拉多路流进行观看,节省了大量的带宽,同时终端采用rtmp进行推送,对推流终端的兼容性较好,同时也实现了多个画面混合,多个声音混合的效果,观看体验得以优化。
附图说明
图1是本发明的流程图。
具体实施方式
下面将对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
本发明的核心是提供一种基于流媒体服务器的混流合屏方法,通过在流媒体服务器上对多个主播推送的直播流进行混合和合屏,最终输出一路直播流供观看端观看。
请参见图1。本发明公开的一种流媒体服务器混流合屏方法,包括如下步骤:
S1多个直播终端推送基于RTMP协议的直播流至同一台流媒体服务器,推流名字分别定义为stream_1,stream_2,…,stream_n;
S2将流stream_1,stream_2,…,stream_n转码成相同视频分辨率的流,视频输出流即为视频分辨率大小,假设视频分辨率为s,视频宽度为w,视频高度为h,则s=w*h;
S3将流stream_1,stream_2,…,stream_n进行转码,固定音频采样率,声道数;
S4将RTMP格式的媒体流stream_1,stream_2,…,stream_n进行解协议,解为flv格式的音视频tag封装格式数据;分别定义为stream_flv_1,stream_flv_2,…,stream_flv_n;
S5将步骤S4产生的flv tag解封装为h264格式的视频码流,分别定义为stream_h264_1,stream_h264_2,…,stream_h264_n;
S6将步骤S4产生的flv tag解封装为aac格式的音频码流,分别定义为stream_aac_1,stream_aac_2,…,stream_aac_n;
S7将步骤S5产生的h264视频码率进行解码,解码成yuv视频像素数据,分别定义为stream_yuv_1,stream_yuv_2,…,stream_yuv_n;yuv视频像素数据包括Y、U、V分量,分别定义为stream_yuv_1[Y],stream_yuv_1[U],stream_yuv_1[V],…,stream_yuv_n[Y],stream_yuv_n[U],stream_yuv_n[V];
S8将步骤S6产生的aac音频码率进行解码,解码为pcm音频采样数据,分别定义:stream_pcm_1,stream_pcm_2,…,stream_pcm_n;
S9将步骤S7产生的各路yuv视频像素数据分别进行混合,混合后输出一路YUV视频像素数据,定义为stream_output_yuv,其YUV分量分别为stream_output_yuv[Y],stream_output_yuv[U],stream_output_yuv[V],当前流混合算法为YUV分量累加,即:
stream_output_yuv[Y]=stream_yuv_1[Y]+stream_yuv_2[Y]+…+stream_yuv_n[Y];
stream_output_yuv[U]=stream_yuv_1[U]+stream_yuv_2[U]+…+stream_yuv_n[U];
stream_output_yuv[V]=stream_yuv_1[V]+stream_yuv_2[V]+…+stream_yuv_n[V];
stream_output_yuv[Y],stream_output_yuv[U],stream_output_yuv[V]分量构成stream_output_yuv视频像素数据;一帧YUV420P像素数据一共占用w*h*3/2Byte的数据。其中前w*h Byte存储Y,接着的w*h*1/4Byte存储U,最后w*h*1/4Byte存储V,该步骤最终实现视频混屏效果;
S10将步骤S8产生的各路pcm音频像素数据分别进行混合,混合后输出一路音频PCM采样数据,定义为stream_output_pcm,stream_output_pcm=stream_pcm_1+stream_pcm_2+…+stream_pcm_n;该步骤会实现各路左右声道数据互相混合的效果;
S11将步骤S9和步骤S10产生的yuv和pcm数据进行音视频编码,输出一路编码数据为stream_output_h264和stream_output_aac;
S12将步骤S11产生的stream_output_h264和stream_output_aac进行封装,封装成flv格式数据,定义为stream_output_flv;
S13将步骤12输出的stream_output_flv封装成基于rtmp协议的媒体流,转发到分发网络服务器。
相比背景技术中介绍的内容,本发明由于在上述方案中将多路主播推送的直播流进行了合并,最终输出一路直播流,相比传统的直播拉多路流进行观看,节省了大量的带宽,同时终端采用rtmp进行推送,对推流终端的兼容性较好,同时也实现了多个画面混合,多个声音混合的效果,观看体验得以优化。
以上所述仅是本发明的优选实施方式,而非对其限制;应当指出,尽管参照上述各实施例对本发明进行了详细说明,本领域的普通技术人员应当理解,其依然可以对上述各实施例所记载的技术方案进行修改,或对其中部分或者全部技术特征进行等同替换;而这些修改和替换,并不使相应的技术方案的本质脱离本发明各实施例技术方案的范围。

Claims (1)

1.一种流媒体服务器混流合屏方法,其特征在于,包括如下步骤:
S1多个直播终端推送基于RTMP协议的直播流至同一台流媒体服务器,推流名字分别定义为stream_1,stream_2,…,stream_n;
S2将流stream_1,stream_2,…,stream_n转码成相同视频分辨率的流,视频输出流即为视频分辨率大小,假设视频分辨率为s,视频宽度为w,视频高度为h,则s=w*h;
S3将流stream_1,stream_2,…,stream_n进行转码,固定音频采样率,声道数;
S4将RTMP格式的媒体流stream_1,stream_2,…,stream_n进行解协议,解为flv格式的音视频tag封装格式数据;分别定义为stream_flv_1,stream_flv_2,…,stream_flv_n;
S5将步骤S4产生的flv tag解封装为h264格式的视频码流,分别定义为stream_h264_1,stream_h264_2,…,stream_h264_n;
S6将步骤S4产生的flv tag解封装为aac格式的音频码流,分别定义为stream_aac_1,stream_aac_2,…,stream_aac_n;
S7将步骤S5产生的h264视频码率进行解码,解码成yuv视频像素数据,分别定义为stream_yuv_1,stream_yuv_2,…,stream_yuv_n;yuv视频像素数据包括Y、U、V分量,分别定义为stream_yuv_1[Y],stream_yuv_1[U],stream_yuv_1[V],…,stream_yuv_n[Y],stream_yuv_n[U],stream_yuv_n[V];
S8将步骤S6产生的aac音频码率进行解码,解码为pcm音频采样数据,分别定义:stream_pcm_1,stream_pcm_2,…,stream_pcm_n;
S9将步骤S7产生的各路yuv视频像素数据分别进行混合,混合后输出一路YUV视频像素数据,定义为stream_output_yuv,其YUV分量分别为stream_output_yuv[Y],stream_output_yuv[U],stream_output_yuv[V],当前流混合算法为YUV分量累加,即:
stream_output_yuv[Y]=stream_yuv_1[Y]+stream_yuv_2[Y]+…+stream_yuv_n[Y];
stream_output_yuv[U]=stream_yuv_1[U]+stream_yuv_2[U]+…+stream_yuv_n[U];
stream_output_yuv[V]=stream_yuv_1[V]+stream_yuv_2[V]+…+stream_yuv_n[V];
stream_output_yuv[Y],stream_output_yuv[U],stream_output_yuv[V]分量构成stream_output_yuv视频像素数据;一帧YUV420P像素数据一共占用w*h*3/2Byte的数据。其中前w*h Byte存储Y,接着的w*h*1/4Byte存储U,最后w*h*1/4Byte存储V,该步骤最终实现视频混屏效果;
S10将步骤S8产生的各路pcm音频像素数据分别进行混合,混合后输出一路音频PCM采样数据,定义为stream_output_pcm,stream_output_pcm=stream_pcm_1+stream_pcm_2+…+stream_pcm_n;该步骤会实现各路左右声道数据互相混合的效果;
S11将步骤S9和步骤S10产生的yuv和pcm数据进行音视频编码,输出一路编码数据为stream_output_h264和stream_output_aac;
S12将步骤S11产生的stream_output_h264和stream_output_aac进行封装,封装成flv格式数据,定义为stream_output_flv;
S13将步骤12输出的stream_output_flv封装成基于rtmp协议的媒体流,转发到分发网络服务器。
CN201711179564.6A 2017-11-23 2017-11-23 一种流媒体服务器混流合屏方法 Pending CN107888946A (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711179564.6A CN107888946A (zh) 2017-11-23 2017-11-23 一种流媒体服务器混流合屏方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711179564.6A CN107888946A (zh) 2017-11-23 2017-11-23 一种流媒体服务器混流合屏方法

Publications (1)

Publication Number Publication Date
CN107888946A true CN107888946A (zh) 2018-04-06

Family

ID=61774653

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711179564.6A Pending CN107888946A (zh) 2017-11-23 2017-11-23 一种流媒体服务器混流合屏方法

Country Status (1)

Country Link
CN (1) CN107888946A (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115065829A (zh) * 2022-04-25 2022-09-16 武汉斗鱼鱼乐网络科技有限公司 一种多人连麦方法及相关设备

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1655609A (zh) * 2004-02-13 2005-08-17 精工爱普生株式会社 记录视频会议数据的方法和系统
US20060176312A1 (en) * 2005-01-04 2006-08-10 Shinji Kuno Reproducing apparatus capable of reproducing picture data
CN101742221A (zh) * 2009-11-09 2010-06-16 中兴通讯股份有限公司 一种会议电视系统中的多画面合成方法及装置
EP2285123A2 (en) * 2009-08-06 2011-02-16 Panasonic Corporation Video processing apparatus
CN103051864A (zh) * 2012-12-26 2013-04-17 浙江元亨通信技术股份有限公司 移动视频会议方法及其系统
CN104602044A (zh) * 2015-02-05 2015-05-06 秦永红 一种rtmp流媒体公网直播系统及其设计方法
CN106792123A (zh) * 2016-12-20 2017-05-31 北京数码视讯科技股份有限公司 动态台标嵌入系统和方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1655609A (zh) * 2004-02-13 2005-08-17 精工爱普生株式会社 记录视频会议数据的方法和系统
US20060176312A1 (en) * 2005-01-04 2006-08-10 Shinji Kuno Reproducing apparatus capable of reproducing picture data
EP2285123A2 (en) * 2009-08-06 2011-02-16 Panasonic Corporation Video processing apparatus
CN101742221A (zh) * 2009-11-09 2010-06-16 中兴通讯股份有限公司 一种会议电视系统中的多画面合成方法及装置
CN103051864A (zh) * 2012-12-26 2013-04-17 浙江元亨通信技术股份有限公司 移动视频会议方法及其系统
CN104602044A (zh) * 2015-02-05 2015-05-06 秦永红 一种rtmp流媒体公网直播系统及其设计方法
CN106792123A (zh) * 2016-12-20 2017-05-31 北京数码视讯科技股份有限公司 动态台标嵌入系统和方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115065829A (zh) * 2022-04-25 2022-09-16 武汉斗鱼鱼乐网络科技有限公司 一种多人连麦方法及相关设备

Similar Documents

Publication Publication Date Title
US20230007316A1 (en) Apparatus for transmitting broadcast signal, apparatus for receiving broadcast signal, method for transmitting broadcast signal and method for receiving broadcast signal
US11178436B2 (en) Broadcast signal transmission device, broadcast signal reception device, broadcast signal transmission method, and broadcast signal reception method
US9014261B2 (en) Method and system for media file compression
US10623754B2 (en) Information processing device and method
US9854333B2 (en) Method and apparatus for transmitting and receiving broadcast signal for providing HEVC based IP broadcast service
JP2018532294A (ja) 放送信号送信装置、放送信号受信装置、放送信号送信方法、及び放送信号受信方法
US10270989B2 (en) Broadcasting signal transmission device, broadcasting signal reception device, broadcasting signal transmission method, and broadcasting signal reception method
CN1881925A (zh) 在因特协议音视频广播网络直播频道切换的方法及结构
US10536665B2 (en) Device for transmitting broadcast signal, device for receiving broadcast signal, method for transmitting broadcast signal, and method for receiving broadcast signal
CN107743252A (zh) 一种降低直播延迟的方法
US10412422B2 (en) Apparatus for transmitting broadcasting signal, apparatus for receiving broadcasting signal, method for transmitting broadcasting signal, and method for receiving broadcasting signal
CN109327706A (zh) 基于dtmb的直播节目信号接收方法及系统
US10666549B2 (en) Broadcast signal transmission apparatus, broadcast signal reception apparatus, broadcast signal transmission method and broadcast signal reception method
CN105430510A (zh) 一种视频点播方法、网关、智能终端及视频点播系统
CN110300338A (zh) 一种快速切换播放组播视频的方法
CN107888946A (zh) 一种流媒体服务器混流合屏方法
US20180359495A1 (en) Apparatus for broadcast signal transmission, apparatus for broadcast signal reception, method for broadcast signal transmission, and method for broadcast signal reception
CN115567494A (zh) 一种云端视频交互系统、方法及装置
KR101941781B1 (ko) Mmt 기반 8k 방송 수신 방법 및 장치
US20210195254A1 (en) Device for transmitting broadcast signal, device for receiving broadcast signal, method for transmitting broadcast signal, and method for receiving broadcast signal
CN109218655A (zh) 无纸化多媒体会议方法、无纸化多媒体会议系统
WO2022253079A1 (zh) 基于hls流的字幕显示方法及装置
Endres Development of an MPEG2 multiplexer compliant with SBTVD digital TV standard
Liu et al. An HD IPTV system based on scalable video coding
CN102088628A (zh) 数字广播系统远程广告插播系统及方法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180406