CN109040644A - Video point exhales the store method and system of video recording - Google Patents
Video point exhales the store method and system of video recording Download PDFInfo
- Publication number
- CN109040644A CN109040644A CN201810830615.5A CN201810830615A CN109040644A CN 109040644 A CN109040644 A CN 109040644A CN 201810830615 A CN201810830615 A CN 201810830615A CN 109040644 A CN109040644 A CN 109040644A
- Authority
- CN
- China
- Prior art keywords
- video
- terminal
- service device
- video data
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/27—Server based end-user applications
- H04N21/274—Storing end-user multimedia data in response to end-user request, e.g. network recorder
- H04N21/2743—Video hosting of uploaded data from client
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Abstract
This application discloses store methods and system that a kind of video point exhales video recording, and wherein method includes: in video call process, and the video data respectively generated and audio data are sent to recording service device respectively by two terminals to conversate；After the video call process, the recording service device carries out stereo process to all audio datas generated in the video call process, the video data that obtained remixed audio generates in the video call process with each terminal respectively is synthesized, two video files obtained after the synthesis are saved.Using the present invention, it can be ensured that the audio-video frequency content saved is synchronous and improves picture quality.
Description
Technical field
The present invention relates to mobile communication technologies, and the store method and system of video recording are exhaled more particularly to a kind of video point.
Background technique
During terminal video call, in order to retain certain evidences, need in recording service device to double-talk
Voice and video data saved.It is directed to the preservation of video call data at present, the method generallyd use is: both sides' reality
When the video data conversed synthesize a video image, and both sides' audio data progress audio mixing, then synthetic view
The audio of frequency file and audio mixing synthesis MP4 file is preserved.
There are the following problems for the store method of above-mentioned video call data:
1, cpu resource expense is big when video image synthesizes, and it is excessive to will lead to recording service device cpu busy percentage, and audio is mixed
The cpu resource that sound uses is few, in this way, will lead to audio-video document generated, may to have sound, video content asynchronous
The problem of.
2, the image of both sides is needed to compress when merging image, to will lead to the image quality decrease after synthesis.
It can be seen that can have image quality decrease and sound, video using the store method of above-mentioned video call data
The nonsynchronous problem of content.
Summary of the invention
In view of this, the main purpose of the present invention is to provide store method and system that a kind of video point exhales video recording, it can
To ensure that saved audio-video frequency content is synchronous and improves picture quality.
In order to achieve the above object, technical solution proposed by the present invention are as follows:
A kind of video point exhales the store method of video recording, comprising:
In video call process, two terminals to conversate are respectively by the video data respectively generated and audio data
It is sent to recording service device；
After the video call process, the recording service device is all to what is generated in the video call process
Audio data carries out stereo process, by obtained remixed audio respectively with each terminal in the video call process
The video data of generation is synthesized, and two video files obtained after the synthesis are saved.
Preferably, the video data respectively generated and audio data are sent to recording service device respectively by described two terminals
Include:
In the video call process, each terminal passes through the video data and audio data that this terminal generates
Transfer server is sent to distant terminal；
All video datas received are sent to the video recording by a video frequency channel and taken by the transfer server
Business device, is sent to the recording service device for the video data and audio data that receive by a voice-frequency channel.
Preferably, the method further includes:
When initiating the video call process, respective terminal recognition number is sent to the transfer by described two terminals
Server and the recording service device；
The transfer server and the recording service device are utilized respectively preset integer value to the end of described two terminals
It holds identifier to carry out complementation, obtains the corresponding remainder of each terminal；
All video datas that will be received are sent to the recording service device
The transfer server carries institute in the RTP packet when sending each video data realtime transmission protocol RTP packet
Belong to the corresponding remainder of terminal；
The recording service device according in the RTP packet the remainder and the remainder it is corresponding with the terminal close
System, knows terminal belonging to the video data in the RTP packet.
Preferably, the transfer server utilizes the synchronisation source of the RTP packet when sending each video data RTP packet
SSRC carries the corresponding remainder of the affiliated terminal of video data.
A kind of video point exhales the preservation system of video recording, comprising:
Terminal, in video call process, video data and audio data that this terminal generates to be sent to video recording
Server；
Recording service device is used for after the video call process, to the institute generated in the video call process
There is audio data to carry out stereo process, by obtained remixed audio respectively with each terminal in the video call process
The video data of middle generation is synthesized, and two video files obtained after the synthesis are saved.
Preferably, the system further comprises transfer server；
The terminal is further used in the video call process, the video data and audio that this terminal is generated
Data are sent to distant terminal by transfer server；
The transfer server, for all video datas received to be sent to the record by a video frequency channel
As server, the video data and audio data that receive are sent to by the recording service by a voice-frequency channel
Device.
Preferably, the system further comprises:
The terminal, for the terminal recognition number of this terminal being sent to described when the video call process is initiated
Transfer server and the recording service device；
The transfer server is used to carry out complementation using terminal recognition number of the preset integer value to the terminal, obtains
The corresponding remainder of each terminal；When sending each video data realtime transmission protocol RTP packet, carried in the RTP packet
The corresponding remainder of affiliated terminal；
The recording service device is used to carry out complementation using terminal recognition number of the integer value to the terminal, obtains every
The corresponding remainder of a terminal；According to the remainder and the remainder and the terminal in received RTP packet pair
It should be related to, know terminal belonging to the video data in the RTP packet.
Preferably, the transfer server, for utilizing the synchronization of the RTP packet when sending each video data RTP packet
Source SSRC carries the corresponding remainder of the affiliated terminal of video data.
In conclusion video point proposed by the present invention exhales the store method and system of video recording, by being respectively each terminal
It generates respective video file to be saved, effectively prevents producing the video data progress image synthesis of video calling both sides
The generation for the problems such as raw sound, video content are asynchronous and picture quality reduces, so as to ensure saved audio-video
Content synchronization simultaneously improves picture quality.
Detailed description of the invention
Fig. 1 is the method flow schematic diagram of the embodiment of the present invention；
Fig. 2 is the system structure diagram of one embodiment of the invention
Fig. 3 is the system structure diagram of another embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, right below in conjunction with the accompanying drawings and the specific embodiments
The present invention is described in further detail.
Core of the invention thought is: by the video data of the both sides of video calling respectively with video calling remixed audio number
According to being synthesized to obtain two video files, in this way, for carry out the both sides of video calling generate respectively respective video file into
Row save, can to avoid to video data carry out image synthesize caused by sound, video content is likely to be out of synchronization and image matter
The generation for the problems such as amount reduces.
Fig. 1 is the method flow schematic diagram of the embodiment of the present invention, as shown in Figure 1, the video point that the embodiment is realized exhales record
The store method of picture specifically includes that
Step 101, in video call process, two terminals to conversate respectively by the video data respectively generated and
Audio data is sent to recording service device.
This step, video, audio data for generating conversational terminal both sides issue recording service device, so as to clothes of recording a video
Business device can generate corresponding video file based on these data and be saved.
Further, in order to reduce data processing overheads of the recording service device in video call process, one can be introduced
Transfer server, is responsible for the real-time Transmission of session both sides sound, video data by transfer server, and by the sound of both sides, video counts
According to being sent to recording service device.In this way, recording service device only needs to generate corresponding video according to the sound, the video data that receive
File talks with the forwarding of both sides' real time data without being responsible for, so as to effectively reduce record in video call process
As the CPU of server handles expense, it is ensured that the quality of generated video file.
Preferably, the video data respectively generated and audio data are sent to recording service device respectively by described two terminals
Include:
In the video call process, each terminal passes through the video data and audio data that this terminal generates
Transfer server is sent to distant terminal；
All video datas received are sent to the video recording by a video frequency channel and taken by the transfer server
Business device, is sent to the recording service device for the video data and audio data that receive by a voice-frequency channel.
Further, in order to enable recording service device can the ownership terminal to received video data (be several
According to being generated by which terminal) accurately identified, corresponding video is generated to distinguish the video data of different terminals
File.When initiating the video call process, respective terminal recognition number can be sent to by two terminals conversed
Transfer server and recording service device.In this way, transfer server can be by the terminal recognition number of two terminals or and terminal recognition
Number corresponding information carries in the video data packet for being sent to recording service device, allows recording service device according to view
The above- mentioned information of frequency data packet know the ownership terminal of data.For example, in order to reduce signaling overheads, can by terminal recognition number with
Mark of the remainder of default integer value as video data ownership terminal, carries in video data packet.Based on above-mentioned purpose, in
Recording service device can be sent to for the video data received using following methods by turning server:
Firstly, transfer server and recording service device are utilized respectively preset integer value to two terminals conversed
Terminal recognition number carries out complementation, obtains the corresponding remainder of each terminal；
Then, transfer server is taken in the RTP packet when sending each video data real-time transport protocol (RTP) packet
With the corresponding remainder of affiliated terminal；
For received video data RTP packet, recording service device by according to the remainder carried in the RTP packet with
And the corresponding relationship of the remainder and the terminal, know terminal belonging to video data in the RTP packet.
Preferably, transfer server can use the synchronisation source of the RTP packet when sending each video data RTP packet
(SSRC) the corresponding remainder of the affiliated terminal of video data is carried.
Step 102, after the video call process, the recording service device in the video call process to producing
Raw all audio datas carry out stereo process, and obtained remixed audio is led to each terminal in the video respectively
The video data generated during words is synthesized, and two video files obtained after the synthesis are saved.
This step is with existing scheme the difference is that after the video data of session both sides is no longer synthesized a video image
It is merged again with the audio of audio mixing, but the remixed audio that the audio data generated using session is generated directly is distinguished into participant
The video data of words both sides merges, and obtains the corresponding video file of respective video data, carries out to the video file of both sides
Preservation.In this way, can to avoid the sound caused by being merged due to image, video content is asynchronous and picture quality reduction is asked
Topic.
For example, it is assumed that terminal A and terminal B carry out video calling, need to generate two video files, be respectively: FILE1 and
FILE2。
FILE1 is made of VIDEO A+MIXAudio (A+B).
FILE2 is made of VIDEO B+MIXAudio (A+B).
Wherein, FILE1 is by the video data VIDEOA and terminal A of terminal A and the remixed audio MIXAudio (A+ of terminal B
B) the MP4 file formed；
FILE2 is by the video data VIDEO B and terminal A of terminal B and remixed audio MIXAudio (A+B) group of terminal B
At MP4 file.
Fig. 2 is that a kind of video point corresponded to the above method exhales the preservation system structure diagram of video recording, such as Fig. 2 institute
Show, which includes:
Terminal, in video call process, video data and audio data that this terminal generates to be sent to video recording
Server；
Recording service device is used for after the video call process, to the institute generated in the video call process
There is audio data to carry out stereo process, by obtained remixed audio respectively with each terminal in the video call process
The video data of middle generation is synthesized, and two video files obtained after the synthesis are saved.
Preferably, it is real conversational terminal both sides can also to be responsible for using transfer server in order to further increase picture quality
When data forwarding, also, by the two generate data be sent to recording service device.Specifically, it can be used and as shown in Figure 3 be
System structure realizes this purpose.As shown in figure 3, the system further comprises a transfer server.
Correspondingly, the terminal is further used in the video call process, the video data that this terminal is generated
Distant terminal is sent to by transfer server with audio data；
The transfer server, for all video datas received to be sent to the record by a video frequency channel
As server, the video data and audio data that receive are sent to by the recording service by a voice-frequency channel
Device.
Preferably, the system further comprises:
The terminal, for the terminal recognition number of this terminal being sent to described when the video call process is initiated
Transfer server and the recording service device；
The transfer server is used to carry out complementation using terminal recognition number of the preset integer value to the terminal, obtains
The corresponding remainder of each terminal；When sending each video data realtime transmission protocol RTP packet, carried in the RTP packet
The corresponding remainder of affiliated terminal；
The recording service device is used to carry out complementation using terminal recognition number of the integer value to the terminal, obtains every
The corresponding remainder of a terminal；According to the remainder and the remainder and the terminal in received RTP packet pair
It should be related to, know terminal belonging to the video data in the RTP packet.
Preferably, the transfer server, for utilizing the synchronization of the RTP packet when sending each video data RTP packet
Source SSRC carries the corresponding remainder of the affiliated terminal of video data.
In conclusion the above is merely preferred embodiments of the present invention, being not intended to limit the scope of the present invention.
All within the spirits and principles of the present invention, any modification, equivalent replacement, improvement and so on should be included in of the invention
Within protection scope.
Claims (8)
1. the store method that a kind of video point exhales video recording characterized by comprising
In video call process, two terminals to conversate respectively send the video data respectively generated and audio data
Give recording service device；
After the video call process, the recording service device is to all audios generated in the video call process
Data carry out stereo process, and obtained remixed audio is generated in the video call process with each terminal respectively
Video data synthesized, save two video files obtained after the synthesis.
2. the method according to claim 1, wherein the video data that described two terminals will be generated respectively respectively
Being sent to recording service device with audio data includes:
In the video call process, the video data and audio data that this terminal generates are passed through transfer by each terminal
Server is sent to distant terminal；
All video datas received are sent to the recording service device by a video frequency channel by the transfer server,
The video data and audio data that receive are sent to the recording service device by a voice-frequency channel.
3. according to the method described in claim 2, it is characterized in that, the method further includes:
When initiating the video call process, respective terminal recognition number is sent to the transfer service by described two terminals
Device and the recording service device；
The transfer server and the recording service device, which are utilized respectively preset integer value, knows the terminal of described two terminals
Alias carries out complementation, obtains the corresponding remainder of each terminal；
All video datas that will be received are sent to the recording service device
The transfer server carries affiliated whole when sending each video data realtime transmission protocol RTP packet in the RTP packet
Hold the corresponding remainder；
The recording service device according to the corresponding relationship of the remainder and the remainder and the terminal in the RTP packet,
Know terminal belonging to the video data in the RTP packet.
4. according to the method described in claim 3, it is characterized in that, the transfer server is sending each video data RTP
Bao Shi carries the corresponding remainder of the affiliated terminal of video data using the synchronisation source SSRC of the RTP packet.
5. the preservation system that a kind of video point exhales video recording characterized by comprising
Terminal, in video call process, video data and audio data that this terminal generates to be sent to recording service
Device；
Recording service device is used for after the video call process, to all sounds generated in the video call process
Frequency produces obtained remixed audio according to stereo process is carried out with each terminal in the video call process respectively
Raw video data is synthesized, and two video files obtained after the synthesis are saved.
6. system according to claim 5, which is characterized in that the system further comprises transfer server；
The terminal is further used in the video call process, the video data and audio data that this terminal is generated
Distant terminal is sent to by transfer server；
The transfer server takes for all video datas received to be sent to the video recording by a video frequency channel
Business device, is sent to the recording service device for the video data and audio data that receive by a voice-frequency channel.
7. system according to claim 6, which is characterized in that the system further comprises:
The terminal, for when the video call process is initiated, the terminal recognition number of this terminal to be sent to the transfer
Server and the recording service device；
The transfer server is used to carry out complementation using terminal recognition number of the preset integer value to the terminal, obtains each
The corresponding remainder of the terminal；When sending each video data realtime transmission protocol RTP packet, in the RTP packet belonging to carrying
The corresponding remainder of terminal；
The recording service device is used to carry out complementation using terminal recognition number of the integer value to the terminal, obtains each institute
State the corresponding remainder of terminal；According to the remainder in the received RTP packet and remainder is corresponding with the terminal closes
System, knows terminal belonging to the video data in the RTP packet.
8. system according to claim 7, which is characterized in that
The transfer server, for being carried using the synchronisation source SSRC of the RTP packet when sending each video data RTP packet
The corresponding remainder of the affiliated terminal of video data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810830615.5A CN109040644B (en) | 2018-07-25 | 2018-07-25 | Video point calling and recording storage method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810830615.5A CN109040644B (en) | 2018-07-25 | 2018-07-25 | Video point calling and recording storage method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109040644A true CN109040644A (en) | 2018-12-18 |
| CN109040644B CN109040644B (en) | 2020-12-04 |
Family
ID=64645282
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810830615.5A Active CN109040644B (en) | 2018-07-25 | 2018-07-25 | Video point calling and recording storage method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109040644B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4847698A (en) * | 1987-07-16 | 1989-07-11 | Actv, Inc. | Interactive television system for providing full motion synched compatible audio/visual displays |
| KR20040093297A (en) * | 2003-04-29 | 2004-11-05 | 엘지전자 주식회사 | Picture call saving apparatus and method for mobile communication terminal |
| US20090086012A1 (en) * | 2007-09-30 | 2009-04-02 | Optical Fusion Inc. | Recording and videomail for video conferencing call systems |
| CN101951492A (en) * | 2010-09-15 | 2011-01-19 | 中兴通讯股份有限公司 | Method and device for recording videos in video call |
| CN102027743A (en) * | 2008-05-16 | 2011-04-20 | Nxp股份有限公司 | Video telephony |
| CN102055949A (en) * | 2009-11-02 | 2011-05-11 | 华为终端有限公司 | Recording method, device and system of multimedia conference and rewinding method and device |
| CN102833524A (en) * | 2011-12-13 | 2012-12-19 | 苏州科达科技有限公司 | Control method for simultaneous picture recording on local audio and calling party audio |
| US9160551B2 (en) * | 2012-03-23 | 2015-10-13 | Cisco Technology, Inc. | Analytic recording of conference sessions |
| CN105635659A (en) * | 2014-11-04 | 2016-06-01 | 广东中星电子有限公司 | Audio processing method and apparatus for video surveillance system |
| CN108024085A (en) * | 2016-10-31 | 2018-05-11 | 联芯科技有限公司 | The method for recording and equipment of audio and video |
-
2018
- 2018-07-25 CN CN201810830615.5A patent/CN109040644B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4847698A (en) * | 1987-07-16 | 1989-07-11 | Actv, Inc. | Interactive television system for providing full motion synched compatible audio/visual displays |
| KR20040093297A (en) * | 2003-04-29 | 2004-11-05 | 엘지전자 주식회사 | Picture call saving apparatus and method for mobile communication terminal |
| US20090086012A1 (en) * | 2007-09-30 | 2009-04-02 | Optical Fusion Inc. | Recording and videomail for video conferencing call systems |
| CN102027743A (en) * | 2008-05-16 | 2011-04-20 | Nxp股份有限公司 | Video telephony |
| CN102055949A (en) * | 2009-11-02 | 2011-05-11 | 华为终端有限公司 | Recording method, device and system of multimedia conference and rewinding method and device |
| CN101951492A (en) * | 2010-09-15 | 2011-01-19 | 中兴通讯股份有限公司 | Method and device for recording videos in video call |
| CN102833524A (en) * | 2011-12-13 | 2012-12-19 | 苏州科达科技有限公司 | Control method for simultaneous picture recording on local audio and calling party audio |
| US9160551B2 (en) * | 2012-03-23 | 2015-10-13 | Cisco Technology, Inc. | Analytic recording of conference sessions |
| CN105635659A (en) * | 2014-11-04 | 2016-06-01 | 广东中星电子有限公司 | Audio processing method and apparatus for video surveillance system |
| CN108024085A (en) * | 2016-10-31 | 2018-05-11 | 联芯科技有限公司 | The method for recording and equipment of audio and video |
Non-Patent Citations (2)
| Title |
|---|
| 朱家栋: "基于324协议栈的Android视频电话方案的研究与实现", 《中国优秀硕士学位论文全文数据库》 * |
| 温情: "硬件视频会议的理想选择 辰联电子", 《HTTP://WWW.AUDIO160.COM/NEWS/2013/8/2013_1_22836.HTM》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109040644B (en) | 2020-12-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10834252B2 (en) | Transcribing audio communication sessions | |
| CN108076306B (en) | Conference implementation method, device, equipment and system and computer readable storage medium | |
| US9426423B2 (en) | Method and system for synchronizing audio and video streams in media relay conferencing | |
| US20060085823A1 (en) | Media communications method and apparatus | |
| CN107018446B (en) | A kind of network video-on-demand and the plug-flow method of live streaming | |
| US11710488B2 (en) | Transcription of communications using multiple speech recognition systems | |
| CN105610824B (en) | A kind of screen sharing method based on screen mirror image and RTSP Streaming Media frame | |
| CN106941629B (en) | Real-time live broadcast method based on SIP + RTP and RTMP protocol intercommunication | |
| US8385234B2 (en) | Media stream setup in a group communication system | |
| US10362173B2 (en) | Web real-time communication from an audiovisual file | |
| CN111327580A (en) | Message transmission method and device | |
| CN110943977B (en) | Multimedia service data transmission method, server, equipment and storage medium | |
| US20090299735A1 (en) | Method for Transferring an Audio Stream Between a Plurality of Terminals | |
| KR101585871B1 (en) | Apparatus and method for providing white board service in mobile communication system | |
| US20120327892A1 (en) | Method For Call Setup Time Improvement | |
| CN103093754A (en) | Voice weakening processing method applied to simultaneous interpretation work | |
| CN109040644A (en) | Video point exhales the store method and system of video recording | |
| CN101951491A (en) | Method and system for playing video services | |
| US20120075408A1 (en) | Technique for providing in-built audio/video bridge on endpoints capable of video communication over ip | |
| CN113612759A (en) | High-performance high-concurrency intelligent broadcasting system based on SIP protocol and implementation method | |
| CN114071058A (en) | Video transmission control method, device, medium and equipment for video conference | |
| Carne | Connections for the Digital Age: Multimedia Communications for Mobile, Nomadic and Fixed Devices | |
| CN108270584A (en) | Realize the method, apparatus of conference telephone capabilities and mostly logical terminal | |
| CN112468507A (en) | Method and system for realizing access of soft video terminal and traditional video terminal to same conference | |
| CN101945107A (en) | Method and system for realizing multimedia color ring |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |