CN108810568A - A kind of method and device of news segmentation - Google Patents

A kind of method and device of news segmentation Download PDF

Info

Publication number
CN108810568A
CN108810568A CN201810474334.0A CN201810474334A CN108810568A CN 108810568 A CN108810568 A CN 108810568A CN 201810474334 A CN201810474334 A CN 201810474334A CN 108810568 A CN108810568 A CN 108810568A
Authority
CN
China
Prior art keywords
title
news
shot
sequence
camera lens
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810474334.0A
Other languages
Chinese (zh)
Other versions
CN108810568B (en
Inventor
刘楠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201810474334.0A priority Critical patent/CN108810568B/en
Publication of CN108810568A publication Critical patent/CN108810568A/en
Application granted granted Critical
Publication of CN108810568B publication Critical patent/CN108810568B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Television Signal Processing For Recording (AREA)
  • Studio Devices (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

A kind of news dividing method of present invention offer and device, this method include:News-video is divided into shot sequence, the shot sequence includes shearing lens and gradual shot;The title detected in the news-video forms title sequence;Judged to whether there is gradual shot between two adjacent different titles according to the shot sequence and title sequence;If it is, screening news cut-point according to the gradual shot between described two adjacent different titles or described two adjacent different titles, the news-video is split using the news cut-point.It can be seen that, news dividing method and device provided in an embodiment of the present invention, it can be judged to whether there is gradual shot between two adjacent different titles according to shot sequence and title sequence, Automatic sieve selects news cut-point, to be split the news-video using the news cut-point.

Description

A kind of method and device of news segmentation
Technical field
The present invention relates to the method and devices that technical field of data processing more particularly to a kind of news are divided.
Background technology
In actual life, people can understand information by seeing news.Wherein, contain in news-video a large amount of Newest information.But the news information of various aspects is frequently included in some news-videos.For example, the whole nation includes numerous TV station, these TV stations almost can all play news-video daily.
The application of some video websites and news category needs to split these news-videos, and pushes and use to user It family may interested news information.Therefore, it is necessary to be split to news-video.
In the prior art, generally news-video is split by the way of manually dividing, artificial segmentation works Personnel manually browse news-video, judge news cut-point, to be split to news-video.
But news-video is typically all largely to be broadcasted in some time (such as 12 noon), and news has timeliness, Therefore, when being split to news-video, it is necessary to assure the speed being split to news-video.That is, in order to ensure Timeliness needs that a large amount of entire news-video is cut into multiple independent news items as early as possible in a relatively short period of time, However the segmentation of news-video cannot be generally completed in a relatively short time in the way of manually dividing.
Accordingly, it is desirable to provide a kind of method of automatic segmentation news-video.
Invention content
In order to solve the above technical problem existing in the prior art, the present invention provides a kind of method and dress of news segmentation It sets, news-video can be divided automatically.
In a first aspect, the embodiment of the present invention provides a kind of method of news segmentation, including:
News-video is divided into shot sequence, the shot sequence includes shearing lens and gradual shot;
It detects the title in the news-video and forms title sequence;
Judged to whether there is gradual shot between two adjacent different titles according to the shot sequence and title sequence;
If it is, according to the gradual shot between described two adjacent different titles or described two adjacent different titles News cut-point is screened, the news-video is split using the news cut-point.
Optionally, news cut-point is screened according to the gradual shot between described two adjacent different titles, specifically included:
As unit of each title in the title sequence, screening is located at the gradual change mirror between two adjacent different titles Head, using the end position of the gradual shot filtered out as the news cut-point.
Optionally, as unit of the title each in the title sequence, screening be located at two adjacent different titles it Between gradual shot, specifically include:
Two adjacent different titles of the time difference less than time threshold are obtained from the title sequence, it is described two adjacent Different titles are denoted as the first title and the second title, and the time difference is the first title end time and second title Difference between initial time;
The first camera lens is searched from the shot sequence, the first title end time is located at opening for first camera lens Begin between time and end time;
Next adjacent camera lens of first camera lens is the second camera lens;
When the end time of second title is between the second camera lens starting and end time, and it is described Second camera lens is less than the first pre-set length threshold for the tapered length of gradual shot and second camera lens and is preset more than second When length threshold, using first camera lens as the gradual shot filtered out.
Optionally, described to screen news cut-point according to described two adjacent different titles, it specifically includes:
As unit of each gradual shot in the shot sequence, the different gradual change mirror of front and back adjacent title is filtered out Head, using the end position of the gradual shot filtered out as the news cut-point.
Optionally, as unit of the gradual shot each in the shot sequence, front and back adjacent title is filtered out not Same gradual shot, specifically includes:
The tapered length that gradual shot is screened from the shot sequence is less than third pre-set length threshold and is more than the 4th The third gradual shot of pre-set length threshold;
The lookup end time is located at initial time and the end time of the third gradual shot from the title sequence Between third title;Next adjacent entitled 4th title of the third title;
It is less than the time when the time difference between the end time and the initial time of the 4th title of the third title When threshold value, then using the gradual shot between the third title and the 4th title as the gradual shot filtered out.
Second aspect, the embodiment of the present invention provide a kind of news segmenting device, the device be applied to news-video into Row segmentation, the device include:
Shot segmentation module, for news-video to be divided into shot sequence, the shot sequence include shearing lens and Gradual shot;
Headline detection module forms title sequence for detecting the title in the news-video;
Judgment module, for judging whether deposited between two adjacent different titles according to the shot sequence and title sequence In gradual shot;
Screening module, for when between two adjacent different titles there are when gradual shot, according to it is described two it is adjacent not News cut-point is screened with the gradual shot between title or described two adjacent different titles, utilizes the news cut-point pair The news-video is split.
Optionally, the screening module, specifically includes:
First screening submodule, for as unit of each title in the title sequence, screening positioned at two it is adjacent not With the gradual shot between title, using the end position of the gradual shot filtered out as the news cut-point.
Optionally, the first screening submodule, specifically includes:
Adjacent title obtains subelement, for obtaining two phases of the time difference less than time threshold from the title sequence Adjacent difference title, described two adjacent different titles are denoted as the first title and the second title, and the time difference is first mark Inscribe the difference between end time and the second start of header time;
Camera lens searches subelement, for searching the first camera lens, the first title end time from the shot sequence At the beginning of first camera lens between the end time;;Next adjacent camera lens of first camera lens is second Camera lens;
First screening subelement, for when second title end time be located at the second camera lens time started with Between end time, and second camera lens is less than the first preset length for the tapered length of gradual shot and second camera lens Threshold value and more than the second pre-set length threshold when, using first camera lens as the gradual shot filtered out.
Optionally, the screening module, specifically includes:
Second screening submodule is front and back adjacent for as unit of each gradual shot in the shot sequence, filtering out The different gradual shot of title, using the end position of the gradual shot filtered out as the news cut-point.
Optionally, the second screening submodule, specifically includes:
Camera lens screens subelement, and the tapered length for screening gradual shot from the shot sequence is default less than third Length threshold and the third gradual shot for being more than the 4th pre-set length threshold;
Title searches subelement, is located at the third gradual shot for searching the end time from the title sequence Third title between initial time and end time;Next adjacent entitled 4th title of the third title;
Second screening subelement, for end time and the 4th title when the third title initial time it Between time difference when being less than time threshold, then using gradual shot between the third title and the 4th title as filtering out Gradual shot.
The third aspect, the embodiment of the present application provide a kind of news splitting equipment, include memory and one or one A above program, either more than one program is stored in memory and is configured to by one or one for one of them It includes the instruction for being operated below that the above processor, which executes the one or more programs,:
News-video is divided into shot sequence, the shot sequence includes shearing lens and gradual shot;
The title detected in the news-video forms title sequence;
Judged to whether there is gradual shot between two adjacent different titles according to the shot sequence and title sequence;
If it is, according to the gradual shot between described two adjacent different titles or described two adjacent different titles News cut-point is screened, the news-video is split using the news cut-point.
Fourth aspect, the embodiment of the present application provide a kind of non-transitorycomputer readable storage medium, when the storage is situated between When instruction in matter is executed by the processor of electronic equipment so that the processor is able to carry out as arbitrary in the above first aspect One news dividing method.
Compared with prior art, the present invention has at least the following advantages:
News dividing method provided in an embodiment of the present invention and device, this method include:News-video is divided into camera lens Sequence, the shot sequence include shearing lens and gradual shot;It detects the title in the news-video and forms title sequence Row;Judged to whether there is gradual shot between two adjacent different titles according to the shot sequence and title sequence;If so, News cut-point is then screened according to the gradual shot between described two adjacent different titles or described two adjacent different titles, The news-video is split using the news cut-point.It can be seen that news segmentation provided in an embodiment of the present invention Method and device can judge to whether there is gradual change mirror between two adjacent different titles according to shot sequence and title sequence Head, Automatic sieve select news cut-point, to be split to news-video using the news cut-point.
Description of the drawings
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments described in application, for those of ordinary skill in the art, without creative efforts, It can also be obtained according to these attached drawings other attached drawings.
Fig. 1 is the flow chart of news dividing method provided by the invention;
Fig. 2 a are a kind of schematic diagram of shearing lens provided by the invention;
Fig. 2 b are a kind of schematic diagram of gradual shot provided by the invention;
Fig. 3 is the side that the gradual shot provided by the invention according between two adjacent different titles screens news cut-point Method flow chart;
Fig. 4 be title each in title sequence provided by the invention as unit of screening be located at two it is adjacent difference titles it Between gradual shot method flow diagram;
Fig. 5 is the method flow diagram provided by the invention that news cut-point is screened according to two adjacent different titles;
Screening is located at before the same gradual shot as unit of Fig. 6 is camera lens each in shot sequence provided by the invention Title and title later method flow diagram;
Fig. 7 is the method flow diagram that detection provided by the invention broadcasts that the title in news forms title sequence;
Fig. 8 is the schematic diagram of news segmenting device provided by the invention.
Specific implementation mode
In order to enable those skilled in the art to better understand the solution of the present invention, below in conjunction in the embodiment of the present invention Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is only this Invention a part of the embodiment, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art exist The every other embodiment obtained under the premise of creative work is not made, shall fall within the protection scope of the present invention.
Inventor has found under study for action, is split to news-video, can be split according to title.But for one For a little news-videos, the form that title occurs is more special.For example, will appear a plurality of title in news item, every title Content all illustrated around the purport of news item, but the content of every title is all different, and is only applicable to explanation and is worked as The content that preceding moment news is stated.Therefore when being split for this kind of news-video, can not have only according to headline The segmentation of the progress news-video of effect, needs to be distinguished by means of other features.
Inventor under study for action by great amount of samples it has been observed that for this kind of news-video, in news item In often there are one title can run through this news always, i.e., from this news item start to finish, which occurs always In video.Also, transition can be carried out to lower news item in a manner of a kind of special gradual change in news ending, occurred simultaneously The heading message of lower news item.In brief, the format of this news-video switching is:Title 1+ gradual shots transition+mark Topic 2.
In consideration of it, inventor proposes that a kind of news dividing method, this method can be applied to be split news-video, This method includes:The news-video is divided into shot sequence, the shot sequence includes shearing lens and gradual shot;Inspection The title surveyed in the news-video forms title sequence;Judge two adjacent differences according to the shot sequence and title sequence It whether there is gradual shot between title;If it is, according to described two adjacent different titles or described two adjacent differences Gradual shot between title screens news cut-point.It can be seen that news dividing method provided in an embodiment of the present invention, not only The segmentation of news-video is carried out according only to headline, but two adjacent differences are judged according to shot sequence and title sequence It whether there is gradual shot between title, to which Automatic sieve selects news cut-point.
First embodiment
Referring to Fig. 1, which is the flow diagram of news dividing method provided in this embodiment.
News dividing method provided in this embodiment, will appear a plurality of title suitable for news item, every title Content is all illustrated around the purport of news item, but the content of every title is all different, and it is current to be only applicable to explanation The segmentation of the news-video for the content that moment news is stated.
News dividing method provided in this embodiment can be realized with S101-S104 as follows.
S101:News-video is divided into shot sequence, the shot sequence includes shearing lens and gradual shot.
It should be noted that the present embodiment does not limit the source of the news-video specifically, it is as an example, described to regard Frequency news can be the local items of local tv station.
It should be noted that video generally can be by multiple group of picture at an and frame image or continuous multiple Frame image can form a camera lens.Therefore, a news-video can be divided into a plurality of lenses.
In the present embodiment, news-video can be divided into a plurality of lenses, and sequentially in time obtain segmentation Camera lens is ranked up, to obtain shot sequence.
In the present embodiment, lens type is divided into shearing lens and gradual shot two types.Wherein, shearing lens are Refer to, a camera lens is rapidly switched to another camera lens, that is to say, that from previous Shot change to cutting the latter camera lens It is very short to change the time, for example, being less than a switching time threshold value.And gradual shot refers to, a camera lens gradually switches to another Camera lens, that is to say, that certain switching time is needed from previous Shot change to the latter camera lens.For example, from previous mirror The time that head switches to another camera lens is more than or equal to switching time threshold value.It should be noted that the present embodiment does not limit specifically The specific setting of the switching time threshold value, switching time threshold value can be specifically arranged according to actual conditions.
For shearing lens and gradual shot, can be understood with reference chart 2a and Fig. 2 b.
Fig. 2 a show a kind of schematic diagram of shearing lens.210 in Fig. 2 a be previous camera lens, after 220 be 210 One camera lens, it can be seen from Fig. 2 a after camera lens 210 switches to 220, the title 211 in 210 all disappears, and switches to The title 221 of lower news item.
Fig. 2 b show a kind of schematic diagram of gradual shot.230 in Fig. 2 b be previous camera lens, after 240 be 230 One camera lens, it can be seen from Fig. 2 b after camera lens 230 switches to 240, the partial content in title 231 in 230 disappears It loses, some title content 241 still exists in camera lens 240.It should be noted that in view of in a news-video Including frame image it is very much, and a camera lens may include multiple frame images.It therefore, in the present embodiment, can be from a mirror The key frame images that can represent this camera lens are selected in multiple frame images that head includes, to reduce in terms of to the news-video Calculation amount.
S101 can be realized in specific implementation with 1-6 as follows.
1, to each frame image in the news-video, RGB (Red Green Blue) color of the frame image is calculated Histogram.
2, the Euclidean distance between the color histogram of the consecutive frame image in time domain is calculated.If Euclidean distance is more than pre- The threshold value Th1 first set, then it is assumed that shear has occurred in camera lens, all videos between record start position and this end position Frame is a camera lens, and the type for recording the camera lens is shearing lens.
The Euclidean distance of color histogram between 3 while the n frames before calculating in present frame and its time domain, if greatly In preset threshold value Th2, then it is assumed that gradual shot has occurred here, between record start position and this end position All video frame be a camera lens, and record camera lens classification be gradual shot.
4, the tapered length L of camera lens is calculated, if camera lens is shearing lens, L=0;If camera lens is gradual shot, gradually The computational methods for becoming length are to be ended up at frame with the camera lens, and in the range of before n frames, for each of which frame, finding expires Foot ending frame is more than the frame of Th2 with the Histogram distance of the frame, which is the value of tapered length L at a distance from ending frame.
5, start position and final position of each camera lens in news-video are recorded, position section can be written as Shot [Tshot_start, Tshot_end, R, L], wherein Shot represents camera lens, and Tshot_start represents the camera lens in news-video In start position;Tshot_end represents end position of the camera lens in news-video;R represents the type of camera lens, and R's takes Value is " shear " or " gradual change ";L represents the tapered length of camera lens.
6, the detection that camera lens is carried out for entire video, has frame sequence to be converted into shot sequence entire video, is configured to Shot0[Tshot_start,Tshot_end,R,L],Shot1[Tshot_start,Tshot_end,R,L],…,ShotN [Tshot_start,Tshot_end,R,L]。
S102:The title in the news-video is detected, title sequence is formed.
It is understood that including multiple titles in title sequence in the present embodiment.
It should be noted that the title referred in the present embodiment refers to the title appeared in the news-video.Namely It says, the title referred in the present embodiment can be the headline of news item, can also be that the headline is surrounded under the headline Purport illustrate, but the subhead suitable for illustrating content that current time news is stated.
In the present embodiment, the time sequencing that can occur in news-video according to title is ranked up, to obtain Title sequence.
S103:Judged to whether there is gradual change mirror between two adjacent different titles according to the shot sequence and title sequence Head.
S104:If it is, according between described two adjacent different titles or described two adjacent different titles gradually Become camera lens and screen news cut-point, the news-video is split using the news cut-point.
About S103 and S104, it should be noted that due to inventor be found that news item ending can be with a kind of spy The mode of different gradual change carries out transition to lower news item, while the heading message of lower news item occurs.That is, this video is new The format for hearing switching is title 1+ gradual shots transition+title 2.Therefore, in the present embodiment, if finding two adjacent titles Between camera lens be gradual shot, then can be confirmed the two titles correspond to two different news, so as to according to two Gradual shot between adjacent difference title or two adjacent different titles, to screen news cut-point, thus not by two It is separated with news.
The news-video is divided into shot sequence, the camera lens by a kind of news dividing method provided in this embodiment Sequence includes shearing lens and gradual shot;The title detected in the news-video forms title sequence;According to the camera lens Sequence and title sequence judge to whether there is gradual shot between two adjacent different titles;If it is, according to described two Gradual shot between adjacent difference title or described two adjacent different titles screens news cut-point.It can be seen that this hair The news dividing method that bright embodiment provides can judge according to shot sequence and title sequence between two adjacent difference titles With the presence or absence of gradual shot, to which Automatic sieve selects news cut-point, to be carried out to news-video using the news cut-point Segmentation.
Second embodiment
A kind of news dividing method that first embodiment provides, proposition can be according to described two adjacent different titles or institutes State the gradual shot screening news cut-point between two adjacent different titles.Second embodiment will specifically be introduced such as in conjunction with attached drawing What screens news cut-point according to the gradual shot between two adjacent different titles.
Referring to Fig. 3, which is that the gradual shot provided in this embodiment according between two adjacent different titles screens newly Hear the flow chart of cut-point.
The method that gradual shot provided in this embodiment according between two adjacent different titles screens news cut-point, It can be realized with S301-S302 as follows.
S301:As unit of each title in the title sequence, screening is located between two adjacent different titles gradually Become camera lens.
It should be noted that S301 can be realized in specific implementation with S401-S403 as follows.
S401:Obtaining the time difference from the title sequence is less than two of time threshold adjacent different titles, and described two A adjacent different titles are denoted as the first title and the second title, and the time difference is the first title end time and described the Difference between two start of header times.
It should be noted that in general, when switching between two different news, even if being cut using gradual shot It changes, switching time will not be too long.Therefore, in the present embodiment, when searching the gradual shot of two adjacent titles so far, first Need to judge the time difference between two titles, only at the beginning of the end time of the first title and the second title between Difference when being less than time threshold, just think that the first title and the second title are likely to be the title of two different news.
It is understood that end time and second title of the time difference for identifying first title Difference between initial time, since the time of occurrence of the second title is later than the first title, so the time difference can be the Two start of header times subtracted for the first title end time.
It should be noted that the present embodiment does not limit the value of the time threshold specifically, the time threshold it is specific Value can specifically be set according to actual conditions.As an example, the time value can be 0.2s.
S402:The first camera lens is searched from the shot sequence, the end time of first title is located at described first At the beginning of camera lens between the end time, next adjacent camera lens of first camera lens is the second camera lens.
S403:When the end time of second title is between the second camera lens starting and end time, And the tapered length that second camera lens is gradual shot and second camera lens is less than the first pre-set length threshold and more than the When two pre-set length thresholds, using first camera lens as the gradual shot filtered out.
About S402 and S403, it should be noted that the end time of first title is located at first camera lens and opens Begin between time and end time to refer to that the first title appears in the first camera lens.The end time of second title is located at Between the second camera lens starting and end time, refer to, the second title appears in the second camera lens.
Also, the second camera lens is gradual shot, illustrates that the second camera lens may be between the first title and the second title gradually Become camera lens.
It should be noted that there are one tapered lengths for gradual shot tool, the tapered length is for identifying the gradual shot Time difference between time started to the end time of the gradual shot.
As it was noted above, when switching between two different news, even if switching over switching time using gradual shot It will not be too long.Also, when being switched over using gradual shot between two different news, the tapered length of the gradual shot also can There are one lower thresholds.That is, the tapered length of the second camera lens should be less than the first pre-set length threshold, and it is more than second Pre-set length threshold.
When the second camera lens is less than the first pre-set length threshold for the tapered length of gradual shot also, the second camera lens and is more than When the second pre-set length threshold, it may be determined that the end position of the previous camera lens of the second camera lens is the segmentation of two different news Point, that is to say, that the end position of the first camera lens is the cut-point of two different news.
It should be noted that the present embodiment does not limit first pre-set length threshold and the second pre-set length threshold specifically Specific value, the first pre-set length threshold and the second pre-set length threshold can specifically be set according to actual conditions.
S302:Using the end position of the gradual shot filtered out as the news cut-point.
About S302, it should be noted that the end position of the gradual shot may be considered what a title disappeared Position, that is to say, that the end position of the gradual shot may be considered the end position of news item.Therefore, it can incite somebody to action Cut-point of the end position of the gradual shot as the news.
Method provided in an embodiment of the present invention, as unit of each title in the title sequence, screening is located at two phases Gradual shot between adjacent difference title, using the end position of the gradual shot filtered out as the news cut-point.Thus As it can be seen that method provided in this embodiment, it can be by judging to whether there is gradual shot, automatic screening between two adjacent titles Go out news cut-point.
3rd embodiment
A kind of news dividing method that first embodiment provides, proposition can be according to described two adjacent different titles or institutes State the gradual shot screening news cut-point between two adjacent different titles.3rd embodiment will specifically be introduced such as in conjunction with attached drawing What screens news cut-point according to two adjacent different titles.
Referring to Fig. 5, which is the method provided in this embodiment for screening news cut-point according to two adjacent different titles Flow chart.
The method provided in this embodiment for screening news cut-point according to two adjacent different titles, can be by walking as follows Rapid S501-S502 is realized.
S501:As unit of each gradual shot in the shot sequence, it is different gradually to filter out front and back adjacent title Become camera lens.
It should be noted that S501 in specific implementation, can be realized with S601-S603 as follows.
S601:The tapered length that gradual shot is screened from the shot sequence is less than third pre-set length threshold and is more than The third gradual shot of 4th pre-set length threshold.
As it was noted above, when switching between two different news, even if switching over switching time using gradual shot Will not be too long, and switching time, there are one lower thresholds.That is, if gradual shot is between two different news switchings The tapered length of gradual shot, the gradual shot should be less than third pre-set length threshold and be more than the 4th pre-set length threshold.
That is, when third camera lens is less than third preset length threshold for the tapered length of gradual shot and third camera lens When being worth and being more than four pre-set length thresholds, which is possible to the gradual change between two different news switchings Camera lens.
It should be noted that the present embodiment does not limit the third pre-set length threshold and the 4th pre-set length threshold specifically Specific value, third pre-set length threshold and the 4th pre-set length threshold can specifically be set according to actual conditions.
S602:The lookup end time is located at initial time and the end of the third gradual shot from the title sequence Third title between time;Next adjacent entitled 4th title of the third title.
S603:It is less than when the time difference between the end time and the initial time of the 4th title of the third title When time threshold, then using the gradual shot between the third title and the 4th title as the gradual shot filtered out.
About S602 and S603, it should be noted that the end time of third title is located at the third gradual shot Between initial time and end time, illustrate that third title appears in third gradual shot.
It is understood that meeting between third title, third gradual shot and the 4th title:Third title+third is gradually Become the news-video switching mode of four title of camera lens+the.
That is, third title and the 4th title may be the title of two different news respectively.But such as institute above It states, it is however generally that, when switching between two different news, even if being switched over using gradual shot, switching time will not be too It is long.That is, the time difference between the time that third title terminates and the time that the 4th title occurs should be unable to be too long, only When difference between having at the beginning of the end time of third title and the 4th title is less than time threshold, third is just thought Title and the 4th title are the titles of two different news.So can by between the third title and the 4th title gradually Become camera lens as the gradual shot filtered out.
S502:Using the end position of the gradual shot filtered out as the news cut-point.
About S502, it should be noted that the end position of the gradual shot may be considered the end of news item Position.It therefore, can be using the end position of the gradual shot as the cut-point of the news.
Method provided in an embodiment of the present invention, as unit of each camera lens in the shot sequence, screening is located at same Title before gradual shot and title later, divide the end position of the title before filtering out as the news Point.It can be seen that method provided in this embodiment, can by judging to whether there is gradual shot between two adjacent titles, Automatic sieve selects news cut-point.
Fourth embodiment
A kind of news dividing method that first embodiment provides.3rd embodiment will specifically introduce the first implementation in conjunction with attached drawing The specific implementation of step S102 in example.
Referring to Fig. 7, which is the flow chart of the title formation title sequence in detection radio hookup news provided in this embodiment.
The method that title in detection radio hookup news provided in this embodiment forms title sequence, can be by following steps S701-S704 is realized.
S701:Select title candidate region.
S701 (1) can be realized in specific implementation to (10) as follows.
(1) selecting video frame bottom section is as title candidate region.
It should be noted that for the video frame of input, since the bottom section of video frame is that most of headline goes out Existing region, therefore selecting video frame bottom section is as title candidate region.That is, in selecting video frame bottom section Image, as image to be detected.In general, title candidate region is rectangular area.
(2) coloured image of selection is converted into gray level image, i.e., the rgb value of image to be detected of selection is converted into ash Angle value, changing formula for gray space is:
Gray=R*0.299+G*0.587+B*0.114.Wherein Gray indicates that gray value, R indicate the value of red channel, G indicates that the value of green channel, B indicate the value of blue channel.
(3) according to the gray value of image to be detected, the edge feature of image is extracted, there are many ways to extracting edge, such as Sobel operators, Canny operators etc..
(4) according to the edge feature of image by edge image binaryzation.
(5) for each channels the RGB of image to be detected, the operation of above step (3) and (4) is executed respectively, obtains three Edge strength the figure Er, Eg, Eb of a channel respectively.Wherein, Er indicates that the edge strength figure of red channel, Eg indicate green channel Edge strength figure, Eb indicate blue channel edge strength figure.
(6) Edge Enhancement is carried out for obtained edge image.
(7) projection that horizontal direction is carried out for final edge image, determines image to be detected side in the horizontal direction Edge.And using the image-region between the horizontal direction edge as first stage candidate region.
(8) for each first stage candidate region.Continue to search for the subtitle region in the first stage candidate region The right boundary in domain.And by the original image in the right boundary region, the candidate region as second stage.
(9) right boundary for finely finding second stage candidate region, as new vertical direction boundary.
(10) rectangular area determined for the above method, is judged using constraints, and constraints includes but not Be limited to, the location information of the starting point of the rectangular area need in certain image range, the rectangular area it is highly desirable one In fixed range etc., if eligible be considered a title candidate region.
S702:For the title candidate region found into line trace.
S702 (1) can be realized in specific implementation to (5) as follows.
(1) determine whether title candidate region described in the first secondary tracking.Wherein, title candidate regions described in the first secondary tracking Domain can refer to and track this region for the first time, after last tracking can also be referred to, then candidate Title area described in secondary tracking.
(2) it due to that may include background area in the video frame candidate region of input, in order to promote the accuracy of tracking, needs Tracing area is set, a following range in video frame is set.
(3) coloured image of selection is converted into gray level image, i.e., by selection by image in selecting video frame tracing area The rgb value of image to be detected is converted to gray value, and changing formula for gray space is:
Gray=R*0.299+G*0.587+B*0.114.Wherein Gray indicates that gray value, R indicate the value of red channel, G indicates that the value of green channel, B indicate the value of blue channel.
(4) determine that method calculates intensity slicing threshold value using adaptive threshold.
(5) by the image binaryzation of image-region, and the color histogram of image in tracing area is calculated.
S703:Judge that the tracing area is a Title area according to the color histogram of the tracing area.
After S703 determines Title area, the title in the Title area is extracted, to obtain the mark in the Title area Topic.
S704:The detection that headline is carried out for entire video, obtains the title of entire news-video, obtains title sequence Row.
It should be noted that in the present embodiment, the testing result of a headline is:Text0[Ttext_start, Ttext_end], wherein Text0 represents title, and at the beginning of Ttext_start represents title, Ttext_end represents title End time.The result of entire video title detection is Text0 [Ttext_start, Ttext_end], Text1 [Ttext_ start,Ttext_end],…,TextM[Ttext_start,Ttext_end]。
Method provided in this embodiment can accurately obtain the title sequence in the news-video, to by sentencing It whether there is gradual shot between disconnected two adjacent titles, accurate Automatic sieve selects news cut-point.
5th embodiment
Based on the news dividing method that first embodiment above to fourth embodiment provides, the present embodiment provides a kind of news Segmenting device.5th embodiment will introduce the device in conjunction with attached drawing.
Referring to Fig. 8, which is the schematic diagram of news segmenting device provided in this embodiment.
News segmenting device 800 provided in this embodiment, the device are applied to be split news-video, the device 800 include:Shot segmentation module 810, headline detection module 820, judgment module 830 and screening module 840.
The shot segmentation module 810, for news-video to be divided into shot sequence, the shot sequence includes shear Camera lens and gradual shot;
The headline detection module 820 forms title sequence for detecting the title in the news-video;
The judgment module 830, for according to the shot sequence and title sequence judge two it is adjacent difference titles it Between whether there is gradual shot;
The screening module 840, for when between two adjacent different titles there are when gradual shot, according to described two Gradual shot between adjacent difference title or described two adjacent different titles screens news cut-point, utilizes the news point Cutpoint is split the news-video.
Optionally, the screening module 840, specifically includes:
First screening submodule, for as unit of each title in the title sequence, screening positioned at two it is adjacent not With the gradual shot between title, using the end position of the gradual shot filtered out as the news cut-point.
Optionally, the first screening submodule, specifically includes:
Adjacent title obtains subelement, for obtaining two phases of the time difference less than time threshold from the title sequence Adjacent difference title, described two adjacent different titles are denoted as the first title and the second title, and the time difference is first mark Inscribe the difference between end time and the second start of header time;
Camera lens searches subelement, for searching the first camera lens, the first title end time from the shot sequence At the beginning of first camera lens between the end time;;Next adjacent camera lens of first camera lens is second Camera lens;
First screening subelement, for when second title end time be located at the second camera lens time started with Between end time, and second camera lens is less than the first preset length for the tapered length of gradual shot and second camera lens Threshold value and more than the second pre-set length threshold when, using first camera lens as the gradual shot filtered out.
Optionally, the screening module 840, specifically includes:
Second screening submodule is front and back adjacent for as unit of each gradual shot in the shot sequence, filtering out The different gradual shot of title, using the end position of the gradual shot filtered out as the news cut-point.
Optionally, the second screening submodule, specifically includes:
Camera lens screens subelement, and the tapered length for screening gradual shot from the shot sequence is default less than third Length threshold and the third gradual shot for being more than the 4th pre-set length threshold;
Title searches subelement, is located at the third gradual shot for searching the end time from the title sequence Third title between initial time and end time;Next adjacent entitled 4th title of the third title;
Second screening subelement, for end time and the 4th title when the third title initial time it Between time difference when being less than time threshold, then using gradual shot between the third title and the 4th title as filtering out Gradual shot.
About the specific implementation of the news segmenting device 800, first embodiment above is referred to 3rd embodiment The description of middle related content, details are not described herein.
The news-video is divided into shot sequence, the camera lens by a kind of news segmenting device provided in this embodiment Sequence includes shearing lens and gradual shot;The title detected in the news-video forms title sequence;According to the camera lens Sequence and title sequence judge to whether there is gradual shot between two adjacent different titles;If it is, according to described two Gradual shot between adjacent difference title or described two adjacent different titles screens news cut-point.It can be seen that this reality Apply example offer news segmenting device, can be judged according to shot sequence and title sequence two it is adjacent difference titles between whether There are gradual shots, to which Automatic sieve selects news cut-point, to be split to news-video using the news cut-point.
Based on the news dividing method that above example provides, the embodiment of the present application also provides a kind of news splitting equipment, The equipment includes that either more than one program one of them or more than one program is stored in by memory and one In memory, and it is configured to execute the one or more programs by one or more than one processor to include to use In the instruction for carrying out following operation:
The news-video is divided into shot sequence, the shot sequence includes shearing lens and gradual shot;
The title detected in news-video forms title sequence;
Judged to whether there is gradual shot between two adjacent different titles according to the shot sequence and title sequence;
If it is, according to the gradual shot between described two adjacent different titles or described two adjacent different titles News cut-point is screened, the news-video is split using the news cut-point.
News splitting equipment provided in this embodiment not only carries out the segmentation of news-video according to headline, and It is to be judged to whether there is gradual shot between two adjacent different titles according to shot sequence and title sequence, to automatic screening Go out news cut-point, to be split to news-video using the news cut-point.
The embodiment of the present application also provides a kind of non-transitorycomputer readable storage medium, the finger in the storage medium When enabling the processor execution by electronic equipment so that the processor is able to carry out as described in first embodiment to 3rd embodiment News dividing method.
The above described is only a preferred embodiment of the present invention, being not intended to limit the present invention in any form.Though So the present invention has been disclosed as a preferred embodiment, and however, it is not intended to limit the invention.It is any to be familiar with those skilled in the art Member, without departing from the scope of the technical proposal of the invention, all using the methods and technical content of the disclosure above to the present invention Technical solution makes many possible changes and modifications, or is revised as the equivalent embodiment of equivalent variations.Therefore, it is every without departing from The content of technical solution of the present invention, according to the technical essence of the invention any simple modification made to the above embodiment, equivalent Variation and modification, still fall within technical solution of the present invention protection in the range of.

Claims (12)

1. a kind of method of news segmentation, which is characterized in that including:
News-video is divided into shot sequence, the shot sequence includes shearing lens and gradual shot;
It detects the title in the news-video and forms title sequence;
Judged to whether there is gradual shot between two adjacent different titles according to the shot sequence and title sequence;
If it is, being screened according to the gradual shot between described two adjacent different titles or described two adjacent different titles News cut-point is split the news-video using the news cut-point.
2. the method for news according to claim 1 segmentation, which is characterized in that according to described two adjacent different titles it Between gradual shot screen news cut-point, specifically include:
As unit of each title in the title sequence, screening is located at the gradual shot between two adjacent different titles, will The end position of the gradual shot filtered out is as the news cut-point.
3. the method for news segmentation according to claim 2, which is characterized in that described each to be marked in the title sequence Entitled unit, screening are located at the gradual shot between two adjacent different titles, specifically include:
Two adjacent different titles of the time difference less than time threshold, described two adjacent differences are obtained from the title sequence Title is denoted as the first title and the second title, and the time difference is the first title end time and second start of header Difference between time;
The first camera lens is searched from the shot sequence, at the beginning of the first title end time is located at first camera lens Between between the end time;
Next adjacent camera lens of first camera lens is the second camera lens;
When the end time of second title is between the second camera lens starting and end time, and described second Camera lens is less than the first pre-set length threshold for the tapered length of gradual shot and second camera lens and is more than the second preset length When threshold value, using first camera lens as the gradual shot filtered out.
4. the method for news segmentation according to claim 1, which is characterized in that described according to described two adjacent different marks Topic screening news cut-point, specifically includes:
As unit of each gradual shot in the shot sequence, the different gradual shot of front and back adjacent title is filtered out, it will The end position of the gradual shot filtered out is as the news cut-point.
5. the method for news according to claim 4 segmentation, which is characterized in that it is described in the shot sequence it is each gradually Change camera lens filters out the different gradual shot of front and back adjacent title, specifically includes into unit:
The tapered length that gradual shot is screened from the shot sequence is less than third pre-set length threshold and is preset more than the 4th The third gradual shot of length threshold;
The lookup end time is located at the initial time of the third gradual shot and between the end time from the title sequence Third title;Next adjacent entitled 4th title of the third title;
It is less than time threshold when the time difference between the end time and the initial time of the 4th title of the third title When, then using the gradual shot between the third title and the 4th title as the gradual shot filtered out.
6. a kind of device of news segmentation, which is characterized in that including:
Shot segmentation module, for news-video to be divided into shot sequence, the shot sequence includes shearing lens and gradual change Camera lens;
Headline detection module forms title sequence for detecting the title in the news-video;
Judgment module, for judging to whether there is gradually between two adjacent different titles according to the shot sequence and title sequence Become camera lens;
Screening module, for when there are when gradual shot, adjacent different being marked according to described two between two adjacent different titles Gradual shot between topic or described two adjacent different titles screens news cut-point, using the news cut-point to described News-video is split.
7. the device of news segmentation according to claim 6, which is characterized in that the screening module specifically includes:
First screening submodule, for as unit of each title in the title sequence, screening to be located at two adjacent different marks Gradual shot between topic, using the end position of the gradual shot filtered out as the news cut-point.
8. the device of news segmentation according to claim 7, which is characterized in that the first screening submodule, it is specific to wrap It includes:
Adjacent title obtains subelement, for obtained from the title sequence time difference be less than two of time threshold it is adjacent not Same title, described two adjacent different titles are denoted as the first title and the second title, and the time difference is the first title knot Difference between beam time and the second start of header time;
Camera lens searches subelement, and for searching the first camera lens from the shot sequence, the first title end time is located at At the beginning of first camera lens between the end time;;Next adjacent camera lens of first camera lens is the second camera lens;
First screening subelement, is located at the second camera lens time started and end for the end time when second title Between time, and second camera lens is less than the first pre-set length threshold for the tapered length of gradual shot and second camera lens And when more than the second pre-set length threshold, using first camera lens as the gradual shot filtered out.
9. the device of news segmentation according to claim 6, which is characterized in that the screening module specifically includes:
Second screening submodule, for as unit of each gradual shot in the shot sequence, filtering out front and back adjacent mark Different gradual shots is inscribed, using the end position of the gradual shot filtered out as the news cut-point.
10. the device of news segmentation according to claim 9, which is characterized in that the second screening submodule, it is specific to wrap It includes:
Camera lens screens subelement, and the tapered length for screening gradual shot from the shot sequence is less than third preset length Threshold value and the third gradual shot for being more than the 4th pre-set length threshold;
Title searches subelement, is located at the starting of the third gradual shot for searching the end time from the title sequence Third title between time and end time;Next adjacent entitled 4th title of the third title;
Second screening subelement, for when between the end time and the initial time of the 4th title of the third title When time difference is less than time threshold, then using the gradual shot between the third title and the 4th title as the gradual change filtered out Camera lens.
11. a kind of news splitting equipment, which is characterized in that include memory and one or more than one program, In one either more than one program be stored in memory and be configured to execute institute by one or more than one processor It states one or more than one program includes the instruction for being operated below:
News-video is divided into shot sequence, the shot sequence includes shearing lens and gradual shot;
The title detected in the news-video forms title sequence;
Judged to whether there is gradual shot between two adjacent different titles according to the shot sequence and title sequence;
If it is, being screened according to the gradual shot between described two adjacent different titles or described two adjacent different titles News cut-point is split the news-video using the news cut-point.
12. a kind of non-transitorycomputer readable storage medium, when the instruction in the storage medium is by the processing of electronic equipment When device executes so that the processor is able to carry out the news dividing method as described in any one of claim 1-5.
CN201810474334.0A 2018-05-17 2018-05-17 News segmentation method and device Active CN108810568B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810474334.0A CN108810568B (en) 2018-05-17 2018-05-17 News segmentation method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810474334.0A CN108810568B (en) 2018-05-17 2018-05-17 News segmentation method and device

Publications (2)

Publication Number Publication Date
CN108810568A true CN108810568A (en) 2018-11-13
CN108810568B CN108810568B (en) 2020-11-27

Family

ID=64092528

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810474334.0A Active CN108810568B (en) 2018-05-17 2018-05-17 News segmentation method and device

Country Status (1)

Country Link
CN (1) CN108810568B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112565820A (en) * 2020-12-24 2021-03-26 新奥特(北京)视频技术有限公司 Video news splitting method and device

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090263098A1 (en) * 2008-04-22 2009-10-22 Samsung Electronics Co., Ltd. Method and apparatus for segmenting recorded news program according to topics
CN101616264A (en) * 2008-06-27 2009-12-30 中国科学院自动化研究所 News video categorization and system
CN102547139A (en) * 2010-12-30 2012-07-04 北京新岸线网络技术有限公司 Method for splitting news video program, and method and system for cataloging news videos
CN102685398A (en) * 2011-09-06 2012-09-19 天脉聚源(北京)传媒科技有限公司 News video scene generating method
CN103051923A (en) * 2013-02-04 2013-04-17 成都索贝数码科技股份有限公司 Lens detection method for high-speed and accurate segmentation
US20140279731A1 (en) * 2013-03-13 2014-09-18 Ivan Bezdomny Inc. System and Method for Automated Text Coverage of a Live Event Using Structured and Unstructured Data Sources
CN104778230A (en) * 2015-03-31 2015-07-15 北京奇艺世纪科技有限公司 Video data segmentation model training method, video data segmenting method, video data segmentation model training device and video data segmenting device
CN104780388A (en) * 2015-03-31 2015-07-15 北京奇艺世纪科技有限公司 Video data partitioning method and device
CN106162223A (en) * 2016-05-27 2016-11-23 北京奇虎科技有限公司 A kind of news video cutting method and device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090263098A1 (en) * 2008-04-22 2009-10-22 Samsung Electronics Co., Ltd. Method and apparatus for segmenting recorded news program according to topics
CN101616264A (en) * 2008-06-27 2009-12-30 中国科学院自动化研究所 News video categorization and system
CN102547139A (en) * 2010-12-30 2012-07-04 北京新岸线网络技术有限公司 Method for splitting news video program, and method and system for cataloging news videos
CN102685398A (en) * 2011-09-06 2012-09-19 天脉聚源(北京)传媒科技有限公司 News video scene generating method
CN103051923A (en) * 2013-02-04 2013-04-17 成都索贝数码科技股份有限公司 Lens detection method for high-speed and accurate segmentation
US20140279731A1 (en) * 2013-03-13 2014-09-18 Ivan Bezdomny Inc. System and Method for Automated Text Coverage of a Live Event Using Structured and Unstructured Data Sources
CN104778230A (en) * 2015-03-31 2015-07-15 北京奇艺世纪科技有限公司 Video data segmentation model training method, video data segmenting method, video data segmentation model training device and video data segmenting device
CN104780388A (en) * 2015-03-31 2015-07-15 北京奇艺世纪科技有限公司 Video data partitioning method and device
CN106162223A (en) * 2016-05-27 2016-11-23 北京奇虎科技有限公司 A kind of news video cutting method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
姜帆等: "新闻视频的场景分段索引及摘要生成", 《计算机学报》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112565820A (en) * 2020-12-24 2021-03-26 新奥特(北京)视频技术有限公司 Video news splitting method and device
CN112565820B (en) * 2020-12-24 2023-03-28 新奥特(北京)视频技术有限公司 Video news splitting method and device

Also Published As

Publication number Publication date
CN108810568B (en) 2020-11-27

Similar Documents

Publication Publication Date Title
CN101616264B (en) Method and system for cataloging news video
US7630021B2 (en) Image processing device and image processing method
US7880815B2 (en) Method for detecting and eliminating flash scene in digital video
US20110286720A1 (en) Electronic apparatus, video processing method, and program
JPH08289244A (en) Method and equipment for television signal sorting
JP2005243035A (en) Apparatus and method for determining anchor shot
CN108093314A (en) A kind of news-video method for splitting and device
CN108256508B (en) News main and auxiliary title detection method and device
CN112752151B (en) Method and device for detecting dynamic advertisement implantation position
CN104735521A (en) Method and device for detecting rolling captions
CN108108733A (en) A kind of news caption detection method and device
CN108710860A (en) A kind of news-video dividing method and device
CN108810568A (en) A kind of method and device of news segmentation
CN100548030C (en) A kind of news main broadcaster's lens detection method based on the space-time strip pattern analysis
CN108446603B (en) News title detection method and device
CN108810569A (en) A kind of news-video dividing method and device
CN108551584A (en) A kind of method and device of news segmentation
CN111615008B (en) Intelligent abstract generation and subtitle reading system based on multi-device experience
CN108710918A (en) A kind of fusion method and device of the multi-modal information of live video
KR20160123647A (en) Apparatus and method for providing additional information usung object tracking
KR101822443B1 (en) Video Abstraction Method and Apparatus using Shot Boundary and caption
CN103051923A (en) Lens detection method for high-speed and accurate segmentation
WO2022145929A1 (en) System and method for automatic video reconstruction with dynamic point of interest
Jindal et al. Efficient and language independent news story segmentation for telecast news videos
Volkmer et al. Gradual transition detection using average frame similarity

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant