CN110278388A - Show generation method, device, equipment and the storage medium of video - Google Patents

Show generation method, device, equipment and the storage medium of video Download PDF

Info

Publication number
CN110278388A
CN110278388A CN201910532395.2A CN201910532395A CN110278388A CN 110278388 A CN110278388 A CN 110278388A CN 201910532395 A CN201910532395 A CN 201910532395A CN 110278388 A CN110278388 A CN 110278388A
Authority
CN
China
Prior art keywords
music
presented
snatch
content
beat
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910532395.2A
Other languages
Chinese (zh)
Other versions
CN110278388B (en
Inventor
黄晨婕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to CN201910532395.2A priority Critical patent/CN110278388B/en
Publication of CN110278388A publication Critical patent/CN110278388A/en
Priority to PCT/CN2020/096969 priority patent/WO2020253806A1/en
Application granted granted Critical
Publication of CN110278388B publication Critical patent/CN110278388B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/68Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0276Advertisement creation
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/03Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Accounting & Taxation (AREA)
  • Acoustics & Sound (AREA)
  • Development Economics (AREA)
  • Strategic Management (AREA)
  • General Physics & Mathematics (AREA)
  • Finance (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Entrepreneurship & Innovation (AREA)
  • General Business, Economics & Management (AREA)
  • Game Theory and Decision Science (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • Library & Information Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The embodiment of the present disclosure discloses a kind of generation method, device, equipment and storage medium for showing video.It include: to obtain at least two pictures and/or characteristic information content to be presented content to be presented;According at least two pictures content to be presented of acquisition and/or the characteristic information determination content to be presented and the matched snatch of music content to be presented;Feature extraction is carried out to the snatch of music, obtains the beat information of the snatch of music;Displaying video is generated according at least two pictures content to be presented and with the matched snatch of music content to be presented.The generation method for the displaying video that the embodiment of the present disclosure provides, obtain the beat information with matched snatch of music content to be presented, it is generated according at least two pictures and snatch of music and shows video, the manufacturing cost for showing video can be reduced, and improve the quality for showing video.

Description

Show generation method, device, equipment and the storage medium of video
Technical field
The embodiment of the present disclosure is related to Internet technical field more particularly to a kind of generation method for showing video, device, sets Standby and storage medium.
Background technique
Advertisement is, by the media of certain forms, to disclose for certain specific demand and widely transmit and believe to the public The publicity measures of breath.The type of advertisement has very much, and wherein video ads are widely closed due to good communication effect Note.
In the prior art, when preparing advertising video, video capture usually is carried out by the commodity that advertiser treats publicity Advertisement video is obtained, which will not only spend a large amount of manpower and material resources, but also shoot the possible effect of advertisement video and pay no attention to Think, to influence the publicity to commodity indirectly.
Summary of the invention
The embodiment of the present disclosure provides a kind of generation method, device, equipment and storage medium for showing video, is shown with reducing The manufacturing cost of video, and improve the quality for showing video.
In a first aspect, the embodiment of the present disclosure provides a kind of generation method for showing video, comprising:
Obtain at least two pictures and/or characteristic information content to be presented content to be presented;
It is true according at least two pictures content to be presented of acquisition and/or the characteristic information content to be presented The fixed and matched snatch of music content to be presented;
Feature extraction is carried out to the snatch of music, obtains the beat information of the snatch of music, the beat information packet Include 1 beat points;
It is generated according at least two pictures content to be presented and with the matched snatch of music content to be presented Show video, wherein the time point that every picture is presented in showing video is corresponding with the beat point in the beat information.
Further, the characteristic information content to be presented includes classification information content to be presented, industry content to be presented Main information and dispensing data content to be presented.
It is further right, according at least two pictures content to be presented of acquisition and/or described content to be presented Characteristic information determination and the matched snatch of music content to be presented, comprising:
Feature extraction is carried out at least two pictures, obtains first eigenvector;
Second feature vector is generated according to the characteristic information;
By the first eigenvector and/or second feature vector input setting neural network model, acquisition and institute State matched snatch of music content to be presented.
Further, feature extraction is carried out to the snatch of music, obtains the beat information of the snatch of music, comprising:
Feature extraction is carried out to snatch of music using mel-frequency cepstrum coefficient algorithm, obtains the stress for meeting and imposing a condition Point;
The one group of stress point of the time interval of adjacent stress point within the set range is obtained, this group of stress point is determined as sound The beat information of happy segment, the beat information include 1 beat points, the stress point in each beat point and group It corresponds.
Further, according at least two pictures content to be presented and with the matched music content to be presented Segment, which generates, shows video, comprising:
On the beat point that at least two pictures are set in the beat information according to setting sequence;
At least two pictures described in being set on beat point and the snatch of music merge, and obtain and show view Frequently.
Further, in the beat being set at least two pictures according to setting sequence in the beat information Point on after, further includes:
Setting is added at least two pictures and plays special efficacy.
Further, in the beat point being set at least two pictures according to setting sequence in the beat information Before upper, further includes:
If the quantity of beat point is greater than the quantity of picture in beat information, shear treatment is carried out to the snatch of music, So that the quantity of beat point is equal with the quantity of picture;
If the quantity of beat point is less than the quantity of picture, the duplicating music sub-pieces from the snatch of music in beat information Section, the music sub-piece is spliced with the snatch of music, forms new snatch of music, so that new snatch of music packet The quantity of the beat point contained is equal with the quantity of picture.
Further, at least two pictures carry out feature extraction, obtain first eigenvector before, further includes:
It obtains and shows video sample collection;
Extract each corresponding first eigenvector of video frame and/or the corresponding second feature of characteristic information for showing video Vector;
Each displaying video is obtained first eigenvector and/or second feature vector input setting neural network Initial snatch of music;The setting neural network includes deep neural network or convolutional neural networks;
The setting mind is adjusted according to the initial snatch of music and the loss function for showing snatch of music in video Through the parameter in network, to be trained to the setting neural network.
Second aspect, the embodiment of the present disclosure additionally provide a kind of generating means for showing video, comprising:
Characteristic information obtains module, for obtaining at least two pictures content to be presented and/or spy content to be presented Reference breath;
Snatch of music determining module, for according at least two pictures content to be presented of acquisition and/or described Characteristic information determination content to be presented and the matched snatch of music content to be presented;
Beat information obtains module, for carrying out feature extraction to the snatch of music, obtains the section of the snatch of music Information is clapped, the beat information includes 1 beat points;
Show video generation module, for according at least two pictures content to be presented and with it is described it is to be presented in Hold matched snatch of music and generate displaying video, wherein the time point and the beat that every picture is presented in showing video Beat point in information is corresponding.
The third aspect, the embodiment of the present disclosure additionally provide a kind of electronic equipment, and the electronic equipment includes:
One or more processing units;
Storage device, for storing one or more programs;
When one or more of programs are executed by one or more of processing units, so that one or more of places Manage the generation method for the displaying video that device is realized as described in the embodiment of the present disclosure.
Fourth aspect, the embodiment of the present disclosure additionally provide a kind of computer-readable medium, are stored thereon with computer program, The generation method of the displaying video as described in the embodiment of the present disclosure is realized when the program is executed by processing unit.
The embodiment of the present disclosure obtains at least two pictures and/or feature content to be presented letter content to be presented first Breath, then according at least two pictures content to be presented of acquisition and/or characteristic information content to be presented determine with wait open up Show the snatch of music of content matching, feature extraction subsequently is carried out to snatch of music, obtains the beat information of snatch of music, finally Displaying video is generated according at least two pictures content to be presented and with matched snatch of music content to be presented.The disclosure is real The generation method for applying the displaying video of example offer, obtains the beat information with matched snatch of music content to be presented, according to extremely Few two pictures and snatch of music, which generate, shows video, can reduce the manufacturing cost for showing video, and improve and show video Quality.
Detailed description of the invention
Fig. 1 is the flow chart for the generation method that one of embodiment of the present disclosure one shows video;
Fig. 2 is the structural schematic diagram for the generating means that one of embodiment of the present disclosure two shows video;
Fig. 3 is the structural schematic diagram of one of the embodiment of the present disclosure three electronic equipment.
Specific embodiment
The disclosure is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining the disclosure, rather than the restriction to the disclosure.It also should be noted that in order to just Part relevant to the disclosure is illustrated only in description, attached drawing rather than entire infrastructure.
Embodiment one
Fig. 1 is a kind of flow chart of the generation method for displaying video that the embodiment of the present disclosure one provides, and the present embodiment can fit For generating the case where showing video according to picture content to be presented, this method can be held by the generating means of displaying video Row, which can be by hardware and/or software sharing, and is typically integrated in electronic equipment.As shown in Figure 1, this method is specific Include the following steps:
Step 110, at least two pictures and/or characteristic information content to be presented content to be presented are obtained.
Wherein, commodity, concert, match race, movie and television play and tourist attractions etc. content to be presented of can be need to publicize Content.Characteristic information content to be presented may include classification information content to be presented, owner's information content to be presented and to Show that content launches data.Owner's information content to be presented can be product side content to be presented, as commodity manufacturer, Sponsor, film-maker of movie and television play of concert etc.;Dispensing data content to be presented, which can be, launches early period content to be presented Consumption, injected volume and click volume afterwards etc..
Specifically, user is content to be presented in order to publicize, at least two pictures content to be presented and to be presented are uploaded The characteristic information of content.
Step 120, true according at least two pictures content to be presented of acquisition and/or characteristic information content to be presented Fixed and matched snatch of music content to be presented.
Wherein, snatch of music is used as the background music for showing video.Specifically, by carrying out feature at least two pictures It extracts, obtains feature content to be presented, matched snatch of music is obtained according to feature content to be presented.Alternatively, straight Connect the snatch of music determining and content to be presented according to the characteristic information of upload.Alternatively, simultaneously according at least two pictures and spy The determination of reference breath and matched snatch of music content to be presented.
In the present embodiment, believed according at least two pictures content to be presented of acquisition and/or feature content to be presented Breath determination and matched snatch of music content to be presented, can be implemented by following manner: carry out feature at least two pictures It extracts, obtains first eigenvector;Second feature vector is generated according to characteristic information;First eigenvector and/or second is special Vector input setting neural network model is levied, is obtained and matched snatch of music content to be presented.
Wherein, setting neural network can be deep neural network (Deep Neural Network, DNN) or convolution Neural network (Convolutional Neural Networks, CNN).In the present embodiment, setting nerve net has according to input First eigenvector and/or the output of second feature vector and the ability of matched snatch of music content to be presented.
In the present embodiment, the mode that at least two pictures carry out feature extraction can be, at least two pictures are inputted into spy Sign extracts neural network and carries out feature extraction, to obtain the corresponding first eigenvector of at least two pictures.Believed according to feature The mode that breath generates second feature vector can be, and obtains vector element corresponding with characteristic information, then forms second feature Vector.
Specifically, after obtaining first eigenvector and second feature vector, by first eigenvector and second feature to Amount or first eigenvector and second feature vector in an input set neural network, thus acquisition with it is to be presented interior Hold matched snatch of music.
Step 130, feature extraction is carried out to snatch of music, obtains the beat information of snatch of music, beat information includes extremely Few two beat points.
In the present embodiment, feature extraction is carried out to snatch of music, the mode for obtaining the beat information of snatch of music may is that Feature extraction is carried out to snatch of music using mel-frequency cepstrum coefficient (Mel-Frequency Cepstrum, MFCC) algorithm, Obtain the stress point for meeting and imposing a condition;The one group of stress point of the time interval of adjacent stress point within the set range is obtained, it will This group of stress point is determined as the beat information of snatch of music.
Wherein, beat information includes 1 beat points, and the stress point in each beat point and group corresponds.Meet The stress point of setting condition can be the music point that sound frequency is more than preset threshold.The time interval of adjacent stress point is being set The time interval that one group of stress point in range can be understood as adjacent stress point is same or similar.
Specifically, being extracted in snatch of music obtaining with after matched snatch of music content to be presented using MFCC algorithm Stress point, then obtain one group of same or similar stress point of the time interval of adjacent stress point, using this group of stress point as The beat information of snatch of music.
Step 140, it is generated according at least two pictures content to be presented and with matched snatch of music content to be presented Show video.
Wherein, the time point that every picture is presented in showing video is corresponding with the beat point in beat information.Specifically, After the beat information for obtaining snatch of music, at least two pictures are set to the point of the beat in beat information according to setting sequence On, at least two pictures and the snatch of music that are set on beat point are merged, obtains and shows video.It will at least two figures Piece is set to right on each beat point that can be understood as in beat information on the point of the beat in beat information according to setting sequence Answer a picture.The shooting time sequence that setting sequence can be the upload sequence of picture or mark in picture, herein not It limits.
Optionally, in the beat point being set at least two pictures according to setting sequence in the beat information Further include following steps after upper: setting being added at least two pictures and plays special efficacy.
Wherein setting play special efficacy may include picture from left to right enter picture, rotate into picture, from top to bottom into Enter the special efficacys such as picture.In the present embodiment, setting is added at least two pictures and plays special efficacy, so that in playing display video, It shows that the picture in video plays special effect play according to setting, increases the interest for showing video.
Optionally, before being set at least two pictures on the point of the beat in beat information according to setting sequence, also If including the following steps:, the quantity of beat point in beat information is greater than the quantity of picture, carries out shear treatment to snatch of music, So that the quantity of beat point is equal with the quantity of picture;If the quantity of beat point is less than the quantity of picture in beat information, from Music sub-piece is spliced with snatch of music, forms new snatch of music by duplicating music sub-piece in snatch of music, so that The quantity for the beat point that new snatch of music includes is equal with the quantity of picture.
Wherein, the mode for carrying out shear treatment to snatch of music can be since at the beginning of snatch of music or ending Shearing can determine the size of the segment of shearing according to the quantity of beat point and the quantity of picture.The length of music sub-piece can To determine that the mode of duplicating music sub-piece can be from snatch of music from snatch of music according to beat quantity and picture number Start the music sub-piece of duplication certain length at beginning and end.The advantage of doing so is that so that picture number and musical film The length matching of section.
The technical solution of the present embodiment obtains at least two pictures content to be presented and/or content to be presented first Then characteristic information is determined according at least two pictures content to be presented of acquisition and/or characteristic information content to be presented With matched snatch of music content to be presented, feature extraction subsequently is carried out to snatch of music, obtains the beat letter of snatch of music Breath finally generates displaying video according at least two pictures content to be presented and with matched snatch of music content to be presented. The generation method for the displaying video that the embodiment of the present disclosure provides, obtains and believes with the beat of matched snatch of music content to be presented Breath generates according at least two pictures and snatch of music and shows video, can reduce the manufacturing cost for showing video, and improve exhibition Show the quality of video.
Optionally, feature extraction is carried out at least two pictures, further includes walking as follows before obtaining first eigenvector It is rapid: to obtain and show video sample collection;Extract each corresponding first eigenvector of video frame and/or characteristic information for showing video Corresponding second feature vector;For each displaying video, by first eigenvector and/or second feature vector input setting mind Through network, initial snatch of music is obtained;According to initial snatch of music and show that the loss function adjustment of snatch of music in video is set The parameter in neural network is determined, to be trained to setting neural network.
Wherein, show that video sample can be issued video.It is corresponding to extract each video frame for showing video The process of first eigenvector can be, and will show that all or part of video frame input feature vector that video includes extracts nerve net In network, the first eigenvector of current presentation video sample is obtained.Extract each characteristic information corresponding second for showing video The mode of feature vector can be, and according to the classification information of current presentation video, owner's information and launch the characteristic informations such as data Generate second feature vector.
Specifically, the first eigenvector of current presentation video and/or the input of second feature vector are set nerve net After network, initial snatch of music is obtained, then calculates the loss function of snatch of music in initial snatch of music and current presentation video, By loss function in setting neural network reverse transfer, the parameter in percentage regulation neural network, to deep neural network It is trained.
In the present embodiment, by showing that video sample collection is trained setting neural network, setting nerve can be improved The accuracy of identification of network.
Embodiment two
Fig. 2 is a kind of structural schematic diagram of the generating means for displaying video that the embodiment of the present disclosure two provides.Such as Fig. 2 institute Show, which includes: that characteristic information obtains module 210, snatch of music determining module 220, and beat information obtains module 230 and exhibition Show video generation module 240.
Characteristic information obtains module 210, for obtaining at least two pictures content to be presented and/or content to be presented Characteristic information;
Snatch of music determining module 220, for according at least two pictures content to be presented of acquisition and/or to be presented Characteristic information determination and the matched snatch of music content to be presented of content;
Beat information obtains module 230, for carrying out feature extraction to snatch of music, obtains the beat letter of snatch of music Breath, beat information include 1 beat points;
Show video generation module 240, for according at least two pictures content to be presented and with content to be presented The snatch of music matched, which generates, shows video, wherein in the time point and beat information that every picture is presented in showing video Beat point is corresponding.
Optionally, characteristic information content to be presented includes classification information content to be presented, owner's information content to be presented And dispensing data content to be presented.
Optionally, snatch of music determining module 220, is also used to:
Feature extraction is carried out at least two pictures, obtains first eigenvector;
Second feature vector is generated according to characteristic information;
By first eigenvector and/or second feature vector input setting neural network model, obtain with it is content to be presented Matched snatch of music.
Optionally, beat information obtains module 230, is also used to:
Feature extraction is carried out to snatch of music using mel-frequency cepstrum coefficient algorithm, obtains the stress for meeting and imposing a condition Point;
The one group of stress point of the time interval of adjacent stress point within the set range is obtained, this group of stress point is determined as sound The beat information of happy segment, beat information include 1 beat points, and the stress point in each beat point and group corresponds.
Optionally, it shows video generation module 240, is also used to:
At least two pictures are set on the point of the beat in beat information according to setting sequence;
At least two pictures and the snatch of music that are set on beat point are merged, obtains and shows video.
Optionally, further includes:
Setting plays special efficacy adding module, plays special efficacy for adding setting at least two pictures.
Optionally, further includes: snatch of music adjusts module, is used for:
If the quantity of beat point is greater than the quantity of picture in beat information, shear treatment is carried out to snatch of music, so that The quantity of beat point is equal with the quantity of picture;
If quantity of the quantity of beat point less than picture in beat information, the duplicating music sub-piece from snatch of music, Music sub-piece is spliced with snatch of music, forms new snatch of music, so that the beat point that new snatch of music includes Quantity it is equal with the quantity of picture.
Optionally, further includes: setting neural metwork training module is used for
It obtains and shows video sample collection;
Extract each corresponding first eigenvector of video frame and/or the corresponding second feature of characteristic information for showing video Vector;
Each displaying video is obtained first eigenvector and/or second feature vector input setting neural network Initial snatch of music;Setting neural network includes deep neural network or convolutional neural networks;
According to initial snatch of music and show that the loss function adjustment of snatch of music in video sets the ginseng in neural network Number, to be trained to setting neural network.
Method provided by the aforementioned all embodiments of the disclosure can be performed in above-mentioned apparatus, and it is corresponding to have the execution above method Functional module and beneficial effect.The not technical detail of detailed description in the present embodiment, reference can be made to the aforementioned all implementations of the disclosure Method provided by example.
Embodiment three
Below with reference to Fig. 3, it illustrates the structural representations for the electronic equipment 300 for being suitable for being used to realize the embodiment of the present disclosure Figure.Electronic equipment in the embodiment of the present disclosure can include but is not limited to such as mobile phone, laptop, digital broadcasting and connect Receive device, PDA (personal digital assistant), PAD (tablet computer), PMP (portable media player), car-mounted terminal (such as vehicle Carry navigation terminal) etc. mobile terminal and such as number TV, desktop computer etc. fixed terminal or various forms Server, such as separate server or server cluster.Electronic equipment shown in Fig. 3 is only an example, should not be to this The function and use scope of open embodiment bring any restrictions.
As shown in figure 3, electronic equipment 300 may include processing unit (such as central processing unit, graphics processor etc.) 301, random visit can be loaded into according to the program being stored in read-only memory device (ROM) 302 or from storage device 305 It asks the program in storage device (RAM) 303 and executes various movements appropriate and processing.In RAM 303, it is also stored with electronics Equipment 300 operates required various programs and data.Processing unit 301, ROM 302 and RAM 303 pass through bus 304 each other It is connected.Input/output (I/O) interface 305 is also connected to bus 304.
In general, following device can connect to I/O interface 305: including such as touch screen, touch tablet, keyboard, mouse, taking the photograph As the input unit 306 of head, microphone, accelerometer, gyroscope etc.;Including such as liquid crystal display (LCD), loudspeaker, vibration The output device 307 of dynamic device etc.;Storage device 308 including such as tape, hard disk etc.;And communication device 309.Communication device 309, which can permit electronic equipment 300, is wirelessly or non-wirelessly communicated with other equipment to exchange data.Although Fig. 3 shows tool There is the electronic equipment 300 of various devices, it should be understood that being not required for implementing or having all devices shown.It can be with Alternatively implement or have more or fewer devices.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer-readable medium On computer program, which includes program code for executing the recommended method of word.In such implementation In example, which can be downloaded and installed from network by communication device 309, or from 305 quilt of storage device Installation, or be mounted from ROM 302.When the computer program is executed by processing unit 301, the embodiment of the present disclosure is executed The above-mentioned function of being limited in method.
It should be noted that the above-mentioned computer-readable medium of the disclosure can be computer-readable signal media or meter Calculation machine readable storage medium storing program for executing either the two any combination.Computer readable storage medium for example can be --- but not Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination.Meter The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, just of one or more conducting wires Take formula computer disk, hard disk, random access memory device (RAM), read-only memory device (ROM), erasable type may be programmed it is read-only Storage device (EPROM or flash memory), optical fiber, portable compact disc read-only memory device (CD-ROM), light storage device part, magnetic Storage device part or above-mentioned any appropriate combination.In the disclosure, computer readable storage medium can be any packet Contain or store the tangible medium of program, which can be commanded execution system, device or device use or in connection It uses.And in the disclosure, computer-readable signal media may include propagating in a base band or as carrier wave a part Data-signal, wherein carrying computer-readable program code.The data-signal of this propagation can take various forms, packet Include but be not limited to electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be meter Any computer-readable medium other than calculation machine readable storage medium storing program for executing, which can send, propagate or Person's transmission is for by the use of instruction execution system, device or device or program in connection.Computer-readable Jie The program code for including in matter can transmit with any suitable medium, including but not limited to: electric wire, optical cable, RF (radio frequency) etc. Deng or above-mentioned any appropriate combination.
Above-mentioned computer-readable medium can be included in above-mentioned electronic equipment;It is also possible to individualism, and not It is fitted into the electronic equipment.
Above-mentioned computer-readable medium carries one or more program, when said one or multiple programs are by this When managing device execution, so that the electronic equipment: obtaining at least two pictures content to be presented and/or feature content to be presented Information;It is determined according at least two pictures content to be presented of acquisition and/or the characteristic information content to be presented With the matched snatch of music content to be presented;Feature extraction is carried out to the snatch of music, obtains the snatch of music Beat information, the beat information include 1 beat points;According at least two pictures content to be presented and with The matched snatch of music content to be presented, which generates, shows video, wherein the time that every picture is presented in showing video Point is corresponding with the beat point in the beat information.
The calculating of the operation for executing the disclosure can be write with one or more programming languages or combinations thereof Machine program code, above procedure design language include object oriented program language-such as Java, Smalltalk, C+ +, it further include conventional procedural programming language-such as " C " language or similar programming language.Program code can Fully to execute, partly execute on the user computer on the user computer, be executed as an independent software package, Part executes on the remote computer or executes on a remote computer or server completely on the user computer for part. In situations involving remote computers, remote computer can pass through the network of any kind --- including local area network (LAN) Or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as utilize Internet service Provider is connected by internet).
Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the disclosure, method and computer journey The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation A part of one module, program segment or code of table, a part of the module, program segment or code include one or more use The executable instruction of the logic function as defined in realizing.It should also be noted that in some implementations as replacements, being marked in box The function of note can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are actually It can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it to infuse Meaning, the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart can be with holding The dedicated hardware based system of functions or operations as defined in row is realized, or can use specialized hardware and computer instruction Combination realize.
Being described in unit involved in the embodiment of the present disclosure can be realized by way of software, can also be by hard The mode of part is realized.Wherein, the title of module does not constitute the restriction to the module itself under certain conditions, for example, obtaining Modulus block be also described as " obtain promotional content it is associated can operational controls module ".
Note that above are only the preferred embodiment and institute's application technology principle of the disclosure.It will be appreciated by those skilled in the art that The present disclosure is not limited to specific embodiments described here, be able to carry out for a person skilled in the art it is various it is apparent variation, The protection scope readjusted and substituted without departing from the disclosure.Therefore, although being carried out by above embodiments to the disclosure It is described in further detail, but the disclosure is not limited only to above embodiments, in the case where not departing from disclosure design, also It may include more other equivalent embodiments, and the scope of the present disclosure is determined by the scope of the appended claims.

Claims (11)

1. a kind of generation method for showing video characterized by comprising
Obtain at least two pictures and/or characteristic information content to be presented content to be presented;
According at least two pictures content to be presented of acquisition and/or the characteristic information content to be presented determine with The matched snatch of music content to be presented;
Feature extraction is carried out to the snatch of music, obtains the beat information of the snatch of music, the beat information includes extremely Few two beat points;
Displaying is generated according at least two pictures content to be presented and with the matched snatch of music content to be presented Video, wherein the time point that every picture is presented in showing video is corresponding with the beat point in the beat information.
2. the method according to claim 1, wherein the characteristic information content to be presented includes in be presented Hold classification information, owner's information content to be presented and dispensing data content to be presented.
3. method according to claim 1 or 2, which is characterized in that according to described content to be presented at least the two of acquisition Picture and/or the characteristic information determination content to be presented and the matched snatch of music content to be presented, comprising:
Feature extraction is carried out at least two pictures, obtains first eigenvector;
Second feature vector is generated according to the characteristic information;
By the first eigenvector and/or the second feature vector input setting neural network model, obtain with it is described to Show the snatch of music of content matching.
4. the method according to claim 1, wherein to snatch of music progress feature extraction, described in acquisition The beat information of snatch of music, comprising:
Feature extraction is carried out to snatch of music using mel-frequency cepstrum coefficient algorithm, obtains the stress point for meeting and imposing a condition;
The one group of stress point of the time interval of adjacent stress point within the set range is obtained, this group of stress point is determined as musical film The beat information of section, the beat information include 1 beat points, and the stress point in each beat point and group is one by one It is corresponding.
5. the method according to claim 1, wherein according at least two pictures content to be presented and with The matched snatch of music content to be presented, which generates, shows video, comprising:
On the beat point that at least two pictures are set in the beat information according to setting sequence;
At least two pictures described in being set on beat point and the snatch of music merge, and obtain and show video.
6. according to the method described in claim 5, it is characterized in that, at least two pictures are set according to setting sequence After being placed on the beat point in the beat information, further includes:
Setting is added at least two pictures and plays special efficacy.
7. according to the method described in claim 5, it is characterized in that, at least two pictures are arranged according to setting sequence Before on beat point in the beat information, further includes:
If the quantity of beat point is greater than the quantity of picture in beat information, shear treatment is carried out to the snatch of music, so that The quantity of beat point is equal with the quantity of picture;
If quantity of the quantity of beat point less than picture in beat information, the duplicating music sub-piece from the snatch of music, The music sub-piece is spliced with the snatch of music, new snatch of music is formed, so that new snatch of music includes Beat point quantity it is equal with the quantity of picture.
8. according to the method described in claim 3, it is characterized in that, carrying out feature extraction, acquisition at least two pictures Before first eigenvector, further includes:
It obtains and shows video sample collection;
Extract it is each show video the corresponding first eigenvector of video frame and/or the corresponding second feature of characteristic information to Amount;
Each displaying video is obtained first eigenvector and/or second feature vector input setting neural network initial Snatch of music;The setting neural network includes deep neural network or convolutional neural networks;
The setting nerve net is adjusted according to the initial snatch of music and the loss function for showing snatch of music in video Parameter in network, to be trained to the setting neural network.
9. a kind of generating means for showing video characterized by comprising
Characteristic information obtains module, for obtaining at least two pictures and/or feature content to be presented letter content to be presented Breath;
Snatch of music determining module, for according at least two pictures content to be presented of acquisition and/or described wait open up Show that the characteristic information of content determines and the matched snatch of music content to be presented;
Beat information obtains module, for carrying out feature extraction to the snatch of music, obtains the beat letter of the snatch of music Breath, the beat information include 1 beat points;
Show video generation module, for according at least two pictures content to be presented and with described content to be presented The snatch of music matched, which generates, shows video, wherein the time point and the beat information that every picture is presented in showing video In beat point it is corresponding.
10. a kind of electronic equipment, which is characterized in that the electronic equipment includes:
One or more processing units;
Storage device, for storing one or more programs;
When one or more of programs are executed by one or more of processing units, so that one or more of processing fill It sets and realizes such as the generation method described in any one of claims 1-8 for showing video.
11. a kind of computer-readable medium, is stored thereon with computer program, which is characterized in that the program is held by processing unit It is realized when row such as the generation method described in any one of claims 1-8 for showing video.
CN201910532395.2A 2019-06-19 2019-06-19 Display video generation method, device, equipment and storage medium Active CN110278388B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910532395.2A CN110278388B (en) 2019-06-19 2019-06-19 Display video generation method, device, equipment and storage medium
PCT/CN2020/096969 WO2020253806A1 (en) 2019-06-19 2020-06-19 Method and apparatus for generating display video, device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910532395.2A CN110278388B (en) 2019-06-19 2019-06-19 Display video generation method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110278388A true CN110278388A (en) 2019-09-24
CN110278388B CN110278388B (en) 2022-02-22

Family

ID=67961271

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910532395.2A Active CN110278388B (en) 2019-06-19 2019-06-19 Display video generation method, device, equipment and storage medium

Country Status (2)

Country Link
CN (1) CN110278388B (en)
WO (1) WO2020253806A1 (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111010611A (en) * 2019-12-03 2020-04-14 北京达佳互联信息技术有限公司 Electronic album obtaining method and device, computer equipment and storage medium
CN111432141A (en) * 2020-03-31 2020-07-17 北京字节跳动网络技术有限公司 Method, device and equipment for determining mixed-cut video and storage medium
CN111756953A (en) * 2020-07-14 2020-10-09 北京字节跳动网络技术有限公司 Video processing method, device, equipment and computer readable medium
CN111813970A (en) * 2020-07-14 2020-10-23 广州酷狗计算机科技有限公司 Multimedia content display method, device, terminal and storage medium
WO2020253806A1 (en) * 2019-06-19 2020-12-24 北京字节跳动网络技术有限公司 Method and apparatus for generating display video, device and storage medium
CN112489681A (en) * 2020-11-23 2021-03-12 瑞声新能源发展(常州)有限公司科教城分公司 Beat recognition method, beat recognition device and storage medium
WO2021098670A1 (en) * 2019-11-18 2021-05-27 北京字节跳动网络技术有限公司 Video generation method and apparatus, electronic device, and computer-readable medium
CN113223487A (en) * 2020-02-05 2021-08-06 字节跳动有限公司 Information identification method and device, electronic equipment and storage medium
CN113438547A (en) * 2021-05-28 2021-09-24 北京达佳互联信息技术有限公司 Music generation method and device, electronic equipment and storage medium
CN113473177A (en) * 2021-05-27 2021-10-01 北京达佳互联信息技术有限公司 Music recommendation method and device, electronic equipment and computer readable storage medium
CN113655930A (en) * 2021-08-30 2021-11-16 北京字跳网络技术有限公司 Information publishing method, information display method and device, electronic equipment and medium
WO2022083148A1 (en) * 2020-10-20 2022-04-28 北京字节跳动网络技术有限公司 Special effect display method and apparatus, electronic device, and computer-readable medium
CN115243107A (en) * 2022-07-08 2022-10-25 华人运通(上海)云计算科技有限公司 Method, device, system, electronic equipment and medium for playing short video
CN115243101A (en) * 2022-06-20 2022-10-25 上海众源网络有限公司 Video dynamic and static rate identification method and device, electronic equipment and storage medium
EP4044616A4 (en) * 2019-11-15 2022-12-07 Beijing Bytedance Network Technology Co., Ltd. Method and apparatus for generating video, electronic device, and computer readable medium
WO2023001115A1 (en) * 2021-07-23 2023-01-26 花瓣云科技有限公司 Video generation method, electronic device and medium
WO2023091090A3 (en) * 2021-11-18 2023-08-10 脸萌有限公司 Video generation method, apparatus, device and storage medium
CN116800908A (en) * 2022-03-18 2023-09-22 北京字跳网络技术有限公司 Video generation method and device, electronic equipment and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114329001B (en) * 2021-12-23 2023-04-28 游艺星际(北京)科技有限公司 Display method and device of dynamic picture, electronic equipment and storage medium

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101727943A (en) * 2009-12-03 2010-06-09 北京中星微电子有限公司 Method and device for dubbing music in image and image display device
US7793208B2 (en) * 2007-09-21 2010-09-07 Adobe Systems Inc. Video editing matched to musical beats
CN102256030A (en) * 2010-05-20 2011-11-23 Tcl集团股份有限公司 Photo album showing system capable of matching background music and background matching method thereof
CN102403011A (en) * 2010-09-14 2012-04-04 北京中星微电子有限公司 Music output method and device
US20140317480A1 (en) * 2013-04-23 2014-10-23 Microsoft Corporation Automatic music video creation from a set of photos
CN104202540A (en) * 2014-09-28 2014-12-10 北京金山安全软件有限公司 Method and system for generating video by using picture
CN105550251A (en) * 2015-12-08 2016-05-04 小米科技有限责任公司 Picture play method and device
CN107743268A (en) * 2017-09-26 2018-02-27 维沃移动通信有限公司 The edit methods and mobile terminal of a kind of video
CN108920648A (en) * 2018-07-03 2018-11-30 四川大学 It is a kind of based on music-image, semantic relationship across mode matching method
CN109256146A (en) * 2018-10-30 2019-01-22 腾讯音乐娱乐科技(深圳)有限公司 Audio-frequency detection, device and storage medium
CN109618222A (en) * 2018-12-27 2019-04-12 北京字节跳动网络技术有限公司 A kind of splicing video generation method, device, terminal device and storage medium
CN109697236A (en) * 2018-11-06 2019-04-30 建湖云飞数据科技有限公司 A kind of multi-medium data match information processing method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7904815B2 (en) * 2003-06-30 2011-03-08 Microsoft Corporation Content-based dynamic photo-to-video methods and apparatuses
CN105072354A (en) * 2015-07-17 2015-11-18 Tcl集团股份有限公司 Method and system of synthesizing video stream by utilizing a plurality of photographs
CN110278388B (en) * 2019-06-19 2022-02-22 北京字节跳动网络技术有限公司 Display video generation method, device, equipment and storage medium

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7793208B2 (en) * 2007-09-21 2010-09-07 Adobe Systems Inc. Video editing matched to musical beats
CN101727943A (en) * 2009-12-03 2010-06-09 北京中星微电子有限公司 Method and device for dubbing music in image and image display device
CN102256030A (en) * 2010-05-20 2011-11-23 Tcl集团股份有限公司 Photo album showing system capable of matching background music and background matching method thereof
CN102403011A (en) * 2010-09-14 2012-04-04 北京中星微电子有限公司 Music output method and device
US20140317480A1 (en) * 2013-04-23 2014-10-23 Microsoft Corporation Automatic music video creation from a set of photos
CN104202540A (en) * 2014-09-28 2014-12-10 北京金山安全软件有限公司 Method and system for generating video by using picture
CN105550251A (en) * 2015-12-08 2016-05-04 小米科技有限责任公司 Picture play method and device
CN107743268A (en) * 2017-09-26 2018-02-27 维沃移动通信有限公司 The edit methods and mobile terminal of a kind of video
CN108920648A (en) * 2018-07-03 2018-11-30 四川大学 It is a kind of based on music-image, semantic relationship across mode matching method
CN109256146A (en) * 2018-10-30 2019-01-22 腾讯音乐娱乐科技(深圳)有限公司 Audio-frequency detection, device and storage medium
CN109697236A (en) * 2018-11-06 2019-04-30 建湖云飞数据科技有限公司 A kind of multi-medium data match information processing method
CN109618222A (en) * 2018-12-27 2019-04-12 北京字节跳动网络技术有限公司 A kind of splicing video generation method, device, terminal device and storage medium

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020253806A1 (en) * 2019-06-19 2020-12-24 北京字节跳动网络技术有限公司 Method and apparatus for generating display video, device and storage medium
EP4044616A4 (en) * 2019-11-15 2022-12-07 Beijing Bytedance Network Technology Co., Ltd. Method and apparatus for generating video, electronic device, and computer readable medium
JP7503629B2 (en) 2019-11-15 2024-06-20 北京字節跳動網絡技術有限公司 VIDEO GENERATION METHOD AND APPARATUS, ELECTRONIC DEVICE, AND COMPUTER READABLE MEDIUM - Patent application
JP2023501694A (en) * 2019-11-15 2023-01-18 北京字節跳動網絡技術有限公司 Methods and apparatus for producing video, electronic devices, and computer readable media
US11818424B2 (en) 2019-11-15 2023-11-14 Beijing Bytedance Network Technology Co., Ltd. Method and apparatus for generating video, electronic device, and computer readable medium
US11636879B2 (en) 2019-11-18 2023-04-25 Beijing Bytedance Network Technology Co., Ltd. Video generating method, apparatus, electronic device, and computer-readable medium
WO2021098670A1 (en) * 2019-11-18 2021-05-27 北京字节跳动网络技术有限公司 Video generation method and apparatus, electronic device, and computer-readable medium
CN111010611A (en) * 2019-12-03 2020-04-14 北京达佳互联信息技术有限公司 Electronic album obtaining method and device, computer equipment and storage medium
CN113223487B (en) * 2020-02-05 2023-10-17 字节跳动有限公司 Information identification method and device, electronic equipment and storage medium
CN113223487A (en) * 2020-02-05 2021-08-06 字节跳动有限公司 Information identification method and device, electronic equipment and storage medium
CN111432141A (en) * 2020-03-31 2020-07-17 北京字节跳动网络技术有限公司 Method, device and equipment for determining mixed-cut video and storage medium
CN111813970A (en) * 2020-07-14 2020-10-23 广州酷狗计算机科技有限公司 Multimedia content display method, device, terminal and storage medium
CN111756953A (en) * 2020-07-14 2020-10-09 北京字节跳动网络技术有限公司 Video processing method, device, equipment and computer readable medium
WO2022083148A1 (en) * 2020-10-20 2022-04-28 北京字节跳动网络技术有限公司 Special effect display method and apparatus, electronic device, and computer-readable medium
US12112414B2 (en) 2020-10-20 2024-10-08 Beijing Bytedance Network Technology Co., Ltd. Method, apparatus, electronic device, and computer-readable medium for displaying special effects
CN112489681B (en) * 2020-11-23 2024-08-16 瑞声新能源发展(常州)有限公司科教城分公司 Beat recognition method, device and storage medium
CN112489681A (en) * 2020-11-23 2021-03-12 瑞声新能源发展(常州)有限公司科教城分公司 Beat recognition method, beat recognition device and storage medium
CN113473177A (en) * 2021-05-27 2021-10-01 北京达佳互联信息技术有限公司 Music recommendation method and device, electronic equipment and computer readable storage medium
CN113473177B (en) * 2021-05-27 2023-10-31 北京达佳互联信息技术有限公司 Music recommendation method, device, electronic equipment and computer readable storage medium
CN113438547B (en) * 2021-05-28 2022-03-25 北京达佳互联信息技术有限公司 Music generation method and device, electronic equipment and storage medium
CN113438547A (en) * 2021-05-28 2021-09-24 北京达佳互联信息技术有限公司 Music generation method and device, electronic equipment and storage medium
WO2023001115A1 (en) * 2021-07-23 2023-01-26 花瓣云科技有限公司 Video generation method, electronic device and medium
CN113655930B (en) * 2021-08-30 2023-01-10 北京字跳网络技术有限公司 Information publishing method, information display method and device, electronic equipment and medium
CN113655930A (en) * 2021-08-30 2021-11-16 北京字跳网络技术有限公司 Information publishing method, information display method and device, electronic equipment and medium
WO2023091090A3 (en) * 2021-11-18 2023-08-10 脸萌有限公司 Video generation method, apparatus, device and storage medium
CN116800908A (en) * 2022-03-18 2023-09-22 北京字跳网络技术有限公司 Video generation method and device, electronic equipment and storage medium
CN115243101B (en) * 2022-06-20 2024-04-12 上海众源网络有限公司 Video dynamic and static ratio identification method and device, electronic equipment and storage medium
CN115243101A (en) * 2022-06-20 2022-10-25 上海众源网络有限公司 Video dynamic and static rate identification method and device, electronic equipment and storage medium
CN115243107B (en) * 2022-07-08 2023-11-21 华人运通(上海)云计算科技有限公司 Method, device, system, electronic equipment and medium for playing short video
CN115243107A (en) * 2022-07-08 2022-10-25 华人运通(上海)云计算科技有限公司 Method, device, system, electronic equipment and medium for playing short video

Also Published As

Publication number Publication date
WO2020253806A1 (en) 2020-12-24
CN110278388B (en) 2022-02-22

Similar Documents

Publication Publication Date Title
CN110278388A (en) Show generation method, device, equipment and the storage medium of video
CN109618222B (en) A kind of splicing video generation method, device, terminal device and storage medium
US10182095B2 (en) Method and system for video call using two-way communication of visual or auditory effect
CN107871500A (en) One kind plays multimedia method and apparatus
CN108989882A (en) Method and apparatus for exporting the snatch of music in video
CN110189394B (en) Mouth shape generation method and device and electronic equipment
CN108446385A (en) Method and apparatus for generating information
CN110401844A (en) Generation method, device, equipment and the readable medium of net cast strategy
CN112153460B (en) Video dubbing method and device, electronic equipment and storage medium
CN109408189A (en) Dynamic adjusting method, device, equipment and the medium of client end interface layout
CN109121022A (en) Method and device for marking video segment
CN110069191B (en) Terminal-based image dragging deformation implementation method and device
CN110276646A (en) For the data processing method of pushed information, device and electronic equipment
CN109982130A (en) A kind of video capture method, apparatus, electronic equipment and storage medium
CN108959087A (en) test method and device
CN109582825A (en) Method and apparatus for generating information
CN115190366B (en) Information display method, device, electronic equipment and computer readable medium
WO2024001545A1 (en) Song list display information generation method and apparatus, electronic device and storage medium
CN111726685A (en) Video processing method, video processing device, electronic equipment and medium
CN110149545B (en) User information processing method and device, electronic equipment and readable storage medium
CN109816670B (en) Method and apparatus for generating image segmentation model
WO2024078293A1 (en) Image processing method and apparatus, electronic device, and storage medium
CN104681048A (en) Multimedia read control device, curve acquiring device, electronic equipment and curve providing device and method
WO2023061229A1 (en) Video generation method and device
CN115665435A (en) Live broadcast processing method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant