CN108322802A - Stick picture disposing method, computer readable storage medium and the terminal of video image - Google Patents
Stick picture disposing method, computer readable storage medium and the terminal of video image Download PDFInfo
- Publication number
- CN108322802A CN108322802A CN201711476832.0A CN201711476832A CN108322802A CN 108322802 A CN108322802 A CN 108322802A CN 201711476832 A CN201711476832 A CN 201711476832A CN 108322802 A CN108322802 A CN 108322802A
- Authority
- CN
- China
- Prior art keywords
- beat point
- textures
- music
- point
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 73
- 238000001514 detection method Methods 0.000 claims description 55
- 238000012360 testing method Methods 0.000 claims description 36
- 230000009471 action Effects 0.000 claims description 14
- 230000008859 change Effects 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 12
- 238000001228 spectrum Methods 0.000 claims description 12
- 238000012790 confirmation Methods 0.000 claims description 9
- 230000003190 augmentative effect Effects 0.000 claims description 8
- 238000001914 filtration Methods 0.000 claims description 6
- 238000007689 inspection Methods 0.000 claims 1
- 238000013461 design Methods 0.000 abstract description 6
- 239000000463 material Substances 0.000 description 13
- 230000003993 interaction Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000001737 promoting effect Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000010354 integration Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000033001 locomotion Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 241000533950 Leucojum Species 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000006854 communication Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 208000001491 myopia Diseases 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 239000011435 rock Substances 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8106—Monomedia components thereof involving special audio data, e.g. different tracks for different languages
- H04N21/8113—Monomedia components thereof involving special audio data, e.g. different tracks for different languages comprising music, e.g. song in MP3 format
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Computer Graphics (AREA)
- Human Computer Interaction (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The present invention provides a kind of stick picture disposing method of video image, and this method includes：The image played in video is obtained, increases textures in described image；The music signal for obtaining the music for being intended to play in playing video, the beat point of the music is detected according to the music signal；It determines when playing music in playing video, beat point occurs in current play position；Obtain the corresponding textures special efficacy of the beat point；The textures in described image are handled according to the textures special efficacy, obtain the video image for including the textures special efficacy.This method can realize that simultaneously real-time edition obtains personalized broadcasting video to user to express the individual character of oneself by the music of self-defined setting, textures and textures special efficacy, it meets the personalized of user and plays video designs demand, increase the interest of Video Applications and the interactivity of application and user, significantly improves the satisfaction of user experience.
Description
Technical field
The present invention relates to technical field of image processing, specifically, the present invention relates to a kind of stick picture disposings of video image
Method, computer readable storage medium and terminal.
Background technology
With the continuous development of Internet technology and image processing techniques, added in video image in video capture
The style of shooting of textures gradually receives pursuing for people.User can be applied by corresponding textures in captured video image
It is middle to add the paster oneself liked, and then increase the interest of shooting process.
However, the textures application of the prior art, is typically only capable to simply add the textures that user selectes on the video images,
Textures exhibition method is single, fails to give full play to the interactivity between user and application, the pleasure that user obtains in shooting process
Interest is less, and satisfaction of users is not high.
Invention content
For overcome the above technical problem, the especially prior art can not improve user and application between interactive enthusiasm,
Using the interesting insufficient problem of experience, spy proposes following technical scheme：
The embodiment of the present invention provides a kind of stick picture disposing method of video image according on one side, including：
The image played in video is obtained, increases textures in described image；
The music signal for obtaining the music for being intended to play in playing video, the music is detected according to the music signal
Beat point；
It determines when playing music in playing video, beat point occurs in current play position；
Obtain the corresponding textures special efficacy of the beat point；
The textures in described image are handled according to the textures special efficacy, obtain the video for including the textures special efficacy
Image.
Preferably, the textures include：Two dimensional model textures based on AR augmented realities and/or threedimensional model textures.
Preferably, described to obtain the image played in video, increase textures in described image, including：
The image played in video is obtained, identifies the human face region in described image, increases textures in the human face region.
Preferably, described to obtain the image played in video, after increasing textures in described image, further include：
Confirmation receives textures switching command；Switch in increased textures in described image.
Further, the confirmation receives textures switching command, including：
The sound in the broadcasting video is obtained, identifies the audio frequency characteristics of the sound；If the audio frequency characteristics with it is preset
Textures switching password audio frequency characteristics matching it is consistent, confirmation receives the textures switching command；Or
The personage region in described image is identified, if in personage's region detection to preset textures switching action, really
Recognize and receives the textures switching command.
Preferably, the video is live video；
It is described to obtain the image played in video, before increasing textures in described image, further include：
Judge whether the main broadcaster that end is broadcast live executes preset increase textures request action；
If so, obtaining the preset textures of the main broadcaster；The image for obtaining and playing in video is carried out, in described image
The step of increasing textures.
Preferably, the beat point includes strong beat point and weak beat point；
The beat point that the music is detected according to the music signal, including：
The music signal is filtered, short time discrete Fourier transform is carried out after filtering, obtains frequency spectrum；
According to the frequency spectrum, the energy change value of test point is determined；
According to energy change value, detect that strong beat point or weak beat point occurs in test point.
Preferably, the beat point includes strong beat point and weak beat point；
The beat point that the music is detected according to the music signal, including：
Processing is weighted to the music signal, the music signal after being weighted；
According to the energy intensity value of the music signal after the weighting, detect that strong beat point or weak beat occurs in test point
Point.
Preferably, the beat point includes strong beat point；
The beat point that the music is detected according to the music signal, including：
Candidate beat point is obtained according to the energy intensity value of the music signal；
According to each candidate beat point, each two neighboring candidate beat point of statistics time interval between frames；
According to the time interval, detect that candidate beat point corresponds to test point and strong beat point occurs.
Preferably, the beat point includes strong beat point；
The beat point that the music is detected according to the music signal, including：
According to the energy variation difference of the music signal of test point, candidate beat point is obtained；
According to the candidate beat point, two sections of music letters are intercepted as signal starting point using each two neighboring candidate beat point
Number；
According to the comparing result of two sections of music signals, detect that candidate beat point corresponds to test point and strong beat point occurs.
Preferably, the acquisition is intended to the music signal of the music played in playing video, is examined according to the music signal
The beat point of the music is measured, including：
The music signal for obtaining the music for being intended to play in playing video judges to detect strong beat point, or the strong section of detection
Clap point and weak beat point；
If detecting strong beat point, judge using intensity value detection or changing value detection；
It is detected according to intensity value, candidate beat point is obtained according to the energy intensity value of the music signal, according to each time
Select beat point, each two neighboring candidate beat point of statistics time interval between frames detected according to the time interval
Candidate beat point corresponds to test point and strong beat point occurs；
It is detected according to changing value, according to the energy variation difference of the music signal of test point, obtains candidate beat point, root
According to the candidate beat point, two sections of music signals, root are intercepted as signal starting point using each two neighboring candidate beat point
According to the comparing result of two sections of music signals, detect that candidate beat point corresponds to test point and strong beat point occurs；
If detecting strong beat point and weak beat point, judge using intensity value detection or changing value detection；
It is detected according to intensity value, processing is weighted to the music signal, the music signal after being weighted, according to
The energy intensity value of music signal after the weighting detects that strong beat point or weak beat point occurs in test point；
It is detected according to changing value, the music signal is filtered, short time discrete Fourier transform is carried out after filtering, obtained
Frequency spectrum determines the energy change value of test point according to the frequency spectrum, according to energy change value, detects that weak section occurs in test point
Clap point or strong candidate beat point；
The judgement detects strong beat point, or detects strong beat point and weak beat point, including：
Textures special efficacy type needed for video is obtained, is judged to detect strong beat point according to textures special efficacy type needed for video, also
It is to detect strong beat point and weak beat point；
If described detect strong beat point, judge using intensity value detection or changing value detection, including：
If detecting strong beat point, the type of the music is obtained, judges to detect or change using intensity value according to type
Value detection；
If described detect strong beat point and weak beat point, judge using intensity value detection or changing value detection, including：
If detecting strong beat point and weak beat point, the type of the music is obtained, judges to examine using intensity value according to type
It surveys or changing value detects.
Preferably, after the beat point that the music is detected according to the music signal, further include, described in record
The correspondence of music position and beat point；
There is beat point when playing music in playing video in current play position in the determination, including：
According to the correspondence, determines when playing music in playing video, beat point occur in current play position.
The embodiment of the present invention additionally provides a kind of computer readable storage medium, the calculating according on the other hand
It is stored with computer program on machine readable storage medium storing program for executing, which realizes the textures of above-mentioned video image when being executed by processor
Processing method.
The embodiment of the present invention additionally provides a kind of terminal according to another aspect, and the terminal includes one or more
Processor；Memory；One or more application program, wherein one or more of application programs are stored in the memory
In and be configured as being executed by one or more of processors, one or more of programs are configured to：It executes above-mentioned
The stick picture disposing method of video image.
Compared with prior art, the present invention having the advantages that：
The stick picture disposing method of video image provided by the invention, by increasing textures in video image, and to being intended to
Play the music that plays in video and carry out beat point detection, and during music according to detected beat point regarding
The corresponding textures special efficacy of beat point is shown in frequency image, so that the textures special efficacy shown on video image and selected video
The beat point tight association for playing music, improves the textures of the music and display that are played in playing video in the sense of hearing and regards
Appeal in feel；And user can express the individual character of oneself simultaneously by the music of self-defined setting, textures and textures special efficacy
Can real-time edition obtain personalized broadcasting video, this method meets the personalized of user and plays video designs demand, increases
The interest of Video Applications and the interactivity of application and user, significantly improve the satisfaction of user experience.
In addition, the stick picture disposing method of video image provided by the invention is realized fast in conjunction with multiple beat point detecting methods
Speed, the beat point for accurately detecting selected video playing music, and can be according to textures special efficacy type and music needed for video
Type come the type of detection beat point needed for selecting and the method for detecting beat point, with realize using suitable method come
To accurate beat point, and operand can be reduced, shorten detection duration, be further ensured that the textures special efficacy shown on video image
With the beat point close association of selected video playing music；User can be by conveniently and efficiently increasing according to the wish of oneself
Add or switch textures, further increases the interest of Video Applications and the interactivity of application and user；Straight applied to video
When broadcasting field, the requirement of live streaming disclosure satisfy that, set off live streaming atmosphere, and the more preferable interaction for promoting main broadcaster and spectators by contrast, further carry
The satisfaction of high user experience.
The additional aspect of the present invention and advantage will be set forth in part in the description, these will become from the following description
Obviously, or practice through the invention is recognized.
Description of the drawings
Above-mentioned and/or additional aspect and advantage of the invention will become from the following description of the accompanying drawings of embodiments
Obviously and it is readily appreciated that, wherein：
Fig. 1 is a kind of method flow diagram of the stick picture disposing method of video image of the embodiment of the present invention；
Fig. 2 is a kind of structural schematic diagram of terminal of the embodiment of the present invention.
Specific implementation mode
The embodiment of the present invention is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, and is only used for explaining the present invention, and is not construed as limiting the claims.
Embodiment one
An embodiment of the present invention provides a kind of stick picture disposing methods of video image, as shown in Figure 1, this method includes：
Step S101, the image played in video is obtained, increases textures in described image.
For the present embodiment, the textures can be the two dimensional model textures based on AR augmented realities, can also be to be based on
The threedimensional model textures of AR augmented realities.The AR (Augmented Reality) is a kind of by real world information and virtual
The augmented reality that world information is combined and shown.By augmented reality, increase base in the image in playing video
In the textures of AR augmented realities, the image of real world can will be played in video with computer virtual image superposition in same picture
In, to realize information integration and the interaction of real world and virtual world.
For the present embodiment, the textures can specifically be used as the materials such as fireworks, love, the snowflake of background classes textures,
Can also be the materials such as corner, beard, glasses as face decorative kind textures, the specific manifestation form of the material is in this reality
It applies in example and does not limit.Wherein, increased textures can be that User Defined is arranged in playing video image, can also be
Video Applications default setting.After determining textures, terminal-pair plays the image in video and carries out scene Recognition, and then in video
The corresponding position of image increases textures.
Step S102, the music signal for obtaining the music for being intended to play in playing video is detected according to the music signal
Go out the beat point of the music.
For the present embodiment, the music for being intended to play in playing video can be from the music that prestores in Video Applications
Selected music can also be the selected music loaded in Video Applications of the music that prestores from user terminal, can also be
The live music played using other equipment obtained by microphone in Video Applications, the source of the music is in the present embodiment
In do not limit.
For the present embodiment, the action for obtaining music signal, which is implemented in user, to be selected and is intended to play in playing video
After music, and the action for selecting the music can execute before playing video, can also be executed in playing video.
For example, when applied to net cast field, the music can be selected before net cast or in net cast, terminal
The music signal of selected music can be obtained immediately, and the beat point of the music is detected according to the music signal.
In another example when being applied to the recording of short-sighted frequency, the music is selected before playing video that is, before video record,
Terminal can obtain the music signal of selected music at once after selected music, and detect the sound according to the music signal
Happy beat point.
It is described to detect that a variety of methods can be used in the beat point of the music according to the music signal for the present embodiment
It realizes.
For example, for this method, the beat point includes strong beat point and weak beat point；This method includes：To the sound
Music signal is filtered, and short time discrete Fourier transform is carried out after filtering, obtains frequency spectrum；According to the frequency spectrum, the energy of test point is determined
Measure changing value；According to energy change value, detect that strong beat point or weak beat point occurs in test point.
In another example for this method, the beat point includes strong beat point and weak beat point；This method includes：To described
Music signal is weighted processing, the music signal after being weighted；According to the energy intensity of the music signal after the weighting
Value detects that strong beat point or weak beat point occurs in test point.
In another example for this method, the beat point includes strong beat point；This method includes：According to the music signal
Energy intensity value obtain candidate beat point；According to each candidate beat point, frame where each two neighboring candidate beat point of statistics it
Between time interval；According to the time interval, detect that candidate beat point corresponds to test point and strong beat point occurs.
For another example for this method, the beat point includes strong beat point；This method includes：According to the music of test point
The energy variation difference of signal obtains candidate beat point；According to the candidate beat point, made with each two neighboring candidate beat point
Two sections of music signals are intercepted for signal starting point；According to the comparing result of two sections of music signals, detect that candidate beat point corresponds to
There is strong beat point in test point.
Step S103, it determines when playing music in playing video, beat point occurs in current play position.
For the present embodiment, each beat point detected in step s 102 corresponds to the different broadcasting positions of the music
It sets, when playing music in net cast, if music current play position is corresponding with the beat point that step S102 is detected, really
The fixed beat point is strong beat point or weak beat point.
Step S104, the corresponding textures special efficacy of the beat point is obtained.
For the present embodiment, the textures special efficacy refers to textures state when textures correspond to different resemblance parameters.
Different resemblance parameters can be arranged in material in the textures, and the resemblance parameter includes state parameter, size ginseng
Number, color parameter etc., do not limit in the present embodiment.In addition, the beat point in a piece of music generally includes strong beat
Point and weak beat point, the material in strong beat point textures special efficacy corresponding with weak beat point is identical, but material is outer
Shape characteristic parameter differs.For example, the textures that user chooses are Little Bear threedimensional model, and for the textures in strong beat point and weak
Different resemblance parameters is set when beat point, the dance step that Little Bear threedimensional model is danced in video image in strong beat point
Frequency is larger, and the dance step frequency that it is danced in weak beat point is then relatively low.
Step S105, the textures in described image are handled according to the textures special efficacy, it includes the textures to obtain
The video image of special efficacy.
For the present embodiment, by obtaining the material for being provided with a certain resemblance parameter in the textures special efficacy, and
The material and the image in the broadcasting video are synthesized in a manner of map overlay, obtained comprising in the textures special efficacy
Material video image.In other embodiments, it can also use and textures special efficacy and image are subjected to Data Integration or root
The other modes such as image, which are changed, according to the resemblance parameter of material in textures special efficacy realizes that it includes the textures special efficacy to obtain described
Video image.
For example, in net cast field, can the data of textures special efficacy and net cast image data be subjected to data
Integration obtains vedio data packet, and the data packet is sent to client, so that client is shown comprising textures spy
The video image of effect.
In another example can be by the resemblance parameter of material in acquisition textures special efficacy, according to the resemblance parameter
Processing is zoomed in and out to image, to obtain the video image that special effect can be achieved and highlight.
The stick picture disposing method of video image provided by the invention, by increasing textures in video image, and to being intended to
Play the music that plays in video and carry out beat point detection, and during music according to detected beat point regarding
The corresponding textures special efficacy of beat point is shown in frequency image, so that the textures special efficacy shown on video image and selected video
The beat point tight association for playing music, improves the textures of the music and display that are played in playing video in the sense of hearing and regards
Appeal in feel；And user can express the individual character of oneself simultaneously by the music of self-defined setting, textures and textures special efficacy
Can real-time edition obtain personalized broadcasting video, this method meets the personalized of user and plays video designs demand, increases
The interest of Video Applications and the interactivity of application and user, significantly improve the satisfaction of user experience.
In addition, the stick picture disposing method of video image provided by the invention is realized fast in conjunction with multiple beat point detecting methods
Speed, the beat point for accurately detecting selected video playing music, are further ensured that the textures special efficacy shown on video image
With the beat point close association of selected video playing music, the satisfaction of user experience is further increased.
Embodiment two
The alternatively possible realization method of the embodiment of the present invention further includes implementing on the basis of shown in embodiment one
Step shown in example two, wherein
Further include the correspondence for recording the music position and beat point after the step S102.
For the present embodiment, after detecting the beat point of the music according to the music signal, by the beat
Correspondence is established in the corresponding music position of point, and records the correspondence.The foundation side of the correspondence
Method does not limit in the present embodiment, can be the mode for adding label information.
For example, the signal data in the corresponding music position of the beat point adds label information, the label information
Carry the information for indicating that there is beat point in the music position and the beat point is strong beat point or weak beat point.
The step S103, including：According to the correspondence, determine when playing music in playing video, current
There is beat point in play position.
For the present embodiment, when playing music in playing video, in current play position, there are corresponding with beat point
When record, obtains the music position and the correspondence of beat point records, extract the correspondence, and then according to institute
It states correspondence and determines that current play position beat point occurs and determines that the beat point is strong beat point or weak beat point.
For the present embodiment, by recording the correspondence of the music position and beat point, it can be achieved that simple, fast
It is strong beat point or weak beat point to determine whether current play position beat point and beat point occurs fastly.
Embodiment three
The alternatively possible realization method of the embodiment of the present invention further includes implementing on the basis of shown in embodiment one
Step shown in example three, wherein
The step S101, including：
The image played in video is obtained, identifies the human face region in described image, increases textures in the human face region.
For the present embodiment, the textures are mainly the materials such as face decorative kind textures, such as corner, beard, glasses, eventually
End to the image played in video by carrying out recognition of face, and then the corresponding position of face increases textures in video image.
For example, being selected in the human face region played in video increases the textures such as virtual ear, beard, textures can be with the face one of user
Play movement, realize virtually and the combination of reality with it is interactive.
For the present embodiment, user can by it is self-defined setting textures and textures special efficacy come express oneself individual character and can be real
When editor obtain the broadcasting video of its personalized visualization design, meet the personalized visualization design requirement of user, increase video
The interest of application and the interactivity of application and user, significantly improve the satisfaction of user experience.
Example IV
The alternatively possible realization method of the embodiment of the present invention further includes implementing on the basis of shown in embodiment one
Step shown in example four, wherein
After the step S101, further include：
Confirmation receives textures switching command；Switch in increased textures in described image.
For the present embodiment, when user to increased textures are dissatisfied in video image when, textures can be sent out to terminal
Textures to be switched to the textures material oneself liked by switching command.The mode of the instruction textures switching can be that voice refers to
Show, act instruction and input instruction etc. modes, the present embodiment this is not limited.
For example, when by switching of the voice to indicate textures, terminal obtains the sound in the broadcasting video first, and knows
The audio frequency characteristics and preset textures are then switched password, such as " switching ", " change " mouth by the audio frequency characteristics of the not described sound
The audio frequency characteristics of order are matched, if matching is consistent, confirmation receives the textures switching command, and is cut to textures
It changes.
In another example when by acting the switching to indicate textures, terminal identifies the personage region in described image first,
And the figure action in personage region is detected, if in personage's region detection to preset textures switching action, such as
The actions such as " waving ", " shaking the head " then confirm and receive the textures switching command, and switched over to textures.
For another example when by inputting the switching to indicate textures, it is another that user need to only re-enter selection in Video Applications
One textures, you can current textures are switched over.
For the present embodiment, user can switch over textures by the wish conveniently and efficiently according to oneself, further
The interest of Video Applications and the interactivity of application and user are increased, the satisfaction of user experience is significantly improved.
Embodiment five
For the present embodiment, the video is live video, i.e. method in the present embodiment is mainly used in net cast
Field.
The alternatively possible realization method of the embodiment of the present invention further includes implementing on the basis of shown in embodiment one
Step shown in example five, wherein
Before the step S101, further include：
Judge whether the main broadcaster that end is broadcast live executes preset increase textures request action；
If so, obtaining the preset textures of the main broadcaster；The image for obtaining and playing in video is carried out, in described image
The step of increasing textures.
For the present embodiment, main broadcaster can ask to wrap to obtain during net cast by executing preset increase textures
Net cast image containing textures.The mode that the request increases textures can be voice request, action request and input request
Etc. modes, the present embodiment this is not limited.
For example, by voice come when asking to increase textures, terminal obtains the sound in the broadcasting video first, and identifies
The audio frequency characteristics of the sound, then by the audio frequency characteristics and preset increase textures password, such as " textures ", " variable body " mouth
The audio frequency characteristics of order are matched, if matching is consistent, just increase textures in the image for playing video.
In another example when by acting to ask to increase textures, terminal identifies the personage region in described image first, and
Figure action in personage region is detected, if in personage's region detection to preset textures switching action, such as " ratio
The actions such as the heart ", " airkissing " just increase textures in the image for playing video.
For another example when by inputting to ask to increase textures, user need to only click one textures of selection in Video Applications,
Just increase the textures in the image for playing video.
In other embodiments, the textures can also be selected by the spectators in net cast, can also by main broadcaster according to
The highest textures of temperature are selected according to the wish of spectators between net cast.This method disclosure satisfy that the requirement of live streaming, set off live streaming atmosphere by contrast
It encloses, and the more preferable interaction for promoting main broadcaster and spectators, further increases the satisfaction of user experience.
Embodiment six
The alternatively possible realization method of the embodiment of the present invention further includes implementing on the basis of shown in embodiment one
Step shown in example six, wherein
The step S102, including：
The music signal for obtaining the music for being intended to play in playing video judges to detect strong beat point, or the strong section of detection
Clap point and weak beat point；
If detecting strong beat point, judge using intensity value detection or changing value detection；It is detected according to intensity value, according to
The energy intensity value of the music signal obtains candidate beat point, according to each candidate beat point, each two neighboring candidate section of statistics
Point institute time interval between frames is clapped, according to the time interval, detects that candidate beat point corresponds to test point and occurs saving by force
Clap point；It is detected according to changing value, according to the energy variation difference of the music signal of test point, obtains candidate beat point, according to
Candidate's beat point intercepts two sections of music signals using each two neighboring candidate beat point as signal starting point, according to
The comparing result of two sections of music signals detects that candidate beat point corresponds to test point and strong beat point occurs；
If detecting strong beat point and weak beat point, judge using intensity value detection or changing value detection；According to intensity
Value detection, processing is weighted to the music signal, and the music signal after being weighted is believed according to the music after the weighting
Number energy intensity value, detect that strong beat point or weak beat point occurs in test point；It is detected according to changing value, to the music
Signal is filtered, and short time discrete Fourier transform is carried out after filtering, is obtained frequency spectrum and is determined the energy of test point according to the frequency spectrum
Changing value detects that weak beat point or strong candidate beat point occurs in test point according to energy change value；
The present embodiment is corresponding with different for the type and examination criteria of different required detection beat points
Beat detection methods.
Wherein, the judgement detects strong beat point, or detects strong beat point and weak beat point, including：
Textures special efficacy type needed for video is obtained, is judged to detect strong beat point according to textures special efficacy type needed for video, also
It is to detect strong beat point and weak beat point；If described detect strong beat point, judge using intensity value detection or changing value detection,
Including：If detecting strong beat point, the type of the music is obtained, judges to examine using intensity value detection or changing value according to type
It surveys；If described detect strong beat point and weak beat point, judge using intensity value detection or changing value detection, including：If detection
Strong beat point and weak beat point, obtain the type of the music, judge to examine using intensity value detection or changing value according to type
It surveys.
For the present embodiment, can textures special efficacy type needed for the video by acquisition come the class of detection beat point needed for judging
Type.Textures special efficacy type needed for the video is user's selection or Video Applications acquiescence textures special efficacy type.For example, with
Family wishes there is the textures special efficacy to emerge one after another in playing video, therefore being judged according to textures special efficacy type needed for its video should
Strong beat point is detected, weak beat point is also detected.
It is that examination criteria is judged by the type of the music of acquisition for the present embodiment.For example, acquired music
Type be rock and roll, the music signal of the music type often has very high intensity value, but its changing value unobvious, thus according to
Its type selects to detect the beat point of the music by detection intensity value.
For the present embodiment, required detection beat can be selected according to the type of textures special efficacy type and music needed for video
The type of point and the method for detecting beat point are obtained accurate beat point using suitable method to realize, and can reduced
Operand shortens detection duration, is further ensured that the tight association of the textures special efficacy and music beat point that are shown on video image
Property, further increase the satisfaction of user experience.
In addition, an embodiment of the present invention provides a kind of computer readable storage medium, deposited on computer readable storage medium
Computer program is contained, at the textures that the video image described in above example one to six is realized when which is executed by processor
Reason method.Wherein, the computer readable storage medium includes but not limited to any kind of disk (including floppy disk, hard disk, light
Disk, CD-ROM and magneto-optic disk), ROM (Read-Only Memory, read-only memory), RAM (Random AcceSS
Memory, immediately memory), EPROM (EraSable Programmable Read-Only Memory, erasable programmable
Read-only memory), EEPROM (Electrically EraSable Programmable Read-Only Memory, electrically erasable
Programmable read only memory), flash memory, magnetic card or light card.It is, storage device include by equipment (for example, calculate
Machine, mobile phone) any medium of storage or transmission information in the form of it can read can be read-only memory, disk or CD etc..
A kind of computer readable storage medium provided in an embodiment of the present invention by increasing in video image, it can be achieved that pasted
Figure, and the music to being intended to play in playing video carries out beat point detection, and during music detected by
Beat point the corresponding textures special efficacy of beat point is shown in video image so that the textures special efficacy shown on video image with
The beat point tight association of selected video playing music, improves the textures of the music and display that are played in playing video
In the sense of hearing and visual appeal；And user can be expressed by the music of self-defined setting, textures and textures special efficacy
The individual character of oneself and can real-time edition obtain personalized broadcasting video, the personalized video that plays that this method meets user is set
Meter demand increases the interest of Video Applications and the interactivity of application and user, significantly improves the satisfaction of user experience.This
Outside, the computer readable storage medium can be additionally used in：In conjunction with multiple beat point detecting methods, realization quickly and accurately detects
Go out the beat point of selected video playing music, and can be according to the type of textures special efficacy type and music needed for video to select
The method that the type of beat point need to be detected and detect beat point obtains accurate beat using suitable method to realize
Point, and operand can be reduced, shorten detection duration, is further ensured that the textures special efficacy shown on video image is regarded with selected
Frequency plays the beat point close association of music；User can be pasted by conveniently and efficiently being increased according to the wish of oneself or being switched
Figure further increases the interest of Video Applications and the interactivity of application and user；When applied to net cast field, energy
Enough requirements for meeting live streaming set off live streaming atmosphere, and the more preferable interaction for promoting main broadcaster and spectators by contrast, further increase user experience
Satisfaction.
The embodiment of the method for above-mentioned offer may be implemented in computer readable storage medium provided in an embodiment of the present invention, specifically
Function realizes the explanation referred in embodiment of the method, and details are not described herein.
In addition, the embodiment of the present invention additionally provides a kind of terminal, as shown in Fig. 2, the terminal may include one or
More than one processor 201, further include memory 202, WiFi (wireless fidelity, Wireless Fidelity) circuit 203,
RF (Radio Frequency, radio frequency) circuit 204, voicefrequency circuit 205, sensor 206, output equipment 207, input equipment
204, power supply 209, processor 201 are the control centres of terminal, utilize various interfaces and the above each section of connection.This field
Technical staff is appreciated that the restriction of terminal structure shown in Figure 2 not structure paired terminal, may include than illustrate it is more or
Less component either combines certain components or different components arrangement.
WiFi circuitry 203 can provide WLAN or internet access to the user；It may include antenna, WiFi module
Deng.RF circuits 204 can receive and send messages, or signal sends and receivees in communication process；It may include antenna, at least one puts
Big device, tuner, one or more oscillators, coupler, duplexer etc..The audio data that voicefrequency circuit 205 can will receive
It is converted into electric signal, is transferred to loud speaker, also the voice signal that microphone is collected audio data can be converted to, issue processor
201 processing；Loud speaker, microphone, earphone interface etc. can be arranged in it.Sensor 206 can be used for incuding outer signals, and issue place
Device 201 is managed to handle；It may include motion sensor, optical sensor etc..Output equipment 207 can be used for showing various signals；It can
For using LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting
Diode, Organic Light Emitting Diode) etc. forms configure display panel.Input equipment 204 can be used for inputting the letters such as number and character
Breath；It can be physical button, touch panel etc..Power supply 209 can be that terminal each section is powered, and pass through power-supply management system and processing
209 logical connection of device；It may include one or more direct current or AC power, charging system, power supply status indicator
Equal components.Memory 202 can be used for storing software program and module；It can be computer readable storage medium, be specifically
Hard disk, flash memory etc..Processor is the control centre of terminal, by running or executing the software program being stored in memory 202
And/or module, and the data for being stored in memory 202 are called, execute terminal various functions, processing terminal data.
As one embodiment, terminal includes：One or more processors 201, memory 202, one or more application
Program, wherein one or more of application programs are stored in memory 202 and are configured as by one or more of
Processor 201 executes, and one or more of programs are configured to carry out the video image described in above example one to six
Stick picture disposing method.
A kind of terminal provided in an embodiment of the present invention in video image, it can be achieved that by increasing textures, and to being intended to broadcasting
Put the music that is played in video and carry out beat point detection, and during music according to detected beat point in video
The corresponding textures special efficacy of beat point is shown in image, so that the textures special efficacy shown on video image is broadcast with selected video
The beat point tight association put the music on, improves the textures of the music and display that are played in playing video in the sense of hearing and vision
On appeal；And user can by the music of self-defined setting, textures and textures special efficacy come express oneself individual character and can
Real-time edition obtains personalized broadcasting video, and this method meets the personalized of user and plays video designs demand, and increase regards
The interest of frequency application and the interactivity of application and user, significantly improve the satisfaction of user experience.In addition, the terminal may be used also
For：In conjunction with multiple beat point detecting methods, the beat point for quickly and accurately detecting selected video playing music is realized,
And the type of detection beat point and detection needed for being selected according to the type of textures special efficacy type and music needed for video save
The method for clapping point is obtained accurate beat point using suitable method to realize, and can reduce operand, when shortening detection
It is long, it is further ensured that the beat point tight association of the textures special efficacy and selected video playing music shown on video image
Property；User can further increase the interest of Video Applications by conveniently and efficiently increasing or switching textures according to the wish of oneself
Taste and the interactivity of application and user；When applied to net cast field, the requirement of live streaming disclosure satisfy that, set off live streaming atmosphere by contrast
It encloses, and the more preferable interaction for promoting main broadcaster and spectators, further increases the satisfaction of user experience.
The embodiment of the method for above-mentioned offer may be implemented in terminal provided in an embodiment of the present invention, and concrete function realization refers to
Explanation in embodiment of the method, details are not described herein.
The above is only some embodiments of the present invention, it is noted that for the ordinary skill people of the art
For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered
It is considered as protection scope of the present invention.
Claims (14)
1. a kind of stick picture disposing method of video image, which is characterized in that include the following steps：
The image played in video is obtained, increases textures in described image；
The music signal for obtaining the music for being intended to play in playing video, the section of the music is detected according to the music signal
Clap point；
It determines when playing music in playing video, beat point occurs in current play position；
Obtain the corresponding textures special efficacy of the beat point；
The textures in described image are handled according to the textures special efficacy, obtain the video figure for including the textures special efficacy
Picture.
2. stick picture disposing method according to claim 1, which is characterized in that the textures include：Based on AR augmented realities
Two dimensional model textures and/or threedimensional model textures.
3. stick picture disposing method according to claim 1, which is characterized in that it is described to obtain the image played in video,
Increase textures in described image, including：
The image played in video is obtained, identifies the human face region in described image, increases textures in the human face region.
4. stick picture disposing method according to claim 1, which is characterized in that it is described to obtain the image played in video,
After increasing textures in described image, further include：
Confirmation receives textures switching command；Switch in increased textures in described image.
5. stick picture disposing method according to claim 4, which is characterized in that the confirmation receives textures switching command,
Including：
The sound in the broadcasting video is obtained, identifies the audio frequency characteristics of the sound；If the audio frequency characteristics and preset patch
The audio frequency characteristics matching of figure switching password is consistent, and confirmation receives the textures switching command；Or
The personage region in described image is identified, if in personage's region detection to preset textures switching action, confirmation connects
Receive the textures switching command.
6. stick picture disposing method according to claim 1, which is characterized in that the video is live video；
It is described to obtain the image played in video, before increasing textures in described image, further include：
Judge whether the main broadcaster that end is broadcast live executes preset increase textures request action；
If so, obtaining the preset textures of the main broadcaster；The image for obtaining and playing in video is carried out, is increased in described image
The step of textures.
7. stick picture disposing method according to claim 1, which is characterized in that the beat point includes strong beat point and weak section
Clap point；
The beat point that the music is detected according to the music signal, including：
The music signal is filtered, short time discrete Fourier transform is carried out after filtering, obtains frequency spectrum；
According to the frequency spectrum, the energy change value of test point is determined；
According to energy change value, detect that strong beat point or weak beat point occurs in test point.
8. stick picture disposing method according to claim 1, which is characterized in that the beat point includes strong beat point and weak section
Clap point；
The beat point that the music is detected according to the music signal, including：
Processing is weighted to the music signal, the music signal after being weighted；
According to the energy intensity value of the music signal after the weighting, detect that strong beat point or weak beat point occurs in test point.
9. stick picture disposing method according to claim 1, which is characterized in that the beat point includes strong beat point；
The beat point that the music is detected according to the music signal, including：
Candidate beat point is obtained according to the energy intensity value of the music signal；
According to each candidate beat point, each two neighboring candidate beat point of statistics time interval between frames；
According to the time interval, detect that candidate beat point corresponds to test point and strong beat point occurs.
10. stick picture disposing method according to claim 1, which is characterized in that the beat point includes strong beat point；
The beat point that the music is detected according to the music signal, including：
According to the energy variation difference of the music signal of test point, candidate beat point is obtained；
According to the candidate beat point, two sections of music signals are intercepted as signal starting point using each two neighboring candidate beat point；
According to the comparing result of two sections of music signals, detect that candidate beat point corresponds to test point and strong beat point occurs.
11. stick picture disposing method according to claim 1, which is characterized in that the acquisition is intended to play in playing video
Music music signal, the beat point of the music is detected according to the music signal, including：
The music signal for obtaining the music for being intended to play in playing video judges to detect strong beat point, or the strong beat point of detection
With weak beat point；
If detecting strong beat point, judge using intensity value detection or changing value detection；
It is detected according to intensity value, candidate beat point is obtained according to the energy intensity value of the music signal, according to each candidate section
Clap point, each two neighboring candidate beat point of statistics time interval between frames candidate is detected according to the time interval
Beat point corresponds to test point and strong beat point occurs；
It is detected according to changing value, according to the energy variation difference of the music signal of test point, candidate beat point is obtained, according to institute
Candidate beat point is stated, two sections of music signals are intercepted as signal starting point using each two neighboring candidate beat point, according to two
The comparing result of section music signal detects that candidate beat point corresponds to test point and strong beat point occurs；
If detecting strong beat point and weak beat point, judge using intensity value detection or changing value detection；
It is detected according to intensity value, processing is weighted to the music signal, the music signal after being weighted, according to described
The energy intensity value of music signal after weighting detects that strong beat point or weak beat point occurs in test point；
It is detected according to changing value, the music signal is filtered, short time discrete Fourier transform is carried out after filtering, obtain frequency
Spectrum, according to the frequency spectrum, determines the energy change value of test point, according to energy change value, detects that weak beat occurs in test point
Point or strong candidate beat point；
The judgement detects strong beat point, or detects strong beat point and weak beat point, including：
Textures special efficacy type needed for video is obtained, is judged to detect strong beat point, or inspection according to textures special efficacy type needed for video
Survey strong beat point and weak beat point；
If described detect strong beat point, judge using intensity value detection or changing value detection, including：
If detecting strong beat point, the type of the music is obtained, judges to examine using intensity value detection or changing value according to type
It surveys；
If described detect strong beat point and weak beat point, judge using intensity value detection or changing value detection, including：
If detecting strong beat point and weak beat point, the type of the music is obtained, is judged using intensity value detection also according to type
It is changing value detection.
12. stick picture disposing method according to claim 1, which is characterized in that described to be detected according to the music signal
Further include the correspondence for recording the music position and beat point after the beat point of the music；
There is beat point when playing music in playing video in current play position in the determination, including：
According to the correspondence, determines when playing music in playing video, beat point occur in current play position.
13. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium
Program realizes claim 1 to 12 any one of them stick picture disposing method when the program is executed by processor.
14. a kind of terminal, which is characterized in that it includes：
One or more processors；
Memory；
One or more application program, wherein one or more of application programs are stored in the memory and are configured
To be executed by one or more of processors, one or more of programs are configured to：It executes according to claim 1 to 12
Any one of them stick picture disposing method.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711476832.0A CN108322802A (en) | 2017-12-29 | 2017-12-29 | Stick picture disposing method, computer readable storage medium and the terminal of video image |
| PCT/CN2018/119266 WO2019114582A1 (en) | 2017-12-15 | 2018-12-05 | Video image processing method and computer storage medium and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711476832.0A CN108322802A (en) | 2017-12-29 | 2017-12-29 | Stick picture disposing method, computer readable storage medium and the terminal of video image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108322802A true CN108322802A (en) | 2018-07-24 |
Family
ID=62894187
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711476832.0A Pending CN108322802A (en) | 2017-12-15 | 2017-12-29 | Stick picture disposing method, computer readable storage medium and the terminal of video image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108322802A (en) |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108986842A (en) * | 2018-08-14 | 2018-12-11 | 百度在线网络技术（北京）有限公司 | Music style identifying processing method and terminal |
| CN109034063A (en) * | 2018-07-27 | 2018-12-18 | 北京微播视界科技有限公司 | Plurality of human faces tracking, device and the electronic equipment of face special efficacy |
| CN109120992A (en) * | 2018-09-13 | 2019-01-01 | 北京金山安全软件有限公司 | Video generation method and device, electronic equipment and storage medium |
| CN109361852A (en) * | 2018-10-18 | 2019-02-19 | 维沃移动通信有限公司 | A kind of image processing method and device |
| CN109379623A (en) * | 2018-11-08 | 2019-02-22 | 北京微播视界科技有限公司 | Video content generation method, device, computer equipment and storage medium |
| CN109618229A (en) * | 2018-12-21 | 2019-04-12 | 广州酷狗计算机科技有限公司 | Association playback method, device, server and the storage medium of audio-video |
| CN109688324A (en) * | 2018-12-04 | 2019-04-26 | 深圳市子瑜杰恩科技有限公司 | Short-sighted channel tool switching method and Related product |
| CN109729394A (en) * | 2018-12-05 | 2019-05-07 | 深圳市子瑜杰恩科技有限公司 | The stage property sort method and Related product of short-sighted frequency |
| WO2019114582A1 (en) * | 2017-12-15 | 2019-06-20 | 广州市百果园信息技术有限公司 | Video image processing method and computer storage medium and terminal |
| CN110072047A (en) * | 2019-01-25 | 2019-07-30 | 北京字节跳动网络技术有限公司 | Control method, device and the hardware device of image deformation |
| CN110069641A (en) * | 2019-03-27 | 2019-07-30 | 北京字节跳动网络技术有限公司 | Image processing method, device and electronic equipment |
| CN110675310A (en) * | 2019-07-02 | 2020-01-10 | 北京达佳互联信息技术有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN110798737A (en) * | 2019-11-29 | 2020-02-14 | 北京达佳互联信息技术有限公司 | Video and audio synthesis method, terminal and storage medium |
| CN111225232A (en) * | 2018-11-23 | 2020-06-02 | 北京字节跳动网络技术有限公司 | Video-based sticker animation engine, realization method, server and medium |
| CN111597984A (en) * | 2020-05-15 | 2020-08-28 | 北京百度网讯科技有限公司 | Sticker testing method, device, electronic equipment and computer readable storage medium |
| CN111857923A (en) * | 2020-07-17 | 2020-10-30 | 北京字节跳动网络技术有限公司 | Special effect display method and device, electronic equipment and computer readable medium |
| CN113055738A (en) * | 2019-12-26 | 2021-06-29 | 北京字节跳动网络技术有限公司 | Video special effect processing method and device |
| CN113632498A (en) * | 2019-03-28 | 2021-11-09 | 多玩国株式会社 | Content distribution system, content distribution method, and content distribution program |
| EP4167192A4 (en) * | 2020-07-10 | 2023-12-13 | Beijing Bytedance Network Technology Co., Ltd. | Image processing method and apparatus for augmented reality, electronic device and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101123086A (en) * | 2006-08-09 | 2008-02-13 | 株式会社河合乐器制作所 | Tempo detection apparatus and tempo-detection computer program |
| CN101165773A (en) * | 2006-10-20 | 2008-04-23 | 索尼株式会社 | Signal processing apparatus and method, program, and recording medium |
| CN104103300A (en) * | 2014-07-04 | 2014-10-15 | 厦门美图之家科技有限公司 | Method for automatically processing video according to music beats |
| US20150007708A1 (en) * | 2009-05-27 | 2015-01-08 | Microsoft Corporation | Detecting beat information using a diverse set of correlations |
| CN104822095A (en) * | 2015-02-08 | 2015-08-05 | 苏州乐聚一堂电子科技有限公司 | Composite beat special effect system and composite beat special effect processing method |
| CN105872838A (en) * | 2016-04-28 | 2016-08-17 | 徐文波 | Sending method and device of special media effects of real-time videos |
| CN106331735A (en) * | 2016-08-18 | 2017-01-11 | 北京奇虎科技有限公司 | Special effect processing method, electronic device and server |
| CN106658035A (en) * | 2016-12-09 | 2017-05-10 | 武汉斗鱼网络科技有限公司 | Dynamic display method and device for special effect gift |
| CN107103917A (en) * | 2017-03-17 | 2017-08-29 | 福建星网视易信息系统有限公司 | Music rhythm detection method and its system |
| CN107124624A (en) * | 2017-04-21 | 2017-09-01 | 腾讯科技（深圳）有限公司 | The method and apparatus of video data generation |
-
2017
- 2017-12-29 CN CN201711476832.0A patent/CN108322802A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101123086A (en) * | 2006-08-09 | 2008-02-13 | 株式会社河合乐器制作所 | Tempo detection apparatus and tempo-detection computer program |
| CN101165773A (en) * | 2006-10-20 | 2008-04-23 | 索尼株式会社 | Signal processing apparatus and method, program, and recording medium |
| US20150007708A1 (en) * | 2009-05-27 | 2015-01-08 | Microsoft Corporation | Detecting beat information using a diverse set of correlations |
| CN104103300A (en) * | 2014-07-04 | 2014-10-15 | 厦门美图之家科技有限公司 | Method for automatically processing video according to music beats |
| CN104822095A (en) * | 2015-02-08 | 2015-08-05 | 苏州乐聚一堂电子科技有限公司 | Composite beat special effect system and composite beat special effect processing method |
| CN105872838A (en) * | 2016-04-28 | 2016-08-17 | 徐文波 | Sending method and device of special media effects of real-time videos |
| CN106331735A (en) * | 2016-08-18 | 2017-01-11 | 北京奇虎科技有限公司 | Special effect processing method, electronic device and server |
| CN106658035A (en) * | 2016-12-09 | 2017-05-10 | 武汉斗鱼网络科技有限公司 | Dynamic display method and device for special effect gift |
| CN107103917A (en) * | 2017-03-17 | 2017-08-29 | 福建星网视易信息系统有限公司 | Music rhythm detection method and its system |
| CN107124624A (en) * | 2017-04-21 | 2017-09-01 | 腾讯科技（深圳）有限公司 | The method and apparatus of video data generation |
Cited By (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019114582A1 (en) * | 2017-12-15 | 2019-06-20 | 广州市百果园信息技术有限公司 | Video image processing method and computer storage medium and terminal |
| CN109034063A (en) * | 2018-07-27 | 2018-12-18 | 北京微播视界科技有限公司 | Plurality of human faces tracking, device and the electronic equipment of face special efficacy |
| US11749020B2 (en) | 2018-07-27 | 2023-09-05 | Beijing Microlive Vision Technology Co., Ltd | Method and apparatus for multi-face tracking of a face effect, and electronic device |
| CN108986842A (en) * | 2018-08-14 | 2018-12-11 | 百度在线网络技术（北京）有限公司 | Music style identifying processing method and terminal |
| CN109120992A (en) * | 2018-09-13 | 2019-01-01 | 北京金山安全软件有限公司 | Video generation method and device, electronic equipment and storage medium |
| CN109361852A (en) * | 2018-10-18 | 2019-02-19 | 维沃移动通信有限公司 | A kind of image processing method and device |
| CN109379623A (en) * | 2018-11-08 | 2019-02-22 | 北京微播视界科技有限公司 | Video content generation method, device, computer equipment and storage medium |
| CN111225232A (en) * | 2018-11-23 | 2020-06-02 | 北京字节跳动网络技术有限公司 | Video-based sticker animation engine, realization method, server and medium |
| CN109688324A (en) * | 2018-12-04 | 2019-04-26 | 深圳市子瑜杰恩科技有限公司 | Short-sighted channel tool switching method and Related product |
| CN109729394A (en) * | 2018-12-05 | 2019-05-07 | 深圳市子瑜杰恩科技有限公司 | The stage property sort method and Related product of short-sighted frequency |
| CN109618229A (en) * | 2018-12-21 | 2019-04-12 | 广州酷狗计算机科技有限公司 | Association playback method, device, server and the storage medium of audio-video |
| US11409794B2 (en) | 2019-01-25 | 2022-08-09 | Beijing Bytedance Network Technology Co., Ltd. | Image deformation control method and device and hardware device |
| WO2020151491A1 (en) * | 2019-01-25 | 2020-07-30 | 北京字节跳动网络技术有限公司 | Image deformation control method and device and hardware device |
| CN110072047A (en) * | 2019-01-25 | 2019-07-30 | 北京字节跳动网络技术有限公司 | Control method, device and the hardware device of image deformation |
| CN110069641A (en) * | 2019-03-27 | 2019-07-30 | 北京字节跳动网络技术有限公司 | Image processing method, device and electronic equipment |
| CN110069641B (en) * | 2019-03-27 | 2021-04-20 | 北京字节跳动网络技术有限公司 | Image processing method and device and electronic equipment |
| US11961190B2 (en) | 2019-03-28 | 2024-04-16 | Dwango Co., Ltd. | Content distribution system, content distribution method, and content distribution program |
| CN113632498A (en) * | 2019-03-28 | 2021-11-09 | 多玩国株式会社 | Content distribution system, content distribution method, and content distribution program |
| CN110675310A (en) * | 2019-07-02 | 2020-01-10 | 北京达佳互联信息技术有限公司 | Video processing method and device, electronic equipment and storage medium |
| US11705160B2 (en) | 2019-07-02 | 2023-07-18 | Beijing Dajia Internet Information Technology Co., Ltd. | Method and device for processing video |
| US11114130B2 (en) | 2019-07-02 | 2021-09-07 | Beijing Dajia Internet Information Technology Co., Ltd. | Method and device for processing video |
| CN110798737A (en) * | 2019-11-29 | 2020-02-14 | 北京达佳互联信息技术有限公司 | Video and audio synthesis method, terminal and storage medium |
| KR102700232B1 (en) | 2019-12-26 | 2024-08-30 | 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 | Method and device for processing video special effects |
| KR20220106848A (en) * | 2019-12-26 | 2022-07-29 | 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 | Video special effects processing methods and devices |
| US11882244B2 (en) | 2019-12-26 | 2024-01-23 | Beijing Bytedance Network Technology Co., Ltd. | Video special effects processing method and apparatus |
| WO2021129628A1 (en) * | 2019-12-26 | 2021-07-01 | 北京字节跳动网络技术有限公司 | Video special effects processing method and apparatus |
| CN113055738A (en) * | 2019-12-26 | 2021-06-29 | 北京字节跳动网络技术有限公司 | Video special effect processing method and device |
| CN111597984B (en) * | 2020-05-15 | 2023-09-26 | 北京百度网讯科技有限公司 | Label paper testing method, device, electronic equipment and computer readable storage medium |
| CN111597984A (en) * | 2020-05-15 | 2020-08-28 | 北京百度网讯科技有限公司 | Sticker testing method, device, electronic equipment and computer readable storage medium |
| EP4167192A4 (en) * | 2020-07-10 | 2023-12-13 | Beijing Bytedance Network Technology Co., Ltd. | Image processing method and apparatus for augmented reality, electronic device and storage medium |
| WO2022012182A1 (en) * | 2020-07-17 | 2022-01-20 | 北京字节跳动网络技术有限公司 | Special effect display method and apparatus, electronic device, and computer readable medium |
| CN111857923A (en) * | 2020-07-17 | 2020-10-30 | 北京字节跳动网络技术有限公司 | Special effect display method and device, electronic equipment and computer readable medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108322802A (en) | Stick picture disposing method, computer readable storage medium and the terminal of video image | |
| CN108111909A (en) | Method of video image processing and computer storage media, terminal | |
| CN108259925A (en) | Music gifts processing method, storage medium and terminal in net cast | |
| CN108259983A (en) | A kind of method of video image processing, computer readable storage medium and terminal | |
| CN109756784B (en) | Music playing method, device, terminal and storage medium | |
| CN106162369B (en) | It is a kind of to realize the method, apparatus and system interacted in virtual scene | |
| CN108259984A (en) | Method of video image processing, computer readable storage medium and terminal | |
| US11701567B2 (en) | Wireless electronic table game scoreboard | |
| CN108810576A (en) | The even method, apparatus and storage medium of wheat live streaming | |
| CN109448761B (en) | Method and device for playing songs | |
| CN109302538A (en) | Method for playing music, device, terminal and storage medium | |
| CN108401124A (en) | The method and apparatus of video record | |
| CN109151593A (en) | Main broadcaster's recommended method, device storage medium | |
| CN109040297A (en) | User's portrait generation method and device | |
| CN112541959B (en) | Virtual object display method, device, equipment and medium | |
| CN109587549B (en) | Video recording method, device, terminal and storage medium | |
| CN109348247A (en) | Determine the method, apparatus and storage medium of audio and video playing timestamp | |
| CN109035180A (en) | Video broadcasting method, device, equipment and storage medium | |
| CN109525883A (en) | Interact Special display effect method, apparatus, electronic equipment, server and storage medium | |
| CN107948702A (en) | Synchronous method, device, terminal and the storage medium of Application Status | |
| JP2022531372A (en) | How to preview behavior during a match in an out-of-competition environment, devices, terminals, and computer programs | |
| CN110139143A (en) | Virtual objects display methods, device, computer equipment and storage medium | |
| CN109743461A (en) | Audio data processing method, device, terminal and storage medium | |
| CN110337042A (en) | Requesting songs method, program request order processing method, apparatus, terminal and medium | |
| CN110035324A (en) | Information interacting method, device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180724 |
|
| RJ01 | Rejection of invention patent application after publication |