CN109922268B - Video shooting method, device, equipment and storage medium - Google Patents

Video shooting method, device, equipment and storage medium Download PDF

Info

Publication number
CN109922268B
CN109922268B CN201910266828.4A CN201910266828A CN109922268B CN 109922268 B CN109922268 B CN 109922268B CN 201910266828 A CN201910266828 A CN 201910266828A CN 109922268 B CN109922268 B CN 109922268B
Authority
CN
China
Prior art keywords
background music
beat information
music
time
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910266828.4A
Other languages
Chinese (zh)
Other versions
CN109922268A (en
Inventor
王禹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
RUIMO INTELLIGENT TECHNOLOGY (SHENZHEN) Co.,Ltd.
Original Assignee
Dongguan Songshan Lake International Robot Research Institute Co ltd
Ruimo Intelligent Technology Shenzhen Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dongguan Songshan Lake International Robot Research Institute Co ltd, Ruimo Intelligent Technology Shenzhen Co ltd filed Critical Dongguan Songshan Lake International Robot Research Institute Co ltd
Priority to CN201910266828.4A priority Critical patent/CN109922268B/en
Publication of CN109922268A publication Critical patent/CN109922268A/en
Application granted granted Critical
Publication of CN109922268B publication Critical patent/CN109922268B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The embodiment of the invention discloses a video shooting method, a video shooting device, video shooting equipment and a storage medium. The method comprises the following steps: analyzing the background music to obtain the beat information of the background music; setting preset shooting parameters at a time point corresponding to the background music according to the beat information; and controlling a camera to shoot the video at the time point corresponding to the background music according to the shooting parameters. According to the video shooting method provided by the embodiment of the invention, the preset shooting parameters are set at the time points corresponding to the background music according to the beat information of the background music, so that the camera carries out video shooting at the time points corresponding to the background music according to the preset shooting parameters, and a shooting person does not need to have a professional shooting level, thereby reducing the shooting difficulty of the video.

Description

Video shooting method, device, equipment and storage medium
Technical Field
The invention relates to the technical field of multimedia manufacturing, in particular to a video shooting method, a video shooting device, video shooting equipment and a storage medium.
Background
The video is used as a carrier capable of fully calling the audio-visual perception ability of people, and is more and more widely applied to the daily life of people by virtue of the abundant information content and strong expressive ability. People are gradually accustomed to the content consumption form of videos, performers can convey rich emotion through the videos, audiences can experience different life styles, and the audiences can obtain satisfaction and pleasure in physiology and psychology.
Excellent video production requires a high production threshold, which depends on careful pre-planning, flexible shooting techniques and elaborate post-editing. Shooting personnel usually need to determine a shooting subject, select background music, generate a shooting script according to the background music, shoot a video according to the script, and finally perform post-processing on the video. The whole process is professional and complex, a higher threshold is established for video creation, and higher cost is brought.
Disclosure of Invention
The embodiment of the invention provides a video shooting method, a video shooting device, video shooting equipment and a storage medium, wherein a video shooting scheme is generated according to background music imported by a user, so that the video shooting difficulty is reduced.
In a first aspect, an embodiment of the present invention provides a video shooting method, including:
analyzing the background music to obtain the beat information of the background music;
setting preset shooting parameters at a time point corresponding to the background music according to the beat information;
and controlling a camera to shoot the video at the time point corresponding to the background music according to the shooting parameters.
Further, analyzing the background music to obtain the beat information of the background music, including:
acquiring the time length of a typical audio; the typical audio is the audio corresponding to the instrument with strong rhythmicity;
intercepting a plurality of music pieces with the same duration as the typical audio from background music; wherein the interval of the starting moments of the adjacent music pieces is less than or equal to the duration of the typical audio;
calculating the component of the typical audio in each music piece;
and determining the beat information of the background music according to the components.
Further, calculating the component of the typical audio in each music piece includes:
sampling the typical audio and music segments according to a set sampling frequency respectively;
the components are calculated for a typical audio and music piece after sampling according to the following formula:
Figure BDA0002017108230000021
wherein, | A | represents the absolute value of the component of the typical audio in the music piece, f [ N ] and g [ N ] represent the numerical values of the nth sampling point of the typical audio and the music piece respectively, and N represents the number of sampling points.
Further, determining beat information of the background music according to the components includes:
acquiring component peaks of the typical audio exceeding a first threshold value on the whole time axis;
filtering the component peak value to obtain a peak value cluster corresponding to the typical audio;
determining candidate typical audio according to the peak cluster, and judging whether the peak cluster of the candidate typical audio meets a set condition;
and if so, determining the time interval of each peak value in the peak value cluster of the candidate typical audio as the beat information of the background music.
Further, filtering the component peak, including:
the component peak values with the time intervals smaller than the set duration are gathered into one class, and the component peak value with the maximum value is reserved; and the moment corresponding to the component peak value is the starting moment, the middle moment or the ending moment of the music piece corresponding to the component peak value.
Further, determining candidate typical audio from the cluster of peaks includes:
when the typical audio comprises a plurality of types, respectively summing the peaks in the peak cluster corresponding to each typical audio to obtain the characteristic quantity of each typical audio;
and determining the typical audio with the largest characteristic quantity as the candidate typical audio.
Further, the setting conditions include: the feature quantity of the candidate typical audio is larger than a second threshold, and peaks in a cluster of peaks of the candidate typical audio have features at equal intervals.
Further, analyzing the background music to obtain the beat information of the background music, including:
acquiring the duration of a window function, and sampling the window function and background music according to a set sampling frequency respectively;
intercepting a plurality of music pieces with the same duration as the window function from the sampled background music; wherein, the interval of the starting time of the adjacent music pieces is less than or equal to the duration of the window function;
acquiring a frequency spectrum function of the background music according to the sampled window function and music fragments;
and determining the beat information of the background music according to the frequency spectrum function.
Further, acquiring a spectrum function of the background music according to the sampled window function and music pieces, including:
performing discrete Fourier transform on the sampled window function and music fragment according to the following formula to obtain a frequency spectrum function corresponding to background music:
Figure BDA0002017108230000041
wherein m represents the mth moment after the background music is sampled, f [ N ] represents the numerical value of the nth sampling point of the window function, g [ m + N-N/2] represents the numerical value of the nth sampling point in the segment intercepted at the mth moment of the background music, the central position of the segment is the mth moment, | STFT (m, k) | represents the spectrum module value at the (m, k) point on the time-frequency plane, and k is more than or equal to 0 and less than or equal to N/2.
Further, determining beat information of the background music according to the spectrum function includes:
extracting local spectral peaks according to the spectral function;
and determining the beat information of the background music according to the local spectrum peak value.
Further, determining the beat information of the background music according to the local spectrum peak value comprises:
and if the local spectrum peak value has the characteristic of equal time spacing in a frequency band smaller than the set threshold value, determining the time interval of the local spectrum peak value as the beat information of the background music.
Further, determining the beat information of the background music according to the characteristics of the local spectrum peak comprises:
if the local spectrum peak value does not have the characteristic of equal time spacing in the frequency band smaller than the set threshold value, acquiring the local spectrum peak value exceeding a third threshold value;
acquiring a frequency spectrum value of each moment in a preset time length; the preset duration is a duration centered at a time corresponding to the local spectrum peak;
if one half of the local spectrum peak value is smaller than the average value of the spectrum values at all times in the preset duration, the beat information of the background music has partial climax characteristics;
and if one half of the local spectrum peak value is larger than the average value of the spectrum values at all the moments in the preset time length, the beat information of the background music has a short and strong sound characteristic.
Further, the shooting parameters comprise the focal length of the camera, the shaking amplitude and the shaking rate of the camera; the camera shaking amplitude and the camera shaking speed comprise the rotation amplitude and the rotation speed of the camera along the transverse roller, the translation amplitude and the translation speed of the camera along the left-right direction, and the translation amplitude and the translation speed of the camera along the up-down direction; if the beat information of the background music has partial climax characteristics, setting preset shooting parameters at a time point corresponding to the background music according to the beat information, including:
setting the focal length of the camera to increase from small to large in a linear or logarithmic mode within a preset time length taking the time corresponding to the local spectrum peak value as a center;
if the beat information of the background music has the characteristics of short and strong sound, setting preset shooting parameters at a time point corresponding to the background music according to the beat information, wherein the preset shooting parameters comprise:
and setting a camera to shake at a set shaking amplitude and a shaking frequency within a preset time length taking the time corresponding to the local spectrum peak value as a center.
Further, setting preset shooting parameters at a time point corresponding to the background music according to the beat information, including:
and setting shooting parameters at the moment corresponding to the peak value every set time period according to a set rule.
Further, setting shooting parameters according to a set rule at the moment corresponding to the peak value, including:
setting the focal length of the camera to increase or decrease by a certain step length in a first set time length taking the moment corresponding to the peak value as the center; and setting the camera to shake at a set shaking amplitude and a shaking frequency within a first set time length taking the time corresponding to the peak value as the center.
In a second aspect, an embodiment of the present invention further provides a video shooting apparatus, including:
the beat information acquisition module is used for analyzing the background music to acquire beat information of the background music;
the preset shooting parameter setting module is used for setting preset shooting parameters at a time point corresponding to the background music according to the beat information;
and the video shooting module is used for controlling the camera to shoot videos at the time point corresponding to the background music according to the shooting parameters.
In a third aspect, an embodiment of the present invention further provides a computer device, including a storage device and a processor, where the memory stores a computer program thereon, and the processor implements the video shooting method described above when executing the computer program.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored, the computer program including program instructions, when executed, implement the video shooting method as described above.
According to the embodiment of the invention, the background music is firstly analyzed to obtain the beat information of the background music, then the preset shooting parameters are set at the time points corresponding to the background music according to the beat information, and finally the camera is controlled to carry out video shooting at the time points corresponding to the background music according to the shooting parameters. According to the video shooting method provided by the embodiment of the invention, the preset shooting parameters are set at the time points corresponding to the background music according to the beat information of the background music, so that the camera carries out video shooting at the time points corresponding to the background music according to the preset shooting parameters, and a shooting person does not need to have a professional shooting level, thereby reducing the shooting difficulty of the video.
Drawings
Fig. 1 is a flowchart of a video shooting method according to a first embodiment of the present invention;
fig. 2 is a flowchart of another video shooting method provided in the second embodiment of the present invention;
fig. 3 is a flowchart of a video shooting method according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a video shooting device provided in the fourth embodiment of the present invention;
fig. 5 is a schematic diagram of a sub-structure of a video camera according to a fourth embodiment of the present invention;
fig. 6 is a schematic diagram of another substructure of a video capture apparatus according to a fourth embodiment of the present invention;
fig. 7 is a schematic structural diagram of a computer device provided in the fifth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a flowchart of a video shooting method according to an embodiment of the present invention, where the present embodiment is applicable to a case where a video shooting scheme is generated according to background music, and the method may be executed by a video shooting device, where the video shooting device may be composed of hardware and/or software, and may be generally integrated in a device with a video shooting function, where the device may be an electronic device such as a server, a mobile terminal, or a server cluster. As shown in fig. 1, the method specifically includes the following steps:
step 110, analyzing the background music to obtain the beat information of the background music.
Wherein the background music may be music corresponding to the video picture, such as: the song sung by the singer in the concert, and the dance accompanying music played in the dance performance. The tempo information may be information that can reflect characteristics of the tempo of the background music, including characteristics of equal tempo intervals, characteristics of partial climax, characteristics of short accents and strong tones, and the like.
The background music is analyzed, and the mode of obtaining the beat information of the background music can comprise a least square method and a Fourier spectrum analysis method. Optionally, the process of obtaining the beat information of the background music by using the least square method may be to obtain typical audio frequencies respectively corresponding to musical instruments with strong rhythmicity, capture the background music according to the duration of the typical audio frequencies to obtain a plurality of music segments, calculate the component of the typical audio frequencies in each music segment by using the least square method, and determine the beat information of the background music according to the component.
Optionally, the method for obtaining the beat information of the background music by using the fourier spectrum analysis method may be that the window function and the background music are sampled according to the same set sampling frequency, the sampled background music is intercepted according to the duration of the window function to obtain a plurality of music pieces, the sampled window function and the plurality of music pieces are subjected to discrete fourier transform to obtain a spectrum function of the background music, and finally the beat information is determined according to the spectrum function.
Optionally, if the least square method is adopted to determine that the tempo information of the background music does not meet the set condition, the fourier spectrum analysis method is continuously adopted to obtain the tempo information of the background music.
And step 120, setting preset shooting parameters at a time point corresponding to the background music according to the beat information.
The shooting parameters may include a focal length of the camera, a shake amplitude of the camera, and a shake rate. The shake amplitude and the shake rate of the camera include a rotation amplitude and a rotation rate of the camera along a Roll axis (Roll axis), and a translation amplitude and a translation rate of the camera along a left-right direction (corresponding to a yaw axis) or an up-down direction (corresponding to a pitch axis (pitch axis)) of the control camera.
Specifically, when the tempo information shows the characteristics of equal tempo time intervals, the preset shooting parameters may be set at the time points corresponding to the background music according to a set rule at the time corresponding to the tempo every set time period. The setting rule may be to set the focal length of the camera to increase or decrease by a certain step length in a first setting time period centered on the time corresponding to the beat, and to set the camera to set the shake amplitude and to set the shake frequency. In the application scenario, the step size range of the camera pitch is 0-255. For example, in a certain shooting process, the variable range of the step length of the focal length of the camera is 100-200, and the time interval between beats is 500ms, the focal length of the camera can be set to rapidly change from 100 to 200 within 100ms near the beats, and the focal length of the camera is slowly pulled back from 200 to 100 within the remaining 400ms, so that the rhythm of the lens is produced. The roll axis may be set to rotate 5 degrees clockwise and counterclockwise within 100ms around the tempo, respectively, so as to make a dazzling feeling of the screen, that is, the roll axis may be rotated 5 degrees clockwise (or counterclockwise) and then returned to 0 degree, and then rotated 5 degrees counterclockwise (or clockwise) and then returned to 0 degree. 1/10 where the camera is shifted in the left-right direction within 100ms around the beat may be set to shift 1/10 left (or right) and then back to the standard reference position, then shift 1/10 right (or left) and then back to the standard reference position. The camera can also do this in the up-down direction. These actions may be repeated, i.e. may be performed one or more times. In this embodiment, the shooting parameters may be set every set time period, for example, every 6 seconds. In this embodiment, the duration of a single motion of the camera and the time interval between two motions may be set by a user, or may be randomly generated by the system.
When the beat information shows partial climax, the preset shooting parameters may be set at a time point corresponding to the background music: in a preset time length (hereinafter referred to as a climax segment) centered at a time corresponding to a climax, the focal length of the camera is set to increase from small to large in a linear or logarithmic manner. Specifically, a focal length range corresponding to the climax section is obtained, the focal length of the starting time point of the climax section is set as the minimum value, the focal length of the ending time point is set as the maximum value, and the focal length of the middle time point is subjected to interpolation calculation in a linear or logarithmic mode and the like. For the two climax segments with the free segment in between, the focal length slowly recovers from the maximum value to the minimum value, and the focal length can be adjusted by adopting a mode that the change rate and the volume are in negative correlation, namely, the focal length is changed more quickly when the volume is smaller. According to the method and the device, the preset shooting parameters are set at the time points corresponding to the background music according to the beat information, so that the video shooting operation is simplified, the threshold of special-effect video shooting is reduced, and the user experience is improved.
When the beat information shows short and strong sound characteristics, the mode of setting the preset shooting parameters at the time point corresponding to the background music is as follows: and in a preset time length taking the moment corresponding to the short tone as the center, setting the camera to rotate clockwise and anticlockwise at a set amplitude and a set speed, or setting the camera to translate in the left-right direction or the up-down direction at the set amplitude and the set speed. For example: clockwise and anticlockwise rotate 5 degrees within 200ms, 1/10 of left and right translation pictures within 200ms, or 1/10 of up and down translation pictures within 200 ms.
In this embodiment, the change of camera focus, the rotation of camera along the roller bearing, the translation of camera along left and right direction and upper and lower direction can mutually support, also mutually independent. The setting can be carried out according to the actual requirement, and is not limited here.
And step 130, controlling the camera to shoot the video at the time point corresponding to the background music according to the shooting parameters.
Specifically, after shooting parameters such as the focal length of the camera, the shaking amplitude and the shaking rate of the camera are set at a time point corresponding to the background music, the camera is controlled to shoot according to the shooting parameters in the process of shooting the video.
According to the technical scheme of the embodiment, the background music is analyzed to obtain the beat information of the background music, then the preset shooting parameters are set at the time points corresponding to the background music according to the beat information, and finally the camera is controlled to shoot the video at the time points corresponding to the background music according to the shooting parameters. According to the video shooting method provided by the embodiment of the invention, the preset shooting parameters are set at the time points corresponding to the background music according to the beat information of the background music, so that the camera carries out video shooting at the time points corresponding to the background music according to the preset shooting parameters, and a shooting person does not need to have a professional shooting level, thereby reducing the shooting difficulty of the video.
Example two
Fig. 2 is a flowchart of another video shooting method according to a second embodiment of the present invention, which is implemented by analyzing the background music to obtain the tempo information of the background music according to the above-mentioned embodiment, as follows: acquiring the time length of a typical audio; intercepting music segments of a plurality of typical audio time lengths from background music; calculating the components of the typical audio in each music piece; beat information of the background music is determined from the components. As shown in fig. 2, the method comprises the steps of:
at step 210, the duration of a typical audio is obtained.
The typical audio is the audio corresponding to the instrument with strong rhythm. Musical instruments may include drums, violins, electric bass, and the like. In the application scenario, the typical audio may be obtained by recording audio generated by a professional musician playing the musical instruments, or by collecting audio of musical instruments included in classical music. The duration of a typical audio may be the duration corresponding to one beat of the instrument playing.
In step 220, music pieces with a plurality of typical audio durations are intercepted from background music.
Wherein the interval of the start time of the adjacent music pieces is less than or equal to the duration of the typical audio. The duration of the intercepted piece of music is equal to the duration of typical audio. For example, assuming that the time length of typical audio is T, music pieces with the time length of T are intercepted in background music every T/2 or T/3.
In step 230, the component of the typical audio in each music piece is calculated.
Specifically, the process of calculating the components of the typical audio in each music piece may be that, first, the typical audio and the music piece are sampled according to a set sampling frequency, and then the components of the sampled typical audio and music piece are calculated according to the following formula:
Figure BDA0002017108230000111
where | A | represents the absolute value of the component of a typical audio in a piece of music, f [ n ]]And g [ n ]]The values of the nth sample point of typical audio and music pieces, respectively, are represented, and N represents the number of sample points.
In the present embodiment, the calculation is performed for the absolute value of the component, and is hereinafter simply referred to as the component. Assume a sampling frequency of fsIf the number of sampling points is N, then N is Tfs. The above formula calculates the components of the typical audio in each music piece, and if M music pieces are extracted from the background music, the components of M time instants can be obtained for each typical audio.
Step 240, determining beat information of the background music according to the components.
In this embodiment, the process of determining the beat information of the background music according to the components may be: the method comprises the steps of firstly obtaining component peak values of typical audio exceeding a first threshold value on the whole time axis, then filtering the component peak values to obtain peak value clusters corresponding to the typical audio, finally determining candidate typical audio according to the peak value clusters, judging whether the peak value clusters of the candidate typical audio meet set conditions or not, and if yes, determining the time interval of each peak value in the peak value clusters of the candidate typical audio as the beat information of background music.
Wherein the component peak is larger than the components on the left and right sides. The component peak values may be filtered by grouping component peak values having a time interval smaller than a set time period into one group and retaining the component peak value having the largest value. The time corresponding to the component peak value is the starting time, the middle time or the ending time of the music piece corresponding to the component peak value. Wherein the set duration may be any value between 300 and 500 ms. The candidate typical audio is determined according to the peak cluster, and the candidate typical audio may be determined by summing peaks in the peak cluster corresponding to each typical audio when the typical audio includes a plurality of types, to obtain a feature quantity of each typical audio, and determining the typical audio with the largest feature quantity as the candidate typical audio; if there is only one typical audio, the typical audio is determined as a candidate typical audio. The setting condition may include that the feature quantity of the candidate typical audio is larger than the second threshold, and peaks in a cluster of peaks of the candidate typical audio have features at equal intervals.
Specifically, assume that M time components are obtained through calculation, component peaks larger than a first threshold are counted in the M components, classification peaks with time intervals smaller than a set time duration are grouped into one class, a component peak with a maximum value is reserved, a filtered peak cluster is obtained, peaks in the peak cluster are summed, a summation value is determined as a feature quantity of the typical audio contained in the background music, and the typical audio with the maximum feature quantity is determined as a candidate typical audio. If the characteristic quantity of the candidate typical audio is larger than the second threshold value, and the peaks in the candidate typical audio peak cluster have characteristics of equal intervals, determining the time interval of each peak in the candidate typical audio peak cluster as the beat information of the background music, namely, the beat information shows equal beat time interval characteristics. And if the candidate typical audio does not meet the set conditions and the rhythm sense of the background music is not strong, continuously acquiring the beat information of the background music by adopting a Fourier spectrum analysis method.
And step 250, setting preset shooting parameters at a time point corresponding to the background music according to the beat information.
And step 260, controlling the camera to shoot the video at the time point corresponding to the background music according to the shooting parameters.
According to the technical scheme, the duration of the typical audio is obtained, a plurality of music sections with the duration of the typical audio are intercepted from the background music, the component of the typical audio in each music section is calculated, the tempo information of the background music is determined according to the component, and the motion of a camera yaw axis, a pitch axis and a roll axis is controlled according to the tempo information, so that the shooting skill is increased in video shooting, the shooting threshold of a specific special-effect video is reduced, and the user experience is improved. And the beat information of the background music is determined by calculating the components of the typical audio in each music piece, so that the accuracy of determining the beat information is improved.
EXAMPLE III
Fig. 3 is a flowchart of another video shooting method according to a third embodiment of the present invention, which is implemented by analyzing the background music to obtain the tempo information of the background music according to the above embodiments as follows: acquiring the duration of a window function, and sampling the window function and background music according to a set sampling frequency respectively; intercepting music pieces with a plurality of window function durations from the sampled background music; wherein, the interval of the starting time of the adjacent music pieces is less than or equal to the duration of the window function; acquiring a frequency spectrum function of background music according to the sampled window function and music fragments; and determining the beat information of the background music according to the frequency spectrum function. As shown in fig. 3, the method comprises the steps of:
step 310, obtaining the duration of the window function, and sampling the window function and the background music according to a set sampling frequency respectively.
The window function may be a cosine window, a rectangular window or a gaussian window, and is preferably a cosine window. Suppose that the frequency is set to fsThe duration of the window function is T, the number of sampling points is N, and N is Tfs. If the total duration of the background music is tau and the number of sampling points is M, then M is fsτ。
And step 320, intercepting a plurality of music pieces with the same duration as the window function from the sampled background music.
Wherein the interval of the start time of the adjacent music pieces is less than or equal to the duration of the window function. The duration of the intercepted piece of music is equal to the duration of the window function. For example, assuming that the duration of typical audio is T, a music piece with the duration of T is intercepted every T/2 in background music. The method is reflected in the sampled background music, wherein N sampling points are intercepted every N/2 sampling points to obtain discrete music segments.
Step 330, obtaining the spectrum function of the background music according to the sampled window function and music segment.
Specifically, the manner of obtaining the spectrum function of the background music according to the sampled window function and music piece may be: performing discrete Fourier transform on the sampled window function and music fragment according to the following formula to obtain a frequency spectrum function corresponding to background music:
Figure BDA0002017108230000141
where m represents the mth time after the background music sample, f [ n ]]The value of the nth sample point of the window function, g [ m + N-N/2]]The value of the nth sampling point in the segment intercepted at the mth moment of the background music is represented, the center position of the segment is the mth moment, | STFT (m, k) | represents the frequency spectrum module value at the (m, k) point on the time-frequency plane, and k is more than or equal to 0 and less than or equal to N/2. The above-mentioned spectrum function represents the time-frequency two-dimensional plane of the background music. In this embodiment, the calculation is performed on the spectrum modulus value, which is hereinafter referred to as the spectrum value.
Step 340, determining the beat information of the background music according to the spectrum function.
Specifically, the method for determining the beat information of the background music according to the spectrum function may be: extracting a local spectrum peak value according to a spectrum function; and determining the beat information of the background music according to the local spectrum peak value.
The local spectrum peak value is the spectrum module value at the (m, k) point on the time-frequency plane, which is larger than the spectrum module values corresponding to the surrounding points, and the surrounding points are the points at (m-1, k), (m +1, k), (m, k-1) and (m, k + 1).
After the local spectrum peak value is obtained, the characteristic of the spectrum peak value is analyzed, so that the beat information of the background music is obtained. If the local spectrum peak value presents the characteristic of equal time spacing in the frequency band smaller than the set threshold value, the time interval of the local spectrum peak value is determined as the beat information of the background music, namely the beat information presents the characteristic of equal beat time interval. If the local spectrum peak value does not have the characteristic of equal time spacing in the frequency band smaller than the set threshold value, acquiring the local spectrum peak value exceeding a third threshold value; and acquiring the frequency spectrum value of each moment in the preset time length. The preset duration is a duration centered at a time corresponding to the local spectrum peak. If one half of the local spectrum peak value is smaller than the average value of the spectrum values at all times in the preset time length, the beat information of the background music has partial climax characteristics. If one half of the local spectrum peak value is larger than the average value of the spectrum values at all the moments in the preset time length, the beat information of the background music has short and strong sound characteristics.
Specifically, when the local spectrum peak does not exhibit the characteristic of equal time spacing in the frequency band smaller than the set threshold, the local spectrum peak exceeding the third threshold is extracted, the spectrum value of each time within the set duration with the time corresponding to the extracted local spectrum peak as the center is acquired, and the average value of each spectrum value is calculated. If one half of the extracted local frequency spectrum peak value is smaller than the average value, the beat information of the background music is represented as partial climax characteristics; if one-half of the extracted local spectrum peak value is larger than the average value, the beat information of the background music is represented as short and strong sound characteristics.
Optionally, characteristics of a local spectrum peak in a region selected by the user on the time-frequency plane may be analyzed, and a shooting parameter is set in a corresponding time period of the region in the background music according to an analysis result.
And step 350, setting preset shooting parameters at a time point corresponding to the background music according to the beat information.
And step 360, controlling the camera to shoot the video at the time point corresponding to the background music according to the shooting parameters.
According to the technical scheme, the duration of the window function is obtained, the window function and the background music are sampled according to the set sampling frequency respectively, the music fragments with the duration of the window function are intercepted from the sampled background music, the frequency spectrum function of the background music is obtained according to the sampled window function and music fragments, the beat information of the background music is determined according to the frequency spectrum function, and the motion of a camera yaw axis, a pitch axis and a roll axis is controlled according to the beat information, so that the shooting skill is increased in video shooting, the shooting threshold of a specific special-effect video is reduced, and the user experience is improved. And the beat information of the background music is determined according to the sampled window function and the spectrum function obtained by the music fragment, so that music with unobvious rhythm sense can be analyzed, and the accuracy of determining the beat information is improved.
Example four
Fig. 4 is a schematic structural diagram of a video shooting apparatus according to a fourth embodiment of the present invention, as shown in fig. 4, the apparatus includes: a tempo information acquisition module 410, a preset shooting parameter setting module 420, and a video shooting module 430.
A beat information obtaining module 410, configured to analyze the background music to obtain beat information of the background music;
a preset shooting parameter setting module 420, configured to set a preset shooting parameter at a time point corresponding to the background music according to the beat information;
and a video shooting module 430, configured to control the camera to shoot a video at a time point corresponding to the background music according to the shooting parameters.
Optionally, as shown in fig. 5, the beat information obtaining module 410 includes:
a duration obtaining unit 411 configured to obtain a duration of a typical audio; wherein, the typical audio is the audio corresponding to the musical instrument with strong rhythm;
a music piece clipping unit 412 for clipping a plurality of music pieces of the same duration as the typical audio from the background music; wherein, the interval of the starting time of the adjacent music pieces is less than or equal to the time length of the typical audio;
a component calculation unit 413 for calculating components of typical audio in each piece of music;
a beat information determination unit 414 for determining beat information of the background music from the components.
Optionally, the component calculating unit 413 is specifically configured to:
sampling the typical audio and music segments according to a set sampling frequency respectively;
the components are calculated for a typical audio and music piece after sampling according to the following formula:
Figure BDA0002017108230000171
wherein, | A | represents the absolute value of the component of the typical audio in the music piece, f [ N ] and g [ N ] represent the numerical values of the nth sampling point of the typical audio and the music piece respectively, and N represents the number of sampling points.
Optionally, the beat information determining unit 414 is specifically configured to:
acquiring component peaks of the typical audio exceeding a first threshold value on the whole time axis;
filtering the component peak value to obtain a peak value cluster corresponding to the typical audio;
determining candidate typical audio according to the peak cluster, and judging whether the peak cluster of the candidate typical audio meets a set condition;
and if so, determining the time interval of each peak in the peak cluster of the candidate typical audio as the beat information of the background music.
Optionally, the beat information determining unit 414 is further configured to:
the component peak values with the time intervals smaller than the set duration are gathered into one class, and the component peak value with the maximum value is reserved; the time corresponding to the component peak value is the starting time, the middle time or the ending time of the music piece corresponding to the component peak value.
Optionally, the beat information determining unit 414 is further configured to:
when the typical audio comprises a plurality of types, respectively summing the peaks in the peak cluster corresponding to each typical audio to obtain the characteristic quantity of each typical audio;
and determining the typical audio with the largest characteristic quantity as the candidate typical audio.
Optionally, the setting conditions include: the feature quantity of the candidate typical audio is larger than the second threshold, and peaks in the cluster of peaks of the candidate typical audio have features at equal intervals.
In some embodiments, as shown in fig. 6, the beat information acquisition module 410 includes:
a window function sampling unit 4101, configured to obtain a duration of a window function, and sample the window function and background music according to a set sampling frequency, respectively;
a music section clipping unit 4102 for clipping a plurality of music sections having the same duration as the window function from the sampled background music; wherein, the interval of the starting time of the adjacent music pieces is less than or equal to the duration of the window function;
a spectrum function acquiring unit 4103 configured to acquire a spectrum function of the background music according to the sampled window function and music piece;
a tempo information determining unit 4104 for determining tempo information of the background music according to the spectrum function.
Optionally, the spectrum function obtaining unit 4103 is specifically configured to:
performing discrete Fourier transform on the sampled window function and music fragment according to the following formula to obtain a frequency spectrum function corresponding to background music:
Figure BDA0002017108230000181
wherein m represents the mth moment after the background music is sampled, f [ N ] represents the numerical value of the nth sampling point of the window function, g [ m + N-N/2] represents the numerical value of the nth sampling point in the segment intercepted at the mth moment of the background music, the central position of the segment is the mth moment, | STFT (m, k) | represents the spectrum module value at the (m, k) point on the time-frequency plane, and k is more than or equal to 0 and less than or equal to N/2.
Optionally, the beat information determining unit 4104 is specifically configured to:
extracting a local spectrum peak value according to a spectrum function;
and determining the beat information of the background music according to the local spectrum peak value.
Optionally, the beat information determining unit 4104 is further configured to:
and if the local spectrum peak value has the characteristic of equal time spacing in a frequency band smaller than the set threshold value, determining the time interval of the local spectrum peak value as the beat information of the background music.
Optionally, the beat information determining unit 4104 is further configured to:
if the local spectrum peak value does not have the characteristic of equal time spacing in the frequency band smaller than the set threshold value, acquiring the local spectrum peak value exceeding a third threshold value;
acquiring a frequency spectrum value of each moment in a preset time length; the preset duration is the duration with the time corresponding to the local spectrum peak as the center;
if one half of the local spectrum peak value is smaller than the average value of the spectrum values at all times within the preset duration, the beat information of the background music has partial climax characteristics;
if one half of the local spectrum peak value is larger than the average value of the spectrum values at all the moments in the preset time length, the beat information of the background music has short and strong sound characteristics.
Optionally, the shooting parameters include a focal length of the camera, a jitter amplitude and a jitter rate of the camera; the camera shaking amplitude and the camera shaking speed comprise the rotation amplitude and the rotation speed of the camera along the transverse roller, the translation amplitude and the translation speed of the camera along the left-right direction, and the translation amplitude and the translation speed of the camera along the up-down direction; if the beat information of the background music has a partial climax characteristic, the preset shooting parameter setting module 420 is further configured to:
setting the focal length of the camera to increase from small to large in a linear or logarithmic mode within a preset time length taking the time corresponding to the local frequency spectrum peak value as the center;
if the beat information of the background music has the short and strong sound characteristic, preset shooting parameters are set at the time point corresponding to the background music according to the beat information, and the method comprises the following steps:
and setting the camera to shake at a set shaking amplitude and a set shaking frequency within a preset time length taking the time corresponding to the local spectrum peak value as a center.
Optionally, the preset shooting parameter setting module 420 is further configured to:
and setting shooting parameters at the moment corresponding to the peak value every set time period according to a set rule.
Optionally, the preset shooting parameter setting module 420 is further configured to:
setting the focal length of the camera to increase or decrease by a certain step length in a first set time length taking the moment corresponding to the peak value as the center; and setting the camera to shake at a set shaking amplitude and a set shaking frequency within a first set time length taking the time corresponding to the peak value as the center.
The device can execute the methods provided by all the embodiments of the invention, and has corresponding functional modules and beneficial effects for executing the methods. For details not described in detail in this embodiment, reference may be made to the methods provided in all the foregoing embodiments of the present invention.
EXAMPLE five
Fig. 7 is a schematic structural diagram of a computer device according to a fifth embodiment of the present invention. FIG. 7 illustrates a block diagram of a computer device 712 suitable for use to implement embodiments of the present invention. The computer device 712 shown in fig. 7 is only an example and should not bring any limitations to the functionality or scope of use of the embodiments of the present invention. Device 712 is typically a computing device that assumes the functionality of capturing video.
As shown in fig. 7, computer device 712 is embodied in the form of a general purpose computing device. Components of computer device 712 may include, but are not limited to: one or more processors 716, a storage device 728, and a bus 718 that couples the various system components (including the storage device 728 and the processors 716). The storage device 728 has a computer program stored thereon, which when executed by the processor 716 implements the method of capturing video as described above.
Bus 718 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.
Computer device 712 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by computer device 712 and includes both volatile and nonvolatile media, removable and non-removable media.
Storage 728 may include computer system readable media in the form of volatile Memory, such as Random Access Memory (RAM) 730 and/or cache Memory 732. Computer device 712 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 734 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 7, commonly referred to as a "hard drive"). Although not shown in FIG. 7, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a Compact disk-Read Only Memory (CD-ROM), a Digital Video disk (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to the bus 718 by one or more data media interfaces. Storage 728 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the video capture methods described above.
Program 736 having a set (at least one) of program modules 726, which may include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, each of which or some combination thereof may comprise an implementation of a network environment, may be stored in, for example, storage 728. Program modules 726 generally perform the functions and/or methodologies of embodiments of the invention as described herein.
Computer device 712 may also communicate with one or more external devices 714 (e.g., keyboard, pointing device, camera, display 724, etc.), with one or more devices that enable a user to interact with computer device 712, and/or with any devices (e.g., network card, modem, etc.) that enable computer device 712 to communicate with one or more other computing devices. Such communication may occur through input/output (I/O) interfaces 722. Further, computer device 712 may also communicate with one or more networks (e.g., a Local Area Network (LAN), Wide Area Network (WAN), and/or a public Network, such as the internet) via Network adapter 720. As shown, network adapter 720 communicates with the other modules of computer device 712 via bus 718. It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with computer device 712, including but not limited to: microcode, device drivers, Redundant processing units, external disk drive Arrays, disk array (RAID) systems, tape drives, and data backup storage systems, to name a few.
The processor 716 executes various functional applications and data processing, such as implementing a video shooting method provided by the above-described embodiments of the present invention, by executing programs stored in the storage device 728.
EXAMPLE six
The sixth embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the video shooting method provided by the sixth embodiment of the present invention.
Of course, the computer program stored on the computer-readable storage medium provided by the embodiments of the present invention is not limited to the method operations described above, and may also perform related operations in the video shooting method provided by any embodiments of the present invention.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (12)

1. A method of capturing video, comprising:
analyzing the background music to obtain the beat information of the background music;
setting preset shooting parameters at a time point corresponding to the background music according to the beat information;
controlling a camera to shoot videos at a time point corresponding to the background music according to the shooting parameters;
wherein the setting of the preset shooting parameters at the time point corresponding to the background music according to the tempo information comprises: when the beat information shows the characteristic of equal beat time intervals, setting shooting parameters at the time corresponding to the beat at intervals of a set time period according to a set rule; when the beat information shows partial climax characteristics, setting the focal length of the camera to increase from small to large in a linear or logarithmic mode within a preset time length taking the time corresponding to the climax as a center; and when the beat information shows the short strong sound characteristic, setting the camera to rotate clockwise and anticlockwise at a set amplitude and a set speed within a preset time length taking the moment corresponding to the short strong sound as the center, or setting the camera to translate in the left-right direction or the up-down direction at the set amplitude and the set speed.
2. The method of claim 1, wherein analyzing the background music to obtain tempo information of the background music comprises:
acquiring the time length of a typical audio; the typical audio is the audio corresponding to the instrument with strong rhythmicity;
intercepting a plurality of music pieces with the same duration as the typical audio from background music; wherein the interval of the starting moments of the adjacent music pieces is less than or equal to the duration of the typical audio;
calculating the component of the typical audio in each music piece;
and determining the beat information of the background music according to the components.
3. The method of claim 2, wherein calculating the component of the typical audio in each music piece comprises:
sampling the typical audio and music segments according to a set sampling frequency respectively;
the components are calculated for a typical audio and music piece after sampling according to the following formula:
Figure FDA0003115675740000021
wherein, | A | represents the absolute value of the component of the typical audio in the music piece, f [ N ] and g [ N ] represent the numerical values of the nth sampling point of the typical audio and the music piece respectively, and N represents the number of sampling points.
4. The method of claim 2, wherein determining beat information of background music from the components comprises:
acquiring component peaks of the typical audio exceeding a first threshold value on the whole time axis;
filtering the component peak value to obtain a peak value cluster corresponding to the typical audio;
determining candidate typical audio according to the peak cluster, and judging whether the peak cluster of the candidate typical audio meets a set condition;
and if so, determining the time interval of each peak value in the peak value cluster of the candidate typical audio as the beat information of the background music.
5. The method of claim 1, wherein analyzing the background music to obtain tempo information of the background music comprises:
acquiring the duration of a window function, and sampling the window function and background music according to a set sampling frequency respectively;
intercepting a plurality of music pieces with the same duration as the window function from the sampled background music;
acquiring a frequency spectrum function of the background music according to the sampled window function and music fragments;
and determining the beat information of the background music according to the frequency spectrum function.
6. The method of claim 5, wherein obtaining the spectrum function of the background music according to the sampled window function and music piece comprises:
performing discrete Fourier transform on the sampled window function and music fragment according to the following formula to obtain a frequency spectrum function corresponding to background music:
Figure FDA0003115675740000031
wherein m represents the mth moment after the background music is sampled, f [ N ] represents the numerical value of the nth sampling point of the window function, g [ m + N-N/2] represents the numerical value of the nth sampling point in the segment intercepted at the mth moment of the background music, the central position of the segment is the mth moment, | STFT (m, k) | represents the spectrum module value at the (m, k) point on the time-frequency plane, and k is more than or equal to 0 and less than or equal to N/2.
7. The method of claim 6, wherein determining beat information of background music according to the spectrum function comprises:
extracting local spectral peaks according to the spectral function;
and determining the beat information of the background music according to the local spectrum peak value.
8. The method of claim 7, wherein determining beat information of background music from the local spectral peaks comprises:
if the local spectrum peak value presents the characteristic of equal time spacing in a frequency band smaller than a set threshold value, determining the time interval of the local spectrum peak value as the beat information of the background music;
determining the beat information of the background music according to the characteristics of the local spectrum peak value, wherein the determining comprises the following steps:
if the local spectrum peak value does not have the characteristic of equal time spacing in the frequency band smaller than the set threshold value, acquiring the local spectrum peak value exceeding a third threshold value;
acquiring a frequency spectrum value of each moment in a preset time length; the preset duration is a duration centered at a time corresponding to the local spectrum peak;
if one half of the local spectrum peak value is smaller than the average value of the spectrum values at all times in the preset duration, the beat information of the background music has partial climax characteristics;
and if one half of the local spectrum peak value is larger than the average value of the spectrum values at all the moments in the preset time length, the beat information of the background music has a short and strong sound characteristic.
9. The method of claim 8, wherein the shooting parameters include a focal length of the camera, a shake amplitude of the camera, and a shake rate; the camera shaking amplitude and the camera shaking speed comprise the rotation amplitude and the rotation speed of the camera along the transverse roller, the translation amplitude and the translation speed of the camera along the left-right direction, and the translation amplitude and the translation speed of the camera along the up-down direction.
10. A video capture device, comprising:
the beat information acquisition module is used for analyzing the background music to acquire beat information of the background music;
the preset shooting parameter setting module is used for setting preset shooting parameters at a time point corresponding to the background music according to the beat information;
the video shooting module is used for controlling a camera to shoot videos at a time point corresponding to the background music according to the shooting parameters;
wherein the setting of the preset shooting parameters at the time point corresponding to the background music according to the tempo information comprises: when the beat information shows the characteristic of equal beat time intervals, setting shooting parameters at the time corresponding to the beat at intervals of a set time period according to a set rule; when the beat information shows partial climax characteristics, setting the focal length of the camera to increase from small to large in a linear or logarithmic mode within a preset time length taking the time corresponding to the climax as a center; and when the beat information shows the short strong sound characteristic, setting the camera to rotate clockwise and anticlockwise at a set amplitude and a set speed within a preset time length taking the moment corresponding to the short strong sound as the center, or setting the camera to translate in the left-right direction or the up-down direction at the set amplitude and the set speed.
11. A computer device comprising a storage means and a processor, the storage means having a computer program stored thereon, wherein the processor implements the method of capturing video according to any one of claims 1-9 when executing the computer program.
12. A computer-readable storage medium storing a computer program comprising program instructions, which when executed implement the method of capturing video of any of claims 1-9.
CN201910266828.4A 2019-04-03 2019-04-03 Video shooting method, device, equipment and storage medium Active CN109922268B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910266828.4A CN109922268B (en) 2019-04-03 2019-04-03 Video shooting method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910266828.4A CN109922268B (en) 2019-04-03 2019-04-03 Video shooting method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109922268A CN109922268A (en) 2019-06-21
CN109922268B true CN109922268B (en) 2021-08-10

Family

ID=66968477

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910266828.4A Active CN109922268B (en) 2019-04-03 2019-04-03 Video shooting method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109922268B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112822563A (en) 2019-11-15 2021-05-18 北京字节跳动网络技术有限公司 Method, device, electronic equipment and computer readable medium for generating video
CN110913136A (en) * 2019-11-27 2020-03-24 维沃移动通信有限公司 Video shooting method and device, electronic equipment and medium
CN112188099B (en) * 2020-09-29 2022-07-01 咪咕文化科技有限公司 Video shooting control method, communication device and computer-readable storage medium
CN112511750B (en) * 2020-11-30 2022-11-29 维沃移动通信有限公司 Video shooting method, device, equipment and medium
CN113096689A (en) * 2021-04-02 2021-07-09 腾讯音乐娱乐科技（深圳）有限公司 Song singing evaluation method, equipment and medium
CN115623145A (en) * 2021-07-12 2023-01-17 华为技术有限公司 Video shooting method and device, electronic equipment and storage medium

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101226526A (en) * 2007-01-17 2008-07-23 上海怡得网络有限公司 Method for searching music based on musical segment information inquest
JP2012135372A (en) * 2010-12-24 2012-07-19 Orion:Kk Relaxation sound and method for generating the same
CN102543052B (en) * 2011-12-13 2015-08-05 北京百度网讯科技有限公司 A kind of method and apparatus analyzing music BPM
CN103338345B (en) * 2013-06-09 2017-05-24 福建凯米网络科技有限公司 Method for shooting images or videos in singing and device applying same
CN104103300A (en) * 2014-07-04 2014-10-15 厦门美图之家科技有限公司 Method for automatically processing video according to music beats
CN105681676A (en) * 2016-03-25 2016-06-15 上海斐讯数据通信技术有限公司 Shooting image method and shooting device
CN107682654B (en) * 2017-09-30 2019-11-26 北京金山安全软件有限公司 Video recording method, shooting device, electronic equipment and medium
CN109176541B (en) * 2018-09-06 2022-05-06 南京阿凡达机器人科技有限公司 Method, equipment and storage medium for realizing dancing of robot

Also Published As

Publication number Publication date
CN109922268A (en) 2019-06-21

Similar Documents

Publication Publication Date Title
CN109922268B (en) Video shooting method, device, equipment and storage medium
US11564001B2 (en) Media content identification on mobile devices
EP2854128A1 (en) Audio analysis apparatus
CN111508508A (en) Super-resolution audio generation method and equipment
US11729458B2 (en) Media content identification on mobile devices
US9646592B2 (en) Audio signal analysis
US20140128160A1 (en) Method and system for generating a sound effect in a piece of game software
CN115691544A (en) Training of virtual image mouth shape driving model and driving method, device and equipment thereof
CN114073854A (en) Game method and system based on multimedia file
WO2023040520A1 (en) Method and apparatus for performing music matching of video, and computer device and storage medium
WO2023051246A1 (en) Video recording method and apparatus, device, and storage medium
CN109410972B (en) Method, device and storage medium for generating sound effect parameters
WO2023030017A1 (en) Audio data processing method and apparatus, device and medium
JP6295381B1 (en) Display timing determination device, display timing determination method, and program
CN112420006B (en) Method and device for operating simulated musical instrument assembly, storage medium and computer equipment
CN112416116B (en) Vibration control method and system for computer equipment
CN109495786B (en) Pre-configuration method and device of video processing parameter information and electronic equipment
CN112825245A (en) Real-time sound modification method and device and electronic equipment
CN113066503B (en) Audio frame adjusting method, device, equipment and readable storage medium
CN113674723B (en) Audio processing method, computer equipment and readable storage medium
CN110289010B (en) Sound collection method, device, equipment and computer storage medium
JP2017017387A (en) Video processing apparatus and video processing method
CN115484503A (en) Bullet screen generation method and device, electronic equipment and storage medium
CN113436644A (en) Sound quality evaluation method, sound quality evaluation device, electronic equipment and storage medium
CN114741046A (en) Audio playback method and device, electronic equipment and computer readable medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20190919

Address after: 518027 Building No. 6, Qianhai Shenzhen-Hong Kong Youth Dream Workshop, Qianhai Shenzhen Cooperation Zone, Shenzhen City, Guangdong Province 220

Applicant after: Rui magic Intelligent Technology (Shenzhen) Co., Ltd.

Applicant after: Dongguan Songshan Lake Robot Research Institute International Company Limited

Address before: 518027 Building No. 6, Qianhai Shenzhen-Hong Kong Youth Dream Workshop, Qianhai Shenzhen Cooperation Zone, Shenzhen City, Guangdong Province 220

Applicant before: Rui magic Intelligent Technology (Shenzhen) Co., Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20211101

Address after: 518027 220, building 6, Qianhai Shenzhen Hong Kong youth dream workshop, Qianhai Shenzhen Hong Kong cooperation zone, Shenzhen City, Guangdong Province

Patentee after: RUIMO INTELLIGENT TECHNOLOGY (SHENZHEN) Co.,Ltd.

Address before: 518027 220, building 6, Qianhai Shenzhen Hong Kong youth dream workshop, Qianhai Shenzhen Hong Kong cooperation zone, Shenzhen City, Guangdong Province

Patentee before: RUIMO INTELLIGENT TECHNOLOGY (SHENZHEN) Co.,Ltd.

Patentee before: DONGGUAN SONGSHAN LAKE TECHXINSTITUTE Co.,Ltd.

TR01 Transfer of patent right