CN107645630A - Image pickup processing method and device - Google Patents
Image pickup processing method and device Download PDFInfo
- Publication number
- CN107645630A CN107645630A CN201610581713.0A CN201610581713A CN107645630A CN 107645630 A CN107645630 A CN 107645630A CN 201610581713 A CN201610581713 A CN 201610581713A CN 107645630 A CN107645630 A CN 107645630A
- Authority
- CN
- China
- Prior art keywords
- audio
- speed
- frame per
- predetermined
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention provides a kind of image pickup processing method and device, this method includes：Obtain audio speed of the predetermined audio source in the audio of predetermined instant；According to the audio speed of acquisition, and audio speed and the corresponding relation of shooting frame per second, it is determined that shooting frame per second corresponding to the audio speed obtained；Camera speed is adjusted according to the shooting frame per second of determination.By the present invention, solve the problems, such as in correlation technique can not dynamic regulation high-speed camera camera speed.
Description
Technical field
The present invention relates to the communications field, in particular to a kind of image pickup processing method and device.
Background technology
With the lifting of smart machine (for example, smart mobile phone) performance, the function on many slr cameras can be in intelligence
It can be realized in equipment, it is therefore, just more and more specialized for the demand of Camera functions on smart machine.At present, various
High-end terminal entries all realize slow motion high-speed camera function, by high-speed camera human eye can be helped to experience the time
Speed.This is a very interesting application, and various scenes can fix in shorter moment.For the side realized at present
Case, in high-speed camera, shooting frame per second is in a scope almost fixed so that camera speed is also fixed, and is imaged
Frame per second is usually higher, e.g., when shooting frame per second is 360fps, that is, has 360 frame data in one second, if play
When, screen player is broadcast according to play frame rate is 30fps, and such screen player, which just needs to play for 12 seconds, to be taken the photograph at a high speed
As the content of one second, because difference becomes smaller between each frame when playing, i.e., the time difference between each frame was elongated, for
On the visual sense of eyes, the effect that a kind of picture slows down can be reached.But screen player is playing the content of high-speed camera
When, can have a problem that, the time difference in playing process between each frame is identical, user experience it is slow feel be
Solidification.
Therefore, the camera speed of high-speed camera can not be dynamically adjusted in correlation technique, causes video player playing
The problem of time difference during high-speed camera content between each frame is identical so that what user experienced slow feels it is solidification
, the speed sense of picture can not be felt.
The content of the invention
The embodiments of the invention provide a kind of image pickup processing method and device, so that at least solve can not dynamic in correlation technique
The problem of adjusting the camera speed of high-speed camera.
According to one embodiment of present invention, there is provided a kind of image pickup processing method, including：Predetermined audio source is obtained pre-
The audio speed for the audio that timing is carved；Closed according to the audio speed of acquisition, and audio speed with the corresponding of shooting frame per second
System, it is determined that shooting frame per second corresponding to the audio speed obtained；Camera speed is adjusted according to the shooting frame per second of determination.
Alternatively, the audio speed for obtaining the predetermined audio source in predetermined instant includes：Obtain the pre- accordatura
Frequency source is at least one audio-frequency information of the audio of the predetermined instant：Loudness acceleration, tone acceleration, tone color accelerate
Degree；At least one described audio-frequency information according to acquisition, determines the audio speed.
Alternatively, obtain the audio of the predetermined audio source in the predetermined instant the audio speed it
Before, in addition to：Filtering is weighted to the audio of the predetermined instant.
Alternatively, in the audio speed according to acquisition, and audio speed and the corresponding relation of shooting frame per second, it is determined that
Before shooting frame per second corresponding to the audio speed obtained, in addition to：According to maximal oxygen image-to-frame ratio, the video being pre-selected is broadcast
The fixation play frame rate of device, and at least one described audio-frequency information of the predetermined instant are put, determines audio speed and shooting
The corresponding relation of frame per second, wherein, the maximal oxygen image-to-frame ratio is determined by the hardware of picture pick-up device.
Alternatively, the audio-source includes at least one of：The audio file being locally stored, the audio text of real-time recording
Part.
According to another embodiment of the invention, there is provided a kind of camera treatment device, including：Acquisition module, for obtaining
Predetermined audio source is taken in the audio speed of the audio of predetermined instant；First determining module, for the audio speed according to acquisition
Degree, and audio speed and the corresponding relation of shooting frame per second, it is determined that shooting frame per second corresponding to the audio speed obtained；Adjustment
Module, for adjusting camera speed according to the shooting frame per second of determination.
Alternatively, the acquisition module includes：Acquiring unit, for obtaining the predetermined audio source in the predetermined instant
At least one the audio-frequency information of the audio：Loudness acceleration, tone acceleration, tone color acceleration；Determining unit, for root
At least one described audio-frequency information according to acquisition, determines the audio speed.
Alternatively, in addition to：Filtration module, for being weighted filtering to the audio of the predetermined instant.
Alternatively, in addition to：Second determining module, for according to maximal oxygen image-to-frame ratio, the video player being pre-selected
Fixation play frame rate, and at least one described audio-frequency information of the predetermined instant, determine audio speed and shooting frame per second
Corresponding relation, wherein, the maximal oxygen image-to-frame ratio is determined by the hardware of picture pick-up device.
Alternatively, the audio-source includes at least one of：The audio file being locally stored, the audio text of real-time recording
Part.
According to still another embodiment of the invention, a kind of storage medium is additionally provided.The storage medium is arranged to storage and used
In the program code for performing following steps：Obtain audio speed of the predetermined audio source in the audio of predetermined instant；According to acquisition
The audio speed, and audio speed and the corresponding relation of shooting frame per second, it is determined that being taken the photograph corresponding to the audio speed obtained
Image-to-frame ratio；Camera speed is adjusted according to the shooting frame per second of determination.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：Obtain the pre- accordatura
Frequency source includes in the audio speed of predetermined instant：Obtain the audio of the predetermined audio source in the predetermined instant
At least one audio-frequency information：Loudness acceleration, tone acceleration, tone color acceleration；According to the audio-frequency information of acquisition at least
One of, determine the audio speed.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：It is described predetermined obtaining
Audio-source before the audio speed of the audio of the predetermined instant, in addition to：To described in the predetermined instant
Audio is weighted filtering.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：In the institute according to acquisition
Audio speed, and audio speed and the corresponding relation of shooting frame per second are stated, it is determined that being imaged corresponding to the audio speed obtained
Before frame per second, in addition to：According to maximal oxygen image-to-frame ratio, the fixation play frame rate for the video player being pre-selected, and it is described
At least one described audio-frequency information of predetermined instant, audio speed is determined with imaging the corresponding relation of frame per second, wherein, the maximum
Shooting frame per second is determined by the hardware of picture pick-up device.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：The audio-source includes
At least one of：The audio file being locally stored, the audio file of real-time recording.
By the present invention, audio speed of the predetermined audio source in the audio of predetermined instant is obtained；According to the audio of acquisition speed
Degree, and audio speed and the corresponding relation of shooting frame per second, it is determined that shooting frame per second corresponding to the audio speed obtained；According to determination
Shooting frame per second adjustment camera speed.The shooting frame per second of high-speed camera is combined together by the present invention with audio, according to acquisition
The audio speed of the audio of audio-source, the shooting frame per second of high-speed camera is determined, because the audio speed of audio always dynamically becomes
Change, so the shooting frame per second determined according to the audio speed of audio is also dynamic change, and then realize dynamic regulation
Camera speed, therefore, can solve the problems, such as in correlation technique can not dynamic regulation high-speed camera camera speed so that user
The speed sense of picture can be felt.
Brief description of the drawings
Accompanying drawing described herein is used for providing a further understanding of the present invention, forms the part of the application, this hair
Bright schematic description and description is used to explain the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings：
Fig. 1 is a kind of hardware block diagram of the mobile terminal of image pickup processing method of the embodiment of the present invention；
Fig. 2 is the flow chart of image pickup processing method according to embodiments of the present invention；
Fig. 3 is the structured flowchart of camera treatment device according to embodiments of the present invention；
Fig. 4 is the structured flowchart of acquisition module 32 in camera treatment device according to embodiments of the present invention；
Fig. 5 is the preferred structure block diagram one of camera treatment device according to embodiments of the present invention；
Fig. 6 is the preferred structure block diagram two of camera treatment device according to embodiments of the present invention；
Fig. 7 is the structural representation of camera treatment device according to embodiments of the present invention；
Fig. 8 is the schematic flow sheet of image pickup processing method according to embodiments of the present invention.
Embodiment
Describe the present invention in detail below with reference to accompanying drawing and in conjunction with the embodiments.It should be noted that do not conflicting
In the case of, the feature in embodiment and embodiment in the application can be mutually combined.
It should be noted that term " first " in description and claims of this specification and above-mentioned accompanying drawing, "
Two " etc. be for distinguishing similar object, without for describing specific order or precedence.
Embodiment 1
The embodiment of the method that the embodiment of the present application 1 is provided can be in mobile terminal, terminal or similar fortune
Calculate and performed in device.Exemplified by running on mobile terminals, Fig. 1 is a kind of movement of image pickup processing method of the embodiment of the present invention
The hardware block diagram of terminal.Handled as shown in figure 1, mobile terminal 10 can include one or more (one is only shown in figure)
Device 102 (processor 102 can include but is not limited to Micro-processor MCV or PLD FPGA etc. processing unit),
Memory 104 for data storage and the transmitting device 106 for communication function.Those of ordinary skill in the art can be with
Understand, the structure shown in Fig. 1 is only to illustrate, and it does not cause to limit to the structure of above-mentioned electronic installation.For example, mobile terminal 10
It may also include more either less components than shown in Fig. 1 or there is the configuration different from shown in Fig. 1.
Memory 104 can be used for the software program and module of storage application software, such as the shooting in the embodiment of the present invention
Programmed instruction/module corresponding to processing method, processor 102 by operation be stored in software program in memory 104 and
Module, so as to perform various function application and data processing, that is, realize above-mentioned method.Memory 104 may include at a high speed with
Machine memory, may also include nonvolatile memory, as one or more magnetic storage device, flash memory or other it is non-easily
The property lost solid-state memory.In some instances, memory 104 can further comprise depositing relative to processor 102 is remotely located
Reservoir, these remote memories can pass through network connection to mobile terminal 10.The example of above-mentioned network is including but not limited to mutual
Networking, intranet, LAN, mobile radio communication and combinations thereof.
Transmitting device 106 is used to data are received or sent via a network.Above-mentioned network instantiation may include
The wireless network that the communication providerses of mobile terminal 10 provide.In an example, transmitting device 106 includes a Network adaptation
Device (Network Interface Controller, NIC), its can be connected by base station with other network equipments so as to it is mutual
Networking is communicated.In an example, transmitting device 106 can be radio frequency (Radio Frequency, RF) module, and it is used
In wirelessly being communicated with internet.
A kind of image pickup processing method for running on above-mentioned mobile terminal is provided in the present embodiment, and Fig. 2 is according to this hair
The flow chart of the image pickup processing method of bright embodiment, as shown in Fig. 2 the flow comprises the following steps：
Step S202, obtain audio speed of the predetermined audio source in the audio of predetermined instant；
Step S204, according to the audio speed of acquisition, and audio speed and the corresponding relation of shooting frame per second, it is determined that obtaining
Audio speed corresponding to shooting frame per second；
Step S206, camera speed is adjusted according to the shooting frame per second of determination.
By above-mentioned steps, shooting frame per second and the audio of high-speed camera are combined together, according to the audio-source of acquisition
Audio audio speed, determine the shooting frame per second of high-speed camera because the audio speed of audio always dynamic change,
It is also dynamic change according to the shooting frame per second that the audio speed of audio determines, and then realizes dynamic regulation camera speed,
Therefore, can solve the problems, such as in correlation technique can not dynamic regulation high-speed camera camera speed so that user can feel
To the speed sense of picture.
Alternatively, obtain predetermined audio source includes in the audio speed of predetermined instant：Predetermined audio source is obtained in pre- timing
At least one the audio-frequency information of audio at quarter：Loudness acceleration, tone acceleration, tone color acceleration；Believed according to the audio of acquisition
At least one breath, determines audio speed.By above-mentioned steps, audio speed is determined by one of the loudness of audio, tone, tone color
Degree, or audio speed is determined by the combination of three, or audio speed is determined by both combinations so that Yong Huke
With according to hobby, the required audio speed of convenient acquisition.
Alternatively, predetermined audio source is being obtained before the audio speed of the audio of predetermined instant, in addition to：To pre- timing
The audio at quarter is weighted filtering.By above-mentioned steps, the frequency that user is non-audible in predetermined audio source is filtered out, by predetermined audio
The frequency in source, which is limited in the audible scope of user, to be held, and improves the Experience Degree of user.
Alternatively, in the audio speed according to acquisition, and audio speed and the corresponding relation of shooting frame per second, it is determined that obtaining
Audio speed corresponding to shooting frame per second before, in addition to：According to maximal oxygen image-to-frame ratio, the video player being pre-selected is consolidated
Determine play frame rate, and at least one audio-frequency information of predetermined instant, determine audio speed with imaging the corresponding relation of frame per second, its
In, maximal oxygen image-to-frame ratio is determined by the hardware of picture pick-up device.By above-mentioned steps, broadcast according to the fixation of selected video player
Putting frame per second determines audio speed with imaging the corresponding relation of frame per second so that the shooting content for noticing the shooting frame per second acquisition of determination can
Played with fluent on selected video player.
For example, the model on judging speed of sound, we establish a kind of frame per second formula related to the factor of sound three, use
Sound is done into one with frame per second to match.
Current FR=Play FR-(WFacotr_Volume*AV+WFacotr_Freq*BV+WFacotr_Tone*
CV)*t；Wherein, corresponding to t it is the time.
Current FR:Variable, during high-speed camera, according to audio speed determine, be issued to Camera
Sensor shooting frame per second, control the speed of imaging sensor output image；
Play FR：Constant, the play frame rate that video player is fixed, for example, could be arranged to some in { 30-720 }
Value.By the frame per second that there is audio analysis module to draw, value is all in { 30-Play FR }, { Play FR-720 } this scope
It is interior, a value of the maximum frame per second for the picture pick-up device that above-mentioned 720 frame only assumes that, as technology develops, higher frame also occurs
Rate, this patent do not limit it, and 720 as just an example.
WFacotr_Volume、WFacotr_Freq、WFacotr_Tone：Loudness, tone, tone color judgement sound are corresponded to respectively
The weight of velocity of sound degree, can be with dynamic regulation, span { 0-100% }, WFacotr_Volume+WFacotr_Freq+
WFacotr_Tone=100%
AV、BV、CV：Loudness, tone and tone color, the acceleration of three's change；For AV, represent within the unit interval,
Sound measures DB value changes from one to another DB value, and BV is then to represent the amplitude in cell frequency change, CV then tables
Show within the unit interval, the situation of change of the harmonic components of sound.Unit corresponding to the acceleration of three factors is：Frame per second/per single
Position rate of change, the i.e. intensity of sound, frequency, the rate of change of harmonic scope.
Alternatively, above-mentioned audio-source includes at least one of：The audio file being locally stored, the audio text of real-time recording
Part.
Through the above description of the embodiments, those skilled in the art can be understood that according to above-mentioned implementation
The method of example can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but a lot
In the case of the former be more preferably embodiment.Based on such understanding, technical scheme is substantially in other words to existing
The part that technology contributes can be embodied in the form of software product, and the computer software product is stored in a storage
In medium (such as ROM/RAM, magnetic disc, CD), including some instructions to cause a station terminal equipment (can be mobile phone, calculate
Machine, server, or network equipment etc.) perform method described in each embodiment of the present invention.
Embodiment 2
A kind of camera treatment device is additionally provided in the present embodiment, and the device is used to realize above-described embodiment and preferred reality
Mode is applied, had carried out repeating no more for explanation.As used below, term " module " can realize the soft of predetermined function
The combination of part and/or hardware.Although device described by following examples is preferably realized with software, hardware, or
The realization of the combination of software and hardware is also what may and be contemplated.
Fig. 3 is the structured flowchart of camera treatment device according to embodiments of the present invention, as shown in figure 3, the device includes：
Acquisition module 32, for obtaining audio speed of the predetermined audio source in the audio of predetermined instant；
First determining module 34, above-mentioned acquisition module 32 is connected to, for the audio speed according to acquisition, and audio speed
Degree and the corresponding relation of shooting frame per second, it is determined that shooting frame per second corresponding to the audio speed obtained；
Adjusting module 36, above-mentioned first determining module 34 is connected to, for adjusting shooting speed according to the shooting frame per second of determination
Degree.
Fig. 4 is the structured flowchart of acquisition module 32 in camera treatment device according to embodiments of the present invention, as shown in figure 4,
Acquisition module 32 includes：Acquiring unit 42 and determining unit 44, are illustrated separately below.
Acquiring unit 42, for obtaining predetermined audio source at least one audio-frequency information of audio of predetermined instant：Loudness
Acceleration, tone acceleration, tone color acceleration；
Determining unit 44, above-mentioned acquiring unit 42 is connected to, at least one audio-frequency information according to acquisition, determines sound
Frequency speed.
Fig. 5 is the preferred structure block diagram one of camera treatment device according to embodiments of the present invention, as shown in figure 5, the device
In addition to including all modules shown in Fig. 3, in addition to：Filtration module 52, for being weighted filtering to the audio of predetermined instant.
Fig. 6 is the preferred structure block diagram two of camera treatment device according to embodiments of the present invention, as shown in fig. 6, the device
In addition to including all modules shown in Fig. 3 and Fig. 5, in addition to：
Second determining module 62, for according to maximal oxygen image-to-frame ratio, the fixed of the video player being pre-selected to play frame
Rate, and at least one audio-frequency information of predetermined instant, audio speed is determined with imaging the corresponding relation of frame per second, wherein, it is maximum
Shooting frame per second is determined by the hardware of picture pick-up device.
Alternatively, audio-source includes at least one of：The audio file being locally stored, the audio file of real-time recording.
Fig. 7 is the structural representation of camera treatment device according to embodiments of the present invention, as shown in fig. 7, the device includes：
Audio analysis module (function is with above-mentioned acquisition module 32), Camera modules, (function is the same as above-mentioned adjustment for high-speed camera control module
Module 36), multi-media module, display module, memory module.The interaction of above-mentioned module is as follows：Start intelligent terminal,
Start audio analysis module；User obtains audio-source, can obtain or select special audio file (ibid by real-time recording
State the audio-source being locally stored)；Audio analysis module interacts analysis result and high-speed camera control module；Start
Camera modules are imaged, and the speed of shooting is controlled by high-speed camera control module；While shooting, by multi-media module
Encoded, then result is saved in the memory cell of memory module；Audio analysis module, high-speed camera control are closed successively
Module, Camera modules.Preserve the video file of shooting；Media player, decoded by multi-media module, according to one
Fixed frame per second plays out, and by display module is showed the content of shooting；
Fig. 8 is the schematic flow sheet of image pickup processing method according to embodiments of the present invention, as shown in figure 8, present example
Provide the scheme that a kind of dynamic regulation quickly images, program flow：
Step S802：Start intelligent terminal, start audio analysis module, Camera modules and high-speed camera control mould
Block；
Step S804：The readjustment of audio analysis result is registered, and opens audio analysis module, audio-source is selected by user；
Step S806：Audio analysis module is decomposed the source of sound of input, in the audible scope of human ear selected first
Frequency (20Hz--20kHz) (such as the scope that human ear is more pleasant, then do A weighted filterings；
Step S808：Filtered audio-source, according to certain model (introducing in more detail below), judge current audio
The speed in source, for example, judge be at a slow speed or middling speed or quick, and during be it is gradually fast or, it is gradually slow, slightly soon, slightly slow；
The foundation of model, three loudness, tone and tone color parts of sound, or appointing in three kinds of key elements can be included
Meaning combination；Wherein, within the unit interval, three factors all determine the speed of sound, such as the sizes values and changing value of loudness, sound
The scope that frequency corresponding to tune changes, there is harmonic period and frequency etc. corresponding to tone color；
Step S810：High-speed camera control module, the limit of power of the frame per second of video recording is informed and gives audio frequency control module, i.e.,
Maximal oxygen image-to-frame ratio is informed into audio frequency control module；
Step S812：Audio analysis module, the speed of the sound drawn according to model, one is done with the frame per second speed of shooting
Matching；When sound than it is very fast and rapid when, can be dripped down with the frame per second of high-speed camera drop, be adjusted according to customized rank
It is whole；When sound is slow, the frame per second of high-speed camera can be improved, same amount of time takes the picture of more multiframe；
Step S814：With the change of sound, the change of sound is constantly informed high-speed camera mould by audio analysis module
Block, then by high-speed camera control module Lai the dynamic frame per second for adjusting Camera video recordings；Live through audio analysis module with
After the interaction of high-speed camera control module, then work that Camera modules can be imaged in real time is exactly and multimedia mould
The interaction of block, memory module and display module；
Step S816：During shooting, by multi-media module, memory mould will be saved in after encoding video content
Block, until video record terminates；
Step S818：Video is played, multi-media module plays video according to fixed frame per second, and frame per second is with sound during video recording
Change and change, so as to bring a kind of effect of picture with sound variation.
It should be noted that above-mentioned modules can be realized by software or hardware, for the latter, Ke Yitong
Cross in the following manner realization, but not limited to this：Above-mentioned module is respectively positioned in same processor；Or above-mentioned modules are with any
The form of combination is located in different processors respectively.
Embodiment 3
Embodiments of the invention additionally provide a kind of storage medium.Alternatively, in the present embodiment, above-mentioned storage medium can
The program code for performing following steps to be arranged to storage to be used for：
S1, obtain audio speed of the predetermined audio source in the audio of predetermined instant；
S2, according to the audio speed of acquisition, and audio speed and the corresponding relation of shooting frame per second, it is determined that the audio obtained
Shooting frame per second corresponding to speed；
S3, camera speed is adjusted according to the shooting frame per second of determination.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：Obtain predetermined audio
Source includes in the audio speed of predetermined instant：
S1, predetermined audio source is obtained at least one audio-frequency information of audio of predetermined instant：Loudness acceleration, tone add
Speed, tone color acceleration；
S2, according at least one audio-frequency information of acquisition, determine audio speed.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：Obtaining pre- accordatura
Frequency source before the audio speed of the audio of predetermined instant, in addition to：
S1, filtering is weighted to the audio of predetermined instant.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：According to acquisition
Audio speed, and audio speed with shooting frame per second corresponding relation, it is determined that obtain audio speed corresponding to shooting frame per second it
Before, in addition to：
S1, according to maximal oxygen image-to-frame ratio, the fixation play frame rate for the video player being pre-selected, and predetermined instant
At least one audio-frequency information, audio speed is determined with imaging the corresponding relation of frame per second, wherein, maximal oxygen image-to-frame ratio is by picture pick-up device
Hardware determine.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：
S1, audio-source include at least one of：The audio file being locally stored, the audio file of real-time recording.
Alternatively, in the present embodiment, above-mentioned storage medium can include but is not limited to：USB flash disk, read-only storage (ROM,
Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disc or
CD etc. is various can be with the medium of store program codes.
Alternatively, in the present embodiment, processor performs according to the program code stored in storage medium：Obtain predetermined
Audio speed of the audio-source in the audio of predetermined instant；According to the audio speed of acquisition, and audio speed and shooting frame per second
Corresponding relation, it is determined that shooting frame per second corresponding to the audio speed obtained；Camera speed is adjusted according to the shooting frame per second of determination.
Alternatively, in the present embodiment, processor performs according to the program code stored in storage medium：Obtain predetermined
Audio-source includes in the audio speed of predetermined instant：Obtain predetermined audio source the audio of predetermined instant audio-frequency information at least it
One：Loudness acceleration, tone acceleration, tone color acceleration；At least one audio-frequency information according to acquisition, determines audio speed.
Alternatively, in the present embodiment, processor performs according to the program code stored in storage medium：It is pre- obtaining
Accordatura frequency source before the audio speed of the audio of predetermined instant, in addition to：Filtering is weighted to the audio of predetermined instant.
Alternatively, in the present embodiment, processor performs according to the program code stored in storage medium：Obtained in basis
The audio speed taken, and audio speed and the corresponding relation of shooting frame per second, it is determined that shooting frame corresponding to the audio speed obtained
Before rate, in addition to：According to maximal oxygen image-to-frame ratio, the fixation play frame rate for the video player being pre-selected, and pre- timing
At least one the audio-frequency information at quarter, audio speed is determined with imaging the corresponding relation of frame per second, wherein, maximal oxygen image-to-frame ratio is by imaging
The hardware of equipment determines.
Alternatively, in the present embodiment, processor performs according to the program code stored in storage medium：Audio-source bag
Include at least one of：The audio file being locally stored, the audio file of real-time recording.
Alternatively, the specific example in the present embodiment may be referred to described in above-described embodiment and optional embodiment
Example, the present embodiment will not be repeated here.
Obviously, those skilled in the art should be understood that above-mentioned each module of the invention or each step can be with general
Computing device realize that they can be concentrated on single computing device, or be distributed in multiple computing devices and formed
Network on, alternatively, they can be realized with the program code that computing device can perform, it is thus possible to they are stored
Performed in the storage device by computing device, and in some cases, can be with different from shown in order execution herein
The step of going out or describing, they are either fabricated to each integrated circuit modules respectively or by multiple modules in them or
Step is fabricated to single integrated circuit module to realize.So, the present invention is not restricted to any specific hardware and software combination.
The preferred embodiments of the present invention are the foregoing is only, are not intended to limit the invention, for the skill of this area
For art personnel, the present invention can have various modifications and variations.Within the spirit and principles of the invention, that is made any repaiies
Change, equivalent substitution, improvement etc., should be included in the scope of the protection.
Claims (10)
- A kind of 1. image pickup processing method, it is characterised in that including：Obtain audio speed of the predetermined audio source in the audio of predetermined instant；According to the audio speed of acquisition, and audio speed and the corresponding relation of shooting frame per second, it is determined that the sound obtained Shooting frame per second corresponding to frequency speed；Camera speed is adjusted according to the shooting frame per second of determination.
- 2. according to the method for claim 1, it is characterised in that obtain the sound of the predetermined audio source in predetermined instant Frequency speed includes：The predetermined audio source is obtained at least one audio-frequency information of the audio of the predetermined instant：Loudness acceleration, Tone acceleration, tone color acceleration；At least one described audio-frequency information according to acquisition, determines the audio speed.
- 3. according to the method for claim 2, it is characterised in that obtaining the predetermined audio source in the predetermined instant Before the audio speed of the audio, in addition to：Filtering is weighted to the audio of the predetermined instant.
- 4. according to the method for claim 2, it is characterised in that in the audio speed according to acquisition, and audio speed Degree and the corresponding relation of shooting frame per second, it is determined that before shooting frame per second corresponding to the audio speed obtained, in addition to：According to maximal oxygen image-to-frame ratio, the fixation play frame rate for the video player being pre-selected, and the institute of the predetermined instant At least one audio-frequency information is stated, determines audio speed with imaging the corresponding relation of frame per second, wherein, the maximal oxygen image-to-frame ratio is by taking the photograph As the hardware of equipment determines.
- 5. according to the method for claim 1, it is characterised in that the audio-source includes at least one of：It is locally stored Audio file, the audio file of real-time recording.
- A kind of 6. camera treatment device, it is characterised in that including：Acquisition module, for obtaining audio speed of the predetermined audio source in the audio of predetermined instant；First determining module, for the audio speed according to acquisition, and audio speed and the corresponding relation of shooting frame per second, It is determined that shooting frame per second corresponding to the audio speed obtained；Adjusting module, for adjusting camera speed according to the shooting frame per second of determination.
- 7. device according to claim 6, it is characterised in that the acquisition module includes：Acquiring unit, for obtain the predetermined audio source the audio of the predetermined instant audio-frequency information at least it One：Loudness acceleration, tone acceleration, tone color acceleration；Determining unit, at least one described audio-frequency information according to acquisition, determine the audio speed.
- 8. device according to claim 7, it is characterised in that also include：Filtration module, for being weighted filtering to the audio of the predetermined instant.
- 9. device according to claim 7, it is characterised in that also include：Second determining module, for according to maximal oxygen image-to-frame ratio, the fixation play frame rate for the video player being pre-selected, and At least one described audio-frequency information of the predetermined instant, audio speed is determined with imaging the corresponding relation of frame per second, wherein, it is described Maximal oxygen image-to-frame ratio is determined by the hardware of picture pick-up device.
- 10. device according to claim 6, it is characterised in that the audio-source includes at least one of：It is locally stored Audio file, the audio file of real-time recording.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610581713.0A CN107645630B (en) | 2016-07-20 | 2016-07-20 | Image pickup processing method and device |
| PCT/CN2017/000088 WO2018014518A1 (en) | 2016-07-20 | 2017-01-03 | Photographing processing method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610581713.0A CN107645630B (en) | 2016-07-20 | 2016-07-20 | Image pickup processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107645630A true CN107645630A (en) | 2018-01-30 |
| CN107645630B CN107645630B (en) | 2021-02-23 |
Family
ID=60991702
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610581713.0A Active CN107645630B (en) | 2016-07-20 | 2016-07-20 | Image pickup processing method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107645630B (en) |
| WO (1) | WO2018014518A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108391096A (en) * | 2018-04-15 | 2018-08-10 | 钱文伟 | Indoor liveness real-time measurement system |
| CN109699018A (en) * | 2018-04-15 | 2019-04-30 | 钱文伟 | Indoor liveness method for real-time measurement |
| CN110393004A (en) * | 2018-05-02 | 2019-10-29 | 深圳市大疆创新科技有限公司 | Holder image pickup method, holder camera system and recording medium |
| CN112532903A (en) * | 2019-09-18 | 2021-03-19 | 华为技术有限公司 | Intelligent video recording method, electronic equipment and computer readable storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117689776A (en) * | 2023-06-13 | 2024-03-12 | 荣耀终端有限公司 | Audio playing method, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030169902A1 (en) * | 2002-03-05 | 2003-09-11 | Nissan Motor Co., Ltd. | Vehicular image processing apparatus and related method |
| CN101350915A (en) * | 2008-09-01 | 2009-01-21 | 北京中星微电子有限公司 | Method for self-adapting regulation of running parameter and monitoring frontend equipment |
| JP2010161602A (en) * | 2009-01-08 | 2010-07-22 | Hitachi Ltd | Recording and reproducing device |
| CN101909191A (en) * | 2009-06-04 | 2010-12-08 | 佳能株式会社 | Video processing equipment and method for processing video frequency |
| JP2014236379A (en) * | 2013-06-03 | 2014-12-15 | 株式会社Ｊｖｃケンウッド | Photographing device, photographing method and photographing program |
| CN104735385A (en) * | 2015-03-31 | 2015-06-24 | 小米科技有限责任公司 | Playing control method and device and electronic equipment |
| CN105611252A (en) * | 2015-12-31 | 2016-05-25 | 浙江大华技术股份有限公司 | Video recording method and device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101593541B (en) * | 2008-05-28 | 2012-01-04 | 华为终端有限公司 | Method and media player for synchronously playing images and audio file |
| CN101661049B (en) * | 2009-10-14 | 2011-01-19 | 中国矿业大学(北京) | Method for counting propagation velocity of pipeline gas explosion flame |
| CN103312987A (en) * | 2013-06-17 | 2013-09-18 | 开平市中铝实业有限公司 | Panoramic photographing system on automobile |
-
2016
- 2016-07-20 CN CN201610581713.0A patent/CN107645630B/en active Active
-
2017
- 2017-01-03 WO PCT/CN2017/000088 patent/WO2018014518A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030169902A1 (en) * | 2002-03-05 | 2003-09-11 | Nissan Motor Co., Ltd. | Vehicular image processing apparatus and related method |
| CN101350915A (en) * | 2008-09-01 | 2009-01-21 | 北京中星微电子有限公司 | Method for self-adapting regulation of running parameter and monitoring frontend equipment |
| JP2010161602A (en) * | 2009-01-08 | 2010-07-22 | Hitachi Ltd | Recording and reproducing device |
| CN101909191A (en) * | 2009-06-04 | 2010-12-08 | 佳能株式会社 | Video processing equipment and method for processing video frequency |
| JP2014236379A (en) * | 2013-06-03 | 2014-12-15 | 株式会社Ｊｖｃケンウッド | Photographing device, photographing method and photographing program |
| CN104735385A (en) * | 2015-03-31 | 2015-06-24 | 小米科技有限责任公司 | Playing control method and device and electronic equipment |
| CN105611252A (en) * | 2015-12-31 | 2016-05-25 | 浙江大华技术股份有限公司 | Video recording method and device |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108391096A (en) * | 2018-04-15 | 2018-08-10 | 钱文伟 | Indoor liveness real-time measurement system |
| CN108391096B (en) * | 2018-04-15 | 2019-01-08 | 郑锋 | Indoor liveness real-time measurement system |
| CN109699018A (en) * | 2018-04-15 | 2019-04-30 | 钱文伟 | Indoor liveness method for real-time measurement |
| CN109699018B (en) * | 2018-04-15 | 2020-01-03 | 解波 | Indoor activity real-time measuring method |
| CN110393004A (en) * | 2018-05-02 | 2019-10-29 | 深圳市大疆创新科技有限公司 | Holder image pickup method, holder camera system and recording medium |
| US11102411B2 (en) | 2018-05-02 | 2021-08-24 | SZ DJI Technology Co., Ltd. | Gimbal photographing method, gimbal camera system, and storage medium |
| CN110393004B (en) * | 2018-05-02 | 2023-02-28 | 深圳市大疆创新科技有限公司 | Pan-tilt shooting method, pan-tilt shooting system and recording medium |
| CN112532903A (en) * | 2019-09-18 | 2021-03-19 | 华为技术有限公司 | Intelligent video recording method, electronic equipment and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107645630B (en) | 2021-02-23 |
| WO2018014518A1 (en) | 2018-01-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107645630A (en) | Image pickup processing method and device | |
| CN106789991B (en) | Multi-person interactive network live broadcast method and system based on virtual scene | |
| CN111131889B (en) | Method and system for adaptively adjusting images and sounds in scene and readable storage medium | |
| US11223760B2 (en) | Video processing method and device, shooting system, and computer-readable storage medium | |
| CN113645408B (en) | Photographing method, photographing apparatus, and storage medium | |
| CN108337465A (en) | Method for processing video frequency and device | |
| CN104822015A (en) | Image processing apparatus and image processing method | |
| CN111083138B (en) | Short video production system, method, electronic device and readable storage medium | |
| JP7295950B2 (en) | Video enhancement control method, device, electronic device and storage medium | |
| CN112714327B (en) | Interaction method, device and equipment based on live application program and storage medium | |
| CN107948733A (en) | Method of video image processing and device, electronic equipment | |
| CN112672174B (en) | Split-screen live broadcast method, acquisition device, playing device and storage medium | |
| CN106131615A (en) | Video broadcasting method and device | |
| CN107995482A (en) | The treating method and apparatus of video file | |
| CN111539882A (en) | Interactive method for assisting makeup, terminal and computer storage medium | |
| CN110149517A (en) | Method, apparatus, electronic equipment and the computer storage medium of video processing | |
| CN104683781A (en) | Video play processing method and video play processing device | |
| CN104113682B (en) | A kind of image acquiring method and electronic equipment | |
| CN107155114A (en) | A kind of video pictures method of adjustment and system | |
| KR20210081082A (en) | Server, method and user device for providing avatar contents based on motion data of object | |
| CN107846605A (en) | System and method for generating streaming media data of anchor terminal, and system and method for live network broadcast | |
| CN108307101B (en) | Image processing method, electronic equipment and server | |
| CN106295659A (en) | Taking pictures of a kind of smart machine takes color application process and system | |
| JP7308374B1 (en) | Electronics | |
| CN105611430B (en) | Method and system for handling video content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |