CN107645630B - Image pickup processing method and device - Google Patents
Image pickup processing method and device Download PDFInfo
- Publication number
- CN107645630B CN107645630B CN201610581713.0A CN201610581713A CN107645630B CN 107645630 B CN107645630 B CN 107645630B CN 201610581713 A CN201610581713 A CN 201610581713A CN 107645630 B CN107645630 B CN 107645630B
- Authority
- CN
- China
- Prior art keywords
- audio
- speed
- frame rate
- shooting
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention provides a method and a device for processing camera shooting, wherein the method comprises the following steps: acquiring the audio speed of the audio of a predetermined audio source at a predetermined moment; determining a camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relation between the audio speed and the camera shooting frame rate; and adjusting the image pickup speed according to the determined image pickup frame rate. The invention solves the problem that the shooting speed of high-speed shooting cannot be dynamically adjusted in the related art.
Description
Technical Field
The present invention relates to the field of communications, and in particular, to a method and an apparatus for processing a camera.
Background
With the improvement of the performance of a smart device (for example, a smart phone), many functions on a single lens reflex Camera can be implemented on the smart device, and therefore, the demand for Camera functions on the smart device is increasingly specialized. At present, a slow-motion high-speed shooting function is realized in various high-end terminal items, and the high-speed shooting can help human eyes to feel the time. This is an interesting application, where various scenes can be frozen at a relatively short instant. For the scheme implemented at present, in the high-speed shooting, the shooting frame rate is in an almost fixed range, so that the shooting speed is also fixed, and the shooting frame rate is generally higher, for example, the shooting frame rate is 360fps, that is, 360 frames of data exist in one second, if the shooting frame rate is played, the video player plays the content at the playing frame rate of 30fps, so that the video player needs to play the content of shooting at the high speed for one second in 12 seconds, because the difference between each frame becomes smaller during playing, that is, the time difference between each frame becomes longer, and in the visual sense of eyes, the effect of slowing down the picture can be achieved. However, when the video player plays the contents shot at a high speed, there is a problem in that the time difference between each frame during the playing is the same, and the slow feeling felt by the user is solidified.
Therefore, the camera shooting speed of the high-speed camera shooting cannot be dynamically adjusted in the related art, which causes the problem that the time difference between every two frames of the video player is the same during the playing of the high-speed camera shooting content, so that the slow feeling felt by the user is solidified, and the speed feeling of the picture cannot be felt.
Disclosure of Invention
The embodiment of the invention provides a shooting processing method and a shooting processing device, which at least solve the problem that the shooting speed of high-speed shooting cannot be dynamically adjusted in the related technology.
According to an embodiment of the present invention, there is provided an image pickup processing method including: acquiring the audio speed of the audio of a predetermined audio source at a predetermined moment; determining the camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relation between the audio speed and the camera shooting frame rate; and adjusting the shooting speed according to the determined shooting frame rate.
Optionally, the obtaining the audio speed of the predetermined audio source at a predetermined time comprises: acquiring at least one of audio information of the audio of the predetermined audio source at the predetermined time: loudness acceleration, pitch acceleration, timbre acceleration; and determining the audio speed according to at least one of the acquired audio information.
Optionally, before acquiring the audio speed of the audio of the predetermined audio source at the predetermined time, further comprising: and carrying out weighted filtering on the audio at the preset time.
Optionally, before determining, according to the acquired audio speed and the corresponding relationship between the audio speed and the camera shooting frame rate, the method further includes: and determining the corresponding relation between the audio speed and the shooting frame rate according to at least one of the maximum shooting frame rate, the fixed playing frame rate of a preselected video player and the audio information at the preset moment, wherein the maximum shooting frame rate is determined by the hardware of the shooting equipment.
Optionally, the audio source comprises at least one of: locally stored audio files, audio files recorded in real time.
According to another embodiment of the present invention, there is provided an image pickup processing apparatus including: the acquisition module is used for acquiring the audio speed of the audio of a preset audio source at a preset moment; the first determining module is used for determining the camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relation between the audio speed and the camera shooting frame rate; and the adjusting module is used for adjusting the shooting speed according to the determined shooting frame rate.
Optionally, the obtaining module includes: an obtaining unit, configured to obtain at least one of audio information of the audio of the predetermined audio source at the predetermined time: loudness acceleration, pitch acceleration, timbre acceleration; and the determining unit is used for determining the audio speed according to at least one of the acquired audio information.
Optionally, the method further comprises: and the filtering module is used for carrying out weighted filtering on the audio at the preset moment.
Optionally, the method further comprises: and the second determining module is used for determining the corresponding relation between the audio speed and the shooting frame rate according to at least one of the maximum shooting frame rate, the fixed playing frame rate of the preselected video player and the audio information at the preset moment, wherein the maximum shooting frame rate is determined by hardware of the shooting equipment.
Optionally, the audio source comprises at least one of: locally stored audio files, audio files recorded in real time.
According to still another embodiment of the present invention, there is also provided a storage medium. The storage medium is configured to store program code for performing the steps of: acquiring the audio speed of the audio of a predetermined audio source at a predetermined moment; determining the camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relation between the audio speed and the camera shooting frame rate; and adjusting the shooting speed according to the determined shooting frame rate.
Optionally, the storage medium is further arranged to store program code for performing the steps of: acquiring the audio speed of the predetermined audio source at a predetermined time comprises: acquiring at least one of audio information of the audio of the predetermined audio source at the predetermined time: loudness acceleration, pitch acceleration, timbre acceleration; and determining the audio speed according to at least one of the acquired audio information.
Optionally, the storage medium is further arranged to store program code for performing the steps of: before acquiring the audio speed of the audio of the predetermined audio source at the predetermined time, further comprising: and carrying out weighted filtering on the audio at the preset time.
Optionally, the storage medium is further arranged to store program code for performing the steps of: before determining the camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relation between the audio speed and the camera shooting frame rate, the method further comprises the following steps: and determining the corresponding relation between the audio speed and the shooting frame rate according to at least one of the maximum shooting frame rate, the fixed playing frame rate of a preselected video player and the audio information at the preset moment, wherein the maximum shooting frame rate is determined by the hardware of the shooting equipment.
Optionally, the storage medium is further arranged to store program code for performing the steps of: the audio source comprises at least one of: locally stored audio files, audio files recorded in real time.
By the method, the audio speed of the audio of the predetermined audio source at the predetermined moment is acquired; determining a camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relation between the audio speed and the camera shooting frame rate; and adjusting the image pickup speed according to the determined image pickup frame rate. The invention combines the camera shooting frame rate of high-speed camera shooting with the audio, determines the camera shooting frame rate of high-speed camera shooting according to the audio speed of the audio of the acquired audio source, and realizes dynamic adjustment of the camera shooting speed because the audio speed of the audio is always dynamically changed, so that the problem that the camera shooting speed of high-speed camera shooting cannot be dynamically adjusted in the related technology can be solved, and a user can feel the speed sense of a picture.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a block diagram of a hardware configuration of a mobile terminal of an image pickup processing method according to an embodiment of the present invention;
fig. 2 is a flowchart of an image sensing processing method according to an embodiment of the present invention;
fig. 3 is a block diagram of the configuration of an image pickup processing apparatus according to an embodiment of the present invention;
fig. 4 is a block diagram of the configuration of the acquisition module 32 in the image pickup processing apparatus according to the embodiment of the present invention;
fig. 5 is a block diagram of a preferred configuration of an image pickup processing apparatus according to an embodiment of the present invention;
fig. 6 is a block diagram of a preferred configuration of an image pickup processing apparatus according to an embodiment of the present invention;
fig. 7 is a schematic configuration diagram of an image pickup processing apparatus according to an embodiment of the present invention;
fig. 8 is a flowchart illustrating an image pickup processing method according to an embodiment of the present invention.
Detailed Description
The invention will be described in detail hereinafter with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
Example 1
The method provided by the embodiment 1 of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking an example of the present invention running on a mobile terminal, fig. 1 is a block diagram of a hardware structure of the mobile terminal of an image pickup processing method according to an embodiment of the present invention. As shown in fig. 1, the mobile terminal 10 may include one or more (only one shown) processors 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmitting device 106 for communication functions. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the electronic device. For example, the mobile terminal 10 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The memory 104 may be used to store software programs and modules of application software, such as program instructions/modules corresponding to the image pickup processing method in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, so as to implement the above-described method. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the mobile terminal 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the mobile terminal 10. In one example, the transmission device 106 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission device 106 can be a Radio Frequency (RF) module, which is used to communicate with the internet in a wireless manner.
In the present embodiment, an image capturing processing method operating in the mobile terminal is provided, and fig. 2 is a flowchart of the image capturing processing method according to the embodiment of the present invention, and as shown in fig. 2, the flowchart includes the following steps:
step S202, acquiring the audio speed of the audio of a preset audio source at a preset time;
step S204, determining a camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relation between the audio speed and the camera shooting frame rate;
in step S206, the imaging speed is adjusted according to the determined imaging frame rate.
Through the steps, the shooting frame rate of high-speed shooting is combined with the audio, the shooting frame rate of high-speed shooting is determined according to the audio speed of the audio of the acquired audio source, and the audio speed of the audio is always dynamically changed, so that the shooting frame rate determined according to the audio speed of the audio is also dynamically changed, and further the shooting speed is dynamically adjusted, therefore, the problem that the shooting speed of high-speed shooting cannot be dynamically adjusted in the related art can be solved, and a user can feel the speed of a picture.
Optionally, the obtaining of the audio speed of the predetermined audio source at the predetermined time comprises: acquiring at least one of audio information of audio of a predetermined audio source at a predetermined time: loudness acceleration, pitch acceleration, timbre acceleration; an audio speed is determined based on at least one of the acquired audio information. Through the steps, the audio speed is determined through one of the loudness, the tone and the timbre of the audio, or the audio speed is determined through the combination of the loudness, the tone and the timbre of the audio, so that a user can conveniently acquire the required audio speed according to the preference.
Optionally, before acquiring the audio speed of the audio of the predetermined audio source at the predetermined time, the method further includes: and carrying out weighted filtering on the audio at the preset moment. Through the steps, the frequency which is not audible to the user in the preset audio source is filtered, the frequency of the preset audio source is limited in the audible range of the user, and the experience degree of the user is improved.
Optionally, before determining the image capturing frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relationship between the audio speed and the image capturing frame rate, the method further includes: and determining the corresponding relation between the audio speed and the shooting frame rate according to at least one of the maximum shooting frame rate, the fixed playing frame rate of the preselected video player and the audio information at the preset moment, wherein the maximum shooting frame rate is determined by the hardware of the shooting device. Through the steps, the corresponding relation between the audio speed and the camera shooting frame rate is determined according to the fixed playing frame rate of the selected video player, so that the camera shooting content obtained by informing the determined camera shooting frame rate can be smoothly played on the selected video player.
For example, regarding the model for determining the speed of sound, we establish a formula of frame rate and sound three factors, which is used to match the sound with the frame rate.
Current FR ═ Play FR- (WFacotr _ Volume · AV + WFacotr _ Freq · BV + WFacotr _ Tone · CV) × t; where t corresponds to time.
The Current FR is a variable which controls the speed of the image sensor to output the image according to the shooting frame rate determined by the audio speed and issued to the Camera sensor in the high-speed shooting process;
play FR: the constant, fixed frame rate of play of the video player, for example, may be set to some value of 30-720. All frame rates obtained by the audio analysis module are in the range of {30-Play FR }, { Play FR-720}, and the above 720 frames are only one of the maximum frame rates of the assumed image capturing device, and as the technology develops, higher frame rates also occur, which is not limited in this patent, and 720 is only an example.
WFacotr _ Volume, WFacotr _ Freq, WFacotr _ Tone: the weights of the sound speed are judged corresponding to loudness, Tone and timbre respectively, and can be dynamically adjusted, wherein the value range is { 0-100% }, and WFacotr _ Volume + WFacotr _ Freq + WFacotr _ Tone is 100%
AV, BV, CV: loudness, tone and timbre, the acceleration of the three changes; for AV, it indicates that the sound changes from one measure DB value to another DB value per unit time, BV indicates the amplitude of the change at unit frequency, and CV indicates the change of the harmonic component of the sound per unit time. The unit of the acceleration of the three factors is: frame rate/rate of change per unit, i.e. the intensity, frequency, and harmonic range of the sound.
Optionally, the audio source comprises at least one of: locally stored audio files, audio files recorded in real time.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
Example 2
In this embodiment, an image pickup processing apparatus is further provided, and the apparatus is used to implement the foregoing embodiments and preferred embodiments, and the description of which has been already made is omitted. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 3 is a block diagram of the configuration of an image pickup processing apparatus according to an embodiment of the present invention, which includes, as shown in fig. 3:
an obtaining module 32, configured to obtain an audio speed of audio of a predetermined audio source at a predetermined time;
a first determining module 34, connected to the acquiring module 32, for determining a camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relationship between the audio speed and the camera shooting frame rate;
and an adjusting module 36, connected to the first determining module 34, for adjusting the image capturing speed according to the determined image capturing frame rate.
Fig. 4 is a block diagram of the configuration of the acquisition module 32 in the image pickup processing apparatus according to the embodiment of the present invention, and as shown in fig. 4, the acquisition module 32 includes: the acquisition unit 42 and the determination unit 44 are explained below separately.
An obtaining unit 42, configured to obtain at least one of audio information of audio of a predetermined audio source at a predetermined time: loudness acceleration, pitch acceleration, timbre acceleration;
a determining unit 44, connected to the above-mentioned obtaining unit 42, for determining the audio speed according to at least one of the obtained audio information.
Fig. 5 is a block diagram of a preferred structure of an image pickup processing apparatus according to an embodiment of the present invention, which, as shown in fig. 5, includes, in addition to all the modules shown in fig. 3: and a filtering module 52, configured to perform weighted filtering on the audio at a predetermined time.
Fig. 6 is a block diagram of a preferred structure of an image pickup processing apparatus according to an embodiment of the present invention, and as shown in fig. 6, the apparatus includes, in addition to all the modules shown in fig. 3 and 5:
the second determining module 62 is configured to determine a corresponding relationship between the audio speed and the camera frame rate according to at least one of a maximum camera frame rate, a fixed play frame rate of a preselected video player, and audio information at a predetermined time, where the maximum camera frame rate is determined by hardware of the camera device.
Optionally, the audio source comprises at least one of: locally stored audio files, audio files recorded in real time.
Fig. 7 is a schematic configuration diagram of an image pickup processing apparatus according to an embodiment of the present invention, which includes, as shown in fig. 7: an audio analysis module (the function of which is the same as the acquisition module 32), a Camera module, a high-speed Camera control module (the function of which is the same as the adjustment module 36), a multimedia module, a display module and a storage module. The interaction process of the modules is as follows: starting the intelligent terminal equipment and starting the audio analysis module; a user acquires an audio source, and can acquire or select a specific audio file (the same as the locally stored audio source) through real-time recording; the audio analysis module interacts the analysis result with the high-speed camera control module; starting a Camera module to shoot, and controlling the shooting speed by a high-speed shooting control module; while shooting, the multimedia module encodes, then store the result in the memory cell of the memory module; and closing the audio analysis module, the high-speed Camera control module and the Camera module in sequence. Saving the video file of the camera; the media player is decoded by the multimedia module, plays the content according to a fixed frame rate, and displays the shot content by the display module;
fig. 8 is a schematic flowchart of an image capturing processing method according to an embodiment of the present invention, and as shown in fig. 8, an embodiment of the present invention provides a scheme for dynamically adjusting fast image capturing, where the scheme includes:
step S802: starting the intelligent terminal equipment, starting the audio analysis module, the Camera module and the high-speed Camera control module;
step S804: registering callback of audio analysis results, opening an audio analysis module, and selecting an audio source by a user;
step S806: the audio analysis module decomposes the input sound source, firstly selects the frequency (20 Hz-20 kHz) in the audible range of human ears (for example, the more pleasant range of human ears, and then performs A weighted filtering;
step S808: the filtered audio source, according to a certain model (described in detail below), determines the speed of the current audio source, for example, whether it is slow, medium, or fast, and whether it is gradual fast, slow, fast, or slow;
the model can be established by three parts of loudness, tone and tone of sound, or any combination of the three elements; in unit time, three factors determine the speed of sound, such as the loudness value and the variation value, the frequency variation range corresponding to tones, the harmonic period and frequency corresponding to timbre, and the like;
step S810: the high-speed camera shooting control module informs the audio control module of the capability range of the frame rate of the video, namely informs the audio control module of the maximum camera shooting frame rate;
step S812: the audio analysis module is used for matching the speed of the sound obtained by the model with the frame rate speed of the camera; when the sound is fast and rapid, the frame rate of high-speed shooting can be reduced, and the adjustment is carried out according to the self-defined level; when the sound is slow, the frame rate of high-speed shooting can be improved, and more frames of pictures can be taken at the same time;
step S814: with the change of the sound, the audio analysis module continuously informs the high-speed Camera module of the change of the sound, and then the high-speed Camera control module dynamically adjusts the frame rate of the Camera video; after the interaction between the audio analysis module and the high-speed Camera control module, the Camera module can perform the Camera shooting work in real time and then interact with the multimedia module, the storage module and the display module;
step S816: in the shooting process, the video content is encoded and stored in a memory module through a multimedia module until the video recording is finished;
step S818: the video is played, the multimedia module plays the video according to a fixed frame rate, and the frame rate changes along with the change of sound during video recording, so that the effect that the picture changes along with the sound is brought.
It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are respectively located in different processors in any combination.
Example 3
The embodiment of the invention also provides a storage medium. Alternatively, in the present embodiment, the storage medium may be configured to store program codes for performing the following steps:
s1, acquiring the audio speed of the audio of a predetermined audio source at a predetermined time;
s2, determining the camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relation between the audio speed and the camera shooting frame rate;
and S3, adjusting the image pickup speed according to the determined image pickup frame rate.
Optionally, the storage medium is further arranged to store program code for performing the steps of: acquiring an audio speed of a predetermined audio source at a predetermined time comprises:
s1, acquiring at least one of audio information of the audio of the predetermined audio source at the predetermined time: loudness acceleration, pitch acceleration, timbre acceleration;
and S2, determining the audio speed according to at least one of the acquired audio information.
Optionally, the storage medium is further arranged to store program code for performing the steps of: before acquiring the audio speed of the audio of the predetermined audio source at the predetermined time, the method further comprises:
and S1, performing weighted filtering on the audio at the preset moment.
Optionally, the storage medium is further arranged to store program code for performing the steps of: before determining the camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relation between the audio speed and the camera shooting frame rate, the method further comprises the following steps:
and S1, determining the corresponding relation between the audio speed and the shooting frame rate according to at least one of the maximum shooting frame rate, the fixed playing frame rate of the video player selected in advance and the audio information at the preset moment, wherein the maximum shooting frame rate is determined by the hardware of the shooting device.
Optionally, the storage medium is further arranged to store program code for performing the steps of:
s1, the audio source includes at least one of: locally stored audio files, audio files recorded in real time.
Optionally, in this embodiment, the storage medium may include, but is not limited to: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Optionally, in this embodiment, the processor executes, according to the program code stored in the storage medium: acquiring the audio speed of the audio of a predetermined audio source at a predetermined moment; determining a camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relation between the audio speed and the camera shooting frame rate; and adjusting the image pickup speed according to the determined image pickup frame rate.
Optionally, in this embodiment, the processor executes, according to the program code stored in the storage medium: acquiring an audio speed of a predetermined audio source at a predetermined time comprises: acquiring at least one of audio information of audio of a predetermined audio source at a predetermined time: loudness acceleration, pitch acceleration, timbre acceleration; an audio speed is determined based on at least one of the acquired audio information.
Optionally, in this embodiment, the processor executes, according to the program code stored in the storage medium: before acquiring the audio speed of the audio of the predetermined audio source at the predetermined time, the method further comprises: and carrying out weighted filtering on the audio at the preset moment.
Optionally, in this embodiment, the processor executes, according to the program code stored in the storage medium: before determining the camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relation between the audio speed and the camera shooting frame rate, the method further comprises the following steps: and determining the corresponding relation between the audio speed and the shooting frame rate according to at least one of the maximum shooting frame rate, the fixed playing frame rate of the preselected video player and the audio information at the preset moment, wherein the maximum shooting frame rate is determined by the hardware of the shooting device.
Optionally, in this embodiment, the processor executes, according to the program code stored in the storage medium: the audio source includes at least one of: locally stored audio files, audio files recorded in real time.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. An image pickup processing method, comprising:
acquiring the audio speed of the audio of a predetermined audio source at a predetermined moment;
determining the camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relation between the audio speed and the camera shooting frame rate;
and adjusting the image pickup speed of the high-speed image pickup according to the determined image pickup frame rate so as to enable a user to feel the speed sense of the picture when the image pickup content is played at the fixed play frame rate.
2. The method of claim 1, wherein obtaining the audio speed of the predetermined audio source at a predetermined time comprises:
acquiring at least one of audio information of the audio of the predetermined audio source at the predetermined time: loudness acceleration, pitch acceleration, timbre acceleration;
and determining the audio speed according to at least one of the acquired audio information.
3. The method of claim 2, further comprising, prior to obtaining the audio speed of the audio of the predetermined audio source at the predetermined time,: and carrying out weighted filtering on the audio at the preset time.
4. The method according to claim 2, before determining a camera frame rate corresponding to the acquired audio speed according to the acquired audio speed and the correspondence between the audio speed and the camera frame rate, further comprising:
and determining the corresponding relation between the audio speed and the shooting frame rate according to at least one of the maximum shooting frame rate, the fixed playing frame rate of a preselected video player and the audio information at the preset moment, wherein the maximum shooting frame rate is determined by the hardware of the shooting equipment.
5. The method of claim 1, wherein the audio source comprises at least one of: locally stored audio files, audio files recorded in real time.
6. An image pickup processing apparatus, comprising:
the acquisition module is used for acquiring the audio speed of the audio of a preset audio source at a preset moment;
the first determining module is used for determining the camera shooting frame rate corresponding to the acquired audio speed according to the acquired audio speed and the corresponding relation between the audio speed and the camera shooting frame rate;
and the adjusting module is used for adjusting the shooting speed of high-speed shooting according to the determined shooting frame rate so as to enable a user to feel the speed sense of the picture when the shooting content is played at the fixed playing frame rate.
7. The apparatus of claim 6, wherein the obtaining module comprises:
an obtaining unit, configured to obtain at least one of audio information of the audio of the predetermined audio source at the predetermined time: loudness acceleration, pitch acceleration, timbre acceleration;
and the determining unit is used for determining the audio speed according to at least one of the acquired audio information.
8. The apparatus of claim 7, further comprising:
and the filtering module is used for carrying out weighted filtering on the audio at the preset moment.
9. The apparatus of claim 7, further comprising:
and the second determining module is used for determining the corresponding relation between the audio speed and the shooting frame rate according to at least one of the maximum shooting frame rate, the fixed playing frame rate of the preselected video player and the audio information at the preset moment, wherein the maximum shooting frame rate is determined by hardware of the shooting equipment.
10. The apparatus of claim 6, wherein the audio source comprises at least one of: locally stored audio files, audio files recorded in real time.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610581713.0A CN107645630B (en) | 2016-07-20 | 2016-07-20 | Image pickup processing method and device |
| PCT/CN2017/000088 WO2018014518A1 (en) | 2016-07-20 | 2017-01-03 | Photographing processing method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610581713.0A CN107645630B (en) | 2016-07-20 | 2016-07-20 | Image pickup processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107645630A CN107645630A (en) | 2018-01-30 |
| CN107645630B true CN107645630B (en) | 2021-02-23 |
Family
ID=60991702
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610581713.0A Active CN107645630B (en) | 2016-07-20 | 2016-07-20 | Image pickup processing method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107645630B (en) |
| WO (1) | WO2018014518A1 (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108391096B (en) * | 2018-04-15 | 2019-01-08 | 郑锋 | Indoor liveness real-time measurement system |
| CN109699018B (en) * | 2018-04-15 | 2020-01-03 | 解波 | Indoor activity real-time measuring method |
| WO2019210462A1 (en) | 2018-05-02 | 2019-11-07 | 深圳市大疆创新科技有限公司 | Pan and tilt head shooting method, pan and tilt head shooting system, and recording medium |
| CN112532903B (en) * | 2019-09-18 | 2022-08-09 | 华为技术有限公司 | Intelligent video recording method, electronic equipment and computer readable storage medium |
| CN117689776A (en) * | 2023-06-13 | 2024-03-12 | 荣耀终端有限公司 | Audio playing method, electronic equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010161602A (en) * | 2009-01-08 | 2010-07-22 | Hitachi Ltd | Recording and reproducing device |
| CN104735385A (en) * | 2015-03-31 | 2015-06-24 | 小米科技有限责任公司 | Playing control method and device and electronic equipment |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3747866B2 (en) * | 2002-03-05 | 2006-02-22 | 日産自動車株式会社 | Image processing apparatus for vehicle |
| CN101593541B (en) * | 2008-05-28 | 2012-01-04 | 华为终端有限公司 | Method and media player for synchronously playing images and audio file |
| CN101350915A (en) * | 2008-09-01 | 2009-01-21 | 北京中星微电子有限公司 | Method for self-adapting regulation of running parameter and monitoring frontend equipment |
| JP2010283605A (en) * | 2009-06-04 | 2010-12-16 | Canon Inc | Video processing device and method |
| CN101661049B (en) * | 2009-10-14 | 2011-01-19 | 中国矿业大学(北京) | Method for counting propagation velocity of pipeline gas explosion flame |
| JP6070424B2 (en) * | 2013-06-03 | 2017-02-01 | 株式会社Ｊｖｃケンウッド | Imaging apparatus, imaging method, and imaging program |
| CN103312987A (en) * | 2013-06-17 | 2013-09-18 | 开平市中铝实业有限公司 | Panoramic photographing system on automobile |
| CN105611252B (en) * | 2015-12-31 | 2019-05-24 | 浙江大华技术股份有限公司 | A kind of kinescope method and equipment of video |
-
2016
- 2016-07-20 CN CN201610581713.0A patent/CN107645630B/en active Active
-
2017
- 2017-01-03 WO PCT/CN2017/000088 patent/WO2018014518A1/en active Application Filing
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010161602A (en) * | 2009-01-08 | 2010-07-22 | Hitachi Ltd | Recording and reproducing device |
| CN104735385A (en) * | 2015-03-31 | 2015-06-24 | 小米科技有限责任公司 | Playing control method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018014518A1 (en) | 2018-01-25 |
| CN107645630A (en) | 2018-01-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107645630B (en) | Image pickup processing method and device | |
| US11223760B2 (en) | Video processing method and device, shooting system, and computer-readable storage medium | |
| WO2015001437A1 (en) | Image processing method and apparatus, and electronic device | |
| CN104822015A (en) | Image processing apparatus and image processing method | |
| CN104618446A (en) | Multimedia pushing implementing method and device | |
| CN112714327B (en) | Interaction method, device and equipment based on live application program and storage medium | |
| CN109752951B (en) | Control system processing method and device, storage medium and electronic device | |
| CN106131615A (en) | Video broadcasting method and device | |
| CN109035180A (en) | Video broadcasting method, device, equipment and storage medium | |
| WO2018133309A1 (en) | Video recording method and device | |
| CN110149517A (en) | Method, apparatus, electronic equipment and the computer storage medium of video processing | |
| CN113574525A (en) | Media content recommendation method and equipment | |
| CN107948660A (en) | The method and device of Video coding adaptation | |
| CN112188230A (en) | Virtual resource processing method and device, terminal equipment and server | |
| CN108629814B (en) | Camera adjusting method and device | |
| CN107329568A (en) | Method of adjustment, device and electronic equipment that panorama is played | |
| CN110139128A (en) | A kind of information processing method, blocker, electronic equipment and storage medium | |
| WO2019033880A1 (en) | Method and system for performing data customization on basic service data | |
| CN110337041B (en) | Video playing method and device, computer equipment and storage medium | |
| CN108174140A (en) | The method and mobile terminal of a kind of video communication | |
| CN105187909B (en) | Terminal detects the method and device that recording audio/video is lost | |
| CN105611430B (en) | Method and system for handling video content | |
| CN110264402A (en) | Image interfusion method, device, storage medium and electronic device | |
| CN114442980B (en) | Control method and control device of video and audio equipment, storage medium and electronic device | |
| CN109166585A (en) | The method and device of voice control, storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |