CN114285978A - Video processing method, video processing device and electronic equipment - Google Patents
Video processing method, video processing device and electronic equipment Download PDFInfo
- Publication number
- CN114285978A CN114285978A CN202111630459.6A CN202111630459A CN114285978A CN 114285978 A CN114285978 A CN 114285978A CN 202111630459 A CN202111630459 A CN 202111630459A CN 114285978 A CN114285978 A CN 114285978A
- Authority
- CN
- China
- Prior art keywords
- video
- frame rate
- target
- video data
- main control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 40
- 238000000034 method Methods 0.000 claims abstract description 32
- 230000006870 function Effects 0.000 description 14
- 238000003780 insertion Methods 0.000 description 9
- 230000037431 insertion Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 230000007423 decrease Effects 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
Images
Landscapes
- Studio Devices (AREA)
Abstract
The application discloses a video processing method, a video processing device and electronic equipment, and belongs to the technical field of data processing. The electronic device includes: the image processing device comprises a main control chip, an image processing chip and an image sensor, wherein a first interface of the main control chip is electrically connected with the image processing chip, and a second interface of the main control chip is electrically connected with the image sensor; the method comprises the following steps: the image sensor acquires video data and sends the video data to the main control chip; the main control chip receives the video data, and sends the video data to the image processing chip under the condition that the target parameter of the image sensor meets a preset condition; the image processing chip performs frame interpolation on the video data to generate a target video and sends the target video to the main control chip; wherein the target parameters include at least one of: frame rate, image resolution, image sensor type, exposure time.
Description
Technical Field
The application belongs to the technical field of data processing, and particularly relates to a video processing method, a video processing device and electronic equipment.
Background
In order to meet the video shooting requirements of various special scenes, the requirements of users on cameras are increasing. The video parameters supported by the camera in the current electronic equipment are very limited, and the shot video hardly meets the diversified requirements of the user, so that the shooting experience of the user is poor. For example: the frame rate (hereinafter, simply referred to as "frame rate") corresponding to a camera supporting slow motion shooting is only 120fps (frames/second), and a user cannot select a higher frame rate to shoot a slow motion video.
Disclosure of Invention
The embodiment of the application aims to provide a video processing method, a video processing device and electronic equipment, and the problem that the shooting experience of a user is poor can be solved.
In a first aspect, an embodiment of the present application provides a video processing method, which is applied to an electronic device, where the electronic device includes: the image processing device comprises a main control chip, an image processing chip and an image sensor, wherein a first interface of the main control chip is electrically connected with the image processing chip, and a second interface of the main control chip is electrically connected with the image sensor;
the method comprises the following steps:
the image sensor acquires video data and sends the video data to the main control chip;
the main control chip receives the video data, and sends the video data to the image processing chip under the condition that the target parameter of the image sensor meets a preset condition;
the image processing chip performs frame interpolation on the video data to generate a target video and sends the target video to the main control chip;
wherein the target parameters include at least one of: frame rate, image resolution, image sensor type, exposure time.
In a second aspect, an embodiment of the present application provides a video processing apparatus, where the apparatus applies the above electronic device, and the apparatus includes:
the acquisition module is used for enabling the image sensor to acquire video data and sending the video data to the main control chip;
the first receiving module is used for enabling the main control chip to receive the video data and sending the video data to the image processing chip under the condition that target parameters of the image sensor meet preset conditions;
the generating module is used for enabling the image processing chip to insert frames into the video data, generating a target video and sending the target video to the main control chip;
wherein the target parameters include at least one of: frame rate, image resolution, image sensor type, exposure time.
In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.
In the embodiment of the application, the image processing chip is added in the electronic equipment, so that the main control chip can send the video data acquired by the image sensor to the image processing chip for frame interpolation according to the target parameters of the image sensor, the number of video frames is increased, the video smoothness is further increased, and the video data is optimized; meanwhile, the requirement of the number of required video frames in different shooting modes can be met, so that more shooting functions can be realized, and the shooting experience of a user is improved.
Drawings
Fig. 1 is a schematic flowchart of a video processing method provided in an embodiment of the present application;
FIG. 2 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;
FIG. 3 is a schematic interface diagram of a video processing method according to an embodiment of the present application;
fig. 4 is a schematic flowchart of a video processing method according to an embodiment of the present application;
FIG. 5 is a second flowchart illustrating a video processing method according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
fig. 8 is a hardware schematic diagram of an electronic device provided in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
The video processing method, the video processing apparatus, the electronic device, and the readable storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.
In the video processing method provided in the embodiment of the present application, an execution subject of the video processing method may be an electronic device or a functional module or a functional entity capable of implementing the video processing method in the electronic device, the electronic device mentioned in the embodiment of the present application includes, but is not limited to, a mobile phone, a tablet computer, a camera, a wearable device, and the like, and the video processing method provided in the embodiment of the present application is described below with the electronic device as the execution subject.
In some embodiments, as shown in fig. 1, the video processing method includes: step 110, step 120 and step 130.
As shown in fig. 2, the video processing method may be applied to an electronic device including: an image sensor 210, a main control chip 220 and an image processing chip 230. The first interface of the main control chip 220 is electrically connected to the image processing chip 230, and the second interface of the main control chip 220 is electrically connected to the image sensor 210. It should be understood that the connection relationship between the modules in the embodiment of the present application is merely used as an example, and the structure of the electronic device is not specifically limited in the embodiment of the present application.
Alternatively, the image sensor 210 may be an image sensor corresponding to different camera types. The camera types include, for example: wide angle cameras, zoom cameras, macro cameras, or the like. The main control chip 220 may be a main Application chip of the electronic device, that is, an Application Processor (AP) chip, and the main control chip 220 may specifically include: a Dynamic Random Access Memory (DRAM) module, a Graphics Processing Unit (GPU) module, or a Central Processing Unit (CPU) module. The image processing chip 230 may be a stand-alone graphics processing chip.
Optionally, in step 110, in a case that the electronic device enters a video shooting mode or a video recording mode, the image sensor 210 starts to acquire video data and sends the video data to the main control chip 220.
Optionally, in step 120, the main control chip receives video data, and sends the video data to the image processing chip when a target parameter of the image sensor meets a preset condition;
in some embodiments, after the main control chip receives the video data, the method further includes:
the electronic equipment receives a first input of a user;
the main control chip 220 switches the target parameter in response to the first input.
Alternatively, the electronic device may adjust the target parameter of the image sensor 210 during the process of acquiring the video data by the main control chip 220 by receiving the first input of the user. The target parameters may include at least one of: frame rate, image resolution, image sensor type, exposure time.
Wherein the first input may be expressed in at least one of the following ways:
first, the first input may be represented as a touch operation, including but not limited to a click operation, a slide operation, a press operation, and the like. In this embodiment, the user switches the target parameter of the image sensor 210 by touching the target control.
Second, the first input may be represented as a physical key input.
In this embodiment, the body of the terminal is provided with a physical key corresponding to the target parameter of the image sensor 210, and receives a first input from the user, which may be expressed as receiving a first input that the user presses the corresponding physical key; the first input may also be a combined operation of pressing a plurality of physical keys simultaneously.
Third, the first input may be represented as a voice input.
In this embodiment, the terminal may trigger the operation of performing frame rate switching when receiving a voice such as "frame rate switch to 960 fps".
Of course, in other embodiments, the first input may also be in other forms, including but not limited to character input, and the like, which may be determined according to actual needs, and this is not limited in this application.
For example, in the process of recording, a user clicks a magnification control on a shooting preview interface to realize first input; or, the user drags the magnification dragging bar on the shooting preview interface to realize the first input, thereby completing the switching of the image sensor types.
Alternatively, the main control chip 220 may complete the switching of the target parameter of the image sensor in response to the first input.
The video processing method provided by the embodiment of the application can realize switching of different target parameters, so that the image sensor can determine whether to send video data to the image processing chip or not according to feedback of different target parameters.
Optionally, after switching the target parameter, the main control chip 220 determines whether the target parameter of the image sensor 210 meets a preset condition. Then the main control chip 220 may send the video data to the image processing chip 230 in step 120 if the target parameter of the image sensor 210 meets the preset condition. Wherein the preset condition may include: the image sensor 210 does not support the target frame rate, the exposure time of the image sensor 210 is below a first threshold, the frame rate of the image sensor 210 is reduced to a second threshold, and so on.
Optionally, as shown in fig. 3, a control corresponding to the target parameter is added to a shooting preview interface of the electronic device. Examples include: and switching controls of the frame rate, the image resolution and the image sensor type, and the like to realize the function of switching the image sensor type, the frame rate or the image resolution. The frame rate range selectable in fig. 3 is 120fps to 960fps, and the selectable image resolution includes: 720p, 1080p, 4K, etc., the magnification factor corresponding to different image sensor types includes: 0.6x, 1x, 2x, or 5x, etc.
Optionally, in step 130, after the image processing chip 230 receives the video data, the video data is subjected to frame interpolation. Wherein the frame interpolation operation can be performed based on motion compensation techniques. Motion compensation techniques are techniques that compensate by detecting motion in a particular frame, estimating the appearance of subsequent frames, and then adding related frames.
In the embodiment of the application, the video frames in the video data can be predicted, and the predicted video frames are added between the continuous video frames to make up for the problem of insufficient number of the video frames. In addition to increasing the number of video frames of the video data, the image processing chip 230 can optimize each frame of the video data to increase the sharpness and contrast of the video data. The image processing chip 230 can take over the operation amount of a part of video frames, so that the power consumption of the main control chip 220 can be reduced.
Optionally, the image processing chip 230 sends the video data after frame insertion to the main control chip 220 as a target video. The main control chip 220 receives the target video and stores the target video.
The video processing method provided by the embodiment of the application can be applied to the following scenes:
assuming that the electronic device does not have the image sensor 210 supporting slow motion shooting, the electronic device will not be able to shoot slow motion video without the image processing chip 230 being provided. After the electronic device is added to the image processing chip 230, the video may be interpolated to output a slow motion video. For example: the video frame number of the video data is 3600 frames, and the video duration is 1 minute. The video data may be input to the image processing chip 230 for frame interpolation, and the video data after frame interpolation may be used as the target video. At this time, the number of video frames of the video data is increased to 7200 frames, and the video duration of the target video is changed to 2 minutes under the condition that the frame rate of video playing is not changed, so that the video data is converted into the slow motion video, that is, by adding the image processing chip 230 to the electronic device, the electronic device corresponding to the image sensor 210 which does not support slow motion shooting can also obtain the target video with the slow motion shooting effect.
In practical implementation, the video processing method provided by the embodiment of the present application is described with reference to fig. 2. As shown in fig. 2, the video processing flow of the electronic device may be: the image sensor 210 acquires video data and transmits the video data to the main control chip 220 through the second interface. The main control chip 220 sends the received image data to the image processing chip 230 through the first interface for frame insertion. The image processing chip 230 transmits the frame-inserted video data back to the main control chip 220. The main control chip 220 stores the video data after frame insertion.
According to the video processing method provided by the embodiment of the application, the image processing chip is added in the electronic equipment, so that the main control chip can send the video data acquired by the image sensor to the image processing chip for frame interpolation according to the target parameters of the image sensor, the video frame number is improved, the video smoothness is improved, and the video data is optimized; meanwhile, the requirement of the number of required video frames in different shooting modes can be met, so that more shooting functions can be realized, and the shooting experience of a user is improved.
In some embodiments, in the case that the target parameter includes any one of the sensor type, the frame rate, and the image resolution, the preset condition is that the target parameter does not support the target frame rate. It can be seen that the main control chip 220 sends the video data to the image processing chip 230 when the target parameter includes the following three situations and the preset condition is that the target parameter does not support the target frame rate.
The first situation is as follows: if the target parameter is the image sensor type, the video data is sent to the image processing chip 230 if the image sensor type switched by the image sensor 210 does not support the target frame rate.
Optionally, after the user switches the image sensor type, if the image sensor type does not support the target frame rate, the main control chip 220 may send the video data to the image processing chip 230. Or when the image resolution outputted by the image sensor type does not support the target frame rate, the main control chip 220 sends the video data to the image processing chip 230.
Optionally, different image sensor types support different frame rates. For example: in general, the electronic device can only capture slow motion video by the image sensor 210 of the main camera, and the image sensor 210 of another camera, such as the image sensor 210 of the wide-angle camera, does not support capture of slow motion video.
In some embodiments, the target frame rate may be a capture frame rate of slow motion video. Since more pictures need to be recorded per second at the time of slow motion video shooting, the amount of data generated per unit time in the slow motion shooting mode will be doubled compared to the normal shooting mode. Therefore, in the slow motion shooting mode, the user needs to consider whether the current image sensor type supports the slow motion shooting mode or not in order to switch different image sensor types.
For example: assuming that the user switches the main camera to the wide-angle camera in the slow motion shooting mode, generally, in the case that the electronic device is not provided with the image processing chip 230, the frame rate supported by the wide-angle camera is 60fps, and the shooting frame rate of the slow motion video needs to reach 120fps, at this time, the user cannot shoot the slow motion video by using the wide-angle camera. And under the condition that electronic equipment is provided with image processing chip 230, image processing chip 230 can insert the frame to the video of shooting under the wide-angle camera, improves the video frame number, makes up the not enough problem of the frame number of wide-angle camera collection to can solve the problem that electronic equipment can't shoot the video of slow motion under the wide-angle camera.
Specifically, assuming that the frame rate supported by the wide-angle camera is 60fps, the number of video frames that can be acquired by the wide-angle camera for 1 minute is 3600 frames. And if the shooting frame rate of the slow motion video needs to reach 120fps, the number of the video frames needing to be collected within 1 minute by the wide-angle camera in the slow motion shooting mode is 7200 frames. Therefore, the image processing chip 230 can interpolate the video shot by the wide-angle camera, so that the 3600 frames of video collected by the wide-angle camera for 1 minute is changed into the 7200 frames of video for 1 minute, that is, the number of the frames of video needing to be collected in the slow motion shooting mode is reached.
As shown in fig. 3, "0.6 x, 1x, 2x, or 5 x" may correspond to different image sensor types. Wherein "0.6 x" corresponds to the image sensor 210 of the wide-angle camera; "1 x" corresponds to the image sensor 210 of the main camera; "2 x" corresponds to the image sensor 210 of the portrait camera; "5 x" corresponds to the image sensor 210 of the tele camera. According to the video processing method provided by the embodiment of the application, the image sensor 210 which does not support slow motion video shooting originally can also shoot the slow motion video, so that a user can freely switch among wide-angle lenses, 1x lenses, 2x lenses, 5x lenses and the like when shooting the slow motion video, and the slow motion video can be changed into the wide-angle camera or multiple lenses in real time according to the requirements of the user.
Further, based on the frame insertion function of the image processing chip 230, the user can freely switch among the shots such as "0.6 x, 1x, 2x, or 5 x" according to the requirement during the shooting or video recording process. And when the type of the image sensor does not support the target frame rate of the current shooting mode, the image processing chip 230 performs frame interpolation on the video shot in the current shooting mode, so that the target frame rate can be achieved.
In some embodiments, a user uses a wide-angle camera to capture a slow motion video, and assuming that the resolution of an image output by the wide-angle camera is 4K, since the amount of data to be collected in the slow motion capture mode is doubled, in order to reduce the processing pressure of the main control chip and capture a video with a stable frame rate, the resolution or color richness of the image of the slow motion video is generally reduced. Therefore, in a case where the electronic apparatus is not provided with the image processing chip 230, the user cannot capture a slow motion video with a high image resolution using a wide-angle camera. And under the condition that electronic equipment is provided with image processing chip 230, image processing chip 230 can insert the frame to the video of shooing, not only can improve the video frame number, can also improve the image resolution of video frame to solve the problem that wide-angle camera can't shoot the video of slow motion that the image resolution is higher, can satisfy the frame rate demand under the different type camera, realized more shooting functions, improved and shot the flexibility.
According to the video processing method provided by the embodiment of the application, under the condition that the type of the image sensor does not support the target frame rate, the main control chip sends the video data to the image processing chip, and frame insertion is realized through the image processing chip, so that different shooting effects can be realized.
Case two: if the target parameter is the frame rate, the main control chip 220 sends the video data to the image processing chip 230 if the frame rate switched by the image sensor 210 does not support the target frame rate.
Alternatively, the user adjusts the target frame rate if the image sensor 210 is selected. In the case that the current frame rate of the image sensor 210 does not support the target frame rate, the main control chip 220 sends the video data to the image processing chip 230 for frame interpolation.
For example: assuming that the current frame rate supported by the image sensor 210 is 120fps, the user wants to adjust the target frame rate to 480 fps. In the case where the electronic apparatus is not provided with the image processing chip 230, the electronic apparatus cannot capture video at a frame rate of 480 fps. When the image processing chip 230 is added to the electronic device, the main control chip 220 may capture video data at 120fps, and then send the video data to the image processing chip 230 for frame insertion. After the image processing chip 230 performs frame interpolation on the video data, a target video with a target frame rate of 480fps can be obtained.
In some embodiments, the target frame rate may be a capture frame rate of slow motion video. When the user adjusts the shooting frame rate of the slow motion video, if the current image sensor 210 does not support the target frame rate, the main control chip 220 sends the video data to the image processing chip 230 for frame interpolation.
For example: since the shooting frame rate of the slow-motion video is usually 120fps, 240fps, or 480fps, the user can select a small frame rate when shooting the slow-motion video. In order to enable the user to adjust the frame rate as required when shooting the slow motion video and to adjust the target frame rate in a wider range, the slow motion video may be sent to the image processing chip 230 through the main control chip 220 for frame interpolation. Therefore, when the user selects 1000fps to shoot the slow motion video, the frame rate supported by the current image sensor 210 is 480fps, and at this time, the electronic device shoots the video data at 480fps first, and sends the shot video data to the image processing chip 230 for frame interpolation. After the image processing chip 230 inserts frames into the video data, the target video with the target frame rate of 1000fps can be obtained, so that the target frame rate selection range of the slow motion shooting mode is increased, the frame rate requirements under different shooting modes can be met, more shooting functions are realized, and the shooting flexibility is improved.
According to the video processing method provided by the embodiment of the application, under the condition that the frame rate of the image sensor does not support the target frame rate, the main control chip sends the video data to the image processing chip for frame interpolation, the selectable frame rate range in the shooting process can be enlarged, a user can dynamically select the frame rate in the shooting process, and the shooting experience of the user is improved.
Case two: if the target parameter is the frame rate, the main control chip 220 sends the video data to the image processing chip 230 if the image resolution switched by the image sensor 210 does not support the image resolution corresponding to the target frame rate.
Alternatively, the user may adjust the image resolution of the image sensor 210 as desired before taking the video. In the case that the image resolution of the image sensor 210 does not support the image resolution corresponding to the target frame rate, the main control chip 220 transmits the video data to the image processing chip 230. For example: assuming that the image resolution of the image sensor 210 is 720p, and the image resolution corresponding to the target frame rate is 1080p, that is, the image resolution of the image sensor 210 does not reach the image resolution corresponding to the target frame rate, the video data captured by the current image sensor 210 is sent to the image processing chip 230 for frame interpolation, so as to generate a target video with a higher resolution.
In some embodiments, the target frame rate may be a capture frame rate of slow motion video. The user may switch the image resolution supported by the slow motion capture mode before entering the slow motion capture mode. In the case that the electronic device is not provided with the image processing chip 230, the current image sensor 210 only supports 1080p or 720p of image resolution in the slow motion shooting mode, and when the user adjusts the image resolution corresponding to the target frame rate to 4K, the image resolution of the current image sensor 210 may not reach 4K, so that the user may not shoot a slow motion video with the image resolution of 4K. Under the condition that the electronic equipment is added with the image processing chip 230, video data shot by the image resolution of the current image sensor 210 is sent to the image processing chip for frame insertion, and after the image processing chip 230 inserts the frame into the video data, a target video with the image resolution of 4K can be generated, so that the image resolution selection range of the slow motion shooting mode is enlarged, the image resolution requirements under different shooting modes can be met, more shooting functions are realized, and the shooting flexibility is improved.
According to the video processing method provided by the embodiment of the application, under the condition that the image resolution corresponding to the image sensor does not support the image resolution corresponding to the target frame rate, the main control chip sends the video data to the image processing chip for frame insertion, the high-resolution target video can be obtained, and therefore the definition of the target video is improved.
In some embodiments, in the case where the target parameters include an exposure time and a frame rate, in the case where the target parameters of the image sensor satisfy a preset condition, transmitting the video data to the image processing chip includes:
reducing the frame rate of the image sensor under the condition that the exposure time meets a first preset condition;
under the condition that the frame rate meets a second preset condition, sending the video data to an image processing chip;
wherein the first preset condition is that the exposure time is lower than a first threshold value;
the second preset condition is that the frame rate is lower than a second threshold.
Optionally, when the user takes a picture or records a video, it is first detected whether the environment where the electronic device is located is a dark environment. The exposure time of the image sensor 210 in a dark environment affects the brightness of the captured image, and the captured image is noisy. The exposure time of the image sensor 210 can be increased by decreasing the frame rate if it is detected that the environment in which the electronic device is located is a dark environment, i.e. in case the exposure time of the image sensor 210 is below the first threshold. The longer the exposure time, the brighter the shot picture and the sharper the imaged picture. For example: assuming that the first threshold is 1/100 (sec/frame) and the current photographing frame rate is 120fps, the exposure time is 1/120 (sec/frame), that is, the exposure time of the image sensor 210 is lower than the first threshold, at this time, the photographing frame rate can be decreased to 30fps, so that the exposure time is increased to 1/30 (sec/frame).
Alternatively, the video smoothness may be degraded due to a decrease in the shooting frame rate. Therefore, in the case where the frame rate of the image sensor 210 is lower than the second threshold, the main control chip 220 may transmit the video data photographed in the dark environment to the image processing chip 230 for frame interpolation. For example: the current shooting frame rate is reduced to 30fps, and if the second threshold is 40fps, the shooting frame rate of the image sensor is lower than the second threshold at this time, and the shot video data can be sent to the image processing chip 230. After the image processing chip 230 inserts frames into the video data, the video frame number of the target video can be increased, and noise reduction processing can be performed on each frame, so that the purity of the video frame can be ensured while the video brightness and the video smoothness are ensured.
The first threshold may be a preset value or a default value, and the embodiment of the present application is not particularly limited. The second threshold may be a preset value or a default value, and the embodiment of the present application is not particularly limited.
According to the video processing method provided by the embodiment of the application, the frame rate of the image sensor is reduced under the condition that the exposure time is lower than the first threshold value, so that the exposure time of the image sensor can be properly increased, the problem that the image noise is too large due to too low exposure time is avoided, and meanwhile, the brightness and the purity of a video frame can be improved; and the image processing chip is adopted to perform frame interpolation on the video data shot after the frame rate is reduced so as to keep the stable frame rate of the target video and achieve the frame rate in the target shooting mode according to the user requirements.
In some embodiments, the electronic device may include an AP terminal, an image sensor, and a separate graphic processing chip. As shown in fig. 4, a flow of a video processing method provided in an embodiment of the present application may include:
And step 403, judging whether the sensor supports the target frame rate. If so, step 404 is entered. If not, go to step 405.
And step 404, the AP end stores the target video.
And 405, the sensor sends the acquired video data to an independent graphic processing chip, the independent graphic processing chip performs frame interpolation on the video data, and the video data subjected to frame interpolation is used as a target video to be sent to the AP end.
In some embodiments, the electronic device may include an AP terminal, an image sensor, and a separate graphic processing chip. As shown in fig. 5, a flow of a video processing method provided in an embodiment of the present application may include:
And 505, the sensor sends the acquired video data to an independent graphic processing chip, the independent graphic processing chip performs frame interpolation and noise reduction on the video data, and the processed video data is used as a target video to be sent to the AP end.
In step 506, the AP receives the target video and proceeds to step 503.
It should be noted that, in the video processing method provided in the embodiment of the present application, the execution subject may be a video processing apparatus, or a control module in the video processing apparatus for executing the video processing method. In the embodiment of the present application, a method for executing video processing by a video processing apparatus is taken as an example, and the video processing apparatus provided in the embodiment of the present application is described.
The embodiment of the application also provides a video processing device.
As shown in fig. 6, the video processing apparatus includes: an acquisition module 610, a first receiving module 620 and a generating module 630.
An obtaining module 610, configured to enable the image sensor to obtain video data and send the video data to the main control chip;
a first receiving module 620, configured to enable the main control chip to receive the video data, and send the video data to the image processing chip when a target parameter of the image sensor meets a preset condition;
a generating module 630, configured to enable the image processing chip to perform frame interpolation on the video data, generate a target video, and send the target video to the main control chip;
wherein the target parameters include at least one of: frame rate, image resolution, image sensor type, exposure time.
According to the video processing device provided by the embodiment of the application, the image processing chip is added in the electronic equipment, so that the main control chip can send the video data acquired by the image sensor to the image processing chip for frame insertion according to the target parameters of the image sensor, the video frame number is improved, the video smoothness is improved, and the video data is optimized; meanwhile, the requirement of the number of required video frames in different shooting modes can be met, so that more shooting functions can be realized, and the shooting experience of a user is improved.
In some embodiments, in a case that the target parameter includes any one of the sensor type, the frame rate, and the image resolution, the preset condition is that the target parameter does not support the target frame rate.
In some embodiments, in the case that the target parameter includes the exposure time and the frame rate, the first receiving module 620 is specifically configured to:
reducing the frame rate under the condition that the exposure time meets a first preset condition;
under the condition that the frame rate meets a second preset condition, sending the video data to the image processing chip;
wherein the first preset condition is that the exposure time is lower than a first threshold;
the second preset condition is that the frame rate is lower than a second threshold.
In some embodiments, the apparatus further comprises:
a second receiving module (not shown in the figure) for enabling the electronic device to receive a first input of a user;
and a switching module (not shown in the figure) for enabling the main control chip to respond to the first input and switch the target parameter.
In some embodiments, the target frame rate is a capture frame rate of slow motion video.
The video processing apparatus in the embodiment of the present application may be an apparatus, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The video processing apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an IOS operating system, or other possible operating systems, which is not specifically limited in the embodiments of the present application.
The video processing apparatus provided in the embodiment of the present application can implement each process implemented by the method embodiments of fig. 1 to fig. 5, and is not described herein again to avoid repetition.
Optionally, as shown in fig. 7, an electronic device 700 is further provided in this embodiment of the present application, and includes a processor 701, a memory 702, and a program or an instruction stored in the memory 702 and executable on the processor 701, where the program or the instruction is executed by the processor 701 to implement each process of the video processing method embodiment, and can achieve the same technical effect, and no further description is provided here to avoid repetition.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 8 is a hardware schematic diagram of an electronic device provided in an embodiment of the present application.
The electronic device 800 includes, but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, and a processor 810.
Those skilled in the art will appreciate that the electronic device 800 may further comprise a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 810 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system. The electronic device structure shown in fig. 8 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.
The processor 810 is configured to enable the image sensor to acquire video data and send the video data to the main control chip;
the main control chip is further used for receiving the video data and sending the video data to the image processing chip under the condition that target parameters of the image sensor meet preset conditions;
the image processing chip is also used for performing frame interpolation on the video data to generate a target video and sending the target video to the main control chip;
wherein the target parameters include at least one of: frame rate, image resolution, image sensor type, exposure time.
According to the electronic equipment provided by the embodiment of the application, the image processing chip is added into the electronic equipment, so that the main control chip can send the video data acquired by the image sensor to the image processing chip for frame interpolation according to the target parameters of the image sensor, the video frame number is improved, the video smoothness is improved, and the video data is optimized; meanwhile, the requirement of the number of required video frames in different shooting modes can be met, so that more shooting functions can be realized, and the shooting experience of a user is improved.
Optionally, in a case that the target parameter includes any one of the sensor type, the frame rate, and the image resolution, the preset condition is that the target parameter does not support the target frame rate.
Optionally, a processor 810, further configured to cause the electronic device to receive a first input of a user;
and the main control chip is used for responding to the first input and switching the target parameter.
Optionally, the target frame rate is a shooting frame rate of the slow motion video.
It should be understood that in the embodiment of the present application, the input Unit 804 may include a Graphics Processing Unit (GPU) 8041 and a microphone 8042, and the Graphics Processing Unit 8041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 807 includes a touch panel 8071 and other input devices 8072. A touch panel 8071, also referred to as a touch screen. The touch panel 8071 may include two portions of a touch detection device and a touch controller. Other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 809 may be used to store software programs as well as various data including, but not limited to, application programs and operating systems. The processor 810 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 810.
The embodiments of the present application further provide a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the video processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each process of the above video processing method embodiment, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A video processing method is applied to an electronic device, and the electronic device comprises: the image processing device comprises a main control chip, an image processing chip and an image sensor, wherein a first interface of the main control chip is electrically connected with the image processing chip, and a second interface of the main control chip is electrically connected with the image sensor; the method comprises the following steps:
the image sensor acquires video data and sends the video data to the main control chip;
the main control chip receives the video data, and sends the video data to the image processing chip under the condition that the target parameter of the image sensor meets a preset condition;
the image processing chip performs frame interpolation on the video data to generate a target video and sends the target video to the main control chip;
wherein the target parameters include at least one of: frame rate, image resolution, image sensor type, exposure time.
2. The video processing method according to claim 1, wherein in a case where the target parameter includes any one of the sensor type, the frame rate, and the image resolution, the preset condition is that the target parameter does not support the target frame rate.
3. The video processing method according to claim 1, wherein in a case where the target parameters include the exposure time and the frame rate, and in a case where target parameters of the image sensor satisfy a preset condition, sending the video data to the image processing chip comprises:
reducing the frame rate under the condition that the exposure time meets a first preset condition;
under the condition that the frame rate meets a second preset condition, sending the video data to the image processing chip;
wherein the first preset condition is that the exposure time is lower than a first threshold;
the second preset condition is that the frame rate is lower than a second threshold.
4. The video processing method of claim 1, wherein after the main control chip receives the video data, further comprising:
the electronic equipment receives a first input of a user;
the main control chip responds to the first input and switches the target parameter.
5. The video processing method according to claim 2, wherein the target frame rate is a shooting frame rate of a slow motion video.
6. A video processing apparatus, applied to the electronic device according to claim 1, the apparatus comprising:
the acquisition module is used for enabling the image sensor to acquire video data and sending the video data to the main control chip;
the first receiving module is used for enabling the main control chip to receive the video data and sending the video data to the image processing chip under the condition that target parameters of the image sensor meet preset conditions;
the generating module is used for enabling the image processing chip to insert frames into the video data, generating a target video and sending the target video to the main control chip;
wherein the target parameters include at least one of: frame rate, image resolution, image sensor type, exposure time.
7. The apparatus according to claim 6, wherein in a case where the target parameter includes any one of the sensor type, the frame rate, and the image resolution, the preset condition is that the target parameter does not support the target frame rate.
8. The video processing apparatus according to claim 6, wherein in a case that the target parameter includes the exposure time and the frame rate, the first receiving module is specifically configured to:
reducing the frame rate under the condition that the exposure time meets a first preset condition;
under the condition that the frame rate meets a second preset condition, sending the video data to the image processing chip;
wherein the first preset condition is that the exposure time is lower than a first threshold;
the second preset condition is that the frame rate is lower than a second threshold.
9. An electronic device comprising a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions when executed by the processor implementing the steps of the video processing method according to any of claims 1-5.
10. A readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the video processing method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111630459.6A CN114285978A (en) | 2021-12-28 | 2021-12-28 | Video processing method, video processing device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111630459.6A CN114285978A (en) | 2021-12-28 | 2021-12-28 | Video processing method, video processing device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114285978A true CN114285978A (en) | 2022-04-05 |
Family
ID=80877372
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111630459.6A Pending CN114285978A (en) | 2021-12-28 | 2021-12-28 | Video processing method, video processing device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114285978A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115514902A (en) * | 2022-09-09 | 2022-12-23 | 维沃移动通信有限公司 | Image processing circuit and electronic device |
| CN115514890A (en) * | 2022-09-09 | 2022-12-23 | 维沃移动通信有限公司 | Image processing apparatus, image processing method, and electronic device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106412451A (en) * | 2015-07-28 | 2017-02-15 | 联发科技股份有限公司 | Image processing method and apparatus and system |
| CN110636375A (en) * | 2019-11-11 | 2019-12-31 | RealMe重庆移动通信有限公司 | Video stream processing method and device, terminal equipment and computer readable storage medium |
| CN111918098A (en) * | 2020-09-16 | 2020-11-10 | Oppo广东移动通信有限公司 | Video processing method and device, electronic equipment, server and storage medium |
| CN112004086A (en) * | 2020-08-21 | 2020-11-27 | Oppo广东移动通信有限公司 | Video data processing method and device |
| CN112532865A (en) * | 2019-09-19 | 2021-03-19 | 华为技术有限公司 | Slow-motion video shooting method and electronic equipment |
| WO2021093712A1 (en) * | 2019-11-11 | 2021-05-20 | 华为技术有限公司 | Image processing method and related product |
-
2021
- 2021-12-28 CN CN202111630459.6A patent/CN114285978A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106412451A (en) * | 2015-07-28 | 2017-02-15 | 联发科技股份有限公司 | Image processing method and apparatus and system |
| CN112532865A (en) * | 2019-09-19 | 2021-03-19 | 华为技术有限公司 | Slow-motion video shooting method and electronic equipment |
| CN110636375A (en) * | 2019-11-11 | 2019-12-31 | RealMe重庆移动通信有限公司 | Video stream processing method and device, terminal equipment and computer readable storage medium |
| WO2021093712A1 (en) * | 2019-11-11 | 2021-05-20 | 华为技术有限公司 | Image processing method and related product |
| CN112004086A (en) * | 2020-08-21 | 2020-11-27 | Oppo广东移动通信有限公司 | Video data processing method and device |
| CN111918098A (en) * | 2020-09-16 | 2020-11-10 | Oppo广东移动通信有限公司 | Video processing method and device, electronic equipment, server and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115514902A (en) * | 2022-09-09 | 2022-12-23 | 维沃移动通信有限公司 | Image processing circuit and electronic device |
| CN115514890A (en) * | 2022-09-09 | 2022-12-23 | 维沃移动通信有限公司 | Image processing apparatus, image processing method, and electronic device |
| WO2024051674A1 (en) * | 2022-09-09 | 2024-03-14 | 维沃移动通信有限公司 | Image processing circuit and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7169383B2 (en) | Capture and user interface using night mode processing | |
| CN107302664B (en) | Shooting method and mobile terminal | |
| CN111601040B (en) | Camera control method and device and electronic equipment | |
| CN112672060B (en) | Shooting method and device and electronic equipment | |
| US11539888B2 (en) | Method and apparatus for processing video data | |
| CN112866576B (en) | Image preview method, storage medium and display device | |
| CN114285978A (en) | Video processing method, video processing device and electronic equipment | |
| CN113596294A (en) | Shooting method and device and electronic equipment | |
| CN114285958B (en) | Image processing circuit, image processing method, and electronic apparatus | |
| CN112770059A (en) | Photographing method and device and electronic equipment | |
| CN114286007A (en) | Image processing circuit, image processing method, electronic device, and readable storage medium | |
| CN113852756B (en) | Image acquisition method, device, equipment and storage medium | |
| CN115278047A (en) | Shooting method, shooting device, electronic equipment and storage medium | |
| CN113891018A (en) | Shooting method and device and electronic equipment | |
| CN114286003A (en) | Shooting method, shooting device and electronic equipment | |
| CN115134505B (en) | Preview picture generation method and device, electronic equipment and storage medium | |
| CN112437237B (en) | Shooting method and device | |
| CN118018835A (en) | Image capturing method, image capturing device, image capturing apparatus, and storage medium | |
| CN112153291B (en) | Photographing method and electronic equipment | |
| CN114093005A (en) | Image processing method and device, electronic equipment and readable storage medium | |
| CN112399092A (en) | Shooting method and device and electronic equipment | |
| CN112291474A (en) | Image acquisition method and device and electronic equipment | |
| CN111405205A (en) | Image processing method and electronic device | |
| CN114520874B (en) | Video processing method and device and electronic equipment | |
| CN112492208B (en) | Shooting method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |