CN114285978A - Video processing method, video processing device and electronic equipment - Google Patents

Abstract

The application discloses a video processing method, a video processing device and electronic equipment, and belongs to the technical field of data processing. The electronic device includes: the image processing device comprises a main control chip, an image processing chip and an image sensor, wherein a first interface of the main control chip is electrically connected with the image processing chip, and a second interface of the main control chip is electrically connected with the image sensor; the method comprises the following steps: the image sensor acquires video data and sends the video data to the main control chip; the main control chip receives the video data, and sends the video data to the image processing chip under the condition that the target parameter of the image sensor meets a preset condition; the image processing chip performs frame interpolation on the video data to generate a target video and sends the target video to the main control chip; wherein the target parameters include at least one of: frame rate, image resolution, image sensor type, exposure time.

Description

Video processing method, video processing device and electronic device

technical field

The present application belongs to the technical field of data processing, and in particular relates to a video processing method, a video processing apparatus and an electronic device.

Background technique

In order to meet the video shooting needs of various special scenes, users have higher and higher requirements for cameras. However, the video parameters supported by the camera in the current electronic device are very limited, and the video captured is difficult to meet the diverse needs of the user, resulting in a poor shooting experience for the user. For example, the frame rate corresponding to some cameras that support slow-motion shooting (hereinafter referred to as "frame rate") can only be selected at 120fps (frames per second), and users cannot select a higher frame rate to shoot slow-motion video.

SUMMARY OF THE INVENTION

The purpose of the embodiments of the present application is to provide a video processing method, a video processing apparatus, and an electronic device, which can solve the problem of poor user shooting experience.

In a first aspect, an embodiment of the present application provides a video processing method, which is applied to an electronic device. The electronic device includes: a main control chip, an image processing chip, and an image sensor, and a first interface of the main control chip is connected to the image The processing chip is electrically connected, and the second interface of the main control chip is electrically connected to the image sensor;

The method includes:

The image sensor acquires video data, and sends the video data to the main control chip;

The main control chip receives the video data, and sends the video data to the image processing chip when the target parameter of the image sensor meets a preset condition;

The image processing chip inserts frames on the video data, generates a target video, and sends the target video to the main control chip;

Wherein, the target parameter includes at least one of the following: frame rate, image resolution, image sensor type, and exposure time.

In a second aspect, an embodiment of the present application provides a video processing apparatus, the apparatus applies the above-mentioned electronic equipment, and the apparatus includes:

an acquisition module, configured to enable the image sensor to acquire video data and send the video data to the main control chip;

a first receiving module, configured to enable the main control chip to receive the video data, and send the video data to the image processing chip when the target parameter of the image sensor meets a preset condition;

A generation module, configured to make the image processing chip perform frame insertion on the video data, generate a target video, and send the target video to the main control chip;

Wherein, the target parameter includes at least one of the following: frame rate, image resolution, image sensor type, and exposure time.

In a third aspect, embodiments of the present application provide an electronic device, the electronic device includes a processor, a memory, and a program or instruction stored on the memory and executable on the processor, the program or instruction being The processor implements the steps of the method according to the first aspect when executed.

In a fourth aspect, an embodiment of the present application provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the steps of the method according to the first aspect are implemented .

In a fifth aspect, an embodiment of the present application provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction, and implement the first aspect the method described.

In the embodiment of the present application, by adding an image processing chip to the electronic device, the main control chip can send the video data acquired by the image sensor to the image processing chip according to the target parameters of the image sensor for frame interpolation, so as to increase the number of video frames , which can improve video fluency and optimize video data; at the same time, it can also meet the requirements of the number of video frames required in different shooting modes, so that more shooting functions can be realized and the shooting experience of users can be improved.

Description of drawings

1 is a schematic flowchart of a video processing method provided by an embodiment of the present application;

2 is a schematic structural diagram of an electronic device provided by applying an embodiment of the present application;

3 is a schematic diagram of an interface for applying the video processing method provided by an embodiment of the present application;

4 is one of the schematic flowcharts of applying the video processing method provided by the embodiment of the present application;

5 is the second schematic flowchart of applying the video processing method provided by the embodiment of the present application;

6 is a schematic structural diagram of a video processing apparatus provided by an embodiment of the present application;

7 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

FIG. 8 is a schematic diagram of hardware of an electronic device provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art fall within the protection scope of this application.

The terms "first", "second" and the like in the description and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances so that the embodiments of the present application can be practiced in sequences other than those illustrated or described herein, and distinguish between "first", "second", etc. The objects are usually of one type, and the number of objects is not limited. For example, the first object may be one or more than one. In addition, "and/or" in the description and claims indicates at least one of the connected objects, and the character "/" generally indicates that the associated objects are in an "or" relationship.

The video processing method, video processing apparatus, electronic device, and readable storage medium provided in the embodiments of the present application will be described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

In the video processing method provided by the embodiments of the present application, the executive body of the video processing method may be an electronic device or a functional module or functional entity capable of implementing the video processing method in the electronic device. The electronic devices mentioned in the embodiments of the present application include but not Limited to a mobile phone, a tablet computer, a computer, a camera, a wearable device, etc., the video processing method provided by the embodiment of the present application is described below by taking an electronic device as an execution subject as an example.

In some embodiments, as shown in FIG. 1 , the video processing method includes: step 110 , step 120 and step 130 .

As shown in FIG. 2 , the video processing method can be applied to an electronic device, and the electronic device includes an image sensor 210 , a main control chip 220 and an image processing chip 230 . The first interface of the main control chip 220 is electrically connected to the image processing chip 230 , and the second interface of the main control chip 220 is electrically connected to the image sensor 210 . It can be understood that the connection relationship between the modules in the embodiment of the present application is only used as an example, and the structure of the electronic device is not specifically limited in the embodiment of the present application.

Optionally, the image sensor 210 may be an image sensor corresponding to different camera types. The camera types include, for example, a wide-angle camera, a zoom camera, or a macro camera. The main control chip 220 may be the main application chip of the electronic device, that is, an application processor (Application Processor, AP) chip, and the main control chip 220 may specifically include: a dynamic random access memory module (Dynamic Random Access Memory, DRAM), a graphics processing A graphics processing unit (GPU) module or a central processing unit (Central Processing Unit, CPU) module, etc. The image processing chip 230 may be an independent graphics processing chip.

Optionally, in step 110 , when the electronic device enters a video shooting mode or a video recording mode, the image sensor 210 starts to acquire video data, and sends the video data to the main control chip 220 .

Optionally, in step 120, the main control chip receives video data, and sends the video data to the image processing chip when the target parameter of the image sensor meets a preset condition;

In some embodiments, after the main control chip receives the video data, it further includes:

The electronic device receives the user's first input;

The main control chip 220 switches the target parameter in response to the first input.

Optionally, the electronic device may adjust the target parameters of the image sensor 210 during the process of acquiring the video data by the main control chip 220 by receiving the first input from the user. The target parameters may include at least one of the following: frame rate, image resolution, image sensor type, exposure time.

Wherein, the first input can be expressed in at least one of the following ways:

First, the first input can be expressed as a touch operation, including but not limited to a click operation, a sliding operation, a pressing operation, and the like. In this embodiment, the user switches the target parameters of the image sensor 210 by touching the target control.

Second, the first input can be represented as a physical key input.

In this embodiment, the body of the terminal is provided with a physical button corresponding to the target parameter of the image sensor 210, and receiving the first input from the user can be expressed as receiving the first input of the user pressing the corresponding physical button; The input can also be a combined operation of pressing multiple physical keys at the same time.

Third, the first input can be expressed as a voice input.

In this embodiment, the terminal may trigger the frame rate switching operation when receiving a voice such as "frame rate switching to 960fps".

Of course, in other embodiments, the first input may also be expressed in other forms, including but not limited to character input, etc., which may be determined according to actual needs, which is not limited in this embodiment of the present application.

For example, during the recording process, the user can click the magnification control on the shooting preview interface to realize the first input; or, the user can drag the magnification drag bar on the shooting preview interface to realize the first input, thereby Complete the switching of the image sensor type.

Optionally, the main control chip 220 can complete the switching of target parameters of the image sensor in response to the first input.

The video processing method provided by the embodiment of the present application can realize switching of different target parameters, so that the image sensor can determine whether to send video data to the image processing chip according to the feedback of different target parameters.

Optionally, after switching the target parameter, the main control chip 220 determines whether the target parameter of the image sensor 210 satisfies a preset condition. Then, in step 120 , when the target parameter of the image sensor 210 satisfies the preset condition, the main control chip 220 may send the video data to the image processing chip 230 . The preset conditions may include: the image sensor 210 does not support the target frame rate, the exposure time of the image sensor 210 is lower than the first threshold, the frame rate of the image sensor 210 is reduced to the second threshold, and the like.

Optionally, as shown in FIG. 3 , a control corresponding to the target parameter is added to the shooting preview interface of the electronic device. For example, it includes controls for switching frame rate, image resolution and image sensor type, etc., to realize the function of switching image sensor type, frame rate or image resolution. In Figure 3, the selectable frame rate ranges from 120fps to 960fps, and the selectable image resolutions include: 720p, 1080p, or 4K, etc., and the corresponding magnifications for different image sensor types include: 0.6x, 1x, 2x, or 5x, etc.

Step 130 , the image processing chip 230 inserts frames into the video data, generates a target video, and sends the target video to the main control chip 220 .

Optionally, in step 130, after receiving the video data, the image processing chip 230 performs frame interpolation on the video data. Wherein, the frame insertion operation can be completed based on the motion compensation technology. Motion compensation techniques work by detecting motion in a particular frame, estimating the appearance of subsequent frames, and then compensating by adding related frames.

In this embodiment of the present application, the video frames in the video data may be predicted, and the predicted video frames may be added between consecutive video frames to make up for the problem of insufficient number of video frames. In addition to increasing the number of video frames of video data, the image processing chip 230 can also optimize each frame of picture to improve picture definition and contrast. Since the image processing chip 230 can undertake the calculation amount of a part of the video frame, the power consumption of the main control chip 220 can be reduced.

Optionally, the image processing chip 230 sends the video data after frame insertion to the main control chip 220 as the target video. The main control chip 220 receives the target video and saves the target video.

The video processing method provided in the embodiment of the present application can be applied to the following scenarios:

Assuming that the electronic device does not have the image sensor 210 that supports slow-motion shooting, if the electronic device is not provided with the image processing chip 230, the electronic device will not be able to shoot slow-motion video. After the image processing chip 230 is added to the electronic device, frame interpolation can be performed on the video to output a slow-motion video. For example, the number of video frames of the video data is 3600 frames, and the video duration is 1 minute. The video data can be input to the image processing chip 230 for frame interpolation, and the video data after frame interpolation can be used as the target video. At this time, the number of video frames of the video data is increased to 7200 frames, and when the frame rate of the video playback remains unchanged, the video duration of the target video becomes 2 minutes, so that the video data can be converted into a slow-motion video, that is, by By adding the image processing chip 230 to the electronic device, the electronic device corresponding to the image sensor 210 that does not support slow-motion shooting can also obtain the target video with the slow-motion shooting effect.

In actual implementation, the video processing method provided by the embodiment of the present application is described with reference to FIG. 2 . As shown in FIG. 2 , the video processing flow of the electronic device may be as follows: the image sensor 210 acquires video data, and sends the video data to the main control chip 220 through the second interface. The main control chip 220 sends the received image data to the image processing chip 230 through the first interface for frame insertion. The image processing chip 230 transmits the video data after frame insertion to the main control chip 220 . The main control chip 220 saves the video data after frame insertion.

In the video processing method provided by the embodiment of the present application, by adding an image processing chip to the electronic device, the main control chip can send the video data acquired by the image sensor to the image processing chip according to the target parameters of the image sensor for frame interpolation, so as to improve the The number of video frames can improve the fluency of the video and optimize the video data; at the same time, it can also meet the requirements of the number of video frames required in different shooting modes, so that more shooting functions can be realized, and the shooting experience of the user can be improved.

In some embodiments, when the target parameter includes any one of the sensor type, frame rate, and image resolution, the preset condition is that the target parameter does not support the target frame rate. It can be seen that the target parameter includes the following three situations and the preset condition is that the target parameter does not support the target frame rate, the main control chip 220 will send the video data to the image processing chip 230 .

Scenario 1: The target parameter is the image sensor type, and the video data is sent to the image processing chip 230 when the image sensor type switched by the image sensor 210 does not support the target frame rate.

Optionally, after the user switches the image sensor type, if the image sensor type does not support the target frame rate, the main control chip 220 will send the video data to the image processing chip 230 . Or when the image resolution output by the image sensor type does not support the target frame rate, the main control chip 220 will send the video data to the image processing chip 230 .

Optionally, different image sensor types support different frame rates. For example, under normal circumstances, the electronic device can only shoot slow-motion video under the image sensor 210 of the main camera, while the image sensor 210 of other cameras such as the image sensor 210 of the wide-angle camera does not support slow-motion video shooting.

In some embodiments, the target frame rate may be the shooting frame rate of the slow-motion video. Since more frames need to be recorded per second during slow-motion video shooting, compared with the normal shooting mode, the amount of data generated per unit of time in the slow-motion shooting mode will be doubled. Therefore, users who want to switch between different image sensor types in the slow-motion shooting mode need to consider whether the current image sensor type supports the slow-motion shooting mode.

For example: Suppose the user switches the main camera to the wide-angle camera in the slow-motion shooting mode. Usually, if the electronic device does not have the image processing chip 230, the frame rate supported by the wide-angle camera is 60fps, while the shooting frame rate of the slow-motion video needs to be When it reaches 120fps, the user cannot shoot slow-motion video with the wide-angle camera at this time. In the case where the electronic device is provided with the image processing chip 230, the image processing chip 230 can insert frames into the video captured by the wide-angle camera, increase the number of video frames, and make up for the insufficient number of frames collected by the wide-angle camera, thereby solving the problem of electronic The device cannot shoot slow-motion video under the wide-angle camera.

Specifically, assuming that the frame rate supported by the wide-angle camera is 60 fps, the number of video frames that can be collected by the wide-angle camera in one minute is 3600 frames. The slow-motion video shooting frame rate needs to reach 120fps, then in the slow-motion shooting mode, the wide-angle camera needs to collect 7200 video frames in 1 minute. Therefore, the image processing chip 230 can be used to insert frames into the video captured by the wide-angle camera, so that the 3,600-frame video captured by the wide-angle camera in 1 minute becomes 7,200 frames in 1 minute, that is, the number of video frames that need to be captured in the slow-motion shooting mode is reached. .

As shown in Figure 3, "0.6x, 1x, 2x or 5x" can correspond to different image sensor types. Among them, "0.6x" corresponds to the image sensor 210 of the wide-angle camera; "1x" corresponds to the image sensor 210 of the main camera; "2x" corresponds to the image sensor 210 of the portrait camera; "5x" corresponds to the telephoto camera The image sensor 210 of the camera. The video processing method provided in this embodiment of the present application can enable the image sensor 210 that does not originally support slow-motion video shooting to also shoot slow-motion video, so that the user can shoot slow-motion video in wide-angle, 1x, 2x, or 5x Switch between the lenses at will, so that the slow-motion video can be turned into a wide-angle camera or a multiple lens in real time according to the user's needs.

Further, based on the frame insertion function of the image processing chip 230, the user can freely switch between shots such as "0.6x, 1x, 2x, or 5x" according to requirements during the shooting or video recording process. And when the image sensor type does not support the target frame rate of the current shooting mode, the image processing chip 230 performs frame interpolation on the video shot in the current shooting mode, so that the target frame rate can be achieved.

In some embodiments, the user uses a wide-angle camera to shoot slow-motion video. Assuming that the image resolution output by the wide-angle camera is 4K, since the amount of data to be collected in the slow-motion shooting mode is doubled, in order to reduce the processing pressure of the main control chip and shooting video with a stable frame rate, usually reducing the image resolution or color richness of slow-motion video. Therefore, in the case where the electronic device is not provided with the image processing chip 230, the user cannot shoot a slow-motion video with a higher image resolution by using the wide-angle camera. In the case where the electronic device is provided with the image processing chip 230, the image processing chip 230 can insert frames into the captured video, which can not only increase the number of video frames, but also increase the image resolution of the video frames, thus solving the problem that the wide-angle camera cannot The problem of shooting slow-motion video with high image resolution can meet the frame rate requirements of different types of cameras, realize more shooting functions, and improve shooting flexibility.

In the video processing method provided by the embodiment of the present application, when the image sensor type does not support the target frame rate, the main control chip sends the video data to the image processing chip, and the image processing chip realizes frame insertion, so that different shootings can be realized. Effect.

Scenario 2: The target parameter is the frame rate, and the main control chip 220 sends the video data to the image processing chip 230 when the frame rate after the switching of the image sensor 210 does not support the target frame rate.

Optionally, the user adjusts the target frame rate when the image sensor 210 is selected. When the frame rate of the current image sensor 210 does not support the target frame rate, the main control chip 220 will send the video data to the image processing chip 230 for frame interpolation.

For example, it is assumed that the frame rate currently supported by the image sensor 210 is 120fps, and the user wants to adjust the target frame rate to 480fps. In the case where the electronic device is not provided with the image processing chip 230, the electronic device cannot shoot video at a frame rate of 480fps. In the case where the image processing chip 230 is added to the electronic device, the main control chip 220 can first capture video data at 120 fps, and then send the video data to the image processing chip 230 for frame insertion. After the image processing chip 230 performs frame interpolation on the video data, a target video with a target frame rate of 480 fps can be obtained.

In some embodiments, the target frame rate may be the shooting frame rate of the slow-motion video. When the user adjusts the shooting frame rate of the slow motion video, if the current image sensor 210 does not support the target frame rate, the main control chip 220 will send the video data to the image processing chip 230 for frame interpolation.

For example, the frame rate of slow motion video is usually 120fps, 240fps or 480fps, so users can choose less frame rate when shooting slow motion video. In order to enable the user to adjust the frame rate according to requirements when shooting slow-motion video, and to adjust the target frame rate in a wider range, the slow-motion video can be sent to the image processing chip 230 through the main control chip 220 for frame interpolation . Therefore, when the user selects 1000fps to shoot a slow-motion video, the current frame rate supported by the image sensor 210 is 480fps. At this time, the electronic device first captures video data at 480fps, and sends the captured video data to the image processing chip 230 for frame interpolation. . The image processing chip 230 can obtain a target video with a target frame rate of 1000 fps after interpolating the video data, thereby increasing the selection range of the target frame rate in the slow-motion shooting mode, thereby meeting the frame rate requirements in different shooting modes, Realize more shooting functions and improve shooting flexibility.

In the video processing method provided by the embodiment of the present application, when the frame rate of the image sensor does not support the target frame rate, the main control chip sends the video data to the image processing chip for frame interpolation, which can increase the number of optional frames during the shooting process. This allows users to dynamically select the frame rate during the shooting process, improving the user’s shooting experience.

Scenario 2: The target parameter is the frame rate, and the main control chip 220 sends the video data to the image processing chip 230 when the image resolution after switching by the image sensor 210 does not support the image resolution corresponding to the target frame rate.

Optionally, the user can adjust the image resolution of the image sensor 210 as required before shooting a video. When the image resolution of the image sensor 210 does not support the image resolution corresponding to the target frame rate, the main control chip 220 sends the video data to the image processing chip 230 . For example, assuming that the image resolution of the image sensor 210 is 720p, and the image resolution corresponding to the target frame rate is 1080p, that is, the image resolution of the image sensor 210 cannot reach the image resolution corresponding to the target frame rate, the current image The video data captured by the sensor 210 is sent to the image processing chip 230 for frame interpolation to generate a higher resolution target video.

In some embodiments, the target frame rate may be the shooting frame rate of the slow-motion video. Before entering the slow-motion shooting mode, the user can switch the image resolution supported by the slow-motion shooting mode. In the case where the electronic device does not have the image processing chip 230, the current image sensor 210 in the slow motion shooting mode only supports an image resolution of 1080p or 720p. When the user adjusts the image resolution corresponding to the target frame rate to 4K, As a result, the image resolution of the current image sensor 210 cannot reach 4K, so the user cannot shoot a slow-motion video with an image resolution of 4K. In the case where the image processing chip 230 is added to the electronic device, the video data captured at the current image resolution of the image sensor 210 is first sent to the image processing chip for frame interpolation. After the image processing chip 230 performs frame interpolation on the video data, it can generate The target video with an image resolution of 4K increases the selection range of image resolution in the slow-motion shooting mode, thereby meeting the image resolution requirements in different shooting modes, realizing more shooting functions and improving shooting flexibility.

In the video processing method provided by the embodiment of the present application, in the case where the image resolution corresponding to the image sensor does not support the image resolution corresponding to the target frame rate, the main control chip sends the video data to the image processing chip for frame insertion, so that the frame can be inserted. Get high-resolution target video, which improves the clarity of the target video.

In some embodiments, when the target parameters include exposure time and frame rate, and when the target parameters of the image sensor meet preset conditions, sending the video data to the image processing chip includes:

In the case that the exposure time satisfies the first preset condition, reducing the frame rate of the image sensor;

In the case that the frame rate satisfies the second preset condition, sending the video data to the image processing chip;

Wherein, the first preset condition is that the exposure time is lower than the first threshold;

The second preset condition is that the frame rate is lower than the second threshold.

Optionally, when the user is shooting or recording, it is first detected whether the environment where the electronic device is located is a dark environment. The exposure time of the image sensor 210 in a dark environment will affect the brightness of the photographed image, and will also cause more noise in the photographed image. Therefore, if it is detected that the environment where the electronic device is located is a dark environment, that is, when the exposure time of the image sensor 210 is lower than the first threshold, the exposure time of the image sensor 210 can be increased by reducing the frame rate. The longer the exposure time, the brighter the shooting picture and the clearer the imaging picture. For example, assuming that the first threshold is 1/100 (seconds/frame), and the current shooting frame rate is 120fps, the exposure time is 1/120 (seconds/frame), that is, the exposure time of the image sensor 210 is lower than the first threshold. At this time, the shooting frame rate can be reduced to 30fps to increase the exposure time to 1/30 (second/frame).

Optionally, the video fluency will be reduced due to the reduction of the shooting frame rate. Therefore, when the frame rate of the image sensor 210 is lower than the second threshold, the main control chip 220 can send the video data captured in a dark environment to the image processing chip 230 for frame interpolation. For example, if the current shooting frame rate is reduced to 30 fps, assuming that the second threshold is 40 fps, then the shooting frame rate of the image sensor is lower than the second threshold, and the shot video data can be sent to the image processing chip 230 . After the image processing chip 230 interpolates the video data, it can not only increase the number of video frames of the target video, but also perform noise reduction processing on each frame, so as to ensure the video brightness and video fluency, and also ensure the video quality. The purity of the screen.

The first threshold may be a preset value or a default value, which is not specifically limited in this embodiment of the present application. The second threshold may be a preset value or a default value, which is not specifically limited in this embodiment of the present application.

In the video processing method provided by the embodiment of the present application, by reducing the frame rate of the image sensor when the exposure time is lower than the first threshold, the exposure time of the image sensor can be appropriately increased to avoid excessive image noise caused by the exposure time being too short. At the same time, it can improve the brightness and purity of the video frame; the image processing chip is used to interpolate the video data shot after the frame rate is reduced, so that the target video maintains a stable frame rate and can reach the target shooting mode according to user needs. frame rate.

In some embodiments, the electronic device may include an AP, an image sensor sensor, and an independent graphics processing chip. As shown in FIG. 4 , the flow of the video processing method provided by the embodiment of the present application may include:

Step 401: The user clicks the video recording button to enter the video shooting mode.

Step 402 , the user can switch sensors, switch frame rates, or switch image sizes on the shooting preview interface. Among them, the image size may correspond to the image resolution.

Step 403: Determine whether the sensor supports the target frame rate. If yes, go to step 404 . If not supported, go to step 405 .

Step 404: The AP saves the target video.

Step 405 , the sensor sends the acquired video data to the independent graphics processing chip, and the independent graphics processing chip inserts frames on the video data, and sends the frame-inserted video data to the AP as the target video.

Step 406 , the AP receives the target video and goes to 404 .

In some embodiments, the electronic device may include an AP, an image sensor sensor, and an independent graphics processing chip. As shown in FIG. 5 , the flow of the video processing method provided by the embodiment of the present application may include:

Step 501: The user clicks the video recording button to enter the video shooting mode.

Step 502: Determine whether the environment where the electronic device is located is a dark environment. If not, go to step 503; if yes, go to step 504.

Step 503: The AP saves the target video.

Step 504, the sensor reduces the shooting frame rate to increase the exposure time.

Step 505: The sensor sends the acquired video data to the independent graphics processing chip, and the independent graphics processing chip performs frame interpolation and noise reduction on the video data, and sends the processed video data to the AP as the target video.

Step 506 , the AP receives the target video, and proceeds to step 503 .

It should be noted that, in the video processing method provided by the embodiments of the present application, the execution body may be a video processing apparatus, or a control module in the video processing apparatus for executing the video processing method. In the embodiments of the present application, a method for performing video processing by a video processing device is used as an example to describe the video processing device provided by the embodiments of the present application.

Embodiments of the present application further provide a video processing apparatus.

As shown in FIG. 6 , the video processing apparatus includes: an acquiring module 610 , a first receiving module 620 and a generating module 630 .

an acquisition module 610, configured to enable the image sensor to acquire video data, and send the video data to the main control chip;

a first receiving module 620, configured to enable the main control chip to receive the video data, and send the video data to the image processing chip when the target parameter of the image sensor meets a preset condition;

A generation module 630, configured to make the image processing chip perform frame insertion on the video data, generate a target video, and send the target video to the main control chip;

Wherein, the target parameter includes at least one of the following: frame rate, image resolution, image sensor type, and exposure time.

In the video processing device provided by the embodiment of the present application, by adding an image processing chip to the electronic device, the main control chip can send the video data obtained by the image sensor to the image processing chip according to the target parameters of the image sensor for frame interpolation, so as to improve the The number of video frames can improve the fluency of the video and optimize the video data; at the same time, it can also meet the requirements of the number of video frames required in different shooting modes, so that more shooting functions can be realized, and the shooting experience of the user can be improved.

In some embodiments, when the target parameter includes any one of the sensor type, the frame rate, and the image resolution, the preset condition is that the target parameter does not support the target frame rate.

In some embodiments, when the target parameter includes the exposure time and the frame rate, the first receiving module 620 is specifically configured to:

In the case that the exposure time satisfies the first preset condition, reducing the frame rate;

sending the video data to the image processing chip under the condition that the frame rate satisfies the second preset condition;

Wherein, the first preset condition is that the exposure time is lower than a first threshold;

The second preset condition is that the frame rate is lower than a second threshold.

In some embodiments, the apparatus further includes:

a second receiving module (not shown in the figure), configured to enable the electronic device to receive the user's first input;

A switching module (not shown in the figure), configured to make the main control chip switch the target parameter in response to the first input.

In some embodiments, the target frame rate is the shooting frame rate of the slow motion video.

The video processing apparatus in this embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The apparatus may be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (personal digital assistant). , PDA), etc., the non-mobile electronic device may be a server, a network attached storage (NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc. The embodiments of the present application There is no specific limitation.

The video processing apparatus in this embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.

The video processing apparatus provided in this embodiment of the present application can implement each process implemented by the method embodiments in FIG. 1 to FIG. 5 , and to avoid repetition, details are not repeated here.

Optionally, as shown in FIG. 7 , an embodiment of the present application further provides an electronic device 700, including a processor 701, a memory 702, a program or instruction stored in the memory 702 and executable on the processor 701, When the program or instruction is executed by the processor 701, each process of the above video processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, details are not described here.

It should be noted that the electronic devices in the embodiments of the present application include the aforementioned mobile electronic devices and non-mobile electronic devices.

FIG. 8 is a schematic diagram of hardware of an electronic device provided by an embodiment of the present application.

The electronic device 800 includes but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, a processor 810 and other components .

Those skilled in the art can understand that the electronic device 800 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 810 through a power management system, so as to manage charging, discharging, and power management through the power management system. consumption management and other functions. The structure of the electronic device shown in FIG. 8 does not constitute a limitation on the electronic device. The electronic device may include more or less components than the one shown, or combine some components, or arrange different components, which will not be repeated here. .

The processor 810 is configured to enable the image sensor to acquire video data and send the video data to the main control chip;

is also used to make the main control chip receive the video data, and send the video data to the image processing chip when the target parameter of the image sensor meets a preset condition;

It is also used to make the image processing chip perform frame insertion on the video data, generate a target video, and send the target video to the main control chip;

Wherein, the target parameter includes at least one of the following: frame rate, image resolution, image sensor type, and exposure time.

In the electronic device provided by the embodiments of the present application, by adding an image processing chip to the electronic device, the main control chip can send the video data acquired by the image sensor to the image processing chip according to the target parameters of the image sensor for frame interpolation, so as to improve the video quality. The number of frames can improve the fluency of the video and optimize the video data; at the same time, it can also meet the requirements of the number of video frames required in different shooting modes, so that more shooting functions can be realized and the shooting experience of users can be improved.

Optionally, when the target parameter includes any one of the sensor type, the frame rate, and the image resolution, the preset condition is that the target parameter does not support the target frame. Rate.

Optionally, the processor 810 is further configured to enable the electronic device to receive the first input of the user;

It is also used to make the main control chip switch the target parameter in response to the first input.

Optionally, the target frame rate is the shooting frame rate of the slow-motion video.

It should be understood that, in this embodiment of the present application, the input unit 804 may include a graphics processor (Graphics Processing Unit, GPU) 8041 and a microphone 8042. camera) to process the image data of still pictures or videos. The display unit 806 may include a display panel 8061, which may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 807 includes a touch panel 8071 and other input devices 8072 . The touch panel 8071 is also called a touch screen. The touch panel 8071 may include two parts, a touch detection device and a touch controller. Other input devices 8072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be described herein again. Memory 809 may be used to store software programs as well as various data, including but not limited to application programs and operating systems. The processor 810 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and application programs, and the like, and the modem processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 810.

Embodiments of the present application further provide a readable storage medium, where a program or an instruction is stored on the readable storage medium. When the program or instruction is executed by a processor, each process of the above video processing method embodiment can be achieved, and the same can be achieved. In order to avoid repetition, the technical effect will not be repeated here.

Wherein, the processor is the processor in the electronic device described in the foregoing embodiments. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

An embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement the above video processing method embodiments. Each process can achieve the same technical effect. In order to avoid repetition, it will not be repeated here.

It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, a system-on-chip, a system-on-a-chip, or a system-on-a-chip, or the like.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in the reverse order depending on the functions involved. To perform functions, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to some examples may be combined in other examples.

From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present application can be embodied in the form of computer software products that are essentially or contribute to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk , CD), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) execute the methods described in the various embodiments of the present application.

The embodiments of the present application have been described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of this application, without departing from the scope of protection of the purpose of this application and the claims, many forms can be made, which all fall within the protection of this application.

Claims (10)

1. A video processing method, applied to electronic equipment, is characterized in that, described electronic equipment comprises: main control chip, image processing chip and image sensor, the first interface of described main control chip is electrically connected with described image processing chip. connected, the second interface of the main control chip is electrically connected to the image sensor; the method includes: The image sensor acquires video data, and sends the video data to the main control chip; The main control chip receives the video data, and sends the video data to the image processing chip when the target parameter of the image sensor meets a preset condition; The image processing chip inserts frames on the video data, generates a target video, and sends the target video to the main control chip; Wherein, the target parameter includes at least one of the following: frame rate, image resolution, image sensor type, and exposure time. 2 . The video processing method according to claim 1 , wherein when the target parameter includes any one of the sensor type, the frame rate, and the image resolution, the pre- Let the condition be that the target parameter does not support the target frame rate. 3 . The video processing method according to claim 1 , wherein, when the target parameter includes the exposure time and the frame rate, the target parameter on the image sensor satisfies a preset condition. 4 . In the case of sending the video data to the image processing chip, including: In the case that the exposure time satisfies the first preset condition, reducing the frame rate; sending the video data to the image processing chip under the condition that the frame rate satisfies the second preset condition; Wherein, the first preset condition is that the exposure time is lower than a first threshold; The second preset condition is that the frame rate is lower than a second threshold. 4. The video processing method according to claim 1, wherein after the main control chip receives the video data, it further comprises: the electronic device receives the user's first input; The main control chip switches the target parameter in response to the first input. 5 . The video processing method according to claim 2 , wherein the target frame rate is the shooting frame rate of the slow-motion video. 6 . 6. A video processing apparatus, characterized in that, applied to the electronic device as claimed in claim 1, the apparatus comprising: an acquisition module, configured to enable the image sensor to acquire video data and send the video data to the main control chip; a first receiving module, configured to enable the main control chip to receive the video data, and send the video data to the image processing chip when the target parameter of the image sensor meets a preset condition; A generation module, configured to make the image processing chip perform frame insertion on the video data, generate a target video, and send the target video to the main control chip; Wherein, the target parameter includes at least one of the following: frame rate, image resolution, image sensor type, and exposure time. 7 . The video processing apparatus according to claim 6 , wherein, when the target parameter includes any one of the sensor type, the frame rate, and the image resolution, the preset Let the condition be that the target parameter does not support the target frame rate. 8 . The video processing apparatus according to claim 6 , wherein, when the target parameter includes the exposure time and the frame rate, the first receiving module is specifically configured to: In the case that the exposure time satisfies the first preset condition, reducing the frame rate; sending the video data to the image processing chip under the condition that the frame rate satisfies the second preset condition; Wherein, the first preset condition is that the exposure time is lower than a first threshold; The second preset condition is that the frame rate is lower than a second threshold. 9. An electronic device, characterized in that it comprises a processor and a memory, wherein the memory stores a program or an instruction that can be run on the processor, and when the program or instruction is executed by the processor, the implementation as claimed in the claims Steps of the video processing method described in any one of 1-5. 10. A readable storage medium, wherein a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the video processing according to any one of claims 1-5 is realized steps of the method.

Images