CN117336611A - Video image processing circuit, method and electronic equipment - Google Patents
Video image processing circuit, method and electronic equipment Download PDFInfo
- Publication number
- CN117336611A CN117336611A CN202311271806.XA CN202311271806A CN117336611A CN 117336611 A CN117336611 A CN 117336611A CN 202311271806 A CN202311271806 A CN 202311271806A CN 117336611 A CN117336611 A CN 117336611A
- Authority
- CN
- China
- Prior art keywords
- image data
- video image
- processing
- video
- shake
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 466
- 238000000034 method Methods 0.000 title claims description 41
- 238000003672 processing method Methods 0.000 claims abstract description 23
- 230000000694 effects Effects 0.000 claims description 47
- 238000004891 communication Methods 0.000 claims description 15
- 238000011282 treatment Methods 0.000 claims description 9
- 230000005540 biological transmission Effects 0.000 claims description 7
- 238000005491 wire drawing Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 description 18
- 230000033001 locomotion Effects 0.000 description 13
- 230000006870 function Effects 0.000 description 10
- 238000012937 correction Methods 0.000 description 6
- 230000009467 reduction Effects 0.000 description 6
- 238000012805 post-processing Methods 0.000 description 5
- 238000003780 insertion Methods 0.000 description 4
- 230000037431 insertion Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003139 buffering effect Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/682—Vibration or motion blur correction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/32—Transforming X-rays
- H04N5/321—Transforming X-rays with video transmission of fluoroscopic images
- H04N5/325—Image enhancement, e.g. by subtraction techniques using polyenergetic X-rays
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
Abstract
The application discloses a video image processing circuit, a video image processing method and electronic equipment, and belongs to the technical field of image processing. The circuit is applied to the central processing chip and comprises an image signal processor, wherein the image signal processor is used for outputting the acquired first video image data to the image processing chip through the display processing unit; the anti-shake algorithm module is used for carrying out first anti-shake processing on the enhanced image data to generate second video image data to be previewed; performing second anti-shake processing on the enhanced image data to generate third video image data to be stored; the enhanced image data is obtained by performing image enhancement processing on the first video image; the display processing unit is used for acquiring the second video image data output by the anti-shake algorithm module and transmitting the second video image data to the display screen; and the video encoder is used for acquiring the third video image data output by the anti-shake algorithm module and transmitting the third video image data to the memory for storage.
Description
Technical Field
The application belongs to the technical field of image processing, and particularly relates to a video image processing circuit, a video image processing method and electronic equipment.
Background
Currently, with the development of camera technology, users have an increasing demand for video recording using electronic devices in daily life. The video recording function in the existing camera cannot be processed by overlapping complex effect algorithms in the recording process due to the fact that the overall power consumption in the recording process is too high, so that a user needs to use a post-video making tool to post-process the recorded video after the video is recorded, the operation is complex, and a large amount of time is consumed.
Disclosure of Invention
The embodiment of the application aims to provide a video image processing circuit, a video image processing method and electronic equipment, which can solve the problems that the existing post-video manufacturing operation is complex and time-consuming.
In a first aspect, embodiments of the present application provide a video image processing circuit applied to a central processing chip, the circuit including: the device comprises an image signal processor, a display processing unit, a video encoder and an anti-shake algorithm module; wherein,
the image signal processor is used for outputting the acquired first video image data to the image processing chip through the display processing unit;
the anti-shake algorithm module is used for acquiring the enhanced image data output by the image processing chip, performing first anti-shake processing on the enhanced image data, and generating second video image data to be previewed; performing second anti-shake processing on the enhanced image data to generate third video image data to be stored; the enhanced image data is obtained after image enhancement processing is carried out on the first video image;
The display processing unit is used for acquiring the second video image data output by the anti-shake algorithm module and transmitting the second video image data to a display screen;
the video encoder is used for acquiring the third video image data output by the anti-shake algorithm module and transmitting the third video image data to a memory for storage
In a second aspect, an embodiment of the present application provides a video image processing method, applied to a central processing chip, where the method includes:
outputting the acquired first video image data to an image processing chip;
the method comprises the steps of obtaining enhanced image data output by the image processing chip, wherein the enhanced image data is obtained after image enhancement processing is carried out on the first video image;
performing first anti-shake processing on the enhanced image data to generate second video image data to be previewed; performing second anti-shake processing on the enhanced image data to generate third video image data to be stored;
and transmitting the second video image data to a display screen, and transmitting the third video image data to a memory for storage.
In a third aspect, embodiments of the present application provide a video image processing circuit, including: the image processing device comprises an image sensor, a central processing chip, an image processing chip and a memory; wherein,
The image sensor is used for acquiring a first video image and outputting the first video image to the central processing chip;
the central processing chip is used for outputting the first video image to the image processing chip;
the image processing chip is used for carrying out image enhancement processing on the first video image to obtain enhanced image data, and outputting the enhanced image data to the central processing chip;
the central processing chip is also used for performing first anti-shake processing on the enhanced image data to generate second video image data to be previewed; performing second anti-shake processing on the enhanced image data to generate third video image data to be stored; and outputting the second video image data to a display screen, and outputting the third video image data to the memory after encoding.
In a fourth aspect, embodiments of the present application provide an electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the method as described in the second aspect.
In a fifth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor implement the steps of the method according to the second aspect.
In a sixth aspect, embodiments of the present application provide a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement a method according to the second aspect.
In a seventh aspect, embodiments of the present application provide a computer program product stored in a storage medium, the program product being executable by at least one processor to implement the method according to the second aspect.
In an embodiment of the present application, a video image processing circuit includes: the device comprises an image signal processor, a display processing unit, a video encoder and an anti-shake algorithm module; the image signal processor is used for outputting the acquired first video image data to the image processing chip through the display processing unit; the anti-shake algorithm module is used for acquiring the enhanced image data output by the image processing chip, performing first anti-shake processing on the enhanced image data and generating second video image data to be previewed; performing second anti-shake processing on the enhanced image data to generate third video image data to be stored; the enhanced image data is obtained by performing image enhancement processing on the first video image; the display processing unit is used for acquiring second video image data output by the anti-shake algorithm module and transmitting the second video image data to the display screen; and the video encoder is used for acquiring the third video image data output by the anti-shake algorithm module and transmitting the third video image data to the memory for storage. Therefore, on one hand, the image processing chip positioned outside the central processing chip can be used for carrying out real-time enhancement processing on video image data, and on the other hand, two paths of different anti-shake processing are respectively carried out on the enhancement image data output by the image processing chip, one path of the enhancement image data is used for real-time preview, and the other path of enhancement image data is used for being checked and used by a user after being stored, so that the user can preview and store the processed video image data in real time without complex and time-consuming post-processing operation.
Drawings
Fig. 1 is a schematic diagram of a video processing architecture according to an embodiment of the present application;
FIG. 2 is one of the flowcharts of a video image processing method provided in an embodiment of the present application;
FIG. 3 is a second flowchart of a video image processing method according to an embodiment of the present disclosure;
fig. 4 is a block diagram of an electronic device according to an embodiment of the present application.
Fig. 5 is a schematic hardware structure of an electronic device according to an embodiment of the present application.
Detailed Description
Technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of the protection of the present application.
The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.
The video image processing method provided by the embodiment of the application is described in detail below by means of specific embodiments and application scenes thereof with reference to the accompanying drawings.
Referring to fig. 1, an embodiment of the present application provides a video image processing circuit, applied to a central processing chip, including: an image signal processor (Image Signal Processing, ISP), a display processing unit, a video encoder and an anti-shake algorithm module; wherein,
an image signal processor for outputting the acquired first video image data to an image processing chip through a display processing unit;
the anti-shake algorithm module is used for acquiring the enhanced image data output by the image processing chip, performing first anti-shake processing on the enhanced image data and generating second video image data to be previewed; performing second anti-shake processing on the enhanced image data to generate third video image data to be stored; the enhanced image data is obtained after image enhancement processing is carried out on the first video image;
the display processing unit is used for acquiring the second video image data output by the anti-shake algorithm module and transmitting the second video image data to a display screen;
And the video encoder is used for acquiring the third video image data output by the anti-shake algorithm module and transmitting the third video image data to a memory for storage.
In the specific implementation, after the real-time image is collected by the image sensor and converted into a digital signal, the digital signal is output to an image signal processor (Image Signal Processing, ISP) in the central processing chip as first video image data, the ISP performs basic effect processing on the first video image data, then the first video image data after the basic effect processing is output to a display processing unit in the central processing chip, the processed first video image data is converted into RGB data by the display processing unit and then is output to the image processing chip, and then the image processing chip performs enhanced image processing on the RGB data.
Optionally, the image enhancement processing includes, but is not limited to, at least one of: the dynamic range is improved, noise reduction, frame insertion, super division, sharpening, clipping and color correction are realized.
Here, the enhanced image data output from the image processing chip is divided into two paths, one for performing the first anti-shake processing and the other for performing the second anti-shake processing.
Optionally, the first anti-shake processing is anti-shake processing based on a single frame image, and the second anti-shake processing is anti-shake processing based on a buffered multi-frame image. The first anti-shake processing based on the single frame image does not need to calculate the motion trend of the object according to the front image frame and the rear image frame, so that the anti-shake effect is limited; the second anti-shake processing based on the multi-frame images utilizes the multi-frame anti-shake algorithm to calculate the movement trend of the object according to the front and back image frames, has better anti-shake effect, but has larger calculated amount and larger generated time delay, and is not suitable for real-time preview.
In the above embodiment, the image processing chip located outside the central processing chip is used to implement real-time enhancement processing on the video image data, and two paths of different anti-shake processing are respectively performed on the enhancement image data output by the image processing chip through the central processing chip, so that one path of the enhancement image data is used for real-time preview, and the other path of enhancement image data is used for being saved for viewing and using by a user, thus, the user can preview in real time and obtain the processed video image data without performing complex and time-consuming post-processing operations.
In some embodiments, the image signal processor is specifically configured to:
Performing basic effect processing on the first video image data to generate metadata of image parameters and two paths of processed first video image data;
transmitting the first video image data of which one path is processed to the image processing chip through the display processing unit;
and outputting the other path of processed metadata of the first video image data transmission and the image parameters to the encoder as a video file to be stored.
In specific implementation, an image signal processor integrated in a central processing chip is used for performing basic effect processing (such as white balance, noise reduction and the like) on an original RAW image (first video image data) acquired by an image sensor, the RAW format image is further converted into a YUV format video image, the first video image data processed by the image signal processor can be divided into two paths of video images, one path of video image data is used as original video data to be output to an encoder as a video file to be stored, and the other path of video image data is used as a video image to be processed to be output to an image processing chip.
In this embodiment, the image processing chip performs enhancement processing on the obtained original video image data (i.e., the first video image data), and additionally stores the original video image data, so that the user can perform post editing modification on the original video image as required.
In some embodiments, the anti-shake algorithm module is further configured to obtain an anti-shake parameter obtained by performing the second anti-shake processing on the enhanced image data; outputting the anti-shake parameter to the encoder;
the encoder is further configured to encode the first video image data, metadata of the image parameters, and the anti-shake parameters, generate a first encoded file, and output the first encoded file to the memory for storage.
Optionally, the anti-shake parameters include: and (5) a distortion correction matrix.
When the method is specifically implemented, the anti-shake algorithm module comprises a video anti-shake algorithm sub-module and a preview anti-shake sub-module, wherein the video anti-shake algorithm module firstly caches the enhanced image data after receiving the enhanced image data obtained through processing of the image processing chip, then carries out estimation of image motion trend on cached multi-frame images after caching video images with specified number (such as 30 frames), and carries out better anti-shake processing according to the estimated motion trend. And then transmitting the video image subjected to the second anti-shake processing and the calculated anti-shake parameters to an encoder.
In this embodiment, the metadata of the first video image data, the metadata of the image parameters and the anti-shake parameters obtained through the second anti-shake processing are encoded together to generate the first encoded file and stored, so that when the user edits the original video image in a later period, the anti-shake parameters corresponding to the original video image and the metadata of the image parameters can be directly obtained, the video image does not need to be cached and the anti-shake parameters are recalculated through an anti-shake algorithm, and the original video does not need to be subjected to basic effect processing through an image signal processor, so that the time can be reduced and the preview delay in the image editing process can be improved.
In some embodiments, performing image enhancement processing on the first video image data includes at least one of:
blurring the background except the portrait in the first video image data;
carrying out face beautifying treatment on the portrait in the first video image data;
spot processing is carried out on the point light sources in the first video image data;
performing wiredrawing processing on point light sources in the first video image data;
performing first filter processing on the portrait in the first video image data;
and performing second filter processing on the background except the portrait in the first video image data.
In the embodiment, the image processing chip performs blurring processing on the background except the portrait in the first video image data, so that the blurring effect of the movie portrait can be realized; the face-beautifying effect of the movie face-beautifying effect can be realized by carrying out face-beautifying treatment on the face in the first video image data; spot processing is carried out on the point light sources in the first video image data, so that a film spot effect can be realized; the movie filter effect can be realized by separating the human scenes in the first video image data and respectively carrying out different filter treatments on the background, the skin color and the like; by performing a drawing process on the point light source in the first video image data, a movie drawing effect can be achieved.
In some embodiments, the display processing unit is specifically configured to:
transmitting the second video image data to the display screen through a first channel; the first channel comprises the display processing unit, and the display processing unit is directly connected with the display screen; or,
transmitting the second video image data to the display screen through a second channel; the second channel comprises the display processing unit and the image processing chip, the display processing unit is in communication connection with the image processing chip, and the image processing chip is in communication connection with the display screen.
In this embodiment, in the case where the display processing unit is directly connected to the display screen, the second video image processing may be transmitted to the display screen through the display processing unit for preview display; and under the condition that the image processing chip is directly connected with the display screen and the display processing unit is connected with the image processing chip, the second video image data is sent to the image processing chip through the display processing unit, and the second video image data is sent to the display screen through the image processing chip for preview display.
In some embodiments, the video encoder is specifically configured to:
encoding the third video image data to obtain a second encoded file;
and transmitting the second coded file to the memory for storage.
In this embodiment, the video image obtained through the image processing chip and the video anti-shake algorithm (second anti-shake processing) is encoded and stored for the user to view in real time.
In some embodiments, the first video image output by the image processing chip is subjected to electronic anti-shake processing by the software anti-shake algorithm module, and two paths of video images are output; one path of video image is sent to an encoder for encoding and storing; and sending the other path of video image to an image processing chip through the DPU for image processing to obtain enhanced image data. Further, the enhanced image data processed by the image processing chip is transmitted back to the central processing chip.
Referring to fig. 1, an embodiment of the present application provides a video image processing circuit, including: the image processing device comprises an image sensor, a central processing chip, an image processing chip and a memory; wherein,
the image sensor is used for acquiring a first video image and outputting the first video image to the central processing chip;
The central processing chip is used for outputting the first video image to the image processing chip;
the image processing chip is used for carrying out image enhancement processing on the first video image to obtain enhanced image data, and outputting the enhanced image data to the central processing chip;
the central processing chip is also used for performing first anti-shake processing on the enhanced image data to generate second video image data to be previewed; performing second anti-shake processing on the enhanced image data to generate third video image data to be stored; and outputting the second video image data to a display screen, and outputting the third video image data to the memory after encoding.
When the method is specifically implemented, the image sensor is used for acquiring a real-time image and converting the real-time image into a digital signal, the digital signal is used as first video image data to be output to the central processing chip, the central processing chip is used for carrying out basic effect processing on the first video image data, then the first video image data after the basic effect processing is output to the image processing chip, and the image processing chip is used for carrying out enhanced image processing on RGB data. Optionally, the image enhancement processing includes, but is not limited to, at least one of: the dynamic range is improved, noise reduction, frame insertion, super division, sharpening, clipping and color correction are realized.
Optionally, the first anti-shake processing is anti-shake processing based on a single frame image, and the second anti-shake processing is anti-shake processing based on a buffered multi-frame image. The first anti-shake processing based on the single frame image does not need to calculate the motion trend of the object according to the front image frame and the rear image frame, so that the anti-shake effect is limited; the second anti-shake processing based on the multi-frame images utilizes the multi-frame anti-shake algorithm to calculate the movement trend of the object according to the front and back image frames, has better anti-shake effect, but has larger calculated amount and larger generated time delay, and is not suitable for real-time preview.
In the above embodiment, the image processing chip located outside the central processing chip is used to implement real-time enhancement processing on the video image data, and two paths of different anti-shake processing are respectively performed on the enhancement image data output by the image processing chip through the central processing chip, so that one path of the enhancement image data is used for real-time preview, and the other path of enhancement image data is used for being saved for viewing and using by a user, thus, the user can preview in real time and obtain the processed video image data without performing complex and time-consuming post-processing operations.
In some embodiments, the central processing chip is further specifically configured to:
Performing basic effect processing on the first video image data to generate metadata of image parameters and two paths of processed first video image data;
transmitting the first video image data of which one path is processed to the image processing chip;
and taking the other path of processed metadata of the first video image data transmission and the image parameters as a video file to be stored for encoding processing.
In this embodiment, the image processing chip performs enhancement processing on the obtained original video image data (i.e., the first video image data), and additionally stores the original video image data, so that the user can perform post editing modification on the original video image as required.
In some embodiments, the central processing chip is further specifically configured to:
obtaining an anti-shake parameter obtained by performing the second anti-shake processing on the enhanced image data;
and carrying out coding processing on the first video image data, the metadata of the image parameters and the anti-shake parameters to generate a first coding file, and outputting the first coding file to the memory.
In this embodiment, the metadata of the first video image data, the metadata of the image parameters and the anti-shake parameters obtained through the second anti-shake processing are encoded together to generate the first encoded file and stored, so that when the user edits the original video image in a later period, the anti-shake parameters corresponding to the original video image and the metadata of the image parameters can be directly obtained, the video image does not need to be cached and the anti-shake parameters are recalculated through an anti-shake algorithm, and the original video does not need to be subjected to basic effect processing through an image signal processor, so that the time can be reduced and the preview delay in the image editing process can be improved.
In some embodiments, the central processing chip is further specifically configured to:
transmitting the second video image data to the display screen through a first channel; wherein the central processing chip is directly connected with the display screen; or,
transmitting the second video image data to the display screen through a second channel; the central processing chip is connected with the image processing chip, and the image processing chip is connected with the display screen.
In this embodiment, in the case that the central processing chip is directly connected to the display screen, the second video image processing may be directly transmitted to the display screen through the central processing chip for preview display; and under the condition that the image processing chip is directly connected with the display screen, the central processing chip is connected with the image processing chip, the central processing chip sends the second video image data to the image processing chip, and the image processing chip sends the second video image data to the display screen for preview display.
Referring to fig. 2, an embodiment of the present application provides a video image processing method, applied to a central processing chip, including the following steps:
Step 101: and outputting the acquired first video image data to an image processing chip.
Optionally, after the image sensor collects the real-time image and converts the real-time image into a digital signal, the digital signal is output to the central processing chip as the first video image data.
Specifically, the first video image data is obtained through the image sensor and is output to an image signal processor (Image Signal Processing, ISP) of the central processing chip, the ISP carries out basic effect processing on the first video image data, then the first video image data after basic effect processing is output to a display processing unit in the central processing chip, the processed first video image data is converted into RGB data through the display processing unit and is output to the image processing chip, and the image processing chip carries out enhanced image processing on the RGB data.
Step 102: and obtaining enhanced image data output by the image processing chip, wherein the enhanced image data is obtained after the image enhancement processing is carried out on the first video image.
Optionally, the image enhancement processing includes, but is not limited to, at least one of: the dynamic range is improved, noise reduction, frame insertion, super division, sharpening, clipping and color correction are realized.
Optionally, the performing image enhancement processing on the first video image data includes at least one of:
blurring the background except the portrait in the first video image data;
carrying out face beautifying treatment on the portrait in the first video image data;
spot processing is carried out on the point light sources in the first video image data;
performing wiredrawing processing on point light sources in the first video image data;
performing first filter processing on the portrait in the first video image data;
and performing second filter processing on the background except the portrait in the first video image data.
In the step, the image processing chip performs blurring processing on the background except the portrait in the first video image data, so that the blurring effect of the movie portrait can be realized; the face-beautifying effect of the movie face-beautifying effect can be realized by carrying out face-beautifying treatment on the face in the first video image data; spot processing is carried out on the point light sources in the first video image data, so that a film spot effect can be realized; the movie filter effect can be realized by separating the human scenes in the first video image data and respectively carrying out different filter treatments on the background, the skin color and the like; by performing a drawing process on the point light source in the first video image data, a movie drawing effect can be achieved.
Step 103: performing first anti-shake processing on the enhanced image data to generate second video image data to be previewed; and performing second anti-shake processing on the enhanced image data to generate third video image data to be stored.
Here, the enhanced image data output from the image processing chip is divided into two paths, one for performing the first anti-shake processing and the other for performing the second anti-shake processing.
Optionally, the first anti-shake processing is anti-shake processing based on a single frame image, and the second anti-shake processing is anti-shake processing based on a buffered multi-frame image. The first anti-shake processing based on the single frame image does not need to calculate the motion trend of the object according to the front image frame and the rear image frame, so that the anti-shake effect is limited; the second anti-shake processing based on the multi-frame images utilizes the multi-frame anti-shake algorithm to calculate the movement trend of the object according to the front and back image frames, has better anti-shake effect, but has larger calculated amount and larger generated time delay, and is not suitable for real-time preview.
Step 104: and transmitting the second video image data to a display screen, and transmitting the third video image data to a memory for storage.
In the above embodiment, the image processing chip located outside the central processing chip is used to implement real-time enhancement processing on the video image data, and two paths of different anti-shake processing are respectively performed on the enhancement image data output by the image processing chip through the central processing chip, so that one path of the enhancement image data is used for real-time preview, and the other path of enhancement image data is used for being saved for viewing and using by a user, thus, the user can preview in real time and obtain the processed video image data without performing complex and time-consuming post-processing operations.
In some embodiments, the central processing chip includes: an image signal processor, a display processing unit, and an encoder; in the step 101, outputting the acquired first video image data to the image processing chip includes:
performing basic effect processing on the first video image data through the image signal processor to generate metadata of image parameters and two paths of processed first video image data;
transmitting the first video image data of which one path is processed to the image processing chip through the display processing unit;
and outputting the other path of processed metadata of the first video image data transmission and the image parameters to the encoder as a video file to be stored.
In specific implementation, an image signal processor integrated in a central processing chip is used for performing basic effect processing (such as white balance, noise reduction and the like) on an original RAW image (first video image data) acquired by an image sensor, the RAW format image is further converted into a YUV format video image, the first video image data processed by the image signal processor can be divided into two paths of video images, one path of video image data is used as original video data to be output to an encoder as a video file to be stored, and the other path of video image data is used as a video image to be processed to be output to an image processing chip.
In this embodiment, the image processing chip performs enhancement processing on the obtained original video image data (i.e., the first video image data), and additionally stores the original video image data, so that the user can perform post editing modification on the original video image as required.
In some embodiments, after performing the second anti-shake processing on the enhanced image data to generate the third video image data to be stored, the method further includes:
obtaining an anti-shake parameter obtained by performing the second anti-shake processing on the enhanced image data;
outputting the anti-shake parameters to the encoder, and encoding the first video image data, the metadata of the image parameters and the anti-shake parameters through the encoder to generate a first encoded file;
And outputting the first coded file to the memory for storage.
Optionally, the anti-shake parameters include: and (5) a distortion correction matrix.
In specific implementation, the central processing chip comprises a video anti-shake algorithm module, after receiving the enhanced image data processed by the image processing chip, the video anti-shake algorithm module caches the enhanced image data, and after caching video images with specified number (such as 30 frames), carries out estimation of image motion trend on the cached multi-frame images, and carries out better anti-shake processing according to the estimated motion trend. And then transmitting the video image subjected to the second anti-shake processing and the calculated anti-shake parameters to an encoder.
In this embodiment, the metadata of the first video image data, the metadata of the image parameters and the anti-shake parameters obtained through the second anti-shake processing are encoded together to generate the first encoded file and stored, so that when the user edits the original video image in a later period, the anti-shake parameters corresponding to the original video image and the metadata of the image parameters can be directly obtained, the video image does not need to be cached and the anti-shake parameters are recalculated through an anti-shake algorithm, and the original video does not need to be subjected to basic effect processing through an image signal processor, so that the time can be reduced and the preview delay in the image editing process can be improved.
In some embodiments, the central processing chip includes: a display processing unit; the transmitting the second video image data to a display screen includes:
transmitting the second video image data to the display screen through the display processing unit of the first channel; the first channel comprises the display processing unit, and the display processing unit is directly connected with the display screen; or,
transmitting the second video image data to the display screen through a second channel; the second channel comprises the display processing unit and the image processing chip, the display processing unit is in communication connection with the image processing chip, and the image processing chip is in communication connection with the display screen.
In this embodiment, in the case where the display processing unit is directly connected to the display screen, the second video image processing may be transmitted to the display screen through the display processing unit for preview display; and under the condition that the image processing chip is directly connected with the display screen and the display processing unit is connected with the image processing chip, the second video image data is sent to the image processing chip through the display processing unit, and the second video image data is sent to the display screen through the image processing chip for preview display.
In some embodiments, the central processing chip includes an encoder; the transmitting the third video image data to a memory for storage includes:
encoding the third video image data through the encoder to obtain a second encoded file;
and transmitting the second coded file to the memory for storage.
In this embodiment, the video image obtained through the image processing chip and the video anti-shake algorithm (second anti-shake processing) is encoded and stored for the user to view in real time.
The following describes the video image processing method shown in fig. 3 in conjunction with the video processing system architecture shown in fig. 1.
As in fig. 1, the central processing chip includes: and a Central Processing Unit (CPU), an Image Signal Processor (ISP), a Display Processor (DPU), a video encoder and other on-chip integrated chips of each functional module, wherein the CPU comprises a preview anti-shake algorithm module and a video anti-shake algorithm module. The image sensor is connected with an Image Signal Processor (ISP), the Image Signal Processor (ISP) is respectively connected with a Display Processor (DPU) and the encoder, and the Display Processor (DPU) is connected with the image processing chip; the external image processing chip is connected with the display screen; the output end of the preview anti-shake algorithm is connected with the input end of the display processing unit; the output end of the video anti-shake algorithm is connected with the input end of the encoder; the output end of the image processor is connected with an MIPI CSI interface of the central processing chip, and the MIPI CSI interface is respectively connected with the input ends of the preview anti-shake algorithm module and the video anti-shake algorithm module; the encoder is connected with the memory.
The image signal processor ISP is used for performing basic effect processing on the digital image; the display processing unit is used for converting the image data into RGB data and transmitting the RGB data to an external display device (such as an LCD display screen); the image processing chip is used for carrying out enhancement processing on the digital image and can comprise image processing such as dynamic range improvement, noise reduction, frame insertion, super division, sharpening, clipping, color correction and the like; the image sensor is used for acquiring real-time images and converting the real-time images into digital signals; the display screen is used for displaying the data image; a video/picture encoder for encoding video data or a single image; and the memory is used for storing video data.
As in fig. 3, the video image processing method includes the steps of:
step 201, the user turns on the camera and enters a recording/photographing mode, and clicks a button to start recording/photographing.
Step 202, an image sensor collects images and transmits the images to an image signal processor ISP through real-time images.
And 203, performing basic effect processing on the original image acquired by the image sensor by the ISP.
Specifically, the image signal processor performs basic effect processing on an original RAW image acquired by the sensor, and converts a video image in a RAW format into a video image in a YUV format.
The video image processed by the ISP is divided into two paths, and one path of video image is transmitted to an encoder for encoding and storage; and the other video image is sent to the image processing chip through the DPU.
And 204, the encoder encodes and stores the original video image which is not processed by the image chip and the element number of the image parameter together with the anti-shake parameter output by the video anti-shake algorithm.
In the step, the original video which is not processed by the external chip is encoded and stored into a video file together with metadata of image parameters and anti-shake parameters output by the video anti-shake algorithm, and when a user performs a video post-editing function in a later period, the original image, the image metadata and the video anti-shake parameters are acquired from the original video file and subjected to real-time post-editing processing.
Step 205, the video image is sent to the DPU and sent to the image processing chip through the DPU.
And 206, performing movie effect processing on the received image by the image processing chip, and transmitting the processed image back to the central processing chip through the MIPI interface.
Specifically, the image processing chip is used for carrying out real-time background blurring, face-beautifying, film facula, film wire drawing, film filter and other film effect processing on the received video image, after the processing is finished, the image is transmitted back to the central processing chip through the MIPI interface, and the data of the external image processing chip are divided into two paths through the MIPI CSI interface, one path is transmitted to the preview anti-shake algorithm, and the other path is transmitted to the video anti-shake algorithm.
Step 207, the video anti-shake algorithm performs multi-frame incremental anti-shake processing (second anti-shake processing) on the video image, and outputs the video image and the anti-shake parameters to the encoder
After receiving video images, the video anti-shake algorithm firstly caches the images without processing, after collecting video images with a specified number (such as 30 frames), carries out estimation of image motion trend on cached multi-frame images, and carries out better anti-shake processing according to the estimated motion trend. And then the image subjected to video anti-shake processing and video anti-shake parameters calculated by an algorithm are sent to a video encoder together.
The main purpose of storing the anti-shake parameters of the video is as follows: when the user performs post-editing, the anti-shake parameters corresponding to the original image can be directly obtained, the software anti-shake algorithm is not required to buffer the image and recalculate the anti-shake parameters, the processing time of the anti-shake algorithm is shortened, and the preview time delay in image editing is improved.
Step 208, the video/photo encoder encodes and saves the video image.
And encoding and storing the video image processed by the external image processing chip and the video anti-shake algorithm for a user to check in real time.
Step 209, the preview anti-shake algorithm performs a basic anti-shake process (a first anti-shake process) of a single frame image on the video image.
Specifically, the preview anti-shake algorithm performs anti-shake processing on a single frame image of a received video image, but does not perform anti-shake processing according to motion trend estimation of multiple frames of images after buffering the preview image.
It should be noted that the reason why the basic anti-shake processing of a single frame image is performed on a preview video image is that: because the user pays more attention to the experience of preview delay when video previewing, if the preview image is subjected to frame buffering, the preview delay of the video image is increased, and the user experience is seriously affected.
Step 210, the DPU sends the video image to the screen for real-time preview display.
In the above embodiment, the low-power consumption external image processing chip is used to replace complex high-power consumption software algorithm processing, so that the video image is subjected to increased anti-shake processing while the external image processing chip is used to perform background blurring, face-beautifying, film facula, film wire drawing, film filter and other film feel effect processing on the real-time video image, and the video anti-shake experience is improved.
According to the video image processing method provided by the embodiment of the application, the execution subject can be a video image processing device. In the embodiment of the present application, a video image processing apparatus is described by taking a video image processing method performed by the video image processing apparatus as an example.
Optionally, as shown in fig. 4, the embodiment of the present application further provides an electronic device 400, including a processor 401 and a memory 402, where the memory 402 stores a program or an instruction that can be executed on the processor 401, and the program or the instruction implements each step of the embodiment of the video image processing method when executed by the processor 401, and the steps achieve the same technical effects, so that repetition is avoided, and no further description is given here.
The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 5 is a schematic hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 500 includes, but is not limited to: radio frequency unit 501, network module 502, audio output unit 503, input unit 504, sensor 505, display unit 506, user input unit 507, interface unit 508, memory 509, and processor 510.
Those skilled in the art will appreciate that the electronic device 500 may further include a power source (e.g., a battery) for powering the various components, and that the power source may be logically coupled to the processor 510 via a power management system to perform functions such as managing charging, discharging, and power consumption via the power management system. The electronic device structure shown in fig. 5 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than shown, or may combine certain components, or may be arranged in different components, which are not described in detail herein.
Wherein, the processor 510 (i.e. the central processing chip) is configured to output the acquired first video image data to the image processing chip;
the method comprises the steps of obtaining enhanced image data output by the image processing chip, wherein the enhanced image data is obtained after image enhancement processing is carried out on the first video image;
performing first anti-shake processing on the enhanced image data to generate second video image data to be previewed; performing second anti-shake processing on the enhanced image data to generate third video image data to be stored;
the second video image data is transferred to the display screen and the third video image data is transferred to the memory 509 for storage.
Optionally, the central processing chip includes: an image signal processor, a display processing unit, and an encoder; a processor (i.e., central processing chip) 510 for: performing basic effect processing on the first video image data through the image signal processor to generate metadata of image parameters and two paths of processed first video image data; transmitting the first video image data of which one path is processed to the image processing chip through the display processing unit; and outputting the other path of processed metadata of the first video image data transmission and the image parameters to the encoder as a video file to be stored.
Optionally, the processor (i.e. the central processing chip) 510 is further configured to: obtaining an anti-shake parameter obtained by performing the second anti-shake processing on the enhanced image data; outputting the anti-shake parameters to the encoder, and encoding the first video image data, the metadata of the image parameters and the anti-shake parameters through the encoder to generate a first encoded file; the first encoded file is output to the memory 509 for storage.
Optionally, the first anti-shake processing is anti-shake processing based on a single frame image; the second anti-shake processing is to perform anti-shake processing based on the cached multi-frame images.
Optionally, the performing image enhancement processing on the first video image data includes at least one of:
blurring the background except the portrait in the first video image data;
carrying out face beautifying treatment on the portrait in the first video image data;
spot processing is carried out on the point light sources in the first video image data;
performing wiredrawing processing on point light sources in the first video image data;
performing first filter processing on the portrait in the first video image data;
And performing second filter processing on the background except the portrait in the first video image data.
Optionally, the central processing chip includes: a display processing unit; a processor (i.e., central processing chip) 510 for:
transmitting the second video image data to the display screen through a first channel; the first channel comprises the display processing unit, and the display processing unit is directly connected with the display screen; or,
transmitting the second video image data to the display screen through a second channel; the second channel comprises the display processing unit and the image processing chip, the display processing unit is in communication connection with the image processing chip, and the image processing chip is in communication connection with the display screen.
Optionally, a processor (i.e. a central processing chip) 510 is configured to perform encoding processing on the third video image data by using the encoder to obtain a second encoded file;
and transmitting the second coded file to the memory for storage.
In the electronic device 500 provided in the above embodiment, the image processing chip located outside the central processing chip is used to implement real-time enhancement processing on video image data, and two different anti-shake processes are respectively performed on the enhancement image data output by the image processing chip through the central processing chip, one path of enhancement image data is implemented for real-time preview, and the other path of enhancement image data is stored for a user to view and use, so that the user can preview and use the processed video image data in real time without performing complicated and time-consuming post-processing operations.
It should be appreciated that in embodiments of the present application, the input unit 504 may include a graphics processor (Graphics Processing Unit, GPU) 541 and a microphone 542, with the graphics processor 541 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The display unit 506 may include a display panel 561, and the display panel 561 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 507 includes at least one of a touch panel 571 and other input devices 572. The touch panel 571 is also referred to as a touch screen. The touch panel 571 may include two parts, a touch detection device and a touch controller. Other input devices 572 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not further described herein.
The memory 509 may be used to store software programs as well as various data. The memory 509 may mainly include a first storage area storing programs or instructions and a second storage area storing data, wherein the first storage area may store an operating system, application programs or instructions (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. Further, the memory 509 may include volatile memory or nonvolatile memory, or the memory 509 may include both volatile and nonvolatile memory. The nonvolatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable EPROM (EEPROM), or a flash Memory. The volatile memory may be random access memory (Random Access Memory, RAM), static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (ddr SDRAM), enhanced SDRAM (Enhanced SDRAM), synchronous DRAM (SLDRAM), and Direct RAM (DRRAM). Memory 509 in embodiments of the present application includes, but is not limited to, these and any other suitable types of memory.
Processor 510 may include one or more processing units; optionally, the processor 510 integrates an application processor that primarily processes operations involving an operating system, user interface, application programs, etc., and a modem processor that primarily processes wireless communication signals, such as a baseband processor. It will be appreciated that the modem processor described above may not be integrated into the processor 510.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction realizes each process of the embodiment of the video image processing method, and the same technical effects can be achieved, so that repetition is avoided, and no further description is given here.
Wherein the processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes computer readable storage medium such as computer readable memory ROM, random access memory RAM, magnetic or optical disk, etc.
The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, and the processor is used for running a program or an instruction, so as to implement each process of the embodiment of the video image processing method, and achieve the same technical effect, so that repetition is avoided, and no redundant description is provided here.
It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.
The embodiments of the present application provide a computer program product stored in a storage medium, where the program product is executed by at least one processor to implement the respective processes of the embodiments of the video image processing method described above, and achieve the same technical effects, and are not repeated herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solutions of the present application may be embodied essentially or in a part contributing to the prior art in the form of a computer software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), comprising several instructions for causing a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the methods described in the embodiments of the present application.
The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are also within the protection of the present application.
Claims (19)
1. A video image processing circuit for use with a central processing chip, said circuit comprising: the device comprises an image signal processor, a display processing unit, a video encoder and an anti-shake algorithm module; wherein,
the image signal processor is used for outputting the acquired first video image data to the image processing chip through the display processing unit;
the anti-shake algorithm module is used for acquiring the enhanced image data output by the image processing chip, performing first anti-shake processing on the enhanced image data, and generating second video image data to be previewed; performing second anti-shake processing on the enhanced image data to generate third video image data to be stored; the enhanced image data is obtained after image enhancement processing is carried out on the first video image;
the display processing unit is used for acquiring the second video image data output by the anti-shake algorithm module and transmitting the second video image data to a display screen;
the video encoder is used for acquiring the third video image data output by the anti-shake algorithm module and transmitting the third video image data to a memory for storage.
2. The video image processing circuit of claim 1, wherein the image signal processor is specifically configured to:
performing basic effect processing on the first video image data to generate metadata of image parameters and two paths of processed first video image data;
transmitting the first video image data of which one path is processed to the image processing chip through the display processing unit;
and outputting the other path of processed metadata of the first video image data transmission and the image parameters to the encoder as a video file to be stored.
3. The video image processing circuit of claim 2, wherein the video signal is processed,
the anti-shake algorithm module is further configured to: obtaining an anti-shake parameter obtained by performing the second anti-shake processing on the enhanced image data; outputting the anti-shake parameter to the encoder;
the encoder is further configured to encode the first video image data, metadata of the image parameters, and the anti-shake parameters, generate a first encoded file, and output the first encoded file to the memory for storage.
4. The video image processing circuit of claim 1, wherein the video signal is processed,
the first anti-shake processing is based on a single frame image;
the second anti-shake processing is to perform anti-shake processing based on the cached multi-frame images.
5. The video image processing circuit of claim 1, wherein said image enhancement processing of said first video image data comprises at least one of:
blurring the background except the portrait in the first video image data;
carrying out face beautifying treatment on the portrait in the first video image data;
spot processing is carried out on the point light sources in the first video image data;
performing wiredrawing processing on point light sources in the first video image data;
performing first filter processing on the portrait in the first video image data;
and performing second filter processing on the background except the portrait in the first video image data.
6. The video image processing circuit according to claim 1, wherein the display processing unit is specifically configured to:
transmitting the second video image data to the display screen through a first channel; the first channel comprises the display processing unit, and the display processing unit is directly connected with the display screen; or,
Transmitting the second video image data to the display screen through a second channel; the second channel comprises the display processing unit and the image processing chip, the display processing unit is in communication connection with the image processing chip, and the image processing chip is in communication connection with the display screen.
7. The video image processing circuit of claim 1, wherein the video encoder is specifically configured to:
encoding the third video image data to obtain a second encoded file;
and transmitting the second coded file to the memory for storage.
8. A video image processing method, applied to a central processing chip, comprising:
outputting the acquired first video image data to an image processing chip;
the method comprises the steps of obtaining enhanced image data output by the image processing chip, wherein the enhanced image data is obtained after image enhancement processing is carried out on the first video image;
performing first anti-shake processing on the enhanced image data to generate second video image data to be previewed; performing second anti-shake processing on the enhanced image data to generate third video image data to be stored;
And transmitting the second video image data to a display screen, and transmitting the third video image data to a memory for storage.
9. The video image processing method according to claim 8, wherein the central processing chip includes: an image signal processor, a display processing unit, and an encoder; the outputting the acquired first video image data to the image processing chip includes:
performing basic effect processing on the first video image data through the image signal processor to generate metadata of image parameters and two paths of processed first video image data;
transmitting the first video image data of which one path is processed to the image processing chip through the display processing unit;
and outputting the other path of processed metadata of the first video image data transmission and the image parameters to the encoder as a video file to be stored.
10. The video image processing method according to claim 9, wherein after the second anti-shake processing is performed on the enhanced image data to generate third video image data to be stored, the method further comprises:
Obtaining an anti-shake parameter obtained by performing the second anti-shake processing on the enhanced image data;
outputting the anti-shake parameters to the encoder, and encoding the first video image data, the metadata of the image parameters and the anti-shake parameters through the encoder to generate a first encoded file;
and outputting the first coded file to the memory for storage.
11. The method for video image processing according to claim 8, wherein,
the first anti-shake processing is based on a single frame image;
the second anti-shake processing is to perform anti-shake processing based on the cached multi-frame images.
12. The video image processing method of claim 8, wherein said image enhancement processing of said first video image data comprises at least one of:
blurring the background except the portrait in the first video image data;
carrying out face beautifying treatment on the portrait in the first video image data;
spot processing is carried out on the point light sources in the first video image data;
performing wiredrawing processing on point light sources in the first video image data;
Performing first filter processing on the portrait in the first video image data;
and performing second filter processing on the background except the portrait in the first video image data.
13. The video image processing method according to claim 8, wherein the central processing chip includes: a display processing unit; the transmitting the second video image data to a display screen includes:
transmitting the second video image data to the display screen through a first channel; the first channel comprises the display processing unit, and the display processing unit is directly connected with the display screen; or,
transmitting the second video image data to the display screen through a second channel; the second channel comprises the display processing unit and the image processing chip, the display processing unit is in communication connection with the image processing chip, and the image processing chip is in communication connection with the display screen.
14. The video image processing method of claim 8, wherein the central processing chip comprises an encoder; the transmitting the third video image data to a memory for storage includes:
Encoding the third video image data through the encoder to obtain a second encoded file;
and transmitting the second coded file to the memory for storage.
15. A video image processing circuit, comprising: the image processing device comprises an image sensor, a central processing chip, an image processing chip and a memory; wherein,
the image sensor is used for acquiring a first video image and outputting the first video image to the central processing chip;
the central processing chip is used for outputting the first video image to the image processing chip;
the image processing chip is used for carrying out image enhancement processing on the first video image to obtain enhanced image data, and outputting the enhanced image data to the central processing chip;
the central processing chip is also used for performing first anti-shake processing on the enhanced image data to generate second video image data to be previewed; performing second anti-shake processing on the enhanced image data to generate third video image data to be stored; and outputting the second video image data to a display screen, and outputting the third video image data to the memory after encoding.
16. The video image processing circuit of claim 15, wherein the central processing chip is further configured to:
performing basic effect processing on the first video image data to generate metadata of image parameters and two paths of processed first video image data;
transmitting the first video image data of which one path is processed to the image processing chip;
and taking the other path of processed metadata of the first video image data transmission and the image parameters as a video file to be stored for encoding processing.
17. The video image processing circuit of claim 16, wherein the central processing chip is further configured to:
obtaining an anti-shake parameter obtained by performing the second anti-shake processing on the enhanced image data;
and carrying out coding processing on the first video image data, the metadata of the image parameters and the anti-shake parameters to generate a first coding file, and outputting the first coding file to the memory.
18. The video image processing circuit of claim 15, wherein the central processing chip is further configured to:
Transmitting the second video image data to the display screen through a first channel; wherein the central processing chip is directly connected with the display screen; or,
transmitting the second video image data to the display screen through a second channel; the central processing chip is connected with the image processing chip, and the image processing chip is connected with the display screen.
19. An electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the video image processing method of any of claims 8-14.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311271806.XA CN117336611A (en) | 2023-09-27 | 2023-09-27 | Video image processing circuit, method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311271806.XA CN117336611A (en) | 2023-09-27 | 2023-09-27 | Video image processing circuit, method and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117336611A true CN117336611A (en) | 2024-01-02 |
Family
ID=89276632
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311271806.XA Pending CN117336611A (en) | 2023-09-27 | 2023-09-27 | Video image processing circuit, method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117336611A (en) |
-
2023
- 2023-09-27 CN CN202311271806.XA patent/CN117336611A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6961648B2 (en) | Real time video summary | |
| CN110475065B (en) | Image processing method and device, electronic equipment and storage medium | |
| DE112015000950T5 (en) | Backward compatible and backward compatible method of providing both standard and high dynamic range video | |
| JP2009303236A (en) | Adaptive image stability | |
| CN112770059B (en) | Photographing method and device and electronic equipment | |
| WO2021244368A1 (en) | Method and device for video playback | |
| CN110889809B (en) | Image processing method and device, electronic equipment and storage medium | |
| KR20230039723A (en) | Projection data processing method and apparatus | |
| CN108027637A (en) | System and method for carrying out control memory frequency using feedforward compression statistics | |
| CN113225585B (en) | Video definition switching method and device, electronic equipment and storage medium | |
| CN107925777A (en) | The method and system that frame for video coding is resequenced | |
| KR20140092517A (en) | Compressing Method of image data for camera and Electronic Device supporting the same | |
| DE112015006587T5 (en) | Adaptive batch encoding for slow motion video recording | |
| WO2023207872A1 (en) | Video encoding and decoding method, video codec and electronic device | |
| CN108833803A (en) | Imaging method, device and electronic equipment | |
| WO2022111717A1 (en) | Image processing method and apparatus, and electronic device | |
| CN112702604B (en) | Encoding method and apparatus and decoding method and apparatus for layered video | |
| WO2024109701A1 (en) | Video encoding/decoding method and apparatus, electronic device, and medium | |
| CN112887515B (en) | Video generation method and device | |
| CN117336611A (en) | Video image processing circuit, method and electronic equipment | |
| DE112013004068T5 (en) | Image file creation device and display device | |
| CN113852774B (en) | Screen recording method and device | |
| CN116170636A (en) | Live video playing method and device, equipment and medium thereof | |
| CN115834906A (en) | Video encoding and decoding method and device, electronic equipment and medium | |
| CN115564695A (en) | Processing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |