CN112565865A - Image processing method and device and electronic equipment - Google Patents
Image processing method and device and electronic equipment Download PDFInfo
- Publication number
- CN112565865A CN112565865A CN202011380628.0A CN202011380628A CN112565865A CN 112565865 A CN112565865 A CN 112565865A CN 202011380628 A CN202011380628 A CN 202011380628A CN 112565865 A CN112565865 A CN 112565865A
- Authority
- CN
- China
- Prior art keywords
- image data
- image
- data
- operation interface
- application program
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4884—Data services, e.g. news ticker for displaying subtitles
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Image Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses an image processing method, an image processing device and electronic equipment, and belongs to the technical field of communication. The problem that the current image acquisition mode is not flexible can be solved. The method comprises the following steps: receiving a first input in a case where a first application displays image data; responding to the first input, separating the operation interface data of the first application program and the image data displayed in the first application program through the central processing chip; enhancing the image data displayed in the separated first application program through an image processing chip to obtain enhanced image data; the image data after the enhancement processing is stored through a memory, the operation interface data and the image data after the enhancement processing are mixed and superposed through an image processing chip, and the mixed and superposed image is displayed on a display screen.
Description
Technical Field
The application belongs to the technical field of communication, and particularly relates to an image processing method and device and electronic equipment.
Background
With the development of communication technology, functions in electronic devices are becoming more powerful, and for example, users can use the electronic devices to obtain contents displayed on a screen.
Currently, a user may use an electronic device to capture content displayed on a screen, such as capturing a picture by screen capture or capturing a video by screen recording, and generally all the content displayed on the entire screen is captured.
However, the user may only be interested in the displayed content in the application and may not desire to obtain other content on the interface. At present, for a picture obtained by screen capture, a user needs to obtain a desired picture by manual clipping after obtaining the screen capture picture; for videos obtained by screen recording, if a user does not have a professional image processing technology, the user cannot process the videos to obtain the required videos, and therefore, the current image acquisition mode is not flexible enough.
Disclosure of Invention
An embodiment of the present application provides an image processing method, an image processing apparatus, and an electronic device, which can solve the problem that the current image acquisition mode is not flexible enough.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides an image processing method, including: receiving a first input in a case where a first application displays image data; responding to the first input, separating the operation interface data of the first application program and the image data displayed in the first application program through a central processing chip; performing enhancement processing on the separated image data displayed in the first application program through an image processing chip to obtain enhanced image data; and storing the image data after the enhancement processing through a memory, mixing and superposing the operation interface data and the image data after the enhancement processing through an image processing chip, and displaying the mixed and superposed image on a display screen.
In a second aspect, an embodiment of the present application provides an image processing apparatus, including: a user input unit for receiving a first input in a case where the first application displays the image data; the central processing chip is used for responding to the first input received by the user input unit and separating the operation interface data of the first application program and the image data displayed in the first application program; the image processing chip is used for enhancing the image data displayed in the separated first application program to obtain enhanced image data; a memory for storing the enhanced image data; the image processing chip is used for mixing and superposing the operation interface data and the image data after the enhancement processing; and the display screen is used for displaying the mixed and superposed images.
In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.
In a sixth aspect, the present application provides a computer program product, which is executed by at least one processor to implement the method of the first aspect.
In this embodiment, the electronic device may receive a first input in a case where the first application displays image data, and then, in response to the first input, the electronic device may separate, by the central processing chip, the operation interface data of the first application and the image data displayed in the first application. Then, the electronic device can perform enhancement processing on the image data displayed in the separated first application program through the image processing chip to obtain enhanced image data. Then the electronic device can store the image data after the enhancement processing through the memory, and can also mix and superpose the operation interface data and the image data after the enhancement processing through the image processing chip, and display the image after the mixing and superposition on the display screen, namely the electronic device can firstly not mix and superpose the operation interface data of the first application program and the image data displayed in the first application program after receiving the first input, but can carry out the enhancement processing on the image data in a separated state, after the enhancement processing, on one hand, the image data after the enhancement processing can be directly stored in the memory, so that the user can acquire the image data without the operation interface data of the first application program, the image data observed by the user does not only include the operation interface of the application program, and the display effect of the image is better than the original display effect, on the other hand, the operation interface data and the image data after the enhancement processing are mixed and superposed through the image processing chip, and then the mixed and superposed image is displayed on the display screen, so that the display effect of the image data displayed on the screen can be improved, and the user experience is better.
Drawings
Fig. 1 is a schematic flowchart of an image processing method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a display interface provided in an embodiment of the present application;
fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram of a possible structure of an image processing apparatus according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;
fig. 6 is a hardware schematic diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
The image processing method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.
Fig. 1 is a schematic flowchart of an image processing method according to an embodiment of the present application. As shown in fig. 1, the method includes the following S101 to S104:
s101, the electronic equipment receives a first input under the condition that the first application program displays image data.
Optionally, the image data displayed in the first application includes an image, or an image and bullet screen data.
For example, in the case that the image is a video, the first application may be any application in the electronic device that can play a video file. In the case where the image is a picture, the first application may be any application in the electronic device.
Illustratively, the first input may be a user-triggered screen capture input or screen capture input.
S102, the electronic equipment responds to the first input, and separates the operation interface data of the first application program and the image data displayed in the first application program through the central processing chip.
For convenience of description, in the embodiments of the present application, the following examples are described by taking a user recording a video displayed in an application as an example.
Fig. 2 is a schematic diagram of a display interface provided in an embodiment of the present application. As shown in fig. 2, the interface is a display interface of a video playing application, where the bottom progress bar and buttons, such as a "next" button, a "high definition" button, a "selection" button, and a "pause" button, are operation interface data corresponding to the video playing application, and the image data is data in the operation interface of the application except the operation interface data.
It should be noted that, the user may select to record a video image that does not include a bullet screen, and the user may also select to record a video image that includes a bullet screen, which is not specifically limited in this embodiment of the application.
S103, the electronic equipment performs enhancement processing on the image data displayed in the separated first application program through the image processing chip to obtain enhanced image data.
Illustratively, the image processing chip may be an external image processing chip (i.e., a chip dedicated to enhancement processing), and the enhancement processing described above may be processed by the external image processing chip in the electronic device.
Illustratively, the enhancement processing may include any one of: image processing such as dynamic range (HDR) improvement, noise reduction (Image Denoising), frame interpolation, super-segmentation, sharpening, clipping, color correction, and the like.
Compared with common images, the High-Dynamic Range (HDR) image can provide more Dynamic Range and image details, and according to LDR (Low-Dynamic Range) images with different exposure times, the LDR image with the best details corresponding to each exposure time is used to synthesize a final HDR image, so that a visual effect in a real environment can be better reflected.
Digital images are often affected by noise interference of imaging equipment and external environment during digitization and transmission, and are called noisy images or noisy images. The process of reducing noise in digital images is called image denoising, also known as image denoising.
The super-resolution is a bottom layer image processing, and images with low resolution are mapped to images with high resolution, so that the effect of enhancing image details is achieved.
Sharpening can quickly focus on a blurred edge, improve the definition or focal length degree of a certain part in an image, and enable the color of a specific area of the image to be more vivid.
And S104, the electronic equipment stores the image data after the enhancement processing through the memory, mixes and superposes the operation interface data and the image data after the enhancement processing through the image processing chip, and displays the mixed and superposed image on the display screen.
It can be understood that the electronic device may divide the image data after the enhancement processing into two paths of data, one path of data for storage and one path of data for display.
Exemplarily, in a scene that a user triggers a screen capture of the electronic device, the electronic device may first acquire a screen capture image that does not include operation interface data, then perform enhancement processing on the screen capture image, and then generate two paths of data, where one path of enhanced data may be used for storage, so that the user may obtain the enhanced screen capture image; one path of data can be used for displaying, so that the effect of displaying on a screen is better.
Exemplarily, in a scene that a user triggers screen recording of the electronic device, the electronic device may not trigger mixed superposition of operation interface data and image data, enhance the image data, generate two paths of data, and store one path of enhanced image data, so that the user obtains a screen recording file which does not include an operation interface and has a better display effect; the other path of data can be used for displaying, the image data after enhancement processing and the operation interface data can be mixed and superposed, and then the mixed and superposed image is displayed on the display screen, so that the user can watch the image with better display effect in the screen recording process, and the watching experience of watching the video by the user is improved.
According to the image processing method provided by the embodiment of the application, the electronic device can receive the first input under the condition that the first application program displays the image data, and then the electronic device can respond to the first input and separate the operation interface data of the first application program and the image data displayed in the first application program through the central processing chip. Then, the electronic device can perform enhancement processing on the image data displayed in the separated first application program through the image processing chip to obtain enhanced image data. Then the electronic device can store the image data after the enhancement processing through the memory, and can also mix and superpose the operation interface data and the image data after the enhancement processing through the image processing chip, and display the image after the mixing and superposition on the display screen, namely the electronic device can firstly not mix and superpose the operation interface data of the first application program and the image data displayed in the first application program after receiving the first input, but can carry out the enhancement processing on the image data in a separated state, after the enhancement processing, on one hand, the image data after the enhancement processing can be directly stored in the memory, so that the user can acquire the image data without the operation interface data of the first application program, the image data observed by the user does not only include the operation interface of the application program, and the display effect of the image is better than the original display effect, on the other hand, the operation interface data and the image data after the enhancement processing are mixed and superposed through the image processing chip, and then the mixed and superposed image is displayed on the display screen, so that the display effect of the image data displayed on the screen can be improved, and the user experience is better.
Optionally, the central processing chip includes a display frame, and in the image processing method provided in this embodiment of the application, after S101 and before S103, the following S105 may be further included:
and S105, the electronic equipment modifies the logic of the display frame and prohibits the display frame from mixing and superposing the operation interface data and the image data.
It is understood that, after receiving the first input, the electronic device may temporarily cancel the mixed superimposition of the operation interface data and the image data, and process the image data first. Thereby enabling the electronic device to directly save the image data; or the image data can be enhanced, the electronic device can store the enhanced image data, and the enhanced image data and the operation interface data can be mixed, superposed and displayed by the electronic device.
Based on the scheme, the electronic equipment can modify the logic of the display frame after acquiring the separated operation interface data of the first application program and the image data displayed in the first application program, and forbids the display frame to mix and superpose the operation interface data and the image data, so that the electronic equipment can conveniently and independently process the image data subsequently.
Optionally, the central processing chip includes an encoder; in the image processing method provided in the embodiment of the present application, the "storing the enhanced image data by the memory" in S104 may be performed by S104 a:
s104a, the electronic device encodes the image data after the enhancement processing by the encoder, and stores the encoded image data in the memory.
Wherein the encoder is a video encoder or a picture encoder.
It can be understood that, in the case that the first input is an input that a user triggers a screen capture of the electronic device, the electronic device may control the picture encoder to encode the enhanced image data, and store the encoded image data in the memory, so that an enhanced screen capture image may be obtained; under the condition that the first input is input that a user triggers the electronic equipment to record a screen, the electronic equipment can control the video encoder to perform enhancement processing, and store the encoded video image data into the memory, so that a screen recording file after the enhancement processing can be obtained.
Based on the scheme, the electronic equipment can use an encoder to encode the image data after enhancement processing, and under the condition that the first input triggers the screen capture of the electronic equipment, the image encoder can be used to encode the image data after enhancement processing, and then the obtained screen capture image is stored; in the case where the first input triggers the electronic device to record a screen, the video encoder may be used to encode the enhanced video data and then store the resulting screen-recording file.
Specifically, the image processing method provided by the embodiment of the application can be applied to a scene of video screen recording under the condition that the image data is video or video and barrage data.
Optionally, after S102, the image processing method provided in the embodiment of the present application may further include the following S106:
s106, the electronic equipment records the video data displayed in the separated first application program to obtain a screen recording file.
That is, the electronic device records only the screen data corresponding to the electronic video file, and does not record the operation interface data of the first application program.
It should be noted that, in the case that the electronic device may also display interface contents of other applications, for example, a pop-up dialog box, the screen recording manner provided in the embodiment of the present application does not record the dialog box, and only records video data of the first application.
Based on the scheme, the electronic equipment can directly store the video data displayed in the first application program after separating the video data displayed in the first application program from the operation interface data of the first language application program, so that a user can obtain the screen recording file only comprising the video data without other later-stage processing in a scene that the video data displayed on the screen is only required to be recorded, and the screen recording mode is simple and flexible.
Optionally, in the image processing method provided in the embodiment of the present application, the foregoing S104 may be specifically executed through S104b to S104 d:
s104b, the electronic device performs enhancement processing on the video data displayed in the separated first application program to obtain enhanced video data.
It can be understood that under the condition that the display effect of a video file source file is not good, the electronic equipment can firstly enhance the video data, the quality of the video data is improved, the display effect of the recorded video is better, and the problem that a user determines the reprocessing in the later period caused by the poor video quality after recording or the re-recording is avoided.
S104c, recording the video data displayed in the enhanced first application by the electronic equipment to obtain a screen recording file.
It can be understood that, before recording the screen, the electronic device may perform enhancement processing on the video data displayed in the separated first application program to obtain the video data after enhancement processing, and then record the video data displayed in the first application after enhancement processing on the screen, so that the display effect of the video file obtained by recording the screen is better.
S104d, the electronic device performs mixed superposition on the operation interface data of the first application program and the video data after enhancement processing, and displays the images after mixed superposition on a display screen.
It can be understood that, after the electronic device separates the operation interface data and the video data of the first application program, the electronic device may perform the mixing and overlaying on the operation interface data and the video after the data enhancement processing after the enhancement processing of the separated video data.
Based on the scheme, the electronic equipment can process the screen recording to obtain the display effect of the video in the file and improve the display effect of the video data displayed on the screen under the condition that the user triggers the screen recording, so that the screen recording experience of the user is better.
Optionally, in the image processing method provided in this embodiment of the present application, when the user needs to record a video, the user may select a recorded object as needed, and before the foregoing S101, the method may further include the following S107 and S108:
s107, the electronic equipment receives the setting input of the user.
Wherein the setup input is used to select data to be recorded.
And S108, the electronic equipment responds to the setting input and determines the data to be recorded.
The data to be recorded may be content displayed on the whole screen, content displayed only in the application (e.g., data of a video file and barrage data), and video displayed only in the application (e.g., data of a video file).
Based on the scheme, the electronic equipment can provide different screen recording modes for the user, so that the user can select the appropriate screen recording mode according to actual needs, and the user can operate more conveniently and flexibly in the screen recording scene.
For convenience of explanation, the image processing method provided by the embodiment of the present application is explained below according to an internal data processing procedure of the electronic device and a processing architecture diagram shown in fig. 3. Fig. 3 is a schematic view of an electronic device according to an embodiment of the present application. As shown in fig. 3, the electronic apparatus includes a central processing chip 30, an external image processing chip 34, a display screen 35, and a memory 37; the central processing chip 30 includes: an application 31, a display framework 32, a display processing unit 33, and an encoder 36. The various modules may perform the following functions:
(1) the application 31 may transmit the operation interface data and the image data of the application 31 to the display frame 32.
(2) A display frame 32 for superimposing the operation interface data and the image data sent by the application program 31 without mixing; to the display processing unit 33.
Illustratively, the display framework may be an android display framework.
(3) The display processing unit 33: the image data sent from the display frame 32 is converted into RGB data, and the operation interface data and the converted image data are sent to the external image processing chip 34, respectively.
It should be noted that, in general, the display frame 32 is a display screen 35 that performs a mixed superimposition of the operation interface data and the image data transmitted by the application program and transmits the mixed superimposed data, and then the display screen 35 displays the mixed superimposed video image.
In this embodiment of the application, after the electronic device receives the screen recording operation of the user, the display frame 32 may be controlled to perform separation processing on the operation interface data and the image data first without performing mixing and overlapping after receiving the operation interface data and the image data sent by the application program, so as to ensure that the operation interface data and the image data are separated.
Specifically, the display frame 32 may send the operation interface data and the image data to the external image processing chip 34 through the display processing unit via the MIPI DSI interface.
(4) The external image processing chip 34, after receiving the separated image data and the operation interface data sent by the display processing unit 33, can perform effect enhancement on the image data.
The external image processing chip 34 may perform at least one of the following image processing on the image data: improving dynamic range, noise reduction, frame interpolation, super-resolution, sharpening, clipping, color correction, and the like.
The external image processing chip can enhance the effect of the image data and improve the image quality and resolution of the image data display.
(5) The external image processing chip 34 may perform a blending and stacking process on the operation Interface data sent by the application program 31 and the image data after the image data is enhanced, and then send the blended and stacked image to the Display screen 35 through a Mobile Industry Processor-Display Pixel Interface (MIPI DSI) Interface, where the Display screen 35 displays the image received through the MIPI DSI Interface.
Illustratively, the Display may be a Liquid Crystal Display (LCD).
The electronic device can control the external image processing chip to internally mix and superpose the operation interface data and the image data after the enhancement processing to synthesize one image, so that the power consumption of a processor of the electronic device can be reduced.
It can be understood that the display screen 35 displays images received through the MIPI DSI interface, and the display effect is better than that of the related art.
(6) The external image processing chip 34 may further send the video data after the enhancement processing to the encoder 36 through a MIPI Camera Serial Interface (CSI) after the enhancement processing is performed on the image data.
(7) And the encoder 36 may be configured to encode the image data after the enhancement processing is received through the MIPI CSI interface, and send the image data after the enhancement processing and encoding to the memory 37.
(8) The memory 37 may be used for storing the image (e.g., screen capture image, screen recording file) encoded by the encoder 36 in the electronic device.
It should be noted that, in the image processing method provided in the embodiment of the present application, the execution subject may be an image processing apparatus, or a control module for executing the method of image processing in the image processing apparatus. In the embodiment of the present application, a method for an image processing apparatus to perform screen recording is taken as an example, and an apparatus for image processing provided in the embodiment of the present application is described.
Fig. 4 is an image processing apparatus according to an embodiment of the present application, and the image processing apparatus 400 shown in fig. 4 includes: a user input unit 401 for receiving a first input in a case where the first application displays image data; a central processing chip 402 for separating the operation interface data of the first application program and the image data displayed in the first application program in response to the first input received by the user input unit; an image processing chip 403, configured to perform enhancement processing on the image data displayed in the separated first application program to obtain enhanced image data; a memory 404 for storing the image data after the enhancement processing; the image processing chip 403 is configured to mix and superimpose the operation interface data and the enhanced image data; and a display screen 405 for displaying the mixed and superimposed image.
Optionally, the central processing chip includes a display frame, and the image processing apparatus further includes: and the prohibiting module is used for modifying the logic of the display frame and prohibiting the display frame from mixing and superposing the operation interface data and the image data.
Optionally, the central processing chip includes an encoder for encoding the image data after the enhancement processing; the memory is specifically used for storing the encoded image data to the memory; wherein the encoder is a video encoder or a picture encoder.
Optionally, the image data displayed in the first application includes an image, or an image and bullet screen data.
With the image processing apparatus according to the embodiment of the present application, the image processing apparatus may receive a first input when the first application displays image data, and then, in response to the first input, the image processing apparatus may separate, by the central processing chip, the operation interface data of the first application from the image data displayed in the first application. Then, the image processing device can perform enhancement processing on the image data displayed in the separated first application program through the image processing chip to obtain enhanced image data. Then the image processing device can store the image data after the enhancement processing through the memory, and can also mix and superpose the operation interface data and the image data after the enhancement processing through the image processing chip, and display the image after the mixing and superposition on the display screen, namely the image processing device can firstly not mix and superpose the operation interface data of the first application program and the image data displayed in the first application program after receiving the first input, but can carry out the enhancement processing on the image data in a separated state, after the enhancement processing, on one hand, the image data after the enhancement processing can be directly stored in the memory, so that the user can acquire the image data without the operation interface data of the first application program, the image data observed by the user does not only comprise the operation interface of the application program, and the display effect of the image is better than the original display effect, on the other hand, the operation interface data and the image data after the enhancement processing are mixed and superposed through the image processing chip, and then the mixed and superposed image is displayed on the display screen, so that the display effect of the image data displayed on the screen can be improved, and the user experience is better.
The screen recording device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The screen recording device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.
The screen recording device provided in the embodiment of the present application can implement each process implemented by the screen recording device in the method embodiments of fig. 1 to fig. 3, and is not described here again to avoid repetition.
Optionally, as shown in fig. 5, an electronic device 500 is further provided in this embodiment of the present application, and includes a processor 501, a memory 502, and a program or an instruction stored in the memory 502 and executable on the processor 501, where the program or the instruction is executed by the processor 501 to implement each process of the above-mentioned embodiment of the image processing method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 6 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 1000 includes, but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010.
Note that the user input unit 1007 may be used to implement the function of the user input unit 401; processor 1010 may be used to implement the functionality of central processing chip 402; memory 1009 may be used to implement the functions of memory 404; the display unit 1006 may be used to implement the functions of the display screen 405;
optionally, the electronic device 1000 may further include an external image processing chip for implementing the functions of the image processing chip 403.
Alternatively, the processor 1010 may implement the functions of the central processing chip and the functions of the external image processing chip described above.
Those skilled in the art will appreciate that the electronic device 1000 may further comprise a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 1010 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 6 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.
The user input unit 1007 is used for receiving a first input when the first application displays image data; a processor 1010, configured to separate, in response to the first input, the operation interface data of the first application program and the image data displayed in the first application program; the external image processing chip is used for performing enhancement processing on the image data displayed in the separated first application program to obtain enhanced image data; a memory 1009 for storing the image data after the enhancement processing; the external image processing chip is also used for mixing and superposing the operation interface data and the image data after the enhancement processing; a display unit 1006, configured to display the mixed and superimposed image.
According to the image processing method provided by the embodiment of the application, the electronic device can receive the first input under the condition that the first application program displays the image data, and then the electronic device can respond to the first input and separate the operation interface data of the first application program and the image data displayed in the first application program through the central processing chip. Then, the electronic device can perform enhancement processing on the image data displayed in the separated first application program through the image processing chip to obtain enhanced image data. Then the electronic device can store the image data after the enhancement processing through the memory, and can also mix and superpose the operation interface data and the image data after the enhancement processing through the image processing chip, and display the image after the mixing and superposition on the display screen, namely the electronic device can firstly not mix and superpose the operation interface data of the first application program and the image data displayed in the first application program after receiving the first input, but can carry out the enhancement processing on the image data in a separated state, after the enhancement processing, on one hand, the image data after the enhancement processing can be directly stored in the memory, so that the user can acquire the image data without the operation interface data of the first application program, the image data observed by the user does not only include the operation interface of the application program, and the display effect of the image is better than the original display effect, on the other hand, the operation interface data and the image data after the enhancement processing are mixed and superposed through the image processing chip, and then the mixed and superposed image is displayed on the display screen, so that the display effect of the image data displayed on the screen can be improved, and the user experience is better.
Optionally, the processor 1010 is further configured to modify logic of the display frame to disable the display frame from performing a hybrid overlay of the operator interface data and the image data.
Optionally, the processor 1010 is further configured to encode the enhanced image data, and store the encoded image data in the memory; the encoding may include video encoding and image encoding.
It should be understood that in the embodiment of the present application, the input Unit 1004 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the Graphics Processing Unit 1041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1006 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1007 includes a touch panel 1071 and other input devices 1072. The touch panel 1071 is also referred to as a touch screen. The touch panel 1071 may include two parts of a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 1009 may be used to store software programs as well as various data, including but not limited to application programs and operating systems. Processor 1010 may integrate an application processor that handles primarily operating systems, user interfaces, applications, etc. and a modem processor that handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1010.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the embodiment of the image processing method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the embodiment of the image processing method, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
An embodiment of the present application further provides a computer program product, where the program product is stored in a non-volatile storage medium, and the program product is executed by at least one processor to implement each process of the above-mentioned embodiment of the image processing method, and the same technical effect can be achieved, and in order to avoid repetition, details are not repeated here.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. An image processing method, characterized in that the method comprises:
receiving a first input in a case where a first application displays image data;
responding to the first input, separating the operation interface data of the first application program and the image data displayed in the first application program through a central processing chip;
performing enhancement processing on the separated image data displayed in the first application program through an image processing chip to obtain enhanced image data;
and storing the image data after the enhancement processing through a memory, mixing and superposing the operation interface data and the image data after the enhancement processing through the image processing chip, and displaying the mixed and superposed image on a display screen.
2. The method of claim 1, wherein the central processing chip comprises a display frame, and after receiving the first input, before performing the enhancement processing on the image data displayed in the separated first application program through the image processing chip, the method further comprises:
and modifying the logic of the display frame, and prohibiting the display frame from performing mixed superposition on the operation interface data and the image data.
3. The method of claim 1, wherein the central processing chip comprises an encoder; the storing, by a memory, the enhanced processed image data includes:
encoding the image data after the enhancement processing by the encoder, and storing the encoded image data to the memory;
wherein the encoder is a video encoder or a picture encoder.
4. The method according to any one of claims 1 to 3, wherein the display image data in the first application comprises an image, or an image and barrage data.
5. An image processing apparatus characterized by comprising:
a user input unit for receiving a first input in a case where the first application displays the image data;
the central processing chip is used for responding to a first input received by the user input unit and separating the operation interface data of the first application program and the image data displayed in the first application program;
the image processing chip is used for performing enhancement processing on the separated image data displayed in the first application program to obtain enhanced image data;
a memory for storing the enhanced image data;
the image processing chip is used for mixing and superposing the operation interface data and the enhanced image data;
and the display screen is used for displaying the mixed and superposed images.
6. The apparatus of claim 5, wherein the central processing chip comprises a display frame, the apparatus further comprising: and the forbidding module is used for modifying the logic of the display frame and forbidding the display frame to carry out mixed superposition on the operation interface data and the image data.
7. The apparatus of claim 5, wherein the central processing chip comprises an encoder for encoding the enhanced processed image data; the memory is specifically configured to store the encoded image data to the memory;
wherein the encoder is a video encoder or a picture encoder.
8. The apparatus according to any one of claims 5 to 7, wherein the image data displayed in the first application comprises an image, or an image and barrage data.
9. An electronic device comprising a processor, a memory and a program or instructions stored on the memory and executable on the processor, which program or instructions, when executed by the processor, implement the steps of the image processing method according to any one of claims 1 to 4.
10. A readable storage medium, characterized in that it stores thereon a program or instructions which, when executed by a processor, implement the steps of the image processing method according to any one of claims 1 to 4.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011380628.0A CN112565865A (en) | 2020-11-30 | 2020-11-30 | Image processing method and device and electronic equipment |
| PCT/CN2021/134440 WO2022111730A1 (en) | 2020-11-30 | 2021-11-30 | Image processing method and apparatus, and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011380628.0A CN112565865A (en) | 2020-11-30 | 2020-11-30 | Image processing method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112565865A true CN112565865A (en) | 2021-03-26 |
Family
ID=75046797
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011380628.0A Pending CN112565865A (en) | 2020-11-30 | 2020-11-30 | Image processing method and device and electronic equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112565865A (en) |
| WO (1) | WO2022111730A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114268707A (en) * | 2021-12-28 | 2022-04-01 | 维沃移动通信有限公司 | Image processing method and device and electronic equipment |
| WO2022111730A1 (en) * | 2020-11-30 | 2022-06-02 | 维沃移动通信有限公司 | Image processing method and apparatus, and electronic device |
| WO2023030519A1 (en) * | 2021-09-06 | 2023-03-09 | 维沃移动通信有限公司 | Screen projection processing method and related device |
| WO2023125316A1 (en) * | 2021-12-28 | 2023-07-06 | 维沃移动通信有限公司 | Video processing method and apparatus, electronic device, and medium |
| CN116563098A (en) * | 2022-06-20 | 2023-08-08 | 广州视源电子科技股份有限公司 | Image processing method, device and equipment |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115022707B (en) * | 2022-06-21 | 2024-06-07 | 杭州海康威视数字技术股份有限公司 | Computer equipment and screen recording device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105898170A (en) * | 2015-12-21 | 2016-08-24 | 乐视移动智能信息技术（北京）有限公司 | Screen capturing method and device |
| CN107390972A (en) * | 2017-07-06 | 2017-11-24 | 努比亚技术有限公司 | A kind of terminal record screen method, apparatus and computer-readable recording medium |
| US20170346584A1 (en) * | 2016-05-31 | 2017-11-30 | Manufacturing Resources International, Inc. | Electronic display remote image verification system and method |
| CN110213637A (en) * | 2019-05-29 | 2019-09-06 | 努比亚技术有限公司 | Method, wearable device and the readable storage medium storing program for executing of video file increase watermark |
| CN111277779A (en) * | 2020-03-05 | 2020-06-12 | Oppo广东移动通信有限公司 | Video processing method and related device |
| CN111314773A (en) * | 2020-01-22 | 2020-06-19 | 广州虎牙科技有限公司 | Screen recording method and device, electronic equipment and computer readable storage medium |
| CN111327959A (en) * | 2020-03-05 | 2020-06-23 | Oppo广东移动通信有限公司 | Video frame insertion method and related device |
| CN111405301A (en) * | 2020-03-02 | 2020-07-10 | 广州虎牙科技有限公司 | Screen recording interaction method and device for terminal, computer equipment and storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108055491B (en) * | 2017-11-30 | 2021-07-23 | 努比亚技术有限公司 | Screen recording method, terminal and storage medium |
| CN109005446A (en) * | 2018-06-27 | 2018-12-14 | 聚好看科技股份有限公司 | A kind of screenshotss processing method and processing device, electronic equipment, storage medium |
| CN110166795B (en) * | 2018-07-19 | 2022-02-18 | 腾讯科技（深圳）有限公司 | Video screenshot method and device |
| CN108848397B (en) * | 2018-08-01 | 2021-07-23 | 上海安录宇高数据技术有限公司 | Using method of screen recording playback device |
| CN112565865A (en) * | 2020-11-30 | 2021-03-26 | 维沃移动通信有限公司 | Image processing method and device and electronic equipment |
-
2020
- 2020-11-30 CN CN202011380628.0A patent/CN112565865A/en active Pending
-
2021
- 2021-11-30 WO PCT/CN2021/134440 patent/WO2022111730A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105898170A (en) * | 2015-12-21 | 2016-08-24 | 乐视移动智能信息技术（北京）有限公司 | Screen capturing method and device |
| US20170346584A1 (en) * | 2016-05-31 | 2017-11-30 | Manufacturing Resources International, Inc. | Electronic display remote image verification system and method |
| CN107390972A (en) * | 2017-07-06 | 2017-11-24 | 努比亚技术有限公司 | A kind of terminal record screen method, apparatus and computer-readable recording medium |
| CN110213637A (en) * | 2019-05-29 | 2019-09-06 | 努比亚技术有限公司 | Method, wearable device and the readable storage medium storing program for executing of video file increase watermark |
| CN111314773A (en) * | 2020-01-22 | 2020-06-19 | 广州虎牙科技有限公司 | Screen recording method and device, electronic equipment and computer readable storage medium |
| CN111405301A (en) * | 2020-03-02 | 2020-07-10 | 广州虎牙科技有限公司 | Screen recording interaction method and device for terminal, computer equipment and storage medium |
| CN111277779A (en) * | 2020-03-05 | 2020-06-12 | Oppo广东移动通信有限公司 | Video processing method and related device |
| CN111327959A (en) * | 2020-03-05 | 2020-06-23 | Oppo广东移动通信有限公司 | Video frame insertion method and related device |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022111730A1 (en) * | 2020-11-30 | 2022-06-02 | 维沃移动通信有限公司 | Image processing method and apparatus, and electronic device |
| WO2023030519A1 (en) * | 2021-09-06 | 2023-03-09 | 维沃移动通信有限公司 | Screen projection processing method and related device |
| CN114268707A (en) * | 2021-12-28 | 2022-04-01 | 维沃移动通信有限公司 | Image processing method and device and electronic equipment |
| WO2023125316A1 (en) * | 2021-12-28 | 2023-07-06 | 维沃移动通信有限公司 | Video processing method and apparatus, electronic device, and medium |
| CN116563098A (en) * | 2022-06-20 | 2023-08-08 | 广州视源电子科技股份有限公司 | Image processing method, device and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022111730A1 (en) | 2022-06-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112565865A (en) | Image processing method and device and electronic equipment | |
| US20230300475A1 (en) | Image processing method and apparatus, and electronic device | |
| CN113014801B (en) | Video recording method, video recording device, electronic equipment and medium | |
| CN113014803A (en) | Filter adding method and device and electronic equipment | |
| CN114268707A (en) | Image processing method and device and electronic equipment | |
| CN114339072A (en) | Image processing circuit, method and electronic device | |
| CN114630053A (en) | HDR image display method and display equipment | |
| CN113852757B (en) | Video processing method, device, equipment and storage medium | |
| CN113794831B (en) | Video shooting method, device, electronic equipment and medium | |
| CN114338874A (en) | Image display method of electronic device, image processing circuit and electronic device | |
| CN113721876A (en) | Screen projection processing method and related equipment | |
| CN114339313A (en) | Frame insertion method and device and electronic equipment | |
| CN112437237B (en) | Shooting method and device | |
| CN113852756A (en) | Image acquisition method, device, equipment and storage medium | |
| CN112508820A (en) | Image processing method and device and electronic equipment | |
| CN112738399A (en) | Image processing method and device and electronic equipment | |
| CN115665562A (en) | Image processing method, circuit, device and medium | |
| CN113487497A (en) | Image processing method and device and electronic equipment | |
| CN113012085A (en) | Image processing method and device | |
| CN114286002B (en) | Image processing circuit, method, device, electronic equipment and chip | |
| CN112367562B (en) | Image processing method and device and electronic equipment | |
| CN115633251A (en) | Image processing method, circuit and electronic equipment | |
| CN112669229B (en) | Image processing method and device and electronic equipment | |
| CN118317203A (en) | Image processing method and device, electronic equipment and chip | |
| Kumar et al. | Real Time Video Processing Using Polar Fire FPGA |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |