CN113810675A - Image processing method, device, equipment and storage medium - Google Patents
Image processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN113810675A CN113810675A CN202010535340.XA CN202010535340A CN113810675A CN 113810675 A CN113810675 A CN 113810675A CN 202010535340 A CN202010535340 A CN 202010535340A CN 113810675 A CN113810675 A CN 113810675A
- Authority
- CN
- China
- Prior art keywords
- information
- screen
- color transformation
- transformation information
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 13
- 230000009466 transformation Effects 0.000 claims abstract description 224
- 238000012545 processing Methods 0.000 claims abstract description 72
- 230000008859 change Effects 0.000 claims abstract description 38
- 238000000034 method Methods 0.000 claims abstract description 33
- 238000006243 chemical reaction Methods 0.000 claims description 48
- 238000012544 monitoring process Methods 0.000 claims description 19
- 230000004044 response Effects 0.000 claims description 18
- 230000001960 triggered effect Effects 0.000 claims description 11
- 238000012546 transfer Methods 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 2
- 230000001131 transforming effect Effects 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 34
- 230000005540 biological transmission Effects 0.000 abstract description 9
- 238000004891 communication Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 239000011159 matrix material Substances 0.000 description 9
- 238000012805 post-processing Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 230000003068 static effect Effects 0.000 description 3
- 208000006992 Color Vision Defects Diseases 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 2
- 201000007254 color blindness Diseases 0.000 description 2
- 238000001816 cooling Methods 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 238000011982 device technology Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000010438 heat treatment Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/68—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Abstract
The present disclosure relates to an image processing method, apparatus, device, and storage medium. The method comprises the following steps: and acquiring screen color transformation information of the current screen of the first equipment, and performing color transformation on image information in an image processing unit (GPU) of the first equipment based on the screen color transformation information. According to the method and the device, the image information in the GPU is subjected to color transformation based on the acquired screen color transformation information, so that the image information in the CPU is the image information transformed based on the screen color transformation information of the current screen, the image information after color change can be sent to the second equipment for display by the second equipment, the image information with the same post-screen processing effect as that of the first equipment can be displayed in the second equipment, and the transmission requirement of a user on the image display effect can be met.
Description
Technical Field
The present disclosure relates to the field of terminal device technologies, and in particular, to an image processing method, an image processing apparatus, an image processing device, and a storage medium.
Background
As mobile device technology has been continuously developed and popularized in daily life, the demand of people on mobile terminals in entertainment and intelligence has increased with . The screen capture function of the mobile terminal facilitates the sharing of information by users and increases the interestingness. The user can share the page on the mobile terminal with other people or intercept the smiling appearance of the calling party in the video telephone and send the smiling appearance to friends so as to increase the entertainment of communication.
In the related art, a user can set an eye protection mode and the like on the terminal device to process the color change effect after the screen is processed. However, in this case, if the current user captures the screen image and sends the captured image to another user, the situation that the screenshot seen by the current user is inconsistent with the image seen by the other user may occur, and the transmission requirement of the user for the image display effect may not be satisfied.
Invention image information
To overcome the problems in the related art, embodiments of the present disclosure provide an image processing method, an image processing apparatus, an image processing device, and a storage medium, which are used to solve the defects in the related art.
According to a first aspect of embodiments of the present disclosure, there is provided an image processing method, including:
responding to a received screenshot instruction, and acquiring screen color transformation information of a current screen of the first equipment;
performing color transformation on image information in an image processing unit (GPU) of the first device based on the screen color transformation information;
and sending the image information after the color change to a second device for the second device to display.
In an embodiment, the method further comprises:
monitoring screen color transformation information of the current screen of the first equipment;
if the change of the screen color transformation information is monitored, updating the screen color transformation information of the current screen of the first equipment to obtain updated screen color transformation information;
the obtaining of the screen color transformation information of the current screen of the first device in response to receiving the screenshot command includes:
and responding to the received screenshot instruction, and acquiring the updated screen color transformation information.
In an embodiment, the method further comprises:
loading a background servo program after the first equipment is started;
and executing the operation of monitoring the screen color transformation information of the current screen of the first equipment based on the background servo program.
In an embodiment, the color transforming the image information in the image processing unit GPU of the first device based on the screen color transformation information comprises:
transmitting the screen color transformation information to an image processing unit (GPU) of the first device;
and informing the GPU to carry out color transformation on the image information in the frame buffer area.
In an embodiment, the obtaining, in response to receiving the screenshot instruction, screen color transformation information of a current screen of the first device includes:
the method comprises the steps of responding to a received screenshot command and a received color transformation information display command, obtaining the screen color transformation information of a current screen of the first equipment, wherein the color transformation information display command comprises a command which is triggered by a switch displayed on the basis of a user interface and is used for displaying the screen color transformation information in a screenshot, and the switch is used for switching whether the screen color transformation information is displayed in the screenshot or not.
According to a second aspect of the embodiments of the present disclosure, there is provided an image processing apparatus, the apparatus including:
the conversion information acquisition module is used for responding to the received screenshot instruction and acquiring the screen color conversion information of the current screen of the first equipment;
the image information transformation module is used for carrying out color transformation on the image information in the GPU of the first equipment based on the screen color transformation information;
and the image information sending module is used for sending the image information with the changed color to the second equipment so as to be displayed by the second equipment.
In one embodiment, the apparatus further comprises an update information acquisition module;
the update information acquisition module includes:
the conversion information monitoring unit is used for monitoring the screen color conversion information of the current screen of the first equipment;
the updating information acquiring unit is used for updating the screen color conversion information of the current screen of the first device when the change of the screen color conversion information is monitored, so as to obtain the updated screen color conversion information;
the transformation information acquisition module is further used for responding to the received screenshot command and acquiring the updated screen color transformation information.
In an embodiment, the update information obtaining module further includes:
the servo program loading unit is used for loading a background servo program after the first equipment is started;
the transformation information monitoring unit is further configured to execute the operation of monitoring the screen color transformation information of the current screen of the first device based on the background servo program.
In one embodiment, the image information transformation module includes:
a transformation information transfer unit for transferring the screen color transformation information to an image processing unit (GPU) of the first device;
and the image information conversion unit is used for informing the GPU of carrying out color conversion on the image information in the frame buffer area.
In an embodiment, the transformation information obtaining module is further configured to obtain, in response to receiving a screenshot instruction and receiving a color transformation information displaying instruction, the screen color transformation information of the current screen of the first device, where the color transformation information displaying instruction includes an instruction for displaying the screen color transformation information in the screenshot triggered by a switch displayed on the basis of a user interface, and the switch is configured to switch whether to display the screen color transformation information in the screenshot.
According to a third aspect of the embodiments of the present disclosure, there is provided a screen capture apparatus, including:
a processor, and a memory for storing processor-executable instructions;
wherein the processor is configured to:
responding to a received screenshot instruction, and acquiring screen color transformation information of a current screen of the first equipment;
performing color transformation on image information in an image processing unit (GPU) of the first device based on the screen color transformation information;
and sending the image information after the color change to a second device for the second device to display.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of:
responding to a received screenshot instruction, and acquiring screen color transformation information of a current screen of the first equipment;
performing color transformation on image information in an image processing unit (GPU) of the first device based on the screen color transformation information;
and sending the image information after the color change to a second device for the second device to display.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
the present disclosure obtains screen color transformation information of a current screen of the first device by responding to receiving a screenshot command, and color-transforms image information in an image processing unit (GPU) of the first device based on the screen color transformation information, and then the image information after color change can be sent to the second device for the second device to display, since the image information in the GPU is color-transformed based on the acquired screen color transformation information, it is thus possible to make the image information in the CPU image information transformed based on the screen color transformation information of the current screen, further, the image information after color change can be sent to a second device for the second device to display, the image information which has the same screen post-processing effect as the first device can be displayed in the second device, and the transmission requirement of a user on the image display effect can be met.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
FIG. 1 is a flow chart illustrating a method of image processing according to a first exemplary embodiment;
FIG. 2 is a flow chart illustrating a method of image processing according to a second exemplary embodiment;
FIG. 3 is a flow chart illustrating a method of image processing according to a third exemplary embodiment;
FIG. 4 is a flow diagram illustrating how image information in a GPU may be color transformed in accordance with an exemplary embodiment;
FIG. 5 is a flow chart illustrating a method of image processing according to a fourth exemplary embodiment;
FIG. 6 is a schematic diagram of an application scenario of a method of image processing according to an exemplary embodiment;
FIG. 7 is a block diagram illustrating an image processing apparatus according to an exemplary embodiment;
fig. 8 is a block diagram illustrating an image processing apparatus according to yet another exemplary embodiment;
FIG. 9 is a block diagram illustrating an electronic device in accordance with an example embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
FIG. 1 is a flow chart illustrating a method of image processing according to a first exemplary embodiment; the image processing method of the embodiment can be applied to terminal devices (such as smart phones, tablet computers, smart watches, wearable devices, and the like). As shown in fig. 1, the method comprises the following steps S101-S103:
in step S101, in response to receiving a screenshot command, screen color transformation information of a current screen of the first device is obtained.
In this embodiment, when a user of the terminal device wants to capture an image of a current screen, a capture instruction may be triggered based on a set key, and the terminal device may further respond to the received capture instruction to obtain screen color transformation information of the current screen of the first device.
It should be noted that the above keys may include a virtual key, a physical key, or a shortcut key formed by multiple keys, which is not limited in this embodiment.
In one embodiment, the screen color transformation information may include a color transformation matrix of a screen in the related art.
In an embodiment, each of the post-screen processing color change effects may correspond to a color change matrix, and after obtaining the color information of the original image, the color information of the original image may be color-transformed based on the color change matrix, so that the corresponding post-screen processing color change effect may be represented based on the color-transformed image information.
The screen post-processing color change effect may include at least one of an eye protection mode, a color blindness mode, a color correction mode, a color inversion mode, and a cooling and heating effect mode, which is not limited in this embodiment.
For example, pseudo code information of several color change matrices colorTransform is listed below.
The first method comprises the following steps: the color change matrix for converting colors into gray levels may be defined in the form of:
private static final float[]MATRIX_GRAYSCALE＝new float[]{
.2126f,.2126f,.2126f,0f,
.7152f,.7152f,.7152f,0f,
.0722f,.0722f,.0722f,0f,
0f,0f,0f,1f
}；
and the second method comprises the following steps: a color change matrix for brightness inversion, which may be defined in the form:
private static final float[]MATRIX_INVERT_COLOR＝new float[]{
0.402f,-0.598f,-0.599f,0f,
-1.174f,-0.174f,-1.175f,0f,
-0.228f,-0.228f,0.772f,0f,
1f,1f,1f,1f
}。
in another embodiment, the above-mentioned manner of obtaining the screen color transformation information of the current screen of the first device may refer to the embodiments shown in fig. 2, fig. 3 or fig. 5, which will not be described in detail herein.
In step S102, the image information in the image processing unit GPU of the first device is color-transformed based on the screen color transformation information.
In this embodiment, after screen color transformation information of the current screen of the first device is obtained in response to receiving a screenshot instruction, color transformation may be performed on image information in an image processing unit GPU of the first device based on the screen color transformation information.
It is understood that a GPU (Graphics Processing Unit), also called a display core, a visual processor, a display chip or a drawing chip, is a microprocessor dedicated to running drawing operations on personal computers, workstations, game machines and some mobile devices (e.g., tablet computers, smart phones, etc.). The display device is used for converting and driving display information required by a computer system, providing a line scanning signal for a display and controlling the display of the display correctly, and is an important element for connecting the display and a personal computer mainboard.
For example, after the screen color transformation information of the current screen of the first device is obtained, the screen color transformation information may be transmitted to the GPU, so that the GPU performs color transformation on the image information to be captured based on the screen color transformation information.
In another embodiment, the above-mentioned manner of performing color transformation on the image information in the image processing unit GPU of the first device based on the screen color transformation information may be referred to the embodiment described in fig. 4 below, and will not be described in detail herein.
In step S103, the image information after color change is sent to a second device for display by the second device.
In this embodiment, after performing color transformation on the image information in the GPU of the first device based on the screen color transformation information, the image information after color transformation may be sent to a second device for display by the second device, for example, the image information after color transformation may be acquired and stored, and the acquired image information may be sent to the second device for display by the second device.
For example, when a user a wants to share a currently displayed picture on a first device with a second device of a user B (the user a and the user B may be the same user or different users), a screenshot instruction may be triggered on the first device, and the first device may obtain, in response to the received screenshot instruction, screen color transformation information, such as a screen color transformation matrix, of a current screen of the first device, and then perform color transformation on image information in an image processing unit GPU of the first device based on the screen color transformation information, and further may send the image information after the color transformation to the second device, so that the second device displays the received image information.
It can be understood that, in the related art, a user can set an eye protection mode and the like on the terminal device to process the color change effect after the screen. However, in this case, if the current user captures the screen image and sends the captured image to another user, the situation that the screenshot seen by the current user is inconsistent with the image seen by the other user may occur, and the transmission requirement of the user for the image display effect may not be satisfied. In this embodiment, since the first device performs color conversion on the image information in the GPU based on the acquired screen color conversion information, the image information after color conversion can include the screen color conversion information, so that the same screen post-processing effect as that of the first device can be exhibited when the second device displays the image information after color conversion, and the transfer requirement of the user for the image display effect can be satisfied.
As can be seen from the above description, the present embodiment obtains the screen color transformation information of the current screen of the first device by responding to the received screenshot command, and color-transforms image information in an image processing unit (GPU) of the first device based on the screen color transformation information, and then the image information after color change can be sent to the second device for the second device to display, since the image information in the GPU is color-transformed based on the acquired screen color transformation information, it is thus possible to make the image information in the CPU image information transformed based on the screen color transformation information of the current screen, further, the image information after color change can be sent to a second device for the second device to display, the image information which has the same screen post-processing effect as the first device can be displayed in the second device, and the transmission requirement of a user on the image display effect can be met.
FIG. 2 is a flow chart illustrating a method of image processing according to a second exemplary embodiment; the image processing method of the embodiment can be applied to terminal devices (such as smart phones, tablet computers, smart watches, wearable devices, and the like). As shown in fig. 2, the method comprises the following steps S201-S205:
in step S201, screen color transformation information of a current screen of the first device is monitored.
In this embodiment, after the terminal device is started, the screen color transformation information of the current screen of the first device may be monitored.
In an embodiment, when the set screen post-processing color change effect is turned on the terminal device, the change of the screen color change information can be monitored.
It should be noted that the set post-screen processing color change effect may include at least one of an eye protection mode, a color blindness mode, a color correction mode, a color inversion mode, a cooling and heating effect mode, which is not limited in this embodiment.
In another embodiment, the above-mentioned manner of monitoring the screen color transformation information of the current screen of the first device may be referred to the following embodiment shown in fig. 3, and will not be described in detail herein.
In step S202, if it is monitored that the screen color transformation information changes, the screen color transformation information of the current screen of the first device is updated, so as to obtain updated screen color transformation information.
In this embodiment, when the monitoring of the screen color transformation information of the current screen is started, if it is monitored that the screen color transformation information changes, the screen color transformation information of the current screen may be updated to obtain updated screen color transformation information.
For example, if the terminal device starts the eye protection mode, it may be monitored that the screen color transformation information changes, and then the screen color transformation matrix of the current screen may be updated to obtain the updated screen color transformation matrix.
In step S203, in response to receiving the screenshot command, the updated screen color transformation information is acquired.
In step S204, the image information in the image processing unit GPU of the first device is color-transformed based on the screen color transformation information.
In step S205, the image information after color change is sent to the second device for display by the second device.
For the explanation and description of steps S203-S205, reference may be made to the above embodiments, which are not repeated herein.
As can be seen from the above description, in this embodiment, the screen color transformation information of the current screen of the first device is monitored, and when it is monitored that the screen color transformation information changes, the screen color transformation information of the current screen of the first device is updated to obtain the updated screen color transformation information, so that the accuracy and validity of the screen color transformation information can be ensured, the accuracy and validity of the updated screen color transformation information obtained subsequently can be further improved, a foundation can be laid for subsequently sending the image information with the changed color to the second device for the display of the second device, and since the image information in the GPU is color-transformed based on the monitored screen color transformation information, the image information in the CPU is the image information transformed based on the screen color transformation information of the current screen, and then the image information after the color change can be sent to the second equipment for the second equipment to display, the image information with the same screen post-processing effect as the first equipment can be displayed in the second equipment, and the transfer requirement of a user on the image display effect can be met.
FIG. 3 is a flow chart illustrating a method of image processing according to a third exemplary embodiment; the image processing method of the embodiment can be applied to terminal devices (such as smart phones, tablet computers, smart watches, wearable devices, and the like). As shown in fig. 3, the method comprises the following steps S301-S306:
in step S301, a background servo program is loaded after the first device is started.
In this embodiment, a pre-programmed background servo program may be loaded after the terminal device is started, where the background servo program is used to monitor the screen color transformation information of the current screen.
It should be noted that the pre-written background server program may include a program existing in the related art or a server program written by a developer based on actual business needs, which is not limited in this embodiment.
In step S302, the screen color transformation information of the current screen of the first device is monitored based on the background servo program.
In this embodiment, after the background servo program is loaded after the first device is started, the screen color transformation information of the current screen may be monitored based on the background servo program.
For example, when the eye protection mode of the terminal device is switched from off to on (or from on to off), the background servo program may monitor the screen color change information of the current screen.
In step S303, if it is monitored that the screen color transformation information changes, the screen color transformation information of the current screen of the first device is updated, so as to obtain updated screen color transformation information.
In step S304, in response to receiving the screenshot command, the updated screen color transformation information is obtained.
In step S305, the image information in the image processing unit GPU of the first device is color-transformed based on the screen color transformation information.
In step S306, the image information after color change is sent to the second device for display by the second device.
For the explanation and explanation of steps S303 to S306, reference may be made to the above embodiments, which are not described herein again.
As can be seen from the above description, in this embodiment, the background servo program is loaded after the first device is started, and the operation of monitoring the screen color conversion information of the current screen of the first device is executed based on the background servo program, so that the effect of monitoring the screen color conversion information can be further improved, a foundation can be laid for performing color conversion on image information in the GPU based on the monitored screen color conversion information, and since a screenshot obtained based on the image information after color conversion includes the screen color conversion information, a post-screen processing effect the same as that of the first device can be displayed when the second device displays the image information after color conversion, and further, the transmission demand of a user on the image display effect can be met.
FIG. 4 is a flow diagram illustrating how image information in a GPU may be color transformed in accordance with an exemplary embodiment; the present embodiment is exemplarily described with an example of how to perform color conversion on image information in the GPU on the basis of the above-described embodiments. As shown in fig. 4, the color transformation of the image information in the image processing unit GPU of the first device based on the screen color transformation information in the above step S102 may include the following steps S401 to S402:
in step S401, the screen color transformation information is passed into an image processing unit GPU of the first device.
In this embodiment, after the terminal device obtains the screen color transformation information of the current screen of the first device, the screen color transformation information may be transmitted to the GPU, which is an image processing unit of the first device.
For example, when a background servo program started on the terminal device monitors that the screen color transformation information changes, the screen color transformation information of the current screen may be updated to obtain updated screen color transformation information, and then the updated screen color transformation information may be transmitted to the GPU, which is the image processing unit of the first device.
In step S402, the GPU is notified to perform color conversion on the image information in the frame buffer.
In this embodiment, after the screen color transformation information is transmitted to the GPU, the GPU may be notified to perform color transformation on the image information in the frame buffer.
The specific way of the GPU performing color transformation on the image information in the frame buffer may refer to related technologies, which is not limited in this embodiment.
As can be seen from the above description, in this embodiment, the screen color transformation information is transmitted to the GPU in the image processing unit of the first device, and the GPU is notified to perform color transformation on the image information in the frame buffer, so that color transformation on the image information in the GPU can be realized, and then color transformation on the image information in the GPU can be subsequently performed based on the screen color transformation information, so that the same post-screen processing effect as that of the first device can be exhibited when the second device displays the color-transformed image information, and further, the transmission requirement of the user for the image display effect can be satisfied.
FIG. 5 is a flow chart illustrating a method of image processing according to a fourth exemplary embodiment; the image processing method of the embodiment can be applied to terminal devices (such as smart phones, tablet computers, smart watches, wearable devices, and the like). As shown in fig. 5, the method includes the following steps S501 to S503:
in step S501, in response to receiving the screenshot command and receiving the color transformation information displaying command, acquiring the screen color transformation information of the current screen of the first device.
In this embodiment, after the terminal device detects a screenshot instruction triggered by a user, it may be determined whether a color transformation information display instruction is received, and then, under the condition that the color transformation information display instruction is received, the screen color transformation information of the current screen of the first device may be obtained.
The color transformation information display instruction may include an instruction for displaying the screen color transformation information in the screenshot triggered by a switch displayed on the user interface, where the switch is used to switch whether to display the screen color transformation information in the screenshot.
For example, a switch for switching whether to present the screen color transition information in the screenshot may be provided in the system setting options of the terminal device. If the image information obtained after the user wants to perform screenshot operation includes the screen post-processing effect of the terminal device, the switch can be turned on to trigger generation of the color transformation information display instruction, and then the terminal device can acquire the screen color transformation information of the current screen of the first device under the condition that the terminal device receives the color transformation information display instruction.
It can be understood that, if the color conversion information display instruction is not received, the terminal device may capture the image information of the current screen according to the capture mode existing in the related art, that is, the captured image does not include the screen color conversion information, so that the same post-screen processing effect as that of the first device cannot be displayed when the second device displays the image information after the color conversion.
In step S502, color transformation is performed on image information in an image processing unit GPU of the first device based on the screen color transformation information.
In step S503, the image information after color change is sent to the second device for display by the second device.
For the explanation and description of steps S502-S503, reference may be made to the above embodiments, which are not described herein again.
As can be seen from the above description, in this embodiment, the screen color conversion information of the current screen of the first device is obtained in response to the received screenshot instruction and the received color conversion information display instruction, and the color conversion information display instruction is an instruction triggered by the switch for displaying the screen color conversion information in the screenshot based on the user interface, so that the screen color conversion information of the current screen of the first device can be obtained based on the user's requirement, a foundation can be laid for performing color conversion on image information in the GPU subsequently based on the screen color conversion information, the same post-screen processing effect as that of the first device can be displayed when the second device displays the image information after color conversion, and the transmission requirement of the user on the image display effect can be satisfied.
FIG. 6 is a schematic diagram of an application scenario of a method of image processing according to an exemplary embodiment; wherein the application scenario involves the terminal device 100 of user a and the terminal device 200 of user B. As shown in fig. 6, when a user a wants to share a currently displayed picture on the terminal device 100 with a user B, a screenshot instruction may be triggered on the terminal device 100, and then the terminal device 100 may obtain, in response to the received screenshot instruction, screen color transformation information, such as a screen color transformation matrix, of a current screen of the first device, and then may perform color transformation on image information in an image processing unit GPU of the terminal device 100 based on the screen color transformation information, and further may send the image information after the color transformation to the terminal device 200, so that the terminal device 200 may display the received image information 201. The user a may control the terminal device 100 to establish a wireless connection (e.g., bluetooth, etc.) or an instant messaging connection (e.g., WeChat or QQ, etc.) with the terminal device 200 of the user B, and then may send the image information after the color change to the terminal device 200 based on the established connection, so that the user B may display the received image information 201 on the terminal device 200. Since the terminal device 100 performs color conversion on the image information in the GPU based on the acquired screen color conversion information, the image information after color conversion can include the screen color conversion information, so that the terminal device 200 can exhibit the same screen post-processing effect as the terminal device 100 when displaying the image information after color conversion, and can meet the transmission requirement of the user a for the image display effect.
Fig. 7 is a block diagram illustrating an image processing apparatus according to an exemplary embodiment. The image processing apparatus of the embodiment can be applied to terminal devices (e.g., smart phones, tablet computers, smart watches, wearable devices, etc.). As shown in fig. 7, the apparatus includes: a transformation information obtaining module 110, an image information transformation module 120, and an image information sending module 130, wherein:
a transformation information obtaining module 110, configured to, in response to receiving a screenshot instruction, obtain screen color transformation information of a current screen of the first device;
an image information transformation module 120 for performing color transformation on image information in an image processing unit GPU of the first device based on the screen color transformation information;
an image information sending module 130, configured to send image information.
As can be seen from the above description, in this embodiment, in response to receiving a screenshot instruction, screen color transformation information of a current screen of the first device is obtained, and color transformation is performed on image information in a GPU of an image processing unit of the first device based on the screen color transformation information, and then, since color transformation is performed on image information in the GPU based on the obtained screen color transformation information, image information in a CPU can be transformed based on the screen color transformation information of the current screen, and then image information after color transformation can be sent to the second device for display by the second device, so that image information with the same post-screen processing effect as that of the first device can be displayed in the second device, and a transfer requirement of a user for an image display effect can be met.
Fig. 8 is a block diagram illustrating an image processing apparatus according to yet another exemplary embodiment; the image processing apparatus of the embodiment can be applied to terminal devices (e.g., smart phones, tablet computers, smart watches, wearable devices, etc.). The transformation information obtaining module 210, the image information transformation module 220, and the image information sending module 230 have the same functions as the transformation information obtaining module 110, the image information transformation module 120, and the image information sending module 130 in the embodiment shown in fig. 7, and are not described herein again.
As shown in fig. 8, the above apparatus may further include an update information obtaining module 240;
the update information obtaining module 240 may include:
a transformation information monitoring unit 241, configured to monitor screen color transformation information of a current screen of the first device;
an update information obtaining unit 242, configured to update the screen color transformation information of the current screen of the first device when it is monitored that the screen color transformation information changes, so as to obtain updated screen color transformation information;
the transformation information obtaining module 210 may be further configured to obtain the updated screen color transformation information in response to receiving the screenshot command.
In an embodiment, the update information obtaining module 240 may further include:
a servo program loading unit 243, configured to load a background servo program after the first device is started;
the transformation information monitoring unit 241 may be further configured to perform the operation of monitoring the screen color transformation information of the current screen of the first device based on the background server.
In an embodiment, the image information transformation module 220 may include:
a transformation information introduction unit 221 for introducing the screen color transformation information into an image processing unit GPU of the first device;
an image information transformation unit 222 for informing the GPU of color transformation of the image information in the frame buffer.
In an embodiment, the transformation information obtaining module 210 may be further configured to obtain, in response to receiving the screenshot command and receiving a color transformation information displaying command, the screen color transformation information of the current screen of the first device, where the color transformation information displaying command may include a command for displaying the screen color transformation information in the screenshot triggered based on a switch displayed on a user interface, and the switch is configured to switch whether to display the screen color transformation information in the screenshot.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
FIG. 9 is a block diagram illustrating an electronic device in accordance with an example embodiment. For example, the device 900 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and so forth.
Referring to fig. 9, device 900 may include one or more of the following components: processing component 902, memory 904, power component 906, multimedia component 908, audio component 910, input/output (I/O) interface 912, sensor component 914, and communication component 916.
The processing component 902 generally controls the overall operation of the device 900, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. Processing element 902 may include one or more processors 920 to execute instructions to perform all or a portion of the steps of the methods described above. Further, processing component 902 can include one or more modules that facilitate interaction between processing component 902 and other components. For example, the processing component 902 can include a multimedia module to facilitate interaction between the multimedia component 908 and the processing component 902.
The memory 904 is configured to store various types of data to support operation at the device 900. Examples of such data include instructions for any application or method operating on device 900, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 904 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The multimedia components 908 include a screen that provides an output interface between the device 900 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 900 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 910 is configured to output and/or input audio signals. For example, audio component 910 includes a Microphone (MIC) configured to receive external audio signals when device 900 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 904 or transmitted via the communication component 916. In some embodiments, audio component 910 also includes a speaker for outputting audio signals.
I/O interface 912 provides an interface between processing component 902 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor component 914 includes one or more sensors for providing status assessment of various aspects of the device 900. For example, the sensor component 914 may detect an open/closed state of the device 900, the relative positioning of components, such as a display and keypad of the device 900, the sensor component 914 may also detect a change in the position of the device 900 or a component of the device 900, the presence or absence of user contact with the device 900, orientation or acceleration/deceleration of the device 900, and a change in the temperature of the device 900. The sensor assembly 914 may also include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 916 is configured to facilitate communications between the device 900 and other devices in a wired or wireless manner. The device 900 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 916 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the device 900 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described image processing methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 904 comprising instructions, executable by the processor 920 of the device 900 to perform the image processing method described above is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (12)
1. An image processing method applied to a first device, the method comprising:
responding to a received screenshot instruction, and acquiring screen color transformation information of a current screen of the first equipment;
performing color transformation on image information in an image processing unit (GPU) of the first device based on the screen color transformation information;
and sending the image information after the color change to a second device for the second device to display.
2. The method of claim 1, further comprising:
monitoring screen color transformation information of the current screen of the first equipment;
if the change of the screen color transformation information is monitored, updating the screen color transformation information of the current screen of the first equipment to obtain updated screen color transformation information;
the obtaining of the screen color transformation information of the current screen of the first device in response to receiving the screenshot command includes:
and responding to the received screenshot instruction, and acquiring the updated screen color transformation information.
3. The method of claim 2, further comprising:
loading a background servo program after the first equipment is started;
and executing the operation of monitoring the screen color transformation information of the current screen of the first equipment based on the background servo program.
4. The method of claim 1, wherein the color transforming image information in an image processing unit (GPU) of the first device based on the screen color transformation information comprises:
transmitting the screen color transformation information to an image processing unit (GPU) of the first device;
and informing the GPU to carry out color transformation on the image information in the frame buffer area.
5. The method of claim 1, wherein obtaining screen color transformation information of a current screen of the first device in response to receiving a screenshot command comprises:
the method comprises the steps of responding to a received screenshot command and a received color transformation information display command, obtaining the screen color transformation information of a current screen of the first equipment, wherein the color transformation information display command comprises a command which is triggered by a switch displayed on the basis of a user interface and is used for displaying the screen color transformation information in a screenshot, and the switch is used for switching whether the screen color transformation information is displayed in the screenshot or not.
6. An image processing apparatus, applied to a first device, the apparatus comprising:
the conversion information acquisition module is used for responding to the received screenshot instruction and acquiring the screen color conversion information of the current screen of the first equipment;
the image information transformation module is used for carrying out color transformation on the image information in the GPU of the first equipment based on the screen color transformation information;
and the image information sending module is used for sending the image information with the changed color to the second equipment so as to be displayed by the second equipment.
7. The apparatus of claim 6, further comprising an update information acquisition module;
the update information acquisition module includes:
the conversion information monitoring unit is used for monitoring the screen color conversion information of the current screen of the first equipment;
the updating information acquiring unit is used for updating the screen color conversion information of the current screen of the first device when the change of the screen color conversion information is monitored, so as to obtain the updated screen color conversion information;
the transformation information acquisition module is further used for responding to the received screenshot command and acquiring the updated screen color transformation information.
8. The apparatus of claim 7, wherein the update information obtaining module further comprises:
the servo program loading unit is used for loading a background servo program after the first equipment is started;
the transformation information monitoring unit is further configured to execute the operation of monitoring the screen color transformation information of the current screen of the first device based on the background servo program.
9. The apparatus of claim 6, wherein the image information transformation module comprises:
a transformation information transfer unit for transferring the screen color transformation information to an image processing unit (GPU) of the first device;
and the image information conversion unit is used for informing the GPU of carrying out color conversion on the image information in the frame buffer area.
10. The apparatus of claim 6, wherein the transformation information obtaining module is further configured to obtain the screen color transformation information of the current screen of the first device in response to receiving the screenshot command and receiving the color transformation information showing command, and the color transformation information showing command includes a command for showing the screen color transformation information in the screenshot triggered by a switch displayed on the user interface, and the switch is configured to switch whether to show the screen color transformation information in the screenshot.
11. A screenshot device, comprising:
a processor, and a memory for storing processor-executable instructions;
wherein the processor is configured to:
responding to a received screenshot instruction, and acquiring screen color transformation information of a current screen of the first equipment;
performing color transformation on image information in an image processing unit (GPU) of the first device based on the screen color transformation information;
and sending the image information after the color change to a second device for the second device to display.
12. A computer-readable storage medium, on which a computer program is stored, which program, when executed by a processor, carries out the steps of:
responding to a received screenshot instruction, and acquiring screen color transformation information of a current screen of the first equipment;
performing color transformation on image information in an image processing unit (GPU) of the first device based on the screen color transformation information;
and sending the image information after the color change to a second device for the second device to display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010535340.XA CN113810675B (en) | 2020-06-12 | 2020-06-12 | Image processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010535340.XA CN113810675B (en) | 2020-06-12 | 2020-06-12 | Image processing method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113810675A true CN113810675A (en) | 2021-12-17 |
| CN113810675B CN113810675B (en) | 2024-03-12 |
Family
ID=78892108
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010535340.XA Active CN113810675B (en) | 2020-06-12 | 2020-06-12 | Image processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113810675B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117149028A (en) * | 2023-10-27 | 2023-12-01 | Tcl通讯科技（成都）有限公司 | Display control method and device, storage medium and terminal equipment |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1185963A (en) * | 1997-04-30 | 1999-03-30 | Canon Inf Syst Res Australia Pty Ltd | Device and method for image processing |
| CN1588302A (en) * | 2004-08-05 | 2005-03-02 | 深圳市友邻通讯设备有限公司 | Computer screen catching monitoring and recording method |
| US7042464B1 (en) * | 2003-08-01 | 2006-05-09 | Apple Computer, Inc. | Methods and apparatuses for the automated display of visual effects |
| CN102665135A (en) * | 2012-04-18 | 2012-09-12 | 山东大学 | Embedded screen transmission system and operating method thereof |
| CA2924461A1 (en) * | 2013-09-20 | 2015-03-26 | A2Zlogix, Inc. | System and method for reducing visible artifacts in the display of compressed and decompressed digital images and video |
| CN105451198A (en) * | 2014-09-30 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Method and device for sharing picture in instant messaging |
| CN105847936A (en) * | 2016-03-31 | 2016-08-10 | 乐视控股（北京）有限公司 | Display control method and device, and terminal |
| US20160231917A1 (en) * | 2015-02-10 | 2016-08-11 | Samsung Electronics Co., Ltd. | Display apparatus and display method |
| KR20160097050A (en) * | 2015-02-06 | 2016-08-17 | 삼성전자주식회사 | Method and apparatus for displaying composition screen by composing the OS screens |
| US20180154258A1 (en) * | 2016-12-07 | 2018-06-07 | Nintendo Co., Ltd. | Storage medium, information processing apparatus and information processing method |
| CN108335659A (en) * | 2018-01-02 | 2018-07-27 | 联想(北京)有限公司 | Method for displaying image and equipment |
| CN108347452A (en) * | 2017-01-23 | 2018-07-31 | 腾讯科技（深圳）有限公司 | The long-range method and device for obtaining screenshot capture |
| CN108604234A (en) * | 2015-07-15 | 2018-09-28 | 查比公司 | System and method for screenshot capture link |
| CN208572286U (en) * | 2018-07-26 | 2019-03-01 | 漳州市利利普电子科技有限公司 | A kind of monitor of accurate display color |
| CN110377391A (en) * | 2019-07-17 | 2019-10-25 | Oppo广东移动通信有限公司 | Image display method, device, mobile terminal and storage medium |
-
2020
- 2020-06-12 CN CN202010535340.XA patent/CN113810675B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1185963A (en) * | 1997-04-30 | 1999-03-30 | Canon Inf Syst Res Australia Pty Ltd | Device and method for image processing |
| US7042464B1 (en) * | 2003-08-01 | 2006-05-09 | Apple Computer, Inc. | Methods and apparatuses for the automated display of visual effects |
| CN1588302A (en) * | 2004-08-05 | 2005-03-02 | 深圳市友邻通讯设备有限公司 | Computer screen catching monitoring and recording method |
| CN102665135A (en) * | 2012-04-18 | 2012-09-12 | 山东大学 | Embedded screen transmission system and operating method thereof |
| CA2924461A1 (en) * | 2013-09-20 | 2015-03-26 | A2Zlogix, Inc. | System and method for reducing visible artifacts in the display of compressed and decompressed digital images and video |
| CN105451198A (en) * | 2014-09-30 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Method and device for sharing picture in instant messaging |
| KR20160097050A (en) * | 2015-02-06 | 2016-08-17 | 삼성전자주식회사 | Method and apparatus for displaying composition screen by composing the OS screens |
| US20160231917A1 (en) * | 2015-02-10 | 2016-08-11 | Samsung Electronics Co., Ltd. | Display apparatus and display method |
| CN108604234A (en) * | 2015-07-15 | 2018-09-28 | 查比公司 | System and method for screenshot capture link |
| CN105847936A (en) * | 2016-03-31 | 2016-08-10 | 乐视控股（北京）有限公司 | Display control method and device, and terminal |
| US20180154258A1 (en) * | 2016-12-07 | 2018-06-07 | Nintendo Co., Ltd. | Storage medium, information processing apparatus and information processing method |
| CN108347452A (en) * | 2017-01-23 | 2018-07-31 | 腾讯科技（深圳）有限公司 | The long-range method and device for obtaining screenshot capture |
| CN108335659A (en) * | 2018-01-02 | 2018-07-27 | 联想(北京)有限公司 | Method for displaying image and equipment |
| CN208572286U (en) * | 2018-07-26 | 2019-03-01 | 漳州市利利普电子科技有限公司 | A kind of monitor of accurate display color |
| CN110377391A (en) * | 2019-07-17 | 2019-10-25 | Oppo广东移动通信有限公司 | Image display method, device, mobile terminal and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 刘新宁;君懿;: "数字视频信号捕捉控制器设计", 电子器件, no. 06, 20 December 2008 (2008-12-20) * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117149028A (en) * | 2023-10-27 | 2023-12-01 | Tcl通讯科技（成都）有限公司 | Display control method and device, storage medium and terminal equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113810675B (en) | 2024-03-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3173923A1 (en) | Method and device for image display | |
| CN111580904B (en) | Display state switching method, display state switching device and storage medium | |
| CN110231901B (en) | Application interface display method and device | |
| CN111078170B (en) | Display control method, display control device, and computer-readable storage medium | |
| CN113032030A (en) | Camera starting method and device, terminal equipment and storage medium | |
| CN112331158B (en) | Terminal display adjusting method, device, equipment and storage medium | |
| CN113810675B (en) | Image processing method, device, equipment and storage medium | |
| CN111261081B (en) | Screen display method and device | |
| CN112423092A (en) | Video recording method and video recording device | |
| CN108877697B (en) | Method and device for displaying image | |
| CN115914721A (en) | Live broadcast picture processing method and device, electronic equipment and storage medium | |
| CN113257177B (en) | Brightness control method and device and electronic equipment | |
| CN114268691A (en) | Call method, device, terminal equipment and readable storage medium | |
| CN116208350A (en) | Digital car key registration method, device and storage medium | |
| CN114442789A (en) | Dark screen control method, device, equipment and storage medium | |
| CN109981729B (en) | File processing method and device, electronic equipment and computer readable storage medium | |
| CN112527160A (en) | Method and device for displaying icons on information screen, processor and display equipment | |
| CN111124099A (en) | State control method, device and storage medium | |
| CN111381407A (en) | Display panel, display device, scanning method and device | |
| CN110955328B (en) | Control method and device of electronic equipment and storage medium | |
| US11961488B2 (en) | Method and device for controlling screen of electronic device, related electronic device and storage medium | |
| CN112506393B (en) | Icon display method and device and storage medium | |
| CN110876013B (en) | Method and device for determining image resolution, electronic equipment and storage medium | |
| CN117369615A (en) | Electronic equipment control method and device, storage medium and electronic equipment | |
| CN116419062A (en) | Image processing method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |