CN113810675B - Image processing method, device, equipment and storage medium - Google Patents
Image processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN113810675B CN113810675B CN202010535340.XA CN202010535340A CN113810675B CN 113810675 B CN113810675 B CN 113810675B CN 202010535340 A CN202010535340 A CN 202010535340A CN 113810675 B CN113810675 B CN 113810675B
- Authority
- CN
- China
- Prior art keywords
- information
- screen
- screen color
- color conversion
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 23
- 238000006243 chemical reaction Methods 0.000 claims abstract description 154
- 230000009466 transformation Effects 0.000 claims abstract description 138
- 238000012545 processing Methods 0.000 claims abstract description 64
- 238000000034 method Methods 0.000 claims abstract description 19
- 230000005540 biological transmission Effects 0.000 claims abstract description 12
- 230000008859 change Effects 0.000 claims description 24
- 230000004044 response Effects 0.000 claims description 24
- 238000012544 monitoring process Methods 0.000 claims description 17
- 230000001960 triggered effect Effects 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 31
- 238000012805 post-processing Methods 0.000 abstract description 11
- 238000004891 communication Methods 0.000 description 11
- 239000011159 matrix material Substances 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 230000003068 static effect Effects 0.000 description 3
- 230000001131 transforming effect Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 2
- 238000001816 cooling Methods 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000010438 heat treatment Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 241001270131 Agaricus moelleri Species 0.000 description 1
- 208000006992 Color Vision Defects Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 201000007254 color blindness Diseases 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011982 device technology Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/68—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Controls And Circuits For Display Device (AREA)
- Image Processing (AREA)
Abstract
The present disclosure relates to an image processing method, apparatus, device, and storage medium. The method comprises the following steps: acquiring screen color conversion information of a current screen of the first device, and carrying out color conversion on image information in an image processing unit GPU of the first device based on the screen color conversion information. The image information in the GPU is subjected to color transformation based on the acquired screen color transformation information, so that the image information in the CPU is the image information transformed based on the screen color transformation information of the current screen, the image information after color transformation can be further sent to the second equipment for display by the second equipment, the image information with the same screen post-processing effect as that of the first equipment can be displayed in the second equipment, and the transmission requirement of a user on the image display effect can be met.
Description
Technical Field
The disclosure relates to the technical field of terminal equipment, and in particular relates to an image processing method, an image processing device and a storage medium.
Background
As mobile device technology continues to evolve and mobile terminals become popular in people's daily lives, the demand for entertainment and intelligence from mobile terminals has increased from day . The screen capturing function of the mobile terminal is convenient for users to share information, and the interestingness is increased. The user can share the page on the mobile terminal with other people or can intercept the smile of the voice of the calling party in the video telephone and send the intercepted voice to friends so as to increase the entertainment of communication.
In the related art, a user can set a screen post-process color change effect such as an eye protection mode on a terminal device. However, in this case, if the current user performs the screenshot on the screen image and sends the intercepted image to other users, the condition that the screenshot seen by the current user is inconsistent with the images seen by other users may occur, and the transmission requirement of the user on the image display effect cannot be met.
Inventive image information
To overcome the problems in the related art, embodiments of the present disclosure provide an image processing method, apparatus, device, and storage medium, which are used to solve the drawbacks in the related art.
According to a first aspect of an embodiment of the present disclosure, there is provided an image processing method including:
responding to the receiving screenshot instruction, and acquiring screen color transformation information of a current screen of the first equipment;
performing color conversion on image information in an image processing unit GPU of the first device based on the screen color conversion information;
and sending the image information with the changed color to a second device for display by the second device.
In an embodiment, the method further comprises:
monitoring screen color conversion information of a current screen of the first equipment;
If the screen color conversion information is monitored to change, updating the screen color conversion information of the current screen of the first equipment to obtain updated screen color conversion information;
the responding to the receiving of the screenshot instruction, the screen color transformation information of the current screen of the first device is obtained, and the method comprises the following steps:
and responding to the receiving screenshot instruction, and acquiring the updated screen color transformation information.
In an embodiment, the method further comprises:
loading a background servo program after the first equipment is started;
and executing the operation of monitoring the screen color conversion information of the current screen of the first equipment based on the background servo program.
In an embodiment, the performing color transformation on the image information in the image processing unit GPU of the first device based on the screen color transformation information includes:
transmitting the screen color transformation information into an image processing unit GPU of the first device;
the GPU is informed to perform color transformation on the image information in the frame buffer.
In an embodiment, the obtaining, in response to receiving the screenshot instruction, screen color transformation information of a current screen of the first device includes:
And in response to receiving the screenshot instruction and receiving the color transformation information display instruction, acquiring screen color transformation information of a current screen of the first device, wherein the color transformation information display instruction comprises an instruction for displaying the screen color transformation information in the screenshot triggered by a switch based on user interface display, and the switch is used for switching whether to display the screen color transformation information in the screenshot.
According to a second aspect of embodiments of the present disclosure, there is provided an image processing apparatus including:
the transformation information acquisition module is used for responding to the receiving of the screenshot instruction and acquiring screen color transformation information of the current screen of the first equipment;
an image information conversion module, configured to perform color conversion on image information in an image processing unit GPU of the first device based on the screen color conversion information;
and the image information sending module is used for sending the image information with the changed color to the second equipment for display by the second equipment.
In an embodiment, the apparatus further comprises an update information acquisition module;
the update information acquisition module includes:
the conversion information monitoring unit is used for monitoring screen color conversion information of the current screen of the first equipment;
The updating information acquisition unit is used for updating the screen color conversion information of the current screen of the first equipment when the screen color conversion information is monitored to change, so as to obtain updated screen color conversion information;
the transformation information acquisition module is also used for acquiring the updated screen color transformation information in response to receiving the screenshot instruction.
In an embodiment, the update information acquisition module further includes:
the servo program loading unit is used for loading a background servo program after the first equipment is started;
the transformation information monitoring unit is further used for executing the operation of monitoring the screen color transformation information of the current screen of the first device based on the background servo program.
In an embodiment, the image information transformation module includes:
the transformation information transmitting unit is used for transmitting the screen color transformation information to the image processing unit GPU of the first device;
and the image information conversion unit is used for informing the GPU to carry out color conversion on the image information in the frame buffer.
In an embodiment, the transformation information obtaining module is further configured to obtain, in response to receiving a screenshot instruction and receiving a color transformation information presentation instruction, screen color transformation information of a current screen of the first device, where the color transformation information presentation instruction includes an instruction for presenting screen color transformation information in a screenshot triggered based on a switch presented by a user interface, where the switch is configured to switch whether to present screen color transformation information in the screenshot.
According to a third aspect of embodiments of the present disclosure, there is provided a screenshot device comprising:
a processor and a memory for storing processor-executable instructions;
wherein the processor is configured to:
responding to the receiving screenshot instruction, and acquiring screen color transformation information of a current screen of the first equipment;
performing color conversion on image information in an image processing unit GPU of the first device based on the screen color conversion information;
and sending the image information with the changed color to a second device for display by the second device.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of:
responding to the receiving screenshot instruction, and acquiring screen color transformation information of a current screen of the first equipment;
performing color conversion on image information in an image processing unit GPU of the first device based on the screen color conversion information;
and sending the image information with the changed color to a second device for display by the second device.
The technical scheme provided by the embodiment of the disclosure can comprise the following beneficial effects:
According to the method and the device, the screen color transformation information of the current screen of the first device is obtained in response to receiving the screenshot instruction, the image information in the GPU of the image processing unit of the first device is subjected to color transformation based on the screen color transformation information, and then the image information after color transformation can be sent to the second device for display, and as the image information in the GPU is subjected to color transformation based on the obtained screen color transformation information, the image information in the CPU can be the image information transformed based on the screen color transformation information of the current screen, and then the image information after color transformation can be sent to the second device for display, so that the image information with the same screen post-processing effect as that of the first device can be displayed in the second device, and the transmission requirement of a user on the image display effect can be met.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flowchart of an image processing method according to a first exemplary embodiment;
fig. 2 is a flowchart of an image processing method according to a second exemplary embodiment;
fig. 3 is a flowchart of an image processing method according to a third exemplary embodiment;
FIG. 4 is a flowchart illustrating how to color transform image information in a GPU, according to an example embodiment;
fig. 5 is a flowchart of an image processing method according to a fourth exemplary embodiment;
FIG. 6 is a schematic view of an application scenario of an image processing method according to an exemplary embodiment;
fig. 7 is a block diagram of an image processing apparatus according to an exemplary embodiment;
fig. 8 is a block diagram of an image processing apparatus according to still another exemplary embodiment;
fig. 9 is a block diagram of an electronic device, according to an example embodiment.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.
Fig. 1 is a flowchart of an image processing method according to a first exemplary embodiment; the image processing method of the embodiment can be applied to terminal equipment (such as a smart phone, a tablet computer, a smart watch, a wearable device and the like). As shown in fig. 1, the method includes the following steps S101-S103:
in step S101, screen color conversion information of a current screen of the first device is acquired in response to receiving a screenshot instruction.
In this embodiment, when the user of the terminal device wants to intercept the image of the current screen, the screenshot instruction may be triggered based on the set key, and then the terminal device may obtain the screen color conversion information of the current screen of the first device in response to receiving the screenshot instruction.
It should be noted that the above keys may include a virtual key, a physical key, or a shortcut key formed by a plurality of keys, which is not limited in this embodiment.
In an embodiment, the screen color transformation information may include a color transformation matrix of a screen in the related art.
In an embodiment, each of the post-processing color change effects may correspond to a color change matrix, and after obtaining the color information of the original image, the color information of the original image may be subjected to color conversion based on the color change matrix, so that the corresponding post-processing color change effect may be expressed based on the image information after the color conversion.
The screen post-processing color change effect may include at least one of an eye protection mode, a color blind mode, a color correction mode, a color inversion mode, a cooling and heating effect mode, and the like, which is not limited in this embodiment.
For example, the following lists pseudo code information for several color change matrices color transform.
First kind: the color change matrix for converting colors into gray scales may be defined as follows:
private static final float[]MATRIX_GRAYSCALE＝new float[]{
.2126f,.2126f,.2126f,0f,
.7152f,.7152f,.7152f,0f,
.0722f,.0722f,.0722f,0f,
0f,0f,0f,1f
}；
second kind: a color change matrix for brightness inversion, which can be defined as follows:
private static final float[]MATRIX_INVERT_COLOR＝new float[]{
0.402f,-0.598f,-0.599f,0f,
-1.174f,-0.174f,-1.175f,0f,
-0.228f,-0.228f,0.772f,0f,
1f,1f,1f,1f
}。
in another embodiment, the above manner of obtaining the screen color conversion information of the current screen of the first device may be referred to the embodiments shown in fig. 2, 3 or 5, which are not described in detail herein.
In step S102, image information in an image processing unit GPU of the first device is color-transformed based on the screen color transformation information.
In this embodiment, after obtaining the screen color conversion information of the current screen of the first device in response to receiving the screenshot instruction, color conversion may be performed on the image information in the GPU of the image processing unit of the first device based on the screen color conversion information.
It will be appreciated that the GPU (image processing unit, graphics Processing Unit), also known as a display core, vision processor, display chip or graphics chip, is a microprocessor that runs graphics operations on personal computers, workstations, gaming machines, and some mobile devices (e.g., tablet computers, smartphones, etc.). The display information required by the computer system is converted and driven, and a line scanning signal is provided for the display to control the correct display of the display, so that the display is an important element for connecting the display and a personal computer main board.
For example, after acquiring the screen color conversion information of the current screen of the first device, the screen color conversion information may be transmitted to the GPU, so as to perform color conversion on the image information to be intercepted by the GPU based on the screen color conversion information.
In another embodiment, the above manner of performing color conversion on the image information in the image processing unit GPU of the first device based on the screen color conversion information may be referred to as the embodiment shown in fig. 4 and will not be described in detail herein.
In step S103, the color-changed image information is sent to the second device for display by the second device.
In this embodiment, after performing color conversion on the image information in the GPU of the first device based on the screen color conversion information, the image information after the color conversion may be sent to a second device for display by the second device, for example, the image information after the color conversion may be acquired and stored, and the acquired image information may be sent to the second device for display by the second device.
For example, when the user a wants to share the currently displayed picture on the first device with the second device of the user B (the user a and the user B may be the same user or different users), a screenshot instruction may be triggered on the first device, and then the first device may obtain, in response to the received screenshot instruction, screen color transformation information, such as a screen color transformation matrix, of the current screen of the first device, and then may perform color transformation on image information in the GPU of the image processing unit of the first device based on the screen color transformation information, and then may send the image information after color transformation to the second device for the second device to display the received image information.
It is understood that a user in the related art may set a screen post-process color change effect such as an eye protection mode on a terminal device. However, in this case, if the current user performs the screenshot on the screen image and sends the intercepted image to other users, the condition that the screenshot seen by the current user is inconsistent with the images seen by other users may occur, and the transmission requirement of the user on the image display effect cannot be met. In this embodiment, the first device performs color conversion on the image information in the GPU based on the acquired screen color conversion information, so that the color-converted image information includes the screen color conversion information, thereby realizing that the same screen post-processing effect as that of the first device can be displayed when the second device displays the color-converted image information, and meeting the transmission requirement of the user on the image display effect.
As can be seen from the foregoing description, in this embodiment, by acquiring the screen color conversion information of the current screen of the first device in response to receiving the screenshot instruction, and performing color conversion on the image information in the GPU of the image processing unit of the first device based on the screen color conversion information, further, the image information after color conversion may be sent to the second device for display by the second device, and because the image information in the GPU is subjected to color conversion based on the acquired screen color conversion information, the image information in the CPU may be the image information converted based on the screen color conversion information of the current screen, further, the image information after color conversion may be sent to the second device for display by the second device, and thus, the image information with the same post-screen processing effect as that of the first device may be displayed in the second device may be realized, and the transmission requirement of the user on the image display effect may be satisfied.
Fig. 2 is a flowchart of an image processing method according to a second exemplary embodiment; the image processing method of the embodiment can be applied to terminal equipment (such as a smart phone, a tablet computer, a smart watch, a wearable device and the like). As shown in fig. 2, the method includes the following steps S201 to S205:
In step S201, the screen color conversion information of the current screen of the first device is monitored.
In this embodiment, after the terminal device is started, the screen color conversion information of the current screen of the first device may be monitored.
In one embodiment, when the set screen post-processing color change effect is turned on the terminal device, the change of the screen color conversion information can be monitored.
Note that the above-mentioned set post-screen processing color change effect may include at least one of an eye protection mode, a color blindness mode, a color correction mode, a color inversion mode, a cooling and heating effect mode, and the like, which is not limited in this embodiment.
In another embodiment, the above manner of monitoring the screen color conversion information of the current screen of the first device may be referred to the embodiment shown in fig. 3 below, which is not described in detail herein.
In step S202, if it is monitored that the screen color conversion information changes, the screen color conversion information of the current screen of the first device is updated, so as to obtain updated screen color conversion information.
In this embodiment, if the monitoring of the screen color conversion information of the current screen is monitored, the screen color conversion information of the current screen may be updated to obtain updated screen color conversion information.
For example, if the terminal device starts the eye protection mode, it may monitor that the screen color transformation information changes, and then update the screen color transformation matrix of the current screen to obtain an updated screen color transformation matrix.
In step S203, in response to receiving the screenshot instruction, the updated screen color transformation information is acquired.
In step S204, image information in an image processing unit GPU of the first device is color-transformed based on the screen color transformation information.
In step S205, the color-changed image information is sent to a second device for display by the second device.
The explanation and explanation of steps S203 to S205 may be referred to the above embodiments, and are not repeated here.
As can be seen from the foregoing description, in this embodiment, by monitoring the screen color conversion information of the current screen of the first device, and updating the screen color conversion information of the current screen of the first device when it is monitored that the screen color conversion information changes, the updated screen color conversion information is obtained, so that accuracy and effectiveness of the screen color conversion information can be ensured, further accuracy and effectiveness of the subsequently obtained updated screen color conversion information can be improved, the subsequently obtained image information after color change can be sent to the second device for the second device to lay a foundation for display, and because the image information in the GPU is subjected to color conversion based on the monitored screen color conversion information, the image information in the CPU is the image information converted based on the screen color conversion information of the current screen, and further the image information after color change can be sent to the second device for display of the second device, so that the image information with the same post-screen processing effect as the first device can be displayed in the second device, and the requirement of a user for image display can be met.
Fig. 3 is a flowchart of an image processing method according to a third exemplary embodiment; the image processing method of the embodiment can be applied to terminal equipment (such as a smart phone, a tablet computer, a smart watch, a wearable device and the like). As shown in fig. 3, the method includes the following steps S301 to S306:
in step S301, a background servo program is loaded after the first device is started.
In this embodiment, after the terminal device is started, a pre-written background servo program may be loaded, where the background servo program is used to monitor the screen color conversion information of the current screen.
It should be noted that the above-mentioned pre-written background servo program may include a servo program already existing in the related art or written by a developer based on actual service needs, which is not limited in this embodiment.
In step S302, the screen color conversion information of the current screen of the first device is monitored based on the background servo.
In this embodiment, after the background servo program is loaded after the first device is started, the screen color conversion information of the current screen may be monitored based on the background servo program.
For example, when the eye-protection mode of the terminal device is switched from off to on (or from on to off), the background servo program may monitor the screen color conversion information of the current screen.
In step S303, if it is monitored that the screen color conversion information changes, the screen color conversion information of the current screen of the first device is updated, so as to obtain updated screen color conversion information.
In step S304, in response to receiving the screenshot instruction, the updated screen color transformation information is acquired.
In step S305, image information in an image processing unit GPU of the first device is color-transformed based on the screen color transformation information.
In step S306, the color-changed image information is sent to the second device for display by the second device.
The explanation and explanation of steps S303-S306 can be referred to the above embodiments, and are not repeated here.
As can be seen from the foregoing description, in this embodiment, by loading the background servo program after the first device is started and executing the operation of monitoring the screen color conversion information of the current screen of the first device based on the background servo program, the effect of monitoring the screen color conversion information can be further improved, so that a foundation can be laid for performing color conversion on the image information in the GPU based on the monitored screen color conversion information.
FIG. 4 is a flowchart illustrating how to color transform image information in a GPU, according to an example embodiment; the present embodiment exemplifies how image information in a GPU is color-converted on the basis of the above-described embodiments. As shown in fig. 4, the performing color transformation on the image information in the image processing unit GPU of the first device based on the screen color transformation information in the step S102 may include the following steps S401 to S402:
in step S401, the screen color conversion information is transferred into an image processing unit GPU of the first device.
In this embodiment, after the terminal device obtains the screen color conversion information of the current screen of the first device, the screen color conversion information may be transferred into the image processing unit GPU of the first device.
For example, when the background servo program started on the terminal device monitors that the screen color conversion information changes, the screen color conversion information of the current screen can be updated to obtain updated screen color conversion information, and then the updated screen color conversion information can be transmitted into the image processing unit GPU of the first device.
In step S402, the GPU is notified to color-transform the image information in the frame buffer.
In this embodiment, after the screen color conversion information is transmitted to the GPU, the GPU may be notified to perform color conversion on the image information in the frame buffer.
The specific manner in which the GPU performs color conversion on the image information in the frame buffer may be referred to in the related art, which is not limited in this embodiment.
As can be seen from the foregoing description, in this embodiment, by transmitting the screen color conversion information to the image processing unit GPU of the first device and notifying the GPU to perform color conversion on the image information in the frame buffer, color conversion on the image information in the GPU can be achieved, further, subsequent color conversion on the image information in the image processing unit GPU based on the screen color conversion information can be achieved, and when the second device displays the image information after the color conversion, the same screen post-processing effect as that of the first device can be displayed, and further, the transmission requirement of the user on the image display effect can be met.
Fig. 5 is a flowchart of an image processing method according to a fourth exemplary embodiment; the image processing method of the embodiment can be applied to terminal equipment (such as a smart phone, a tablet computer, a smart watch, a wearable device and the like). As shown in fig. 5, the method includes the following steps S501 to S503:
In step S501, screen color conversion information of a current screen of the first device is acquired in response to receiving the screenshot instruction and receiving the color conversion information presentation instruction.
In this embodiment, after detecting the screenshot instruction triggered by the user, the terminal device may determine whether to receive the color transformation information display instruction, and may further obtain the screen color transformation information of the current screen of the first device when receiving the color transformation information display instruction.
The color conversion information display instruction may include an instruction for displaying the screen color conversion information in the screenshot triggered by a switch for displaying the screen color conversion information in the screenshot based on the user interface.
For example, a switch for switching whether to show the screen color conversion information in the screenshot may be provided in the system setting option of the terminal device. If the image information obtained after the user wants to perform the screenshot operation contains the screen post-processing effect of the terminal device, the switch can be turned on to trigger the generation of the color conversion information display instruction, and then the terminal device can acquire the screen color conversion information of the current screen of the first device under the condition that the color conversion information display instruction is received.
It can be understood that if the color conversion information display instruction is not received, the terminal device may perform screenshot on the image information of the current screen according to the existing screenshot mode in the related art, that is, the intercepted image does not include the screen color conversion information, so that the same post-screen processing effect as that of the first device cannot be displayed when the second device displays the image information after the color conversion.
In step S502, image information in an image processing unit GPU of the first device is color-transformed based on the screen color transformation information.
In step S503, the color-changed image information is sent to the second device for display by the second device.
The explanation and explanation of steps S502-S503 may be referred to the above embodiments, and are not repeated here.
As can be seen from the above description, in this embodiment, by responding to the screenshot instruction and the color transformation information display instruction, the screen color transformation information of the current screen of the first device is obtained, and the color transformation information display instruction is an instruction for displaying the screen color transformation information in the screenshot triggered by the switch based on the user interface display, the screen color transformation information of the current screen of the first device can be obtained based on the requirement of the user, so that a foundation can be laid for performing color transformation on the image information in the GPU of the image processing unit based on the screen color transformation information, the same screen post-processing effect as that of the first device can be displayed when the second device displays the image information after the color transformation, and further the transmission requirement of the user on the image display effect can be met.
FIG. 6 is a schematic view of an application scenario of an image processing method according to an exemplary embodiment; wherein the application scenario involves the terminal device 100 of user a and the terminal device 200 of user B. As shown in fig. 6, when the user a wants to share the currently displayed picture on the terminal device 100 with the user B, a screenshot instruction may be triggered on the terminal device 100, so that the terminal device 100 may obtain, in response to the received screenshot instruction, screen color conversion information of the current screen of the first device, such as a screen color conversion matrix, and then may perform color conversion on image information in the image processing unit GPU of the terminal device 100 based on the screen color conversion information, so that the color-converted image information may be sent to the terminal device 200 for the terminal device 200 to display the received image information 201. The user a may control the terminal device 100 to establish a wireless connection (such as bluetooth, etc.) or an instant messaging connection (such as a WeChat or QQ, etc.) with the terminal device 200 of the user B, and then may send the image information after the color change to the terminal device 200 based on the established connection, so that the user B may display the received image information 201 at the terminal device 200. Because the terminal device 100 performs color conversion on the image information in the GPU based on the acquired screen color conversion information, the color-converted image information may include the screen color conversion information, so that the same screen post-processing effect as that of the terminal device 100 may be displayed when the terminal device 200 displays the color-converted image information, and the transmission requirement of the user a on the image display effect may be satisfied.
Fig. 7 is a block diagram of an image processing apparatus according to an exemplary embodiment. The image processing apparatus of the present embodiment may be applied to a terminal device (e.g., a smart phone, a tablet computer, a smart watch, a wearable device, etc.). As shown in fig. 7, the apparatus includes: a transformation information acquisition module 110, an image information transformation module 120, and an image information transmission module 130, wherein:
a transformation information obtaining module 110, configured to obtain screen color transformation information of a current screen of the first device in response to receiving the screenshot instruction;
an image information transformation module 120, configured to perform color transformation on image information in an image processing unit GPU of the first device based on the screen color transformation information;
and an image information transmitting module 130, configured to.
As can be seen from the foregoing description, in this embodiment, by acquiring the screen color conversion information of the current screen of the first device in response to receiving the screenshot instruction, and performing color conversion on the image information in the GPU of the image processing unit of the first device based on the screen color conversion information, further, because the image information in the GPU is subjected to color conversion based on the acquired screen color conversion information, the image information in the CPU can be the image information converted based on the screen color conversion information of the current screen, and further, the image information after color conversion can be sent to the second device for display by the second device, so that the image information with the same post-screen processing effect as that of the first device can be displayed in the second device, and the transmission requirement of the user on the image display effect can be met.
Fig. 8 is a block diagram of an image processing apparatus according to still another exemplary embodiment; the image processing apparatus of the present embodiment may be applied to a terminal device (e.g., a smart phone, a tablet computer, a smart watch, a wearable device, etc.). The functions of the transformation information obtaining module 210, the image information transforming module 220 and the image information transmitting module 230 are the same as those of the transformation information obtaining module 110, the image information transforming module 120 and the image information transmitting module 130 in the embodiment shown in fig. 7, and are not described herein.
As shown in fig. 8, the above apparatus may further include an update information acquisition module 240;
the update information acquisition module 240 may include:
a conversion information monitoring unit 241, configured to monitor screen color conversion information of a current screen of the first device;
an update information obtaining unit 242, configured to update, when it is monitored that the screen color conversion information changes, the screen color conversion information of the current screen of the first device, so as to obtain updated screen color conversion information;
the transformation information obtaining module 210 may be further configured to obtain the updated screen color transformation information in response to receiving the screenshot instruction.
In an embodiment, the update information acquisition module 240 may further include:
a servo program loading unit 243, configured to load a background servo program after the first device is started;
the transformation information listening unit 241 may be further configured to perform the operation of listening to the screen color transformation information of the current screen of the first device based on the background servo.
In an embodiment, the image information transformation module 220 may include:
a transformation information input unit 221 for inputting the screen color transformation information into an image processing unit GPU of the first device;
an image information transforming unit 222, configured to inform the GPU to perform color transformation on the image information in the frame buffer.
In an embodiment, the transformation information obtaining module 210 may be further configured to obtain, in response to receiving the instruction to screen capture and receiving the instruction to display color transformation information, screen color transformation information of a current screen of the first device, where the instruction to display color transformation information of the current screen of the first device may include an instruction to display screen color transformation information in the screen capture triggered by a switch based on user interface display, where the switch is configured to switch whether to display the screen color transformation information in the screen capture.
The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.
Fig. 9 is a block diagram of an electronic device, according to an example embodiment. For example, device 900 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, exercise device, personal digital assistant, and the like.
Referring to fig. 9, device 900 may include one or more of the following components: a processing component 902, a memory 904, a power component 906, a multimedia component 908, an audio component 910, an input/output (I/O) interface 912, a sensor component 914, and a communication component 916.
The processing component 902 generally controls overall operation of the device 900, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 902 may include one or more processors 920 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 902 can include one or more modules that facilitate interaction between the processing component 902 and other components. For example, the processing component 902 can include a multimedia module to facilitate interaction between the multimedia component 908 and the processing component 902.
The memory 904 is configured to store various types of data to support operations at the device 900. Examples of such data include instructions for any application or method operating on device 900, contact data, phonebook data, messages, pictures, videos, and the like. The memory 904 may be implemented by any type of volatile or nonvolatile memory device or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power component 906 provides power to the various components of the device 900. Power components 906 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for device 900.
The multimedia component 908 comprises a screen between the device 900 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front-facing camera and/or a rear-facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 900 is in an operational mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
The audio component 910 is configured to output and/or input audio signals. For example, the audio component 910 includes a Microphone (MIC) configured to receive external audio signals when the device 900 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 904 or transmitted via the communication component 916. In some embodiments, the audio component 910 further includes a speaker for outputting audio signals.
The I/O interface 912 provides an interface between the processing component 902 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.
The sensor assembly 914 includes one or more sensors for providing status assessment of various aspects of the device 900. For example, the sensor assembly 914 may detect the on/off state of the device 900, the relative positioning of the components, such as the display and keypad of the device 900, the sensor assembly 914 may also detect the change in position of the device 900 or one component of the device 900, the presence or absence of user contact with the device 900, the orientation or acceleration/deceleration of the device 900, and the change in temperature of the device 900. The sensor assembly 914 may also include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 916 is configured to facilitate communication between the device 900 and other devices, either wired or wireless. The device 900 may access a wireless network based on a communication standard, such as WiFi,2G or 3G,4G or 5G, or a combination thereof. In one exemplary embodiment, the communication part 916 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 further includes a Near Field Communication (NFC) module to facilitate short range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 900 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for performing the image processing methods described above.
In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as a memory 904 including instructions executable by the processor 920 of the device 900 to perform the above-described image processing method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (6)
1. An image processing method, applied to a first device, comprising:
loading a background servo program after the first equipment is started;
monitoring screen color conversion information of a current screen of the first equipment based on the background servo program;
if the screen color conversion information is monitored to change, updating the screen color conversion information of the current screen of the first equipment to obtain updated screen color conversion information;
Responding to the receiving screenshot instruction, and acquiring screen color transformation information of a current screen of the first equipment;
performing color conversion on image information in an image processing unit GPU of the first device based on the screen color conversion information;
transmitting the image information with the changed color to a second device for display by the second device; the responding to the receiving of the screenshot instruction, the screen color transformation information of the current screen of the first device is obtained, and the method comprises the following steps:
acquiring the updated screen color transformation information in response to receiving a screenshot instruction;
the performing color transformation on the image information in the image processing unit GPU of the first device based on the screen color transformation information includes:
transmitting the screen color transformation information into an image processing unit GPU of the first device;
the GPU is informed to perform color transformation on the image information in the frame buffer.
2. The method of claim 1, wherein the obtaining screen color transformation information for the current screen of the first device in response to receiving a screenshot instruction comprises:
and in response to receiving the screenshot instruction and receiving the color transformation information display instruction, acquiring screen color transformation information of a current screen of the first device, wherein the color transformation information display instruction comprises an instruction for displaying the screen color transformation information in the screenshot triggered by a switch based on user interface display, and the switch is used for switching whether to display the screen color transformation information in the screenshot.
3. An image processing apparatus, characterized in that it is applied to a first device, the apparatus includes an update information acquisition module, a transformation information acquisition module, an image information transformation module, and an image information transmission module;
the update information acquisition module includes:
the servo program loading unit is used for loading a background servo program after the first equipment is started; the transformation information monitoring unit is used for monitoring screen color transformation information of the current screen of the first equipment based on the background servo program;
the updating information acquisition unit is used for updating the screen color conversion information of the current screen of the first equipment when the screen color conversion information is monitored to change, so as to obtain updated screen color conversion information;
the transformation information acquisition module is used for responding to the screenshot instruction, and acquiring the updated screen color transformation information;
the image information transformation module is used for carrying out color transformation on the image information in the image processing unit GPU of the first device based on the screen color transformation information;
the image information sending module is used for sending the image information with the changed color to the second equipment for the second equipment to display;
The image information conversion module includes:
the transformation information transmitting unit is used for transmitting the screen color transformation information to the image processing unit GPU of the first device;
and the image information conversion unit is used for informing the GPU to carry out color conversion on the image information in the frame buffer.
4. The apparatus of claim 3, wherein the transformation information acquisition module is further to acquire screen color transformation information for a current screen of the first device in response to receiving a screenshot instruction and receiving a color transformation information presentation instruction, the color transformation information presentation instruction including an instruction to present screen color transformation information in a screenshot triggered based on a switch presented by a user interface, the switch to switch whether to present screen color transformation information in a screenshot.
5. A screenshot device, comprising:
a processor and a memory for storing processor-executable instructions;
wherein the processor is configured to:
loading a background servo program after the first device is started;
monitoring screen color conversion information of a current screen of the first equipment based on the background servo program;
If the screen color conversion information is monitored to change, updating the screen color conversion information of the current screen of the first equipment to obtain updated screen color conversion information;
responding to the receiving screenshot instruction, and acquiring screen color transformation information of a current screen of the first equipment;
performing color conversion on image information in an image processing unit GPU of the first device based on the screen color conversion information;
transmitting the image information with the changed color to a second device for display by the second device;
the responding to the receiving of the screenshot instruction, the screen color transformation information of the current screen of the first device is obtained, and the method comprises the following steps:
acquiring the updated screen color transformation information in response to receiving a screenshot instruction;
the performing color transformation on the image information in the image processing unit GPU of the first device based on the screen color transformation information includes:
transmitting the screen color transformation information into an image processing unit GPU of the first device;
the GPU is informed to perform color transformation on the image information in the frame buffer.
6. A computer readable storage medium having stored thereon a computer program, characterized in that the program when executed by a processor performs the steps of:
Loading a background servo program after the first device is started;
monitoring screen color conversion information of a current screen of the first equipment based on the background servo program;
if the screen color conversion information is monitored to change, updating the screen color conversion information of the current screen of the first equipment to obtain updated screen color conversion information;
responding to the receiving screenshot instruction, and acquiring screen color transformation information of a current screen of the first equipment;
performing color conversion on image information in an image processing unit GPU of the first device based on the screen color conversion information;
transmitting the image information with the changed color to a second device for display by the second device;
the responding to the receiving of the screenshot instruction, the screen color transformation information of the current screen of the first device is obtained, and the method comprises the following steps:
acquiring the updated screen color transformation information in response to receiving a screenshot instruction;
the performing color transformation on the image information in the image processing unit GPU of the first device based on the screen color transformation information includes:
transmitting the screen color transformation information into an image processing unit GPU of the first device;
The GPU is informed to perform color transformation on the image information in the frame buffer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010535340.XA CN113810675B (en) | 2020-06-12 | 2020-06-12 | Image processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010535340.XA CN113810675B (en) | 2020-06-12 | 2020-06-12 | Image processing method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113810675A CN113810675A (en) | 2021-12-17 |
| CN113810675B true CN113810675B (en) | 2024-03-12 |
Family
ID=78892108
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010535340.XA Active CN113810675B (en) | 2020-06-12 | 2020-06-12 | Image processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113810675B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117149028A (en) * | 2023-10-27 | 2023-12-01 | Tcl通讯科技（成都）有限公司 | Display control method and device, storage medium and terminal equipment |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1185963A (en) * | 1997-04-30 | 1999-03-30 | Canon Inf Syst Res Australia Pty Ltd | Device and method for image processing |
| CN1588302A (en) * | 2004-08-05 | 2005-03-02 | 深圳市友邻通讯设备有限公司 | Computer screen catching monitoring and recording method |
| US7042464B1 (en) * | 2003-08-01 | 2006-05-09 | Apple Computer, Inc. | Methods and apparatuses for the automated display of visual effects |
| CN102665135A (en) * | 2012-04-18 | 2012-09-12 | 山东大学 | Embedded screen transmission system and operating method thereof |
| CA2924461A1 (en) * | 2013-09-20 | 2015-03-26 | A2Zlogix, Inc. | System and method for reducing visible artifacts in the display of compressed and decompressed digital images and video |
| CN105451198A (en) * | 2014-09-30 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Method and device for sharing picture in instant messaging |
| CN105847936A (en) * | 2016-03-31 | 2016-08-10 | 乐视控股（北京）有限公司 | Display control method and device, and terminal |
| KR20160097050A (en) * | 2015-02-06 | 2016-08-17 | 삼성전자주식회사 | Method and apparatus for displaying composition screen by composing the OS screens |
| CN108335659A (en) * | 2018-01-02 | 2018-07-27 | 联想(北京)有限公司 | Method for displaying image and equipment |
| CN108347452A (en) * | 2017-01-23 | 2018-07-31 | 腾讯科技（深圳）有限公司 | The long-range method and device for obtaining screenshot capture |
| CN108604234A (en) * | 2015-07-15 | 2018-09-28 | 查比公司 | System and method for screenshot capture link |
| CN208572286U (en) * | 2018-07-26 | 2019-03-01 | 漳州市利利普电子科技有限公司 | A kind of monitor of accurate display color |
| CN110377391A (en) * | 2019-07-17 | 2019-10-25 | Oppo广东移动通信有限公司 | Image display method, device, mobile terminal and storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20160097868A (en) * | 2015-02-10 | 2016-08-18 | 삼성전자주식회사 | A display apparatus and a display method |
| JP6695788B2 (en) * | 2016-12-07 | 2020-05-20 | 任天堂株式会社 | Information processing program, information processing apparatus, and information processing method |
-
2020
- 2020-06-12 CN CN202010535340.XA patent/CN113810675B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1185963A (en) * | 1997-04-30 | 1999-03-30 | Canon Inf Syst Res Australia Pty Ltd | Device and method for image processing |
| US7042464B1 (en) * | 2003-08-01 | 2006-05-09 | Apple Computer, Inc. | Methods and apparatuses for the automated display of visual effects |
| CN1588302A (en) * | 2004-08-05 | 2005-03-02 | 深圳市友邻通讯设备有限公司 | Computer screen catching monitoring and recording method |
| CN102665135A (en) * | 2012-04-18 | 2012-09-12 | 山东大学 | Embedded screen transmission system and operating method thereof |
| CA2924461A1 (en) * | 2013-09-20 | 2015-03-26 | A2Zlogix, Inc. | System and method for reducing visible artifacts in the display of compressed and decompressed digital images and video |
| CN105451198A (en) * | 2014-09-30 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Method and device for sharing picture in instant messaging |
| KR20160097050A (en) * | 2015-02-06 | 2016-08-17 | 삼성전자주식회사 | Method and apparatus for displaying composition screen by composing the OS screens |
| CN108604234A (en) * | 2015-07-15 | 2018-09-28 | 查比公司 | System and method for screenshot capture link |
| CN105847936A (en) * | 2016-03-31 | 2016-08-10 | 乐视控股（北京）有限公司 | Display control method and device, and terminal |
| CN108347452A (en) * | 2017-01-23 | 2018-07-31 | 腾讯科技（深圳）有限公司 | The long-range method and device for obtaining screenshot capture |
| CN108335659A (en) * | 2018-01-02 | 2018-07-27 | 联想(北京)有限公司 | Method for displaying image and equipment |
| CN208572286U (en) * | 2018-07-26 | 2019-03-01 | 漳州市利利普电子科技有限公司 | A kind of monitor of accurate display color |
| CN110377391A (en) * | 2019-07-17 | 2019-10-25 | Oppo广东移动通信有限公司 | Image display method, device, mobile terminal and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 数字视频信号捕捉控制器设计;刘新宁;君懿;;电子器件;20081220(第06期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113810675A (en) | 2021-12-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10230921B2 (en) | Mobile terminal, display apparatus and control method thereof | |
| EP2978234A1 (en) | Method and apparatus for sharing video information | |
| EP3173923A1 (en) | Method and device for image display | |
| EP3136699A1 (en) | Method and device for connecting external equipment | |
| CN109274510B (en) | Message processing method, device, client, server and storage medium | |
| CN112019893B (en) | Screen projection method of terminal and screen projection device of terminal | |
| CN111078170B (en) | Display control method, display control device, and computer-readable storage medium | |
| CN108965611B (en) | Shooting interface switching method, device, equipment and storage medium | |
| CN113556614B (en) | Information release method and device and electronic equipment | |
| CN112331158B (en) | Terminal display adjusting method, device, equipment and storage medium | |
| EP3896982A1 (en) | Method and apparatus for inputting information on display interface, and storage medium | |
| CN113810675B (en) | Image processing method, device, equipment and storage medium | |
| CN112423092A (en) | Video recording method and video recording device | |
| CN113257177B (en) | Brightness control method and device and electronic equipment | |
| CN111246012B (en) | Application interface display method and device and storage medium | |
| CN114268691A (en) | Call method, device, terminal equipment and readable storage medium | |
| CN111261081B (en) | Screen display method and device | |
| CN107463471B (en) | Method and device for diagnosing terminal screen | |
| CN112527160A (en) | Method and device for displaying icons on information screen, processor and display equipment | |
| CN111124099A (en) | State control method, device and storage medium | |
| CN110955328B (en) | Control method and device of electronic equipment and storage medium | |
| CN116074025A (en) | Method, apparatus and storage medium for inputting authentication information | |
| CN117369615A (en) | Electronic equipment control method and device, storage medium and electronic equipment | |
| CN115016718A (en) | Interface display method, interface display device and storage medium | |
| CN114266690A (en) | Image rendering method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |