CN113709375A - Image display method and device and electronic equipment - Google Patents
Image display method and device and electronic equipment Download PDFInfo
- Publication number
- CN113709375A CN113709375A CN202111039420.7A CN202111039420A CN113709375A CN 113709375 A CN113709375 A CN 113709375A CN 202111039420 A CN202111039420 A CN 202111039420A CN 113709375 A CN113709375 A CN 113709375A
- Authority
- CN
- China
- Prior art keywords
- image
- display
- target
- user
- image information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/65—Control of camera operation in relation to power supply
- H04N23/651—Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
Abstract
The application discloses an image display method and device and electronic equipment, and belongs to the technical field of image processing. The image display method includes: acquiring user face image information, wherein the user face image information comprises user eye image information; determining a target display area of a display screen where the sight of the user is located according to the facial image information of the user; determining a target area which needs to be subjected to image quality enhancement processing in a target image according to the target display area, wherein the target image is an image which needs to be displayed currently on the display screen; performing image quality enhancement processing on the image information of the target area; synthesizing image information of a target area subjected to image quality enhancement processing with image information which is not subjected to image quality enhancement processing in the target image to obtain a synthesized image; and transmitting the composite image to the display screen for displaying.
Description
Technical Field
The application belongs to the technical field of image processing, and particularly relates to an image display method and device and electronic equipment.
Background
With the continuous popularization of intelligent terminals, people have higher and higher requirements on the display image quality of the intelligent terminals, and the mode of performing image quality enhancement processing on display pictures by using a processor algorithm optimization mode gradually fails to meet the strong demand of users on the increasing display image quality, so that a scheme for performing image quality enhancement by using an independent display IC is generated.
However, although the image quality is enhanced by using the independent display IC, the display quality is effectively improved, the power consumption of the terminal is greatly increased due to the existence of the additional hardware circuit (independent display IC), so that the usable time of the terminal is reduced, and the use experience of the user is affected.
Disclosure of Invention
The embodiment of the application aims to provide an image display method, an image display device and electronic equipment, which can solve the problem that the power consumption of a terminal is greatly increased due to the addition of an additional hardware circuit (an independent display IC), so that the usable time of the terminal is reduced, and the use experience of a user is influenced.
In a first aspect, an embodiment of the present application provides an image display method, including:
acquiring user face image information, wherein the user face image information comprises user eye image information;
determining a target display area of a display screen where the sight of the user is located according to the facial image information of the user;
determining a target area which needs to be subjected to image quality enhancement processing in a target image according to the target display area, wherein the target image is an image which needs to be displayed currently on the display screen;
performing image quality enhancement processing on the image information of the target area;
synthesizing image information of a target area subjected to image quality enhancement processing with image information which is not subjected to image quality enhancement processing in the target image to obtain a synthesized image;
and transmitting the composite image to the display screen for displaying.
In a second aspect, an embodiment of the present application provides an electronic device, where the electronic device includes a processor, a display chip, a camera, and a display screen;
the camera is connected with the processor and used for acquiring user face image information in real time and transmitting the user face image information to the processor;
the processor determines a target area which needs to be subjected to image quality enhancement processing in a target image according to the user face image information, wherein the target image is an image which needs to be displayed currently on the display screen;
the display chip performs image quality enhancement processing on the image information of the target area;
the processor or the display chip synthesizes image information of a target area after image quality enhancement processing and image information which is not subjected to image quality enhancement processing in the target image to obtain a synthetic image, and transmits the synthetic image to the display screen;
the display screen displays the composite image.
In a third aspect, an embodiment of the present application provides an image display apparatus, including:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring user face image information, and the user face image information comprises user eye image information;
the first determining module is used for determining a target display area of a display screen where the sight of the user is located according to the facial image information of the user;
the second determining module is used for determining a target area which needs to be subjected to image quality enhancement processing in a target image according to the target display area, wherein the target image is an image which needs to be displayed currently on the display screen;
the processing module is used for carrying out image quality enhancement processing on the image information of the target area;
the image processing device comprises a synthesis module, a processing module and a processing module, wherein the synthesis module is used for synthesizing image information of a target area after image quality enhancement processing and image information which is not subjected to image quality enhancement processing in the target image to obtain a synthesized image;
and the display module is used for transmitting the composite image to the display screen for displaying.
In a fourth aspect, embodiments of the present application provide an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, implement the steps of the method according to the first aspect.
In a fifth aspect, the present embodiments provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.
In a sixth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.
In the embodiment of the application, the image quality enhancement processing can be performed on only partial images concerned by the sight of the user according to the target display area where the sight of the user is located by acquiring the facial image information of the user, especially the eye image information of the user in real time, so that the image quality enhancement effect of the images is realized, the power consumption of the display chip can be reduced to the minimum, the electric quantity of the electronic equipment is saved, and the available time is prolonged.
Drawings
Fig. 1 is a schematic flowchart of an image display method according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram illustrating division of a display area according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram illustrating a user's gaze at location A in a display area according to an embodiment of the present disclosure;
FIG. 4 is a schematic diagram illustrating a user's gaze at a location B in a display area according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;
fig. 6 is a schematic flowchart of another image display method according to an embodiment of the present disclosure;
fig. 7 is a second schematic structural diagram of an electronic device according to an embodiment of the present disclosure;
fig. 8 is a schematic flowchart of another image display method according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of an image display device according to an embodiment of the present disclosure;
fig. 10 is a third schematic structural diagram of an electronic apparatus according to an embodiment of the present application;
fig. 11 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
The following describes in detail an image display method, an image display device, and an electronic device provided in the embodiments of the present application with reference to the accompanying drawings.
Referring to fig. 1, fig. 1 is a schematic flow chart of an image display method according to an embodiment of the present disclosure. As shown in fig. 1, the image display method in the embodiment of the present application includes the steps of:
step 101: the method comprises the steps of obtaining user face image information, wherein the user face image information comprises user eye image information.
The image display method in the embodiment of the application is applied to the electronic equipment, and when the facial image information of a user is obtained, the front-facing camera of the electronic equipment can be started to shoot in real time. In order to reduce the power consumption of the front camera, when the face of the user is not detected in the image collected by the front camera, the front camera is stopped to continue shooting, and the front camera is restarted at certain intervals to shoot again.
Step 102: and determining a target display area of the display screen where the sight of the user is located according to the facial image information of the user.
In the embodiment of the application, it can be known that information such as an area where an eye sight line of a user falls can be known from the eye image information of the user, that is, which part of an area in a display screen of an electronic device is currently focused by the user, and therefore, the face image information of the user needs to include the eye image information of the user. Therefore, the display area of the display screen of the electronic equipment where the current sight of the user falls is determined by performing algorithm processing on the face image information of the user, and the display area is the target display area.
Step 103: and determining a target area which needs to be subjected to image quality enhancement processing in a target image according to the target display area, wherein the target image is an image which needs to be displayed currently on the display screen.
After the target display area in the display screen of the electronic device where the current sight of the user falls is determined, the target display area is an area focused by the user, and the display area of the display screen of the electronic device has a corresponding relation with the target image which needs to be displayed currently by the display screen, so that which partial area in the target image which needs to be displayed currently by the display screen needs to be subjected to image quality enhancement processing can be determined according to the position of the target display area in the display area of the display screen, that is, the target area. Optionally, the target area may be an area in which the current line of sight of the user falls in the display area of the display screen, or may be larger than the area in which the current line of sight of the user falls in the display area of the display screen, that is, the area may be included, and the specific size of the target area may be defined according to a display requirement (for example, a requirement on image quality).
Step 104: and performing image quality enhancement processing on the image information of the target area.
In the embodiment of the application, after the target area in the target image, namely the area focused by the user, is determined, the image quality enhancement processing can be performed on the image information of the target area of the target image, so that the image quality of the target area is effectively improved, and the image information of other areas except the target area in the target image does not need to be subjected to the image quality enhancement processing, so that the processing power consumption can be effectively reduced. Optionally, the electronic device includes an independent display chip, and the electronic device performs image quality enhancement processing on the image information of the target area of the target image by using the independent display chip.
Step 105: synthesizing image information of the target area after the image quality enhancement processing and image information which is not subjected to the image quality enhancement processing in the target image to obtain a synthesized image
After the image quality enhancement processing of the image information of the target area of the target image is completed, the image information of the target area after the image quality enhancement processing and the image information which is not subjected to the image quality enhancement processing in the target image can be synthesized, so that a complete synthesized image can be obtained; compared with the target image, the image content in the composite image is not lost, and only the image part which is focused by the user is subjected to image quality enhancement processing.
Step 106: and transmitting the composite image to the display screen for displaying.
Finally, the composite image is displayed by the display screen of the electronic equipment, and the part of the composite image subjected to image quality enhancement processing is just displayed in the target display area of the display screen, namely the position of the sight line of the user on the display screen, so that for the user, the image quality of the image of the area concerned with the user is effectively improved, and the viewing effect of the user is basically not influenced by other areas not concerned with the user, so that the display effect of the display screen of the electronic equipment is effectively improved in the view of the user.
Therefore, in the embodiment of the application, by acquiring the facial image information of the user in real time, particularly the eye image information of the user, the image quality enhancement processing can be performed on only the partial image concerned by the sight of the user according to the target display area where the sight of the user is located, so that the image quality enhancement effect of the image is achieved, meanwhile, the power consumption of the display chip can be reduced to the minimum, the electric quantity of the electronic equipment is saved, and the available time is prolonged.
In some embodiments of the present application, a display area of the display screen is divided into a plurality of display partitions, and determining, according to the user facial image information, a target display area of the display screen where a user's sight line is located includes:
and determining a display partition on which the current sight of the user falls according to the eye image information of the user, and determining the display partition on which the current sight of the user falls as the target display area.
Referring to fig. 2, fig. 2 is a schematic diagram illustrating division of a display area according to an embodiment of the present disclosure. As shown in fig. 2, in the embodiment of the present application, the front surface of the electronic device includes a front camera 21, a display area 22, and a non-display area 23, where the front camera 21 may be disposed in the non-display area 23, and the non-display area 23 is disposed at the periphery of the display area 22; the display area 22 of the display screen of the electronic device can be divided into the plurality of display subareas 221, the plurality of display subareas 221 can be equal in area, unequal in area, equal in shape, or different in shape, for example, for the middle area of the display area 22, a larger probability is an area in which a user focuses attention, so that the area of the display subarea 221 located in the middle area of the display area 22 can be set larger, and when the image quality enhancement processing is performed on the target image, the corresponding target area is increased, so that the image quality of the image in the part of the area is improved, and the user's impression is ensured; on the other hand, since the edge region of the real region has a smaller probability of being a region of major interest to the user, the area of the display partition 221 located in the edge region of the display region 22 can be set smaller, so that when the image quality enhancement processing is performed on the target image, the corresponding target region is reduced, that is, the image information required to be subjected to the image quality enhancement processing is reduced, thereby further reducing the image processing power consumption. In fig. 2, a plurality of display sections 221 are arranged in an array.
Referring to fig. 3, fig. 3 is a schematic view illustrating a position a of a user's sight line in a display area according to an embodiment of the present disclosure. As shown in fig. 3, in the embodiment of the present application, after a plurality of display partitions are divided, a front camera is turned on and collects user face image information in real time, a processor of an electronic device performs calculation according to the user face image information to obtain a position a where a current sight line of eyes 24 of a user falls in a display area, where the display partition where the position a is located is a target display area where the current sight line of the user falls. Therefore, the target area of the target image can be determined according to the target display area, the image information of the target area is enhanced by using the independent display chip, the image information of the target area after the image quality enhancement processing is combined with the image information which is not subjected to the image quality enhancement processing in the target image, a complete combined image is formed, and the combined image is displayed in the display area of the display screen. At this time, the position a viewed by the eyes 24 of the user is perceived by the user as the image quality enhancement, but the other regions are located outside the main line of sight of the user, so that the user hardly perceives the image quality enhancement, and the power consumption of the display chip can be reduced while the image quality enhancement effect of the image is achieved.
In other embodiments of the present application, after determining, according to the facial image information of the user, a target display area of a display screen in which a current line of sight of the user is located, the method further includes:
and under the condition that the current sight line of the user is detected to be changed, re-determining the target display area of the display screen where the current sight line of the user is located according to the current eye image information of the user.
Referring to fig. 4, fig. 4 is a schematic diagram illustrating a user's view line falling at a position B of a display area according to an embodiment of the present application. As shown in fig. 4, the front-facing camera continues to be turned on and collects the facial image information of the user in real time, and when it is detected that the current sight line of the user changes, for example, the sight line of the user's eyes 24 moves from the position a to the position B, the target display area of the display screen where the current sight line of the user is located needs to be determined again, that is, the above steps are repeated again, that is, the electronic device performs calculation according to the current facial image information of the user to obtain the position B where the current sight line of the user's eyes 24 falls in the display area, and the display partition where the position B is located is the target display area where the current sight line of the user falls. Therefore, the target area of the target image can be determined according to the target display area, the image information of the target area is enhanced by using the independent display chip, the image information of the target area after the image quality enhancement processing is combined with the image information which is not subjected to the image quality enhancement processing in the target image, a complete combined image is formed, and the combined image is displayed in the display area of the display screen. At this time, the B position viewed by the eyes 24 of the user is perceived by the user as an image quality enhancement, and the other area is located outside the main line of sight of the user, so that the user hardly perceives the other area even if the image quality enhancement is not performed. By the method, the position of the sight of the user on the display screen can be tracked in real time, so that the image quality enhancement processing is carried out on the image information of the target area of the target image corresponding to the target display area, and the high-quality image quality is always provided for the user.
In summary, in the embodiment of the present application, the image information of the face of the user, especially the image information of the eyes of the user, is obtained in real time, the sight line of the user is tracked in real time, and only the partial image concerned by the sight line of the user can be subjected to image quality enhancement processing according to the target display area where the sight line of the user is located, so that the image quality enhancement effect of the image is achieved, meanwhile, the power consumption of the display chip can be reduced to the minimum, the electric quantity of the electronic device is saved, and the available time is increased.
Hardware devices that can be used for the above-described image display method are described below.
Another embodiment of the present application further provides an electronic device, where the electronic device includes a processor, a display chip, a camera and a display screen, where the camera is connected to the processor, and the camera collects user facial image information in real time and transmits the user facial image information to the processor; the processor determines a target area which needs to be subjected to image quality enhancement processing in a target image according to the user face image information, wherein the target image is an image which needs to be displayed currently on the display screen; the display chip performs image quality enhancement processing on the image information of the target area; the processor or the display chip synthesizes image information of a target area after image quality enhancement processing and image information which is not subjected to image quality enhancement processing in the target image to obtain a synthetic image, and transmits the synthetic image to the display screen; the display screen displays the composite image.
That is to say, information such as an area where the eye sight line of the user falls can be known from the eye image information of the user, that is, which part of the area in the display screen of the electronic device the user focuses on currently, so that the face image information of the user needs to include the eye image information of the user, and of course, when the face image information of the user also includes image information of other parts of the face of the user except the eye region, the eye image information and the image information of other parts can be comprehensively considered, so that the area where the eye sight line of the user falls can be more accurately determined. Therefore, the front camera is used for acquiring the facial image information of the user in real time, and performing algorithm processing on the facial image information of the user to determine a display area, namely a target display area, in the display screen of the electronic equipment, where the current sight of the user falls; then, because the target display area is an area of key attention of the user, and the display area of the display screen of the electronic device has a corresponding relationship with the target image which needs to be displayed currently on the display screen, which partial area of the target image which needs to be displayed currently on the display screen needs to be subjected to image quality enhancement processing can be determined according to the position of the target display area in the display area of the display screen, namely the target area; then, the image quality of the image information of the target area of the target image can be enhanced, so that the image quality of the target area is effectively improved, and the image information of other areas except the target area in the target image does not need to be enhanced, so that the processing power consumption can be effectively reduced; finally, the electronic device synthesizes the image information of the target area after the image quality enhancement processing with the image information of the target image without the image quality enhancement processing, so as to obtain a complete synthesized image, the synthesized image is displayed by a display screen of the electronic device, and the part of the synthesized image which is subjected to the image quality enhancement processing is just displayed in the target display area of the display screen, namely the position of the sight line of a user on the display screen, so that for the user, the image quality of the area concerned with emphasis is effectively improved, and the watching effect of the user is basically not influenced by other areas not concerned with emphasis, so that the display effect of the display screen of the electronic device is effectively improved in the view of the user.
Therefore, in the embodiment of the application, the user sight is tracked in real time by acquiring the facial image information of the user in real time, particularly the eye image information of the user, and only the partial image concerned by the user sight can be subjected to image quality enhancement processing according to the target display area where the user sight is located, so that the image quality enhancement effect of the image is realized, the power consumption of the display chip can be reduced to the minimum, the electric quantity of the electronic equipment is saved, and the available time is prolonged.
In this embodiment of the application, optionally, the display chip is an independent display chip.
In this embodiment of the application, optionally, in order to reduce the power consumption of the front camera, when the face of the user is not detected in the image collected by the front camera, the front camera is stopped to continue shooting, and the front camera is restarted at a certain interval to shoot again.
In this embodiment, optionally, the target area may be an area in which the current line of sight of the user falls in the display area of the display screen, or may be larger than the area in which the current line of sight of the user falls in the display area of the display screen, that is, the area may be included, and the specific size of the target area may be defined according to a display requirement (for example, a requirement on image quality).
In some embodiments of the present application, the processor is connected to the display chip, and the display chip is further connected to the display screen;
the processor transmits the image information of the target area and the image information of the target image except the target area to the display chip respectively, or the processor transmits the target image and identification information for identifying the target area to the display chip;
the display chip synthesizes the image information of the target area after the image quality enhancement processing and the image information which is not subjected to the image quality enhancement processing in the target image to obtain a synthetic image, and transmits the synthetic image to the display screen.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. As shown in fig. 5, in the embodiment of the present application, the electronic device includes a processor 51, a display chip 52, a camera 53 and a display 54, where the camera 53 is connected to the processor 51, the two are specifically connected by an interface of the mobile industry processor 51, the processor 51 is connected to the display chip 52, the display chip 52 is further connected to the display 54, and the two are also specifically connected by an interface of the mobile industry processor 51. The processor 51 transmits the image information of the target area and the image information of the target image except the target area to the display chip 52, or the processor 51 transmits the target image and the identification information for identifying the target area to the display chip 52; the display chip 52 performs the image quality enhancement processing on the image information of the target area, and the display chip 52 synthesizes the image information of the target area after the image quality enhancement processing and the image information of the target image which is not subjected to the image quality enhancement processing to obtain a synthesized image and transmits the synthesized image to the display 54.
That is, in an alternative embodiment, after determining the target area in the target image, the processor 51 may perform an operation such as layer separation on the target image, so as to divide the target image into two parts, one part is image information of the target area, the other part is image information of the target area, and the two parts of the processor 51 are respectively transmitted to the display chip 52, so that the display chip 52 may directly perform the image quality enhancement processing on the image information of the target area. In another alternative embodiment, after determining the target area in the target image, the processor 51 does not perform operations such as layer separation on the target image, but directly transmits the entire target image and the identification information for identifying the target area in the target image to the display chip 52, so that the display chip 52 can perform image quality enhancement processing on only the image information of the target area in the target image according to the identification information, thereby omitting the operation of performing the layer separation on the target image by the processor 51.
In the embodiment of the present application, since the display chip 52 is connected to the display screen 54, the display chip 52 may directly synthesize the image information of the target area after the image quality enhancement processing and the image information of the target image that is not subjected to the image quality enhancement processing to obtain the synthesized image, transmit the synthesized image to the display screen 54, and display the synthesized image on the display screen 54 without performing the synthesis processing by the processor 51.
Referring to fig. 6, fig. 6 is a schematic flowchart illustrating another image display method according to an embodiment of the present disclosure. As shown in fig. 6, the image display method in the embodiment of the present application may be applied to the electronic device shown in fig. 5, and the method includes the steps of:
1) the front camera shoots a facial image of a user and transmits the image to the CPU;
2) the CPU processes images, calculates the positions of human eyes by adopting an algorithm and determines the position information of the sight of a user on a screen;
4) the CPU separates layers of the target image, separates specific images needing to be enhanced and transmits the specific images to the independent display IC, and simultaneously transmits the images not needing to be enhanced to the independent display IC;
5) the independent display IC reinforces the local image, synthesizes the local image with the non-reinforced image to obtain a complete picture, and then transmits the complete picture to the display screen;
6) the display screen is driven by voltage or current to complete picture display.
Referring to fig. 7, fig. 7 is a second schematic structural diagram of an electronic device according to an embodiment of the present disclosure. As shown in fig. 7, in the embodiment of the present application, the electronic device includes a processor 71, a display chip 72, a camera 73 and a display screen 74, where the camera 73 is connected to the processor 71, the two may be specifically connected through an interface of the mobile industry processor 71, the processor 71 is connected to the display chip 72, the processor 71 is further connected to the display screen 74, and the two may also be specifically connected through an interface of the mobile industry processor 71. The processor 71 transmits the image information of the target area to the display chip 72, the display chip 72 performs image quality enhancement processing on the image information of the target area, transmits the image information of the target area after the image quality enhancement processing to the processor 71, and the processor 71 synthesizes the image information of the target area after the image quality enhancement processing and the image information of the target area without the image quality enhancement processing to obtain a synthetic image and transmits the synthetic image to the display screen 74.
That is, in an alternative embodiment, after determining the target area in the target image, the processor 71 may perform an operation such as layer separation on the target image, so as to divide the target image into two parts, one part is image information of the target area, and the other part is image information of the target area except the target area in the target image, and the processor 71 only transmits the image information of the target area to the display chip 72, so that the display chip 72 may directly perform the image quality enhancement processing on the image information of the target area, and then the display chip 72 transmits the image information of the target area after the image quality enhancement processing back to the processor 71.
In the embodiment of the present application, since the processor 71 is connected to the display 74, the processor 71 synthesizes the image information of the target area after the image quality enhancement processing fed back by the display chip 72 with the image information of the target image which is not subjected to the image quality enhancement processing to obtain a synthesized image, transmits the synthesized image to the display 74, and displays the synthesized image on the display 74 without performing the synthesis processing by the display chip 72.
Referring to fig. 8, fig. 8 is a schematic flowchart illustrating another image display method according to an embodiment of the present disclosure. As shown in fig. 8, the image display method in the embodiment of the present application may be applied to the electronic device shown in fig. 7, and the method includes the steps of:
1) the front camera shoots a facial image of a user and transmits the image to the CPU;
2) the CPU processes images, calculates the positions of human eyes by adopting an algorithm and determines the position information of the sight of a user on a screen;
4) the CPU separates layers of the target image, separates specific images needing to be enhanced and transmits the specific images to the independent display IC, and images not needing to be enhanced are not transmitted to the independent display IC;
5) the independent display IC reinforces the local image and feeds back and transmits the reinforced image to the CPU;
6) the CPU synthesizes the enhanced image and the non-enhanced image to obtain a complete picture, and then transmits the complete picture to a display screen;
7) the display screen is driven by voltage or current to complete picture display.
In summary, in the embodiment of the present application, the image information of the face of the user, especially the image information of the eyes of the user, is obtained in real time, the sight line of the user is tracked in real time, and only the partial image concerned by the sight line of the user can be subjected to image quality enhancement processing according to the target display area where the sight line of the user is located, so that the image quality enhancement effect of the image is achieved, meanwhile, the power consumption of the display chip can be reduced to the minimum, the electric quantity of the electronic device is saved, and the available time is increased.
It should be noted that, in the image display method provided in the embodiment of the present application, the execution subject may be an image display apparatus, or a control module in the image display apparatus for executing the image display method. The embodiment of the present application describes an image display device provided in the embodiment of the present application, by taking an example in which the image display device executes an image display method.
Referring to fig. 9, fig. 9 is a diagram illustrating an image display apparatus 90 according to an embodiment of the present disclosure, where the apparatus includes:
an obtaining module 91, configured to obtain user face image information, where the user face image information includes user eye image information;
the first determining module 92 is used for determining a target display area of a display screen where the sight of the user is located according to the facial image information of the user;
a second determining module 93, configured to determine, according to the target display area, a target area that needs to be subjected to image quality enhancement processing in a target image, where the target image is an image that needs to be currently displayed on the display screen;
a processing module 94, configured to perform image quality enhancement processing on the image information of the target area;
a synthesizing module 95, configured to synthesize image information of a target area after image quality enhancement processing and image information of the target image that is not subjected to image quality enhancement processing to obtain a synthesized image;
and the display module 96 is configured to transmit the composite image to the display screen for displaying.
Optionally, the display area of the display screen is divided into a plurality of display partitions, and the first determining module includes:
and the determining unit is used for determining the display partition on which the current sight of the user falls according to the eye image information of the user, and determining the display partition on which the current sight of the user falls as the target display area.
Optionally, the apparatus further comprises:
and the third determining module is used for re-determining the target display area of the display screen where the current sight of the user is located according to the current eye image information of the user under the condition that the current sight of the user is detected to be changed.
In the embodiment of the application, the user sight is tracked in real time by acquiring the facial image information of the user in real time, particularly the eye image information of the user, and only the partial image concerned by the user sight can be subjected to image quality enhancement processing according to the target display area where the user sight is located, so that the image quality enhancement effect of the image is realized, meanwhile, the power consumption of a display chip can be reduced to the minimum, the electric quantity of electronic equipment is saved, and the available time is prolonged.
The image display device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a Personal Computer (PC), a Television (TV), a teller machine, a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The image display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system (Android), an iOS operating system, or other possible operating systems, which is not specifically limited in the embodiments of the present application.
The image display device provided in the embodiment of the present application can implement each process implemented by the method embodiments of fig. 1 to fig. 5, and is not described herein again to avoid repetition.
Optionally, as shown in fig. 10, an electronic device 1000 is further provided in this embodiment of the present application, and includes a processor 1001, a memory 1002, and a program or an instruction stored in the memory 1002 and executable on the processor 1001, where the program or the instruction is executed by the processor 1001 to implement each process of the above-mentioned embodiment of the image display method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 11 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 1100 includes, but is not limited to: a radio frequency unit 1101, a network module 1102, an audio output unit 1103, an input unit 1104, a sensor 1105, a display unit 1106, a user input unit 1107, an interface unit 1108, a memory 1109, a processor 1110, and the like.
Those skilled in the art will appreciate that the electronic device 1100 may further include a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 1110 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system. The electronic device structure shown in fig. 11 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is not repeated here.
The processor 1110 is configured to obtain user facial image information, where the user facial image information includes user eye image information;
the processor 1110 is further configured to determine, according to the user facial image information, a target display area of the display screen where the user's sight line is located;
the processor 1110 is further configured to determine, according to the target display area, a target area that needs to be subjected to image quality enhancement processing in a target image, where the target image is an image that needs to be currently displayed on the display screen;
the processor 1110 is further configured to perform image quality enhancement processing on the image information of the target area;
a processor 1110, further configured to synthesize image information of the target area after the image quality enhancement processing and image information of the target image that is not subjected to the image quality enhancement processing, so as to obtain a synthesized image;
a processor 1110 further configured to transmit the composite image to the display screen for display;
a display unit 1106 is configured to display the composite image.
In the embodiment of the application, the user sight is tracked in real time by acquiring the facial image information of the user in real time, particularly the eye image information of the user, and only the partial image concerned by the user sight can be subjected to image quality enhancement processing according to the target display area where the user sight is located, so that the image quality enhancement effect of the image is realized, meanwhile, the power consumption of a display chip can be reduced to the minimum, the electric quantity of electronic equipment is saved, and the available time is prolonged.
Optionally, the dividing a display area of the display screen into a plurality of display partitions, and the determining, according to the user facial image information, a target display area of the display screen where the user's sight line is located includes:
and determining a display partition on which the current sight of the user falls according to the eye image information of the user, and determining the display partition on which the current sight of the user falls as the target display area.
Optionally, the processor 1110 is further configured to, when it is detected that the current sight line of the user changes, re-determine a target display area of the display screen where the current sight line of the user is located according to the current eye image information of the user.
It should be understood that in the embodiment of the present application, the input Unit 1104 may include a Graphics Processing Unit (GPU) 11041 and a microphone 11042, and the Graphics processor 11041 processes image data of still pictures or video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1106 may include a display panel 11061, and the display panel 11061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1107 includes a touch panel 11071 and other input devices 11072. A touch panel 11071, also called a touch screen. The touch panel 11071 may include two portions of a touch detection device and a touch controller. Other input devices 11072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 1109 may be used for storing software programs and various data including, but not limited to, application programs and an operating system. Processor 1110 may integrate an application processor that handles primarily operating systems, user interfaces, applications, etc. and a modem processor that handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1110.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the above-mentioned embodiment of the image display method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the above image display method embodiment, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (11)
1. An image display method, comprising:
acquiring user face image information, wherein the user face image information comprises user eye image information;
determining a target display area of a display screen where the sight of the user is located according to the facial image information of the user;
determining a target area which needs to be subjected to image quality enhancement processing in a target image according to the target display area, wherein the target image is an image which needs to be displayed currently on the display screen;
performing image quality enhancement processing on the image information of the target area;
synthesizing image information of a target area subjected to image quality enhancement processing with image information which is not subjected to image quality enhancement processing in the target image to obtain a synthesized image;
and transmitting the composite image to the display screen for displaying.
2. The method of claim 1, wherein the display area of the display screen is divided into a plurality of display sections, and wherein determining the target display area of the display screen where the user's gaze is located according to the user's facial image information comprises:
and determining a display partition on which the current sight of the user falls according to the eye image information of the user, and determining the display partition on which the current sight of the user falls as the target display area.
3. The method according to claim 1, wherein after determining the target display area of the display screen where the current sight line of the user is located according to the facial image information of the user, the method further comprises:
and under the condition that the current sight line of the user is detected to be changed, re-determining the target display area of the display screen where the current sight line of the user is located according to the current eye image information of the user.
4. An electronic device is characterized by comprising a processor, a display chip, a camera and a display screen;
the camera is connected with the processor and used for acquiring user face image information in real time and transmitting the user face image information to the processor;
the processor determines a target area which needs to be subjected to image quality enhancement processing in a target image according to the user face image information, wherein the target image is an image which needs to be displayed currently on the display screen;
the display chip performs image quality enhancement processing on the image information of the target area;
the processor or the display chip synthesizes image information of a target area after image quality enhancement processing and image information which is not subjected to image quality enhancement processing in the target image to obtain a synthetic image, and transmits the synthetic image to the display screen;
the display screen displays the composite image.
5. The electronic device of claim 4, wherein the processor is coupled to the display chip, the display chip being further coupled to the display screen;
the processor transmits the image information of the target area and the image information of the target image except the target area to the display chip respectively, or the processor transmits the target image and identification information for identifying the target area to the display chip;
the display chip synthesizes the image information of the target area after the image quality enhancement processing and the image information which is not subjected to the image quality enhancement processing in the target image to obtain a synthetic image, and transmits the synthetic image to the display screen.
6. The electronic device of claim 4, wherein the processor is connected to the display chip, the processor is further connected to the display screen, the processor transmits the image information of the target area to the display chip, the display chip transmits the image information of the target area after the image quality enhancement processing to the processor, and the processor synthesizes the image information of the target area after the image quality enhancement processing and the image information of the target area without the image quality enhancement processing to obtain a synthesized image and transmits the synthesized image to the display screen.
7. An image display apparatus, comprising:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring user face image information, and the user face image information comprises user eye image information;
the first determining module is used for determining a target display area of a display screen where the sight of the user is located according to the facial image information of the user;
the second determining module is used for determining a target area which needs to be subjected to image quality enhancement processing in a target image according to the target display area, wherein the target image is an image which needs to be displayed currently on the display screen;
the processing module is used for carrying out image quality enhancement processing on the image information of the target area;
the image processing device comprises a synthesis module, a processing module and a processing module, wherein the synthesis module is used for synthesizing image information of a target area after image quality enhancement processing and image information which is not subjected to image quality enhancement processing in the target image to obtain a synthesized image;
and the display module is used for transmitting the composite image to the display screen for displaying.
8. The apparatus of claim 7, wherein the display area of the display screen is divided into a plurality of display partitions, and wherein the first determining module comprises:
and the determining unit is used for determining the display partition on which the current sight of the user falls according to the eye image information of the user, and determining the display partition on which the current sight of the user falls as the target display area.
9. The apparatus of claim 7, further comprising:
and the third determining module is used for re-determining the target display area of the display screen where the current sight of the user is located according to the current eye image information of the user under the condition that the current sight of the user is detected to be changed.
10. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the image display method according to any one of claims 1 to 3.
11. A readable storage medium, characterized in that it stores thereon a program or instructions which, when executed by a processor, implement the steps of the image display method according to any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111039420.7A CN113709375B (en) | 2021-09-06 | 2021-09-06 | Image display method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111039420.7A CN113709375B (en) | 2021-09-06 | 2021-09-06 | Image display method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113709375A true CN113709375A (en) | 2021-11-26 |
| CN113709375B CN113709375B (en) | 2023-07-11 |
Family
ID=78660580
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111039420.7A Active CN113709375B (en) | 2021-09-06 | 2021-09-06 | Image display method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113709375B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2014026906A (en) * | 2012-07-30 | 2014-02-06 | Canon Inc | Display device and manufacturing method therefor |
| US20140375865A1 (en) * | 2013-06-21 | 2014-12-25 | Qualcomm Incorporated | Systems and methods to super resolve a user-selected region of interest |
| CN106531073A (en) * | 2017-01-03 | 2017-03-22 | 京东方科技集团股份有限公司 | Processing circuit of display screen, display method and display device |
| CN106959759A (en) * | 2017-03-31 | 2017-07-18 | 联想(北京)有限公司 | A kind of data processing method and device |
| CN109271914A (en) * | 2018-09-07 | 2019-01-25 | 百度在线网络技术（北京）有限公司 | Detect method, apparatus, storage medium and the terminal device of sight drop point |
| CN110378914A (en) * | 2019-07-22 | 2019-10-25 | 北京七鑫易维信息技术有限公司 | Rendering method and device, system, display equipment based on blinkpunkt information |
| CN111145108A (en) * | 2019-12-06 | 2020-05-12 | Oppo广东移动通信有限公司 | Image processing method, device, equipment and storage medium |
| CN111179881A (en) * | 2020-01-21 | 2020-05-19 | 重庆长安汽车股份有限公司 | Method, device and system for adjusting brightness of vehicle-mounted display screen, automobile and controller |
| CN111190486A (en) * | 2019-12-27 | 2020-05-22 | 季华实验室 | Partition display method and device based on eye control |
| CN111988525A (en) * | 2020-08-25 | 2020-11-24 | Oppo广东移动通信有限公司 | Image processing method and related device |
| CN113260949A (en) * | 2019-01-31 | 2021-08-13 | 华为技术有限公司 | Method for reducing power consumption and electronic equipment |
-
2021
- 2021-09-06 CN CN202111039420.7A patent/CN113709375B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2014026906A (en) * | 2012-07-30 | 2014-02-06 | Canon Inc | Display device and manufacturing method therefor |
| US20140375865A1 (en) * | 2013-06-21 | 2014-12-25 | Qualcomm Incorporated | Systems and methods to super resolve a user-selected region of interest |
| CN106531073A (en) * | 2017-01-03 | 2017-03-22 | 京东方科技集团股份有限公司 | Processing circuit of display screen, display method and display device |
| CN106959759A (en) * | 2017-03-31 | 2017-07-18 | 联想(北京)有限公司 | A kind of data processing method and device |
| CN109271914A (en) * | 2018-09-07 | 2019-01-25 | 百度在线网络技术（北京）有限公司 | Detect method, apparatus, storage medium and the terminal device of sight drop point |
| CN113260949A (en) * | 2019-01-31 | 2021-08-13 | 华为技术有限公司 | Method for reducing power consumption and electronic equipment |
| CN110378914A (en) * | 2019-07-22 | 2019-10-25 | 北京七鑫易维信息技术有限公司 | Rendering method and device, system, display equipment based on blinkpunkt information |
| CN111145108A (en) * | 2019-12-06 | 2020-05-12 | Oppo广东移动通信有限公司 | Image processing method, device, equipment and storage medium |
| CN111190486A (en) * | 2019-12-27 | 2020-05-22 | 季华实验室 | Partition display method and device based on eye control |
| CN111179881A (en) * | 2020-01-21 | 2020-05-19 | 重庆长安汽车股份有限公司 | Method, device and system for adjusting brightness of vehicle-mounted display screen, automobile and controller |
| CN111988525A (en) * | 2020-08-25 | 2020-11-24 | Oppo广东移动通信有限公司 | Image processing method and related device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113709375B (en) | 2023-07-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113126862B (en) | Screen capture method and device, electronic equipment and readable storage medium | |
| CN113766129A (en) | Video recording method, video recording device, electronic equipment and medium | |
| US20230345113A1 (en) | Display control method and apparatus, electronic device, and medium | |
| CN112911147B (en) | Display control method, display control device and electronic equipment | |
| CN113014801B (en) | Video recording method, video recording device, electronic equipment and medium | |
| CN112422817B (en) | Image processing method and device | |
| CN112261340B (en) | Visual field sharing method and device, electronic equipment and readable storage medium | |
| CN112099704A (en) | Information display method and device, electronic equipment and readable storage medium | |
| CN113655929A (en) | Interface display adaptation processing method and device and electronic equipment | |
| CN112702533B (en) | Sight line correction method and sight line correction device | |
| CN113721876A (en) | Screen projection processing method and related equipment | |
| CN112399010B (en) | Page display method and device and electronic equipment | |
| CN112367486A (en) | Video processing method and device | |
| CN113709375B (en) | Image display method and device and electronic equipment | |
| CN113794831B (en) | Video shooting method, device, electronic equipment and medium | |
| CN114895813A (en) | Information display method and device, electronic equipment and readable storage medium | |
| CN113962840A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN113473012A (en) | Virtualization processing method and device and electronic equipment | |
| CN114125149A (en) | Video playing method, device, system, electronic equipment and storage medium | |
| CN112165584A (en) | Video recording method, video recording device, electronic equipment and readable storage medium | |
| CN113905125A (en) | Video display method and device and electronic equipment | |
| CN112560642A (en) | Display method and device and electronic equipment | |
| CN112367562B (en) | Image processing method and device and electronic equipment | |
| CN112367470B (en) | Image processing method and device and electronic equipment | |
| CN112954252A (en) | Video call method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |