CN111142616B - Image display method and electronic equipment - Google Patents

Image display method and electronic equipment Download PDF

Info

Publication number
CN111142616B
CN111142616B CN201911228586.6A CN201911228586A CN111142616B CN 111142616 B CN111142616 B CN 111142616B CN 201911228586 A CN201911228586 A CN 201911228586A CN 111142616 B CN111142616 B CN 111142616B
Authority
CN
China
Prior art keywords
image
display screen
coordinate
pixel coordinate
sub
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911228586.6A
Other languages
Chinese (zh)
Other versions
CN111142616A (en
Inventor
叶桂
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN201911228586.6A priority Critical patent/CN111142616B/en
Publication of CN111142616A publication Critical patent/CN111142616A/en
Application granted granted Critical
Publication of CN111142616B publication Critical patent/CN111142616B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1637Details related to the display arrangement, including those related to the mounting of the display in the housing
    • G06F1/1641Details related to the display arrangement, including those related to the mounting of the display in the housing the display being formed by a plurality of foldable display components
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

The embodiment of the invention discloses an image display method and electronic equipment. The image display method comprises the following steps: under the condition that the foldable display screen is changed from a first size to a second size, determining a first pixel coordinate of the display screen in the first size and a second pixel coordinate of the display screen in the second size according to a preset coordinate system corresponding to the display screen; performing image interpolation processing on the first image according to the first pixel coordinate and the second pixel coordinate to obtain a second image; the second image is displayed. The embodiment of the invention can solve the problems of distortion, deletion and the like of the displayed image when the foldable display screen deforms.

Description

Image display method and electronic equipment
Technical Field
The embodiment of the invention relates to the technical field of image display, in particular to an image display method and electronic equipment.
Background
With the widespread use of flexible screens, electronic devices have begun to use flexible screens as display screens. The user can stretch or bend the display screen according to the needs, so that the display screen can be in a deformation state such as enlargement, reduction or folding, and the physical form of the display screen is changed.
After the user changes the physical form of the display screen, if the display screen still displays the image according to the image display mode of the initial physical form, the image displayed on the display screen may be distorted or missing.
Disclosure of Invention
The embodiment of the invention provides an image display method and electronic equipment, and aims to solve the problem that when a foldable display screen deforms, displayed images are distorted, lost and the like.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides an image display method applied to an electronic device, where the electronic device includes a foldable display screen, and the method includes:
under the condition that the display screen is changed from a first size to a second size, determining a first pixel coordinate of the display screen in the first size and a second pixel coordinate of the display screen in the second size according to a preset coordinate system corresponding to the display screen;
performing image interpolation processing on the first image according to the first pixel coordinate and the second pixel coordinate to obtain a second image;
the second image is displayed.
In a second aspect, an embodiment of the present invention provides an electronic device, where the electronic device includes a foldable display screen, and includes:
the first coordinate acquisition module is used for determining a first pixel coordinate of the display screen in a first size and a second pixel coordinate of the display screen in a second size according to a preset coordinate system corresponding to the display screen under the condition that the display screen is changed from the first size to the second size;
the first image processing module is used for carrying out image interpolation processing on the first image according to the first pixel coordinate and the second pixel coordinate to obtain a second image;
and the first image display module is used for displaying the second image.
In a third aspect, an embodiment of the present invention provides an electronic device, which includes a processor, a memory, and a computer program stored in the memory and being executable on the processor, and when the computer program is executed by the processor, the steps of the image display method according to the first aspect are implemented.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the image display method according to the first aspect.
In the embodiment of the present invention, when detecting that the foldable display screen changes from the first size to the second size, the electronic device can perform image interpolation processing on the first image in the first size based on the first pixel coordinate of the display screen in the first size and the second pixel coordinate of the display screen in the second size to obtain the second image in the second size, and then display the second image having the same image content as the first image.
Drawings
The present invention will be better understood from the following description of specific embodiments thereof taken in conjunction with the accompanying drawings, in which like or similar reference characters designate like or similar features.
Fig. 1 is a schematic flowchart of an image display method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a display screen according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a display screen according to another embodiment of the present invention;
FIG. 4 is a flowchart illustrating an image displaying method according to another embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a hardware structure of an electronic device implementing various embodiments of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
In order to solve the problems in the prior art, embodiments of the present invention provide an image display method and an electronic device. The following first describes an image display method provided by an embodiment of the present invention.
Fig. 1 is a flowchart illustrating an image display method according to an embodiment of the present invention. As shown in fig. 1, the image display method may include:
s110, under the condition that the display screen is changed from a first size to a second size, determining a first pixel coordinate of the display screen under the first size and a second pixel coordinate of the display screen under the second size according to a preset coordinate system corresponding to the display screen;
s120, performing image interpolation processing on the first image according to the first pixel coordinate and the second pixel coordinate to obtain a second image;
and S130, displaying the second image.
In an embodiment of the present invention, the display screen may be a foldable display screen.
In the embodiment of the present invention, when detecting that the foldable display screen changes from the first size to the second size, the electronic device can perform image interpolation processing on the first image in the first size based on the first pixel coordinate of the display screen in the first size and the second pixel coordinate of the display screen in the second size to obtain the second image in the second size, and then display the second image having the same image content as the first image.
The image display method provided by the embodiment of the invention can be applied to electronic equipment. In some embodiments, the electronic device may include, but is not limited to, a cell phone, a tablet, a laptop, a palmtop, a vehicle-mounted terminal, a wearable device, a pedometer, and the like. In other embodiments, the electronic device may further include a server.
In some embodiments of the present invention, the first image may be a screen wallpaper image, so that the electronic device using the image display method of the embodiments of the present invention may freely change and select the screen wallpaper image without being limited by the size of the screen wallpaper image. In other embodiments of the present invention, the first image may also be picture content, a still image, a moving image, or an icon, etc. displayed in the display screen specified by the user.
In some embodiments of the present invention, before step S110, the physical shape of the display screen may be detected. Specifically, the electronic device may determine the physical form of the display screen by detecting pixels of the display screen that are in an operating state and based on the pixels that are in the operating state. For example, the size of the display panel may be detected by using the number of pixels in the operating state, and the included angle between each group of two adjacent sub-display panels in the plurality of sub-display panels of the display panel may be detected by using the pixel coordinates in the operating state.
In the embodiment of the invention, after the physical form of the display screen is detected, the situation that the display screen is changed from the first size to the second size may occur, and the situation that the included angle between a plurality of groups of adjacent two sub-display screens is changed from the first included angle to the second included angle may also occur. In the following, specific methods for detecting the size change of the display panel and the change of the included angle between the two sub-display panels by using the pixels in the working state will be separately described.
As the size of the display screen changes, the number of pixels on the display surface of the display screen increases as the size of the display screen increases, even if the number of pixels in the operating state increases, and conversely, as the size of the display screen decreases, the number of pixels on the display surface of the display screen decreases, even if the number of pixels in the operating state decreases.
Therefore, in some embodiments of the present invention, a specific method for detecting a size change of a display screen by using a pixel in an active state may include:
acquiring the number of first working pixels of a display screen at a first moment and the number of second working pixels of the display screen at a second moment in two adjacent moments;
and if the number of the first working pixels is different from the number of the second working pixels, determining that the display screen is changed from the first size corresponding to the number of the first working pixels to the second size corresponding to the number of the second working pixels.
After detecting the physical form of the display screen, if it is determined that the display screen changes from the first size to the second size, steps S110 to S130 of the embodiment of the present invention may be executed to perform size scaling processing on the first image based on the first pixel coordinate of the display screen in the first size and the second pixel coordinate of the display screen in the second size, so as to obtain and display the second image.
In some embodiments of the present invention, the preset coordinate system corresponding to the display screen may be a spatial rectangular coordinate system, the origin of coordinates may be a center point of the display screen when the display screen is in the initial state, the x-axis may be a width direction when the display screen is in the initial state, the y-axis may be a length direction when the display screen is in the initial state, and the z-axis may be a direction perpendicular to the display surface of the display screen when the display screen is in the initial state.
In some embodiments of the present invention, step S120 may specifically include:
acquiring a first pixel value corresponding to a first pixel coordinate in a first image;
and performing cubic convolution interpolation processing by using the first pixel coordinate, the second pixel coordinate and the first pixel value, and determining a second pixel value corresponding to the second pixel coordinate to obtain a second image.
The first pixel coordinates of the display screen in the first size may include a plurality of first sub-pixel coordinates, the first pixel values may include a plurality of first sub-pixel values, one first sub-pixel coordinate corresponds to one first sub-pixel value, and the second pixel coordinates of the display screen in the second size may include a plurality of second sub-pixel coordinates. That is, in the case where the display screen is changed from the first size to the second size, a plurality of pixel coordinates of the display screen in the first size are determined, and a plurality of second pixel coordinates of the display screen in the second size are determined.
Specifically, a first sub-pixel value corresponding to each first sub-pixel coordinate in the first image may be obtained, and then a third convolution interpolation method is used to obtain a second sub-pixel value corresponding to each second sub-pixel coordinate based on the plurality of first sub-pixel coordinates, the first sub-pixel value corresponding to each first sub-pixel coordinate, and the plurality of second sub-pixel coordinates, so as to obtain the second image.
The cubic convolution interpolation method may use the plurality of second sub-pixel coordinates as a target pixel coordinate set, use the plurality of first sub-pixel coordinates and a first sub-pixel value corresponding to each first sub-pixel coordinate as an original pixel coordinate set and an original pixel value set, and perform cubic convolution interpolation processing on the target pixel coordinate set by using the original pixel coordinate set and the original pixel value set to obtain a second sub-pixel value corresponding to each second sub-pixel coordinate in the target pixel coordinate set, so as to obtain a scaled second image with a second size. Due to the fact that the computing precision of the cubic convolution interpolation method is high, the quality of the second image after scaling is high, the situation that pixel values are discontinuous cannot occur, and therefore the phenomena of image missing, image distortion and the like can be avoided.
In step S120 of other embodiments of the present invention, image interpolation processing may be performed on the first image by using a nearest neighbor interpolation method, a bi-linear interpolation method, and the like, so as to obtain a second image, which is not described herein.
In some embodiments of the present invention, the plurality of sub-display screens of the display screen may include a first sub-display screen and a second sub-display screen which are adjacent to each other. In other embodiments of the present invention, the plurality of sub display screens of the display screen may further include a first sub display screen, a second sub display screen, a third sub display screen, a fourth sub display screen, or more sub display screens adjacent to each other, which are adjacent in sequence, and are not described herein again.
In the following, taking an example that the display screen includes a first sub display screen and a second sub display screen which are adjacent to each other, the detection of the change of the included angle between the first sub display screen and the second sub display screen is described in detail.
In other embodiments of the present invention, a specific method for detecting a change in an included angle between a first sub-display and a second sub-display by using a pixel in an active state may include:
acquiring a first working pixel coordinate of a display screen at a first moment and a second working pixel coordinate of the display screen at a second moment in two adjacent moments according to a preset coordinate system; the first working pixel coordinate comprises a plurality of first sub-working pixel coordinates, and the second working pixel coordinate comprises a plurality of second sub-working pixel coordinates;
determining a plurality of target second sub-working pixel coordinates in the second working pixel coordinates;
determining a plurality of target first sub-working pixel coordinates corresponding to the plurality of target second sub-working pixel coordinates in the first working pixel coordinates;
respectively determining a first angle value of each target first sub-working pixel coordinate relative to a first central point coordinate in the first working pixel coordinate and a second angle value of each target second sub-working pixel coordinate relative to a second central point coordinate in the second working pixel coordinate;
and if at least one first angle value is different from at least one second angle value, determining that a first included angle between a first sub-display screen and a second sub-display screen corresponding to the first working pixel coordinate of the display screen is changed into a second included angle between the first sub-display screen and the second sub-display screen corresponding to the second working pixel coordinate of the display screen.
In some embodiments of the present invention, the plurality of target second sub-working pixel coordinates may be coordinates of each edge center point pixel of the display screen at the second time, and correspondingly, the plurality of target first sub-working pixel coordinates may be coordinates of each edge center point pixel of the display screen at the first time.
In other embodiments of the present invention, the plurality of target second sub-working pixel coordinates may further include coordinates of each corner pixel of the display screen at the second time point, in addition to the above coordinates of each edge center pixel, and correspondingly, the plurality of target first sub-working pixel coordinates further include coordinates of each corner pixel of the display screen at the first time point, in addition to the coordinates of each edge center pixel.
In other embodiments of the present invention, in order to more accurately detect the change of the included angle between the first sub-display panel and the second sub-display panel, more second sub-working pixel coordinates may be determined as the target second sub-working pixel coordinates, or all second sub-working pixel coordinates may be determined as the target second sub-working pixel coordinates.
Fig. 2 is a schematic structural diagram of a display screen according to an embodiment of the present invention. Fig. 3 is a schematic structural diagram of a display screen according to another embodiment of the present invention.
Next, referring to fig. 2 and fig. 3, a specific method for detecting a change in an included angle between the first sub-display screen and the second sub-display screen is described in detail, taking an example that coordinates of a plurality of target second sub-working pixels may be coordinates of each edge center pixel of the display screen at the second time.
Fig. 2 shows the target first sub-working pixel coordinates a (x1, y1, z1), b (x2, y2, z2), c (x3, y3, z3), d (x4, y4, z4) corresponding to the edge center point pixel of the display screen at the first time, and the first center point coordinate o (x0, y0, z0) in the first working pixel coordinates. In fig. 3, target second sub-working pixel coordinates a ' (x1 ', y1 ', z1 '), b ' (x2 ', y2 ', z2 '), c (x3, y3, z3 '), d ' (x4 ', y4 ', z4 ') corresponding to the edge center point pixel of the display screen at the second time instant and second center point coordinates o ' (x ', y ', z ') in the second working pixel coordinates are shown.
After the coordinates are determined, a second distance between each target second sub-working pixel coordinate and the second center point coordinate and a first distance between each target first sub-working pixel coordinate and the first center point coordinate may be calculated, respectively, and taking target first sub-working pixel coordinate a (x1, y1, z1) and first center point coordinate o (x0, y0, z0) as an example, the first distance oa is a straight-line distance between point a and point o, i.e., | oa | ═ x1-x0, y1-y0, z1-z0 |.
After a second distance between each target second sub-working pixel coordinate and the second central point coordinate and a first distance between each target first sub-working pixel coordinate and the first central point coordinate are calculated, a first angle value of each target first sub-working pixel coordinate relative to the first central point coordinate in the first working pixel coordinate and a second angle value of each target second sub-working pixel coordinate relative to the second central point coordinate in the second working pixel coordinate can be respectively calculated through a cosine law. Then, each first angle value is compared with a corresponding second angle value, for example, the first angle value corresponding to the target first sub-working pixel coordinate a (x1, y1, z1) is compared with the second angle value corresponding to the target second sub-working pixel coordinate a '(x 1', y1 ', z 1'), if the first angle value and the second angle value are different, it is indicated that the included angle between the first sub-display screen and the second sub-display screen is changed, and the included angle is changed from the first included angle corresponding to the first angle value to the second included angle corresponding to the second angle value.
In some embodiments of the present invention, in a case where an angle between a first sub-display and a second sub-display among a plurality of sub-displays of a display is changed from a first angle to a second angle and a size of the display is not changed, the image display method may further include:
under the condition that the included angle between the first sub display screen and the second sub display screen is changed from a first included angle to a second included angle, determining a third pixel coordinate of the display screen under the first included angle and a fourth pixel coordinate of the display screen under the second included angle according to a preset coordinate system;
projecting the first image into a fifth image according to the corresponding relation between the third pixel coordinate and the fourth pixel coordinate;
and displaying the fifth image.
Wherein the third pixel coordinate may include a plurality of third sub-pixel coordinates, the third pixel value may include a plurality of third sub-pixel values, one third sub-pixel coordinate corresponds to one third sub-pixel value, and the fourth pixel coordinate may include a plurality of fourth sub-pixel coordinates.
Specifically, a plurality of third sub-pixel coordinates and a third sub-pixel value corresponding to each third sub-pixel coordinate may be obtained, and then the third sub-pixel value corresponding to each third sub-pixel coordinate is directly set as the fourth sub-pixel value corresponding to the corresponding fourth sub-pixel coordinate according to the mapping relationship between each third sub-pixel value and the corresponding fourth sub-pixel coordinate, so as to project the first image as the fifth image. Taking the fourth sub-pixel coordinate as q (i + x, j + y, v + z) as an example, if the corresponding third sub-pixel coordinate p (i, j, v) is found according to the mapping relationship between each third sub-pixel value and the corresponding fourth sub-pixel coordinate, the third sub-pixel value corresponding to the pixel p may be directly set as the fourth sub-pixel value corresponding to the pixel q.
In other embodiments of the present invention, when the display screen changes from the first size to the second size, and the included angle between the first sub-display screen and the second sub-display screen changes from the first included angle to the second included angle, step S120 shown in fig. 1 may further include:
under the condition that the included angle between the first sub display screen and the second sub display screen is changed from a first included angle to a second included angle, determining a second projection coordinate of the second pixel coordinate relative to a preset plane of a preset coordinate system;
performing image interpolation processing on the first image according to the first pixel coordinate and the second projection coordinate to obtain a third image;
and projecting the third image into a second image according to the corresponding relation between the second projection coordinate and the second pixel coordinate.
Optionally, the specific method for performing image interpolation processing on the first image according to the first pixel coordinate and the second projection coordinate to obtain the third image may include:
determining a first projection coordinate of the first pixel coordinate relative to a preset plane under the condition that the first included angle is not a straight angle;
projecting the first image into a fourth image according to the corresponding relation between the first pixel coordinate and the first projection coordinate;
and performing image interpolation processing on the fourth image according to the first projection coordinate and the second projection coordinate to obtain a third image.
In some embodiments of the present invention, the predetermined plane may be a horizontal plane of the rectangular spatial coordinate system in the case that the predetermined coordinate system is the rectangular spatial coordinate system.
It can be seen that, since the size of the display screen changes, the size scaling processing needs to be performed on the first image, but if the image interpolation processing needs to be performed, the first image and the second image need to be planar images, and if the first included angle is not a flat angle, if the image interpolation processing needs to be performed on the first image based on the first pixel coordinate and the second pixel coordinate, the first image needs to be first converted into a planar image, that is, a fourth image, and the deformed second pixel coordinate needs to be located in one plane, that is, the second projection coordinate, then the image interpolation processing needs to be performed on the fourth image by using the first projection coordinate and the second projection coordinate, so as to obtain a third image located in a predetermined plane, and finally the third image is projected as the second image. Specifically, the specific method for performing image interpolation processing on the fourth image by using the first projection coordinate and the second projection coordinate is similar to the specific method for performing image interpolation processing on the first image by using the first pixel coordinate and the second pixel coordinate, and details are not repeated here. Moreover, the specific method for projecting each image is similar to the specific method for projecting the first image into the fifth image, and is not described herein again.
Fig. 4 is a flowchart illustrating an image display method according to another embodiment of the present invention. As shown in fig. 4, the image display method may further include:
s110, under the condition that the display screen is changed from a first size to a second size, determining a first pixel coordinate of the display screen under the first size and a second pixel coordinate of the display screen under the second size according to a preset coordinate system corresponding to the display screen;
s120, performing image interpolation processing on the first image according to the first pixel coordinate and the second pixel coordinate to obtain a second image;
s130, displaying a second image;
s140, taking the first pixel coordinate, the second pixel coordinate, the first image and the second image as training samples, and training an image conversion model to obtain a trained image conversion model.
Steps S110 to 130 are similar to steps S110 to 130 in the embodiment shown in fig. 1, and are not repeated herein.
In step S140 of the embodiment of the present invention, the first pixel coordinate, the second pixel coordinate, the first image, and the second image may be stored as a training sample, and when the number of the training samples reaches a predetermined value, for example, 100 training samples, or after the time length of storing the first training sample reaches a predetermined time length, for example, one week, the training sample is used to train the image conversion model to obtain the trained image conversion model, so that when the size of the display screen changes again, the fifth pixel coordinate of the display screen in the third size and the sixth pixel coordinate of the display screen in the fourth size may be directly obtained according to the preset coordinate system, and the image to be displayed, the fifth pixel coordinate, and the sixth pixel coordinate are input into the trained image conversion model to obtain the image for display, and the image is displayed.
The image conversion model may be a machine learning model or a deep learning model, such as a random forest model. Specifically, the electronic device may automatically train the image conversion model with the training samples to obtain the trained image conversion model after determining that the standby time exceeds a predetermined standby time, for example, 2 hours, after the number of training samples reaches a predetermined value or the time for storing the first training sample reaches a predetermined time, or in a standby mode in which the electronic device is in a do-not-disturb mode.
Therefore, in the embodiment of the invention, the image to be displayed can be quickly processed by utilizing the trained image conversion model to obtain the image for display, so that the image display speed is improved, and the data processing amount is reduced.
In some embodiments of the invention, the training sample may further include usage data of the electronic device at a second time instance corresponding to the second pixel coordinate. Wherein the usage data may include at least one of: temperature data of the electronic device, geographical location data of the electronic device, application data of the operation of the electronic device, and a second time.
Therefore, the embodiment of the invention can intelligently utilize the image to be displayed to predict the image for display during the operation of the electronic equipment by the user according to the user use data by counting the operation habit of the user on the electronic equipment and the corresponding image display information, thereby ensuring that the image can be freely displayed along with the deformation of the screen without distortion.
Fig. 5 is a flowchart illustrating an electronic device according to an embodiment of the present invention. As shown in fig. 5, the electronic apparatus includes:
the first coordinate obtaining module 210 is configured to, when the display screen changes from the first size to the second size, determine a first pixel coordinate of the display screen in the first size and a second pixel coordinate of the display screen in the second size according to a preset coordinate system corresponding to the display screen;
the first image processing module 220 is configured to perform image interpolation processing on the first image according to the first pixel coordinate and the second pixel coordinate to obtain a second image;
and a first image display module 230 for displaying the second image.
In an embodiment of the present invention, the display screen may be a foldable display screen.
In the embodiment of the present invention, when detecting that the foldable display screen changes from the first size to the second size, the electronic device can perform image interpolation processing on the first image in the first size based on the first pixel coordinate of the display screen in the first size and the second pixel coordinate of the display screen in the second size to obtain the second image in the second size, and then display the second image having the same image content as the first image.
In some embodiments, the electronic device may include, but is not limited to, a cell phone, a tablet, a laptop, a palmtop, a vehicle-mounted terminal, a wearable device, a pedometer, and the like. In other embodiments, the electronic device may further include a server.
In some embodiments of the present invention, the first image may be a screen wallpaper image, so that the electronic device using the image display method of the embodiments of the present invention may freely change and select the screen wallpaper image without being limited by the size of the screen wallpaper image. In other embodiments of the present invention, the first image may also be picture content, a still image, a moving image, or an icon, etc. displayed in the display screen specified by the user.
In some embodiments of the present invention, the first image processing module 220 comprises:
the first pixel acquisition module is used for acquiring a first pixel value corresponding to a first pixel coordinate in a first image;
and the first pixel processing module is used for performing cubic convolution interpolation processing by using the first pixel coordinate, the second pixel coordinate and the first pixel value, determining a second pixel value corresponding to the second pixel coordinate and obtaining a second image.
In the embodiment of the invention, the calculation accuracy of the cubic convolution interpolation method is high, so that the quality of the scaled second image is high, and the condition of discontinuous pixel values is avoided, thereby avoiding the phenomena of image deletion, image distortion and the like.
In other embodiments of the present invention, the display screens include a first sub-display screen and a second sub-display screen, and the first image processing module 220 may further include:
the first coordinate projection module is used for determining a second projection coordinate of the second pixel coordinate relative to a preset plane of a preset coordinate system under the condition that an included angle between the first sub-display screen and the second sub-display screen is changed from a first included angle to a second included angle;
the first image interpolation module is used for carrying out image interpolation processing on the first image according to the first pixel coordinate and the second projection coordinate to obtain a third image;
and the first image projection module is used for projecting the third image into the second image according to the corresponding relation between the second projection coordinate and the second pixel coordinate.
In some embodiments, the first image interpolation module comprises:
the second coordinate projection module is used for determining a first projection coordinate of the first pixel coordinate relative to a preset plane under the condition that the first included angle is not a straight angle;
the second image projection module is used for projecting the first image into a fourth image according to the corresponding relation between the first pixel coordinate and the first projection coordinate;
and the projection image interpolation module is used for carrying out image interpolation processing on the fourth image according to the first projection coordinate and the second projection coordinate to obtain a third image.
In some embodiments of the present invention, the display screen includes a first sub-display screen and a second sub-display screen, and the electronic device further includes:
the second coordinate acquisition module is used for determining a third pixel coordinate of the display screen under the first included angle and a fourth pixel coordinate of the display screen under the second included angle according to a preset coordinate system under the condition that the included angle between the first sub-display screen and the second sub-display screen is changed from the first included angle to the second included angle;
the second image processing module is used for projecting the first image into a fifth image according to the corresponding relation between the third pixel coordinate and the fourth pixel coordinate;
and the second image display module is used for displaying the fifth image.
In other embodiments of the present invention, the electronic device further comprises:
and the conversion model training module is used for training the image conversion model by taking the first pixel coordinate, the second pixel coordinate, the first image and the second image as training samples to obtain the trained image conversion model. The image conversion model may be a machine learning model or a deep learning model, such as a random forest model.
Therefore, in the embodiment of the invention, the image to be displayed can be quickly processed by utilizing the trained image conversion model to obtain the image for display, so that the image display speed is improved, and the data processing amount is reduced.
The electronic device provided by the embodiment of the present invention can implement each process implemented by the electronic device in the method embodiments of fig. 1 to fig. 4, and is not described herein again to avoid repetition.
Fig. 6 shows a hardware structure diagram of an electronic device implementing various embodiments of the present invention. As shown in fig. 6, the electronic device 300 includes, but is not limited to: radio frequency unit 301, network module 302, audio output unit 303, input unit 304, sensor 305, display unit 306, user input unit 307, interface unit 308, memory 309, processor 310, and power supply 311. Those skilled in the art will appreciate that the electronic device structures shown in the figures do not constitute limitations on electronic devices, which may include more or fewer components than shown, or some components in combination, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
Wherein the display unit 306 may include a foldable display screen;
a processor 310 configured to: under the condition that the display screen is changed from a first size to a second size, determining a first pixel coordinate of the display screen under the first size and a second pixel coordinate of the display screen under the second size according to a preset coordinate system corresponding to the display screen; performing image interpolation processing on the first image according to the first pixel coordinate and the second pixel coordinate to obtain a second image; the second image is displayed.
In the embodiment of the present invention, when detecting that the foldable display screen changes from the first size to the second size, the electronic device can perform image interpolation processing on the first image in the first size based on the first pixel coordinate of the display screen in the first size and the second pixel coordinate of the display screen in the second size to obtain the second image in the second size, and then display the second image having the same image content as the first image.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 301 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 310; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 301 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 301 may also communicate with a network and other devices through a wireless communication system.
The electronic device provides wireless broadband internet access to the user via the network module 302, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.
The audio output unit 303 may convert audio data received by the radio frequency unit 301 or the network module 302 or stored in the memory 309 into an audio signal and output as sound. Also, the audio output unit 303 may also provide audio output related to a specific function performed by the electronic device 300 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 303 includes a speaker, a buzzer, a receiver, and the like.
The input unit 304 is used to receive audio or video signals. The input Unit 304 may include a Graphics Processing Unit (GPU) 3041 and a microphone 3042, and the Graphics processor 3041 processes image data of a still picture or video obtained by an image capturing apparatus (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 306. The image frames processed by the graphic processor 3041 may be stored in the memory 309 (or other storage medium) or transmitted via the radio frequency unit 301 or the network module 302. The microphone 3042 may receive sounds and may be capable of processing such sounds into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 301 in case of a phone call mode.
The electronic device 300 also includes at least one sensor 305, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that adjusts the brightness of the display panel 3061 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 3061 and/or the backlight when the electronic device 300 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and identify related functions of vibration (such as pedometer, tapping); the sensors 305 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The display unit 306 is used to display information input by the user or information provided to the user. The Display unit 306 may include a Display panel 3061, and the Display panel 3061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 307 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 307 includes a touch panel 3071 and other input devices 3072. The touch panel 3071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 3071 (e.g., operations by a user on or near the touch panel 3071 using any suitable object or attachment such as a finger, a stylus, etc.). The touch panel 3071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 310, and receives and executes commands sent by the processor 310. In addition, the touch panel 3071 may be implemented using various types, such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 307 may include other input devices 3072 in addition to the touch panel 3071. Specifically, the other input devices 3072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described herein.
Further, the touch panel 3071 may be overlaid on the display panel 3061, and when the touch panel 3071 detects a touch operation on or near the touch panel, the touch operation is transmitted to the processor 310 to determine the type of the touch event, and then the processor 310 provides a corresponding visual output on the display panel 3061 according to the type of the touch event. Although the touch panel 3071 and the display panel 3061 are shown as two separate components in fig. 6 to implement the input and output functions of the electronic device, in some embodiments, the touch panel 3071 and the display panel 3061 may be integrated to implement the input and output functions of the electronic device, which is not limited herein.
The interface unit 308 is an interface for connecting an external device to the electronic apparatus 300. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 308 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 300 or may be used to transmit data between the electronic apparatus 300 and the external device.
The memory 309 may be used to store software programs as well as various data. The memory 309 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 309 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 310 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by operating or executing software programs and/or modules stored in the memory 309 and calling data stored in the memory 309, thereby monitoring the whole electronic device. Processor 310 may include one or more processing units; preferably, the processor 310 may integrate an application processor and a modem processor, wherein the application processor mainly handles operating systems, user interfaces, application programs, and the like, and the modem processor mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 310.
The electronic device 300 may further include a power supply 311 (such as a battery) for supplying power to various components, and preferably, the power supply 311 may be logically connected to the processor 310 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.
In addition, the electronic device 300 includes some functional modules that are not shown, and are not described in detail herein.
Preferably, an embodiment of the present invention further provides an electronic device, which includes a processor 310, a memory 309, and a computer program stored in the memory 309 and capable of running on the processor 310, where the computer program, when executed by the processor 310, implements each process of the above-mentioned embodiment of the image display method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the embodiment of the image display method, and can achieve the same technical effect, and in order to avoid repetition, the detailed description is omitted here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (7)

1. An image display method applied to an electronic device, wherein the electronic device comprises a foldable display screen, the method comprising:
under the condition that the display screen is changed from a first size to a second size, determining a first pixel coordinate of the display screen under the first size and a second pixel coordinate of the display screen under the second size according to a preset coordinate system corresponding to the display screen;
performing image interpolation processing on the first image according to the first pixel coordinate and the second pixel coordinate to obtain a second image with a second size;
displaying the second image;
the method for performing image interpolation processing on a first image according to the first pixel coordinate and the second pixel coordinate to obtain a second image with a second size includes:
under the condition that the included angle between the first sub display screen and the second sub display screen is changed from a first included angle to a second included angle, determining a second projection coordinate of the second pixel coordinate relative to a preset plane of the preset coordinate system;
performing image interpolation processing on the first image according to the first pixel coordinate and the second projection coordinate to obtain a third image;
and projecting the third image into the second image according to the corresponding relation between the second projection coordinate and the second pixel coordinate.
2. The method according to claim 1, wherein the performing image interpolation processing on the first image according to the first pixel coordinate and the second projection coordinate to obtain a third image comprises:
determining a first projection coordinate of the first pixel coordinate relative to the preset plane under the condition that the first included angle is not a straight angle;
projecting the first image into a fourth image according to the corresponding relation between the first pixel coordinate and the first projection coordinate;
and performing image interpolation processing on the fourth image according to the first projection coordinate and the second projection coordinate to obtain the third image.
3. The method of claim 1, wherein the display screen comprises a first sub-display screen and a second sub-display screen, the method further comprising:
under the condition that the included angle between the first sub-display screen and the second sub-display screen is changed from a first included angle to a second included angle, determining a third pixel coordinate of the display screen under the first included angle and a fourth pixel coordinate of the display screen under the second included angle according to the preset coordinate system;
projecting the first image into a fifth image according to the corresponding relation between the third pixel coordinate and the fourth pixel coordinate;
and displaying the fifth image.
4. An electronic device including a foldable display screen, comprising:
the first coordinate acquisition module is used for determining a first pixel coordinate of the display screen under a first size and a second pixel coordinate of the display screen under a second size according to a preset coordinate system corresponding to the display screen under the condition that the display screen is changed from the first size to the second size;
the first image processing module is used for carrying out image interpolation processing on the first image according to the first pixel coordinate and the second pixel coordinate to obtain a second image with a second size;
the first image display module is used for displaying the second image;
the display screen comprises a first sub-display screen and a second sub-display screen, and the first image processing module comprises:
the first coordinate projection module is used for determining a second projection coordinate of the second pixel coordinate relative to a preset plane of a preset coordinate system under the condition that an included angle between the first sub display screen and the second sub display screen is changed from a first included angle to a second included angle;
the first image interpolation module is used for carrying out image interpolation processing on the first image according to the first pixel coordinate and the second projection coordinate to obtain a third image;
and the first image projection module is used for projecting the third image into a second image according to the corresponding relation between the second projection coordinate and the second pixel coordinate.
5. The electronic device of claim 4, wherein the first image interpolation module comprises:
the second coordinate projection module is used for determining a first projection coordinate of the first pixel coordinate relative to a preset plane under the condition that the first included angle is not a straight angle;
the second image projection module is used for projecting the first image into a fourth image according to the corresponding relation between the first pixel coordinate and the first projection coordinate;
and the projection image interpolation module is used for carrying out image interpolation processing on the fourth image according to the first projection coordinate and the second projection coordinate to obtain a third image.
6. The electronic device of claim 4, wherein the display screen comprises a first sub-display screen and a second sub-display screen, the electronic device further comprising: the second coordinate acquisition module is used for determining a third pixel coordinate of the display screen under the first included angle and a fourth pixel coordinate of the display screen under the second included angle according to the preset coordinate system under the condition that the included angle between the first sub-display screen and the second sub-display screen is changed from the first included angle to the second included angle;
the second image processing module is used for projecting the first image into a fifth image according to the corresponding relation between the third pixel coordinate and the fourth pixel coordinate;
and the second image display module is used for displaying the fifth image.
7. An electronic device, comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the image display method according to any one of claims 1 to 3.
CN201911228586.6A 2019-12-04 2019-12-04 Image display method and electronic equipment Active CN111142616B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911228586.6A CN111142616B (en) 2019-12-04 2019-12-04 Image display method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911228586.6A CN111142616B (en) 2019-12-04 2019-12-04 Image display method and electronic equipment

Publications (2)

Publication Number Publication Date
CN111142616A CN111142616A (en) 2020-05-12
CN111142616B true CN111142616B (en) 2022-04-26

Family

ID=70517570

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911228586.6A Active CN111142616B (en) 2019-12-04 2019-12-04 Image display method and electronic equipment

Country Status (1)

Country Link
CN (1) CN111142616B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1622134A (en) * 2005-01-11 2005-06-01 北京中星微电子有限公司 Image conversion method capable of realizing zooming
CN107589836A (en) * 2017-08-16 2018-01-16 维沃移动通信有限公司 A kind of on-screen display (osd) area method of adjustment and mobile terminal
CN109947320A (en) * 2019-03-15 2019-06-28 Oppo广东移动通信有限公司 Image display method and device, electronic equipment and storage medium
CN110442314A (en) * 2019-07-19 2019-11-12 咪咕动漫有限公司 A kind of display methods, terminal and computer readable storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10222840B2 (en) * 2014-10-15 2019-03-05 Samsung Electronics Co., Ltd. Display apparatus and controlling method thereof
CN108737642A (en) * 2018-04-13 2018-11-02 维沃移动通信有限公司 The display methods and device of content
CN109348019B (en) * 2018-11-30 2021-03-23 维沃移动通信有限公司 Display method and device
CN110290263B (en) * 2019-06-20 2021-08-06 维沃移动通信有限公司 Image display method and mobile terminal

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1622134A (en) * 2005-01-11 2005-06-01 北京中星微电子有限公司 Image conversion method capable of realizing zooming
CN107589836A (en) * 2017-08-16 2018-01-16 维沃移动通信有限公司 A kind of on-screen display (osd) area method of adjustment and mobile terminal
CN109947320A (en) * 2019-03-15 2019-06-28 Oppo广东移动通信有限公司 Image display method and device, electronic equipment and storage medium
CN110442314A (en) * 2019-07-19 2019-11-12 咪咕动漫有限公司 A kind of display methods, terminal and computer readable storage medium

Also Published As

Publication number Publication date
CN111142616A (en) 2020-05-12

Similar Documents

Publication Publication Date Title
CN108073343B (en) display interface adjusting method and mobile terminal
CN109725683B (en) Program display control method and folding screen terminal
CN109032445B (en) Screen display control method and terminal equipment
CN108900695B (en) Display processing method, terminal equipment and computer readable storage medium
CN109348019B (en) Display method and device
CN111459233B (en) Display method, electronic device and storage medium
CN111031234B (en) Image processing method and electronic equipment
CN107734172B (en) Information display method and mobile terminal
CN110933494A (en) Picture sharing method and electronic equipment
CN111290810A (en) Image display method and electronic equipment
CN110908750B (en) Screen capturing method and electronic equipment
CN111028686B (en) Image processing method, image processing apparatus, electronic device, and medium
CN109618055B (en) Position sharing method and mobile terminal
CN109443261B (en) Method for acquiring folding angle of folding screen mobile terminal and mobile terminal
CN109597546B (en) Icon processing method and terminal equipment
CN108536404B (en) Display control method, bendable terminal and computer readable storage medium
CN110941378A (en) Video content display method and electronic equipment
CN108335259B (en) Image processing method, image processing equipment and mobile terminal
CN111147754B (en) Image processing method and electronic device
CN110769162B (en) Electronic equipment and focusing method
CN109842722B (en) Image processing method and terminal equipment
CN109327605B (en) Display control method and device and mobile terminal
CN109189517B (en) Display switching method and mobile terminal
CN108965701B (en) Jitter correction method and terminal equipment
CN110780795A (en) Screen capturing method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant