CN107995518B - Image display method, apparatus and computer storage medium - Google Patents
Image display method, apparatus and computer storage medium Download PDFInfo
- Publication number
- CN107995518B CN107995518B CN201711407207.0A CN201711407207A CN107995518B CN 107995518 B CN107995518 B CN 107995518B CN 201711407207 A CN201711407207 A CN 201711407207A CN 107995518 B CN107995518 B CN 107995518B
- Authority
- CN
- China
- Prior art keywords
- image
- pixel points
- displaying
- adjusting
- displayed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000009826 distribution Methods 0.000 claims abstract description 44
- 238000004590 computer program Methods 0.000 claims description 9
- 238000003707 image sharpening Methods 0.000 claims description 9
- 238000007621 cluster analysis Methods 0.000 claims description 7
- 239000004973 liquid crystal related substance Substances 0.000 claims description 6
- 239000003086 colorant Substances 0.000 claims 1
- 238000012545 processing Methods 0.000 description 22
- 230000000694 effects Effects 0.000 description 21
- 238000004422 calculation algorithm Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 230000007547 defect Effects 0.000 description 5
- 238000013461 design Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000009828 non-uniform distribution Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 230000003014 reinforcing effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000007476 Maximum Likelihood Methods 0.000 description 1
- 239000006096 absorbing agent Substances 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000008358 core component Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
The embodiment of the invention provides an image display method and device. The image display method of the present invention is applied to an image display device including a plurality of movable pixel points, and includes: determining an interested area of the image according to the image to be displayed; adjusting the positions of the pixel points according to the interested area of the image so that the distribution density of the pixel points of the interested area for displaying the image in the image display device is greater than the distribution density of the pixel points of other areas for displaying the image; and displaying the image to be displayed on the adjusted pixel point. The embodiment of the invention can improve the image display quality by dynamically changing the distribution density of the pixel points.
Description
Technical Field
The present invention relates to display technologies, and in particular, to an image display method and apparatus.
Background
With the continuous development of modern society and the application of high-tech products, the image display technology is developed dramatically. The application of 1080P, the currently prevailing 4K2K, and the coming 8K4K display technologies on a large scale all illustrate the development of image display technologies toward high-quality and high-definition visual effects.
The pixels of the display screen on which the image is displayed are typically evenly distributed. Even in a curved display screen, the distribution positions of the pixel points are fixed and unchanged, and the image content is displayed by the fixed pixel points when an image is displayed. The display mode can obtain better viewing effect for a display screen with small screen and high resolution. However, for a large-sized screen, such as a large screen on an oversized television or an outdoor building, the visual effect is often poor due to the relatively large and distance feeling of the pixel points.
In order to improve the image display effect, it is often not enough to rely on the image processing technology, and after the image processing technology is developed to a certain degree, the improvement of the display effect becomes difficult.
Disclosure of Invention
The embodiment of the invention provides an image display method and device, which aim to improve the image display quality by dynamically changing the distribution density of pixel points.
In a first aspect, an embodiment of the present invention provides an image display method, where the image display method is applied to an image display device, where the image display device includes a plurality of movable pixel points, and the method includes:
determining an interested area of the image according to the image to be displayed;
adjusting the positions of the pixel points according to the interested area of the image so that the distribution density of the pixel points of the interested area for displaying the image in the image display device is greater than the distribution density of the pixel points of other areas for displaying the image;
and displaying the image to be displayed on the adjusted pixel point.
In a second aspect, an embodiment of the present invention provides an image display apparatus, including:
a plurality of movable pixel points;
a memory for storing a computer program;
a processor for executing the computer program to implement the method according to the first aspect.
It will be appreciated that the memory may also store video buffer frames.
In a third aspect, an embodiment of the present invention provides a computer storage medium, including: the computer storage medium is for storing a computer program which, when executed, is for implementing the method as described in the first aspect.
The image display method and the device of the embodiment of the invention determine the interested area of the image according to the image to be displayed, adjust the position of the pixel point according to the interested area of the image, so that the distribution density of the pixel points of the interested area for displaying the image in the image display device is larger than the distribution density of the pixel points of other areas for displaying the image, display the image to be displayed on the adjusted pixel point, thereby dynamically changing the distribution density of the pixel points, leading the distribution density of the pixel points of the interested area for displaying the image to be larger than the distribution density of the pixel points of other areas for displaying the image, showing more details of the interested area of the image, increasing the definition of the interested area of the image, improving the image display quality, avoiding the image distortion caused by optimizing the display effect by only depending on an image processing algorithm, and the defect that the display effect is difficult to continue to be improved after the image processing algorithm is optimized to a certain degree can be overcome.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic diagram of an application scenario of the image display method of the present invention;
FIG. 2 is a flowchart illustrating a first embodiment of an image displaying method according to the present invention;
FIG. 3 is a schematic diagram of adjustment directions and adjustment distances of pixel points;
FIG. 4 is a schematic diagram of pixel movement;
FIG. 5 is a flowchart illustrating a second exemplary embodiment of an image displaying method according to the present invention;
FIG. 6 is a flowchart of a third embodiment of an image displaying method according to the present invention;
FIG. 7 is a flowchart of a first embodiment of an image processing method according to the present invention;
fig. 8 is a schematic structural diagram of an image display device according to a first embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The image enhancement processing and the image sharpening processing referred to herein can flexibly select a specific implementation algorithm according to the use requirement.
Fig. 1 is a schematic view of an application scenario of the image display method of the present invention, and as shown in fig. 1, an application scenario of this embodiment may include an image input unit 1, a pixel point control unit 2, and a display unit 3, where the image input unit 1 is connected to the pixel point control unit 2, and the pixel point control unit 2 is connected to the display unit 3. The image input unit 1 is configured to receive an input signal to be displayed, which is specifically determined by a signal source supported by the system, for example, a television (television) video signal, a High Definition Multimedia Interface (HDMI) video signal, a Multimedia video signal, a network video signal, and the like, and the signal to be displayed is input as an image of the pixel point control unit 2, and the signal to be displayed includes a plurality of images to be displayed. The pixel point control unit 2 can adjust the distribution density of pixel points in different areas in the image display device according to the content of the image to be displayed, and the display unit 3 displays the image to be displayed on the adjusted pixel points. Therefore, the image display quality is improved by dynamically changing the distribution of the pixel points in different areas, the image distortion caused by optimizing the display effect by only depending on an image processing algorithm is avoided, and the defect that the display effect is difficult to continue to be improved after the image processing algorithm is optimized to a certain degree can be overcome.
The image display method of the present application can be specifically explained with reference to the following examples.
The image input unit 1, the pixel point control unit 2, and the display unit 3 may be combined with the image display device of the present application, or may be part of the functional units of the image display device of the present application. The image display apparatus of the present application may be a liquid crystal display, a projection display device, or the like.
The image display device of the present application includes a plurality of movable pixels, which may be Light Emitting units, such as Light Emitting Diodes (LEDs), Organic Light Emitting Diodes (OLEDs), micro lenses, and the like.
Fig. 2 is a flowchart of a first embodiment of an image display method according to the present invention, where the image display method of the present embodiment may be applied to an image display device, where the image display device includes a plurality of movable pixels, and as shown in fig. 2, the method of the present embodiment may include:
The region of interest of the image refers to a region in which the user is interested. The region of interest of the image may specifically be determined by using a region of interest detection algorithm existing in the prior art, which is not limited in this embodiment of the present invention.
In an alternative embodiment, the region of interest of the image may be a region where an edge of the image is located, a region where a foreground of the image is located, or another region focused by the user.
In this embodiment, the original resolution of the image display device is not changed, but on the basis that the original resolution is not changed, the distribution density of the pixel points in the image display device is adjusted according to the region of interest of the image to be displayed, specifically, the distribution density of the pixel points is changed by controlling the positions of the pixel points to move within a certain range, so that the distribution density of the pixel points of the region of interest for displaying the image is greater than the distribution density of the pixel points of other regions for displaying the image, the details of the region of interest in the image can be more shown, and the definition of the region of interest of the image is increased. Unlike the prior art, the image display device of the present embodiment has a variable position and a non-uniform distribution of the pixels, i.e., the distribution density of the pixels in the image display device can be varied.
And 203, displaying the image to be displayed on the adjusted pixel point.
Specifically, the present embodiment may adjust the distribution of the pixel points according to the region of interest of the image to be displayed, and display details of the region of interest of the image to be displayed, such as a region where an edge of the image is located, as much as possible by adjusting the distribution of the pixel points, so that the display effect of the image display device is clearer and the details are richer, the effective utilization rate of the pixel points is improved, and the viewing experience of the user is enhanced.
In the foregoing, adjusting the position of the pixel point according to the region of interest of the image may be implemented in a manner that: and determining an adjusting direction and an adjusting distance according to the interested area of the image, and controlling the pixel points of other areas for displaying the image to move the adjusting distance along the adjusting direction.
Another way of implementation may be: and determining an adjusting direction and an adjusting distance according to the interested area of the image, and controlling the pixel point of the interested area for displaying the image to move the adjusting distance along the adjusting direction.
As mentioned above, the pixel point is moved by adjusting the direction and the distance, it can be understood that the pixel point may also be moved by other manners, for example, the pixel point may be moved to the center position according to the determined center position of the region of interest, which is not illustrated here.
Optionally, the adjustment direction may be specifically shown in fig. 3, fig. 3 is a schematic diagram of the adjustment direction and the adjustment distance of the pixel point, and as shown in fig. 3, the pixel point P may move within a certain distance range along eight directions shown in the figure, namely, an upper direction (D1), a lower direction (D5), a left direction (D7), a right direction (D3), an upper right direction (D2), a lower right direction (D4), an upper left direction (D8), and a lower left direction (D6). It is understood that the adjustment direction may not be limited to the above eight directions, and may be any direction movement. As shown in fig. 3, the maximum adjustment distance may be the distance between range 2 and range 1. The range of the adjustment distance may be determined according to actual conditions, and the range of the adjustment distance may be divided into N steps, such as the range 1 and the range 2 shown in fig. 3, and the pixel point P may be moved in 0 to N steps, for example, corresponding to the step0 starting from the initial position of the range 1 in fig. 3, to the step1, … … until the step N corresponding to the range 2 may be moved. step0, step1, … … and step N are called adjustment orders, and each adjustment order corresponds to an adjustment distance.
Taking three pixel points as an example, fig. 4 is a schematic diagram of the movement of the pixel points, and as shown in fig. 4, taking three horizontally arranged pixel points P1, P2, and P3 as an example, the pixel point P2 can move between P2-1 and P2-2 in the horizontal direction, and can divide the space between P2-1 and P2 and the space between P2 and P2-2 into N orders, and the P2 can move 1 order or multiple orders at a time. After the movement, the position relationship between P2 and P1 and P3 becomes non-uniform distribution. Namely, the pixel points with larger distribution density can be used for displaying the image edge, the foreground and the like.
In this embodiment, the region of interest of the image is determined according to the image to be displayed, the positions of the pixel points are adjusted according to the region of interest of the image, so that the distribution density of the pixel points of the region of interest for displaying the image in the image display device is greater than the distribution densities of the pixel points of other regions for displaying the image, and the image to be displayed is displayed on the adjusted pixel points, so that the distribution density of the pixel points of the region of interest for displaying the image is greater than the distribution densities of the pixel points of other regions for displaying the image by dynamically changing the distribution density of the pixel points, the details of the region of interest in the image can be more shown, the definition of the region of interest of the image is increased, the image display quality is improved, and image distortion caused by optimizing the display effect by only depending on an image processing algorithm is avoided, and the defect that the display effect is difficult to continue to be improved after the image processing algorithm is optimized to a certain degree can be overcome.
The following describes in detail the technical solution of the embodiment of the method shown in fig. 2, using several specific embodiments.
Fig. 5 is a flowchart of a second embodiment of an image display method according to the present invention, where the image display device of this embodiment is a liquid crystal display, and each pixel of the liquid crystal display is provided with an electrode, it should be noted that the image display device of this embodiment may also be other display devices, and this embodiment is not limited thereto, and as shown in fig. 5, the method of this embodiment may include:
For a specific implementation of step 501, refer to step 201 above, which is not described herein again.
Specifically, the adjustment direction and the adjustment distance may be determined according to the position of the region of interest of the image in the image.
Specifically, the acting force includes an attractive force and a repulsive force, in order to realize accurate movement of the pixel points, the movement involved in the implementation can also be called as "offset", and when the distribution design of the pixel points of the liquid crystal display is performed, an electrode can be added on each pixel point. Under the condition that all the pixel points are at the initial positions, the acting force (including the attraction force and the repulsion force) of each pixel point reaches a balance, namely the attraction force and the repulsion force of each pixel point reach balance. Determining an adjustment direction and an adjustment distance according to an interesting region of an image to be displayed, and adjusting an acting force applied to electrodes of pixels in the image display device according to the adjustment direction and the adjustment distance, so that pixels in other regions for displaying the image move the adjustment distance along the adjustment direction, thereby adjusting the distribution density of the pixels in the image display device for displaying the interesting region and the other regions, for example, when determining that physical positions of two pixels need to be controlled to be close according to the image to be displayed, the attractive force between the electrodes of the two pixels can be increased or the repulsive force between the electrodes of the two pixels can be reduced, specifically, when the acting force (the attractive force and the repulsive force) of the pixels reaches balance, the pixels do not move, and when the two pixels need to be moved to be close, the attractive force can be increased or the repulsive force can be reduced, the specific selection of the two ways of increasing the attraction force or reducing the repulsion force can be determined according to the polarities of the electrodes of the two pixels, for example, if the two electrodes are both positive electrodes, the specific selection of the way of reducing the repulsion force enables the two pixels to be close to each other, and conversely, when the physical positions of the two pixels are determined to be controlled to be far away according to the image to be displayed, the attraction force between the electrodes of the two pixels can be reduced or the repulsion force between the electrodes of the two pixels can be increased.
The pixel point after the adjustment is non-evenly distributed, and this embodiment can be according to the distribution of waiting the image adjustment pixel point that shows in order to show the image that waits to show as far as possible through the distribution of adjustment pixel point, can make image display device's display effect clearer, the detail is abundanter, improves the effective utilization of pixel point, and reinforcing user's impression is experienced.
It should be noted that, in the step 503, the acting force applied to the electrode of the pixel point may be adjusted according to an adjustment distance and an adjustment direction, so that the pixel point of the region of interest for displaying the image moves the adjustment distance along the adjustment direction, where the adjustment distance and the adjustment direction may be different from those in the step 503.
And 504, displaying the image to be displayed on the adjusted pixel point.
In this embodiment, the interested region of the image is determined according to the image to be displayed, the adjustment direction and the adjustment distance are determined according to the interested region of the image, the acting force applied to the electrodes of the pixel points is adjusted according to the adjustment distance and the adjustment direction, so that the pixel points of other regions for displaying the image move the adjustment distance along the adjustment direction, and the image to be displayed is displayed on the adjusted pixel points, thereby the distribution density of the pixel points of the interested region for displaying the image is made to be greater than the distribution density of the pixel points of other regions for displaying the image by dynamically changing the distribution density of the pixel points, the details of the interested region in the image can be more shown, the definition of the interested region of the image is increased, the image display quality is improved, and the image distortion caused by optimizing the display effect by only depending on an image processing algorithm is avoided, and the defect that the display effect is difficult to continue to be improved after the image processing algorithm is optimized to a certain degree can be overcome.
Fig. 6 is a flowchart of a third embodiment of an image display method according to the present invention, where the image display apparatus of the present embodiment is a projection display device, and a pixel point in the projection display device is a micromirror, as shown in fig. 6, the method of the present embodiment may include:
The specific implementation of step 601 may refer to step 201, which is not described herein again.
Specifically, the adjustment direction and the adjustment distance may be determined according to the position of the region of interest of the image in the image.
Specifically, the pixel points of this embodiment may be microlenses. A core component of a Digital Light Processing (DLP) of the projection display Device is a Digital Micromirror Device (DMD), and the DMD emits Light onto a projection screen after receiving a control signal from a control board. The DMD looks like just a small mirror, enclosed in a metal-glass enclosed space. In fact, the DMD is composed of hundreds of thousands to millions of micro mirrors, each micro mirror represents a pixel, and the size of each micro mirror is 14 μm × 14 μm (or 16 μm × 16 μm), so that the resolution of the image display device can be improved by increasing the number of micro mirrors in the DMD. The micromirrors are linked by a device called "yoke" and controlled by a "torsion hinge" and can be flipped left and right to adjust the orientation and angle of the micromirror. The rotation of the micromirror plate is controlled by a driving signal from a random access memory (CMOS RAM), and when the driving signal is written into the CMOS RAM, static electricity activates the address electrode, the mirror plate and the YOKE plate (YOKE) to cause the hinge device to rotate. The operating principle of the DMD is to reflect the required light by the micro mirror, and to project an image by absorbing the unnecessary light by the light absorber, and the light irradiation direction is realized by controlling the angle of the micro mirror by the electrostatic effect.
The embodiment may specifically realize the movement of the pixel point by adjusting a driving signal, such as a digital driving signal, for controlling the micromirror in the other area for displaying the image.
The utility model provides a concrete implementable mode, in order to realize the removal of the pixel of this embodiment, in the design of DMD, there is the slide in the design of the bottom of hinge, and the hinge can slide near initial default position along the slide when control little mirror surface rotation direction to realize the little skew of the position of pixel. Meanwhile, a digital driving signal (an image to be displayed) written in the CMOS RAM for controlling the rotation of the micro-lens is added with control information of the adjustment distance and the adjustment direction of the pixel points besides information in the original design. Taking a pixel point as an example, it is determined that the pixel point needs to move step2 in the direction of D8 as shown in fig. 3 according to an image to be displayed, and the information is written into the CMOS RAM together with an original digital driving signal to control the movement and rotation of the micromirror on the slide way, thereby realizing the movement of the pixel point.
And step 604, displaying the image to be displayed on the adjusted pixel point.
Specifically, the pixel point after the adjustment is non-evenly distributed, and this embodiment can be according to the distribution of waiting to show image adjustment pixel point, through adjustment pixel point's distribution in order to show the details of the region of interest in waiting to show the image as far as possible, can make image display device's display effect clearer, the details are abundanter, improve the effective utilization of pixel point, reinforcing user's impression experience.
It should be noted that, in step 601, the driving signal for controlling the micromirror of the region of interest for displaying the image may be adjusted according to the adjustment distance and the adjustment direction, so that the micromirror moves the adjustment distance along the adjustment direction, where the adjustment distance and the adjustment direction may be different from those in step 603.
In this embodiment, the region of interest of the image is determined according to the image to be displayed, the adjustment direction and the adjustment distance are determined according to the region of interest of the image, the driving signal for controlling the micromirror of the other region for displaying the image is adjusted according to the adjustment distance and the adjustment direction, so that the micromirror moves the adjustment distance along the adjustment direction, and the image to be displayed is displayed on the adjusted pixel point, so that the distribution density of the pixel points of the region of interest for displaying the image is made greater than the distribution density of the pixel points of the other region for displaying the image by dynamically changing the distribution density of the pixel points, the details of the region of interest in the image can be presented more, the definition of the region of interest of the image is increased, the image display quality is improved, and the image distortion caused by optimizing the display effect by purely depending on an image processing algorithm is avoided, and the defect that the display effect is difficult to continue to be improved after the image processing algorithm is optimized to a certain degree can be overcome.
In an alternative implementation, the image processing may be performed by the following embodiment shown in fig. 7, that is, after the image processing by the embodiment shown in fig. 7, the image to be displayed of the above embodiment is acquired.
Fig. 7 is a flowchart of a first embodiment of an image processing method according to the present invention, and as shown in fig. 7, the method of this embodiment may include:
And step 702, respectively extracting image characteristics of the plurality of video frame images.
Specifically, a video signal includes a plurality of consecutive video frame images, and there is a certain correlation between the previous frame image and the next frame image. The present embodiment may first perform feature extraction on the video frame image. The image features include shape, color, texture, and the like. Alternatively, the texture feature of the video frame image may be mainly extracted, but may not be limited thereto. Texture features are generally defined as local properties of an image, or a measure of the relationship between pixels in a local area, and may also be considered as patterns resulting from a change in gray scale or color in space in some manner.
And 703, performing cluster analysis on the plurality of video frame images according to the extracted image characteristics, and dividing the plurality of video frame images into a plurality of groups.
The specific implementation process of the cluster analysis may be as follows: and calculating the similarity. According to the extracted image features of each video frame image, the similarity between two continuous video frame images is obtained, and for example, the similarity can be calculated through the Euclidean distance. Since different eigenvector values often differ greatly, if the similarity distance is directly calculated, the weight of the eigenvector is affected by the difference of the values, so the eigenvector is normalized before the similarity distance is calculated, and assuming that the eigenvectors after normalization of the two video frame images are Fx ═ Fx1, Fx2, …, FxN ] and Fy ═ Fy1, Fy2, …, FyN, respectively, the similarity distance is:
and then, carrying out cluster analysis on the plurality of video frame images according to the result of similarity calculation, wherein the cluster analysis is an important problem in pattern recognition and is an important method for unsupervised learning. The algorithm of the cluster analysis can be K-means algorithm, maximum likelihood estimation algorithm, graph theory based method and the like. I.e. the video frame images are divided into families according to the result of the similarity calculation.
After clustering analysis is performed on video frame images within a period of time, key frames within each family are extracted.
And the key frame image and other video frame images of each family adopt the same image enhancement or image sharpening mode.
Specifically, image processing (image enhancement or image sharpening) is performed based on the key frame, and similar processing is performed on the remaining frames in the same family. A video signal is divided into a plurality of clusters, each cluster having a key frame. The extracted key frames are subjected to image enhancement or image sharpening, and the rest frames in the same family are subjected to the same processing according to the key frames, so that the time can be saved, and the processing speed can be improved. And (3) carrying out a series of processing on the extracted image features (such as texture features and the like), such as image sharpening, image enhancement and the like, so that the detailed part of the image is more prominent, and the outline is clearer, thereby achieving the optimal viewing effect.
In this embodiment, a video signal is subjected to cluster analysis to extract a key frame, image enhancement of an intra-class video frame is performed based on the key frame, information such as image details, textures, edges, and the like is enhanced, and then the obtained multiple images to be displayed are sequentially subjected to image display in the embodiments shown in fig. 2 to 6. In the embodiment, before the distribution of the pixel points is adjusted, the image is enhanced, so that the image display effect can be effectively improved.
Fig. 8 is a schematic structural diagram of a first image display device according to an embodiment of the present invention, and as shown in fig. 8, the device according to the embodiment may include: a memory 11 and a processor 12, where the memory 11 is used for storing a computer program, and the processor 12 is used for executing the computer program and for executing the technical solution of the foregoing method embodiment, and the implementation principle and the technical effect are similar, and are not described herein again.
When at least a part of the functions of the image display method according to the embodiment of the present invention is implemented by software, the embodiment of the present invention further provides a computer storage medium for storing computer software instructions for the image display apparatus, which, when executed on a computer, enable the computer to perform various possible image display methods according to the embodiment of the method described above. The processes or functions described in accordance with the embodiments of the present invention may be generated in whole or in part when the computer-executable instructions are loaded and executed on a computer. The computer instructions may be stored on a computer storage medium or transmitted from one computer storage medium to another via wireless (e.g., cellular communications, infrared, short-range wireless, microwave, etc.) to another website site, computer, server, or data center. The computer storage media may be any available media that can be accessed by a computer or a data storage device, such as a server, data center, etc., that incorporates one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., SSD), among others.
Furthermore, embodiments of the present invention also provide a computer program product, i.e. a software product, containing instructions, which, when run on a computer, cause the computer to perform various possible image display methods in the above-described method embodiments. The implementation principle and the technical effect are similar, and the detailed description is omitted here.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (6)
1. An image display method applied to an image display apparatus including a plurality of movable pixel points, the method comprising:
determining an interested area of the image according to the image to be displayed;
adjusting the positions of the pixel points according to the interested area of the image so that the distribution density of the pixel points of the interested area for displaying the image in the image display device is greater than the distribution density of the pixel points of other areas for displaying the image;
displaying the image to be displayed on the adjusted pixel point;
wherein, the adjusting the position of the pixel point according to the region of interest of the image comprises:
determining an adjusting direction and an adjusting distance according to the interesting region of the image, and controlling pixel points of other regions for displaying the image to move the adjusting distance along the adjusting direction;
or,
determining an adjusting direction and an adjusting distance according to the region of interest of the image, and controlling the pixel point of the region of interest for displaying the image to move the adjusting distance along the adjusting direction;
the image display device is a liquid crystal display, and each pixel point of the liquid crystal display is provided with an electrode; or, the image display device is a projection display device, and pixel points in the projection display device are micro lenses;
correspondingly, the controlling the pixel points of the other area for displaying the image to move the adjustment distance along the adjustment direction includes:
adjusting the acting force applied to the electrodes of the pixel points according to the adjustment distance and the adjustment direction, so that the pixel points in other areas for displaying the image move the adjustment distance along the adjustment direction;
or,
and adjusting a driving signal for controlling the micro mirror for displaying the other area of the image according to the adjustment distance and the adjustment direction, so that the micro mirror moves the adjustment distance along the adjustment direction.
2. Method according to claim 1, characterized in that the image to be displayed is acquired according to the following steps:
extracting image features of a video frame image, wherein the image features comprise shapes, colors and textures;
and carrying out image enhancement or image sharpening on the image characteristics to obtain an image to be displayed.
3. The method of claim 2, wherein the extracting image features of the video frame image comprises:
receiving a video signal, wherein the video signal comprises a plurality of continuous video frame images;
and respectively extracting the image characteristics of the plurality of video frame images.
4. The method according to claim 3, wherein the performing image enhancement or image sharpening on the image feature to obtain the image to be displayed comprises:
performing cluster analysis on the plurality of video frame images according to the extracted image features, and dividing the plurality of video frame images into a plurality of groups;
and respectively carrying out image enhancement or image sharpening on the key frame image of each group and other video frame images in the group to obtain a plurality of images to be displayed.
5. An image display apparatus, comprising:
a plurality of movable pixel points;
a memory for storing a computer program;
a processor for executing the computer program to implement the method of any one of claims 1 to 4.
6. A computer storage medium, comprising: the computer storage medium is for storing a computer program which, when executed by a processor, is for implementing the method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711407207.0A CN107995518B (en) | 2017-12-22 | 2017-12-22 | Image display method, apparatus and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711407207.0A CN107995518B (en) | 2017-12-22 | 2017-12-22 | Image display method, apparatus and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107995518A CN107995518A (en) | 2018-05-04 |
| CN107995518B true CN107995518B (en) | 2021-02-26 |
Family
ID=62041554
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711407207.0A Active CN107995518B (en) | 2017-12-22 | 2017-12-22 | Image display method, apparatus and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107995518B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109497887B (en) * | 2018-11-06 | 2020-10-30 | 浙江义乌舒美佳科技股份有限公司 | Safety barrel type dust collector |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1588226A (en) * | 2004-08-09 | 2005-03-02 | 扬明光学股份有限公司 | Projection device and adjustable iris aperture therein |
| CN103914124A (en) * | 2014-04-04 | 2014-07-09 | 浙江工商大学 | Energy-saving color mapping method aiming at three-dimensional scenes |
| CN104301605A (en) * | 2014-09-03 | 2015-01-21 | 北京智谷技术服务有限公司 | Imaging control method and device for digital zoom images and imaging equipment |
| CN104464620A (en) * | 2014-11-14 | 2015-03-25 | 北京智谷睿拓技术服务有限公司 | Image display control method and device and display device |
| WO2016074546A1 (en) * | 2014-11-10 | 2016-05-19 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Light-communication sending methods and apparatus, light-communication receiving methods and apparatus, and light communication systems |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100545856C (en) * | 2006-10-11 | 2009-09-30 | 北京新岸线网络技术有限公司 | Video content analysis system |
| CN105450924B (en) * | 2014-09-30 | 2019-04-12 | 北京智谷技术服务有限公司 | The acquisition methods and device of super-resolution image |
| CN104469343B (en) * | 2014-11-26 | 2017-02-01 | 北京智谷技术服务有限公司 | Optical field display control and device and optical field display device |
| CN104469344B (en) * | 2014-12-03 | 2017-03-01 | 北京智谷技术服务有限公司 | Light field display control method and device, light field display device |
| CN104537975B (en) * | 2015-01-16 | 2018-09-04 | 北京智谷睿拓技术服务有限公司 | Display control method and device, display equipment |
| CN106228188B (en) * | 2016-07-22 | 2020-09-08 | 北京市商汤科技开发有限公司 | Clustering method and device and electronic equipment |
-
2017
- 2017-12-22 CN CN201711407207.0A patent/CN107995518B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1588226A (en) * | 2004-08-09 | 2005-03-02 | 扬明光学股份有限公司 | Projection device and adjustable iris aperture therein |
| CN103914124A (en) * | 2014-04-04 | 2014-07-09 | 浙江工商大学 | Energy-saving color mapping method aiming at three-dimensional scenes |
| CN104301605A (en) * | 2014-09-03 | 2015-01-21 | 北京智谷技术服务有限公司 | Imaging control method and device for digital zoom images and imaging equipment |
| WO2016074546A1 (en) * | 2014-11-10 | 2016-05-19 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Light-communication sending methods and apparatus, light-communication receiving methods and apparatus, and light communication systems |
| CN104464620A (en) * | 2014-11-14 | 2015-03-25 | 北京智谷睿拓技术服务有限公司 | Image display control method and device and display device |
Non-Patent Citations (1)
| Title |
|---|
| Variable pixel size ionospheric tomography;Dunyong Zheng等;《Advances in Space Research》;20170615;第59卷(第12期);2969-2986 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107995518A (en) | 2018-05-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11961431B2 (en) | Display processing circuitry | |
| US11321906B2 (en) | Asynchronous time and space warp with determination of region of interest | |
| CN109716766B (en) | Method and device for filtering 360-degree video boundary | |
| WO2017113951A1 (en) | Spliced display system and display method therefor | |
| US20120287233A1 (en) | Personalizing 3dtv viewing experience | |
| US20160066024A1 (en) | Reducing interference of an overlay with underlying content | |
| US11004427B2 (en) | Method of and data processing system for providing an output surface | |
| US20190295455A1 (en) | Controlling image display via mapping of pixel values to pixels | |
| US10534397B2 (en) | Display panel, display device and method for driving display panel | |
| JP2023519728A (en) | 2D image 3D conversion method, apparatus, equipment, and computer program | |
| JP6461209B2 (en) | Video encoding system and method for encoding video | |
| TW201041372A (en) | Image processing system and image processing method | |
| CN111696034B (en) | Image processing method and device and electronic equipment | |
| CN109429085B (en) | Display device and image processing method thereof | |
| CN107995518B (en) | Image display method, apparatus and computer storage medium | |
| JP7397008B2 (en) | Graphics rendering with encoder feedback | |
| CN105791980B (en) | Films and television programs renovation method based on increase resolution | |
| EP4020372A1 (en) | A writing/drawing-to-digital asset extractor | |
| GB2591506A (en) | Data storage system and method | |
| Chen et al. | NLUT: Neural-based 3D Lookup Tables for Video Photorealistic Style Transfer | |
| CN112825243A (en) | Image display method and device, video processor and image display system | |
| WO2022017271A1 (en) | Image display method for display device, and device and computer-readable storage medium | |
| CN111010525B (en) | Method for dynamically adjusting image definition and image processing device thereof | |
| WO2023193648A1 (en) | Image processing method and apparatus, electronic device, and storage medium | |
| US20140320505A1 (en) | Greyscale animation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Applicant after: Hisense Visual Technology Co., Ltd. Address before: 266100 Zhuzhou Road, Laoshan District, Shandong, No. 151, No. Applicant before: QINGDAO HISENSE ELECTRONICS Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |