WO2013061599A1 - A method of processing image data for an image display panel - Google Patents

A method of processing image data for an image display panel Download PDF

Info

Publication number
WO2013061599A1
WO2013061599A1 PCT/JP2012/006863 JP2012006863W WO2013061599A1 WO 2013061599 A1 WO2013061599 A1 WO 2013061599A1 JP 2012006863 W JP2012006863 W JP 2012006863W WO 2013061599 A1 WO2013061599 A1 WO 2013061599A1
Authority
WO
WIPO (PCT)
Prior art keywords
pixels
image
group
pixel
luminance
Prior art date
Application number
PCT/JP2012/006863
Other languages
English (en)
French (fr)
Inventor
Benjamin John Broughton
Masahiro Esashi
Kenji Maeda
Tatsuo Watanabe
Original Assignee
Sharp Kabushiki Kaisha
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sharp Kabushiki Kaisha filed Critical Sharp Kabushiki Kaisha
Priority to CN201280041169.0A priority Critical patent/CN103765499B/zh
Priority to JP2014509965A priority patent/JP5756883B2/ja
Publication of WO2013061599A1 publication Critical patent/WO2013061599A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/003—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration using local operators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/068—Adjustment of display parameters for control of viewing angle adjustment
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0686—Adjustment of display parameters with two or more screen areas displaying information with different brightness or colours
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2358/00—Arrangements for display data security
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals

Definitions

  • the present invention relates to a display device, such as an active matrix liquid crystal display device, which is switchable between a public and private display mode.
  • Devices incorporating such displays include mobile phones, Personal Digital Assistants (PDAs), laptop computers, desktop monitors, Automatic Teller Machines (ATMs) and Electronic Point of Sale (EPOS) equipment.
  • PDAs Personal Digital Assistants
  • ATMs Automatic Teller Machines
  • EPOS Electronic Point of Sale
  • Such devices can also be beneficial in situations where it is distracting and therefore unsafe for certain viewers (for example drivers or those operating heavy machinery) to be able to see certain images at certain times, for example an in car television screen while the car is in motion.
  • GB2413394 Sharp
  • WO06132384A1 Sharp, 2005
  • GB2439961 Sharp
  • a switchable privacy device is constructed by adding one or more extra liquid crystal layers and polarisers to a display panel.
  • the intrinsic viewing angle dependence of these extra elements can be changed by switching the liquid crystal electrically in the well-known way.
  • Devices utilising this technology include the Sharp Sh851i and Sh902i mobile phones. These methods share the disadvantages that the additional optical components add thickness and cost to the display.
  • Sharp Sh702iS mobile phone This uses a manipulation of the image data displayed on the phone's LCD, in conjunction with the angular data-luminance properties inherent to the liquid crystal mode used in the display, to produce a private mode in which the displayed information is unintelligible to viewers observing the display from an off-centre position.
  • a key advantage of this type of method is that in the public mode, the display consists of, and operates as, a standard display, with no image quality degradation causes by the private mode capability. However, when in the private mode, the quality of the image displayed to the legitimate, on-axis viewer is severely degraded.
  • the principle of operation of WO2009/110128 is illustrated in Figure 5, which is taken from WO2009/110128.
  • the voltage applied to a sub-pixel in the private mode is determined by an LUT which receives as inputs the main image data, the side image data, and a spatial "flag" parameter.
  • the spatially dependent flag parameter may be a value indicating which of two or more groups the pixel is deemed to be in based on its spatial position. For example, pixels in odd numbered columns in the image array may be said to form one group and pixels in even columns another.
  • the groups could also constitute odd and even pixel rows, or perhaps the two parts of a chequerboard arrangement of the pixel array, etc.
  • mapping between the main image data values, the side image data values, and a spatial "flag" parameter is fixed across the display, so that a particular main image data value, a particular side image data value, and a particular value of the flag parameter will always produce the same sub-pixel voltage, regardless of the position of the pixel in the image.
  • WO201134209 it is described how increasing the size of the group of pixels within which luminance is redistributed increases the maximum contrast of the masking image seen by the off-axis viewer. It is however also described how such in increased size of pixel groups reduces the effective spatial resolution of the main image observed by the on-axis viewer. Essentially, a trade-off exists between the strength of the privacy effect and resolution loss in the main image. WO201134208 describes how this resolution trade-off may be mitigated by careful selection of the spatial parameter which determines which pixels in a group are made brighter or darker, or by temporal inversion of the pattern of the spatial parameter, to cause the eye to average the luminance produced by individual pixels in the group over a number of frames. However, while the perceived resolution loss may be reduced by these methods, there remains an increase in this perceived loss when the luminance averaging is performed over groups consisting of an increased number of pixels.
  • a first aspect of the invention provides a method of processing image data for an image display panel, the method comprising, in a first mode: determining signal voltages to be applied to pixels of the image display panel from received image data constituting an image for display on the image display panel and from a secondary data value for the pixel thereby to generate luminance variations perceivable at a first viewing position but substantially not perceivable at a second viewing position; wherein the signal voltages to be applied to pixels in a group of pixels are determined such that the overall luminance of the pixels in the group is dependent on the overall luminance specified for the pixels in the group by the image data; and wherein the number of pixels in a group is locally variable and is selected according to the image data and/or the secondary data values for pixels in a region of the image where the group is to be defined.
  • the overall luminance of the pixels in the group may be proportional to the overall luminance specified for the pixels in the group by the image data, although the invention is not limited to this.
  • This mode of operation of the display device provides a private (narrow-view) display mode.
  • the luminance variations generated as a result of the secondary data values serve to obscure the image that would be generated if the received image data were the sole input, so that a viewer at the first viewing position (for example position 5 in figure 2) which is outside the intended viewing range in the private mode (the narrow viewing range 6 in figure 2) cannot make out the image, or can only see a degraded version of the image, owing to the superposed luminance variations.
  • a viewer at the second viewing position (for example position 3 in figure 2) which is inside the intended viewing range in the private mode perceives little or no intensity variations, and so sees the original image (that is, the image that would be generated if the received image data were the sole input) with little or no degradation in image quality.
  • the present invention extends the image processing methods of GB2428152A1, WO2009110128A1, WO201134209 and WO201134208 by providing an additional processing step which adaptively and locally determines the size of the groups of pixels within which luminance is redistributed, according to the input image content and/or the side image content. That is, before signal voltages are determined the invention provides the step of defining groups of pixels in the in the pixels of the image display panel, and the signal voltages are determined to provide a redistribution of luminance between pixels in a group (compared to the pixel luminances that would be generated by signal voltages determined from the received image data only).
  • This additional step therefore makes it possible to, for example specify luminance redistribution over an increased pixel group size in local regions in which the main image content is relatively uniform, with no high spatial resolution image features, or in regions in which the side image content requires the increased contrast achievable through luminance averaging over such an increased group size.
  • the additional step may specify luminance redistribution over a reduced pixel group size for main image regions with sharp edges and other high resolution features, or in side image regions where the increased contrast achievable with the use of an increased pixel; group size is not required.
  • the invention can thus provide improved image quality to a viewer at a viewing position in the intended viewing range 6, such as a viewer at position 3 in figure 2, and/or can provide more effective obscuring of the image from a viewer who is at a position outside the intended viewing range, such as a viewer at position 5 in figure 2.
  • Figure 1 is an example schematic of a standard LCD display panel and associated control electronics.
  • Figure 2 is a schematic of a display with a switchable public/private viewing mode, according to an embodiment of the present invention.
  • Figure 3 is a plot of the available off-axis to on-axis luminance space producible by a display incorporating the present invention, when using two pixel groupings.
  • Figure 4 is a plot of the available off-axis to on-axis luminance space producible by a display incorporating the present invention, when using four pixel groupings.
  • Figure 5 is a schematic illustrating how a portion of the control electronics of the prior art for an RGB type display may be implemented in an electronic circuit.
  • Figure 6 is a schematic illustrating how an embodiment of the present invention may be implemented in a portion of the control electronics in an RGB type display.
  • Figure 7 is an illustration of the processing method of an embodiment of the present invention, and its operation on example input image data.
  • Figure 8 is an illustration of A) the results of a processing method of an embodiment of the present invention, and B) the subsequent results of the privacy processing, applied to example input image data.
  • Figure 9 is an illustration of the processing method of a further embodiment of the present invention, and its operation on example input image data.
  • Figure 10 is an illustration of A) the results of a processing method of a further embodiment of the present invention, and B) the subsequent results of the privacy processing, applied to example input image data.
  • Figure 11 is an plot of the different off-axis to on-axis luminance outputs produced by a display incorporating the present invention with four different side image levels when applying A) two pixel and B) four pixel groupings.
  • the display consists of a standard (single wide-viewing (public) mode only), LCD display, with modified control electronics that allow the display to be operated in either the wide-view (public) mode or in a narrow-view (private) mode.
  • An LCD display generally consists of several component parts including:
  • a backlighting unit to supply even, wide angle illumination to the panel.
  • Control electronics to receive digital image data and output analogue signal voltages for each pixel, as well as timing pulses and a common voltage for the counter electrode of all pixels.
  • a schematic of the standard layout of an LCD control electronics is shown in Figure 1 (Ernst Lueder, Liquid Crystal Displays, Wiley and sons Ltd, 2001).
  • a liquid crystal (LC) panel for displaying an image by spatial light modulation, consisting of two opposing glass substrates, onto one of which is disposed an array of pixel electrodes and active matrix array to direct the electronic signals, received from the control electronics, to the pixel electrodes. Onto the other substrate is usually disposed a uniform common electrode and colour filter array film. Between the glass substrates is contained a liquid crystal layer of given thickness, usually 2-6 micro meter, which may be aligned by the presence of an alignment layer on the inner surfaces of the glass substrates. The glass substrates will generally be placed between crossed polarising films and other optical compensation films to cause the electrically induced alignment changes within each pixel region of the LC layer to produce the desired optical modulation of light from the backlight unit and ambient surroundings, and thereby generate the image.
  • LC liquid crystal
  • FIG. 2 An embodiment of the present invention is represented schematically in Figure 2.
  • the LCD Control Electronics (referred to herein also as control electronics), 1, will be configured specifically to the electro-optical characteristics of the LC panel, 2, so as to output signal voltages which are dependent on the input image data in such a way as to optimise the perceived quality of the displayed image, i.e. resolution, contrast, brightness, response time etc, for the principal viewer, 3, observing from a direction normal to the display surface (on-axis).
  • the relationship between the input image data value for a given pixel and the observed luminance resulting from the display (gamma curve) is determined by the combined effect of the data-value to signal voltage mapping of the display driver, and the signal voltage to luminance response of the LC panel.
  • the LC panel, 2 will generally be configured with multiple LC domains per sub-pixel and/or passive optical compensation films so as to preserve the display gamma curve as closely as possible to the on-axis response for all viewing angles, thereby providing substantially the same high quality image to a wide viewing region, 4.
  • it is an inherent property of liquid crystal displays that their electro-optic response is angularly dependent and the off-axis gamma curve will inevitably differ from the on-axis one. As long as this does not result in contrast inversion or large colour-shift or contrast reduction, this does not generally result in an obvious perceived fault in the observed image for the off-axis viewer, 5.
  • a set of main image data, 6, constituting a single image is input to the control electronics, 1, in each frame period.
  • the control electronics then outputs a set of signal data voltages to the LC panel, 2.
  • Each of these signal voltages is directed by the active matrix array of the LC panel to the corresponding pixel electrode and the resulting collective electro-optical response of the pixels in the LC layer generates the image.
  • the control electronics has a single mapping of input pixel data value to output pixel data voltage (for example held in a Look-up table), which it applies to the process for all pixels.
  • a different look-up table may be used for the red, green and blue sub-pixels of the display, but there is no variation in the mapping of an input data value to an output voltage based on the spatial position of the pixel data within the image, or the pixel electrode within the display. Substantially the same image is then perceived by the on-axis viewer, 3, and off-axis viewers, 5, and the display can be said to be operating in a wide viewing mode.
  • the control electronics then outputs a set of signal data voltages, one data voltage for each pixel in the LC panel as previously.
  • the control electronics (display controller) now utilises an expanded look-up table (LUT) and the output signal data voltage for each pixel in the LC panel, constituting a combined image, is dependent on the data values for the corresponding pixel (in terms of spatial position in the image) in both the main, 7, and side, 8, images.
  • the output data voltage for each pixel is also dependent on a third parameter determined by the spatial position of the pixel within the display and the main and/or side image content at that image position.
  • the expanded LUT therefore stores an output data value for every combination of input main image data value, input side image data value and spatial "flag" parameter.
  • the standard LCD control electronics are modified to receive, and store in a buffer, two, rather than one, images per frame period, and also to map the data values of two input images to a single output voltage per pixel, also taking into account a third, spatially dependent, parameter into this mapping.
  • the mapping of input image data to output pixel voltage is no longer identical for all pixels, or even all sub-pixels of the same colour component, in the display.
  • the third, spatially dependent, parameter may be a "flag" value indicating which of two or more pixel type classifications the pixel is deemed to be in based on its spatial position. For example, pixels in odd numbered columns in the image array may be said to form one class and pixels in even columns another. The classes could also constitute odd and even pixel rows, or perhaps the two parts of a chequerboard arrangement of the pixel array, etc. If more than two classifications are used, the spatial flag parameter could now have as many values as there are classifications. The number of output data values or signal voltages for each combination of main and side image data value may also be correspondingly increased.
  • Pixel or sub-pixels in the display of the same colour type may be considered as groups, each group containing one or more pixels or sub-pixels of each classification type.
  • the size of each pixel group, and therefore the number of different values the spatial "flag" parameter may have in any image region may be varied for different image regions and may be determined for each image region according to the main image and/or side image content at each region.
  • the output voltage from the control electronics, 1, causes the LC panel, 2, to display a combined image which is the main image when observed by the main viewer, 3, with minimal degradation of the main image quality.
  • these off-axis observers perceive the side image most prominently, which obscures and/or degrades the main image, securing the main image information to viewers within a restricted cone of angles centred on the display normal, 6.
  • the modified control electronics achieve this by altering the brightness of the individual sub-pixels within the groups of sub-pixels of the same colour type determined by the spatial flag parameter assignment.
  • the individual brightness's are altered from that specified by the main image data, so that while the group maintains a luminance the same or proportional to the overall or average luminance specified by the main image data as observed by the on-axis viewer, 3, the distribution of luminance within the group is changed to a greater or lesser extent.
  • two sub-pixels of 50% luminance may have their luminance altered in equal and opposite directions, so they maintain the same average to the on-axis viewer, but their average luminance to the off-axis viewer, 5, changes as the degree of alteration is increased.
  • the average normalised off-axis luminance produced by a pair of pixels of a typical VAN mode LCD, with all possible combinations of two data values is plotted against the average normalised on-axis luminance in Figure 3. This plot shows that, for any given average on-axis luminance (except the maximum and minimum luminance), a range of possible average off-axis luminances exist.
  • VAN mode displays in which mid-level data values generally produce a higher luminance relative to the maximum at off-axis angle than on-axis, pixel pairs in which the two data values applied to the pair are equal form the upper edge of the space of available off-axis to on-axis luminance points, and pixel pairs in which the combined luminance is concentrated as much as possible into one pixel of the pair (i.e. the data values are maximally different, one of the two being at 0 or 255 in an 8 bit display) lie along the lower edge of the available space.
  • the present invention therefore proposes that the number of pixels in the group within which luminance is redistributed may be determined separately for each local image region, based on an analysis of the main and/or side image content at that region.
  • the key advantage of such an adaptive pixel group size selection process is the simultaneous preservation of perceived image resolution for the on-axis viewer and maximisation of image contrast to the off-axis viewer.
  • a larger group size allows increased side image contrast and therefore improved privacy strength, when the luminance produced by the group to the on-axis viewer is maximally redistributed (i.e. concentrated in as few of the sub-pixels of the group as possible) the main image resolution appears reduced by a larger amount.
  • the pixel group size selection step therefore allows regions of the main image with high resolution features, or regions corresponding to low-contrast requirement areas of the side image, to retain a greater degree of the original resolution by redistributing luminance within a smaller group of neighbouring pixels, at the expense of some side image contrast in these image regions.
  • the group size selection step allows main image regions which are relatively uniform, or regions corresponding to areas in the side image where high contrast would be desirable, to have the privacy strength increased by redistributing luminance within a larger group of neighbouring pixels.
  • high spatial resolution to mean any image feature which occurs on a similar scale to the pixel group sizes which may be selected, e.g.
  • any image feature causing significant change in the image data over the area of the 4x2 block being sampled may be considered “high resolution”.
  • the invention thus provides an advance on the methods for producing a switchable privacy mode disclosed in GB2428152A1, WO2009110128A1, WO201134209 and WO201134208, through providing the additional processing step of main and/or side image content dependent adaptive pixel group size selection, and the above noted applications are incorporated herein by reference.
  • the remainder of this disclosure will concentrate on the advantageous possible configurations and implementations of the pixel group size selection step so as to simultaneously optimise the perceived resolution of the main image and the contrast of the side image, and minimise the resource requirement.
  • the pixel group size selection step is based on analysis of the main image content only, and consists of a sequential analysis of each 2x2 block of like colour type sub-pixels in the main image, plus the two like colour type sub-pixels immediately adjacent horizontally to the 2x2 block on either side (as indicated by the block shown in broken lines in figure 7).
  • pixel groups are referred to as "pixel groups”.
  • Figure 6 shows the modified image data processing method of this embodiment, whereby the spatial flag parameter determining block, which outputs a fixed pattern of pixel classification values, is replaced with the pixel group size selection process which analyses the main image content over a given region (if the main image pixel data values are fed into the LCD control electronics sequentially, this then requires a pixel data buffer) and then outputs a customised spatial flag parameter pattern for that image region.
  • the pixel group size selection step identifies if any of the 8 pixels in the 2x2 block plus 4 adjacent pixels have main image data values over a given threshold, e.g. 150 of a maximum 255 in an 8-bit per colour display.
  • the pixel group size selection step also determines if the difference in the largest and smallest data values applied to the 8 pixels is greater than a given threshold, e.g. 50. These steps serve as a means of simply determining if there are any bright pixels, or high resolution features in the 8 pixel region. If either of the threshold tests is exceeded, then a two pixel classification pattern of spatial parameters is used for the 2x2 block forming the central 4 pixels of the 8 sampled, i.e.
  • the 2x2 block of pixels is assigned the pattern of classification values [1, 2, 1, 2] for the [top left, top right, bottom right and bottom left] pixels respectively If the tests are not exceeded, the 2x2 block is assigned the pattern of classifications of [3, 6, 4, 5] or [4, 5, 3, 6], depending on the position of the 2x2 block in the image.
  • the pixel classification value is then used to select which of the six output data values, for each main image and side image input data value combination in the LUTs is selected for output for that pixel.
  • the output data values in the LUTs are therefore calculated so that the output values for pixel classifications 1 and 2 in combination produce the desired average on-axis and off-axis luminance for each main and side image input data value combination, while the same is also true for the output values 3, 4, 5 and 6 in combination.
  • the LUT output values for pixel class 1 are larger than those of pixel class 2, then repeated blocks of the [1,2,1,2] output pattern will form a chequerboard pattern of brighter and darker pixels in the output image.
  • the output data values for the [3, 4, 5, 6] classification set decrease in order from 3 to 6, then the [3, 6, 4, 5] or [4, 5, 3, 6] patterns will produce a sparse chequer pattern of the same phase as the [1,2,1,2] pattern, i.e. the position of the brightest pixels in each pattern matches. This is advantageous as sharp boundaries between 2 pixel and 4 pixel groupings will not result in the brightest pixels of the output set being positioned adjacent to each other, which may cause visible artefacts in the output image.
  • Providing two possible output patterns for the four pixel group output, [3, 6, 4, 5] and [4, 5, 3, 6] is also advantageous, as for main image regions of 25% luminance, a single pixel in the output set of four pixels may be much brighter than the other three, in this case the position of that bright pixel in the block is varied which provides improved output image appearance to the on-axis viewer.
  • the two output patterns also share the property that the position of the brightest output pixels (type 3 and 4) remains in phase with the position of the brightest output pixels in the [1,2,1,2] pattern output, thereby again ensuring that transitions between 2 pixel groups and 4 pixel groups appear seamless to the on-axis viewer.
  • Figure 7 outlines the pixel group size selection method of the preferred embodiment and shows the method as applied to a main image consisting of a blurred bright diagonal line on a darker background (main image data values of 0-255 are used to illustrate the effect applied to an 8 bit per colour channel display).
  • Figure 8 A) shows the result of the pixel group size selection step in terms of the pixel type classification assigned to each pixel. It can be seen that each 2x2 block of pixels has been assigned the classification pattern [1,2,1,2] where the block is in the vicinity of the bright line, and has been assigned the classification pattern [3, 6, 4, 5] or [4, 5, 3, 6] elsewhere.
  • Figure 8 B shows the result of such pixel class assignments in the output privacy processed image, for the same input main image region, and a corresponding side image content which causes the luminance produced by each group to be concentrated into as few of the pixels in the group as possible. It can be seen that the result of this is where 4 pixel groups were assigned, only one pixel in the group (that assigned class 3) is turned on, and therefore provides the luminance of the entire 4 pixel group form the input main image. In the vicinity of the brighter line, as the pixel group size selection process detected a higher resolution feature and specified pixel groups of size 2 to be applied, a 2x2 bright-dark chequer pattern is produced. For pixels assigned class 1, the output data values are higher than the input data values (inputs of 64 and 191 are increased to 120 and 255 respectively), whereas the pixels assigned class 2 have their data value reduced to zero.
  • the pixel buffer memory requirement is reduced by analysing each 4x1 pixel block of input main image data, rather than each 2x2 block.
  • the main image data is typically read into the display control electronics sequentially, from left to right one row at a time, the requirement to analyse the data of pixels on different rows means the pixel memory buffer has to have capacity to store at least a full line of pixel data. This requirement is reduced to just four pixel by the use of a 4x1 analysis kernel.
  • Pixel Group Size Selection Process is below: (1) For each colour channel in the main image, For each 2x2 block in the main image, (2) If there is one pixel in the 4x2 block centred on the 2x2 block with data value > threshold 1. (3) Or the difference between the highest data value and the lowest data value in the 4x2 block > threshold 2. (4) Then apply 2 x 2 pixel groups in the 2x2 block. (5) Otherwise apply 1 x 4 pixel group in the 2x2 block.
  • the main image data for a single colour channel of the main image at a time are analysed each 4x1 block at a time. While the previous embodiment analysed the neighbouring pixels in addition to the four pixels in the 2x2 block which were having their classification type determined, in order to decide the classification, in this embodiment the pixels having their classification determined are the only ones to be analysed. Also as with the previous embodiment, the four pixels in the current block are analysed to see if any of the pixels have a data value exceeding a first threshold, and also to see if the difference between the largest and smallest data value in the block exceeds a second threshold.
  • the 4x1 block of pixels is assigned the pattern of classification values [1, 2, 1, 2] or [2, 1, 2, 1] for the [leftmost, centre left, centre right and rightmost] pixels respectively, depending on the position of the 4x1 block. If the tests are not exceeded, the 4x1 block is assigned the pattern of classifications of [3, 6, 4, 5], [5, 4, 6, 3], [4, 5, 3, 6] or [6, 3, 5, 4], depending on the position of the 4x1 block in the image. This ensures that regions in which the threshold tests are not exceeded result in the same pattern of pixel classifications as the previous preferred embodiment produced, after four or more rows have been processed.
  • Figures 9 and 10 show the equivalent process outline, pixel classification result and resultant privacy processing result of Figures 7 and 8, for the process of this embodiment. It can be seen that the method of this embodiment produces a very similar result for bright diagonal line features as the preferred embodiment. The method of this embodiment will also produce similar output images to the preferred embodiment for bright and dark vertical lines and other fine features, but fine horizontal line type features will be indistinguishable from plain background regions due to the single line kernel, the process of this embodiment may produce significantly differing outputs to the preferred embodiment in these cases.
  • the threshold tests have been arranged so that 2x2 or 4x2 blocks of pixels analysed in each step have not specified output groups of size two in the instances where the edge of the bright feature has fallen within the sampling kernel, but the central, brightest pixels have not.
  • the threshold test may be arranged so this is not the case however, and a broader region of reduced pixel group size is produced around fine features. This is simply a case of tuning the process parameters to produce the preferred output image appearance for the typical main image content of the display.
  • Pixel Group Size Selection Process is below: (1) For each colour channel in the main image, For each 4x1 block in the main image, (2) If there is one pixel in the 4x1block with data value > threshold 1. (3) Or the difference between the highest data value and the lowest data value in the 4x1 block > threshold 2. (4) Then apply 2 x 2 pixel groups in the 4x2 block. (5) Otherwise apply 1 x 4 pixel group in the 4x1 block.
  • any image content analysis method may be used which provides the desired discrimination between image regions in which are best suited to a particular pixel group size.
  • both the main and side image content in each image region are sampled.
  • main image regions which have no fine features, and therefore might be subject to four pixel groupings based on main image analysis only may have two pixel groupings applied instead if the side image content for that region is such that there is no particular advantage to be gained by using increased pixel size groupings. This may be the case for uniformly bright side image regions.
  • This method may be advantageous for use in displays with a pixel pitch and typical viewing distance that means that the sparse pixel pattern produced by four pixel groups causes a visible "grainy" or coarse texture to be perceived by the on-axis viewer in four pixel grouping regions. This is as it allows the use of such regions to be restricted to those areas in which the increased side image contrast is beneficial.
  • solely the side image content is used. This may be advantageous in that it reduces the computing resource requirement to apply the group size selection process.
  • a process is applied which may be similar to any of the above embodiments, but rather than selecting simply between pixel group sizes of two or four, allows selection between any number of different group sizes, e.g. group of 2, 3 and 4 may be selected between, or two, 4 and 8.
  • group of 2 3 and 4 may be selected between, or two, 4 and 8.
  • the process may also have capability to specify a group size of 1 (i.e. no redistribution of luminance). This may be advantages in low ppi displays in which any luminance redistribution around fine main image features would appear too disruptive to the appearance of those features to the on-axis viewer.
  • a further process is included in the display control electronics which registers instances of the pixel group size selection step changing its output from one neighbouring group of pixels to another.
  • the size of the pixel group determines the range of off-axis luminances which may be produced by the group for any given on-axis luminance
  • changes in the pixel group size, within an image region where the side image value is constant may cause a change in the perceived luminance to the off-axis viewer.
  • figure 11 shows the off-axis to on-axis luminance values produced by the privacy display, as a function of main image input luminance, for four side image levels.
  • the side image may show a logo, a personalised image etc - and in such embodiments it may be desirable for the side image to be as accurately reproduced as possible.
  • a first aspect of the invention provides a method of processing image data for an image display panel, the method comprising, in a first mode: determining signal voltages to be applied to pixels of the image display panel from received image data constituting an image for display on the image display panel and from a secondary data value for the pixel thereby to generate luminance variations perceivable at a first viewing position but substantially not perceivable at a second viewing position; wherein the signal voltages to be applied to pixels in a group of pixels are determined such that the overall luminance of the pixels in the group is dependent on the overall luminance specified for the pixels in the group by the image data; and wherein the number of pixels in a group is locally variable and is selected according to the image data and/or the secondary data values for pixels in a region of the image where the group is to be defined.
  • the overall luminance of the pixels in the group may be proportional to the overall luminance specified for the pixels in the group by the image data, although the invention is not limited to this.
  • This mode of operation of the display device provides a private (narrow-view) display mode.
  • the luminance variations generated as a result of the secondary data values serve to obscure the image that would be generated if the received image data were the sole input, so that a viewer at the first viewing position (for example position 5 in figure 2) which is outside the intended viewing range in the private mode (the narrow viewing range 6 in figure 2) cannot make out the image, or can only see a degraded version of the image, owing to the superposed luminance variations.
  • a viewer at the second viewing position (for example position 3 in figure 2) which is inside the intended viewing range in the private mode perceives little or no intensity variations, and so sees the original image (that is, the image that would be generated if the received image data were the sole input) with little or no degradation in image quality.
  • the present invention extends the image processing methods of GB2428152A1, WO2009110128A1, WO201134209 and WO201134208 by providing an additional processing step which adaptively and locally determines the size of the groups of pixels within which luminance is redistributed, according to the input image content and/or the side image content. That is, before signal voltages are determined the invention provides the step of defining groups of pixels in the in the pixels of the image display panel, and the signal voltages are determined to provide a redistribution of luminance between pixels in a group (compared to the pixel luminances that would be generated by signal voltages determined from the received image data only).
  • This additional step therefore makes it possible to, for example specify luminance redistribution over an increased pixel group size in local regions in which the main image content is relatively uniform, with no high spatial resolution image features, or in regions in which the side image content requires the increased contrast achievable through luminance averaging over such an increased group size.
  • the additional step may specify luminance redistribution over a reduced pixel group size for main image regions with sharp edges and other high resolution features, or in side image regions where the increased contrast achievable with the use of an increased pixel; group size is not required.
  • the invention can thus provide improved image quality to a viewer at a viewing position in the intended viewing range 6, such as a viewer at position 3 in figure 2, and/or can provide more effective obscuring of the image from a viewer who is at a position outside the intended viewing range, such as a viewer at position 5 in figure 2.
  • the method may comprise identifying one or more regions of the image in which there are high spatial resolution features, and selecting a small group size for the identified region(s).
  • Use of a small group size retains a higher degree of the original resolution of the image, and it may therefore be preferable to use a small group size in regions of the image in which there are high spatial resolution features or other image features which may have their appearance disrupted by luminance redistribution among a larger group of pixels.
  • the method may comprise for each distinct group of N pixels in the image, determining the pixel voltages to obtain either a luminance redistribution within all N pixels of the group or a luminance redistribution within M groups of N/M pixels.
  • Determining the pixel voltages to obtain a luminance redistribution within all N pixels of a group may comprise determining pixel voltages for pixels within the group such that one pixel of the group has maximal luminance. Concentration of luminance into just one pixel of a group of pixels improves the strength of the obscuring effect caused by the luminance variations, and so provide a better privacy effect.
  • the method may comprise determining pixel voltages such that, in the displayed image, the resultant arrangement of brighter and darker pixels in a first region of the image having a first pixel group size is in phase with the resultant arrangement of brighter and darker pixels in a second region of the image, the second region being adjacent to the first region and having a first pixel group size different from the second pixel group size. This prevents visible artefacts appearing at the boundaries between regions of the image which have different pixel group sizes.
  • the method may comprise, for a block of pixels, defining one or more groups of pixels in the block on the basis of image data for the pixels in the block.
  • the method may comprise, for a block of pixels, defining one or more groups of pixels in the block on the basis of image data for the pixels in the block and for at least one pixel outside the block.
  • the method may comprise, for pixels at a boundary between a first image region having groups of a first size and a second image region having groups of a second size different from the first size, modifying the pixel voltages to match luminance levels perceived at the first viewing position. This prevents a mismatch between the luminance levels (perceived at the first viewing position) for pixels in the first image region and for pixels in the second image region which might otherwise lead to visible boundaries appearing in the image perceived at the first viewing position.
  • the signal voltages to be applied to pixels in a group of pixels may be determined such that the overall luminance of the pixels in the group is equal to the overall luminance specified for the pixels in the group by the image data.
  • the second viewing position may be a substantially on-axis viewing position.
  • the method may comprise, in a second mode, determining signal voltages to be applied to pixels of the image display panel from the received image data thereby to generate an image perceivable at both the first viewing position and at the second viewing position.
  • This mode provides a wide-view (public) display mode. Switching between the first (private) mode and the second (public) mode may be effected by, for example, use of a "Privacy mode On/Off" signal as shown in figure 6.
  • a second aspect of the present invention provides a control circuit for a display panel, the control circuit being adapted to perform a method of the first aspect.
  • a third aspect of the present invention provides a display comprising a control circuit of the second aspect and a display panel, the control circuit being adapted to, in use, output the determined signal voltages to the display panel.
  • the display panel may be a liquid crystal display panel.
  • a fourth aspect of the present invention provides display panel adapted to perform a method of the first aspect.
  • a fifth aspect of the present invention provides a computer-readable medium containing instructions which, when executed by a processor, cause the processor to perform a method of the first aspect.
  • the embodiments of this invention are applicable to many display devices, and a user may benefit from the option of a privacy function on their normally wide-view display for use in certain public situations where privacy is desirable.
  • Examples of such devices include mobile phones, Personal Digital Assistants (PDAs), laptop computers, desktop monitors, Automatic Teller Machines (ATMs) and Electronic Point of Sale (EPOS) equipment.
  • PDAs Personal Digital Assistants
  • ATMs Automatic Teller Machines
  • EPOS Electronic Point of Sale
  • Such devices can also be beneficial in situations where it is distracting and therefore unsafe for certain viewers (for example drivers or those operating heavy machinery) to be able to see certain images at certain times, for example an in car television screen while the car is in motion.
  • LCD Control Electronics 2. Liquid crystal panel 3. Principal viewer 4. Angular viewing range of the main image in the public mode 5. Off-axis viewer 6. Angular viewing range of the main image in the private mode. 7. Input main image data 8. Input side image data

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Liquid Crystal Display Device Control (AREA)
PCT/JP2012/006863 2011-10-28 2012-10-25 A method of processing image data for an image display panel WO2013061599A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201280041169.0A CN103765499B (zh) 2011-10-28 2012-10-25 一种处理图像数据以用于图像显示面板的方法
JP2014509965A JP5756883B2 (ja) 2011-10-28 2012-10-25 画像表示パネルにおける画像データの処理方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB1118684.8A GB2496114A (en) 2011-10-28 2011-10-28 Adaptive luminance sharing for implementing private display mode
GB1118684.8 2011-10-28

Publications (1)

Publication Number Publication Date
WO2013061599A1 true WO2013061599A1 (en) 2013-05-02

Family

ID=45375509

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/006863 WO2013061599A1 (en) 2011-10-28 2012-10-25 A method of processing image data for an image display panel

Country Status (5)

Country Link
JP (1) JP5756883B2 (zh)
CN (1) CN103765499B (zh)
GB (1) GB2496114A (zh)
TW (1) TWI478141B (zh)
WO (1) WO2013061599A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015019617A1 (en) * 2013-08-08 2015-02-12 Sharp Kabushiki Kaisha Device and method for processing image data for privacy and wide-view using error diffusion
WO2016170793A1 (en) * 2015-04-21 2016-10-27 Sharp Kabushiki Kaisha Display device and a method of driving thereof
CN113284060A (zh) * 2021-05-17 2021-08-20 大连海事大学 一种基于波长衰减识别的水下图像增强方法
CN116648102A (zh) * 2023-06-20 2023-08-25 惠科股份有限公司 显示面板、显示驱动方法及显示装置

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2496113A (en) * 2011-10-28 2013-05-08 Sharp Kk Multiple view window multi-primary display
US10152812B2 (en) * 2015-10-23 2018-12-11 Sharp Kabushiki Kaisha Odd-even veil view for FFS
CN118075437A (zh) * 2024-04-18 2024-05-24 深圳市艾科维达科技有限公司 一种用于投影机的光源智能控制方法及系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070040780A1 (en) * 2005-07-08 2007-02-22 Gass Paul A Display device and liquid crystal display panel
WO2009110128A1 (en) * 2008-03-04 2009-09-11 Sharp Kabushiki Kaisha Display device
WO2010047379A1 (en) * 2008-10-20 2010-04-29 Sharp Kabushiki Kaisha Method of and apparatus for processing image data for display by a display device
WO2011034209A1 (en) * 2009-09-16 2011-03-24 Sharp Kabushiki Kaisha Method, apparatus and program for processing image data for display by a display panel of a display device, and a display device
WO2011034208A1 (en) * 2009-09-16 2011-03-24 Sharp Kabushiki Kaisha Apparatus, display device, method, program, storage medium and lookup table for operating a display device comprising a display panel
JP2011107214A (ja) * 2009-11-12 2011-06-02 Sharp Corp 表示制御装置、表示装置、および電子機器

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8502762B2 (en) * 2003-03-31 2013-08-06 Sharp Kabushiki Kaisha Image processing method and liquid-crystal display device using the same
TWI351668B (en) * 2006-10-24 2011-11-01 Chimei Innolux Corp Display method for display on a display device
GB2445982A (en) * 2007-01-24 2008-07-30 Sharp Kk Image data processing method and apparatus for a multiview display device
JP4834893B2 (ja) * 2007-09-26 2011-12-14 奇美電子股▲ふん▼有限公司 液晶表示装置
US8194016B2 (en) * 2007-09-26 2012-06-05 Chimei Innolux Corporation Liquid crystal display with peep-preventing function
CN101878501B (zh) * 2007-11-29 2013-07-31 皇家飞利浦电子股份有限公司 用于在显示器上提供隐私的方法和设备
GB2476027A (en) * 2009-09-16 2011-06-15 Sharp Kk Display privacy image processing method to emphasise features of a secondary image
US8368727B2 (en) * 2010-01-18 2013-02-05 Sharp Kabushiki Kaisha Angular dependent pixels for trick view
US8629821B2 (en) * 2011-09-12 2014-01-14 Sharp Kabushiki Kaisha Display device with faster changing side image

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070040780A1 (en) * 2005-07-08 2007-02-22 Gass Paul A Display device and liquid crystal display panel
WO2009110128A1 (en) * 2008-03-04 2009-09-11 Sharp Kabushiki Kaisha Display device
WO2010047379A1 (en) * 2008-10-20 2010-04-29 Sharp Kabushiki Kaisha Method of and apparatus for processing image data for display by a display device
WO2011034209A1 (en) * 2009-09-16 2011-03-24 Sharp Kabushiki Kaisha Method, apparatus and program for processing image data for display by a display panel of a display device, and a display device
WO2011034208A1 (en) * 2009-09-16 2011-03-24 Sharp Kabushiki Kaisha Apparatus, display device, method, program, storage medium and lookup table for operating a display device comprising a display panel
JP2011107214A (ja) * 2009-11-12 2011-06-02 Sharp Corp 表示制御装置、表示装置、および電子機器

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015019617A1 (en) * 2013-08-08 2015-02-12 Sharp Kabushiki Kaisha Device and method for processing image data for privacy and wide-view using error diffusion
JP2016527528A (ja) * 2013-08-08 2016-09-08 シャープ株式会社 誤差拡散を使用したプライバシーおよび広視野角のための画像データ処理装置および方法
WO2016170793A1 (en) * 2015-04-21 2016-10-27 Sharp Kabushiki Kaisha Display device and a method of driving thereof
CN113284060A (zh) * 2021-05-17 2021-08-20 大连海事大学 一种基于波长衰减识别的水下图像增强方法
CN113284060B (zh) * 2021-05-17 2024-04-05 大连海事大学 一种基于波长衰减识别的水下图像增强方法
CN116648102A (zh) * 2023-06-20 2023-08-25 惠科股份有限公司 显示面板、显示驱动方法及显示装置
CN116648102B (zh) * 2023-06-20 2024-04-19 惠科股份有限公司 显示面板、显示驱动方法及显示装置

Also Published As

Publication number Publication date
TWI478141B (zh) 2015-03-21
CN103765499A (zh) 2014-04-30
GB201118684D0 (en) 2011-12-14
TW201327541A (zh) 2013-07-01
CN103765499B (zh) 2015-02-18
GB2496114A (en) 2013-05-08
JP2014525595A (ja) 2014-09-29
JP5756883B2 (ja) 2015-07-29

Similar Documents

Publication Publication Date Title
US9330614B2 (en) Method of processing image data for display on a display device, which comprising a multi-primary image display panel
EP2195705B1 (en) Display device
WO2013061599A1 (en) A method of processing image data for an image display panel
US8836715B2 (en) Method, apparatus and program for processing image data for display by a display panel of a display device, and a display device
WO2010047379A1 (en) Method of and apparatus for processing image data for display by a display device
US20120169790A1 (en) Apparatus, display device, method, program, storage medium and lookup table for operating a display device comprising a display panel
WO2011148530A1 (en) Methods for off axis halo mitigation
US8629821B2 (en) Display device with faster changing side image
US20180114505A1 (en) Display device and a method of driving thereof
US10152812B2 (en) Odd-even veil view for FFS
US9402073B2 (en) Image processing for privacy and wide-view using error diffusion

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12844580

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2014509965

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12844580

Country of ref document: EP

Kind code of ref document: A1