JP2016519322A - Display image brightness control - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make an image displayed on a fluoroscopic display easy to see. The present disclosure relates to adjusting the brightness of an image displayed on a perspective display in response to the measured brightness of the perspective view. In one example, the brightness of the perspective view is measured via a sensor located behind the perspective display, and thus the measured brightness corresponds to the brightness perceived by the user's eyes. The change in brightness of the display image is determined corresponding to the change in brightness measured on the perspective view. [Selection] Figure 5

Description

[0001] A fluoroscopic head mounted display provides a user with a combined image that includes a display image and a perspective view of a scene in front of the user. Therefore, the light from the perspective view may make it difficult to see the display image. For example, when the scene in front of the user is brighter, the contrast between the background scene and the display image may decrease. This may make it difficult to see the display image.

[0002] Embodiments relating to adjusting the brightness of an image displayed on a fluoroscopic display in response to the measured brightness of a perspective view are disclosed. For example, in some embodiments, the brightness of the perspective view is measured via a sensor located behind the perspective display, and thus the measured brightness corresponds to the brightness perceived by the user's eyes. . The change in brightness of the display image is determined corresponding to the change in brightness measured on the perspective view.

[0003] FIG. 1 is an illustration of an exemplary fluoroscopic head mounted display device. [0004] FIG. 4 is an example of a combined image viewed by a user using a perspective display device. [0005] FIG. 2 is a cross-sectional view of an exemplary lens assembly in a fluoroscopic head mounted display. 2 is a cross-sectional view of an exemplary lens assembly in a perspective head mounted display. FIG. [0006] FIG. 2 is a cross-sectional view of an exemplary lens assembly on a user's head with a brightness sensor located behind the shielding lens. [0007] FIG. 2 is a cross-sectional view of an exemplary lens assembly on a user's head with a brightness sensor located behind the shielding lens and attached to the side of the arm or frame. [0008] FIG. 5 is a graph showing a non-linear relationship between brightness perceived by the human eye (L *) and measured luminance of a scene or display image. [0009] FIG. 6 is a perspective view and a graph showing perceived brightness (L *) of a display image when d = 2. [0010] FIG. 6 is a graph of the ratio between display luminance and measured perspective brightness to provide a display image that is perceived twice as bright as compared to the perspective view (d = 2) over a wide range of perspective view measured brightness. [0011] FIG. 5 is a flow diagram illustrating an example of a method for automatically controlling display brightness. [0012] FIG. 6 is a flow diagram illustrating another example of a method for automatically controlling brightness of a display. [0013] FIG. 3 is a block diagram of an exemplary computing device.

[0014] In the see-through head mounted display, the user can see the displayed image and at the same time see the see-through view of the scene from the surrounding environment. However, as described above, it may be difficult to see the display image depending on the relative brightness of the display image and the perspective view due to the ambient light. Therefore, to help improve the contrast between the image displayed on the fluoroscopic display and the background environment visible through the fluoroscopic display, the brightness of the displayed image is reduced as the brightness of the background scene increases. And / or an electrochromic or photochromic shielding lens can be used to automatically darken or lighten in response to changes in brightness in the environment.

However, the discriminability of the display image is determined by the difference in brightness between the display image seen by the user's eyes and the perspective view. Therefore, the present disclosure measures the brightness of a perspective view via an optical sensor located on the same side as the user's eyes in the perspective display, and adjusts the brightness of the display image based on the measured brightness. The present invention relates to controlling the brightness of an image displayed on a fluoroscopic head-mounted display.

FIG. 1 shows a diagram of an exemplary fluoroscopic head mounted display device 100. The device includes a frame 105 having one or more lenses 110 that cover a display area 115 and a transparent area 102. FIGS. 3A and 3B show cross-sectional views of two types of lens assemblies 301 and 302 representing one or more lenses 110, where the one or more lenses 110 include a shielding lens 310 and the shielding lens 310. Can be a colored lens having a constant dark hue, or an electrochromic or photochromic lens having a variable dark hue or variable optical density. Lens assemblies 301 and 302 also include display optics 320 and 330, respectively, which display image sources and associated optics for presenting image light from the image sources to display area 115 (see FIG. The image source and associated optics can be located at the top as shown in FIG. 3B and can be located at the bottom (not shown), as shown in FIG. 3A. It can be located on the side surface 320 of the display area 115 or can be located in any other suitable location. In the case of the see-through head mounted display device 100, at least a portion of the display optics 320, 330 and the associated shielding lens 310 is transparent, so that the user's eye 350 has a display image superimposed on a perspective view of the surrounding environment. Is provided. The frame 105 is supported on the observer's head by the arm 130. The arm 130 and / or other portion of the fluoroscopic head mounted display device 100 can also include an electronic device 125, which can be a processor and / or other suitable logic device (for driving the display). Memory) for storing instructions executable by the logic device (s) to operate various functions of the fluoroscopic head mounted display device, and batteries, and WiFi, Bluetooth, cellular, or other Peripheral electronics 127 including wireless connection (s) to other information sources as may be obtained over the Internet or from a local server via wireless technology.

[0017] Additionally, one or more cameras 120 may be included to capture an image of the surrounding environment. Any suitable one or more cameras can be used. For example, the fluoroscopic head mounted display device 100 may be an outward-facing color image camera, grayscale camera, one or more depth cameras (eg, time-of-flight and / or stereoscopic illumination camera (s), stereo camera pair, etc.). ) Can be included. In addition, the fluoroscopic head mounted display device 100 can also include one or more inward (eg, user oriented) cameras, such as a camera that is part of a target tracking system. The optotype tracking camera can be used with one or more light sources to image light from one or more light sources reflected by the user's eyes. The position of the reflection with respect to the user's pupil can be used to determine the gaze direction. This gaze direction can then be used to detect the position where the user gazes at the user interface displayed on the fluoroscopic display. Further, the fluoroscopic head mounted display device 100 is not limited to such a variety of motion sensors (s), position sensors (eg, global positioning sensors), microphones, contact sensors (s), etc. Any other suitable electronic device can be included, including sensors. It will be appreciated that the positions of the various components within the fluoroscopic head mounted display device 100 are shown by way of example, and that other positions are possible.

The transparent head mounted display device 100 can further include a controllable dimming layer for the display area 115, which controls the opacity behind each portion of the display area 115. It can be changed to allow a change in operating mode between transparent, translucent and opaque within the area where the image is displayed. A controllable dimming layer can be included in the shielding lens 310 or the display optics 320 and 330. The controllable dimming layer can be divided so that an image can be displayed on different parts of the display area 115.

FIG. 2 shows an example of a combined image 200 viewed by a user using the perspective head mounted display device 100, the perspective head mounted display device 100 operating in a transparent mode. As can be seen in FIG. 2, the combined image 200 viewed by the user includes a display image 220 provided by the image source superimposed on a perspective view 210 of the user's previous scene. It will be appreciated that the image of FIG. 2 is presented for illustrative purposes and any suitable image or images can be displayed. For example, a virtual image can be displayed such that the image appears to be present in the background scene (eg, by displaying a stereoscopic image). Furthermore, the virtual image is fixed in place with respect to an object in the background scene (eg, through recognition of an object imaged by an outward-facing camera) and fixed in position with respect to the display screen, or A virtual image that is fixed in place relative to any other suitable coordinate frame can also be displayed. Further, various types of images can be displayed including, but not limited to, still images, video images, computer graphics images, user interface images, and the like.

[0020] A fluoroscopic head-mounted display device such as the fluoroscopic head-mounted display device 100 can have various configurations. For example, a fluoroscopic head mounted display device can provide image information to one eye of the user or to both eyes of the user. A fluoroscopic head mounted display device that presents image information to both eyes of the user can have one or two image sources. Monoscopic viewing in which the same image information is presented to both eyes is performed using a fluoroscopic head mounted display device having one or two image sources, and stereoscopic viewing is performed using two images. Utilizing a head mounted display device with a source, different images are presented to the user's eyes, and different images have different perspectives of the same scene.

[0021] Using a variety of image sources including, for example, organic light emitting diode (OLED) displays, quantum dot based light emitting diode (QLED) displays, liquid crystal displays (LCD), or liquid crystal on silicon (LCOS) displays, An image for display can be provided. Further, the image source can be a microprojector or microdisplay with associated optics, or a self-luminous display that presents image light to the display area 115 so that the user can see the displayed image. can do.

The optical system related to the image source relays image light from the image source to the display area 115. These optical systems can include refractive lenses, reflective lenses, mirrors, diffractive lenses, holographic lenses, or waveguides. In the case of a fluoroscopic head mounted display device, the user can be provided with at least a partial view of the scene in front of the fluoroscopic head mounted display device within the user's field of view.

[0023] Embodiments disclosed herein provide automatic control of the brightness of a display image 220 presented to the user's eyes. As described above, the brightness of the scene in front of the user is changed according to the illumination. For example, when the environment is illuminated by full sunlight, the background scene seen through the fluoroscopic display device is much brighter than when the environment is illuminated by moonlight. Furthermore, the darkness or optical density of the shielding lens 310 may also change.

[0024] Accordingly, in order to maintain a more consistent perceived brightness of the display image 220 relative to the perspective view 210, the control system for the perspective head mounted display device 100 can be configured with the perspective view 210 presented to the user's eye. The actual brightness can be taken into account. For this reason, the fluoroscopic head mounted display device can include a brightness sensor located behind the shielding lens 310 so as to measure the brightness of the perspective view 210 corresponding to the brightness seen by the user's eyes. . Any suitable light sensor can be used. One non-limiting example is the APDS 9300 optical sensor available from Avago Technologies, Singapore, which is available through the Avago Technologies Americas Sales Office, San Jose, California.

[0025] Further, in some examples, the fluoroscopic head mounted display device perceives different levels of brightness and brightness changes when the human eye determines the brightness of the display image 220 to be presented. How to do can be taken into account. In such an example, adjusting the brightness of the display image 220 takes into account the non-linear sensitivity of the human eye, and thus is transparent regardless of changes in the brightness of the environment and the darkness of the shielding lens 310. Display image 220 can be presented with consistent perceived brightness differences relative to measured brightness in FIG. Such adjustments can be made via a colored lens having a constant optical density, a shielding lens 310 including an electrochromic or photochromic lens having an optical density that changes in response to ambient brightness, and / or It can be done in any other suitable way.

FIG. 4 shows a simple brightness sensor such as a photodiode provided near the top behind the shielding lens 310 so as to be able to measure the average brightness of the light from the perspective view 210. 4 shows an exemplary head mounted display device including 460. FIG. 5 shows another example in which a simple brightness sensor 560 is located near the side of the user's eye 350 behind the shielding lens 310 in the arm 130 or at the edge of the frame 105. Other examples are possible, such as over the user's eye 350 behind the lens assembly 301 as long as the simple brightness sensor 460 or 560 is located behind the shielding lens. Further, a simple brightness sensor 460 or 560 can be selected and positioned to have a field of view and viewpoint in the same direction that the display image 220 occupies in the user perspective 210. A lens or other optical structure may be added to the brightness sensor 460 or 560 to match the sensor field of view to the user's perspective field of view. By positioning a simple brightness sensor 460 or 560 behind the shielding lens 310, changes in the darkness or optical density of the shielding lens 310 and the associated changes in the brightness of the perspective view 210 can be determined and displayed. The brightness of the image 220 can be changed to provide a more visible display image 220 and a more visible perspective view 210. Accordingly, it is possible to provide a control system that automatically changes the brightness of the display image 220 in response to a change in the brightness of the perspective view.

[0027] Changes in the brightness of the perspective view can be caused by changes in the composition of the scene, changes in the illumination of the scene, changes in the darkness or optical density of the shielding lens, or combinations thereof. As an example, if the measured brightness of perspective 210 is changed by a factor of 2, the average brightness of display image 220 can be changed by a factor of two or any other suitable amount. The average brightness of the display image 220 can be changed by changing the average digital brightness of the display image, by changing the illumination of the image source in the display optics (by changing the voltage, current, or current duty cycle). Change the illumination efficiency in the display optical system with a variable light reduction layer (such as an electrochromic layer) or a variable reflection layer (such as a variable reflector). Can be changed in different ways, including The average digital brightness of the displayed image can be determined by averaging the pixel code values in the image. Alternatively, the average brightness of the displayed image can be determined by determining the brightness of the displayed image ("Brightness Calculation in Digital Image Processing", Sergey Bezryadin et al., Technologies for Digital Fulfillment 2007, Las Vegas , See NV). An exemplary digital method for brightness editing is described in US Pat. No. 7,489,420. In order to make the display image 220 more visible in the combined image 200, the display image 220 can be provided to be perceived as brighter than the perspective view 210, but using the embodiments, the perspective view can be provided. A display image 220 having a lower perceived brightness than 210 may be provided.

[0028] The human eye has a non-linear sensitivity to the brightness of the scene. When the brightness level is low, the human eye is very sensitive to changes in brightness, and when the brightness level is high, the human eye is relatively insensitive (ie, the human eye). Is non-linear). In contrast, an electronic sensor, such as a simple brightness sensor 460 or 560, has a linear sensitivity to changes in brightness. For discussion purposes, perceived brightness or perceived brightness is commonly known as L *. FIG. 6 shows the literature “Gamma and it's Diseases: The Nonlinear Mappings of Intensity in Perception, CRTs, Film and Video”, Charles A. et al. Shows a non-linear relationship between brightness perceived by the human eye (L *) and measured brightness (luminance), obtained from Poynton, SMPTE Journal, December 1993, pp. 1099-1108 . This document describes various mathematical relationships between the perceived brightness (L *) and brightness of a scene or display image, and CIE (Commision Internationale de l'Eclairage, International Lighting Commission). ) And presented by Poynton, the relationship between L * and luminance Y is shown below as an example.
When Y / Y _n > 0.008856, L * = 116 (Y / Y _n ) ^1/3 -16 Equation 1
And if Y / Y _n <0.008856, L * = 903.3 (Y / Y _n )

[0029] In the above equation, Y is the brightness of the scene or displaying images (cd / m2), Y _n is the normalized luminance of the white reference surface is typically a 1 cd / m @ 2, another It can also be set as the value of.

[0030] In a further embodiment of the present invention, an automated brightness control system is provided, and the average brightness of the display image 220 provided to the user by the control system is a perspective view provided by a simple brightness sensor 460. Are selected corresponding to the measured luminance. This control system takes into account the non-linear sensitivity of the human eye, known as the gamma curve. In the control system, the predetermined brightness difference d is the desired ratio between the perceived average perspective brightness L * _ast and the average perceived brightness L * _adi of the displayed image. Is shown in Equation 2 below. The brightness difference d can be selected by the user to match the user's viewing preferences, or whether the user is moving or stationary, and how fast the user is moving, Alternatively, the external scene determined by the camera 120 can be automatically selected based on the detected usage scenario.
d = L * _adi / L * _ast equation 2

[0031] Equation 2 and Equation 1 can be combined to provide an equation that determines the average brightness of the display image Y _adi , which is given below as Equation 3 and the term Y _ast is Refers to the measured brightness of the perspective view.
If Y _ast / Y _n > 0.008856, then Y _adi = Y _n ((dL * _ast +16) / 116) ^{3
_{= Y n ((d (116Y}} ast 1/3 -16) +16) / 116) 3 Equation 3
And if Y _ast / Y _n <0.008856, then Y _adi = Y _n (dL * _ast /903.3)
= Y _n (d (903.3Y _ast ) /903.3)

As a result, when the display image on the head-mounted fluoroscopic head-mounted display device 100 is shown twice as bright as the perspective view, the display image 220 is only slightly brighter than the perspective view 210 in a dim environment. Well, in a bright environment, the display image 220 may need to be much brighter than the perspective view 210. FIG. 7 shows the relationship between the perceived brightness (L *) of the perspective view and the perceived brightness of the display image when d = 2. Over the wide range of perceived brightness shown, the ratio is always double due to the control system of the present invention. Conversely, FIG. 8 shows the ratio of display luminance Y _adi and measured perspective luminance Y _ast to provide a constant double ratio of perceived brightness between display image 220 and perspective 210. As can be seen, this ratio varies from 2 in a dim condition (low luminance) to 8 in a bright condition (high luminance).

[0033] FIG. 9 is a flowchart of an exemplary method of operating a fluoroscopic head mounted display device. In step 910, the user selects the brightness of the display image 220 relative to the perspective view 210 so that it can be seen well. At step 920, the brightness of perspective view 210 is measured using brightness sensor 460 or 560 positioned inside shielding lens 310. At step 930, the brightness of display image 220 is changed in response to the measured change in brightness of perspective diagram 210. Steps 920 and 930 are automatically repeated for the time that the user is using the fluoroscopic head mounted display device 100, or the time that the fluoroscopic head mounted display is otherwise operating. The brightness of the display image 220 can be changed by changing the average digital brightness of the display image, changing the illumination of the image source in the display optical system, a variable dimming layer (such as an electrochromic layer) or variable. It can be changed by different methods including changing the illumination efficiency in the display optical system by a reflective layer (such as a variable reflector).

FIG. 10 is a flowchart of another example of a method for operating a fluoroscopic head-mounted display device. In step 1010, the illumination efficiency of the display optics 320 or 330 is determined, and the illumination efficiency is calculated based on the average digital brightness (luma) of the display image 220 and the average of the display image presented to the user's eye 350. _Related to the brightness Y _adi . The illumination efficiency is a function of the illumination applied to the image source in the display optics 320 or 330 and the loss in the display optics 320 or 330. In step 1020, the user selects a brightness difference (d) between the display image 220 and the perspective view 210 to provide good visibility of the display image 220 or perspective view 210. At step 1030, the brightness Y _ast of the perspective view is measured using the brightness sensor 460 or 560 positioned inside the shielding lens 310. In step 1040, the average brightness Y _{adi of} the display image is determined from the average digital brightness (luma) of the display image and the illumination efficiency of the display optical system 330 or 340. At step 1050, the brightness Y _adi of the displayed image is changed in response to the measured change in perspective brightness Y _ast and the sensitivity of the human eye, as shown, for example, in Equation 3. Steps 1030, 1040, and 1050 are automatically repeated for a period during which the user is using the fluoroscopic head mounted display device 100 or during which the fluoroscopic head mounted display device 100 is otherwise operating. .

[0035] In a further example, the brightness sensor 460 or 560 may be a low resolution image sensor having a plurality of pixels. In this way, the brightness of different parts of the field of view can be determined. Changes to the brightness of the displayed image include the average brightness of the scene, the maximum brightness of the scene, the brightness of the center of the scene, and / or the brightness of the part of the scene where the image is displayed. You can add based on the size. It will be appreciated that in other embodiments, any suitable sensor can be used as a brightness sensor, including but not limited to an image sensor.

[0036] In yet another example, the measured brightness of the scene can be used to change the way the displayed image is presented. For example, if the scene is determined to be very dim, the display image can be changed to a grayscale image or a red or green image so that the user's eyes can better adapt to dim conditions. Alternatively, if it is determined that the scene is too bright, the contrast in the display image can be increased. In this embodiment, a predetermined threshold should be selected, and exceeding the threshold results in a change in the way the display image is presented. The threshold can be selected to be exceeded by either exceeding the threshold or falling below the threshold.

[0037] The advantage of this control system is a more consistent visibility of the displayed image superimposed on the perspective view over a wide range of environmental conditions from dim to bright conditions and over a wide range of darkness or optical density of the shielding lens. Is to be provided. The user can select the brightness of the displayed image relative to the perspective view, and the system can maintain a more constant perceived difference.

[0038] In some embodiments, the methods and processes described herein can be coupled to a computing system of one or more computing devices. In particular, such methods and processes may be implemented as computer application programs or services, application programming interfaces (APIs), libraries, and / or other computer program products.

[0039] FIG. 11 schematically illustrates a non-limiting embodiment of a computing system 1100 that can perform one or more of the methods and processes described above. The computing system 1100 is shown in a simplified form. The computing system 1100 includes a head mounted display device, other perspective display devices, and / or one or more personal computers, server computers, tablet computers, home entertainment computers, network computing devices, gaming devices, mobile computing devices, It can take the form of a human interface device, a mobile communication device (eg, a smartphone), and / or other computing devices.

The computing system 1100 includes a logical machine 1102 and a storage machine 1104. The computing system 1100 may optionally include a display subsystem 1106, an input subsystem 1108, a communication subsystem 1110, and / or other components not shown in FIG.

[0041] Logical machine 1102 includes one or more physical devices configured to execute instructions. For example, a logical machine may be configured to execute instructions that are part of one or more applications, services, programs, routines, libraries, objects, components, data structures, or other logical constructs. it can. Implement such instructions, perform tasks, implement data types, transform the state of one or more components, achieve technical effects, or otherwise achieve the desired result be able to.

[0042] A logical machine may include one or more processors configured to execute software instructions. Additionally or alternatively, a logical machine can include one or more hardware or firmware logical machines configured to execute hardware or firmware instructions. A logical machine processor can be single-core or multi-core, and instructions executed on the processor can be configured for sequential, parallel, and / or distributed processing. The individual components of the logic machine can optionally be distributed between two or more separate devices, which can be remotely located and / or configured for collaborative processing. be able to. A logical machine aspect can be virtualized and executed by a remotely accessible networked computing device configured in a cloud computing configuration.

[0043] The storage machine 1104 includes one or more physical devices configured to hold instructions executable by a logical machine to perform the methods and processes described herein. When such methods and processes are performed, the state of the storage machine 1104 can be converted, eg, to hold different data.

[0044] The storage machine 1104 may include removable and / or embedded devices. Storage machine 1104 includes, among other things, optical memory (eg, CD, DVD, HD-DVD, Blu-Ray disc, etc.), semiconductor memory (eg, RAM, EPROM, EEPROM, etc.), and / or magnetic memory (eg, hard disk drive, Floppy disk drive, tape drive, MRAM, etc.). Storage machine 1104 is a volatile, non-volatile, dynamic, static, read / write, read only, random access, sequential access, location addressable, file addressable, and / or content addressable device. Can be included. In some embodiments, storage machine 804 and logic machine 802 may be incorporated into a controller on a human interface device.

[0045] It will be appreciated that the storage machine 1104 includes one or more physical devices. Alternatively, however, the aspects of the instructions described herein can be propagated through a communication medium (eg, an electromagnetic signal, an optical signal, etc.) rather than being stored via a storage medium.

[0046] Aspects of logical machine 1102 and storage machine 1104 may be integrated together into one or more hardware logical components. Such hardware logic components include, for example, field programmable gate arrays (FPGA), application specific application and application specific circuits (PASIC / ASIC), application specific application and application standard products (PSSP / ASSP), system on chip ( SOC), as well as complex programmable logic devices (CPLDs).

[0047] The term "program" may be used to describe aspects of computing system 1100 that are implemented to perform a particular function. In some cases, a program may be instantiated through execution of instructions held by storage machine 1104 by logical machine 1102. It will be appreciated that different programs can be instantiated from the same application, service, code block, object, library, routine, API, function, etc. Similarly, the same program can be instantiated with different applications, services, code blocks, objects, routines, APIs, functions, and the like. The term program can encompass individual executable files, data files, libraries, drivers, scripts, database records, etc., or a collection thereof.

[0048] The display subsystem 1106 can be used to present a visual representation of the data held by the storage machine 1104 and can display the data on a fluoroscopic display, as described above. As the methods and processes described herein change the data held by the storage machine and thus convert the state of the storage machine, the state of the display subsystem 1106 will also visually represent changes in the subordinate data as well. Can be converted as follows. Display subsystem 1106 may include one or more display devices that utilize virtually any type of technology. Such a display device can be combined with logical machine 1102 and / or storage machine 1104 in a shared enclosure, or such a display device can be a peripheral display device. Display subsystem 1106 can also include electrochromic structures, photochromic structures, and / or colored structures to help modify contrast or other features of the displayed image.

[0049] The input subsystem 1108 includes an image sensor, a brightness sensor, a microphone, a target tracking system sensor (eg, an inward image sensor on a head mounted display device), a global positioning system sensor, a motion sensor (eg, One or more inertial measurement units), touch sensors, buttons, keyboards, game controllers, mice, optical position trackers, etc., may include or interface with one or more user input devices be able to. In some embodiments, the input subsystem can include or interface to selected natural user input (NUI) components. Such components can be integrated components or peripheral components, and the transformation and / or processing of input motion can be handled on or off the substrate.

[0050] The communication subsystem 1110 may configure the computing system 1100 to be communicatively coupled to one or more other computing devices (eg, to communicatively couple a human interface device to a host computing device). Can do. The communication subsystem 1110 can include wired and / or wireless communication devices that are compatible with one or more different communication protocols.

[0051] Since the configurations and / or techniques described herein are presented for purposes of illustration and numerous variations are possible, these specific embodiments or examples are considered limiting. It will be understood that this should not be done. The particular routines or methods described herein can represent any number of processing strategies, one or more. Accordingly, the various operations illustrated and / or described can be performed in the order illustrated and / or described, can be performed in other orders, can be performed in parallel, or can be omitted. it can. Similarly, the order of the aforementioned processes can be changed.

[0052] The subject matter of this disclosure is the various processes, systems, and configurations disclosed herein, as well as any new and non-obvious combinations and subcombinations of other features, functions, operations, and / or characteristics. As well as any equivalents thereof.

Claims (20)

A fluoroscopic display;
An automatic brightness control system, wherein the automatic brightness control system corresponds to a brightness sensor located behind the fluoroscopic display and a measured brightness of a perspective view measured by the brightness sensor. A processor configured to adjust the brightness of the displayed image;
Perspective head mounted display.   The fluoroscopic head mounted display according to claim 1, wherein the fluoroscopic head mounted display further includes a shielding lens, and the brightness sensor is positioned behind the shielding lens near the top of the shielding lens.   The fluoroscopic head mounted display according to claim 1, wherein the fluoroscopic head mounted display further includes a shielding lens, and the brightness sensor is positioned behind the shielding lens near a side surface of the shielding lens.   The fluoroscopic head mounted display according to claim 3, wherein the brightness sensor is positioned behind the shielding lens in an arm of the head mounted display.   The fluoroscopic head-mounted display according to claim 3, wherein the brightness sensor is positioned behind the shielding lens in a frame of the head-mounted display.   The processor is configured to adjust the brightness of the display image to maintain a constant ratio between the average perceived brightness of the display image and the average perceived brightness of the perspective view. The fluoroscopic head-mounted display according to claim 1.   The fluoroscopic head-mounted display according to claim 1, wherein the processor is configured to adjust the brightness of the displayed image further corresponding to a non-linear sensitivity of the human eye.   The fluoroscopic head mounted according to claim 1, wherein the processor is configured to adjust the brightness of the display image by changing a code value of the image or by changing illumination of an image source. Expression display.   The perspective head mounted display of claim 8, wherein the processor is configured to change illumination of the image source by changing a voltage, current, or power duty cycle to a light source for the image source. .   The fluoroscopy according to claim 1, further comprising a shielding lens, wherein the brightness sensor is located behind the shielding lens, and the shielding lens constitutes a photochromic shielding lens, an electrochromic shielding lens, or a colored shielding lens. Head mounted display.   The fluoroscopic head mounted display according to claim 1, wherein a visual field of the brightness sensor is substantially the same as a visual field of the fluoroscopic display.   The fluoroscopic head mounted display according to claim 1, wherein the brightness sensor has a plurality of pixels for measuring a relative brightness of different parts of the visual field of the fluoroscopic display.   The fluoroscopic head-mounted display according to claim 1, wherein the processor is configured to display the image as a red or green image based on the measured brightness being dim.   The fluoroscopic head-mounted display according to claim 1, wherein the processor is configured to increase the contrast of the display image when the measured brightness exceeds a predetermined brightness threshold. A method for controlling the brightness of a display image on a fluoroscopic head mounted display having a brightness sensor behind a shielding lens,
Selecting the brightness of the display image for a perspective view on the head mounted display;
Measuring the brightness of the perspective view using the brightness sensor;
Automatically adjusting the brightness of the display image in response to the measured brightness change of the perspective view; and
Providing the display image having the adjusted brightness to the head mounted display.   The method of claim 15, wherein the adjustment of the brightness of the display image further comprises adjusting the brightness of the display image in response to human eye sensitivity.   The adjustment of the brightness of the display image is one of the digital brightness of the display image, the illumination in the display optical system, and the optical efficiency in the display optical system and the electrochromic layer in the display optical system. 16. The method of claim 15, comprising adjusting a plurality.   The method of claim 1, wherein the brightness sensor comprises a plurality of pixels for measuring the brightness of a portion of a perspective field and adjusting the portion of the display image. A fluoroscopic display;
A shielding lens;
An automatic brightness control system, wherein the automatic brightness control system is measured by the brightness sensor in response to a brightness sensor located behind the shielding lens and a non-linear sensitivity of the human eye A processor configured to adjust the brightness of the displayed image in response to the measured brightness;
Perspective head mounted display.   The processor is configured to adjust the brightness of the display image to maintain a constant ratio between the average perceived brightness of the display image and the average perceived brightness of the perspective view. The fluoroscopic head-mounted display according to claim 19.

Images