KR20250049801A - Head-mounted display device and its control method - Google Patents

Abstract

The present disclosure includes a head mounted display device including a display module configured to output light constituting a virtual image, an optical system for transmitting light of the outputted virtual image to a user's eye and allowing external light to pass through, at least one tunable optical filter configured to electrically control transmittance according to wavelength of the transmitted light, a memory storing one or more instructions, and at least one processor executing one or more instructions stored in the memory, wherein the at least one processor obtains a target transmittance spectrum including information on preset wavelength-specific transmittance, and controls the at least one tunable optical filter such that an adjusted transmittance spectrum formed by the at least one tunable optical filter corresponds to the wavelength-specific transmittance of the target transmittance spectrum, and a method for controlling the same.

Description

HEAD-MOUNTED DISPLAY DEVICE AND ITS CONTROL METHOD

A head mounted display device and a control method thereof are disclosed. Specifically, a head mounted display device and a control method thereof for controlling a variable optical filter based on a target transmission spectrum are disclosed.

Light passing through a variable optical filter has its intensity of light reduced by wavelength according to the transmission spectrum of the variable optical filter. Users with eye diseases or low vision need to prevent light of a specific wavelength from entering their eyes according to their individual eye characteristics. Therefore, each user may have a transmission spectrum that is suitable for them.

In one embodiment of the present disclosure, an augmented reality device may include an optical system for transmitting light of an output virtual image to a user's eye and allowing external light to be transmitted, at least one tunable optical filter configured to electrically control transmittance according to wavelength of the transmitted light, a memory storing one or more instructions, and at least one processor for executing one or more instructions stored in the memory. In one embodiment, the at least one processor may obtain a target transmittance spectrum including information about preset transmittance according to wavelength. In one embodiment, the at least one processor may control the at least one tunable optical filter such that an adjusted transmittance spectrum formed by the at least one tunable optical filter corresponds to the transmittance according to wavelength of the target transmittance spectrum.

A virtual reality device according to one embodiment of the present disclosure may include an optical system for transmitting light of an output image to a user's eyes, a memory for storing one or more instructions, and at least one processor for executing one or more instructions stored in the memory. In one embodiment, the at least one processor may obtain RGB channel values of a plurality of pixels of an original image. In one embodiment, the at least one processor may obtain a target transmittance spectrum including information on preset wavelength-specific transmittance. In one embodiment, the at least one processor may obtain a corrected image by adjusting the RGB channel values of the plurality of pixels based on the wavelength-specific transmittance of the target transmittance spectrum. In one embodiment, the at least one processor may display the corrected image on a display.

A method of controlling a head mounted display device including at least one variable optical filter according to one embodiment of the present disclosure may include a step of obtaining a target transmittance spectrum including information on preset wavelength-specific transmittance. In one embodiment, the method may include a step of controlling the at least one variable optical filter such that an adjusted transmittance spectrum formed by the at least one variable optical filter corresponds to the wavelength-specific transmittance of the target transmittance spectrum.

According to one embodiment of the present disclosure, a computer-readable recording medium having recorded thereon a program for performing at least one of the control methods of the disclosed head mounted display device on a computer may be provided.

FIG. 1 is a drawing for explaining the operation of a head mounted display device according to one embodiment of the present disclosure.
FIG. 2 is a plan view of a virtual reality device according to one embodiment of the present disclosure.
FIG. 3 is a plan view of a virtual reality device according to one embodiment of the present disclosure.
FIG. 4 is a drawing for explaining the structure of a variable optical filter according to one embodiment of the present disclosure.
FIG. 5 is a flowchart for explaining the operation of a head mounted display device according to one embodiment of the present disclosure.
FIG. 6 is a flowchart illustrating a method for controlling at least one variable optical filter by a head mounted display device according to one embodiment of the present disclosure.
FIGS. 7A and 7B are drawings for explaining a method for controlling a first variable optical filter of a head mounted display device according to one embodiment of the present disclosure.
FIGS. 8A and 8B are drawings for explaining a method for controlling a second variable optical filter in a head mounted display device according to one embodiment of the present disclosure.
FIGS. 9A and 9B are drawings for explaining a method for controlling a third variable optical filter in a head mounted display device according to one embodiment of the present disclosure.
FIGS. 10A and 10B are drawings for explaining a method for controlling a fourth variable optical filter in a head mounted display device according to one embodiment of the present disclosure.
FIG. 11 is a drawing for explaining an adjusted transmission spectrum formed by overlapping a plurality of transmission spectra according to one embodiment of the present disclosure.
FIG. 12 is a flowchart illustrating a method in which a head mounted display device according to one embodiment of the present disclosure is controlled based on the intensity of external light.
FIG. 13 is a drawing for explaining a change in the intensity of external light passing through at least one variable optical filter according to one embodiment of the present disclosure.
FIG. 14 is a flowchart for explaining the operation of a head mounted display device according to one embodiment of the present disclosure.
FIG. 15 is a diagram for explaining a method for a head mounted display device according to one embodiment of the present disclosure to adjust RGB channel values of a plurality of pixels.
FIG. 16 is a diagram for explaining a process of converting a color gamut of a display by a head mounted display device according to one embodiment of the present disclosure.
FIG. 17 is a flowchart illustrating a method in which a head mounted display device according to one embodiment of the present disclosure is controlled based on the brightness of the display.
FIG. 18 is a detailed configuration diagram of an augmented reality device according to one embodiment of the present disclosure.
FIG. 19 is a detailed configuration diagram of a virtual reality device according to one embodiment of the present disclosure.

The terms used in the embodiments of this specification are selected from the most widely used general terms possible while considering the functions of the present disclosure, but this may vary depending on the intention of engineers working in the field, precedents, the emergence of new technologies, etc. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meanings thereof will be described in detail in the description of the relevant embodiments. Therefore, the terms used in this specification should be defined based on the meanings of the terms and the overall contents of the present disclosure, rather than simply the names of the terms.

Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art described herein.

Throughout this disclosure, when a part is said to "include" a certain component, this does not mean that other components are excluded, but rather that other components may be included, unless otherwise specifically stated. In addition, terms such as "... part", "... module", etc. described in this specification mean a unit that processes at least one function or operation, which may be implemented by hardware or software, or a combination of hardware and software.

The expression "configured to" as used herein can be used interchangeably with, for example, "suitable for", "having the capacity to", "designed to", "adapted to", "made to", or "capable of". The term "configured to" does not necessarily mean that something is "specifically designed to" in terms of hardware. Instead, in some contexts, the expression "a system configured to" can mean that the system is "capable of" in conjunction with other devices or components. For example, the phrase "a processor configured to perform A, B, and C" can mean a dedicated processor (e.g., an embedded processor) for performing the operations, or a generic-purpose processor (e.g., a CPU or application processor) that can perform the operations by executing one or more software programs stored in memory.

In this disclosure, 'Augmented Reality (AR)' means displaying a virtual image together within a physical environment space of the real world or displaying a real object and a virtual image together.

In the present disclosure, 'virtual reality (VR)' means showing an image of a virtual environment separated from the physical environment space of the real world. In one embodiment, virtual reality may include mixed reality (MR) in which information about the physical environment space of the real world is shown together.

In the present disclosure, a 'head-mounted display device' may mean an augmented reality device capable of expressing augmented reality or a virtual reality device capable of expressing virtual reality. In one embodiment, the head-mounted display device may be in the shape of glasses that a user wears on the face, but is not necessarily limited to the examples described above.

In the present disclosure, a 'virtual image' is an image generated by an optical engine and may include both static images and dynamic images. This virtual image is observed together with a real scene, and may be a virtual image representing information about a real object in the real scene, information about the operation of an augmented reality device, a control menu, etc.

In the present disclosure, an 'optical system' may mean at least one optical element for guiding light generated from a light source of an augmented reality device or a virtual reality device to a user's eyes. In one embodiment, an optical system included in an augmented reality device may include optical elements made of a transparent material for guiding a virtual image generated from an optical engine for generating a virtual image to the user's eyes and also allowing the user to view a scene in the real world. In one embodiment, since the augmented reality device must also be able to observe a scene in the real world, the device may include an optical element for changing the path of light having straightness in order to guide the light generated from the optical engine to the user's eyes. In one embodiment, the optical system may change the path of light by using reflection by a mirror or the like, or may change the path of light by diffraction by a diffractive optical element (DOE), a holographic optical element (HOE), or the like, but is not necessarily limited to the examples described above.

In the present disclosure, a 'variable optical filter' may mean an optical device capable of adjusting or controlling a transmission spectrum for light incident on the 'variable optical filter'. The 'variable optical filter' may adjust the transmittance of a specific wavelength by an electrical or mechanical method, and may change the wavelength band and degree of light blocked, absorbed, or reflected by changing the characteristics of at least one layer constituting the variable optical filter using, but not limited to, a change in electromagnetic force, a change in molecular arrangement, or a change in nanostructure incidence conditions.

In the present disclosure, the 'transmittance spectrum' may mean a graph or data indicating how much light transmitted through a material is transmitted according to wavelength. In one embodiment, the 'transmittance spectrum' may include information on the transmittance by wavelength within a preset wavelength band.

In the present disclosure, 'color gamut' is a concept that can represent the range of colors that a display can display. In one embodiment, the color gamut can be expressed as a triangle or polygon in an RGB color space. In one embodiment, the color of a pixel displayed on the display can be displayed as one of the colors included in the color gamut as the RGB channel value changes.

FIG. 1 is a drawing for explaining the operation of a head mounted display device according to one embodiment of the present disclosure.

In one embodiment, the head mounted display device (100) may include an augmented reality device (2000) and a virtual reality device (3000). In one embodiment, the head mounted display device (100) may include at least one variable optical filter (110). In one embodiment, the head mounted display device (100) may control the at least one variable optical filter (110) to adjust a transmission spectrum formed by each of the at least one variable optical filter (110). In other words, by controlling the at least one variable optical filter (110) by the head mounted display device (100), the intensity of light transmitted through the at least one variable optical filter (110) may be adjusted for each wavelength.

In one embodiment, the light transmitted through at least one variable optical filter (110) may include at least one of external light incident from the outside of the head mounted display device (100) and internal light output from an internal display module (or display) of the head mounted display device (100). In one embodiment, the light transmitted through at least one variable optical filter (110) may include multi-colored light (or composite light) in which lights of various wavelengths are mixed. Accordingly, the external light or the internal light may be transmitted through at least one variable optical filter (110), thereby blocking or reducing the intensity of light of a specific wavelength among lights of various wavelengths.

In one embodiment, the head mounted display device (100) may obtain a target transmission spectrum (120) including information on transmittance for each preset wavelength. In one embodiment, the target transmission spectrum (120) may be a transmission spectrum preset according to the eye characteristics of the user. For example, if the user of the head mounted display device (100) is a patient with an eye disease or has low vision, light of a specific wavelength band may need to be blocked or its intensity may need to be reduced in order to protect the user's eyes. In other words, the target transmission spectrum may be formed such that light of a wavelength band that is not fatal to the user's eyes is transmitted as is or has a high transmittance, and light of a wavelength band that is fatal to the user's eyes is blocked or has a low transmittance. In one embodiment, since the type or degree of an eye disease may vary depending on the user, the target transmission spectrum may include information on transmittance for each wavelength that is individualized depending on the user.

In one embodiment, the head mounted display device (100) can control at least one variable optical filter (110) such that an adjusted transmission spectrum (130) formed by at least one variable optical filter corresponds to a wavelength-specific transmittance of a target transmission spectrum (120). In one embodiment, the adjusted transmission spectrum (130) may mean a transmission spectrum formed by controlling at least one variable optical filter (110). In one embodiment, when there are two or more variable optical filters (110), the adjusted transmission spectrum (130) may mean a transmission spectrum formed by overlapping transmission spectra of each of the at least one variable optical filters (110).

In one embodiment, the characteristics of the transmission spectrum that they can form may be limited according to the characteristics of each of the at least one variable optical filter (110). In one embodiment, the characteristics of the transmission spectrum may include various types of information about the shape of the transmission spectrum determined based on at least one of a transmission band and a wavelength-specific transmission rate change rate. Accordingly, the head mounted display device (100) may form an adjusted transmission spectrum (130) that can closely achieve the effect by the target transmission spectrum (120) by controlling each of the at least one variable optical filter (110) of a limited number based on the characteristics of the target transmission spectrum (120).

In this way, according to one embodiment of the present disclosure, the head mounted display device (100) can protect the user's eyes from external light incident on the head mounted display device (100) and internal light generated from the head mounted display device (100) by forming an adjusted transmission spectrum (130) corresponding to a target transmission spectrum (120) suitable for the eye condition of each user.

FIG. 2 is a plan view of a virtual reality device according to one embodiment of the present disclosure.

Referring to FIG. 2, the augmented reality device (2000) may include a frame (2010), a display module (2100), an optical system (2200), a memory (2300), a light sensor (2400), and at least one processor (2800). However, the present invention is not limited to the above-described examples, and some components may be omitted or other components may be added.

The frame (2010) includes other components of the augmented reality device (2000) and is configured to allow a user to wear the augmented reality device (2000), and may include glasses temples, a nose bridge, and the like, but is not necessarily limited to the examples described above. In one embodiment, left-eye optical components and right-eye optical components may be arranged or attached to the left and right sides of the frame (2010), or the left-eye optical components and right-eye optical components may be integrally formed and mounted on the frame (2010). In another example, some of the optical components may be arranged or attached to only one of the left and right sides of the frame (2010). In one embodiment, the frame (2010) may include two rims through which external light (EL) may be transmitted so that external light (EL) may be incident on the user's eyes, and the two rims may include or omit glasses lenses having or not having refractive power (degree).

The display module (2100) may be a component that generates and outputs light (IL) of a virtual image. The light (IL) of the virtual image output through the display module (2100) may be incident on the eyes of a user wearing the augmented reality device (2000). In one embodiment, the display module (2100) may include an optical engine of a projector including an image panel, an illumination optical system, a projection optical system, etc. In one embodiment, the display module (2100) may include a left-eye display module and a right-eye display module, and each display module may be arranged within a frame (2010), but is not necessarily limited thereto.

In one embodiment, the display module (2100) may include a light source that outputs light, an image panel that forms a two-dimensional virtual image using the light output from the light source, and a projection optical system that projects light of the virtual image formed on the image panel. The light source is an optical component that illuminates light and can generate light by controlling the color of RGB. The light source may be formed of, for example, a light-emitting diode (LED). The image panel may be formed of a reflective image panel that modulates light illuminated by the light source into light containing a two-dimensional image and reflects it. The reflective image panel may be, for example, a DMD (Digital Micromirror Device) panel or an LCoS (Liquid Crystal on Silicon) panel, or other known reflective image panels.

In one embodiment, the display module (1300) may include a light source that outputs light and a two-axis scanner that scans the light output from the light source in two dimensions. In another embodiment, the display module (1300) may include a light source that outputs light, a linear image panel that forms a linear image (i.e., a one-dimensional image) using the light output from the light source, and a one-axis scanner that scans the light of the linear image formed in the linear image panel.

In one embodiment, the display module (2100) can obtain image data constituting a virtual image from at least one processor (2800), generate a virtual image based on the obtained image data, and project light constituting the virtual image output from a light source through an emission surface onto the optical system (2200). In one embodiment, the at least one processor (2800) can provide image data including RGB channel values of a plurality of pixels constituting the virtual image to the display module (2100), and the display module (2100) can control a light source based on the RGB channel values of each of the plurality of pixels, thereby projecting light constituting the virtual image onto the optical system (2200).

The optical system (2200) may be a component that transmits light (IL) of a virtual image to the user's eyes and through which external light (EL) is transmitted. In one embodiment, the optical system (2200) may include a birdbath type optical system (or a reflective optical system) or a waveguide type optical system (or a waveguide optical system) depending on a method of transmitting light (IL) of a virtual image emitted from the display module (2100) to the user's eyes, and is not necessarily limited to the examples described above. In one embodiment, the optical system (2200) may include optical elements such as a collimator that focuses or parallels light generated from an optical engine and a combiner that changes a path of light generated from the optical engine, and is not necessarily limited to the examples described above. In one embodiment, the light (IL) of the virtual image and external light (EL) may transmit through the optical system (2200) and be incident on the user's eyes.

The light sensor (2400) may be a component that obtains information about the intensity of external light (EL) of the augmented reality device (2000). In one embodiment, the information about the external light (EL) may include at least one of intensities of multiple wavelengths of the external light (EL) and a total intensity of the external light (EL) calculated based on the intensities of the multiple wavelengths of light.

In one embodiment, the light sensor (2400) may include photovoltaic cells that generate voltage and current based on light incident on the light sensor (2400), or photoresistors that change their conductance based on light incident on the light sensor (2400). In one embodiment, the light sensor (2400) may obtain information on the intensity of external light (EL) based on the values of voltage and current generated through the photovoltaic cells or the conductance of the photoresistor.

In one embodiment, the light sensor (2400) may include a camera or an image sensor of a camera capable of capturing an image by photographing the surroundings of the augmented reality device (2000). In one embodiment, the light sensor (2400) may capture an image of the surroundings of the augmented reality device (2000), extract information about pixel values representing brightness of a plurality of pixels constituting the captured image, and obtain information about the intensity of external light (EL) based on the extracted information. However, the present invention is not limited to the above-described example, and the light sensor (2400) may obtain information about the intensity of external light (EL) based on the amount of charge generated when the external light (EL) reaches the image sensor of the camera.

In one embodiment, the augmented reality device (2000) may include electronic components such as at least one processor (2800) and memory (2300), and the electronic components may be mounted on a PCB substrate, an FPCB substrate, or the like and positioned at one location of the frame (2010) or may be distributed at a plurality of locations. In one embodiment, the electronic components included in the augmented reality device (2000) may further include a communication interface, a camera, a user input unit, and the like, and specific details regarding the operation of the electronic components of the augmented reality device (2000) will be described again with reference to FIG. 18 below.

In one embodiment, the augmented reality device (2000) may include at least one variable optical filter (110). In one embodiment, the at least one variable optical filter (110) may be positioned at at least one of a first position (P1_a) between the display module (2100) and the optical system (2000), a second position (P2_a) on the path of the external light (EL) before the external light (EL) is incident on the optical system (2200), a third position (P3_a) inside the optical system (2200), and a fourth position (P4_a) between the optical system (2200) and the user's eye. However, the present invention is not necessarily limited to the above-described example, and the at least one variable optical filter (110) may be positioned at a position through which at least one of the light (IL) of the virtual image and the external light (EL) may be transmitted.

In one embodiment, the at least one variable optical filter (110) may be a component that is detachable from at least one of a first position (P1_a), a second position (P2_a), a third position (P3_a), and a fourth position (P4_a). In one embodiment, the at least one variable optical filter (110) and the augmented reality device (2000) may include at least one coupling means for attaching or detaching the at least one variable optical filter (110) to the augmented reality device (2000).

In one embodiment, the coupling means may be included in the at least one variable optical filter (110) or may be included in a guide member used to attach the at least one variable optical filter (110) to the augmented reality device (2000). For example, the coupling means may include a coupling groove and a corresponding coupling protrusion included in each of the at least one variable optical filter (110) and the augmented reality device (2000), such that the at least one variable optical filter (110) may be attached or detached from the augmented reality device (2000) by the coupling groove and the coupling protrusion being coupled or detached from each other. As another example, the coupling means may include an object having a magnetic force and an object capable of responding to the magnetic force included in each of the at least one variable optical filter (110) and the augmented reality device (2000), such that the at least one variable optical filter (110) may be attached or detached from the augmented reality device (2000) by the magnetic force. However, the type or structure of the coupling means is not necessarily limited to the examples described above.

In one embodiment, when at least one variable optical filter (110) is coupled to the augmented reality device (2000) via a coupling means, electrodes of the at least one variable optical filter (110) and electrodes connected to electronic components (e.g., the processor (2800)) included in the augmented reality device (2000) may be electrically connected. In one embodiment, the at least one variable optical filter (110) attached to the augmented reality device (2000) may receive a signal from the processor (2800) via the connected electrode, and a transmission spectrum of the at least one variable optical filter (110) may be adjusted based on the received signal.

FIG. 3 is a plan view of a virtual reality device according to one embodiment of the present disclosure.

Referring to FIG. 3, a virtual reality device (3000) may include a frame (3010), a display (3100), an optical system (3200), a memory (3300), and at least one processor (3700). However, the present invention is not limited to the above-described examples, and some components may be omitted or other components may be added.

The frame (3010) includes other components of the virtual reality device (2000) and is configured to allow a user to wear the virtual reality device (3010), and may include glasses temples, a nose bridge, and the like, but is not necessarily limited to the examples described above. In one embodiment, left-eye optical components and right-eye optical components may be arranged or attached to the left and right sides of the frame (3010), or the left-eye optical components and right-eye optical components may be integrally formed and mounted to the frame (3010). In another example, some of the optical components may be arranged or attached to only one of the left and right sides of the frame (3010).

The display (3100) is a component for displaying an image and/or a video. Light (IL) of an image output from the display (3100) may be incident on the eyes of a user wearing the virtual reality device (3000). In one embodiment, the display (3100) may be configured as a physical device including at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode (OLED), a flexible display, a 3D display, and an electrophoretic display.

In one embodiment, the display (3100) can obtain image data constituting an image from at least one processor (3700) and output light corresponding to a plurality of pixels constituting the image based on the obtained image data. In one embodiment, the light (IL) of the image output from the display (3100) can be projected onto the optical system (3200).

In one embodiment, the optical system (3200) may be a component that transmits light (IL) of an image to a user's eye. In one embodiment, the optical system (3200) may include at least one lens having a refractive power (degree) to focus or change the path of light (IL) of an image output from the display (3100). In one embodiment, light (IL) of an image output from the display (3100) may pass through the optical system (3200) and be incident on a user's eye.

In an embodiment, the virtual reality device (3000) may include electronic components such as at least one processor (3700) and memory (3300), and the electronic components may be mounted on a PCB substrate, an FPCB substrate, or the like and positioned at one location of the frame (3010) or may be distributed and positioned at a plurality of locations. In one embodiment, the electronic components included in the virtual reality device (3000) may further include a communication interface camera and a user input unit, and specific details regarding the operation of the electronic components of the virtual reality device (3000) will be described again with reference to FIG. 19 below.

In one embodiment, the augmented reality device (3000) may include at least one variable optical filter (110). In one embodiment, the at least one variable optical filter (110) may be positioned at at least one of a first location (P1_b) between the display (3100) and the optical system (3200), a second location (P2_b) within the optical system (3200), and a third location (P3_b) between the optical system (3200) and a user's eye. However, the present invention is not limited to the above-described example, and the at least one variable optical filter (110) may be positioned at a location through which light (IL) of an image may be transmitted.

In one embodiment, at least one variable optical filter (110) may be configured as one of a plurality of layers forming the display (3100), or may be positioned between the plurality of layers of the display (3100). In one embodiment, the display (3100) may receive a signal from at least one processor (3700) to control the at least one variable optical filter (110), and a transmission spectrum of the at least one variable optical filter (110) included in the display (3100) may be adjusted based on the received signal.

In one embodiment, at least one variable optical filter (110) may be a component that is detachable to at least one of a first position (P1_b), a second position (P2_b), and a third position (P3_b). In one embodiment, at least one variable optical filter (110) and the virtual reality device (3000) may include at least one coupling means for attaching or detaching the at least one variable optical filter (110) to the virtual reality device (3000). Since the specific details of the coupling means have been described with reference to FIG. 2, a redundant description will be omitted.

FIG. 4 is a drawing for explaining the structure of a variable optical filter according to one embodiment of the present disclosure.

In one embodiment, at least one variable optical filter (110) is configured to adjust the wavelength-specific transmittance of transmitted light in response to a supply voltage or supply current input from the head mounted display device (100).

Referring to FIG. 4, at least one variable optical filter (110) may be a liquid crystal tunable filter (LCTF) including a first polarizer (111), a liquid crystal cell (112), a quartz plate (113), a second polarizer (114), and an electrode (115). However, the present invention is not limited to the above-described example, and some components may be omitted or other components may be added. In addition, the at least one variable optical filter (110) may include one of various types of known variable optical filters, including a holographically-formed, polymer dispersed liquid crystal (H-PDLC) and an acoustically-optical tunable filter (AOTF).

In one embodiment, the first polarizing plate (111) and the third polarizing plate (113) are components capable of controlling the polarization state of light passing through at least one variable optical filter (110). Light incident on at least one variable optical filter (110) has its polarization state changed by the first polarizing plate (111) before being incident on the liquid crystal cell (112), and light passing through the liquid crystal cell (112) can have its polarization state changed by the second polarizing plate (113) before reaching the user's eyes.

The liquid crystal cell (112) is a configuration that can selectively control the transmittance of light according to the wavelength to be transmitted. In one embodiment, the liquid crystal cell (112) may include a liquid crystal material in which the direction in which molecules are arranged changes based on a surrounding electric field, and at least one indium tin oxide (ITO) layer. In one embodiment, the at least one ITO layer may include a transparent conductor through which light may be transmitted, and may generate an electric field applied to the liquid crystal material based on a current or voltage applied to the liquid crystal cell (112). In one embodiment, the direction in which molecules of the liquid crystal material are arranged changes based on the electric field generated in the at least one ITO layer, so that light of a specific wavelength transmitted through the liquid crystal cell (112) may be blocked or transmitted.

In one embodiment, the quartz plate (113) may be a component that supports components of at least one variable optical filter (110) and stably maintains a path of transmitted light. In one embodiment, the quartz plate (113) may include a material that is stable against temperature changes, thereby enabling at least one variable optical filter (110) to operate stably under various temperature conditions.

In one embodiment, the electrode (115) may be a component for providing a supply voltage or supply current input from the head mounted display device (100) to the liquid crystal cell (112). In one embodiment, the electrode (115) may be implemented as a transparent electrode, and it will be readily understood by those skilled in the art that the position and number of the electrodes (115) may be changed in accordance with the performance or structure of the head mounted display device (100).

In one embodiment, the at least one variable optical filter (110) may have a transmission spectrum characteristic that the at least one variable optical filter (110) can form determined based on the structure or characteristic of at least one of the first polarizing plate (111), the liquid crystal cell (112), the quartz plate (113), and the second polarizing plate (114). For example, the at least one variable optical filter (110) may include at least one of a characteristic of blocking light of a preset wavelength band, a characteristic of a notch filter, a characteristic of a notch ND filter, and a characteristic of an ND filter, based on the structure or characteristic of at least one of the first polarizing plate (111), the liquid crystal cell (112), the quartz plate (113), and the second polarizing plate (114), but is not necessarily limited to the examples described above. In one embodiment, at least one variable optical filter (110) may have a transmission spectrum that the at least one variable optical filter (110) can form determined depending on the type of the variable optical filter (110).

In one embodiment, at least one variable optical filter (110) can have a transmission spectrum that includes characteristics of a transmission spectrum of the at least one variable optical filter (110) adjusted based on a supply voltage or supply current input from a head mounted display device (100), and details thereof will be described below with reference to FIGS. 7 to 10.

FIG. 5 is a flowchart for explaining the operation of a head mounted display device according to one embodiment of the present disclosure. The operations of the head mounted display device (100) explained in FIG. 5 may mean the operation of a virtual reality device (2000) including at least one variable optical filter (110), or the operation of an augmented reality device (3000) including at least one variable optical filter (110), but are not necessarily limited thereto.

In step S510, the head mounted display device (100) can obtain a target transmission spectrum (120) including information on transmittance for each preset wavelength. In one embodiment, the target transmission spectrum (120) can be input through a user input unit or received from an external electronic device and stored in the head mounted display device (100). In one embodiment, the target transmission spectrum can include information on transmittance for each of a plurality of wavelengths spaced at a predetermined interval in a preset wavelength band. For example, the target transmission spectrum (120) can be obtained in the following data format.

Wavelength (nm) 515 … 530 … 645 … 775 … 905 … 1035 Transmittance (%) 0 … 10 … 20 … 40 … 15 … 0

That is, the target transmission spectrum (120) may be a discrete data format that is information on the transmittance for each of a plurality of wavelengths spaced at intervals of 5 nm in a wavelength band of 515 nm or more and 1035 nm or less. However, it is not necessarily limited to the above-described example.

In step S520, the head mounted display device (100) can control at least one variable optical filter so that an adjusted transmission spectrum (130) formed by at least one variable optical filter (110) corresponds to the wavelength-specific transmittance of the target transmission spectrum (120). In one embodiment, the head mounted display device (100) can control at least one variable optical filter (110) so that a characteristic of a transmission spectrum of the at least one variable optical filter (110) corresponds to the characteristic of the target transmission spectrum (120). Accordingly, the adjusted transmission spectrum (130) formed by at least one variable optical filter (110) includes the characteristic of the target transmission spectrum (120), thereby being able to correspond to the wavelength-specific transmittance of the target transmission spectrum (120).

FIG. 6 is a flowchart illustrating a method for controlling at least one variable optical filter in a head mounted display device according to one embodiment of the present disclosure. Steps S610 to S640 of FIG. 6 may be included in step S520 of FIG. 5, but are not necessarily limited thereto.

In step S610, the head mounted display device (100) can identify a transmission band of the target transmission spectrum (120) based on the target transmission spectrum (120). In one embodiment, the transmission band may mean a continuous wavelength band including wavelengths having a transmittance that is not 0 or a transmittance that is equal to or greater than a threshold value, but is not necessarily limited thereto.

In step S620, the head mounted display device (100) can control at least one variable optical filter (110) so that the adjusted transmission spectrum (130) forms a transmission band. In one embodiment, the at least one variable optical filter (110) can include a first variable optical filter including a characteristic of blocking light of a preset wavelength band. For example, the transmission spectrum of the first variable optical filter can be a variable optical filter including a spectral characteristic of blocking transmission of light of a wavelength band higher than or lower than a specific wavelength, or including a spectral characteristic of transmitting only light of a specific wavelength band and blocking transmission of light of the remaining wavelength bands, but is not necessarily limited to the above-described examples.

In one embodiment, the head mounted display device (100) can control the first variable optical filter so that the adjusted transmission spectrum (130) forms a transmission band. In other words, the head mounted display device (100) can control the first variable optical filter so that a transmission band of a transmission spectrum formed by the first variable optical filter corresponds to a transmission band of a target transmission spectrum (120). Accordingly, the adjusted transmission spectrum (130) formed by the first variable optical filter or a variable optical filter other than the first variable optical filter can form a transmission band of the target transmission spectrum (120).

In one embodiment, the head mounted display device (100) can identify whether the target transmission spectrum (120) includes a preset spectral characteristic. The preset spectral characteristic may mean a spectral characteristic determined based on a rate of change in transmittance of a preset wavelength band. In one embodiment, at least one variable optical filter (110) can include a characteristic corresponding to each of the preset spectral characteristics.

In one embodiment, the rate of change in transmittance of the preset wavelength band may include at least one of the difference between the transmittance of a specific wavelength among a plurality of wavelengths of the target transmittance spectrum (120) and the transmittance of a wavelength closest to the specific wavelength (hereinafter, “instantaneous rate of change”) and the difference between the transmittance of the minimum wavelength and the transmittance of the maximum wavelength of the preset wavelength band (hereinafter, “average rate of change”). For example, if the target transmittance spectrum (120) includes a transmittance band of 515 nm to 1035 nm and a plurality of wavelengths within the transmittance band are spaced apart by 5 nm, the rate of change in transmittance of the transmittance of the transmittance of the transmittance band may mean the differences between the transmittance of the plurality of wavelengths within the transmittance band and the transmittance of a wavelength that is 5 nm longer or shorter than each of the plurality of wavelengths, and the average rate of change in transmittance of the transmittance of the transmittance band may mean the difference between the transmittance of the 515 nm wavelength and the transmittance of the 1035 nm wavelength. However, it is not necessarily limited to the examples described above, and the change in transmittance may also mean the difference between the transmittance of a specific wavelength and the transmittance of a wavelength a predetermined distance away from the specific wavelength.

At step S640, if the head mounted display device (100) identifies that the target transmission spectrum (120) includes preset spectral characteristics (S630-Y), it can control at least one variable optical filter (110) so that the adjusted transmission spectrum (130) includes the preset spectral characteristics.

In one embodiment, at least one variable optical filter (110) may include a second variable optical filter having the characteristics of a notch filter. In one embodiment, the notch filter may be a variable optical filter having spectral characteristics that selectively block only specific wavelengths, but is not necessarily limited to the examples described above.

In one embodiment, the head mounted display device (100) can identify, based on the target transmission spectrum (120), whether the target transmission spectrum (120) includes a first spectral characteristic in which a rate of change in transmittance within a transmission band is greater than or equal to a first threshold value from each of a minimum wavelength and a maximum wavelength of the transmission band to a first length.

In one embodiment, the head mounted display device (100) can control the second variable optical filter so that the adjusted transmission spectrum (130) includes the first spectral characteristic. In other words, the head mounted display device (100) can control the second variable optical filter so that the characteristic of the transmission spectrum formed by the second variable optical filter corresponds to the first spectral characteristic of the target transmission spectrum (120). Accordingly, the adjusted transmission spectrum (130) formed by the first variable optical filter or the second variable optical filter and a different variable optical filter can include the first spectral characteristic of the target transmission spectrum (120).

In one embodiment, at least one variable optical filter (110) may include a third variable optical filter having the characteristics of a notch ND filter. In one embodiment, the notch ND filter may be a variable optical filter having spectral characteristics that selectively reduce the transmittance of only certain wavelengths, but is not necessarily limited to the examples described above.

In one embodiment, the head mounted display device (100) can identify whether the second spectral characteristic includes a second threshold value or greater in a transmittance change rate within a transmission band that is a second length wavelength band away from a center of the transmission band.

In one embodiment, the head mounted display device (100) can control the third variable optical filter so that the adjusted transmission spectrum (130) includes the second spectral characteristic. In other words, the head mounted display device (100) can control the third variable optical filter so that the characteristic of the transmission spectrum formed by the third variable optical filter corresponds to the second spectral characteristic of the target transmission spectrum (120). Accordingly, the adjusted transmission spectrum (130) formed by the third variable optical filter or a variable optical filter other than the third variable optical filter can include the second spectral characteristic of the target transmission spectrum (120).

In one embodiment, at least one variable optical filter (110) may include a fourth variable optical filter having characteristics of an ND filter. In one embodiment, the ND filter may be a variable optical filter having spectral characteristics that reduce transmittance across the entire wavelength band, but is not necessarily limited to the examples described above.

In one embodiment, the head mounted display device (100) can identify whether the target transmission spectrum includes a third spectral characteristic in which the transmission band is at least a third length within the transmission band, the transmittance differs by at least a third threshold value from the maximum transmittance of the target transmission spectrum, and the transmittance change rate is at most a fourth threshold value.

In one embodiment, the head mounted display device (100) can control the fourth variable optical filter so that the adjusted transmission spectrum includes the third spectral characteristic. In other words, the head mounted display device (100) can control the fourth variable optical filter so that the characteristic of the transmission spectrum formed by the fourth variable optical filter corresponds to the third spectral characteristic of the target transmission spectrum (120). Accordingly, the adjusted transmission spectrum (130) formed by the fourth variable optical filter or a variable optical filter other than the fourth variable optical filter can include the third spectral characteristic of the target transmission spectrum (120).

In this way, the head mounted display device (100) according to one embodiment of the present disclosure can implement an adjusted transmission spectrum (130) corresponding to various types of target transmission spectra (120) by using a limited number of at least one variable optical filter (110).

FIGS. 7A and 7B are drawings for explaining a method for controlling a first variable optical filter of a head mounted display device according to one embodiment of the present disclosure.

Referring to FIG. 7a, the head mounted display device (100) can identify a transmission band of the target transmission spectrum (700) based on the target transmission spectrum (700) and obtain information (720) about the transmission band of the identified target transmission spectrum. The target transmission spectrum (700) illustrated in FIGS. 7a, 8a, 9a, and 10 is only an example of the target transmission spectrum (120) of FIG. 1 and is not necessarily limited thereto.

In one embodiment, the head mounted display device (100) may identify a continuous wavelength band including wavelengths having a transmittance that is not 0 or a transmittance that is greater than or equal to a threshold value in the target transmittance spectrum (700) as a transmittance band (710). For example, the head mounted display device (100) may identify a wavelength band from 615 nm to 1035 nm, which is a continuous wavelength band having a transmittance of not 0 for each wavelength in the target transmittance spectrum (700), as a transmittance band of the target transmittance spectrum (700), but is not necessarily limited to the above-described example.

In one embodiment, the information (720) about the transmission band of the transmission spectrum may include information about a wavelength band identified as the transmission band (710) in the target transmission spectrum (700). For example, the information (720) about the transmission band may include information that the identified transmission band (710) is from 615 nm to 1035 nm. However, the present invention is not necessarily limited to the above-described example, and the information (720) about the transmission band may further include various information used to specify the identified transmission band (710), such as the transmittance of each of a plurality of wavelengths within the transmission band (720), the instantaneous change rate of the transmittance, and the average change rate, or to control the first variable optical filter (110-1).

Referring to FIG. 7b, the head mounted display device (100) can adjust the transmission spectrum of the first variable optical filter (110-1) by controlling the first variable optical filter (110-1) based on the information (720) about the transmission band. In one embodiment, the head mounted display device (100) can control the first variable optical filter (110-1) so that the transmission band of the transmission spectrum of the first variable optical filter (110-1) corresponds to the transmission band of the target transmission spectrum (700). Accordingly, the adjusted transmission spectrum (130) formed by the first variable optical filter (110-1) or at least one variable optical filter other than the first variable optical filter (110-1) can form the transmission band of the target transmission spectrum (700).

In one embodiment, the first variable optical filter (110-1) can adjust the transmission band of the transmission spectrum of the first variable optical filter (110-1) by changing at least one of the length of the transmission band and the center wavelength of the transmission band based on the supplied current or voltage. In one embodiment, the head mounted display device (100) can control the first variable optical filter (110-1) so that the transmission band of the transmission spectrum of the first variable optical filter (110-1) is included in the transmission band of the target transmission spectrum (700).

For example, the head mounted display device (100) may control the first variable optical filter (110-1) so that the transmission spectrum of the first variable optical filter (110-1) changes from the transmission spectrum before adjustment (730) to the transmission spectrum after adjustment (740) based on information (720) about the transmission band that the transmission band of the target transmission spectrum (700) is from 615 nm to 1035 nm. In this case, the transmission spectrum before adjustment (730) may include spectral characteristics that form a transmission band from 325 nm to 905 nm, and the transmission spectrum after adjustment (740) may include spectral characteristics that form a transmission band from 615 nm to 1035 nm, but is not necessarily limited to the above-described example.

In one embodiment, the transmission band of the transmission spectrum of the first variable optical filter (110-1) can be adjusted within a preset range of wavelength bands. In one embodiment, when the transmission band of the target transmission spectrum (700) is included within the preset range of wavelength bands within which the transmission band can be adjusted, the head mounted display device (100) can control the first variable optical filter (700) such that the transmission band of the transmission spectrum of the first variable optical filter (110-1) becomes the same as the transmission band of the target transmission spectrum (700). In one embodiment, when the transmission band of the target transmission spectrum (700) is not included within the preset range of wavelength bands within which the transmission band can be adjusted, the first variable optical filter (700) can be controlled such that the length of the wavelength band in which the transmission band of the transmission spectrum of the first variable optical filter (110-1) and the transmission band of the target transmission spectrum (700) overlap becomes the longest.

FIGS. 8A and 8B are drawings for explaining a method for controlling a second variable optical filter in a head mounted display device according to one embodiment of the present disclosure.

Referring to FIG. 8A, the head mounted display device (100) can identify whether the target transmission spectrum (700) includes a first spectral characteristic based on the target transmission spectrum (700), and obtain information about the identified first spectral characteristic.

In one embodiment, the head mounted display device (100) can identify whether a target transmission spectrum (700) includes a first spectral characteristic in which a rate of change in transmittance within a transmission band is greater than or equal to a first threshold value from each of a minimum wavelength and a maximum wavelength of the transmission band to a first length, and obtain information (820) about the identified first spectral characteristic.

For example, it is assumed that the first length is 100 nm and the first threshold is 10%. In this case, the head mounted display device (100) can identify that a transmittance change rate is 10% or more within the first partial transmission band (810-1) among the first partial transmission band (810-1) from a minimum wavelength of 515 nm to 100 nm of the transmission band and the second partial transmission band (810-2) from a maximum wavelength of 1035 nm to 100 nm of the transmission band in the target transmission spectrum (700). Here, the transmittance change rate of 10% or more may mean that the first partial transmission band (810-1) includes a wavelength at which an instantaneous transmittance change rate is 10% or more, or that an average transmittance change rate of the first partial transmission band (810-1) is 10% or more, and is not necessarily limited to the above-described example. If it is identified that the transmittance change rate is 10% or more within the first partial transmittance band (810-1), the head mounted display device (100) can identify that the target transmittance spectrum (700) includes the first spectral characteristic.

In one embodiment, the information (820) about the first spectral characteristic may include information about a transmission band identified as including the first spectral characteristic in the target transmission spectrum (700). For example, the information (820) about the first spectral characteristic may include information that the first spectral characteristic is identified within a first partial transmission band (810-1) from 515 nm to 615 nm. However, the information (820) about the first spectral characteristic may further include various information used to specify the first spectral characteristic or to control the second variable optical filter (110-2), such as transmittance, instantaneous change rate, and average change rate of transmittance of each of a plurality of wavelengths in the first partial transmission band (810-1).

Referring to FIG. 8B, the head mounted display device (100) can adjust the transmission spectrum of the second variable optical filter (110-2) by controlling the second variable optical filter (110-2) based on the information (820) about the first spectrum characteristic. In one embodiment, the head mounted display device (100) can control the second variable optical filter (110-2) so that the characteristics of the transmission spectrum of the second variable optical filter (110-2) correspond to the first spectral characteristics of the target transmission spectrum (700). Accordingly, the adjusted transmission spectrum (130) formed by the second variable optical filter (110-2) or at least one variable optical filter other than the second variable optical filter (110-2) can include the first spectral characteristics of the target transmission spectrum (700).

In one embodiment, the second variable optical filter (110-2) can adjust the transmission spectrum of the second variable optical filter (110-2) by changing the wavelength to be blocked based on the supplied current or voltage. In one embodiment, the head mounted display device (100) can control the second variable optical filter (110-2) so that the wavelength to be blocked of the transmission spectrum of the second variable optical filter (110-2) is included in a transmission band identified as including the first spectral characteristic of the target transmission spectrum (700).

For example, the head mounted display device (100) may control the second variable optical filter (110-2) to change the transmission spectrum of the second variable optical filter (110-2) from the transmission spectrum before adjustment (830) to the transmission spectrum after adjustment (840) based on the information (820) about the first spectral characteristic that the first spectral characteristic is identified within the first partial transmission band (810-1) from 515 nm to 615 nm of the target transmission spectrum (700). In this case, the transmission spectrum before adjustment (830) may include the spectral characteristic that blocks the transmission of light having a wavelength of 650 nm, and the transmission spectrum after adjustment (840) may include the spectral characteristic that blocks the transmission of light having a wavelength of 515 nm, but is not necessarily limited to the above-described example.

In one embodiment, a wavelength blocked in the transmission spectrum of the second variable optical filter (110-2) can be adjusted within a preset range of wavelength bands. In one embodiment, the head mounted display device (100) can control the second variable optical filter (110-2) such that, when a transmission band of a target transmission spectrum (700) in which a first spectral characteristic is identified is included within a preset range of wavelength bands in which a blocked wavelength can be adjusted, the second variable optical filter (110-2) can be controlled such that a wavelength blocked in the transmission spectrum of the second variable optical filter (110-2) is included within the transmission band of the transmission spectrum (700) in which the first spectral characteristic is identified. In one embodiment, the head mounted display device (100) may control the second variable optical filter (110-2) so that the wavelength being blocked of the transmission spectrum of the second variable optical filter (110-2) becomes closest to the transmission band of the target transmission spectrum (700) with the first spectral characteristic identified, when the transmission band of the target transmission spectrum (700) with the first spectral characteristic identified is not included within a preset range of wavelength bands within which the wavelength being blocked can be adjusted.

FIGS. 9A and 9B are drawings for explaining a method for controlling a third variable optical filter in a head mounted display device according to one embodiment of the present disclosure.

Referring to FIG. 9A, the head mounted display device (100) can identify whether the target transmission spectrum (700) includes a second spectral characteristic in which a rate of change in transmittance is greater than or equal to a second threshold value within a transmission band that deviates from a second length wavelength band from a center of the transmission band based on the target transmission spectrum (700), and obtain information (920) about the identified second spectral characteristic.

For example, it is assumed that the second length is 100 nm and the second threshold is 7%. In this case, the head mounted display device (100) has a center wavelength of 775 nm, which is the center of the transmission band of the target transmission spectrum (700). ) out of the first partial transmission band (910-1) from 515 nm to 675 nm and the second partial transmission band (910-2) from 875 nm to 1035 nm, which is a second length of 100 nm, it can be identified that the transmittance change rate is 7% or more within the first partial transmission band (910-1). Here, the transmittance change rate of 7% or more within the first partial transmission band (910-1) may mean that the first partial transmission band (910-1) includes a wavelength at which the instantaneous transmittance change rate is 7% or more, or that the first partial transmission band (910-1) has an average change rate of 7% or more, and is not necessarily limited to the above-described examples. If it is identified that the transmittance change rate is 7% or more within the first partial transmittance band (910-1), the head mounted display device (100) can identify that the target transmittance spectrum (700) includes the second spectral characteristic.

In one embodiment, the information about the second spectral characteristic (920) may include information about a transmission band identified as including the second spectral characteristic in the target transmission spectrum (700). For example, the information about the second spectral characteristic (920) may include information that the second spectral characteristic is identified within the first partial transmission band (910-1) from 515 nm to 675 nm. However, the present invention is not necessarily limited to the above-described example, and the information about the second spectral characteristic (920) may further include various information used to specify the second spectral characteristic or to control the third variable optical filter (110-3), such as transmittance, instantaneous change rate, and average change rate of transmittance of each of a plurality of wavelengths in the first partial transmission band (910-1).

Referring to FIG. 9B, the head mounted display device (100) can adjust the transmission spectrum of the third variable optical filter (110-3) by controlling the third variable optical filter (110-3) based on the information (920) about the second spectrum characteristic. In one embodiment, the head mounted display device (100) can control the third variable optical filter (110-3) so that the characteristics of the transmission spectrum of the third variable optical filter (110-3) correspond to the second spectrum characteristics of the target transmission spectrum (700). Accordingly, the adjusted transmission spectrum (130) formed by the third variable optical filter (110-3) or at least one variable optical filter other than the third variable optical filter (110-3) can include the second spectrum characteristics of the target transmission spectrum (700).

In one embodiment, the third variable optical filter (110-3) can adjust the transmission spectrum of the third variable optical filter (110-3) by changing at least one of the wavelength at which the transmittance is reduced and the transmittance based on the supplied current or voltage. In one embodiment, the head mounted display device (100) can control the third variable optical filter (110-3) such that the wavelength at which the transmittance is reduced in the transmission spectrum of the third variable optical filter (110-3) is included in a transmission band identified as including the second spectral characteristic in the target transmission spectrum (700). In one embodiment, the head mounted display device (100) can control the third variable optical filter (110-3) such that the transmittance of the wavelength at which the transmittance is reduced in the transmission spectrum of the third variable optical filter (110-3) corresponds to the transmittance of the transmission band identified as including the second spectral characteristic in the target transmission spectrum (700). In other words, the head mounted display device (100) can control the third variable optical filter (110-3) so that the wavelength of the lowest transmittance in the transmission band identified as including the second spectral characteristic in the target transmittance spectrum (700) and the transmittance of that wavelength is included in the adjusted transmittance spectrum (130).

For example, the head mounted display device (100) may control the third variable optical filter (110-3) to change the transmission spectrum of the third variable optical filter (110-3) from the transmission spectrum before adjustment (930) to the transmission spectrum after adjustment (940) based on the information (920) about the second spectral characteristic that the second spectral characteristic is identified within the first partial transmission band (910-1) from 515 nm to 675 nm of the target transmission spectrum (700). In this case, the transmission spectrum before adjustment (940-1) may include the spectral characteristic in which the transmittance of light having a wavelength of 665 nm is 35%, and the transmission spectrum after adjustment (940-2) may include the spectral characteristic in which the transmittance of light having a wavelength of 645 nm is 35%, but is not necessarily limited to the above-described example.

In one embodiment, a wavelength at which transmittance in a transmission spectrum of the third variable optical filter (110-3) is reduced can be adjusted within a preset range of wavelength bands. In one embodiment, the head mounted display device (100) can control the third variable optical filter (110-3) such that, when a transmission band of a target transmission spectrum (700) in which a second spectral characteristic is identified is included within a preset range of wavelength bands in which a reduced wavelength can be adjusted, the wavelength at which transmittance in the transmission spectrum of the third variable optical filter (110-3) is reduced is included within a transmission band of the transmission spectrum (700) in which the second spectral characteristic is identified. In one embodiment, the head mounted display device (100) can control the third variable optical filter (110-3) so that the reduced wavelength of the transmission spectrum of the third variable optical filter (110-3) becomes closest to the transmission band of the target transmission spectrum (700) with the second spectral characteristic identified, when the transmission band of the target transmission spectrum (700) with the second spectral characteristic identified is not included within the preset range of wavelength bands within which the reduced wavelength can be adjusted.

FIGS. 10A and 10B are drawings for explaining a method for controlling a fourth variable optical filter in a head mounted display device according to one embodiment of the present disclosure.

Referring to FIG. 10A, the head mounted display device (100) can identify, based on the target transmission spectrum (700), whether the target transmission spectrum (700) includes a third spectral characteristic in which a transmission band is a third length or longer within a transmission band, a transmittance is different from a maximum transmittance of the target transmission spectrum by a third threshold value or more, and a transmittance change rate is a fourth threshold value or less, and obtain information (1020) about the identified third spectral characteristic.

For example, it is assumed that the third length is 100 nm or longer, the third threshold is 15%, and the fourth threshold is 10%. In this case, the head mounted display device (100) can identify that the partial transmission band (1010) from 580 nm to 700 nm of the target transmission spectrum (700) has a length of 100 nm or longer, a transmittance that is 15% or more different from the maximum transmittance of 45% of the target transmission spectrum, and a transmittance change rate is 10% or less. Here, the transmittance change rate of the partial transmission band (1010) being 10% or less may mean that the partial transmission band (1010) does not include a wavelength whose instantaneous transmittance change rate is 10% or more, or that the average change rate of the partial transmission band (1010) is 10% or less, and is not necessarily limited to the above-described example. When it is identified that the partial transmission band (1010) has a length of 100 nm or longer, a transmittance is 15% or more different from the maximum transmittance of the target transmission spectrum, which is 45%, and a transmittance change rate is 10% or less, the head mounted display device (100) can identify that the target transmission spectrum (700) includes the third spectral characteristic.

In one embodiment, the information about the third spectral characteristic (930) may include information about a transmission band identified as including the third spectral characteristic in the target transmission spectrum (700). For example, the information about the third spectral characteristic (1020) may include information that the third spectral characteristic is identified in a partial transmission band (1010) from 580 nm to 700 nm. However, the present invention is not necessarily limited to the above-described example, and the information about the third spectral characteristic (1020) may further include various information used to specify the third spectral characteristic or to control the fourth variable optical filter (110-4), such as transmittance, instantaneous change rate, and average change rate of transmittance of each of a plurality of wavelengths in the partial transmission band (1010).

Referring to FIG. 10b, the head mounted display device (100) can adjust the transmission spectrum of the fourth variable optical filter (110-4) by controlling the fourth variable optical filter (110-4) based on the information (1020) about the third spectral characteristic. In one embodiment, the head mounted display device (100) can control the fourth variable optical filter (110-4) so that the characteristic of the transmission spectrum of the fourth variable optical filter (110-4) corresponds to the third spectral characteristic of the target transmission spectrum (700). Accordingly, the adjusted transmission spectrum (130) formed by the fourth variable optical filter (110-4) or at least one variable optical filter other than the third variable optical filter (110-4) can include the third spectral characteristic of the target transmission spectrum (700).

In one embodiment, the fourth variable optical filter (110-4) can be configured to have a reduced transmittance of the entire wavelength changed based on the supplied current or voltage, thereby adjusting the transmission spectrum of the fourth variable optical filter (110-4). In one embodiment, the head mounted display device (100) can control the fourth variable optical filter (110-4) so that the transmittance of the entire wavelength in the transmission spectrum of the fourth variable optical filter (110-4) corresponds to the transmittance of a transmission band identified as including the third spectral characteristic in the target transmission spectrum (700). In other words, the head mounted display device (100) can control the fourth variable optical filter (110-4) so that the maximum transmittance and the change rate of the transmittance of the transmission band identified as including the third spectral characteristic in the target transmission spectrum (700) are included in the adjusted transmission spectrum (130).

For example, the head mounted display device (100) may control the fourth variable optical filter (110-4) to change the transmission spectrum of the fourth variable optical filter (110-4) from the transmission spectrum before adjustment (1030) to the transmission spectrum after adjustment (1040) based on information (1020) about the third spectral characteristic that the third spectral characteristic is identified within a partial transmission band (1010) from 580 nm to 700 nm of the target transmission spectrum (700). In this case, the transmission spectrum before adjustment (1040-1) may include spectral characteristics having a transmittance of 55% of the entire wavelength, and the transmission spectrum after adjustment (1040-2) may include spectral characteristics having a transmittance of 30% of the entire wavelength, but is not necessarily limited to the above-described examples.

In one embodiment, the head mounted display device (100) can control the fourth variable optical filter (110-4) based on the transmittance of the target transmission spectrum (700). In one embodiment, the head mounted display device (100) can control the fourth variable optical filter (110-4) such that an average of transmittances of a plurality of wavelengths of the adjusted transmission spectrum (130) becomes less than or equal to an average of transmittances of each of the plurality of wavelengths of the target transmission spectrum (700). In one embodiment, the head mounted display device (100) can control the fourth variable optical filter (110-4) such that a maximum transmittance of the adjusted transmission spectrum (130) becomes less than or equal to a maximum transmittance of the target transmission spectrum (700).

FIG. 11 is a diagram for explaining an adjusted transmission spectrum formed by overlapping a plurality of transmission spectra according to one embodiment of the present disclosure. The adjusted transmission spectrum (1150) of FIG. 11 is an example of the adjusted transmission spectrum (130) of FIG. 1, and may be a transmission spectrum corresponding to the wavelength-specific transmittance of the target transmission spectrum (700) of FIGS. 7 to 10. In addition, since a description of a method for controlling the first to fourth variable optical filters (110-1 to 110-4) has been described in FIGS. 7 to 10, a description of overlapping content will be omitted.

Referring to FIG. 11, a transmission spectrum (1110) of a first variable optical filter, a transmission spectrum (1120) of a second variable optical filter, a transmission spectrum (1130) of a third variable optical filter, and a transmission spectrum (1140) of a fourth variable optical filter may be overlapped to form an adjusted transmission spectrum (1150).

As shown in the mathematical expression 1 below, when the transmission spectra of different variable optical filters are overlapped, the wavelength-specific transmittance of the overlapped transmission spectra can be determined by multiplying the wavelength-specific transmittance of each transmission spectrum.

[Mathematical formula 1]

T_combined(λ) = T1(λ) * T2(λ)

Here, T1(λ) and T2(λ) are the transmission spectra of different variable optical filters, respectively, and T_combined(λ) is the transmission spectrum formed by overlapping the transmission spectra of different variable optical filters.

In one embodiment, light that transmits all of the first to fourth variable optical filters (110-1 to 110-4) may have its intensity of light reduced for each wavelength according to an adjusted transmission spectrum (1150). In one embodiment, light that transmits only some of the first to fourth variable optical filters (110-1 to 110-4) may have its intensity of light reduced for each wavelength by an adjusted transmission spectrum formed by overlapping the transmission spectra of the variable optical filters through which the light is transmitted.

In one embodiment, the tuned transmission spectrum formed by overlapping the transmission spectra of the light-transmitting variable optical filters differs from the tuned transmission spectrum (1150) in that it may not include the spectral characteristics of the transmission spectra of the non-transmitting variable optical filters. However, since it includes the spectral characteristics of the transmission spectra of the remaining light-transmitting variable optical filters, an effect of protecting the user's eyes based on a reduction in the intensity of light by wavelength that can be expected from the target transmission spectrum (120) can still be expected.

Referring to FIG. 2, when the head mounted display device (100) is an augmented reality device (2000), light (IL) of a virtual image and external light (EL) may be transmitted through at least one variable optical filter (110) and then incident on the user's eyes. In one embodiment, the variable optical filter through which the light (IL) of the virtual image is transmitted and the variable optical filter through which the external light (EL) is transmitted may be determined depending on where the at least one variable optical filter (110) is positioned in the augmented reality device (2000).

In one embodiment, the adjusted transmission spectrum (130) may include at least one of a first transmission spectrum formed by a variable optical filter through which light (IL) of a virtual image is transmitted among at least one variable optical filter (110) and a second transmission spectrum formed by external light (EL). For example, the first transmission spectrum may be a transmission spectrum formed by a variable optical filter disposed at at least one of the first position (P1_a), the third position (P3_a), and the fourth position (P4_a), and the second transmission spectrum may be a transmission spectrum formed by a variable optical filter disposed at at least one of the second position (P2_a), the third position (P3_a), and the fourth position (P4_a), but is not necessarily limited to the examples described above.

In one embodiment, the priority of at least one variable optical filter (110) may be preset based on a spectral characteristic included in the at least one variable optical filter (110). For example, among the at least one variable optical filter (110), a first variable optical filter (110-1) including a characteristic of blocking light of a preset wavelength band and a fourth variable optical filter (110-4) including a characteristic of an ND filter may have a higher priority than a second variable optical filter (110-2) including a characteristic of a notch filter and a third variable optical filter (110-3) including a characteristic of a notch ND filter, but is not necessarily limited to the above-described example.

In one embodiment, a location at which at least one variable optical filter (110) is placed on the augmented reality device (2000) may be determined based on a priority of each of at least one variable optical filter (110). In one embodiment, a variable optical filter (110) having a higher priority may be placed at a location at which both light (IL) of a virtual image and external light (EL) are transmitted, and a variable optical filter having a lower priority may be placed at a location at which only one of light (IL) of a virtual image and external light (EL) is transmitted. For example, the first variable optical filter (110-1) and the fourth variable optical filter (110-4) may be positioned at at least one of the third position (P3_a) and the fourth position (P4_a), and the second variable optical filter (110-3) and the third variable optical filter (110-4) may be positioned at at least one of the first position (P1_a) and the second position (P2_a), but are not necessarily limited to the examples described above.

In one embodiment, when at least one variable optical filter (110) includes a plurality of spectral characteristics, the head mounted display device (100) can determine a spectral characteristic implemented by the at least one variable optical filter (110) based on a position where the at least one variable optical filter (110) is arranged, and control the at least one variable optical filter (110) such that the adjusted transmission spectrum (130) includes the determined spectral characteristics.

In one embodiment, the head mounted display device (100) may determine that at least one variable optical filter (110) positioned at a position through which both light (IL) of a virtual image and external light (EL) are transmitted implements spectral characteristics of a variable optical filter having a high priority, and at least one variable optical filter (110) positioned at a position through which only one of light (IL) of the virtual image and external light (EL) is transmitted implements spectral characteristics of a variable optical filter having a low priority. For example, at least one variable optical filter (110) disposed at at least one of the second position (P2_a) and the third position (P3_a) may be determined to implement at least one of the spectral characteristics of the first variable optical filter (110-1) and the fourth variable optical filter (110-4), and at least one variable optical filter (110) disposed at at least one of the first position (P1_a) and the fourth position (P4_a) may be determined to implement at least one of the spectral characteristics of the second variable optical filter (110-2) and the third variable optical filter (110-3), but is not necessarily limited to the examples described above.

FIG. 12 is a flowchart for explaining a method in which a head mounted display device according to one embodiment of the present disclosure is controlled based on the intensity of external light. The head mounted display device (100) of FIG. 12 may mean the operation of an augmented reality device (2000) including an intensity sensor (2400) in FIG. 2.

In step S1210, the head mounted display device (100) can obtain information on the intensity of external light. In one embodiment, the illumination sensor (2400) can measure the information on the intensity of external light at preset time intervals, or the illumination sensor (2400) can measure the information in response to a signal requesting measurement of the intensity of external light. In one embodiment, the information on the intensity of external light measured by the illumination sensor (2400) can be stored in the head mounted display device (100).

In step S1220, the head mounted display device (100) can identify the illuminance of external light transmitted through at least one variable optical filter (110) based on the adjusted transmission spectrum (130) and the illuminance of the external light. In one embodiment, when the external light transmits only a part of the at least one variable optical filter (110), the adjusted transmission spectrum (130) can include a transmission spectrum formed by overlapping the transmission spectra of at least one variable optical filter (110) through which the external light is transmitted among the at least one variable optical filter (110).

In step S1230, the head mounted display device (100) can obtain information on target illuminance, which is a preset illuminance. In one embodiment, the target illuminance may be input through a user input unit or received from an external electronic device and stored in the head mounted display device (100). In one embodiment, the target illuminance may mean a preset illuminance value according to the eye characteristics of the user. For example, if the user of the head mounted display device (100) is a patient with an eye disease or has low vision, it is necessary to block light exceeding a certain intensity from reaching the eyes in order to protect the user's eyes. Accordingly, the target illuminance may include information on the maximum allowable illuminance individually for each user.

At step S1240, the head mounted display device (100) can control at least one variable optical filter (110) based on a result of comparing the illuminance of external light with the target illuminance. In one embodiment, by controlling the at least one variable optical filter (110), the wavelength-specific transmittance of the adjusted transmission spectrum (130) formed by the at least one variable optical filter (110) can be changed.

In one embodiment, the head mounted display device (100) can control the at least one variable filter (110) so that the illuminance of the identified external light becomes less than or equal to the target illuminance when the illuminance of the identified external light is greater than the target illuminance. In one embodiment, the head mounted display device (100) can control the at least one variable optical filter (110) through which the external light is transmitted to reduce the wavelength-specific transmittance of the adjusted transmission spectrum (130), thereby reducing the illuminance of the external light transmitted through the at least one variable optical filter (110).

In one embodiment, the head mounted display device (100) can control the display module (2100) so that the illuminance of the light of the virtual image corresponds to the illuminance of the identified external light. In one embodiment, the illuminance of the light of the virtual image corresponding to the illuminance of the identified external light can mean that the light of the virtual image is adjusted so that the user can easily recognize the content represented by the light of the virtual image when the light of the virtual image is incident on the user's eyes together with the external light.

In one embodiment, the head mounted display device (100) can identify the illuminance of light of a virtual image transmitted through at least one variable optical filter (110) based on the adjusted transmission spectrum (130). In one embodiment, when the light of the virtual image transmits only a part of the at least one variable optical filter (110), the adjusted transmission spectrum (130) can include a transmission spectrum formed by overlapping the transmission spectra of at least one variable optical filter (110) through which the light of the virtual image is transmitted among the at least one variable optical filter (110). In one embodiment, the head mounted display device (100) can compare the illuminance of light of the identified virtual image with the illuminance of identified external light, and control the display module (2100) based on the comparison result. For example, the head mounted display device (100) can increase the illuminance of light of a virtual image transmitted through at least one variable optical filter (110) by the illuminance of external light transmitted through at least one variable optical filter (110), but is not necessarily limited to the above-described example.

In this way, the head mounted display device (100) according to one embodiment of the present disclosure controls at least one variable optical filter (110) based on the illuminance of external light, thereby preventing damage to the user's eyes caused by external light, while allowing the user to more easily recognize the content indicated by the light of a virtual image.

FIG. 13 is a drawing for explaining a change in the intensity of external light passing through at least one variable optical filter according to one embodiment of the present disclosure.

Referring to FIG. 13, the head mounted display device (100) can identify the illuminance of external light transmitted through at least one variable optical filter (110) based on the illuminance of the external light and the first adjusted transmission spectrum (1310). For example, the illuminance of the external light is 400 lux, and the illuminance of the external light transmitted through at least one variable optical filter (110) can be identified as 300 lux.

In one embodiment, the head mounted display device (100) can control at least one variable optical filter (110) based on a result of comparing the illuminance of the identified external light with the target illuminance. For example, when the illuminance of the external light transmitted through the at least one variable optical filter (110) is 300 lux and the target illuminance is 250 lux, the head mounted display device (100) can control the at least one variable optical filter (110) so that the illuminance of the external light transmitted through the at least one variable optical filter (110) becomes lower than the target illuminance.

In one embodiment, at least one variable optical filter (110) may be controlled so that the first adjusted transmission spectrum (1310) may be changed to a second adjusted transmission spectrum (1320). The second adjusted transmission spectrum (1320) may be a transmission spectrum having a reduced wavelength-specific transmittance compared to the first adjusted transmission spectrum (1310). Accordingly, the illuminance of external light transmitted through the at least one variable optical filter (110) whose wavelength-specific light intensity is reduced by the second adjusted transmission spectrum (1320) may be changed from 300 lux to 200 lux, which is lower than the target illuminance of 250 lux.

FIG. 14 is a flowchart for explaining the operation of a head mounted display device (100) according to one embodiment of the present disclosure. The head mounted display device (100) of FIG. 14 may mean the operation of the virtual reality device (3000) of FIG. 3.

In step S1410, the head mounted display device (100) can obtain RGB channel values of a plurality of pixels of the original image. In one embodiment, the RGB channel values of the pixels can include an R (Red) channel value, a G (Green) channel value, and a B (Blue) channel value, and a color of the pixel displayed on the display (3100) can be determined based on each channel value. In one embodiment, the RGB channel values can each be set to one value from 0 to 255, and are not necessarily limited to the above-described example.

In one embodiment, the original image may be one of a plurality of frames of an image displayed on a display (3100) of a head mounted display device (100), or may be an image of a single frame. In one embodiment, the virtual reality device may obtain the original image, and obtain information about RGB channel values of each of a plurality of pixels constituting the original image from the obtained original image.

In step S1420, the head mounted display device (100) can obtain a target transmission spectrum including information on transmittance for each preset wavelength. In one embodiment, the target transmission spectrum may be input through a user input unit or received from an external electronic device and stored in the head mounted display device (100). In one embodiment, the target transmission spectrum (120) may be input through a user input unit or received from an external electronic device and stored in the head mounted display device (100). In one embodiment, the target transmission spectrum may include information on transmittance for each of a plurality of wavelengths spaced apart at a predetermined interval in a preset wavelength band. For example, the target transmission spectrum may include information on transmittance for each of a plurality of wavelengths spaced apart at a 5 nm interval in a wavelength band of 1100 nm or less, but is not necessarily limited to the above-described example.

In step S1430, the head mounted display device (100) can obtain a correction image by adjusting RGB channel values of a plurality of pixels based on transmittance by wavelength of the target transmission spectrum. In one embodiment, adjusting the RGB channel values of the pixels may mean decreasing or increasing at least one of a value of an R channel, a value of a G channel, and a value of a B channel of the pixel. In other words, the correction image may be composed of a plurality of pixels whose RGB channel values are changed in the original image.

In one embodiment, the head mounted display device (100) can identify a representative wavelength (1320) of the plurality of pixels based on RGB channel values (1310) of the plurality of pixels. In one embodiment, when a pixel is displayed on the display (3100), light may be emitted from a light emitting element corresponding to each RGB channel based on the RGB channel values of the pixel. In this case, the light emitted from the light emitting element corresponding to each RGB channel may be synthesized so that the pixel displayed on the display may exhibit a specific color. In one embodiment, the representative wavelength may mean a wavelength corresponding to a color of the pixel displayed on the display based on the RGB channel values of the pixel.

In one embodiment, the representative wavelength may be a wavelength corresponding to a color displayed on a display for which calibration has been performed based on RGB channel values of a plurality of pixels. Specific details on the calibration of the display will be described again with reference to FIG. 16 below.

In one embodiment, the head mounted display device (100) can identify representative wavelengths of the plurality of pixels based on RGB channel values of the plurality of pixels. In one embodiment, a representative wavelength corresponding to each RGB channel value of the pixel can be preset. For example, a representative wavelength corresponding to RGB channel value (130, 0, 200) can be 405 nm, and a representative wavelength corresponding to RGB channel value (200,200,10) can be 597 nm, but is not necessarily limited to the above-described examples.

In one embodiment, the RGB channel values of a pixel and the representative wavelengths corresponding thereto may be mapped and stored in the head mounted display device (100) as a lookup table (LUT). In one embodiment, the head mounted display device (100) may identify the representative wavelengths of the plurality of pixels by applying the RGB channel values of the pixels for identifying the representative wavelengths to the LUT in which the RGB channel values and the representative wavelengths are mapped, thereby. However, the present invention is not necessarily limited to the above-described example, and the head mounted display device (100) may also identify the representative wavelengths through an artificial intelligence model or algorithm learned to input RGB channel values and output representative wavelengths.

In one embodiment, the head mounted display device (100) can adjust RGB channel values of a plurality of pixels based on transmittance of a representative wavelength of a target transmission spectrum (120). In one embodiment, the head mounted display device (100) can identify transmittance of a representative wavelength of a plurality of pixels among a plurality of wavelengths of the target transmission spectrum (120), and adjust RGB channel values of the plurality of pixels based on the transmittance of the identified representative wavelength. In one embodiment, the head mounted display device (100) can reduce the RGB channel values of the plurality of pixels by the transmittance of the representative wavelength of the plurality of pixels of the target transmission spectrum (120).

In step S1440, the head mounted display device (100) can display the acquired correction image on the display (3100). In one embodiment, if the original image is one of a plurality of frames of the image, the head mounted display device (100) can repeatedly perform steps S1410 to S1430 for other frames of the image to acquire a correction image composed of a plurality of frames and display the image on the display (3100).

In this way, the head mounted display device (100) according to one embodiment of the present disclosure can reduce the intensity of light in a wavelength band that is harmful to the user's eyes from light emitted from the display (3100) by displaying a corrected image in which the RGB channel values of each pixel in the original image are adjusted based on the target transmission spectrum (120).

FIG. 15 is a diagram for explaining a method for a head mounted display device according to one embodiment of the present disclosure to adjust RGB channel values of a plurality of pixels.

Referring to FIG. 15, the head mounted display device (100) can obtain a target transmission spectrum (700) including RGB channel values (1510) of a plurality of pixels of an original image and information on transmittance for each preset wavelength.

In one embodiment, the head mounted display device (100) can identify representative wavelengths of the plurality of pixels based on RGB channel values (1510) of the plurality of pixels. In one embodiment, the head mounted display device (100) can obtain information (1520) about representative wavelengths of the plurality of pixels based on the identification result. For example, the head mounted display device (100) can identify that the representative wavelength of the pixel P1 is 640 nm based on the RGB channel values (255, 190, 0) of the pixel P1, but is not necessarily limited to the above-described example.

In one embodiment, the head mounted display device (100) can obtain information (1530) about transmittance of the plurality of pixels based on information (1520) about representative wavelengths of the plurality of pixels and information (1530) about transmittance of the plurality of pixels based on the target transmittance spectrum (700). For example, the head mounted display device (100) can identify that the transmittance of the pixel P1 is 31% based on information that the transmittance of the pixel P1 at the representative wavelength of 640 nm of the target transmittance spectrum (700) is 31%, but is not necessarily limited to the above-described example.

In one embodiment, the head mounted display device (100) can obtain adjusted RGB channel values (1540) of the plurality of pixels based on the RGB channel values (1510) of the plurality of pixels and the information (1530) about the transmittance of the plurality of pixels. For example, the head mounted display device (100) can reduce each of the R channel, G channel, and B channel values of the RGB channel value (255, 190, 0) of the pixel P1 by 31% based on the information that the RGB channel value of the pixel P1 is (255, 190, 0) and the pixel transmittance is 31%. Accordingly, the head mounted display device (100) can obtain the adjusted RGB channel values (69, 51, 0) of P1, and is not necessarily limited to the above-described example.

In one embodiment, the head mounted display device (100) can obtain a correction image composed of RGB channel values (1540) of a plurality of adjusted pixels. In one embodiment, the head mounted display device (100) can display the obtained correction image on the display (3100).

FIG. 16 is a diagram for explaining a process of converting a color gamut of a display by a head mounted display device according to one embodiment of the present disclosure. The head mounted display device (100) of FIG. 16 may mean the operation of a virtual reality device (3000) including at least one variable optical filter (110).

Referring to FIG. 16, the head mounted display device (100) can control at least one variable optical filter (110) so that an adjusted transmission spectrum (1610) formed by the at least one variable optical filter (110) corresponds to the wavelength-specific transmittance of the target transmission spectrum (700). In one embodiment, the head mounted display device (100) can control a first variable optical filter (110-1) including a characteristic of blocking light of a preset wavelength band so that the adjusted transmission spectrum (1610) forms a transmission band of the target transmission spectrum (700). In one embodiment, light of an image output from the display (3100) of the head mounted display device (100) can have its intensity of light reduced for each wavelength according to the adjusted transmission spectrum (1610) while transmitting through the at least one variable optical filter (110).

In one embodiment, the color gamut (1620) of the display (3100) and the adjusted color gamut (1630) formed by the light of the image output from the display (3100) passing through at least one variable optical filter (110) may be different from each other. Since the intensity of light of the image output from the display (3100) is reduced in each wavelength according to the adjusted transmission spectrum (1610), the color gamut (1620) of the display (3100) determined based on the light of the image that does not pass through at least one variable optical filter (110) and the adjusted color gamut (1630) determined based on the light of the image that passes through at least one variable optical filter (110) may be different from each other.

In one embodiment, the head mounted display device (100) can obtain information about an adjusted color gamut formed by light of an image output from the display (3100) passing through at least one variable optical filter (110).

In one embodiment, the head mounted display device (100) can obtain light spectrum information of a pixel displayed on the display (3100). In one embodiment, the light spectrum information can include information about intensity for each wavelength set according to RGB channel values of the pixel. For example, the head mounted display device (100) can obtain information about what spectrum the light of each pixel forms when a full red pixel having an RGB channel value of (255, 0, 0), a full green pixel having an RGB channel value of (0, 255, 0), and a full blue pixel having an RGB channel value of (0, 0, 255) are displayed on the display (3100), and is not necessarily limited to the above-described example. In one embodiment, the light spectrum information of the pixel can include information about intensity of light for each wavelength and can be input through a user input unit or received from another electronic device and stored in the head mounted display device (100).

In one embodiment, the head mounted display device (100) can obtain optical spectrum information of a pixel transmitted through at least one variable optical filter (110) based on the optical spectrum information of the pixel and the adjusted transmission spectrum. In one embodiment, the head mounted display device (100) can obtain information about an adjusted color gamut based on the optical spectrum information of the pixel transmitted through at least one variable optical filter (110). For example, the head mounted display device (100) can identify at what coordinates a complete red pixel, a complete green pixel, and a complete blue pixel are located in an RGB color space based on the optical spectrum information of the pixel transmitted through at least one variable optical filter (110). The head mounted display device (100) can obtain information about an adjusted color gamut by forming a color gamut based on the coordinates of the identified pixels.

In one embodiment, the head mounted display device (100) can calibrate the display (3100) so that the color gamut (1620) of the display corresponds to the adjusted color gamut (1630). In one embodiment, calibration can mean adjusting hardware parameters of the display, such as brightness, contrast, color temperature, gamma, etc., to express accurate color and brightness. In one embodiment, the color profile can be modified through calibration so that RGB channel values mapped to the color gamut (1620) of the display are mapped to the adjusted color gamut (1630). In one embodiment, the display (3100) can display a plurality of pixels constituting an image on the display (3100) based on the modified color profile.

In one embodiment, the head mounted display device (100) can control activation of at least one variable optical filter (110). In one embodiment, the head mounted display device (100) can receive a user input controlling activation of at least one variable optical filter (110) through a user input unit, and can activate or deactivate the at least one variable optical filter (110) based on the received user input.

In one embodiment, when at least one variable optical filter (110) is activated, the at least one variable optical filter (110) forms a transmission spectrum, so that light transmitting through the at least one variable optical filter (110) can have its intensity of light reduced for each wavelength according to the transmission spectrum. In one embodiment, the head mounted display device (100) can perform calibration of the display (3100) described above together with steps S1410 to S1440 of FIG. 14 when at least one variable optical filter (110) is activated.

In one embodiment, when at least one variable optical filter (110) is deactivated, the at least one variable optical filter (110) does not form a transmission spectrum, so that light transmitting through the at least one variable optical filter (110) can be transmitted as is without a decrease in the intensity of light for each wavelength. In one embodiment, the head mounted display device (100) can perform steps S1410 to S1440 of FIG. 14 without performing calibration of the display (3100) described above when at least one variable optical filter (110) is deactivated. In one embodiment, the state in which at least one variable optical filter (110) is deactivated may mean a state in which the head mounted display device (100) does not include at least one variable optical filter (110).

FIG. 17 is a flowchart for explaining a method in which a head mounted display device according to one embodiment of the present disclosure is controlled based on the brightness of a display. The head mounted display device (100) of FIG. 17 may mean the operation of a virtual reality device (3000) including a display (3100) in FIG. 3.

In step S1710, the head mounted display device (100) can obtain information about target luminance, which is a preset luminance of the display (3100). In one embodiment, the target luminance may be input through a user input unit or received from an external electronic device and stored in the head mounted display device (100). In one embodiment, the target luminance may mean a preset luminance value of the display according to the eye characteristics of the user. For example, if the user of the head mounted display device (100) is a patient with an eye disease or has low vision, it is necessary to block light exceeding a certain intensity from reaching the eyes in order to protect the user's eyes. Accordingly, the target illuminance may include information about the maximum luminance of the display (3100) that can be individually tolerated depending on the user.

In step S1720, the head mounted display device (100) can adjust the brightness of the display (3100) based on a result of comparing the brightness of the display (3100) with the target brightness. Here, adjusting the brightness of the display (3100) may mean controlling the display (3100) so that the brightness value of the display (3100) changes.

In one embodiment, the head mounted display device (100) can decrease the luminance of the display (3100) so that the luminance (3100) of the display becomes lower than the target luminance when the luminance of the display (3100) is greater than the target luminance. In one embodiment, the head mounted display device (100) can increase the luminance of the display (3100) so that the luminance of the display (3100) becomes closer to the target luminance when the luminance of the display (3100) is lower than the target luminance.

In one embodiment, the head mounted display device (100) can identify a luminance of the display (3100) reduced by the at least one variable optical filter (110) based on the adjusted transmission spectrum (130) and the luminance of the display (3100) when the at least one variable optical filter (110) is activated. In one embodiment, the head mounted display device (100) can reduce the luminance of the display (3100) so that the luminance of the display (3100) reduced by the at least one variable optical filter (110) becomes lower than the target luminance if the identified luminance of the display is greater than the target luminance. In one embodiment, the head mounted display device (100) can increase the luminance of the display (3100) so that the luminance of the display (3100) reduced by the at least one variable optical filter becomes closer to the target luminance if the identified luminance of the display is less than the target luminance.

In this way, the head mounted display device (100) according to one embodiment of the present disclosure prevents damage to the user's eyes caused by light generated from the display (3100), while allowing the user to more easily recognize content displayed on the display (3100).

FIG. 18 is a detailed configuration diagram of an augmented reality device according to one embodiment of the present disclosure.

Referring to FIG. 18, the augmented reality device (2000) may include a display module (2100), at least one variable optical filter (110), a memory (2300), a light sensor (2400), a communication interface (2500), a camera (2600), a user input unit (2700), and at least one processor (2800). The display module (2100), at least one variable optical filter (110), the memory (2200), the light sensor (2400), the communication interface (2500), the camera (2600), the user input unit (2700), and the at least one processor (2800) may be electrically and/or physically connected to each other, respectively.

The components illustrated in FIG. 18 are only according to one embodiment of the present disclosure, and the components included in the augmented reality device (2000) are not limited to those illustrated in FIG. 18. The augmented reality device (2000) according to one embodiment of the present disclosure may not include some of the components illustrated in FIG. 18, and may further include components not illustrated in FIG. 18. In addition, description of overlapping content with respect to the components described in FIG. 2 among the components illustrated in FIG. 18 will be omitted.

The memory (2300) may store instructions or program codes for performing functions or operations of the augmented reality device (2000). In one embodiment, at least one instruction, algorithm, data structure, program code, and application program stored in the memory (2200) may be implemented in a programming or scripting language, such as, for example, C, C++, Java, or an assembler.

In one embodiment, the memory (2300) may include at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a Mask ROM, a Flash ROM, etc.), a hard disk drive (HDD), or a solid state drive (SSD).

In one embodiment, the memory (2300) may include a target transmission spectrum (120) including information on transmittance for each preset wavelength. In one embodiment, the memory (2300) may include information on target illuminance, which is a preset illuminance. In one embodiment, the information stored in the memory (2300) may be input through the user input unit (2700) or received from another electronic device through the communication interface (2500) and stored in the memory (2300). However, the present invention is not necessarily limited to the above-described example, and the information stored in the memory (2300) may include various information necessary for performing the operation and function of the augmented reality device (2000) disclosed herein.

In one embodiment, the communication interface (2500) is a component for the augmented reality device (2000) to communicate with an external electronic device. In one embodiment, the communication interface (2400) may perform data communication with the augmented reality device (2000) using at least one of data communication methods including wired LAN, wireless LAN, Wi-Fi, Bluetooth, zigbee, WFD (Wi-Fi Direct), infrared Data Association (IrDA), Bluetooth Low Energy (BLE), Near Field Communication (NFC), Wireless Broadband Internet (Wibro), World Interoperability for Microwave Access (WiMAX), Shared Wireless Access Protocol (SWAP), Wireless Gigabit Alliance (WiGig), and RF communication.

In one embodiment, the communication interface (2500) can transmit and receive at least one of information about a target transmission spectrum (120) and target illuminance from an external electronic device. However, it is not necessarily limited to the above-described example, and various pieces of information necessary to perform the operation and function of the augmented reality device (2000) disclosed in this specification can be transmitted and received with the external electronic device through the communication interface (2500).

The camera (2600) is a configuration that can obtain information about the external space by photographing the outside of the augmented reality device (2000). In one embodiment, the camera (2600) may include a single camera, or may include three or more multi-cameras. In one embodiment, the camera (2600) may include a lens module, an image sensor, and an image processing module. The camera (2600) may obtain a still image or a moving image obtained by an image sensor (e.g., CMOS or CCD). The image processing module may process a still image or a moving image obtained through the image sensor to extract necessary information. In one embodiment, an image captured through the camera (2600) or information about the external space may be provided as an original image to at least one processor (2800). In one embodiment, at least one processor (2800) may obtain information about the illuminance of external light based on the image acquired through the camera or information about the external space.

The user input unit (2700) is a component for receiving various user inputs. In one embodiment, the user input unit (2700) may include a touch panel, a physical button, etc. In one embodiment, information input through the user input unit (2700) may be provided to at least one processor (2800). In one embodiment, information about a target transmission spectrum or information about target illuminance may be input through the user input unit (2800). However, it is not necessarily limited to the above-described example, and various information for performing the operation and function of the augmented reality device (2000) disclosed in this specification may be input through the user input unit (2700).

At least one processor (2800) can execute one or more instructions of a program stored in a memory (2300). At least one processor (2800) can be configured with hardware components that perform arithmetic, logic, and input/output operations and signal processing. At least one processor (2800) can be configured with at least one of, for example, a Central Processing Unit (CPU), a microprocessor, a Graphic Processing Unit (GPU), Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), and Field Programmable Gate Arrays (FPGAs), but is not limited thereto.

In one embodiment, at least one processor (2800) can obtain a target transmission spectrum (120) including information about preset wavelength-specific transmittance. In one embodiment, at least one processor (2800) can control at least one variable optical filter (110) such that an adjusted transmission spectrum (130) formed by the at least one variable optical filter (110) corresponds to the wavelength-specific transmittance of the target transmission spectrum (120).

In one embodiment, at least one processor (2800) can identify a transmission band of a target transmission spectrum (120). In one embodiment, at least one processor (2800) can control a first variable optical filter such that the adjusted transmission spectrum (130) forms a transmission band.

In one embodiment, at least one processor (2800) can identify whether the target transmission spectrum (120) includes a first spectral characteristic having a transmittance variation rate greater than a first threshold value within the transmission band from each of a minimum wavelength and a maximum wavelength of the transmission band to a first length. In one embodiment, the at least one processor (2800) can control the second variable optical filter such that the adjusted transmission spectrum (130) includes the first spectral characteristic.

In one embodiment, at least one processor (2800) can identify whether the target transmission spectrum (120) includes a second spectral characteristic having a transmission rate variation greater than a second threshold value within a transmission band that is a second wavelength band away from a center of the transmission band. In one embodiment, at least one processor (2800) controls a third variable optical filter such that the adjusted transmission spectrum (130) includes the second spectral characteristic.

In one embodiment, at least one processor (2800) can identify that the target transmission spectrum (120) includes a third spectral characteristic, wherein the transmission band is at least a third length within the transmission band, the transmittance differs by a third threshold value or more from the maximum transmittance of the target transmission spectrum (120), and the transmittance change rate is at most a fourth threshold value. In one embodiment, the at least one processor (2800) can control the fourth variable optical filter such that the adjusted transmission spectrum (130) includes the third spectral characteristic.

In one embodiment, at least one processor (2800) can identify the illuminance of external light transmitted through at least one variable optical filter (110)(110) based on the illuminance of the external light and the adjusted transmission spectrum (130). In one embodiment, at least one processor (2800) can obtain information about a target illuminance, which is a preset illuminance. In one embodiment, at least one processor (2800) can control at least one variable filter based on a result of comparing the illuminance of the identified external light with the target illuminance.

In one embodiment, at least one processor (2800) can control at least one variable filter so that the illuminance of the identified external light becomes less than or equal to the target illuminance when the illuminance of the identified external light is greater than the target illuminance.

In one embodiment, at least one processor (2800) can control the display module such that the illuminance of the light in the virtual image corresponds to the illuminance of the identified external light.

In one embodiment, at least one processor (2800) can perform the operations and functions of the virtual reality device (2000) disclosed herein, including the embodiments described above, and redundant descriptions will be omitted.

In this way, according to one embodiment of the present disclosure, the augmented reality device (2000) can protect the user's eyes from external light incident on the augmented reality device (2000) and internal light generated from the augmented reality device (2000) by forming an adjusted transmission spectrum (130) corresponding to a target transmission spectrum (120) suitable for the eye condition of each user.

FIG. 19 is a detailed configuration diagram of a virtual reality device according to an embodiment of the present disclosure. Referring to FIG. 19, a virtual reality device (3000) may include a display (3100), at least one variable optical filter (110), a memory (3300), a communication interface (3400), a camera (3500), a user input unit (3600), and at least one processor (3700). The display (3100), at least one variable optical filter (110), the memory (3300), the communication interface (3400), the camera (3500), the user input unit (3600), and the at least one processor (3700) may be electrically and/or physically connected to each other, respectively.

The components illustrated in FIG. 19 are only according to one embodiment of the present disclosure, and the components included in the virtual reality device (3000) are not limited to those illustrated in FIG. 19. The virtual reality device (3000) according to one embodiment of the present disclosure may not include some of the components illustrated in FIG. 19, and may further include components not illustrated in FIG. 19. In addition, description of overlapping content regarding the components illustrated in FIG. 3 among the components illustrated in FIG. 19 will be omitted.

Memory (3300) may store commands or program codes for performing functions or operations of the virtual reality device (3000). Since the memory (3300) of Fig. 19 corresponds to the memory (2300) of Fig. 18, any duplicate content will be omitted.

In one embodiment, the memory (3300) may include an original image and a corrected image. In one embodiment, the memory (3300) may include information on a lookup table (LUT) in which RGB channel values and corresponding representative wavelengths are mapped. In one embodiment, the memory (3300) may include information on a color gamut of the display (3100) and information on an optical spectrum of pixels displayed on the display (3100). In one embodiment, the memory (3300) may include information on a target luminance, which is information on a preset luminance value of the display (3100). In one embodiment, the information stored in the memory (3300) may be input through the user input unit (3600) or received from another electronic device through the communication interface (3400) and stored in the memory (3300). However, it is not necessarily limited to the examples described above, and the information stored in the memory (3300) may include various information necessary to perform the operation and function of the virtual reality device (3000) disclosed in this specification.

In one embodiment, the communication interface (3400) is a component for the augmented reality device (2000) to communicate with an external electronic device. Since the communication interface (3400) corresponds to the communication interface (2500) of FIG. 18, redundant details will be omitted.

In one embodiment, the communication interface (3400) may transmit and receive one of the following: an original image, a corrected image, RGB channel values, and a corresponding representative wavelength, which are mapped to a lookup table (LUT), information on a color gamut of the display (3100), information on a light spectrum of a pixel displayed on the display (3100), and information on a preset luminance value of the display (3100). However, the present invention is not limited to the above-described example, and various pieces of information necessary to perform the operation and function of the virtual reality device (3000) disclosed in the present specification may be transmitted and received with an external electronic device through the communication interface (3400).

In one embodiment, the camera (3500) is configured to obtain information about the external space by photographing the outside of the virtual reality device (3000). Since the camera (3500) of Fig. 19 corresponds to the camera (2600) of Fig. 18, any duplicate content will be omitted.

The user input unit (3600) is a component for receiving various user inputs. In one embodiment, the user input unit (3600) may include a touch panel, a physical button, etc. In one embodiment, information input through the user input unit (3600) may be provided to at least one processor (3700). In one embodiment, information about a target transmission spectrum or information about a target luminance may be input through the user input unit (3600). However, it is not necessarily limited to the above-described example, and various information for performing the operation and function of the augmented reality device (3000) disclosed in this specification may be input through the user input unit (3600).

At least one processor (3700) can execute one or more instructions of a program stored in a memory (3300). At least one processor (3700) can be configured with hardware components that perform arithmetic, logic, and input/output operations and signal processing. At least one processor (3700) can be configured with at least one of, for example, a Central Processing Unit (CPU), a microprocessor, a Graphic Processing Unit (GPU), Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), and Field Programmable Gate Arrays (FPGAs), but is not limited thereto.

In one embodiment, at least one processor (3700) can obtain a target transmission spectrum (120) including information about preset wavelength-specific transmittance. In one embodiment, at least one processor (3700) can control at least one variable optical filter (110) such that an adjusted transmission spectrum (130) formed by the at least one variable optical filter (110) corresponds to the wavelength-specific transmittance of the target transmission spectrum (120).

In one embodiment, at least one processor (3700) can identify a transmission band of a target transmission spectrum (120). In one embodiment, at least one processor (3700) can control a first variable optical filter such that the adjusted transmission spectrum (130) forms a transmission band.

In one embodiment, at least one processor (3700) can identify whether the target transmission spectrum (120) includes a first spectral characteristic having a transmittance variation rate greater than a first threshold value within the transmission band from each of a minimum wavelength and a maximum wavelength of the transmission band to a first length. In one embodiment, the at least one processor (3700) can control the second variable optical filter such that the adjusted transmission spectrum (130) includes the first spectral characteristic.

In one embodiment, at least one processor (3700) can identify whether the target transmission spectrum (120) includes a second spectral characteristic having a transmission rate variation greater than a second threshold value within a transmission band that is a second wavelength band away from a center of the transmission band. In one embodiment, at least one processor (3700) controls a third variable optical filter such that the adjusted transmission spectrum (130) includes the second spectral characteristic.

In one embodiment, at least one processor (3700) can identify that the target transmission spectrum (120) includes a third spectral characteristic, wherein the transmission band is at least a third length within the transmission band, the transmittance differs by a third threshold value or more from the maximum transmittance of the target transmission spectrum (120), and the transmittance change rate is at most a fourth threshold value. In one embodiment, the at least one processor (3700) can control the fourth variable optical filter such that the adjusted transmission spectrum (130) includes the third spectral characteristic.

In one embodiment, at least one processor (3700) can identify an illuminance of external light transmitted through at least one variable optical filter (110)(110) based on the illuminance of the external light and the adjusted transmission spectrum (130). In one embodiment, at least one processor (3700) can obtain information about a target illuminance, which is a preset illuminance. In one embodiment, at least one processor (3700) can control at least one variable filter based on a result of comparing the illuminance of the identified external light with the target illuminance.

In one embodiment, at least one processor (3700) can obtain RGB channel values of a plurality of pixels of an original image. In one embodiment, at least one processor (3700) can obtain a target transmittance spectrum including information on preset wavelength-specific transmittance. In one embodiment, at least one processor (3700) can obtain a corrected image by adjusting RGB channel values of a plurality of pixels based on the wavelength-specific transmittance of the target transmittance spectrum. In one embodiment, at least one processor (3700) can display the corrected image on a display.

In one embodiment, at least one processor (3700) can identify a representative wavelength of the plurality of pixels based on RGB channel values of the plurality of pixels. In one embodiment, at least one processor (3700) can adjust the RGB channel values of the plurality of pixels based on a transmittance of the representative wavelength of the target transmittance spectrum.

In one embodiment, at least one processor (3700) can reduce RGB channel values of a plurality of pixels by a transmittance of a representative wavelength.

In one embodiment, at least one processor (3700) can obtain information about an adjusted color gamut formed by light of an image passing through at least one variable optical filter. In one embodiment, at least one processor (3700) can perform calibration of the display so that the color gamut of the display corresponds to the adjusted color gamut.

In one embodiment, at least one processor (3700) can obtain information about a target luminance, which is a luminance of the display. In one embodiment, at least one processor (3700) can adjust the luminance of the display based on a result of comparing the luminance of the display and the target luminance.

In one embodiment, at least one processor (3700) can perform the operations and functions of the virtual reality device (3000) disclosed herein, including the embodiments described above, and redundant descriptions will be omitted.

In this way, according to one embodiment of the present disclosure, the virtual reality device (3000) can protect the user's eyes from external light incident on the augmented reality device (3000) and internal light generated from the augmented reality device (3000) by forming an adjusted transmission spectrum (130) corresponding to a target transmission spectrum (120) suitable for the eye condition of each user.

A computer-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" means only that it is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently in the storage medium and cases where data is stored temporarily. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a commodity. The computer program product may be traded between a seller and a buyer as a commodity. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be at least temporarily stored or temporarily generated in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or an intermediary server.

Although the embodiments have been described above by way of limited examples and drawings, those skilled in the art may make various modifications and variations from the above description. For example, appropriate results may be achieved even if the described techniques are performed in a different order than the described method, and/or components such as the described computer system or modules are combined or combined in a different form than the described method, or are replaced or substituted by other components or equivalents.

Claims (20)

A display module configured to output light that constitutes a virtual image;
An optical system that transmits the light of the above output virtual image to the user's eyes and allows external light to pass through;
At least one tunable optical filter configured to electrically control the transmittance of transmitted light according to the wavelength;
A memory that stores one or more instructions; and
At least one processor for executing one or more instructions stored in the memory;
At least one processor of the above,
Obtain a target transmission spectrum (120) containing information on transmittance for each preset wavelength,
An augmented reality device that controls the at least one variable optical filter (110) so that the adjusted transmission spectrum (130) formed by the at least one variable optical filter corresponds to the wavelength-specific transmittance of the target transmission spectrum. In the first paragraph,
At least one variable optical filter,
A first variable optical filter comprising a characteristic of blocking light of a predetermined wavelength band,
At least one processor of the above,
Identify the transmission band of the above target transmission spectrum,
An augmented reality device, wherein the first variable optical filter is controlled so that the adjusted transmission spectrum forms the transmission band. In the second paragraph,
At least one variable optical filter,
A second variable optical filter comprising the characteristics of a notch filter,
At least one processor of the above,
Identifying whether the target transmission spectrum includes a first spectral characteristic in which a change in transmittance within the transmission band is greater than a first threshold value from each of the minimum wavelength and the maximum wavelength of the transmission band to a first length,
An augmented reality device that controls the second variable optical filter so that the adjusted transmission spectrum includes the first spectral characteristic. In any one of the second and third paragraphs,
At least one variable optical filter,
A third variable optical filter comprising the characteristics of a notch Neutral Density filter,
At least one processor of the above,
Identifying whether the target transmission spectrum includes a second spectral characteristic having a change in transmittance greater than or equal to a second threshold value within a transmission band that is outside a second wavelength band of a length from the center of the transmission band,
An augmented reality device that controls the third variable optical filter so that the adjusted transmission spectrum includes the second spectral characteristic. In any one of the second to fourth paragraphs,
At least one variable optical filter,
A fourth variable optical filter comprising the characteristics of an ND filter (Neutral Density filter),
At least one processor of the above,
Identifying whether the target transmission spectrum includes a third spectral characteristic in which the transmission band is a third length or longer within the transmission band, the transmittance differs by a third threshold value or more from the maximum transmittance of the target transmission spectrum, and the transmittance change rate is a fourth threshold value or less;
An augmented reality device that controls the fourth variable optical filter so that the adjusted transmission spectrum includes the third spectral characteristic. In any one of the provisions of paragraphs 2 to 5,
At least one variable optical filter,
An augmented reality device, wherein the device is positioned at least in one of a first position between the display module and the optical system, a second position on the path of the external light before the external light enters the optical system, a third position inside the optical system, and a fourth position between the optical system and a user's eye. In any one of claims 1 to 6,
Further comprising a light sensor for obtaining information on the intensity of the external light;
At least one processor of the above,
Identifying the illuminance of external light transmitted through at least one variable optical filter (110) based on the illuminance of the external light and the adjusted transmission spectrum,
Obtain information about the target illuminance, which is a preset illuminance,
An augmented reality device that controls at least one variable filter based on a result of comparing the illuminance of the identified external light with the target illuminance. In Article 7,
At least one processor of the above,
An augmented reality device that controls the at least one variable filter so that the illuminance of the identified external light becomes less than or equal to the target illuminance when the illuminance of the identified external light is greater than the target illuminance. In any one of paragraphs 7 to 8,
At least one processor of the above,
An augmented reality device that controls the display module so that the illuminance of the light of the virtual image corresponds to the illuminance of the identified external light. In any one of claims 1 to 9,
The above adjusted transmission spectrum is,
An augmented reality device comprising at least one of a first transmission spectrum formed by a variable optical filter through which light of the virtual image is transmitted, and a second transmission spectrum formed by a variable optical filter through which external light is transmitted, among the at least one variable optical filter. A display that outputs images;
An optical system that transmits light of the printed image to the user's eyes;
A memory that stores one or more instructions; and
At least one processor for executing one or more instructions stored in the memory;
At least one processor of the above,
Obtain the RGB channel values of multiple pixels of the original image,
Obtain a target transmission spectrum (120) containing information on transmittance for each preset wavelength,
By adjusting the RGB channel values of the plurality of pixels based on the wavelength-specific transmittance of the target transmittance spectrum, a correction image is obtained,
A virtual reality device that displays the above-mentioned corrected image on the above-mentioned display. In Article 11,
At least one processor of the above,
Identifying representative wavelengths of the plurality of pixels based on the RGB channel values of the plurality of pixels,
A virtual reality device that adjusts RGB channel values of the plurality of pixels based on the transmittance of the representative wavelength of the target transmittance spectrum. In Article 12,
At least one processor of the above,
A virtual reality device that reduces the RGB channel values of the plurality of pixels by the transmittance of the representative wavelength. In any one of Articles 11 to 13,
further comprising at least one tunable optical filter configured to electrically control the transmittance of transmitted light according to the wavelength;
At least one processor of the above,
A virtual reality device that controls the at least one variable optical filter so that the adjusted transmission spectrum formed by the at least one variable optical filter corresponds to the wavelength-specific transmittance of the target transmission spectrum. In any one of Articles 11 to 14,
At least one variable optical filter,
A first variable optical filter comprising a characteristic of blocking light of a predetermined wavelength band,
At least one processor of the above,
Identify the transmission band of the above target transmission spectrum,
A virtual reality device, wherein the first variable optical filter is controlled so that the adjusted transmission spectrum forms the transmission band. In any one of Articles 14 to 15,
At least one processor of the above,
Obtaining information about an adjusted color gamut formed by light of the image passing through at least one variable optical filter,
A virtual reality device that performs calibration of the display so that the color gamut of the display corresponds to the adjusted color gamut. In Article 16,
The above representative wavelengths are
A virtual reality device, wherein the wavelength corresponds to the color of the plurality of pixels displayed on the display on which the calibration was performed, based on the RGB channel values of the plurality of pixels. In any one of Articles 11 to 17,
At least one processor of the above,
Obtain information about the target brightness, which is the brightness of the preset display,
A virtual reality device that adjusts the brightness of the display based on a result of comparing the brightness of the display and the target brightness. In any one of Articles 14 to 19,
At least one variable optical filter,
A virtual reality device, wherein the virtual reality device is located at least in one of a first location between the display and the optical system, a second location within the optical system, and a third location between the optical system and the user's eye. A method for controlling a head mounted display device comprising at least one variable optical filter,
Step (S510) of obtaining a target transmission spectrum including information on transmittance for each preset wavelength; and
A method comprising: a step (S610) of controlling the at least one variable optical filter so that the adjusted transmission spectrum formed by the at least one variable optical filter corresponds to the wavelength-specific transmittance of the target transmission spectrum.

Images