KR102473221B1 - Personal immersion display device and driving method thereof - Google Patents

Abstract

The present invention provides a personal immersive display device including a housing, a display panel unit, a camera unit, and a control unit. The display panel unit is disposed on an inner surface of the front structure of the housing. The camera unit is disposed on the side structure of the housing and moves to be located either inside or outside the housing. The control unit controls the display panel unit and the camera unit. The control unit separately performs an image processing operation for displaying an image on the display panel unit and a panel compensation operation for compensating for deterioration of the display panel according to the location of the camera unit.

Description

Personal immersive display device and its driving method {PERSONAL IMMERSION DISPLAY DEVICE AND DRIVING METHOD THEREOF}

The present invention relates to a personal immersive display device capable of realizing virtual reality and augmented reality and a method of driving the same.

As information technology develops, the market for display devices, which are communication media between users and information, is growing. Accordingly, displays such as a light emitting display (LED), a quantum dot display (QDD), a liquid crystal display (LCD), and an electrophoretic display (ELD) The use of devices is increasing.

Some of the display devices described above are implemented as personal immersive display devices capable of implementing virtual reality or augmented reality. Personal immersive devices are being developed in various forms, such as a Head Mounted Display (HMD), a Face Mounted Display (FMD), and an Eye Glasses-type Display (EGD). Personal immersive devices can be divided into virtual reality (VR) devices and augmented reality (AR) devices.

A display panel for displaying an image in an electroluminescent display device is manufactured based on a device including a light emitting diode, which is a self light emitting device, and a driving transistor driving the same. In the manufactured display panel, it is possible to compensate for a luminance deviation (luminance mura) occurrence through a compensation method using a camera or the like.

In the case of elements included in the display panel, factors that deteriorate the display quality of the screen, such as afterimages, may occur due to changes over time (deterioration of elements) during use of the device. However, conventionally proposed personal immersive devices have difficulty compensating for deterioration of elements included in a display panel using only a general compensation method. Therefore, research is needed to compensate for the deterioration of the personal immersive display device and to improve its lifespan.

The present invention for solving the problems of the above-described background art implements augmented reality in virtual reality based on objects or surrounding environment information when a device is used, additionally provides additional information or functions, and when the device is not in use It is an object of the present invention to provide a personal immersive display device capable of extending its lifespan by improving problems (deterioration in display quality such as afterimages) caused by changes over time (deterioration of elements) of a display panel.

As a means for solving the above problems, the present invention provides a personal immersive display device including a housing, a display panel unit, a camera unit, and a control unit. The display panel unit is disposed on an inner surface of the front structure of the housing. The camera unit is disposed on the side structure of the housing and moves to be located either inside or outside the housing. The control unit controls the display panel unit and the camera unit. The control unit separately performs an image processing operation for displaying an image on the display panel unit and a panel compensation operation for compensating for deterioration of the display panel according to the location of the camera unit.

When the camera unit is located outside the housing, the controller may reflect an image obtained from the camera unit to an input image.

When the camera unit is located inside the housing, the controller may compensate for deterioration of the display panel unit based on an image obtained from the camera unit.

The camera unit includes an optical element unit having a sensor unit for capturing an image and a lens unit disposed in front of the sensor unit, a camera driving unit for driving the optical element unit, and a driving element unit having a board unit on which the camera driving unit is mounted, and the board unit is a housing. It may have a function of moving while being inserted into the side structure of the.

The board part may move to fill a space generated by the movement of the optical element part or to give a place for the optical element part to return.

The optical device unit may further include a dummy lens unit disposed in front of the lens unit.

The controller may reflect the image obtained from the camera unit to the input image and add augmented reality reflecting the user's environmental factors to the virtual reality to be displayed on the display panel unit.

The controller may add image information or audio information that helps the user recognize the surrounding environment based on the image obtained from the camera unit.

In another aspect, the present invention controls the display panel unit disposed on the inner surface of the front structure of the housing, the camera unit disposed on the side structure of the housing and moved to be located in one of the inside and outside of the housing, and the display panel unit and the camera unit. It provides a method of driving a personal immersive display device including a control unit to do. A method of driving a personal immersive display device includes reflecting an image obtained from a camera unit on an input image, and compensating for deterioration of a display panel unit based on the image obtained from the camera unit.

When the camera unit is located outside the housing, an image obtained from the camera unit is reflected in the input image, augmented reality reflecting the user's environmental factors is added to the virtual reality to be displayed on the display panel unit, and the camera unit is located inside the housing. When located, at least one information of luminance and chromaticity of the display panel may be detected based on an image obtained from the camera, and deterioration of the display panel may be compensated for based on the detected information.

The present invention has an effect of providing a personal immersive display device capable of implementing virtual reality and augmented reality in one device. In addition, the present invention has an effect of providing additional information or functions as well as implementing augmented reality in virtual reality based on objects or surrounding environment information when using the device. In addition, the present invention has an effect of prolonging the life of the display panel by improving problems (deterioration in display quality such as afterimages) caused by aging (deterioration of elements) of the display panel when the device is not in use.

1 is an external view schematically illustrating a personal immersive display device according to an embodiment of the present invention;
2 is a schematic block diagram of the personal immersive display device shown in FIG. 1;
3 is a device configuration diagram schematically illustrating a driving unit and a display panel shown in FIG. 2;
4 is a schematic cross-sectional view of a personal immersive display device according to the related art;
5 is a diagram for explaining a general luminance deviation compensation method;
6 is a cross-sectional view schematically illustrating a main configuration of a personal immersive display device according to a first embodiment of the present invention.
7 and 8 are cross-sectional views for explaining in more detail a part of the device shown in FIG. 6 and its operation according to the first embodiment of the present invention.
9 and 10 are cross-sectional views for explaining in more detail a part of the device shown in FIG. 6 and its operation according to a second embodiment of the present invention.
11 and 12 are diagrams for explaining functions of a personal immersive display device according to a third embodiment of the present invention.
13 and 14 are diagrams for explaining functions of a personal immersive display device according to a fourth embodiment of the present invention.
15 and 16 are diagrams for explaining functions of a personal immersive display device according to a fifth embodiment of the present invention.
17 to 19 are diagrams for explaining functions of a personal immersive display device according to a sixth embodiment of the present invention.
20 to 22 are diagrams for explaining functions of a personal immersive display device according to a seventh embodiment of the present invention.
23 to 25 are diagrams for explaining functions of a personal immersive display device according to an eighth embodiment of the present invention.

Hereinafter, specific details for the implementation of the present invention will be described with reference to the accompanying drawings.

The present invention provides a personal immersion display device capable of realizing virtual reality and augmented reality in one device by integrating a virtual reality (VR) device and an augmented reality (AR) device. to provide. The personal immersive display device according to the present invention includes a light emitting display (LED), a quantum dot display (QDD), a liquid crystal display (LCD), and an electrophoretic display (electrophoretic display). Display; ELD) and the like.

Hereinafter, the present invention will be described by taking an electroluminescent display device, which is one of the display devices, as an example. Meanwhile, the electroluminescent display device may be implemented based on organic light emitting diodes or inorganic light emitting diodes. However, hereinafter, an organic light emitting display device based on an organic light emitting diode will be described as an example.

1 is an external view schematically showing a personal immersive display device according to an embodiment of the present invention, FIG. 2 is a block diagram schematically showing the personal immersive display device shown in FIG. 1, and FIG. It is a device configuration diagram schematically showing the illustrated driving unit and the display panel.

1 to 3, the personal immersive display device 100 according to an embodiment of the present invention includes a system control unit 110, a camera 115, a driving unit 200, a small wide-angle camera 215, and A display panel 150 is included.

The system controller 110 transmits image data and various control signals to the driver 200 . Although the system controller 110 is shown briefly, it further includes a memory, an external device interface connected to an external video source, a user interface for receiving user commands, and a power supply unit for generating power. The external device interface may be implemented with various well-known interface modules such as universal serial bus (USB) and high definition multimedia interface (HDMI).

The system controller 110 interworks with the camera unit 115 for capturing the user's left and right eyes. The system controller 110 analyzes the data transmitted from the camera unit 115 based on a preset eye tracking algorithm to estimate a focal region to which the user's gaze is directed. The system controller 110 adjusts the resolution of the focus area, the peripheral area adjacent to the focus area, and the outer area outside the peripheral area based on a foveated rendering algorithm or the like.

The driving unit 200 includes a timing controller 120 , a scan driving unit 130 and a data driving unit 140 . The driving unit 200 interlocks with the small wide-angle camera unit 215 . The small wide-angle camera unit 215 may work with the timing controller 120 included in the driving unit 200 or may work with the timing controller 120 and the data driver 140 . However, hereinafter, operation of the small wide-angle camera unit 215 under the control of the timing controller 120 will be described as an example.

In addition, hereinafter, the small wide-angle camera unit 215 is referred to as a first camera unit, and descriptions related thereto will be dealt with in more detail below. In addition, although the following describes an example in which the first camera units are disposed in pairs on the left and right sides of the personal immersive display device, only one may be disposed on one side.

The timing controller 120 receives image data and various control signals from the system controller 110 and controls the scan driver 130 and the data driver 140 based on this. The timing controller 120 may control the operating timing of the scan driver 130 based on a gate timing control signal, etc., and may control the operating timing of the data driver 140 based on a data timing control signal, but is not limited thereto. don't The timing controller 120 performs an image processing operation to display an image on the display panel 150 according to the position of the small wide-angle camera unit 215 (to implement augmented reality in virtual reality) and deterioration of the display panel 150. The panel compensation operation for compensating for is separately performed.

The scan driver 130 outputs a scan signal (or gate signal) in response to the gate timing control signal supplied from the timing controller 120 . The scan driver 130 supplies scan signals to the subpixels SP included in the display panel 150 through the scan lines GL. The scan driver 130 is formed in the form of an integrated circuit (IC) or formed in the display panel 150 in a gate-in-panel (GIP) method.

The data driver 140 converts image data in the form of digital signals into data voltages in the form of analog signals in response to the data timing control signal supplied from the timing controller 120 and outputs the converted data voltage. The data driver 140 supplies data voltages to the subpixels SP included in the display panel 150 through the data lines DL. The data driver 140 is formed in the form of an integrated circuit (IC).

The display panel 150 displays an image corresponding to the scan signal supplied from the scan driver 130 and the data voltage supplied from the data driver 140 . The display panel 150 is divided into a first display panel 150L displaying a left eye image and a second display panel 150R displaying a right eye image. The first display panel 150L and the second display panel 150R may each have a scan driver 130 and a data driver 140 that drive themselves, but are not limited thereto.

4 is a schematic cross-sectional view of a conventional personal immersive display device, and FIG. 5 is a diagram for explaining a general luminance deviation compensation method.

As shown in FIG. 4 , the personal immersive display device 100 according to the related art includes a housing HOU having a front structural unit FS, a rear structural unit BS, a left structural unit LS, and a right structural unit RS. include The left structural part LS and the right structural part RS are side structural parts.

A first display panel 150L and a second display panel 150R are disposed on the inner surface of the front structural part FS. A first luminous lens LL and a second luminous lens RL are disposed on the rear structural part BS. The first luminous lens LL is positioned to correspond to the first display panel 150L, and the second luminous lens RL is positioned to correspond to the second display panel 150R. The user sees the images displayed on the first display panel 150L and the second display panel 150R through the first viewing lens LL and the second viewing lens RL.

The first display panel 150L and the second display panel 150R are manufactured based on devices including organic light emitting diodes, which are self-light emitting devices, and driving transistors driving the organic light emitting diodes. As shown in FIG. 5 , the first display panel 150L and the second display panel 150R can compensate for luminance deviation (luminance mura) through a compensation method using a camera (CAM) before shipment. If compensation is performed using a camera (CAM), a jagged luminance deviation profile can be relatively uniformly compensated.

In the case of elements included in the first display panel 150L and the second display panel 150R, factors deteriorating the display quality of the screen, such as afterimages, may occur due to aging (deterioration of the elements) during use of the device. However, it is difficult to compensate for deterioration of elements included in the first display panel 150L and the second display panel 150R in the conventionally proposed personal immersion type device using only a general compensation method.

Hereinafter, a main configuration and a driving method of a personal immersive display device according to an embodiment of the present invention will be described.

<First Embodiment>

6 is a cross-sectional view schematically showing the main configuration of a personal immersive display device according to the first embodiment of the present invention, and FIGS. 7 and 8 are parts of the device shown in FIG. 6 according to the first embodiment of the present invention. And cross-sectional views for explaining its operation in more detail.

As shown in FIG. 6, the personal immersive display device 100 according to the first embodiment of the present invention includes a front structure unit FS, a rear structure unit BS, a left structure unit LS, and a right structure unit RS. It includes a housing (HOU) having. The left structural part LS and the right structural part RS are side structural parts.

A first display panel 150L and a second display panel 150R are disposed on the inner surface of the front structural part FS. A first luminous lens LL and a second luminous lens RL are disposed on the rear structural part BS. The first luminous lens LL is positioned to correspond to the first display panel 150L, and the second luminous lens RL is positioned to correspond to the second display panel 150R. The user sees the images displayed on the first display panel 150L and the second display panel 150R through the first viewing lens LL and the second viewing lens RL.

The first left camera unit LSP is disposed on the left structural unit LS, and the second right camera unit RSP is disposed on the right structural unit RS. The first left camera unit LSP and the second right camera unit RSP are small wide-angle cameras. As described above, the first left camera unit LSP and the second right camera unit RSP may be interlocked with the timing control unit or may be interlocked with the timing control unit and the data driver.

As shown in (a) and (b) of FIG. 6 , the first left camera unit LSP and the second right camera unit RSP are provided to be movable outside and inside the personal immersive display device 100 . When the first left camera unit LSP and the second right camera unit RSP are located outside the personal immersive display device 100 (FIG. 6 a), they are outside the personal immersive display device 100. You take pictures of things you see or the environment around you. As such, when the first left camera unit LSP and the second right camera unit RSP face the outside of the personal immersive display device 100, the personal immersive display device 100 captures image information through them. It operates to control an image to be displayed through the first display panel 150L and the second display panel 150R based on (object or surrounding environment information). In addition, when the condition as shown in FIG. 6 (a) is met, the personal immersive display device 100 uses the image information acquired through the first left camera unit (LSP) and the second right camera unit (RSP) to provide a user experience. It operates to provide other additional information or functions.

In contrast, when the first left camera unit LSP and the second right camera unit RSP are located inside the personal immersive display device 100 (FIG. 6B), they are the personal immersive display device 100. ), the first display panel 150L and the second display panel 150R visible inside are photographed. As such, when the first left camera unit LSP and the second right camera unit RSP face the inside of the personal immersive display device 100, the personal immersive display device 100 captures image information through them. It operates to compensate for deterioration of elements included in the first display panel 150L and the second display panel 150R based on (state information of the display panel, etc.).

Taking the first left camera unit LSP as an example, detailed descriptions of this configuration and operation are as follows. Hereinafter, since the configuration and operation of the second right camera unit RSP are the same as those of the first left camera unit LSP, reference will be made to this configuration and operation.

As shown in FIGS. 7 and 8 , the first left camera unit LSP includes a first left sensor unit CSL, a first left lens unit CL, a first left board unit BF, and a first left sensor unit CSL. It includes a camera driving unit (DCL). The first left sensor unit (CSL) and the first left lens unit (CL) are optical element units for capturing images, and the first left board unit (BF) and the first left camera driver (DCL) are optical element units for driving the optical element unit. It may be defined as a driving element part.

The first left sensor unit CSL is formed of an image sensor such as a CMOS sensor or a CCD sensor. The first left sensor unit CSL performs an operation such as capturing an image under the control of the first left camera driver DCL. The first left lens unit CL is installed in front of the first left sensor unit CSL. Due to the first left lens unit CL, the first left sensor unit CSL may obtain image information within the range of the first angle Lr1.

The first left board part BF is installed on the left structural part LS. The first left board part BF may be installed in a state of being inserted into the groove provided in the left structural part LS. The first left board part BF and the first left sensor part CSL are connected through a mechanical structure. The first left board part BF fills the space generated by the movement of the first left sensor part CSL and the first left lens part CL, or the first left sensor part CSL and the first left lens part ( CL) reciprocates vertically to make room for it to return.

When the first left camera part LSP comes out of the inside of the left structural part LS, the first left board part BF slides from the first vertical direction y1 to the second vertical direction y2. When the first left camera part LSP enters the inside from the outside of the left structure part LS, the first left board part BF slides from the second vertical direction y2 to the first vertical direction y1. .

As such, the first left board part BF plays a role as a board substrate on which the first left camera driving part DCL is mounted, as well as a light blocking substrate preventing light from entering the space of the left structure part LS when the optical element part moves. Move to fulfill a role.

As described above, in the first left camera unit LSP, the first left sensor unit CSL and the first left lens unit CL reciprocally move from the inside to the outside or from the outside to the inside of the left structural unit LS. . To this end, the first left camera unit LSP may be partially installed in a driving method such as a button type, electronic type, or mechanical type, but is not limited thereto.

The first display panel 150L and the second display panel 150R are manufactured based on devices including organic light emitting diodes, which are self-light emitting devices, and driving transistors driving the organic light emitting diodes. The first display panel 150L and the second display panel 150R are compensated for luminance deviation (no brightness) through a compensation method using a camera before shipment.

In the case of elements included in the first display panel 150L and the second display panel 150R, factors deteriorating the display quality of the screen, such as afterimages, may occur due to aging (deterioration of the elements) during use of the device. The personal immersive device 100 according to the first embodiment of the present invention can compensate for deterioration of elements included in the first display panel 150L and the second display panel 150R.

<Second Embodiment>

9 and 10 are cross-sectional views for explaining a part of the device shown in FIG. 6 and its operation in more detail according to the second embodiment of the present invention.

9 and 10, the first left camera unit LSP includes a first left sensor unit CSL, a first left lens unit CL, a first left dummy lens unit EL, and a first left sensor unit CSL. It includes a left board part BF and a first left camera driving part DCL. The first left sensor unit CSL and the first left lens unit CL may be defined as optical element units, and the first left board unit BF and the first left camera driving unit DCL may be defined as driving element units.

The first left sensor unit CSL is formed of an image sensor such as a CMOS sensor or a CCD sensor. The first left sensor unit CSL performs an operation such as capturing an image under the control of the first left camera driver DCL. The first left lens unit CL is installed in front of the first left sensor unit CSL. The first left dummy lens unit EL is installed in front of the first left lens unit CL. The first left dummy lens unit EL is installed on the inner surface of the left structural unit LS in a fixed form or is positioned on the left structural unit LS so as to move together with the first left lens unit CL, but is in a non-fixed form. can be installed with

The first left board part BF is installed on the left structural part LS. The first left board part BF is installed in a state of being inserted into the groove provided in the left structural part LS. The first left board part BF fills the space generated by the movement of the first left sensor part CSL and the first left lens part CL, or the first left sensor part CSL and the first left lens part ( CL) reciprocates vertically to make room for it to return.

When the first left camera part LSP comes out of the inside of the left structural part LS, the first left board part BF slides from the first vertical direction y1 to the second vertical direction y2. When the first left camera part LSP moves from the outside to the inside of the left structural part LS, the first left board part BF slides from the second vertical direction y2 to the first vertical direction y1.

As such, the first left board part BF plays a role as a board substrate on which the first left camera driving part DCL is mounted, as well as a light blocking substrate preventing light from entering the space of the left structure part LS when the optical element part moves. play a role

As described above, in the first left camera unit LSP, the first left sensor unit CSL and the first left lens unit CL reciprocally move from the inside to the outside or from the outside to the inside of the left structural unit LS. . To this end, the first left camera unit LSP may be partially installed in a driving method such as a button type, electronic type, or mechanical type, but is not limited thereto.

The first display panel 150L and the second display panel 150R are manufactured based on devices including organic light emitting diodes, which are self-light emitting devices, and driving transistors driving the organic light emitting diodes. The first display panel 150L and the second display panel 150R are compensated for luminance deviation (no brightness) through a compensation method using a camera before shipment.

In the case of elements included in the first display panel 150L and the second display panel 150R, factors deteriorating the display quality of the screen, such as afterimages, may occur due to aging (deterioration of the elements) during use of the device. The personal immersive device 100 according to the first embodiment of the present invention can compensate for deterioration of elements included in the first display panel 150L and the second display panel 150R.

Meanwhile, in the first embodiment, as shown in FIG. 7 , since only the first left lens part CL is included in the optical element part, image information can be obtained within the range of the first angle Lr1. For this reason, in the first embodiment, it may be difficult to photograph the entire display area of the first display panel 150L.

However, the second embodiment includes the first left lens part CL and the first left dummy lens part EL in the optical element part as shown in FIG. Image information can be acquired within the range of two angles (Lr2). As such, when the entire display area of the first display panel 150L can be captured, sensing is possible over the entire display area, so compensation accuracy can be further increased. The first left dummy lens unit EL serves to widen the imaging area (or imaging angle) of the optical element unit.

The personal immersive display device 100 according to an embodiment of the present invention has the above configuration, so that an augmented reality function can be added to a virtual reality device and other additional information or functions can be provided. Same as the description. However, hereinafter, the first camera unit automatically moves outside or inside depending on whether the power of the personal immersive display device 100 is turned on or off, as an example.

<Third Embodiment>

11 and 12 are diagrams for explaining functions of a personal immersive display device according to a third embodiment of the present invention.

The personal immersive display device according to the third embodiment of the present invention operates in the flow shown in FIG. 11 .

When the power of the personal immersive display device (VR device) is turned on (S110), virtual reality (VR) content is executed (S115), and at the same time, the first camera unit installed in the personal immersive display device (small wide angle) camera) is operated to be exposed to the outside (S120).

The first camera unit takes an external image and transmits the captured information to a timing controller (S130). The timing controller or the like performs object recognition/segmentation (eg, a specific object/user) of the information transmitted from the first camera unit (S140).

After the timing controller or the like performs image synthesis through image processing (S150), the synthesized image is reproduced on the first and second display panels (S160).

As the personal immersive display device according to the third embodiment of the present invention operates in the same flow as in FIG. 11 , an augmented reality function is additionally implemented in the virtual reality device as shown in FIG. 12 .

As shown in FIG. 12 (a), in the past, the image implemented in the game (an avatar prepared by the game company), not the image of the user, is displayed on the personal immersive display device. However, according to the third embodiment of the present invention, since the actual user's appearance is reflected and displayed on the personal immersive display device, it is possible to maximize the user's sense of immersion. And according to the third embodiment of the present invention, not only the user but also objects or people around the user can be applied to the virtual reality (VR) screen.

<The fourth embodiment>

13 and 14 are diagrams for explaining functions of a personal immersive display device according to a fourth embodiment of the present invention.

The personal immersive display device according to the fourth embodiment of the present invention operates in the flow shown in FIG. 13 .

When the power of the personal immersive display device (VR device) is turned on (S210), virtual reality (VR) content is executed (S215), and at the same time, the first camera unit installed in the personal immersive display device (small wide angle) camera) is exposed to the outside (S220).

The first camera unit captures an external image and transmits the captured information to a timing controller (S230). The timing controller or the like performs object recognition/segmentation (ex. specific object/user) of the information transmitted from the first camera unit (S240).

After calculating the distance between the specific object and the personal immersive display device (S250), the timing controller or the like determines whether the distance between the object and the user is close (S260). If the distance between the specific object and the user is close (YES), voice guidance and distance information between the specific object and the user are displayed on the first and second display panels (S270).

As the personal immersive display device according to the fourth embodiment of the present invention operates in the same flow as in FIG. 13, as shown in FIG. 14, image information (image notification) and An alarm function that notifies obstacles or risk factors will be additionally implemented.

As shown in FIG. 14, according to the fourth embodiment of the present invention, the user wears the personal immersive display device 100, but recognizes the surroundings through the first camera units LSP and RSP (obtained through the small camera). based on image information) becomes possible. As a result, the personal immersive display device 100 can help the user safely use the device through voice notification and information display functions after the user detects the risk of collision with the object in advance based on the distance calculation between the user and the surrounding object. .

<Fifth Embodiment>

15 and 16 are diagrams for explaining functions of a personal immersive display device according to a fifth embodiment of the present invention.

The personal immersive display device according to the fifth embodiment of the present invention operates in the flow shown in FIG. 15 .

When the power of the personal immersive display device (VR device) is turned on (S310), virtual reality (VR) content is executed (S315), and at the same time, the first camera unit installed in the personal immersive display device (small wide angle) camera) is exposed to the outside (S320).

The first camera unit captures an external image and transmits the captured information to a timing controller (S330). The timing controller or the like performs object recognition/segmentation (ex. specific object/user) of the information transmitted from the first camera unit (S340).

After calculating the distance between the specific object and the personal immersive display device (S350), the timing controller or the like determines whether the distance between the object and the user is close (S360). If the distance between the specific object and the user is close (YES), voice guidance and distance information between the specific object and the user are displayed on the first and second display panels (S370).

As the personal immersive display device according to the fifth embodiment of the present invention operates in the same flow as in FIG. 14, as shown in FIG. 15, information and notification functions for enabling recognition of the surrounding environment in the virtual reality device are additionally implemented will do

As shown in FIG. 16, according to the fifth embodiment of the present invention, the user wears the personal immersive display device 100, but recognizes the surroundings through the first camera unit (LSP, RSP) (obtained through the small camera). based on image information) becomes possible. As a result, the personal immersive display device 100 has a function of displaying corresponding information on a display panel and a voice notification capable of recognizing a distance between a user and a surrounding object.

Meanwhile, the first camera units LSP and RSP are disposed at a position farther apart than both eyes of a person and have a wide angle (taking angles of Lr and Rr are approximately 100° as an example). Therefore, the personal immersive display device 100 considers the positional, structural, and optical conditions such as the location of the first camera units (LSP, RSP), the separation distance between them, and the wide-angle characteristic, so that the position of the actual object (the illustrated apple) is determined. It may have a correction function for correcting the separation distance L between the and the personal immersive display device 100 . That is, the personal immersive display device 100 may perform a self-calibration operation based on the flow shown in FIG. 15 to increase the accuracy and resolution of the image information acquired through the first camera units LSP and RSP.

<Embodiment 6>

17 to 19 are diagrams for explaining functions of a personal immersive display device according to a sixth embodiment of the present invention.

The personal immersive display device according to the sixth embodiment of the present invention operates in the flow shown in FIG. 17 .

When the power of the personal immersive display device (VR device) is turned off (S410), virtual reality (VR) content ends, and at the same time, the first camera unit (small wide-angle camera) installed in the personal immersive display device is operated to move inside (S420).

The timing control unit operates the scan driving unit and the data driving unit so that the inspection patterns are turned on on the first and second display panels (S430), and the first camera unit (small size) controls the inspection patterns displayed on the first and second display panels. wide-angle camera) is operated (S440). In this case, a full pattern based on red, green, and blue sub-pixels may be used as the inspection pattern.

The timing controller or the like corrects the captured image by converting the original captured image obtained from the first camera unit (small wide-angle camera) into a conversion technique through a perspective transform (S450). As a result, as shown in FIG. 18, distorted characteristics of image information such as luminance/chromaticity as well as mechanical characteristics such as the position and angle of the first camera unit (small wide-angle camera) are corrected as shown in FIG. can be converted and corrected. That is, as the first camera unit (small wide-angle camera) acquires an image from the side of the display panel, a deviation resulting from a difference in luminance/chromaticity information from the front of the display panel is eliminated.

The timing controller or the like detects luminance/chromaticity information in units of sub-pixels within the resulting image information in a corrected state (S460). However, since this is only an example, since one sub-pixel is used as a representative value and luminance/chromaticity can be detected and compensated therefrom, image correction may be omitted. However, since image correction can improve detection accuracy and compensation accuracy of luminance/chromaticity, etc., it is preferable to perform image correction step (S450).

The timing controller or the like determines the degree of deterioration of elements included in the sub-pixels based on the luminance/chromaticity information detected in units of sub-pixels, generates compensation data (S470), and generates compensation data for the first and second display panels. Compensation operation for applying is performed (S480).

As the personal immersive display device according to the sixth embodiment of the present invention operates in the same flow as in FIG. Deterioration compensation is possible. That is, the personal immersive display device according to the sixth embodiment of the present invention can improve problems (deterioration in display quality such as afterimages) caused by aging of the display panel (deterioration of elements) when the device is not in use, and as a result, its lifespan is also improved. can be extended

<Seventh Embodiment>

20 to 22 are diagrams for explaining functions of a personal immersive display device according to a seventh embodiment of the present invention.

The personal immersive display device according to the seventh embodiment of the present invention operates in the flow shown in FIG. 20 .

When the power of the personal immersive display device (VR device) is turned off (S510), virtual reality (VR) content ends, and at the same time, the first camera unit (small wide-angle camera) installed in the personal immersive display device is operated to move inside (S520).

The timing control unit operates the scan driving unit and the data driving unit so that the inspection pattern is turned on on the first and second display panels (S530), and the first camera unit (small size) operates the inspection pattern displayed on the first and second display panels. wide-angle camera) is operated (S540).

The timing controller or the like corrects the captured image by converting the original captured image obtained from the first camera unit (small wide-angle camera) into a transformation technique through a perspective transform (S550). As a result, as shown in FIG. 18, distorted characteristics of image information such as luminance/chromaticity as well as mechanical characteristics such as the position and angle of the first camera unit (small wide-angle camera) are corrected as shown in FIG. can be converted and corrected.

The timing controller or the like detects luminance/chromaticity information in units of sub-pixels within the resulting image information in a corrected state (S560). The timing controller or the like determines the degree of deterioration of elements included in the sub-pixels based on the luminance/chromaticity information detected in units of sub-pixels, generates compensation data (S570), and generates compensation data for the first and second display panels. Performs a compensation operation for applying (S580).

As the personal immersive display device according to the seventh embodiment of the present invention operates in the same flow as in FIG. Deterioration compensation is possible.

On the other hand, in the seventh embodiment of the present invention, instead of a full pattern, a test pattern is displayed in a form in which selected one of red, green, and blue sub-pixels is individually turned on. According to this method, as shown in FIG. 22 , in the first display panel 150L, only selected sub-pixels among red, green, and blue sub-pixels are turned on and the rest are turned off.

<Eighth Embodiment>

23 to 25 are diagrams for explaining functions of a personal immersive display device according to an eighth embodiment of the present invention.

The personal immersive display device according to the eighth embodiment of the present invention operates in the flow shown in FIG. 23 .

When the power of the personal immersive display device (VR device) is turned off (S610), virtual reality (VR) content ends, and at the same time, the first camera unit (small wide-angle camera) installed in the personal immersive display device is operated to move inside (S620).

The timing control unit operates the scan driving unit and the data driving unit so that the inspection patterns are turned on on the first and second display panels (S630), and the first camera unit (small wide-angle camera) is operated (S640).

The timing controller or the like corrects the captured image by converting the original captured image obtained from the first camera unit (small wide-angle camera) into a conversion technique through a perspective transform (S560).

The timing controller or the like detects luminance/chromaticity information in units of sub-pixels within the resulting image information in a corrected state (S660). The timing controller or the like determines the degree of deterioration of elements included in the sub-pixels based on the luminance/chromaticity information detected in units of sub-pixels, generates compensation data (S670), and generates compensation data for the first and second display panels. Performs a compensation operation for applying (S680).

As the personal immersive display device according to the eighth embodiment of the present invention operates in the flow shown in FIG. 23 , it is possible to compensate for deterioration of the display panel disposed inside the personal immersive display device. For example, as shown in FIG. 24 , it is possible to compensate for the occurrence of luminance deviation (no luminance) in which the target luminance is distorted for each sub-pixel position due to the change in the display panel over time. According to this compensation method, as shown in FIG. 25, a jagged luminance profile before compensation can be compensated to have a relatively uniform luminance profile as after compensation.

Above, the present invention has an effect of providing a personal immersive display device capable of implementing virtual reality and augmented reality in one device. In addition, the present invention has an effect of providing additional information or functions as well as implementing augmented reality in virtual reality based on objects or surrounding environment information when using the device. In addition, the present invention has an effect of prolonging the life of the display panel by improving problems (deterioration in display quality such as afterimages) caused by aging (deterioration of elements) of the display panel when the device is not in use.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, the above-described technical configuration of the present invention can be changed into other specific forms by those skilled in the art without changing the technical spirit or essential features of the present invention. It will be appreciated that it can be implemented. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting. In addition, the scope of the present invention is indicated by the claims to be described later rather than the above detailed description. In addition, all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention.

HOU: housing 100: personal immersive display device
150L: first display panel 150R: second display panel
LSP: first left camera unit RSP: second right camera unit
CSL: first left sensor unit CL: first left lens unit
BF: first left board part DCL: first left camera driving part

Claims (10)

housing;
a display panel unit disposed on an inner surface of the front structural unit of the housing;
a camera unit disposed on a side structure of the housing and moving to be located either inside or outside the housing; and
A control unit controlling the display panel unit and the camera unit;
The control unit separately performs an image processing operation for displaying an image on the display panel unit and a panel compensation operation for compensating for deterioration of the display panel according to the position of the camera unit,
Wherein the control unit compensates for deterioration of the display panel unit based on an image obtained from the camera unit when the camera unit is located inside the housing. According to claim 1,
When the camera unit is located outside the housing,
The control unit reflects the image obtained from the camera unit on the input image. delete According to claim 1,
the camera part
An optical element unit having a sensor unit for capturing an image and a lens unit disposed in front of the sensor unit;
A driving element unit having a camera driving unit for driving the optical element unit and a board unit on which the camera driving unit is mounted,
The personal immersive display device having a function of moving while the board part is inserted into the side structure of the housing. According to claim 4,
the board part
A personal immersive display device that moves to fill a space created by the movement of the optical element unit or to make room for the optical element unit to return to. According to claim 4,
The optical element part
The personal immersive display device further comprises a dummy lens unit disposed in front of the lens unit. According to claim 2,
The control unit
A personal immersive display device that reflects the image obtained from the camera unit to the input image and adds augmented reality reflecting environmental factors of the user to virtual reality to be displayed on the display panel unit. According to claim 7,
The control unit
A personal immersive display device that adds image information or audio information to help the user recognize a surrounding environment based on the image obtained from the camera unit. A display panel unit disposed on the inner surface of the front structural unit of the housing, a camera unit disposed on the side structural unit of the housing and moving to be located either inside or outside the housing, and a control unit controlling the display panel unit and the camera unit. In the method of driving a personal immersive display device comprising:
reflecting the image obtained from the camera unit to the input image;
Compensating for degradation of the display panel based on an image obtained from the camera;
Compensating for the deterioration of the display panel unit is performed when the camera unit is located inside the housing. According to claim 9,
When the camera unit is located outside the housing,
By reflecting the image obtained from the camera unit to the input image, augmented reality reflecting the user's environmental factors is added to the virtual reality to be displayed on the display panel unit,
When the camera unit is located inside the housing,
A method of driving a personal immersive display device for detecting at least one information among luminance and chromaticity of the display panel unit based on an image obtained from the camera unit and compensating for deterioration of the display panel unit based on the detected information.

Images