KR102102760B1 - Display apparatus for rear projection-type capable of detecting touch input and gesture input - Google Patents

Abstract

The present invention relates to a display device. A display device according to an exemplary embodiment of the present invention includes a screen having a first transparency during a first frame period, a second transparency during a second frame period, and a light source unit outputting output light for detecting a distance of an external object And a processor for processing a touch input during a first frame section and processing a gesture input during a second frame section based on the output light and the received light, and a light detector for receiving light received from an external object. do. Accordingly, touch input and gesture input detection can be performed.

Description

Display apparatus for rear projection-type capable of detecting touch input and gesture input}

The present invention relates to a display device, and more particularly, to a rear projection type display device capable of sensing touch input and gesture input.

The display device is a device that displays an image. Meanwhile, among the display devices, a projector is a device that projects an image onto a screen.

On the other hand, while displaying a projected image on a screen, a user interaction request by a touch input or a gesture input by a user is increasing.

On the other hand, in the case of the front projection method, a gesture input detection method is proposed, and in the case of the rear projection method, a touch input detection method is proposed.

However, there are certain limitations in simultaneously detecting touch input and gesture input.

An object of the present invention is to provide a rear projection type display device capable of sensing touch input and gesture input.

A display device according to an embodiment of the present invention for achieving the above object, during a first frame section, having a first transparency, during a second frame section, a screen having a second transparency, and for detecting the distance of an external object A light source unit for outputting light, a light detection unit for receiving light received from an external object, and a touch input process during a first frame period, a gesture input during a second frame period, based on the output light and the received light It includes a processor to process.

In addition, the display device according to another embodiment of the present invention for achieving the above object, the first area has a first transparency, the second area has a second transparency screen, and the output for detecting the distance of the external object A light source unit for outputting light, a photodetector for receiving received light from an external object, and a touch input in the first area on the screen based on the output light and the received light, and gestures in the second area on the screen And a processor that processes input.

A display device according to an embodiment of the present invention detects a touch input while a screen has a first transparency during a first frame period, and a gesture input while a screen has a second transparency during a second frame period Detects. In particular, by outputting the output light for detecting the distance of the external object, respectively, it is possible to sense the touch input and the gesture input based on the output light and the received light corresponding to the output light.

On the other hand, when the display device outputs the projected image by the rear projection method, the output light can be output together with the projected image, whereby it is possible to simultaneously sense the touch input or gesture input while projecting the image. .

Meanwhile, the display device according to another embodiment of the present invention may further include a camera, and during a second frame period, while a screen has a second transparency, a captured image of an external object is acquired through the camera Then, the captured image can be displayed again on the screen as a projected image.

1 illustrates a conceptual diagram of a display device according to an embodiment of the present invention.
FIG. 2 is an example of a simplified internal block diagram of the display device of FIG. 1.
FIG. 3 illustrates simultaneous output of a projection image and light for distance detection in the optical output module of FIG. 1.
4A to 4B are diagrams referenced to describe the detection of touch input and gesture input in the optical output module of FIG. 1.
5A to 5B are views referred to for explaining a distance detection method of the light output module of FIGS. 4A to 4B.
6A to 6D are views for explaining the screens of FIGS. 4A to 4B.
7 illustrates an implementation example of the display device of FIG. 1.
8 is another example of a simplified internal block diagram of the display device of FIG. 1.
9 is a view referred to for explaining the detection of the gesture input in the optical output module of FIG. 8.
FIG. 10 illustrates that an image is projected from the light output module of FIG. 8.
11 is a flowchart illustrating a method of operating a display device according to an embodiment of the present invention.
12 and 13 illustrate various examples of the arrangement of the first frame section and the second frame section.
14A and 14B are views illustrating an operation according to a touch input and a gesture input on a screen.
15 is a view for explaining the operation of the light source unit of FIGS. 4A to 4B.
16 to 17 are diagrams illustrating various examples of touch input and gesture input.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "modules" and "parts" for components used in the following description are given simply by considering the ease of writing this specification, and do not imply any special significance or role in itself. Therefore, the "module" and the "unit" may be used interchangeably.

The display device described in this specification is a display device capable of displaying a projected image on a dual screen by a scanning method. In particular, while displaying a projected image on a dual screen by a scanning method, it is possible to grasp the distance or movement of an external object.

To this end, the display device may include a light output module for outputting output light for detecting a distance of an external object. In addition, the light output module may output a projected image for displaying an image on the screen, in addition to the output light.

The display device may receive the received light scattered or reflected from the external object, and detect a distance, etc. to the external object based on the difference between the output light and the received light.

In particular, the display device may detect a touch input while the screen has the first transparency during the first frame period, and detect a gesture input while the screen has the second transparency during the second frame period.

Meanwhile, such a display device may be included in a household appliance such as a TV, a media player, a game device, an air conditioner, a refrigerator, a washing machine, a cooking appliance, a robot cleaner, or may be included in a vehicle such as an automobile.

Hereinafter, such a display device will be described in detail.

1 illustrates a conceptual diagram of a display device according to an embodiment of the present invention.

Referring to the drawings, the display device 10 may include a light output module 100 and a screen 200.

The light output module 100 outputs the output light for detecting the distance of the external object to the outside by scanning in the first direction and scanning in the second direction, receives the received light corresponding to the output light, and output light The distance or movement of the external object can be detected based on the received light.

In addition, the light output module 100 may output, together with the output light, a projected image based on visible light, by direction scanning and second direction scanning, to the outside.

To this end, the optical output module 100 may include a 2D scanner capable of simultaneously outputting a projected image and output light by a scanning method.

On the other hand, since the user 700 located on the opposite side of the light output module 100 recognizes the projected image projected on the screen 200, this method may be referred to as a rear projection method.

On the other hand, for the user 700 located in front of the screen 200, it is possible to perform distance detection based on the output light output in the direction of the screen 200.

For example, as shown in the drawing, when a user positioned in front of the screen 200 performs a touch input using the finger 20 to touch the screen 200, the light output module 100 may display a user finger ( In 20), scattered or reflected received light may be received, and a touch input may be sensed based on the output light and the received light.

As another example, as shown in the drawing, when the user 700 located in front of the screen 200 performs a gesture input in front of the screen 200 using the hand 60, the light output module 100 may display a user hand ( In 60), scattered or reflected received light may be received, and a gesture input may be sensed based on the output light and the received light.

On the other hand, the display device 10 according to an embodiment of the present invention, in order to smoothly detect the touch input and the gesture input, during the first frame period, the screen 200 has the first transparency, the first frame During the period, the touch input is sensed, and during the second frame period, the screen 200 may have a second transparency lower than the first transparency, so that during the second frame period, the gesture input may be detected.

As a result, according to the display device 100, touch input and gesture input are enabled.

FIG. 2 is a simplified internal block diagram of the light output module of FIG. 1.

Referring to the drawings, the optical output module 100 outputs a projected image and output light in a time of flight (TOF) method.

To this end, the optical output module 100 includes a memory 120, a scanner 140, a processor 170, a communication module 180, a driving unit 185, a power supply unit 190, a light source unit 210, and a light detection unit 280 and the like.

The memory 120 may store a program for processing and control of the processor 170, or may perform a function for temporarily storing input or output data (eg, still images, videos, etc.). .

The communication module 135 serves as an interface with all external devices connected to the optical output module 100 by wire or wireless. The communication module 135 may receive data from these external devices or receive power and transmit the data to each component inside the optical output module 100, so that the data inside the optical output module 100 is transmitted to the external device. Can be.

In particular, the communication module 135 may receive a wireless signal from an adjacent mobile terminal (not shown). Here, the wireless signal may include various types of data such as a voice call signal, a video call signal, or text data and video data.

To this end, the communication module 135 may include a short-range communication module (not shown). Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, Near Field Communication (NFC) may be used as the short-range communication technology.

The scanner 140 may sequentially and repeatedly perform the first direction scanning and the second direction scanning, and output the input light to the outside.

The light input to the scanner 140 may include visible light corresponding to the projected image and output light for detecting a distance to an external object. Here, the output light may be infrared light.

The scanner 140 may sequentially and repeatedly perform scanning from left to right and scanning from right to left with respect to the external scan area, while scanning the entire external scan area on a frame-by-frame basis. Then, the projection image based on visible light and the output light can be output to the external scan area by such scanning.

The processor 170 may perform an overall control operation of the optical output module 100. Specifically, the operation of each unit in the optical output module 100 can be controlled.

The processor 170 may control a video image stored in the memory 120 or a video image received from the outside through the communication module 135 to be output to an external scan area as a projection image.

To this end, the processor 170 may control the driving unit 185 that controls the light source unit 210 that outputs visible light such as R, G, and B. Specifically, the R, G, and B signals corresponding to the video image to be displayed may be output to the driver 185.

Meanwhile, the processor 170 may transmit an electrical signal corresponding to the output light to the driver 185 for detecting the distance of the external object.

The processor 170 may control the operation of the scanner 140. Specifically, the first direction scanning and the second direction scanning may be sequentially and repeatedly performed to control to output a projected image and output light to the outside.

Meanwhile, the processor 170 may control the scanning speed of the scanner 140 by varying the frame rate when controlling the operation of the scanner 140.

Meanwhile, the processor 170 performs distance detection on an external object based on an electrical signal corresponding to the output light transmitted to the driver 185 and an electrical signal based on the received light received from the light detector 280. can do.

For example, the processor 170 may detect a distance in the external scan area 40 using a phase difference between an electrical signal corresponding to the output light and an electrical signal corresponding to the received light. In addition, the processor 170 may detect a gesture gesture of the user based on the distance information for the external scan area detected in units of frames.

Specifically, the processor 170, during the first frame period, causes the screen 200 to have the first transparency, processes the touch input during the first frame period, and the screen 200 during the second frame period. ) Has a second transparency lower than the first transparency, so that a gesture input can be processed during the second frame period.

Meanwhile, the processor 170 may control the screen control unit 205 that controls the screen 200 outside the light output module 100.

The screen 200 may have a first transparency during the first frame period, and a second transparency lower than the first transparency during the second frame period. Specifically, during the first frame period, the screen 200 is changed to be opaque so that the projected image is displayed on the screen 200, and during the second frame period, the screen 200 is transparently changed to output light Through this screen 200, it is possible to detect a user located in front of the screen 200.

For each frame section, adjustment of the transparency of the screen may be performed by the screen control unit 205.

When the screen 200 includes a first transparent electrode and a second transparent electrode intersecting each other, and an anisotropic body disposed between the first transparent electrode and the second transparent electrode, the screen control unit 205 may include the first transparent electrode Depending on the power applied between the second transparent electrode, the arrangement direction of the anisotropic body is varied so that the screen 200 has a first transparency during the first frame section and a second transparency during the second frame section. Can be controlled.

Meanwhile, the frame synchronization signal or the like may be transmitted from the processor 170 to the screen control unit 205.

The light source unit 210 may include a blue light source unit outputting blue single light, a green light source unit outputting green single light, and a red light source unit outputting red single light. At this time, each light source unit may be implemented with a laser diode. Alternatively, it may be implemented as an LED.

In addition, the light source unit 210 may include an infrared light source unit that outputs infrared light.

The photodetector 280 may convert received light received from the outside into an electrical signal corresponding to the output light. To this end, the photodetector 280 may include a photodiode that converts the optical signal into a received signal, that is, an electrical signal. In particular, the photodetector 280 may include an Avalanche Photodiode that converts received light scattered from an external object into an electric signal with a high photoelectric efficiency photodiode.

Meanwhile, when the output light is infrared light, the photodetector 280 may include a charge coupled device (CCD) or a CMOS sensor to receive the received light of infrared light.

Meanwhile, although not illustrated in the drawing, a sampler (not shown) for converting an analog signal to a digital signal may be further provided between the photodetector 280 and the processor 170.

The driving unit 185 may control the red light source, the green light source, and the blue light source in the driving unit 185 to output red light, green light, and blue light, respectively, in response to R, G, and B signals received from the processor 170. have.

Meanwhile, the driving unit 185 may control the infrared light to be output from the infrared light source in the driving unit 185 in response to an electrical signal corresponding to the output light received from the processor 170.

The power supply unit 190 may receive external power or internal power under the control of the processor 170 to supply power required for the operation of each component.

FIG. 3 illustrates simultaneous output of a projection image and light for distance detection in the optical output module of FIG. 1.

Referring to the drawings, the scanner 140 in the optical output module 100 according to an embodiment of the present invention sequentially and repeatedly performs input light, scanning in the first direction and scanning in the second direction, and thereby an external scan area Can be output to In the drawing, it is illustrated that the projection image 202a (RGB) and the output light IR are output to the screen 200.

The scanner 140 in the optical output module 100 according to an embodiment of the present invention can simultaneously output a projection image RGB based on visible light input and an output light IR that is infrared light. Particularly, for the external scan area, scanning of the entire external scan area may be performed on a frame-by-frame basis while sequentially and repeatedly performing left-to-right scanning and right-to-left scanning.

That is, according to the optical output module 100 according to an embodiment of the present invention, while projecting an image to the outside, it is possible to detect the distance of the external object, so based on the distance or movement of the object to display the related image, or An image corresponding to a gesture can be displayed.

Meanwhile, hereinafter, the inside of the light output module 100 will be described in more detail.

4A to 4B are diagrams referenced to describe the detection of touch input and gesture input in the optical output module of FIG. 1.

The light output module 100a of FIGS. 4A and 4B is the same light output module, a light source unit 210, a light collection unit 212, a photosynthesis unit 220, a light reflection unit 256, a scanner 140, a processor ( 170), a driving unit 185, a light collecting unit 218, an infrared transmission filter 282, and a light detection unit 280.

The light source unit 210 may include a plurality of light source units. That is, the light source unit 210 may include a red light source unit 210R, a green light source unit 210G, a blue light source unit 210B, and an output light source unit 210IR for outputting infrared-type output light. Among them, the light source units 210R, 210G, and 210B may include laser diodes.

Meanwhile, each of the light source units 210R, 210G, 210B, and 210IR may be driven by each electric signal from the driving unit 185, and the electric signal of the driving unit 185 may be controlled by the processor 170. , Can be generated. Meanwhile, the output light source unit 210IR may output the output light by an electric signal corresponding to the output light.

The light output from each of the light source units 210R, 210G, 210B, and 210IR is collimated through each collimator lens in the light collecting unit 212.

The photosynthesis unit 220 synthesizes the light output from each of the light source units 210R, 210G, 210B, and 210IR and outputs them in one direction. To this end, the photosynthesis unit 220 may include four 2D MEMS mirrors 220a, 220b, 220c, and 220d.

That is, the first photosynthesis unit 220a, the second photosynthesis unit 220b, the third photosynthesis unit 220c, and the fourth photosynthesis unit 220d, respectively, are red light and a green light source unit output from the red light source unit 210R. The green light output from the 210G, the blue light output from the blue light source unit 210B, and the output light output from the output light source unit 210IR are output to the scanner 140.

The light reflection unit 256 reflects the red light, the green light, the blue light, and the output light that have passed through the photosynthesis unit 220 toward the scanner 140. The light reflection unit 256 reflects light of various wavelengths, and for this purpose, may be implemented with Total Mirror (TM).

Meanwhile, the scanner 140 may receive visible light (RGB) and output light (IR) from the light source unit 210, and sequentially and repeatedly perform first direction scanning and second direction scanning to the outside. have. This scanning operation is repeatedly performed for the entire external scan area. In particular, the visible light RGB output from the scanner 140 and the output light IR may be output to the screen 200.

Accordingly, a projected image corresponding to visible light (RGB) may be displayed on the screen 200.

On the other hand, since the user 700 located on the opposite side of the light output module 100 recognizes the projected image projected on the screen 200, this method may be referred to as a rear projection method.

On the other hand, for a user located in front of the screen 200, it is possible to perform distance detection based on the output light output to the screen 200.

Specifically, the optical output module 100 detects a touch input by the user's finger 20 that is touched on the screen 200 during the first frame section, and is located across the screen 200 during the second frame section. Gesture input by the user's hand 60 is detected. To this end, during the first frame period, the screen 200 may be opaque, and during the second frame period, the screen 200 may be transparent.

FIG. 4A illustrates that during the first frame period, the screen 200 is opaque. At this time, the optical output module 100 may simultaneously output a projection image RGB and output light IR by visible light. have. During the first frame period, when the user moves the finger 20 to perform touch input on the screen 200, the output light IR is scattered or reflected by the finger 20 to receive light, It may be incident on the light output module 100. Specifically, the received light may be input to the light detection unit 280 through the light collecting unit 218 and the infrared transmission filter 282.

The photodetector 280 converts the received light into an electrical signal, and the processor 170 may perform distance detection and touch input processing based on the received light and the output light by the finger 20.

4B illustrates that the screen 200 is transparent during the second frame period, and in this case, the optical output module 100 may output the output light IR. Alternatively, the optical output module 100 may output the projected image RGB and visible light IR by visible light together. During the second frame period, when the user moves the hand 60 to perform gesture input in front of the screen 200, the output light IR is scattered or reflected by the user hand 60 to receive light, It may be incident on the light output module 100. Specifically, the received light may be input to the light detection unit 280 through the light collecting unit 218 and the infrared transmission filter 282.

The photodetector 280 converts the received light into an electrical signal, and the processor 170 may perform distance detection and gesture input processing based on the received light and the output light by the user's hand 60. .

Meanwhile, the first frame section and the second frame section may be alternately arranged, but are not limited thereto, and various examples are possible.

Meanwhile, according to an embodiment of the present invention, since the visible light RGB output from the scanner 140 is output, even if the screen 200 on which the projected image is displayed has a free-form, the curved surface of the screen Correspondingly, it is possible to display the projected image. For example, it is also possible to grasp the curved state of the screen 200 through distance detection by the output light, perform scaling of the display image in response to the curved surface, and display the scaled projected image. Accordingly, a free-form surface display is possible.

5A to 5B are views referred to for explaining a distance detection method of the light output module of FIGS. 4A to 4B.

First, FIG. 5A is a diagram referenced to describe touch input detection on the screen 200 of FIG. 4A during a first frame period.

In a state in which output light is output on the screen 200, when the user touches the first point P1 on the screen, as shown in (a) of FIG. 5A, for example, using the user's hand to touch In this case, the output light is scattered or reflected by the user's hand and is received by the light detector 280.

In the drawing, it is exemplified that the amplitude of the received light at the x and y coordinates corresponding to the first point P1 is increased.

FIG. 5A (b) illustrates the electrical signal tx of the output light and the electrical signal Rx of the received light, and in particular, the size of the received light at the x coordinate and the y coordinate corresponding to the first point P1 ( amplitude) Ae. That is, by the user's touch, the magnitude of the electrical signal of the received light at the touch point becomes larger than the magnitude at the point on the other screen.

Using these characteristics, the processor 170 detects and processes a touch point on the screen 200. In particular, when the screen 200 has the first transparency, the processor 170 may calculate the coordinates of the touch input.

Next, FIG. 5B is a view referred to for explaining gesture input detection performed in front of the screen 200 of FIG. 4B during the second frame period.

Here, Tx represents the electrical signal of the output light, Rx represents the electrical signal of the received light by the user's gesture in front of the screen.

When the screen transmits the output light, the output light according to the gesture input of the user's hand 60 positioned in front of the screen may be received by the light output module 100.

In addition, the processor 170 may calculate distance information according to a phase difference Φ between the electrical signal of the output light and the electrical signal of the received light, and process the gesture input based on the distance information.

6A to 6D are views for explaining the screens of FIGS. 4A to 4B.

First, FIG. 6A illustrates a cross-sectional view of the screen 200 according to an embodiment of the present invention. The screen 200 includes a protective film 905, a top glass 910 and a bottom glass 920, and a first electrode 915 and a second electrode (between the top glass 910 and the bottom glass 920). 925), and may include an anisotropic body 930 disposed between the first electrode 915 and the second electrode 925.

The protective film 905 can protect the screen 200.

The first electrode 915 and the second electrode 925 disposed between the upper glass 910 and the lower glass 920 may be transparent electrodes such as ITO.

The anisotropic body 930 disposed between the first electrode 915 and the second electrode 925 has an array direction variable according to a power source enclosed between the first electrode 915 and the second electrode 925, Depending on the variable arrangement direction, different refractive indices may be obtained. For example, the anisotropic body 930 may be a liquid crystal.

Next, FIG. 6B is a diagram illustrating the arrangement of the top glass and the first electrode of the screen of FIG. 6A.

In the drawing, it is exemplified that the first electrode 915 disposed on the top glass is disposed in the vertical direction. In the drawing, it is illustrated that m first electrodes V1, ... VmN are arranged in a vertical direction. On the other hand, although the drawings show that the first electrodes V1, ... VmN are electrically connected, differently, they may be spaced apart from each other.

6C illustrates a power supply application waveform applied to the first electrode of FIG. 6B. As shown in the figure, during the first frame period (1 frame), the first electrodes (V1, ... ... VmN) is applied to the low level (L) power, during the second frame period (2 frame), the first A high level (H) power source may be applied to the electrodes V1, ... VmN.

Next, FIG. 6D is a diagram illustrating the arrangement of the top glass and the second electrode of the screen of FIG. 6A.

In the drawing, it is exemplified that the second electrodes 925 disposed on the lower glass are disposed in parallel in the horizontal direction. In the drawing, it is exemplified that n second electrodes H1, ... HN are arranged in the horizontal q direction.

6E illustrates a power supply application waveform applied to the second electrode of FIG. 6D. As shown in the figure, during the first frame period (1 frame), the second electrode (H1, ...... HN) is applied to the low level (L) power, during the second frame period (2 frame), the second A high level (H) power supply may be applied to the electrodes H1, ... HN.

As described above, when low-level power is applied to the first and second electrodes, the arrangement direction of the anisotropic body 930 does not change, so that the screen 200 may have a first transparency, that is, opacity.

Meanwhile, when a high-level power is applied to the first and second electrodes, the arrangement direction of the anisotropic body 930 is variable, so that the screen 200 may have a second transparency, that is, transparency.

Thereby, the screen 200 becomes opaque during the first frame period, and becomes transparent during the second frame period.

7 illustrates an implementation example of the display device of FIG. 1.

Referring to the drawings, the display device 10 of the present invention is a rear projection type display device capable of sensing touch input and gesture input, and may be implemented as a device for display in public places such as a venue, a terminal, or an airport Can be. Alternatively, it may be embodied as a display device for a living room and a master room in a personalized space, at home. Alternatively, it may be embodied as a display device inside a vehicle in a personalized space.

7 illustrates that a display device according to an exemplary embodiment of the present invention is implemented in a center fascia 610 having a free curved surface inside a vehicle.

The center fascia 610 may include a screen 200 corresponding to a dashboard area in which an instrument panel is disposed, in front of the steering wheel 403.

In the drawing, it is illustrated that the instrument panel image is displayed on the screen 200.

Thereby, the driver can check the instrument panel image displayed on the screen 200. Meanwhile, the driver may perform touch input on the screen 200 or, in front of the screen 200, gesture input.

In this case, the display device 10 of the present invention may sense a touch input or gesture input based on output light output from the light output module 100 and received light corresponding to the output light.

In addition, the display device 10 of the present invention may provide an image corresponding to a user's touch input or gesture input to the screen 200.

8 is another example of a simplified internal block diagram of the display device of FIG. 1.

8 is a display device 10 according to another embodiment of the present invention, similar to the display device 10 of FIG. 2, but differs in that the camera 195 is further provided.

The camera 195 is provided in the light output module 100, but is not limited thereto, and various examples are possible.

The camera 195 may photograph an external object located over the transparent screen 200 during the second frame period, that is, when the screen 200 has the second transparency.

To this end, the camera 195, as an RGB camera, may acquire a captured image of an external object. For example, the camera 195 may include a CCD (Charge Coupled Device), or a CMOS sensor.

The image captured by the camera 195 may be transferred to the processor 170 and output as a projected image on the screen 200 during the first frame period.

9 is a view referred to for explaining the detection of the gesture input in the optical output module of FIG.

9B, similar to FIG. 4B, during the second frame period, a distance of an external object, such as a gesture input, may be detected.

Furthermore, since the light output module 100a includes a camera 195, the camera 195 can acquire a captured image of an external object. Specifically, a captured image of a user, including the user's hand 60, may be obtained.

FIG. 10 illustrates that an image is projected from the light output module of FIG. 8.

Referring to the drawings, during the second frame period, an image captured by the camera 195 in the optical output module 100 may be displayed again as a projected image on the screen 200. Then, the user 700 is able to check the image 650 photographing his or her appearance.

Meanwhile, the optical output module 100 may output the projected image 650 during the first frame period after the camera is photographed.

Meanwhile, the display device 10 including the optical output module 100 may perform data exchange by connecting to a network or an external terminal device through the communication module 180.

Accordingly, as shown in FIG. 10, the photographed image 650 may be transmitted to the counterpart terminal device, and the counterpart photographed image may be received from the counterpart terminal device. Accordingly, a video conferencing system may be implemented.

Meanwhile, although not illustrated in FIG. 2 and the like, the display device 10 of the present invention may further include an audio output unit, an audio input unit, and the like, and thus, a video telephone system may be implemented.

11 is a flowchart illustrating a method of operating a display device according to an embodiment of the present invention.

Referring to the drawings, the display device according to an embodiment of the present invention sets the screen to the first transparency during the first frame period (S810).

The processor 170 may control the low-level power to be applied to the first electrode 915 and the second electrode 925 of the screen 200 through the screen control unit 210. Thereby, the screen 200 may be set to a first transparency, that is, opaque.

Next, during the first frame period, the display device detects a touch input on the screen (S820). The light source unit 210 may output visible light and output light during the first frame period. Then, the scanner 140 may scan and output a projection image and output light based on visible light to the screen 200.

At this time, since the screen 200 is opaque, the projected image is displayed by being diffused on the screen 200, and the output light is reflected in the screen 200. On the other hand, when there is a touch input on the screen 200, unlike the received light reflected from the screen 200, the size of the received light at the touch input point is different.

Specifically, the electrical signal by the received light at the touch input point may correspond to the RX2 waveform of FIG. 5A, and the electrical signal by the received light reflected and received by the screen other than the touch input point may be the RX1 waveform of FIG. 5B. Can respond to. That is, the amplitude of the electric signal by the received light at the touch input point becomes larger.

As a result, the processor 170 may process the touch input based on the phase difference between the electrical signal corresponding to the output light and the electrical signal corresponding to the received light, and the magnitude of the electrical signal corresponding to the received light. Meanwhile, the phase difference is only used to detect the distance of the screen 200 and may not be considered when sensing the touch input. That is, the processor 170 may process the touch input based on the magnitude of the electrical signal corresponding to the received light.

Next, during the second frame period, the display device sets the screen to the second transparency (S830).

The processor 170 may control the high-level power to be applied to the first electrode 915 and the second electrode 925 of the screen 200 through the screen control unit 210. Accordingly, the screen 200 may be set to have a second transparency that is lower than the first transparency, that is, transparency.

Next, during the second frame period, the display device detects a user's gesture input in front of the screen (S840).

The light source unit 210 may output only output light, except for visible light, during the second frame period, but is not limited thereto, and various examples are possible.

The scanner 140 may scan and output the output light to the screen 200.

At this time, since the screen 200 is transparent, the output light can pass through the screen 200 and reach the user near the screen 200. Then, the output light is scattered or reflected by the user's hand 60, so that the received light can be received.

At this time, the electrical signal by the received light by the gesture can correspond to the RX waveform of FIG. 5B.

As a result, the processor 170 may process the gesture input based on the phase difference between the electrical signal corresponding to the output light and the electrical signal corresponding to the received light.

Meanwhile, in the second frame section, since the output light must pass through the screen 200, in order to improve the accuracy of gesture input detection, the light source unit 210 outputs in the second frame section, compared to the first frame section. It is possible to increase the intensity of the output light.

Meanwhile, various examples of arrangement of the first frame section and the second frame section are possible. This will be described with reference to FIGS. 12 and 13.

12 and 13 illustrate various examples of the arrangement of the first frame section and the second frame section.

First, FIG. 12 illustrates that the first frame section for sensing the touch input and the second frame section for sensing the gesture input are alternately arranged. Accordingly, the screen 200 may change opaquely in the odd frame section (1,3, ... n-1 frame) and transparently in the superior frame section (2,4, ... n frame). .

That is, the odd frame section (1,3, ... n-1 frame) corresponds to the first frame section described above, and the superior frame section (2,4, ... n frame) is the second frame described above. Can correspond to the section.

In the odd frame section (1,3, ... n-1 frame), corresponding projection images 910a, 910c, .., 910y may be displayed on the screen in a scanning manner, and the excellent frame section ( 2,4, ... n frames), corresponding projection images 910b, 910d, .., 910z may be displayed on the screen in a scanning manner.

On the other hand, unlike FIG. 12, it is also possible that the projected image is not displayed on the screen in the excellent frame section (2, 4, ... n frame). In this case, the light source unit for outputting visible light among the light source units 210 may be turned off.

Meanwhile, unlike FIG. 12, it is possible that the frequency of the first frame section is different from the frequency of the second frame section.

13 illustrates that the frequency of the first frame section is greater than the frequency of the second frame section to increase the accuracy of the touch input.

In the drawing, in every frame section (1,2,3, ... n-1, n frmae), except for the fourth frame section (4 frames), the screen 200 changes to be opaque and the corresponding projection Illustrates displaying an image. On the other hand, in the fourth frame section (4 frame), the screen 200 is transparently changed, and a corresponding projection image may be displayed.

Meanwhile, unlike FIG. 13, in order to increase the accuracy of gesture input, it is possible that the frequency of the second frame section is greater than the frequency of the first frame section.

The adjustment of the frequency of the first frame section and the frequency of the second frame section can be controlled by the processor 170.

On the other hand, as shown in FIG. 13, when the frequency of the first frame section is greater than the frequency of the second frame section, when the gesture input is detected in the fourth frame section (4 frame), than in FIG. It is possible to further increase the frequency of 2 frame sections. For example, as shown in FIG. 12, it is also possible to alternately arrange the first frame section and the second frame section.

Conversely, when the frequency of the second frame section is greater than the frequency of the first frame section, when the touch input starts to be detected, it is also possible to further increase the frequency of the first frame section.

14A and 14B are views illustrating an operation according to a touch input and a gesture input on a screen.

First, FIG. 14A (a) illustrates that a projection image 1100 indicating instrument panel information is displayed on the screen 200. At this time, when there is a touch input by the user finger 20, the display device 10 according to an embodiment of the present invention may detect a touch input based on the received light and perform an operation corresponding thereto. .

14A (b), it can be seen that a projection image 1120 indicating time information according to a touch input is displayed. Thereby, user convenience can be increased.

Next, FIG. 14B (a) illustrates that the broadcast image of the first channel CH 9 is displayed as the projected image 1210 on the screen 200. At this time, if there is a gesture input by the user's hand 50, the display device 10 according to an embodiment of the present invention, based on the received light, can detect the gesture input, and perform an operation corresponding thereto. .

14B (b) illustrates that the channel image is performed according to the gesture input, and accordingly, the broadcast image of the second channel CH 11 is displayed as the projected image 1220. Thereby, user convenience can be increased.

15 is a view for explaining the operation of the light source unit of FIGS. 4A to 4B.

As described above, during the first frame period for sensing the touch input, the projected image and the output light are output, but during the second frame period for detecting the gesture input, the projected image is not output but only the output light can be output. .

Accordingly, as shown in the drawing, during the first frame period, the red light source unit 210R, the green light source unit 210G, the blue light source unit 210B, and the output light source unit 210IR in the light source unit 210 are turned on, and the second light source unit 210IR is turned on. During the frame period, the red light source unit 210R, the green light source unit 210G, and the blue light source unit 210B in the light source unit 210 may be turned off, and the output light source unit 210IR may be turned on. Thereby, unnecessary power consumption can be reduced.

On the other hand, as a method for detecting a touch input and a gesture input, the touch input section and the gesture input section are described in terms of time for each frame section, but unlike this, spatial division is also possible.

That is, the display device according to another embodiment of the present invention, the first area has a first transparency, the second area is a screen having a second transparency lower than the first transparency, and the output light for detecting the distance of the external object A light source unit for outputting, and if there is a touch input in the first area on the screen, processes the touch input based on the received light corresponding to the output light, and when there is a gesture input in the second area on the screen, the output light A processor may process a gesture input based on the corresponding received light.

At this time, the first area of the screen 200 may have a first transparency, and the second area may be set to have a second transparency lower than the first transparency.

And, when there is a touch input in the first area on the screen 200, the processor 170 processes the touch input based on the received light corresponding to the output light, and gestures in the second area on the screen 200 If there is input, a gesture input can be processed based on the received light corresponding to the output light.

At this time, the light source unit 210 may output a projection image based on visible light and output light together, and the scanner 140 performs first direction scanning and second direction scanning to screen the projected image and output light ( 200) can be output together.

Meanwhile, the processor 170 may control an image to be displayed to be projected on a first area on the screen 200 by scaling an image to be displayed.

As described above, description of a display device according to another embodiment of the present invention will be omitted with reference to FIGS. 4A to 15.

16 to 17 are diagrams illustrating various examples of touch input and gesture input.

First, FIG. 16 (a) illustrates that the first region 1310 on the screen 200 is opaque and the second region 1320 is transparent. At this time, when the user finger 20 touches a predetermined point in the first area 1310, the display device 10 may detect it based on the received light. And, for smooth touch input detection, the size of the first area 1310 on the screen 200 may be varied.

In FIG. 16B, it is illustrated that the entire area 1315 on the screen 200 is opaque. Accordingly, it is possible to sense a touch input to all areas 1315 on the screen 200.

Next, FIG. 17A illustrates that the first area 1310 on the screen 200 is opaque and the second area 1320 is transparent. At this time, when the user's hand 60 gestures in front of the second area 1320, the display device 10 may detect it based on the received light. In addition, the display device 10 may vary the size of the second area 1320 on the screen 200 for smooth gesture input detection.

In FIG. 17 (b), it is illustrated that the entire area 1325 on the screen 200 is transparent. Accordingly, gesture input detection for all areas 1325 on the screen 200 becomes possible.

On the other hand, the variable of the transparent area and the opaque area, the first electrodes (H1, ... Hm), and the second electrodes (V1, ...) in the screen 200 described in FIGS. 6A to 6E. A part of Vn) can be implemented by applying a high level (H) and another part by applying a low level (L).

The display device according to the embodiment of the present invention is not limited to the configuration and method of the embodiments described as described above, the embodiments are all or part of each embodiment is optional so that various modifications can be made It may be configured in combination.

In addition, although the preferred embodiments of the present invention have been shown and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be implemented by those skilled in the art, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

Claims (10)

A screen having a first transparency during the first frame period and a second transparency during the second frame period;
A light source unit outputting output light for detecting a distance of an external object;
A light detector for receiving light received from the external object;
scanner; And
And a processor configured to process a touch input during the first frame period and a gesture input during the second frame period based on the output light and the received light.
The light source unit,
The projected image based on visible light and the output light are output together.
The scanner,
During the first frame period, the projected image and the output light are output in the screen direction,
During the second frame period, the display device outputs the output light in the screen direction. According to claim 1,
The screen,
A display device characterized by displaying the projected image during the first frame period and not displaying the projected image during the second frame period. According to claim 1,
The scanner,
And performing the first direction scanning and the second direction scanning to output the output light in the screen direction. delete A screen having a first transparency during the first frame period and a second transparency during the second frame period;
A light source unit outputting output light for detecting a distance of an external object;
A light detector for receiving light received from the external object; And
And a processor configured to process a touch input during the first frame period and a gesture input during the second frame period based on the output light and the received light.
The processor,
A display device characterized by varying the frequency of the first frame section and the frequency of the second frame section according to the touch input or the gesture input. According to claim 1,
The screen,
It includes a first electrode and a second electrode crossing each other, and an anisotropic body disposed between the first electrode and the second electrode,
Depending on the power applied between the first electrode and the second electrode, the arrangement direction of the anisotropic body is varied to have the first transparency during the first frame section and the second transparency during the second frame section. Display device characterized in that it has a. According to claim 1,
It is disposed on the other side of the external object with respect to the screen, and during the second frame section, the camera for photographing the external object; further includes,
The processor, the display device, characterized in that for receiving the captured image of the external object. A screen in which the first region has a first transparency and the second region has a second transparency;
A light source unit outputting output light for detecting a distance of an external object;
A photodetector configured to receive received light from the external object;
scanner; And
And a processor configured to process a touch input in the first area on the screen and a gesture input in the second area on the screen based on the output light and the received light.
The light source unit,
The projected image based on visible light and the output light are output together.
The scanner,
In the direction of the first area, the projection image and the output light are output,
And displaying the output light in the direction of the second region. The method of claim 8,
The scanner,
And performing the first direction scanning and the second direction scanning to output the output light in the screen direction. A screen in which the first region has a first transparency and the second region has a second transparency;
A light source unit outputting output light for detecting a distance of an external object;
A photodetector configured to receive received light from the external object; And
And a processor configured to process a touch input in the first area on the screen and a gesture input in the second area on the screen based on the output light and the received light.
The screen,
And a size of the first area and the second area is varied according to the touch input or the gesture input.

Images