KR20220060228A - Display apparatus and control method thereof - Google Patents

Abstract

Disclosed is a display device. The present display device comprises: a display; a plurality of light emitting elements disposed on each of the first to fourth side surfaces of a display, and irradiating a light in a direction crossing the front of the display; a plurality of light receiving elements disposed on each of the first to fourth side surfaces, and disposed between the plurality of light emitting elements; and a processor that controls the display to display an image, controls the plurality of light emitting elements so that at least one among the plurality of light emitting elements irradiates light, and identifies at least one among a size or shape of an object located on the front of the display based on a sensing value of the plurality of light receiving elements. Therefore, the present invention is capable of providing the display device capable of identifying an area for which a user wants to point to on the display.

Description

Display device and its control method {DISPLAY APPARATUS AND CONTROL METHOD THEREOF}

The present disclosure relates to a display device and a method for controlling the same, and more particularly, a display device capable of identifying a region that a user wants to point to on a display without direct contact with the display by recognizing an object disposed on the front of the display. and to a control method thereof.

Recently, a system that provides various services by receiving a command input from a user through a touch method on a display, such as a kiosk, has become common.

However, in the case of a touch display disposed in a multi-use facility, since several people come into contact with the same display screen, there is a problem of poor hygiene.

The present disclosure is intended to solve the above-described problems, and an object of the present disclosure is to identify an area that a user wants to point to on the display without direct contact with the display by identifying the position, size, and shape of an object disposed on the front side of the display. An object of the present invention is to provide an identifiable display device and a method for controlling the same.

In order to achieve the above object, a display device according to an embodiment of the present disclosure includes a display, a plurality of displays disposed on first to fourth side surfaces of the display, and irradiating light in a direction transverse to the front surface of the display of the light-emitting element, which is disposed on each of the first to fourth side surfaces, and controls the display to display a plurality of light-receiving elements and images disposed between the plurality of light-emitting elements, and at least one of the plurality of light-emitting elements emits light and a processor for controlling the plurality of light emitting devices to irradiate the light and identifying at least one of a size or a shape of an object located on the front surface of the display based on sensing values of the plurality of light receiving devices.

In this case, the display device further includes a bezel part disposed in an outer region of the display, and the bezel part includes a housing for accommodating the sensing device and a sealing member provided between the housing and the front surface of the display to maintain airtightness. Including, the light irradiated from the light emitting device may be irradiated in a direction transverse to the front surface of the display through the sealing member.

Meanwhile, the plurality of light emitting devices and the plurality of light receiving devices may be alternately disposed.

On the other hand, the processor identifies the position of the object located on the front surface of the display based on the sensed values of the plurality of light receiving elements, and at the position of the light receiving element having the largest value among the sensing values of the plurality of light receiving elements. Based on the location of the object can be identified.

In this case, the processor identifies at least one of the size or shape of the object based on the sensed value of the light receiving element located on the side opposite to the side of the display on which the light receiving element having the largest sensing value is located can do.

In this case, the processor may correct the position of the object based on the size and shape of the identified object.

In this case, if the identified object is a hand having the pointing finger, the processor may correct the position of the object to a position corresponding to the tip of the pointing finger.

Meanwhile, the processor may identify the size of the object based on the position of the light receiving element having a preset sensing value or more among the sensing values of the plurality of light receiving elements.

Meanwhile, the processor identifies the position of the object located on the front surface of the display based on the sensing values of the plurality of light receiving elements, and when the object is located at the identified position for a preset time, the identified position Based on the , a touch event for a specific region of the displayed image may be generated.

Meanwhile, the sealing member may be formed to be inclined toward the front surface of the display in a direction away from the periphery of the display.

Meanwhile, the light emitting device may radiate light in a direction crossing the front surface of the display at a predetermined angle with respect to the front surface of the display.

On the other hand, the control method of the display device according to an embodiment of the present disclosure includes the steps of controlling the display to display an image, controlling the plurality of light emitting devices so that at least one of the plurality of light emitting devices irradiates light, and and identifying at least one of a size and a shape of an object located on the front surface of the display based on a value sensed by a light receiving element.

In this case, the plurality of light emitting elements and the plurality of light receiving elements may be alternately disposed.

On the other hand, the method further includes the step of identifying the position of the object located on the front surface of the display based on the sensing values of the plurality of light receiving elements, wherein the identifying of the position of the object includes: among the values sensed by the plurality of light receiving elements The position of the object may be identified based on the position of the light receiving element having the largest value.

In this case, the step of identifying at least one of the size or shape of the object may include a sensing value sensed by the light receiving element located on the side opposite to the side of the display on which the light receiving element having the largest sensing value is located. At least one of a size or a shape of the object may be identified.

In this case, the method may further include correcting the position of the object based on the size and shape of the identified object.

In this case, in the step of correcting, if the identified object is a hand having an index finger, the position of the object may be corrected to a position corresponding to the tip of the index finger.

The method may further include identifying the size of the object based on a position of the light receiving element having a preset sensing value or more among the sensing values of the plurality of light receiving elements.

On the other hand, the method further comprises the step of identifying the position of the object located on the front surface of the display based on the sensing values of the plurality of light receiving elements, and when the object is located at the identified position for a preset time, the identified position The method may further include generating a touch event for a specific region of the displayed image based on the .

Meanwhile, the light emitting device may radiate light in a direction crossing the front surface of the display at a predetermined angle with respect to the front surface of the display.

1 is a diagram schematically illustrating a display device according to an embodiment of the present disclosure.
2 is a block diagram illustrating a configuration of a display device according to an embodiment of the present disclosure.
3 is a block diagram illustrating a detailed configuration of a display device according to an exemplary embodiment of the present disclosure.
FIG. 4 is a view for explaining an operation in which the display device identifies the position of an object disposed on the front surface of the display according to an embodiment of the present disclosure;
5 is a view for explaining the structure of a bezel part and a sensing device according to an embodiment of the present disclosure.
6 is a view for explaining the structure of a bezel part and a sensing device according to another embodiment of the present disclosure.
7 is a view for explaining that the sensing device according to an embodiment of the present disclosure senses a motion of an object.
8 is a diagram for explaining a case in which a user generates a touch event with his or her right hand.
9 is a diagram for explaining a case in which a user generates a touch event with his or her left hand.
10 is a diagram for explaining an operation of identifying the position and size of an object according to the size of the object and the distance from the bezel part, and illustrates a case in which one light emitting element irradiates light.
11 is a diagram for explaining an operation of identifying the position and size of an object according to the size of the object and the distance from the bezel part, and illustrates a case in which a plurality of light emitting devices irradiate light.
12 is a diagram schematically illustrating a display device according to another embodiment of the present disclosure.
13 is a view for explaining a method of controlling a display apparatus according to an embodiment of the present disclosure.

It should be understood that the embodiments described below are illustratively shown to help the understanding of the present disclosure, and the present disclosure may be implemented with various modifications, different from the embodiments described herein. However, in the following description of the present disclosure, if it is determined that a detailed description of a related well-known function or component may unnecessarily obscure the gist of the present disclosure, the detailed description and specific illustration thereof will be omitted. In addition, the accompanying drawings are not drawn to scale in order to help understanding of the disclosure, but dimensions of some components may be exaggerated.

The terms used in this specification and claims have been chosen in consideration of the function of the present disclosure. However, these terms may vary depending on the intention of a person skilled in the art, legal or technical interpretation, and emergence of new technology. Also, some terms are arbitrarily selected by the applicant. These terms may be interpreted in the meanings defined herein, and in the absence of specific definitions, they may be interpreted based on the general content of the present specification and common technical common sense in the art.

In the description of the present disclosure, the order of each step should be understood as non-limiting unless the preceding step must be logically and temporally performed before the subsequent step. In other words, except for the above exceptional cases, even if the process described as the subsequent step is performed before the process described as the preceding step, the essence of the disclosure is not affected, and the scope of rights should also be defined regardless of the order of the steps.

In this specification, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of a corresponding characteristic (eg, a numerical value, function, operation, or component such as a part). and does not exclude the presence of additional features.

Terms such as first, second, etc. may be used to describe various elements, but the elements should not be limited by the terms. The above terms may be used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present disclosure, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component.

In addition, since the present specification describes components necessary for the description of each embodiment of the present disclosure, the present disclosure is not necessarily limited thereto. Accordingly, some components may be changed or omitted, and other components may be added. In addition, they may be distributed and arranged in different independent devices.

Further, an embodiment of the present disclosure will be described in detail below with reference to the accompanying drawings and the contents described in the accompanying drawings, but the present disclosure is not limited or limited by the embodiments.

Hereinafter, the present disclosure will be described in detail with reference to FIGS. 1 to 13 .

1 is a diagram schematically illustrating a display device according to an embodiment of the present disclosure.

Referring to FIG. 1 , the display apparatus 100 according to an embodiment of the present disclosure includes a bezel part 10 , a display 110 , and a plurality of light emitting devices 210 and a plurality of light receiving devices 220 . device 200 .

In FIG. 1 , the plurality of light emitting devices 210 and the plurality of light receiving devices 220 are illustrated as being disposed on the bezel part 10 , but this is a relative relation between the plurality of light emitting devices 210 and the plurality of light receiving devices 220 . It is shown briefly to show the arrangement relationship, and the sensing device 200 including the plurality of light emitting elements 210 and the plurality of light receiving elements 220 may be accommodated in the bezel part 10 . Detailed structures of the bezel part 10 and the sensing device 200 will be described later with reference to FIGS. 5 to 6 .

The display 110 may provide various content screens. Here, the content screen may include various contents such as images, videos, texts, and music, an application execution screen, a graphic user interface (GUI) screen, and the like.

A user may point to a specific location on the front of the display 110 to generate a touch event without direct contact with the display 110 . As an example, FIG. 1 illustrates that the user points to a specific location on the front surface of the display 110 through the index finger of the right hand.

The sensing device 200 may sense the position, size, or shape of an object disposed on the front surface of the display 110 . The sensing device 200 may include a plurality of light emitting devices 210 , for example, a light emitting diode (LED) and a plurality of light receiving devices 220 , for example, a photodiode or photo-detector (PD). .

Referring to FIG. 1 , a plurality of light emitting elements 210 and a plurality of light receiving elements 220 are respectively disposed on first to fourth side surfaces of the display 110 , and the light irradiated from the light emitting element 210 is displayed on the display ( It may be reflected from an object disposed on the front surface of 110 , and the reflected light may be received by the light receiving element 220 . A detailed description related to the sensing operation of the sensing device 200 will be described later.

2 is a block diagram illustrating a configuration of a display device according to an embodiment of the present disclosure.

Referring to FIG. 2 , the display device 100 may include a display 110 , a processor 120 , and a sensing device 200 .

The display device 100 may be implemented as various types of devices having a display function. For example, kiosk (KIOSK), TV, smart phone (smart phone), tablet (tablet) PC, PMP (Portable Multimedia Player), PDA (Personal Digital Assistants), laptop (laptop computer), smart watch (smart watch) , HMD (Head mounted Display), NED (Near Eye Display), digital signage, etc. can be implemented as a device with a display function.

The display 110 has various types such as liquid crystal display (LCD), organic light-emitting diode (OLED), liquid crystal on silicon (LCoS), digital light processing (DLP), micro LED, quantum dot (QD) display panel, and the like. can be implemented as However, the present invention is not limited thereto. The display 110 may be implemented as a flexible display, a transparent display, or the like in some cases.

The sensing device 200 may be disposed inside the bezel part 10 disposed in the outer region of the display 110 , more specifically, in the outer region of the display 110 . The sensing device 200 may include a plurality of light emitting elements 210 and a plurality of light receiving elements 220 .

The light emitting device 210 may emit light of various intensities according to the magnitude of the applied current. In addition, the light emitting device 210 may emit light included in various regions, such as ultraviolet, visible, and infrared regions, according to a manufacturing method and material. As an example, the light emitting device may be implemented as an infrared diode (IRED).

The light receiving element 220 may receive light. For example, the light receiving device 220 may receive the light irradiated by the light emitting device 210 . In addition, the light receiving element 220 may receive the reflected light irradiated by the light emitting element 210 and reflected from the object. Here, the light receiving element 220 may refer to an element that converts an optical signal or light energy into an electrical signal or electrical energy. Meanwhile, the light receiving element 220 may be variously called a photo detector, a light receiving sensor, an infrared light receiving module, etc., but hereinafter, it will be collectively referred to as the light receiving element 220 .

The light receiving element 220 according to an embodiment of the present disclosure may transmit the signal intensity of the received light and the signal intensity (or intensity) of the light reflected from the object to the processor 120 .

According to an embodiment of the present disclosure, each of the plurality of light receiving elements 220 may be disposed between the plurality of light emitting elements 210 . For example, the plurality of light emitting devices 210 and the plurality of light receiving devices 220 may be alternately disposed. Meanwhile, such an arrangement is only an example, and the sensing device 200 may include a plurality of light emitting elements 210 and a plurality of light receiving elements 220 arranged in various shapes.

The processor 120 may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes digital signals, but is not limited thereto, and the central processing unit ( central processing unit (CPU), micro controller unit (MCU), micro processing unit (MPU), controller, application processor (AP), graphics-processing unit (GPU) or communication processor (CP)), may include one or more of an ARM processor, or may be defined by a corresponding term In addition, the processor 120 is a SoC (System on Chip) or LSI (large scale integration) in which a processing algorithm is embedded. It may be implemented in the form of a field programmable gate array (FPGA), and the processor 120 may perform various functions by executing computer executable instructions stored in a memory.

The processor 120 may control the overall operation of the display apparatus 100 .

In particular, the processor 120 controls the display 110 to display an image, controls the plurality of light emitting devices 210 so that at least one of the plurality of light emitting devices 210 irradiates light, and the plurality of light receiving devices ( At least one of the position, size, and shape of the object located on the front surface of the display 110 may be identified based on the sensed value of 220 .

3 is a block diagram illustrating a detailed configuration of a display device according to an exemplary embodiment of the present disclosure.

Referring to FIG. 3 , the display apparatus 100 according to an embodiment of the present disclosure includes a memory 130 , a communication interface 140 , and an input interface in addition to the display 110 , the processor 120 , and the sensing device 200 . At least one of 150 and the output interface 160 may be further included.

The memory 130 may store instructions or programs executed by the processor 120 . In addition, information or data received through the communication interface 140 may be stored in the memory 130 . The memory 130 is accessed by the processor 120 , and reading/writing/modification/deletion/update of instructions, modules, artificial intelligence models or data may be performed by the processor 120 .

The communication interface 140 may refer to hardware capable of transmitting and receiving various types of information (or data) by performing communication using a wired communication method or a wireless communication method with various external devices. In this case, the communication interface 140 is TCP/IP (Transmission Control Protocol/Internet Protocol), UDP (User Datagram Protocol), HTTP (Hyper Text Transfer Protocol), HTTPS (Secure Hyper Text Transfer Protocol), FTP (File Transfer Protocol) ), SFTP (Secure File Transfer Protocol), MQTT (Message Queuing Telemetry Transport), and other communication protocols (protocols) can be used to transmit and receive various information with various external devices.

The input interface 150 may receive various user inputs and transmit them to the processor 120 . The input interface may include, for example, at least one of a touch panel, a pen sensor, a key, and a microphone. The touch panel may use, for example, at least one of a capacitive type, a pressure-sensitive type, an infrared type, and an ultrasonic type, and for this, the touch panel may include a control circuit. The touch panel may further include a tactile layer to provide a tactile response to the user. The pen sensor may be, for example, a part of the touch panel or may include a separate recognition sheet. The key may include, for example, a physical button, an optical key, or a keypad. Such an input interface may be implemented as a configuration of a user terminal device that is embedded in the display device 100 or communicates with the display device 100 such as a built-in keyboard, trackpad, button, touch panel, or the like.

The output interface 160 may include at least one of a display and a speaker. Here, the display is a device for outputting information in a visual form (eg, text, image, etc.). The display may display the image frame in all or part of the display area. The display area may refer to the entire area of a pixel unit in which information or data is visually displayed. A speaker is a device that outputs information in an audible form (eg, voice). The speaker may directly output various types of notification sounds or voice messages as well as various audio data on which various processing operations such as decoding, amplification, and noise filtering have been performed by an audio processing unit (not shown).

FIG. 4 is a view for explaining an operation in which the display device identifies the position of an object disposed on the front surface of the display according to an embodiment of the present disclosure;

Referring to FIG. 4 , the plurality of light emitting devices 210 and the plurality of light receiving devices 220 may be respectively disposed in the outer region of the display 110 . Specifically, the plurality of light-emitting elements 210 and the plurality of light-receiving elements 220 are disposed on each of the first to fourth side surfaces of the display 110 , and the plurality of light-receiving elements 220 includes the plurality of light-emitting elements 210 . may be disposed between them.

Each of the light receiving elements 220 may receive the reflected light reflected from the object disposed on the front surface of the display 110 of the light irradiated from the light emitting element 210 . In this case, the processor 120 may identify the position of the object based on the sensing value of each light receiving element 220 .

For example, the plurality of light emitting devices 210 sequentially irradiate light one by one, and the sensing value of each light receiving device 220 is determined by the light reflected from the object irradiated from each light emitting device 210 . do. The processor 120 determines that the light receiving element 220 having the largest value among the sensing values of the plurality of light receiving elements 220 is located at the closest distance from the object, and based on the position of the light receiving element 220 , the object location can be identified.

The position of the object may be identified by operating all of the plurality of light emitting devices 210 disposed on the first to fourth side surfaces of the display 110 , but the present invention is not limited thereto, and one side of the display 110 and the other adjacent thereto are not limited thereto. The position of the object may be identified by operating the plurality of light emitting devices 210 respectively disposed on the side surfaces. The position of the object may be identified, for example, in two-dimensional coordinates on the front surface of the display 110 .

Meanwhile, the size and shape of the object may be identified based on the identified position of the object and sensing values of the plurality of light receiving elements 220 disposed on each side of the display 110 . A detailed description related thereto will be described later with reference to FIGS. 8 to 9 .

5 is a view for explaining the structure of a bezel part and a sensing device according to an embodiment of the present disclosure.

5 illustrates a cross-section of the display apparatus 100 . Referring to FIG. 5 , the bezel part 10 may include a housing 11 and a sealing member 12 .

The housing 11 is disposed in the outer region of the display 110 and can accommodate the sensing device 200 therein.

The sealing member 12 is provided between the housing 11 and the front surface of the display 110 to maintain airtightness, thereby preventing foreign substances from penetrating into the bezel part 10 . In addition, the sealing member 12 prevents the sensing device 200 from being seen through the vortex of the display device 100 , and selectively selects a signal of a specific wavelength of light emitted from the light emitting device 210 , for example, a wavelength in the infrared region. can be transmitted through

The light emitting device 210 may be disposed inside the bezel part 10 in a form embedded in the substrate 230 , and may radiate light in a direction transverse to the front surface of the display 110 . In this case, the light irradiated from the light emitting device 210 may pass through the sealing member 12 to be irradiated.

Referring to FIG. 5 , the sealing member 12 may be formed to be inclined toward the front surface of the display 110 in a direction away from the periphery of the display 110 . In this case, light irradiated from the light emitting device 210 and transmitted through the sealing member 12 may be refracted from a direction crossing the front surface of the display 110 to a direction toward the front of the display 110 . Accordingly, even if the object is disposed at a predetermined distance from the front surface of the display 110 without contacting the display 110 , the light irradiated from the light emitting element 210 may be reflected to the object, and the reflected light may be reflected by the light receiving element 220 .

6 is a view for explaining the structure of a bezel part and a sensing device according to another embodiment of the present disclosure.

Referring to FIG. 6 , the substrate 230 in which the light emitting device 210 is embedded may be disposed in the bezel part 10 at a predetermined angle. In this case, the light emitting device 210 may radiate light in a direction that crosses the front surface of the display 110 at a predetermined angle with respect to the front surface of the display 110 . Accordingly, as in the embodiment shown in FIG. 5 , light can be irradiated to an object disposed at a distance from the front surface of the display 110 , and the light reflected from the object is received by the light receiving element 220 . can be

7 is a view for explaining that the sensing device according to an embodiment of the present disclosure senses a motion of an object.

When the user points to a specific area on the display 110 , the processor 120 may generate a touch event for the area corresponding to the user's intention.

For example, when the object is located at the identified position for a preset time, the processor 120 may generate a touch event for a specific region of the image displayed on the display 110 based on the identified position.

Meanwhile, the processor 120 may generate a touch event by sensing the motion of the object. For example, referring to FIG. 7 , when the object approaches the front surface of the display 110 in a vertical direction, the area of the object reflected by the light irradiated from the light emitting device 210 increases, so that the light receiving the reflected light is received. The sensing value of the device 220 increases. Accordingly, a movement speed at which an object moves in a direction perpendicular to the front surface of the display 110 can be detected based on a change in the sensing value of the light receiving element 220 , and when an operation greater than or equal to a preset acceleration is detected, for the identified area A touch event can be generated.

On the other hand, when the user points out a specific area on the display 110 to generate a touch event, the location of the touch event intended by the user may be different depending on the shape of the user's hand used for pointing.

In detail, the processor 120 may identify the position of the object with respect to the center of mass based on the signal received from the sensing device 200 . In this case, when the user points using his right hand and when pointing with his left hand, the pointing position of the finger may be different, whereas the location of the center of mass of each of the right and left hands reflects information on the finger pointing position. Since it is not marked, the pointed position may be identified incorrectly. Accordingly, it is necessary to correct the touch event occurrence location according to the shape of the hand pointed by the user.

FIG. 8 is a diagram for explaining a case in which a user generates a touch event with their right hand, and FIG. 9 is a diagram for explaining a case where a user generates a touch event with their left hand.

Referring to FIGS. 8 and 9 , the area in which light reflected from the side of the hand where the pointing finger is located is received by the plurality of light receiving elements 220 disposed on one side of the display 110 is from the opposite side of the hand. There is a difference when compared with the area where the reflected light is received by the plurality of light receiving elements 220 located on opposite sides of the display 110 . Based on the sensing values of the plurality of light receiving elements 220 and the identified position of the object, an area for each surface on which light is reflected from the object may be calculated. Accordingly, the processor 120 may identify the size and shape of the object.

For example, when an object is identified as a hand having a pointing finger and the shape of the hand is identified as a right hand as shown in FIG. 8 , a position at which a touch event is generated may be corrected from the center of mass of the object to the upper left corner. Similarly, when the shape of the hand is identified as the left hand as shown in FIG. 9 , the position where the touch event is generated may be corrected from the center of mass of the object to the upper right corner.

10 and 11 are views for explaining the operation of identifying the position and size of an object according to the size of the object and the distance from the bezel part, and FIG. 10 shows a case in which one light emitting element irradiates light. , FIG. 11 illustrates a case in which a plurality of light emitting devices irradiate light.

Referring to FIG. 10 , when one light emitting device 210 irradiates light, a small object located at a close distance from the light emitting device 210 has a small distance from the light receiving device 220 but a small amount of reflected light, and emits light. A large object located far from the element 210 has a relatively large distance from the light receiving element 220, but a large amount of reflected light. When the distance is far away, the sensing value of the light receiving element 220 may appear the same.

In this case, the above-described two cases can be distinguished by simultaneously operating the light emitting device 210 and the adjacent other light emitting device 210 . Referring to FIG. 11 , when a small-sized object is nearby, even when the other light-emitting element 210 is operated, the light irradiated from the other light-emitting element 210 is not reflected by the object, so that the sensing value of the light-receiving element 220 is not affected. On the other hand, when a large-sized object is nearby, when the other light-emitting element 210 is operated, the light irradiated from the other light-emitting element 210 is reflected by the object, so that the sensing value of the light-receiving element 220 is changed. can Accordingly, it is possible to identify the size and position of an object using only the light emitting element 210 and the light receiving element 220 disposed on one side.

12 is a diagram illustrating a display device according to another embodiment of the present disclosure.

12 , in the display device according to another embodiment of the present disclosure, a plurality of light emitting devices are disposed on one side of the display and the other side adjacent thereto, and a plurality of light emitting devices are disposed on a side opposite to each of the side surfaces on which the plurality of light emitting devices are disposed. of the light receiving element may be disposed.

The light irradiated from the light emitting device disposed on one side of the display may be reflected from the object, and may be received by the light receiving device disposed on the side adjacent to the one side of the display.

Meanwhile, light irradiated from the light emitting device disposed on the other side of the display may be reflected from the object and received by the light receiving device disposed on the adjacent side thereof.

The processor 120 may identify the position, size, and shape of the object based on the sensing values of the light receiving elements disposed on each side. Identifies the position, size, and shape of the object based on the sensing values of the light receiving elements Since the operation has been described above, a redundant description will be omitted.

13 is a view for explaining a method of controlling a display apparatus according to an embodiment of the present disclosure.

Referring to FIG. 13 , in the method of controlling a display apparatus according to an embodiment of the present disclosure, controlling the display to display an image ( S1310 ), the plurality of light emitting devices so that at least one of the plurality of light emitting devices irradiates light It may include controlling the device ( S1320 ) and identifying at least one of a size or a shape of an object located on the front surface of the display based on sensing values of the plurality of light receiving devices ( S1330 ).

First, the display apparatus 100 may control the display 110 to display an image ( S1310 ).

Here, the image displayed on the display 110 may include various contents such as an image, a moving picture, text, and music, an application execution screen, a graphic user interface (GUI) screen, and the like.

In addition, the display apparatus 100 may control the plurality of light emitting devices 210 so that at least one of the plurality of light emitting devices 210 emit light ( S1320 ).

Here, the plurality of light emitting devices 210 may be disposed on each of the first to fourth side surfaces of the display 110 to radiate light in a direction crossing the front of the display 110 , and the plurality of light receiving devices 220 . ) may be disposed between the plurality of light emitting devices 210 . In this case, the plurality of light emitting devices 210 and the plurality of light receiving devices 220 may be alternately disposed. Accordingly, when the light irradiated from the light emitting device 210 and reflected from the object is received by the light receiving device 220 , the light receiving device 220 disposed adjacent to the light emitting device 210 receives the light of the strongest intensity. Thus, it can have the largest sensing value.

In addition, the display apparatus 100 may identify at least one of a size or a shape of an object located on the front surface of the display 110 based on the sensing values of the plurality of light receiving elements 220 ( S1330 ).

The display apparatus 100 may identify the position of the object based on the position of the light receiving element 220 having the largest value among the sensing values of the plurality of light receiving elements 220, and the light receiving element having the largest sensing value ( The size or shape of the object may be identified based on a sensing value sensed by the light receiving element 220 positioned on the side opposite to the side of the display 110 on which the 220 is positioned.

For example, based on the sensing values of the plurality of light receiving elements 220 disposed on one side of the display 110 and the distance from the one side of the display 110 to the object corresponding to one side of the display 110 , An area for one side of the object may be calculated. In addition, the other side of the display 110 based on the sensing values of the plurality of light receiving elements 220 disposed on the other side opposite to the one side of the display 110 and the distance from the object to the other side of the display 110 . It is possible to calculate the area for the other side of the object corresponding to . Accordingly, the size or shape of the object may be identified based on the areas viewed from different directions of the object.

In this case, the method may further include correcting the position of the object based on the size and shape of the identified object.

For example, if the identified object is a hand having an index finger, the position of the object may be corrected to a position corresponding to the tip of the index finger. Specifically, the display apparatus 100 may identify the shape of a hand based on sensing values of each of the plurality of light receiving elements 220 disposed on both sides of the display 110 and determine the position of the pointing finger.

Accordingly, a touch event may be generated for a specific area on the display corresponding to the user's intention.

Meanwhile, the display apparatus 100 may further include, when the object is located at the identified position for a preset time, generating a touch event for a specific region of the image displayed on the display based on the identified position.

Accordingly, when the user designates a specific area on the display, a touch event may be generated for the area corresponding to the user's intention without direct contact with the display.

Meanwhile, a non-transitory computer readable medium in which a program for controlling a display device according to an embodiment of the present disclosure is stored may be provided.

The non-transitory readable medium refers to a medium that stores data semi-permanently, rather than a medium that stores data for a short moment, such as a register, cache, memory, and the like, and can be read by a device. Specifically, the various applications or programs described above may be provided by being stored in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In the above, preferred embodiments of the present disclosure have been illustrated and described, but the present disclosure is not limited to the specific embodiments described above, and it is common in the technical field to which the disclosure belongs without departing from the gist of the present disclosure as claimed in the claims. Various modifications may be made by those having the knowledge of

100: display device 110: display
120: processor 200: sensing device
210: light-emitting element 220: light-receiving element

Claims (20)

In the display device,
display;
a plurality of light emitting devices disposed on each of the first to fourth side surfaces of the display and irradiating light in a direction transverse to the front surface of the display;
a plurality of light receiving elements disposed on each of the first to fourth side surfaces and disposed between the plurality of light emitting elements; and
Controls the display to display an image, controls the plurality of light emitting devices so that at least one of the plurality of light emitting devices irradiates light, and is located on the front surface of the display based on sensing values of the plurality of light receiving devices A display device comprising a; a processor for identifying at least one of the size and shape of the object. According to claim 1,
It further includes; a bezel portion disposed in the outer region of the display;
The bezel part,
a housing accommodating the sensing device; and
a sealing member provided between the housing and the front surface of the display to maintain airtightness;
The light irradiated from the light emitting device passes through the sealing member and is irradiated in a direction crossing the front surface of the display. According to claim 1,
and the plurality of light-emitting elements and the plurality of light-receiving elements are alternately arranged. According to claim 1,
The processor is
Identifies the position of the object located on the front surface of the display based on the sensing values of the plurality of light receiving elements,
A display device for identifying the position of the object based on the position of the light receiving element having the largest value among the sensing values of the plurality of light receiving elements. 5. The method of claim 4,
The processor is
A display device for identifying at least one of a size or a shape of the object based on a sensing value sensed by a light receiving element located on a side opposite to a side of a display on which the light receiving element having the largest sensing value is located. 6. The method of claim 5,
The processor is
A display device for correcting the position of the identified object based on the size and shape of the object. 7. The method of claim 6,
The processor is
If the identified object is a hand having the pointing finger, the display device corrects the position of the object to a position corresponding to the tip of the pointing finger. According to claim 1,
The processor is
The display apparatus of claim 1, wherein the size of the object is identified based on a position of the light-receiving element having a predetermined value or more among the sensing values of the plurality of light-receiving elements. According to claim 1,
The processor is
Identifies the position of the object located on the front surface of the display based on the sensing values of the plurality of light receiving elements,
When the object is located at the identified position for a preset time, the display device generates a touch event for a specific area of the displayed image based on the identified position. 3. The method of claim 2,
The sealing member,
The display device is formed to be inclined toward the front surface of the display in a direction away from the periphery of the display. According to claim 1,
The light emitting device is
A display device for irradiating light in a direction crossing the front of the display at a predetermined angle with respect to the front of the display. A method for controlling a display device, comprising:
controlling a display to display an image;
controlling the plurality of light emitting devices so that at least one of the plurality of light emitting devices irradiates light; and
A control method comprising a; identifying at least one of a size or a shape of an object located on the front surface of the display based on the sensing values of the plurality of light receiving elements. 13. The method of claim 12,
and the plurality of light-emitting elements and the plurality of light-receiving elements are alternately arranged. 13. The method of claim 12,
Further comprising; identifying the position of the object located on the front surface of the display based on the sensing values of the plurality of light receiving elements;
Identifying the location of the object comprises:
A control method for identifying the position of the object based on the position of the light receiving element having the largest value among the sensing values of the plurality of light receiving elements. 15. The method of claim 14,
The step of identifying at least one of the size or shape of the object,
A control method for identifying at least one of a size or a shape of the object based on a sensing value sensed by a light receiving element located on a side opposite to a side of a display on which the light receiving element having the largest sensing value is located. 16. The method of claim 15,
Compensating the position of the object based on the identified size and shape of the object; further comprising, the control method. 17. The method of claim 16,
The correcting step is
If the identified object is a hand having the pointing finger, the control method comprising correcting the position of the object to a position corresponding to the tip of the pointing finger. 13. The method of claim 12,
The method further comprising: identifying the size of the object based on the position of the light receiving element having a preset sensing value or more among the sensing values of the plurality of light receiving elements. 13. The method of claim 12,
Further comprising; identifying the position of the object located on the front surface of the display based on the sensing values of the plurality of light receiving elements;
When the object is located at the identified position for a preset time, generating a touch event for a specific region of the displayed image based on the identified position; further comprising a control method. 13. The method of claim 12,
The light emitting device is
A control method for irradiating light in a direction crossing the front of the display at a predetermined angle with respect to the front of the display.

Images