KR101753090B1 - Display apparatus and object recognition method - Google Patents

Abstract

The present invention relates to a display device and a method of recognizing the object. The disclosed display device recognizes an object based on the touch information of the object and the grasped shape of the object on the display panel. Therefore, even if the object does not have dedicated equipment such as a touch unit made of an electrostatic-change inducing material, the object can be recognized by the display device. Further, in the case of an object having a touch unit or the like, conventionally, the display unit recognizes the touch unit. However, the present invention can be applied to an electrostatic charge induction material Of the weight or the capacity of the sample. In the case of a smartphone, since the display device can grasp the case where the display window is in contact with the display panel and the case where the case is in contact with the display panel, various additional services are provided through the function of the display device and the interlocking of the smartphone can do. In addition to the touch detection using the display panel, recognition of the object using up to the light transmission characteristic at the upper part of the display panel has an advantage in that accuracy of object recognition is improved when compared with recognition of the object only by touch sensing using the display panel .

Description

[0001] DISPLAY APPARATUS AND OBJECT RECOGNITION METHOD [0002]

The present invention relates to a display device, and more particularly, to a display device capable of recognizing an object placed on a display panel and a method of recognizing the object.

As is known, a computer can be used as a tool for collaborative work, and a table top display device having a touch screen on the top surface of the table is attracting attention because of its high ease of collaboration using a computer. Such a tabletop display device is in a trend of being enlarged so as to facilitate interaction when a large number of people collaborate.

As such, the table top display device is used as a tool for collaborative work, so that there is a high possibility that various objects are placed on the display panel, and thus a function of recognizing the objects placed on the table top display device is required.

Conventionally, an electronic touch unit has been proposed to enable an object to be recognized by a tabletop display device. The electronic touch unit includes a plurality of mutually insulated touch units and a control module configured to selectively charge capacitors assigned to a specified number of touch units among the plurality of touch units. When the electronic touch unit is touched to the touch screen while the control module controls the capacitors assigned to a specified number of touch units of the plurality of touch units to be selectively stored, the multi touch touched point is recognized on the touch screen.

However, this prior art has a problem that the object can not be used universally because it must necessarily have a dedicated electronic touch unit composed of an electrostatic-change inducing material.

Korean Published Patent Application No. 2015-0134118, published on 01 December 2015.

According to the embodiment of the present invention, in addition to touch sensing using a display panel, light is irradiated on an upper part of a display panel to be used for object recognition, so that the accuracy of object recognition can be improved A display device and a method for recognizing the object are provided.

The problems to be solved by the present invention are not limited to those mentioned above, and another problem to be solved can be clearly understood by those skilled in the art from the following description.

According to one aspect of the present invention, there is provided a display device comprising: a display portion having a display panel and a touch sensor; a plurality of light emitting elements arranged along a periphery of the display panel to emit light toward the inside of the peripheral portion; And a control unit for controlling the display unit and the optical unit, wherein the control unit controls the display unit and the light receiving unit based on the light emission information of the light emitting device and the light receiving information of the light receiving device The coordinate information by sensing the object is detected and when the coordinate information by the sensing is not changed for a predetermined time, it is determined that the object recognition event has occurred and the coordinate information by the sensing is collected as the shape information of the object , Coordinate information by touch according to the sensed value of the touch sensor, The object can be recognized based on the information and the coordinate information by the touch.

According to another aspect of the present invention, there is provided a display device including a display panel, a touch sensor, a plurality of light emitting elements arranged along a periphery of the display panel to irradiate light to the inside of the peripheral portion, A method of recognizing an object performed by a display device including a device includes the steps of sensing coordinate information by sensing for the object according to light emission information of the light emitting device and light receiving information of the light receiving device, Determining that an object recognition event has occurred and collecting the coordinate information by the sensing as shape information of the object if the object recognition event is not changed for a predetermined time; Based on the shape information and the coordinate information by the touch, A may include the step of recognizing.

According to the embodiment of the present invention, the object is sensed according to the light transmission characteristic on the display panel to collect shape information, and the object is recognized based on the touch information of the object and the collected shape information on the display panel .

Therefore, even if the object does not have dedicated equipment such as a touch unit made of an electrostatic-change inducing material, the object can be recognized by the display device.

Further, in the case of an object having a touch unit or the like, conventionally, the display unit recognizes the touch unit. However, the present invention can be applied to an electrostatic charge induction material Of the weight or the capacity of the sample.

For example, in the case of a smart phone, since the display device can grasp the case where the display window is in contact with the display panel and the case where the case is in contact with the display panel, Can be provided.

In addition, since the object is recognized by using the light transmission characteristic at the upper part of the display panel in addition to the touch detection using the display panel, the accuracy of object recognition is improved when compared with the case of recognizing the object only by touch sensing using the display panel .

1 is a view showing a stacked structure of a display unit and an optical unit constituting a display device according to a first embodiment of the present invention.
2 is a view illustrating a stacked structure of a display unit, an optical unit, and an additional optical unit included in a display device according to a second embodiment of the present invention.
3 is a block diagram of a display device according to a second embodiment of the present invention.
4 is a flowchart illustrating an object recognition method performed in a display device according to an embodiment of the present invention.
5 is a graph showing a change in capacitance due to a change in a contact surface between a display panel and an object in a display device according to an exemplary embodiment of the present invention.
6 is a graph showing a change in capacitance due to weight variation of an object in a display device according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims.

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The following terms are defined in consideration of the functions in the embodiments of the present invention, which may vary depending on the intention of the user, the intention or the custom of the operator. Therefore, the definition should be based on the contents throughout this specification.

BRIEF DESCRIPTION OF DRAWINGS FIG. 1 is a view showing a laminated structure of a display section and an optical section constituting a display apparatus according to a first embodiment of the present invention, wherein (a) is a perspective view and (b) is a sectional view. FIG. 2 is a view showing a laminated structure of a display portion, an optical portion and a further optical portion constituting a display device according to a second embodiment of the present invention, wherein FIG. 2A is a perspective view and FIG. 3 is a block diagram of a display device according to a second embodiment of the present invention.

First, comparing the first embodiment shown in Fig. 1 with the second embodiment shown in Fig. 2, the first embodiment includes a single optical section 120, while the second embodiment includes the optical section 120 and the additional optics 140. [ The other components are the same as those of the first embodiment and the second embodiment, and the following description will focus on the second embodiment.

A display unit according to an embodiment of the present invention includes a display unit 110, an optical unit 120, a frame unit 130, an additional optical unit 140, a control unit 150, a storage unit 160, (Not shown). The display unit 110 includes a display panel 111 and a touch sensor 112.

The display panel 111 displays an image according to a control signal of the controller 150. For example, the display panel 111 may be a flat panel display device using a liquid crystal display (LCD), an organic light emitting diode (OLED), or the like.

The touch sensor 112 senses the touch of the object with respect to the display panel 111 and provides the sensed value of the touch to the control unit 150. For example, the touch sensor 112 may be implemented as a touch screen that is disposed on the upper surface of the display panel 111 and measures a capacitance that is changed by a touch.

The optical section 120 includes a plurality of light emitting elements and a plurality of light receiving elements. The plurality of light emitting elements are arranged along the periphery of the display panel 111 to irradiate light to the inside of the peripheral portion, and the plurality of light receiving elements are arranged along the peripheral portion of the display panel 111, do. For example, when one light emitting element is disposed on one side of the periphery of the display panel 111, the corresponding light emitting element may be disposed on the opposite side of the periphery of the display panel. The arrangement of the light emitting device and the light receiving device is repeatedly performed at a predetermined distance. When the path of the light emitted from the light emitting devices and the path of the light received by the light receiving devices are displayed on the virtual surface, Such as the touch coordinates of the sensing area.

The frame part 130 is provided between the periphery of the display panel 111 and the optical part 120. Here, if the touch sensor 112 is implemented as a touch screen and disposed on the upper surface of the display panel 111, the frame unit 130 is installed between the periphery of the touch sensor 112 and the optical unit 120. The frame part 130 serves to make the light emitting element and the light receiving element constituting the optical part 120 to be spaced from the display panel 111 by a predetermined distance.

The additional optical section 140 is disposed on the optical section 120 and includes a plurality of light emitting elements and a plurality of light receiving elements. The additional optical unit 140 irradiates light to the inside of the display panel 111, like the optical unit 120, and the light receiving element receives the light irradiated by the light emitting element. Although only one additional optical section 140 is shown in FIG. 2, a plurality of additional optical sections 140 may be stacked on top of the optical section 120.

The coordinate information by the sensing of the object performed by the optical unit 120 and the additional optical unit 140 and the coordinate information by the touch sensed by the touch sensor 112 correspond to a plurality of objects respectively in the storage unit 160 . That is, the object-specific reference information is stored in a form including coordinate information by sensing and coordinate information by touch. For example, in the storage unit 160, an ID (Identification) assigned to a specific object, coordinate information by sensing to identify a specific object, and coordinate information by touch can be stored in a one-to-one correspondence. For example, the storage unit 160 may be implemented as a nonvolatile memory device such as an EEPROM (Electrically Erasable Programmable Read-Only Memory).

The tilt sensor unit 170 measures the tilt of the display panel 111 and provides the measured tilt value to the controller 150. For example, the tilt sensor unit 170 may be implemented as an inertial sensor.

The control unit 150 controls the display unit 110, the optical unit 120, and the additional optical unit 140. The control unit 150 determines whether the object is recognized according to the tilt value of the display panel 111 measured by the tilt sensor unit 170. For example, when the inclination value of the display panel 111 is included in the set range and can be regarded as a horizontal state, it can be determined that the object is being operated in the form of a table top so that object recognition can be performed.

The control unit 150 converts the coordinate information by the object placed on the display panel 111 into the object information according to the light emission information of the light emitting element and the light receiving information of the light receiving element constituting the optical unit 120 and the additional optical unit 140 As shown in FIG. In addition, the controller 150 grasps the coordinate information on the touch of the display panel 111 by the object according to the sensed value of the touch sensor 112, and based on the collected shape information and the coordinate information by touch, And recognizes the object placed on the display panel 111.

The control unit 150 receives the light emission information of the light emitting element and the light receiving information of the light receiving element from the optical unit 120 and the additional optical unit 140 and receives a plurality of Acquires shape information, and recognizes and grasps the object in three dimensions based on a plurality of shape information and coordinate information by touch. The control unit 150 grasps the coordinate information by sensing the optical unit 120 and the additional optical unit 140 and grasps coordinate information by touching the display panel 111 through the touch sensor 112 The coordinate information by sensing and the coordinate information by touch are compared with the reference information for each object stored in the storage unit 160 and the object placed on the display panel 111 is recognized according to the comparison result. In addition, when the same object is recognized a plurality of times, the control unit 150 can grasp a difference in weight or capacity of a substance contained in the same object according to the touch intensity or the capacitance detected by the touch sensor 112 . That is, the control unit 150 can determine the weight or the capacity of the substance contained in the object based on the touch intensity or the capacitance detected by the touch sensor 112. The controller 150 may determine the type of contact surface of the object with respect to the display panel 111 according to the capacitance of the object recognized by the touch sensor 112. [ For example, the control unit 150 may be implemented by a processor such as a CPU (Central Processing Unit).

4 is a flowchart illustrating an object recognition method performed in a display device according to an embodiment of the present invention.

As described above, the object recognition method according to an embodiment of the present invention includes steps S201 to S205 of detecting an object on a display panel when it is determined that the object is horizontal according to a measured tilt value after measuring a tilt of the display panel, .

Then, based on the light emission information of the light emitting element and the light receiving information of the light receiving element, if the sensing coordinate is not changed for a predetermined time after the object is sensed, it is determined that an object recognition event has occurred and the sensing coordinates are collected And activating the touch sensor (S207 to S213).

The method further includes steps (S215 and S217) of grasping coordinate information on the touch based on the sensed value of the touch sensor.

Next, the method further includes a step (S219 and S221) of recognizing the object based on the shape information of the object and the coordinate information by touching. Here, the object can be recognized according to the result of comparison between the coordinate information by sensing, the coordinate information by touch, and the reference information for each object previously set corresponding to a plurality of objects. In addition, when the same object is recognized a plurality of times, it is possible to grasp a difference in weight or capacity of a substance contained in the same object according to the touch intensity or the capacitance detected by the touch sensor. That is, the weight or the capacity of the substance contained in the object can be grasped based on the touch intensity or the electrostatic capacity sensed by the touch sensor. Also, depending on the capacitance of the object sensed by the touch sensor, the kind of the contact surface of the object with respect to the display panel can be grasped.

Hereinafter, an object recognition method performed in the display device according to the embodiment of the present invention will be described in detail with reference to FIG. 1 to FIG.

First, the tilt sensor 170 measures the tilt of the display panel 111 and then transmits the measured tilt value to the controller 150 (S201). Then, the controller 150 determines whether the display panel 111 is in a horizontal state by comparing the measured slope value with a preset slope range (S203). When the horizontal state of the display panel 111 is confirmed, the controller 150 recognizes that the display device is being operated in the form of a table top, and recognizes the operation of the display panel 111 through the optical unit 120 and the additional optical unit 140. [ It is searched whether or not the object is laid on it (S205). These steps S201 to S205 are performed in order to distinguish between the case of operating in a table top mode and the case of not operating in a table top mode when the display device needs to recognize an object only when the display device is operating in a table top form . That is, steps S201 and S203 may not be performed if the object is always recognized regardless of whether the object is operated in any form.

The optical unit 120 and the additional optical unit 140 driven by the control unit 150 drive the plurality of light emitting devices and the plurality of light receiving devices to sense whether an object is placed on the display panel 111 . When the light emitting device emits light and irradiates the light, if the object is not positioned on the optical path to which the light is irradiated, the light must be received by the light receiving device corresponding to the light emitting device. However, when an object is placed on the display panel 111 and the light path is blocked, light is not received by the corresponding light receiving element. If the light emitted from the light emitting element is not received by the light receiving element that is paired with the light emitting element, the object is sensed (S207).

The control unit 150 grasps the coordinate information on which the object is sensed based on the light emission information of the light emitting element and the light receiving information of the light receiving element by the optical unit 120 and the additional optical unit 140, If the sensing coordinates are not changed (S209), it is determined that an object recognition event has occurred. If the path of the light emitted from the light emitting elements of the optical unit 120 and the additional optical unit 140 and the path of the light received by the light receiving elements are all displayed on the virtual surface, The control unit 150 can grasp the sensing coordinates of the object because it has a lattice structure that can express the sensing area as coordinates. In addition, it is determined that an object recognition event occurs when the sensing coordinates are not changed within a preset time, even when the user performs an action such as touch input, the sensing by the optical unit 120 and the additional optical unit 140 (S211).

Here, the controller 150 collects the coordinate information of the object sensed by the optical unit 120 or the additional optical unit 140 as shape information. When the light emitting device emits light and irradiates the light, if the object is not positioned on the optical path to which the light is irradiated, the light must be received by the light receiving device corresponding to the light emitting device. However, when an object is placed on the display panel 111 and the light path is blocked, light is not received by the corresponding light receiving element. Accordingly, when the control unit 150 collects the coordinate information in which the light path is blocked, the shape of the object can be grasped. In addition, when all the coordinate information of the object sensed by the optical unit 120 and the additional optical unit 140 is used, a plurality of shape information about the height direction of the object is collected when compared with the case of using only the optical unit 120 Since the shape of the upper part can be grasped, the shape of the object can be grasped and recognized more stereoscopically.

The control unit 150 determines that an object recognition event has occurred and controls the touch sensor 112 to activate the touch sensor 112 in step S213. The activated touch sensor 112 detects a touch on the display panel 111, To the control unit 150 (S215).

Then, the control unit 150 grasps the coordinate information by touching the object based on the sensed value by the touch sensor 112. At this time, the control unit 150 grasps the coordinate information by touching the same or similar principle as that used for grasping the touch coordinates in a normal touch screen (S217).

Then, the controller 150 recognizes the object based on the shape information of the object detected in the object sensing process in step S207 and the coordinate information on the touch detected in step S217. Here, the control unit 150 grasps the contact surface shape and the contact area of the object contacted to the display panel 111 based on the coordinate information by touch detected in step S217, and compares the shape of the object identified in step S207 Dimensional information, and the object can be recognized based on the three-dimensional information.

In addition, the control unit 150 can recognize the object more accurately by using the preset reference information for each object in the storage unit 160. [ The coordinate information by the sensing of the optical unit 120 or the additional optical unit 140 and the coordinate information by the touch of the touch sensor 112 are registered and stored in advance in the storage unit 160 corresponding to a plurality of objects . Here, the controller 150 compares coordinate information by sensing in step S207 and coordinate information by touch sensing in step S215 with a plurality of object-specific reference information stored in the storage unit 160 (S219) Selects matching or nearest object-specific reference information from the reference information, and recognizes the registered object corresponding to the selected object-specific reference information as an object sensed in step S207 (S221).

For example, a table including a plurality of object-specific reference information may be registered and stored in the storage unit 160 as shown in Table 1 below. Table 1 shows object-by-object reference information for two objects, but the number of objects can be increased as needed.

Object name Sensing area Touch Strength Sensing area coordinates Capacitance data Water cup 28 13 (111, 222) 13 (112, 222) 14 ... ... Smartphone 72 33 (111, 222) 32 (112, 222) 34 ... ...

For example, as shown in Table 1, it is possible to store, in the sensing area field, object-by-object reference information that can be compared with the number of coordinates at which the object is sensed in step S207, and to compare the sensed- The per-object reference information can be stored in the touch strength field. In the sensing area coordinate field, all the coordinate information sensed in step S207 can be stored. In the capacitance data field, the electrostatic capacitance value of all the coordinates sensed in step S217 can be stored.

Here, the controller 150 compares the reference information for each object of the sensing area field and the touch strength field with the coordinate information by sensing in step S207 and the coordinate information by touch sensing in step S215, and recognizes the object can do. Alternatively, the sensing area field, the touch intensity field, the sensing area coordinate field, and the capacitance data field are all compared with the coordinate information by sensing in step S207 and the coordinate information by touch sensing in step S215, Can be recognized. In case of recognizing an object by comparing only a part of fields, it is possible to perform indexing relatively fast compared to recognition of an object by comparing all the fields. In addition, in the case of recognizing an object by comparing all the fields, it is possible to improve the accuracy of recognizing the object relatively more than the case of recognizing the object by comparing only some fields.

The controller 150 determines the type of contact surface of the object with respect to the display panel 111 based on the touch intensity detected by the touch sensor 112 and the information about the object recognized in step S221 .

For example, in the case of a smartphone, capacitance values are measured differently when the display window is in contact with the display panel 111 and when the case is in contact with the display panel 111. [ 5A, if the capacitance value is not measured in a specific sensing area, the controller 150 determines that the case of the smartphone is in contact with the display panel 111 I understand. 5 (b), it is determined that the display window of the smartphone is in contact with the display panel 111 when the capacitance value is measured in a specific sensing area.

In addition, the control unit 150 can determine the weight of the substance contained in the object based on the touch intensity detected by the touch sensor 112 and the information about the object recognized in step S221, as detected in step S215.

For example, when the recognition results for a plurality of objects are all water cups, capacitance values are measured differently depending on the volume of water contained in the water cups. 6 (b), when the capacitance value is measured in the sensing area as shown in FIG. 6 (a), the controller 150 determines that the capacitance value of the water cup It is judged that the weight is light, so that the amount of water in the water cup is relatively small. When the electrostatic capacitance value is measured as shown in FIG. 6 (b), it is determined that the weight of the water cup is heavier than the case where the electrostatic capacitance value is measured as shown in FIG. 6 (a) do.

As described above, according to the embodiment of the present invention, the shape information is collected by sensing the object according to the optical transmission characteristics on the display panel, and based on the touch information of the object and the grasped shape of the object on the display panel , And recognizes the object.

Therefore, even if the object does not have dedicated equipment such as a touch unit made of an electrostatic-change inducing material, the object can be recognized by the display device.

Further, in the case of an object having a touch unit or the like, conventionally, the display unit recognizes the touch unit. However, the present invention can be applied to an electrostatic charge induction material Of the weight or the capacity of the sample.

For example, in the case of a smart phone, since the display device can grasp the case where the display window is in contact with the display panel and the case where the case is in contact with the display panel, Can be provided.

In addition, by recognizing an object using up to the light transmission characteristic at the upper part of the display panel in addition to the touch sensing using the display panel, accuracy of object recognition is improved as compared with recognition of an object only by touch sensing using a display panel.

Combinations of the steps of each flowchart attached to the present invention may be performed by computer program instructions. These computer program instructions may be loaded into a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus so that the instructions, which are executed via a processor of a computer or other programmable data processing apparatus, Lt; / RTI > These computer program instructions may also be stored in a computer usable or computer readable memory capable of directing a computer or other programmable data processing apparatus to implement the functionality in a particular manner so that the computer usable or computer readable memory It is also possible to produce manufacturing items that contain instruction means for performing the functions described in each step of the flowchart. Computer program instructions may also be stored on a computer or other programmable data processing equipment so that a series of operating steps may be performed on a computer or other programmable data processing equipment to create a computer- It is also possible for the instructions to perform the processing equipment to provide steps for executing the functions described in each step of the flowchart.

In addition, each step may represent a module, segment, or portion of code that includes one or more executable instructions for executing the specified logical function (s). It should also be noted that in some alternative embodiments, the functions mentioned in the steps may occur out of order. For example, the two steps shown in succession may in fact be performed substantially concurrently, or the steps may sometimes be performed in reverse order according to the corresponding function.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

The present invention can be applied to a technology for recognizing an object placed on a display panel in a tabletop display device including a display panel for a large table top interface.

110: display unit 111: display panel
112: touch sensor 120: optical part
130: frame part 140: additional optical part
150: control unit 160:
170: tilt sensor unit

Claims (13)

A display unit having a display panel and a touch sensor,
An optical portion having a plurality of light emitting elements arranged along a peripheral portion of the display panel and emitting light to the inside of the peripheral portion and a plurality of light receiving elements for receiving light emitted by the light emitting element;
And a control unit for controlling the display unit and the optical unit,
Wherein,
The coordinate information by the sensing of the object is grasped according to the light emission information of the light emitting element and the light receiving information of the light receiving element and it is judged that the object recognition event occurs when the coordinate information by the sensing is not changed for a predetermined time Acquiring the coordinate information by the sensing as shape information of the object, grasping coordinate information by touch according to the sensed value of the touch sensor, calculating the coordinate information by the touch based on the shape information and the coordinate information by touch Recognizable
Display device.
The method according to claim 1,
And a frame portion provided between the peripheral portion of the display panel and the optical portion so that the light emitting element and the light receiving element are spaced from the display panel by a predetermined distance
Display device.
3. The method according to claim 1 or 2,
Wherein an additional optical portion including a plurality of light emitting elements and a plurality of light receiving elements is disposed on the optical portion
Display device.
The method of claim 3,
Wherein the control unit collects a plurality of shape information about a height direction of the object from the optical unit and the additional optical unit and recognizes the object based on the plurality of shape information and the coordinate information by touch
Display device.
The method according to claim 1,
The control unit recognizes the object according to a result of comparison between the coordinate information by the sensing, the coordinate information by the touch, and reference information for each object previously set corresponding to a plurality of objects
Display device.
6. The method of claim 5,
The control unit may determine the weight or capacity of the substance contained in the object according to the touch intensity or electrostatic capacity sensed by the touch sensor
Display device.
6. The method of claim 5,
The controller may determine the type of contact surface of the object with respect to the display panel according to the capacitance of the object sensed by the touch sensor
Display device.
The method according to claim 1,
And a tilt sensor unit for measuring a tilt of the display panel,
The control unit determines whether the object is recognized according to a tilt value measured by the tilt sensor unit
Display device.
A display device comprising a display panel, a touch sensor, a plurality of light emitting elements arranged along a periphery of the display panel to irradiate light to the inside of the peripheral portion, and a plurality of light receiving elements for receiving light emitted by the light emitting element A method for recognizing an object to be performed,
The coordinate information by the sensing of the object is grasped according to the light emission information of the light emitting element and the light receiving information of the light receiving element, and when the coordinate information by the sensing does not change for a predetermined time, Collecting coordinate information by the sensing as shape information of the object,
Determining coordinate information by touch according to the sensing value of the touch sensor;
And recognizing the object based on the shape information and the coordinate information by the touch
Object recognition method.
10. The method of claim 9,
The step of recognizing the object may include recognizing the object according to a result of comparison between the coordinate information by the sensing, the coordinate information by the touch, and the reference information for each object previously set corresponding to a plurality of objects
Object recognition method.
11. The method of claim 10,
The step of recognizing the object may include sensing a weight or a capacity of the material contained in the object according to the touch intensity or capacitance detected by the touch sensor
Object recognition method.
11. The method of claim 10,
The step of recognizing the object may include determining a type of the contact surface of the object with respect to the display panel according to the capacitance of the object sensed by the touch sensor
Object recognition method.
10. The method of claim 9,
Further comprising the step of determining whether the object is recognized according to the measured slope value after measuring the slope of the display panel
Object recognition method.

Images