WO2021085692A1

WO2021085692A1 - Electronic pen and electronic pen system having same

Info

Publication number: WO2021085692A1
Application number: PCT/KR2019/014680
Authority: WO
Inventors: 윤창걸; 김영환; 김정태; 소영준; 윤성훈; 임유두; 황효균
Original assignee: 엘지전자 주식회사
Priority date: 2019-11-01
Filing date: 2019-11-01
Publication date: 2021-05-06

Abstract

The present invention relates to an electronic pen and an electronic pen system having same. An electronic pen, according to one embodiment of the present invention, comprises: a case; a pen tip disposed at one end of the case and having one end exposed to the outside; an optical output module, disposed in the case, for outputting light through the pen tip; an optical sensor, disposed in the case, for sensing, through the pen tip, received light corresponding to the light outputted from the optical output module; an inertia sensor module, disposed in the case, for sensing movement; an input button disposed on the case; a pressure sensor for sensing a pressure of the input button; and a communication unit, disposed in the case, for exchanging data with an external electronic device. Due to this feature, an optical pen mode and a pointing mode can be implemented.

Description

Electronic pen and electronic pen system having the same

The present invention relates to an electronic pen and an electronic pen system including the same, and more particularly, to an electronic pen capable of performing an optical pen mode and a pointing mode, and an electronic pen system including the same.

The electronic pen has a pen shape and is a device used to input characters or images corresponding to movement of the electronic pen when writing on a display such as a mobile terminal.

The electronic pen method may be classified into a pressure-sensitive type, a capacitive type, an Electro Magnetic Resonance (EMR) method that does not require a separate power source, and an active electrostatic solution (AES) method using an internal power source.

On the other hand, in the case of Korean Patent Laid-Open No. 10-2018-0011730 (hereinafter, referred to as'prior literature'), an electromagnetic resonance type electronic pen is disclosed.

On the other hand, an electronic pen such as the prior literature only performs handwriting on a display such as a mobile terminal, and there is a problem in that handwriting recognition is not possible when displayed outside of the mobile terminal.

An object of the present invention is to provide an electronic pen capable of performing an optical pen mode and a pointing mode, and an electronic pen system including the same.

An object of the present invention is to provide an electronic pen capable of writing in a pen mode even when it is out of a display area, and an electronic pen system including the same.

The electronic pen according to an embodiment of the present invention for achieving the above object includes a case, a pen tip disposed at one end of the case, and one end exposed to the outside, and a pen tip disposed in the case, and outputting light through the pen tip. A light output module, an optical sensor disposed in the case and sensing received light corresponding to the light output from the light output module through a pen tip, an inertial sensor module disposed in the case and sensing motion, and on the case It includes an input button disposed, a pressure sensor sensing a pressure of the input button, and a communication unit disposed in the case and exchanging data with an external electronic device.

Meanwhile, in the pen mode, the communication unit may transmit the calculated coordinate information to the outside according to the operation of the optical output module and the optical sensor, and in the pointing mode, the inertial sensor module may transmit the calculated coordinate information to the outside.

Meanwhile, in the pen mode operation, when pairing with the first electronic device is not performed, the communication unit may perform pairing with the first electronic device.

Meanwhile, in the pen mode operation, when pairing with the first electronic device is not performed, the communication unit may transmit a pairing request signal to the first electronic device and receive a pairing response signal from the first electronic device.

Meanwhile, when pairing with the second electronic device is not performed during the pointing mode operation, the communication unit may perform pairing with the second electronic device.

Meanwhile, when pairing with the second electronic device is not performed during the pointing mode operation, the communication unit may transmit a pairing request signal to the second electronic device and receive a pairing response signal from the second electronic device.

Meanwhile, the electronic pen according to an embodiment of the present invention controls to operate in a pen mode when the level of the optical signal sensed by the optical sensor is higher than the reference level, and the level of the optical signal sensed by the optical sensor is below the reference level. In this case, it may further include a control unit that controls to operate in the pointing mode.

Meanwhile, the electronic pen according to an embodiment of the present invention further includes a control unit that controls to operate in a pen mode according to a first operation of an input button, and controls to operate in a pointing mode according to a second operation of the input button. Can include.

Meanwhile, the electronic pen according to an embodiment of the present invention controls to operate in a pen mode when a first sensing signal is received from a pressure sensor, and operates in a pointing mode when a second sensing signal is received from the pressure sensor. It may further include a control unit for controlling to be performed.

Meanwhile, the inertial sensor module may continuously sense motion information during the pen mode operation.

Meanwhile, the electronic pen according to an embodiment of the present invention may further include a control unit that controls to operate in a standby mode when there is no movement sensed by the inertial sensor module during a pointing mode or a pen mode operation.

Meanwhile, when the input button is pressed during the pointing mode operation, the communication unit may transmit motion information sensed by the inertial sensor module and input button operation information to the outside.

Meanwhile, when there is a signal sensed by the pressure sensor during the pointing mode operation, the communication unit may transmit motion information sensed by the inertial sensor module and sensing information of the pressure sensor to the outside.

Meanwhile, the communication unit may transmit level information of the signal sensed by the pressure sensor together with the motion information to the outside.

On the other hand, the electronic pen system according to an embodiment of the present invention includes a light output module that outputs light, an optical sensor that senses received light corresponding to light output from the light output module, and an inertial sensor module that senses motion. An electronic pen including, in a writing mode, a mobile terminal receiving coordinate information calculated based on information sensed by an optical sensor from the electronic pen, and in a pointing mode, motion information sansed by the inertial sensor module from the electronic pen It may include an image display device to receive.

Meanwhile, when pairing is not performed between the electronic pen and the mobile terminal during the pen mode operation, pairing is performed, and when pairing is performed between the electronic pen and the image display device during the pointing mode operation, pairing is performed. I can.

Meanwhile, in the handwriting mode, even when the electronic pen leaves the display of the mobile terminal, coordinate information calculated based on the information sensed by the optical sensor may be transmitted to the mobile terminal.

Meanwhile, when there is a signal sensed by the pressure sensor of the electronic pen during the pointing mode operation, the electronic pen transmits motion information sensed by the inertial sensor module and sensing information of the pressure sensor to the outside. Based on the information and the sensing information of the pressure sensor, the displayed object may be zoomed in or out, or the displayed image or the depth of the object may be varied.

Meanwhile, as the level of the sensing information of the pressure sensor increases, the image display device zooms in on the displayed object to increase the size of the object or increase the depth of the displayed image or object.

Meanwhile, when the input button is pressed during the pointing mode operation, the electronic pen transmits motion information sensed by the inertial sensor module and input button operation information to the image display device, and the image display device includes the motion information and the input button. Based on the motion information, the displayed object can be moved by dragging.

An electronic pen according to an embodiment of the present invention includes a case, a pen tip disposed at one end of the case and having one end exposed to the outside, a light output module disposed in the case, and outputting light through the pen tip, and a case An optical sensor disposed within the pen tip to sense received light corresponding to light output from the light output module, an inertial sensor module disposed within the case to sense movement, and an input button disposed on the case, A pressure sensor for sensing a pressure of an input button, and a communication unit disposed in the case and exchanging data with an external electronic device are included. Accordingly, it is possible to perform the optical pen mode and the pointing mode. Particularly, writing is possible in the pen mode even when it is out of the display area.

Meanwhile, in the pen mode, the communication unit may transmit the calculated coordinate information to the outside according to the operation of the optical output module and the optical sensor, and in the pointing mode, the inertial sensor module may transmit the calculated coordinate information to the outside. Accordingly, it is possible to perform the optical pen mode and the pointing mode. Particularly, writing is possible in the pen mode even when it is out of the display area.

Meanwhile, in the pen mode operation, when pairing with the first electronic device is not performed, the communication unit may perform pairing with the first electronic device. Accordingly, handwriting according to the pen mode operation is performed in the first electronic device.

Meanwhile, in the pen mode operation, when pairing with the first electronic device is not performed, the communication unit may transmit a pairing request signal to the first electronic device and receive a pairing response signal from the first electronic device. Accordingly, handwriting according to the pen mode operation is performed in the first electronic device.

Meanwhile, when pairing with the second electronic device is not performed during the pointing mode operation, the communication unit may perform pairing with the second electronic device. Accordingly, pointing according to the pointing mode operation is performed in the second electronic device.

Meanwhile, when pairing with the second electronic device is not performed during the pointing mode operation, the communication unit may transmit a pairing request signal to the second electronic device and receive a pairing response signal from the second electronic device. Accordingly, pointing according to the pointing mode operation is performed in the second electronic device.

Meanwhile, the electronic pen according to an embodiment of the present invention controls to operate in a pen mode when the level of the optical signal sensed by the optical sensor is higher than the reference level, and the level of the optical signal sensed by the optical sensor is below the reference level. In this case, it may further include a control unit that controls to operate in the pointing mode. Accordingly, it is possible to switch between the pen mode and the point mode.

Meanwhile, the electronic pen according to an embodiment of the present invention further includes a control unit that controls to operate in a pen mode according to a first operation of an input button, and controls to operate in a pointing mode according to a second operation of the input button. Can include. Accordingly, it is possible to switch between the pen mode and the point mode.

Meanwhile, the electronic pen according to an embodiment of the present invention controls to operate in a pen mode when a first sensing signal is received from a pressure sensor, and operates in a pointing mode when a second sensing signal is received from the pressure sensor. It may further include a control unit for controlling to be performed. Accordingly, it is possible to switch between the pen mode and the point mode.

Meanwhile, the inertial sensor module may continuously sense motion information during the pen mode operation. Accordingly, it is possible to switch between the pen mode and the point mode.

Meanwhile, the electronic pen according to an embodiment of the present invention may further include a control unit that controls to operate in a standby mode when there is no movement sensed by the inertial sensor module during a pointing mode or a pen mode operation. Accordingly, it operates in the standby mode, and power consumption can be reduced.

Meanwhile, when the input button is pressed during the pointing mode operation, the communication unit may transmit motion information sensed by the inertial sensor module and input button operation information to the outside. Accordingly, a drag operation in the pointing mode is possible.

Meanwhile, when there is a signal sensed by the pressure sensor during the pointing mode operation, the communication unit may transmit motion information sensed by the inertial sensor module and sensing information of the pressure sensor to the outside. Accordingly, it is possible to zoom in/zoom out and change the depth in the pointing mode.

Meanwhile, the communication unit may transmit level information of the signal sensed by the pressure sensor together with the motion information to the outside. Accordingly, it is possible to zoom in/zoom out and change the depth in the pointing mode.

On the other hand, the electronic pen system according to an embodiment of the present invention includes a light output module that outputs light, an optical sensor that senses received light corresponding to light output from the light output module, and an inertial sensor module that senses motion. An electronic pen including, in a writing mode, a mobile terminal receiving coordinate information calculated based on information sensed by an optical sensor from the electronic pen, and in a pointing mode, motion information sansed by the inertial sensor module from the electronic pen It may include an image display device to receive. Accordingly, it is possible to perform the optical pen mode and the pointing mode. Particularly, writing is possible in the pen mode even when it is out of the display area.

Meanwhile, when pairing is not performed between the electronic pen and the mobile terminal during the pen mode operation, pairing is performed, and when pairing is performed between the electronic pen and the image display device during the pointing mode operation, pairing is performed. I can. Accordingly, handwriting according to the pen mode operation is performed in the mobile terminal.

Meanwhile, in the handwriting mode, even when the electronic pen leaves the display of the mobile terminal, coordinate information calculated based on the information sensed by the optical sensor may be transmitted to the mobile terminal. Accordingly, even when the mobile terminal is out of the display area, writing is possible in the pen mode.

Meanwhile, when there is a signal sensed by the pressure sensor of the electronic pen during the pointing mode operation, the electronic pen transmits motion information sensed by the inertial sensor module and sensing information of the pressure sensor to the outside. Based on the information and the sensing information of the pressure sensor, the displayed object may be zoomed in or out, or the displayed image or the depth of the object may be varied. Accordingly, it is possible to zoom in/out or change the depth in the pointing mode.

Meanwhile, as the level of the sensing information of the pressure sensor increases, the image display device zooms in on the displayed object to increase the size of the object or increase the depth of the displayed image or object. Accordingly, it is possible to zoom in or increase the depth in the pointing mode.

Meanwhile, when the input button is pressed during the pointing mode operation, the electronic pen transmits motion information sensed by the inertial sensor module and input button operation information to the image display device, and the image display device includes the motion information and the input button. Based on the motion information, the displayed object can be moved by dragging. Accordingly, a drag operation in the pointing mode is possible.

1 is a diagram illustrating an electronic pen system according to an embodiment of the present invention.

2 is a diagram illustrating an electronic pen according to an embodiment of the present invention.

3 is an internal block diagram of the electronic pen of FIG. 2.

4A is a diagram illustrating a method of operating a pen mode of the electronic pen of FIG. 2.

4B is a diagram illustrating a method of operating a pointing mode of the electronic pen of FIG. 2.

5 to 11C are views referenced for explaining the operation of the electronic pen according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

* The suffixes "module" and "unit" for components used in the following description are given in consideration of only the ease of writing in the present specification, and do not impart a particularly important meaning or role by themselves. Therefore, the "module" and "unit" may be used interchangeably with each other.

Referring to the drawings, the electronic pen system 10 may include an electronic pen 100, an image display device (IMD), and a mobile terminal (MOB).

The electronic pen may be implemented in various ways, such as an electromagnetic resonance method, an active method, and a pressure-sensitive type. However, the electromagnetic resonance method, the active method, the pressure-sensitive type, etc., have a disadvantage in that the handwriting recognition cannot be performed smoothly when the display DS of the mobile terminal MOB is out of the way.

Accordingly, in the present invention, an optical-based electronic pen 100 is proposed.

To this end, the electronic pen 100 according to an embodiment of the present invention includes a case (CSE), a pen tip (PTP) that is disposed at one end of the case (CSE), and one end is exposed to the outside, and a case (CSE). The light output module 458 for outputting light through a pen tip (PTP), and a light output module 458 disposed in the case (CSE), corresponding to the light output from the light output module 458 through the pen tip (PTP) And an optical sensor 448 for sensing the received light.

Meanwhile, the electronic pen 100 according to an embodiment of the present invention is characterized in that a pointing mode is additionally performed in addition to the pen mode.

Accordingly, the electronic pen 100 according to an embodiment of the present invention includes an inertial sensor module IMU that is disposed in a case CSE and senses motion, and an input button BTN disposed on the case CSE. And, a pressure sensor TSS for sensing the pressure of the input button BTN, and a communication unit 420 disposed in the case CSE and exchanging data with an external electronic device. Accordingly, it is possible to perform the optical pen mode and the pointing mode. Particularly, writing is possible in the pen mode even when the display is out of the DS area.

For example, when the electronic pen 100 operates in the pen mode, the display DS of the paired mobile terminal MOB is displayed on the display DS of the paired mobile terminal MOB. Pictures, etc.) will be shown.

As another example, when the electronic pen 100 operates in the pointing mode, a pointer corresponding to the movement of the electronic pen 100 may be displayed on the display DIS of the paired image display device IMD. Accordingly, the pointing mode is performed.

Meanwhile, the display DIS of the image display device IMD may be implemented with any one of various panels. For example, the display DIS may be any one of a liquid crystal display panel (LCD panel), an organic light emitting panel (OLED panel), an inorganic light emitting panel (LED panel), and the like.

Meanwhile, the display DS of the mobile terminal MOB may be implemented with any one of various panels. For example, the display DS may be any one of a liquid crystal display panel (LCD panel), an organic light emitting panel (OLED panel), an inorganic light emitting panel (LED panel), and the like.

Meanwhile, the image display device (IMD) of FIG. 1 may be a monitor, a TV, a vehicle display device, and the like, and the mobile terminal (MOB) may be a tablet PC, a mobile phone, a smart phone, or the like.

Referring to the drawings, the electronic pen 100 according to an embodiment of the present invention includes a case (CSE) having a hollow formed at one end, and disposed at one end of the case (CSE) through the hollow, and one end is exposed to the outside. A pen tip PTP, a cap surrounding the other end of the pen tip PTP, and a second case RCS coupled to the other end of the case CSE may be included. Accordingly, the appearance of the electronic pen 100 can be formed.

Meanwhile, a button BTN for user manipulation may be formed on one surface of the case CSE.

The electronic pen 100 according to an embodiment of the present invention is an optical electronic pen, disposed in a case CSE, and an optical output module 458 that outputs light through a pen tip PTP, An optical sensor 448 disposed in the case CSE and sensing received light corresponding to the light output from the optical output module 458 through the pen tip PTP may be further provided.

Meanwhile, the electronic pen 100 according to an embodiment of the present invention is disposed in a case CSE for a pointing mode, an inertial sensor module IMU for sensing movement, and an inertial sensor module IMU disposed on the case CSE. It includes an input button BTN, a pressure sensor TSS for sensing the pressure of the input button BTN, and a communication unit 420 disposed in the case CSE and exchanging data with an external electronic device. Accordingly, it is possible to perform the optical pen mode and the pointing mode. Particularly, writing is possible in the pen mode even when the display is out of the DS area.

3 is an internal block diagram of the electronic pen of FIG. 2.

Referring to the drawings, the electronic pen 100 includes a wireless communication unit 420, a user input unit 435, a sensor unit 440, an output unit 450, a power supply unit 460, a storage unit 470, and a control unit. (480) may be included.

The wireless communication unit 420 may perform pairing with the mobile terminal MOB or the image display device IMD, and exchange data with the paired device.

In particular, the wireless communication unit 420 may transmit coordinate information or the like to a mobile terminal (MOB) or an image display device (IMD).

Meanwhile, the wireless communication unit 420 may include an RF module 421 capable of transmitting and receiving signals to and from an image display device (IMD) according to an RF communication standard.

Meanwhile, the wireless communication unit 420 may include an IR module 423 capable of transmitting and receiving signals to and from an image display device (IMD) according to an IR communication standard.

When operating in the pointing mode, the wireless communication unit 420 transmits information about the movement of the electronic pen 100 to the image display device (IMD) through the RF module 421.

When operating in the pen mode, the wireless communication unit 420 may transmit calculated coordinate information through the RF module 421 according to the operation of the light output module 458 and the light sensor 448.

Meanwhile, the wireless communication unit 420 may receive a signal transmitted from the image display device IMD through the RF module 421.

Meanwhile, the wireless communication unit 420 may transmit a command regarding power on/off, channel change, volume change, etc. to the image display apparatus IMD through the IR module 423 as needed.

The user input unit 435 may be composed of a keypad, a button, a touch pad, or a touch screen.

A user may input a command related to the electronic pen 100 by manipulating the user input unit 435.

For example, when the user input unit 435 includes a hard key button, the user may input a command related to the electronic pen 100 through a push operation of the hard key button.

The sensor unit 440 may include an electromagnetic sensor (EMS), an inertial sensor module (IMU), an optical module (OPU), a pressure sensor (TSS), and the like.

The electromagnetic sensor EMS may sense an electromagnetic field around it.

The inertial sensor module IMU is disposed in the case CSE and may sense movement of the electronic pen 100.

To this end, the inertial sensor module IMU may include a gyro sensor 441 or an acceleration sensor 443.

The gyro sensor 441 may sense information about movement of the electronic pen 100. For example, the gyro sensor 441 may sense information on the operation of the electronic pen 100 based on the x, y, and z axes.

The acceleration sensor 443 may sense information about a moving speed of the electronic pen 100 and the like.

The optical module (OPU) is disposed in the case (CSE), through the pen tip (PTP), the optical output module 458 that outputs light, and the optical module (OPU) is disposed in the case (CSE), through the pen tip (PTP), An optical sensor 448 for sensing received light corresponding to the light output from the output module 458 may be provided.

The pressure sensor TSS is disposed under the input button BTN disposed on the case CSE, and may sense the pressure of the input button BTN.

For example, in the pressure sensor TSS, the level of the signal sensed by the pressure sensor TSS may vary or the duty of the sensed signal may vary according to the force of the input button BTN.

The output unit 450 may output an image or audio signal corresponding to an operation of the user input unit 435 or a signal transmitted from the image display device (IMD). Through the output unit 450, the user may recognize whether the user input unit 435 is operated or whether the image display device IMD is controlled.

As an example, the output unit 450 is an LED module 451 that lights up when the user input unit 435 is manipulated or a signal is transmitted or received from the image display device (IMD) through the wireless communication unit 420, a vibration generating vibration A module 453, a sound output module 455 for outputting sound, or a display module 457 for outputting an image may be provided.

The power supply unit 460 supplies power to the inside of the electronic pen 100.

The power supply unit 460 may reduce power waste by stopping power supply when the electronic pen 100 has not moved for a predetermined period of time.

Meanwhile, the power supply unit 460 may resume power supply when a predetermined key provided in the electronic pen 100 is operated.

The storage unit 470 may store various types of programs and application data necessary for controlling or operating the electronic pen 100.

For example, when the electronic pen 100 is paired with an image display device (IMD) or a mobile terminal (MOB) and wirelessly transmits and receives a signal through the RF module 421, the electronic pen 100 displays an image. It transmits and receives signals to and from the device IMD or the mobile terminal MOB through a predetermined frequency band.

Meanwhile, the control unit 480 stores information on a frequency band through which signals can be transmitted and received wirelessly with an image display device (IMD) or mobile terminal (MOB) paired with the electronic pen 100, in the storage unit 470 And refer to it.

The controller 480 controls all items related to control of the electronic pen 100.

The control unit 480 transmits a signal corresponding to a predetermined key operation of the user input unit 435 or coordinate information or motion information sensed by the sensor unit 440 through the wireless communication unit 420, through a paired image display device (IMD) or It can be transmitted to a mobile terminal (MOB).

The user input interface unit (not shown) of the image display device (IMD) includes a wireless communication unit (not shown) capable of transmitting and receiving signals wirelessly with the electronic pen 100, and a pointer corresponding to the operation of the electronic pen 100 A coordinate value calculator (not shown) capable of calculating the coordinate value of may be provided.

The user input interface unit (not shown) may wirelessly transmit and receive signals with the electronic pen 100 through an RF module (not shown). In addition, a signal transmitted by the electronic pen 100 according to an IR communication standard may be received through an IR module (not shown).

On the other hand, the coordinate value calculation unit (not shown) corrects the hand shake or error from the received signal corresponding to the operation of the electronic pen 100 and displays the coordinate values (x,y) of the pointer 205 to be displayed on the display 180. ) Can be calculated.

The transmission signal of the electronic pen 100 input to the image display device IMD through the user input interface unit (not shown) is transmitted to the signal processing unit (not shown) of the image display device IMD. The signal processing unit (not shown) may determine information on an operation of the electronic pen 100 and key manipulation from a signal transmitted from the electronic pen 100 and control the image display device IMD in response thereto.

As another example, the electronic pen 100 may calculate a pointer coordinate value corresponding to the operation and output it to a user input interface unit (not shown) of the image display apparatus IMD. In this case, the user input interface unit (not shown) of the image display device IMD may transmit information on the received pointer coordinate value to the signal processing unit (not shown) without a separate hand shake or error correction process.

In addition, as another example, the coordinate value calculation unit (not shown) may be provided inside the signal processing unit (not shown) rather than the user input interface unit (not shown) unlike the drawing.

Referring to the drawings, during the pen mode operation, the optical sensor 448 senses received light corresponding to the light output from the output module 458.

Further, the controller 480 may perform control to calculate coordinate information based on the continuously received received light and transmit the calculated coordinate information to the paired mobile terminal MOB.

* Accordingly, the communication unit 425 transmits coordinate information according to the handwriting mode to the paired mobile terminal (MOB) through the RF module 421 or the like.

Accordingly, on the display DS of the mobile terminal MOB, characters such as "LG", which are handwritten contents, are displayed as shown in (a) of FIG. 4A.

On the other hand, as shown in (b) of FIG. 4A, even when the electronic pen 100 is out of the display DS of the mobile terminal MOB, the optical sensor 448 corresponds to the light output from the output module 458. The received light is sensed.

Accordingly, on the display DS of the mobile terminal MOB, characters such as "LG", which are handwritten contents, are displayed as shown in FIG. 4A(b).

Referring to the drawings, (a) of FIG. 4B illustrates that a pointer 205 corresponding to the electronic pen 100 is displayed on the display DIS.

The user may move or rotate the electronic pen 100 up and down, left and right (FIG. 4B (b)), and back and forth (FIG. 4B (c)). The pointer 205 displayed on the display DIS of the image display device corresponds to the movement of the electronic pen 100.

As shown in the drawing, since the corresponding pointer 205 is moved and displayed according to movement in 3D space, the electronic pen 100 may be referred to as a pointing device operating in a pointing mode.

4B (b) illustrates that when the user moves the electronic pen 100 to the left, the pointer 205 displayed on the display DIS of the image display apparatus IMD also moves to the left in response thereto.

Meanwhile, information on the movement of the electronic pen 100 sensed through the sensor of the electronic pen 100 is transmitted to the image display apparatus IMD through the wireless communication unit 420. The image display device IMD may calculate the coordinates of the pointer 205 from information about the movement of the electronic pen 100. The image display device IMD may display the pointer 205 to correspond to the calculated coordinates.

4B (c) illustrates a case in which a user moves the electronic pen 100 away from the display DIS while pressing a specific button in the electronic pen 100. Accordingly, the selection area in the display DIS corresponding to the pointer 205 may be zoomed in and displayed in an enlarged manner.

Conversely, when the user moves the electronic pen 100 closer to the display DIS, the selection area in the display DIS corresponding to the pointer 205 may be zoomed out and displayed in a reduced size. Meanwhile, when the electronic pen 100 moves away from the display DIS, the selection area is zoomed out, and when the electronic pen 100 approaches the display DIS, the selection area may be zoomed in.

On the other hand, when a specific button in the electronic pen 100 is pressed, recognition of vertical and horizontal movement may be excluded. That is, when the electronic pen 100 moves away from or approaches the display DIS, up, down, left, and right movements are not recognized, and only forward and backward movements may be recognized. When a specific button in the electronic pen 100 is not pressed, only the pointer 205 moves according to the movement of the electronic pen 100 up, down, left, and right.

Meanwhile, the moving speed or moving direction of the pointer 205 may correspond to the moving speed or moving direction of the electronic pen 100.

5A illustrates a pen mode operation of the electronic pen 100.

Referring to the drawings, when writing is performed on the display DS of the mobile terminal MOB according to the pen mode operation of the electronic pen 100, the communication unit 420 of the electronic pen 100 is in the pen mode. , According to the operation of the optical output module 458 and the optical sensor 448, the calculated coordinate information may be transmitted to the outside.

Accordingly, characters or pictures corresponding to handwriting according to the movement of the electronic pen 100 are displayed on the display DS of the mobile terminal MOB.

On the other hand, unlike the drawing, when writing is performed on the floor, while leaving the display DS of the mobile terminal MOB, the communication unit 420 of the electronic pen 100 may, in the pen mode, the optical output module According to the operation of 458 and the optical sensor 448, the calculated coordinate information may be transmitted to the outside.

Meanwhile, in the pen mode operation, when pairing with the mobile terminal MOB is not performed, the communication unit 420 may perform pairing with the mobile terminal MOB. Accordingly, handwriting according to the pen mode operation is performed in the mobile terminal MOB.

Meanwhile, the communication unit 420 transmits a pairing request signal to the mobile terminal MOB when pairing with the mobile terminal MOB is not performed during the pen mode operation, and receives a pairing response signal from the mobile terminal MOB. can do. Accordingly, handwriting according to the pen mode operation is performed in the mobile terminal MOB.

Meanwhile, the inertial sensor module IMU may continuously sense motion information during a pen mode operation. Accordingly, it is possible to switch between the pen mode and the point mode.

5B shows the pointing mode of the electronic pen 100.

Referring to the drawings, during the pen mode operation of the electronic pen 100, when the electronic pen 100 is lifted and the input button BTN is pressed, the electronic pen 100 may be switched to the pointing mode.

When the electronic pen 100 moves according to the pointing mode operation of the electronic pen 100, the communication unit 420 of the electronic pen 100 may, in the pointing mode, receive the calculated coordinate information in the inertial sensor module IMU. Can be transferred to the outside.

Meanwhile, when pairing with the image display device IMD is not performed during the pointing mode operation, the communication unit 420 may perform pairing with the image display device IMD. Accordingly, pointing according to the pointing mode operation is performed in the image display device IMD.

Meanwhile, the communication unit 420 transmits a pairing request signal to the image display device IMD when pairing with the image display device IMD is not performed during the pointing mode operation, and a pairing response from the image display device IMD Can receive signals. Accordingly, pointing according to the pointing mode operation is performed in the image display device IMD.

Meanwhile, the electronic pen 100 according to an embodiment of the present invention may operate in a standby mode when there is no movement sensed by the inertial sensor module IMU during a pointing mode or a pen mode operation. Accordingly, it operates in the standby mode, and power consumption can be reduced.

Meanwhile, when the input button BTN is pressed during the pointing mode operation, the communication unit 420 may transmit motion information sensed by the inertial sensor module IMU and operation information of the input button BTN to the outside. Accordingly, a drag operation in the pointing mode is possible.

Meanwhile, the communication unit 420 transmits motion information sensed by the inertial sensor module (IMU) and sensing information of the pressure sensor (TSS) to the outside when there is a signal sensed by the pressure sensor (TSS) during the pointing mode operation. I can. Accordingly, it is possible to zoom in/zoom out and change the depth in the pointing mode.

Meanwhile, the communication unit 420 may transmit level information of the signal sensed by the pressure sensor TSS to the outside together with the motion information. Accordingly, it is possible to zoom in/zoom out and change the depth in the pointing mode.

On the other hand, unlike FIG. 5B, when the level of the optical signal sensed by the optical sensor 448 is equal to or higher than the reference level, the electronic pen 100 operates in a pen mode, and is sensed by the optical sensor 448. When the level of the optical signal is less than or equal to the reference level, the pointing mode may be operated. Accordingly, it is possible to switch between the pen mode and the point mode.

Meanwhile, as shown in FIG. 6A, the electronic pen 100 may operate in a pen mode according to the first operation of the input button BTN.

Next, as shown in FIG. 6B, the electronic pen 100 may operate in the pointing mode according to the second operation of the input button BTN. Accordingly, it is possible to switch between the pen mode and the point mode.

The first operation of the input button BTN and the second operation of the input button BTN may be the same operation, and for example, the mode change may be performed by being toggled.

Alternatively, as shown in FIG. 6A, when the first sensing signal is received from the pressure sensor TSS, the electronic pen 100 may operate in a pen mode.

Meanwhile, as shown in FIG. 6B, when the second sensing signal is received from the pressure sensor TSS, the electronic pen 100 may operate in a pointing mode. Accordingly, it is possible to switch between the pen mode and the point mode.

At this time, the first sensing signal and the second sensing signal may be the same signal. Accordingly, mode switching may be performed according to a toggle input based on the same signal.

Meanwhile, the first sensing signal and the second sensing signal may be signals having at least one of different strength, duty, and number of signals.

7 is a diagram illustrating various modes of the electronic pen.

7(a) illustrates a pen mode in which the electronic pen 100 and the mobile terminal (MOB) contact, and FIG. 7(b) shows the electronic pen 100 and the mobile terminal (MOB) partially spaced apart. Illustrates the pen mode to be used.

On the other hand, Figure 7 (c) illustrates the standby mode.

When there is no movement sensed by the inertial sensor module IMU during pointing mode or pen mode operation, the electronic pen 100 according to an embodiment of the present invention, as shown in FIG. 7C. It is possible to operate in a standby mode. Accordingly, by operating in a standby mode, it is possible to reduce power consumption.

Meanwhile, (d) of FIG. 7 illustrates a pointing mode according to an operation of the input button BTN.

As shown in the figure, in the standby mode state, when the electronic pen 100 moves and there is an input signal according to the operation of the input button BTN, the controller 480 controls to end the standby mode and enter the pointing mode. can do.

On the other hand, Figure 7 (e) illustrates the operation of the pointing mode.

Meanwhile, in the pointing mode, the communication unit 420 may transmit coordinate information calculated by the inertial sensor module IMU to the outside. Accordingly, it is possible to display a pointer and move an object on the paired image display device IMD.

On the other hand, Fig. 7(f) illustrates a handwriting mode.

Meanwhile, during the pointing mode operation, when rewriting, the controller 480 may control to switch to the handwriting mode.

For example, the controller 480 controls the optical output module 458 and the optical sensor 448 to operate even during the pointing mode operation, and when the level of the optical signal sensed by the optical sensor 448 is below the reference level , You can control to continue operating in the pointing mode.

Meanwhile, during the pointing mode operation, when the level of the optical signal sensed by the optical sensor 448 is equal to or higher than the reference level, the controller 480 may control to switch to the pen mode.

Accordingly, when switching from the pointing mode to the pen mode, the controller 480 may control to terminate the pairing with the paired image display device IMD and perform pairing with the mobile terminal MOB.

And, after completing the pairing with the mobile terminal (MOB), according to the pen mode, the communication unit 420, according to the operation of the optical output module 458 and the optical sensor 448, the calculated coordinate information to the mobile terminal (MOB) Will be sent to.

8A to 9C are diagrams referred to for description of the pointing mode.

First, FIG. 8A is a diagram illustrating a plurality of objects that can be displayed on the image display device IMD by distinguishing them by depth.

As the depth increases, it may proceed from depth1 to depth N direction. It can be defined as increasing the depth as the distance increases from the user standard.

8B is a diagram illustrating objects from depth 0 to depth 3.

For example, in case of depth0, a first object UX0 may be displayed, in case of depth1, a second object UX1 may be displayed, and in case of depth2, a third object UX2 may be displayed. have.

Referring to FIG. 8B, when there is a signal sensed by the pressure sensor TSS during pointing mode operation, the communication unit 420 includes motion information sensed by the inertial sensor module IMU and sensing information of the pressure sensor TSS. Can be transferred to the outside.

In particular, the communication unit 420 may transmit level information of a signal sensed by the pressure sensor TSS to the outside together with the motion information. Accordingly, it is possible to zoom in/zoom out and change the depth in the pointing mode.

For example, when the first level information on the first pressure signal is transmitted from the pressure sensor TSS to the image display device IMD, the display DIS of the image display device IMD corresponds to depth0. The first object UX0 may be displayed.

As another example, when second level information corresponding to a second pressure signal having a higher pressure level than the first pressure signal from the pressure sensor TSS is transmitted to the image display device IMD, the image display device IMD The display DIS of may display the second object UX1 corresponding to depth1.

As another example, when third level information corresponding to a third pressure signal having a higher pressure level than the second pressure signal from the pressure sensor TSS is transmitted to the image display device IMD, the image display device IMD The display DIS of) may display the third object UX2 corresponding to depth2.

On the other hand, unlike FIG. 8B, depending on the level of level information corresponding to the pressure sensor TSS, it is possible to perform zoom-in or zoom-out rather than varying the depth.

That is, the image display device IMD may zoom in or out of a displayed object, or change a displayed image or depth of an object based on motion information and sensing information of the pressure sensor TSS. Accordingly, it is possible to zoom in/out or change the depth in the pointing mode.

Meanwhile, as the level of sensing information of the pressure sensor TSS increases, the image display device IMD may increase the size of the object or increase the depth of the displayed image or object by zooming in the displayed object. have. Accordingly, it is possible to zoom in or increase the depth in the pointing mode.

9A to 9C are diagrams referred to for describing object movement and the like in a pointing mode.

First, FIG. 9A illustrates selecting an object in a pointing mode.

Referring to the drawings, in the pointing mode, the communication unit 420 of the electronic pen 100 may transmit coordinate information calculated by the inertial sensor module IMU to the image display device IMD.

Accordingly, a pointer or the like may be displayed on the image display device IMD.

On the other hand, in the pointing mode, when the input button BTN of the electronic pen 100 is operated, the image display device IMD is displayed on the image display device IMD, as shown in FIG. 9A, based on coordinate information or the like. You can select a specific object (OBJ).

Next, FIG. 9B illustrates that the electronic pen 100 moves to the right while the input button BTN is pressed.

Accordingly, in the pointing mode, the communication unit 420 of the electronic pen 100 can transmit the calculated coordinate information and the input button BTN operation information to the image display device IMD in the inertial sensor module IMU. have.

The image display device IMD causes the selected object OHJ to be dragged to the right as shown in the drawing, based on coordinate information and operation information of the input button BTN. Accordingly, a drag operation in the pointing mode is possible.

Next, FIG. 9C illustrates a case where the pointer is moved to the boundary of the object.

The communication unit 420 of the electronic pen 100 may transmit coordinate information calculated by the inertial sensor module IMU to the image display device IMD in the pointing mode.

Meanwhile, the image display device IMD matches the coordinate information with the object, and when it is determined that the coordinate information of the pointer PT exists in the boundary area of the object, it displays guide information for reducing or expanding the object. I can.

On the other hand, when the input button BTN is operated, the communication unit 420 of the electronic pen 100, in the pointing mode, receives the calculated coordinate information and the input button BTN operation information in the inertial sensor module IMU. It can be transmitted to an image display device (IMD).

Accordingly, reduction or enlargement of the object may be selected, and as a result, the object OHJ may be reduced or enlarged.

10A (a) illustrates that the input button BTN of the electronic pen 100 is pressed.

FIG. 10A (b) illustrates that the input button BTN of the electronic pen 100 is pressed in one direction and the input button BTN moves in one direction.

10B shows an example of the structure of an input button.

A pressure sensor TSS may be disposed under the input button BTN, and a tact switch TSW may be disposed at one side of the pressure sensor TSS.

At this time, one side of the pressure sensor TSS may correspond to one direction of FIG. 10A(b).

The controller 480 of the electronic pen 100 may control to switch from the pen mode to the electronic pen mode when the input button BTN is pressed and moved in one direction.

Meanwhile, when the input button BTN is pressed during the pointing mode operation, the communication unit 420 may transmit motion information sensed by the inertial sensor module IMU and operation information of the input button BTN to the outside.

Meanwhile, when there is a signal sensed by the pressure sensor TSS during the pointing mode operation, the communication unit 420 transmits motion information sensed by the inertial sensor module IMU and sensing information of the pressure sensor TSS to the outside. I can. Accordingly, it is possible to zoom in/zoom out and change the depth in the pointing mode.

For example, when the force value of the signal sensed by the pressure sensor TSS increases, the depth in the pointing mode may increase.

As another example, when the force value of the signal sensed by the pressure sensor TSS is maintained, the depth in the pointing mode may be maintained.

As another example, when the force value of the signal sensed by the pressure sensor TSS decreases, the depth in the pointing mode may decrease.

Meanwhile, as the amount of movement in one direction increases while the input button BTN is pressed, the force value of the signal sensed by the pressure sensor TSS may increase.

As another example, when the input button BTN moves in a direction opposite to one direction while being pressed, a force value of a signal sensed by the pressure sensor TSS may be decreased.

11A is a flowchart illustrating an operation for varying the depth of an object according to a pointing mode in the electronic pen system.

Referring to the drawing, when the input button BTN of the electronic pen 100 is pressed and then operated in the first direction as shown in FIG. 10A(b) (S1112), a signal sensed by the pressure sensor TSS The force value of righteousness increases (S1113).

Meanwhile, the communication unit 420 may transmit level information of the signal sensed by the pressure sensor TSS to the outside together with the motion information.

Accordingly, the image display device IMD may increase the depth of the displayed object according to the level information of the signal sensed by the pressure sensor TSS (S1114). For example, UX2 of FIG. 8B may be displayed.

When the input button BTN of the electronic pen 100 is pressed and then operated in a second direction opposite to the first direction (S1115), as shown in FIG. 10A(b), sensed by the pressure sensor TSS The force value of the signal may decrease (S1116).

Meanwhile, the communication unit 420 may transmit level information of a signal sensed by the pressure sensor TSS to the outside together with the motion information.

Accordingly, the image display device IMD may reduce the depth of the displayed object according to the level information of the signal sensed by the pressure sensor TSS (S1117). For example, UX0 of FIG. 8B may be displayed.

11B is a flowchart illustrating an operation for zooming in or out of an object according to a pointing mode in the electronic pen system.

Referring to the drawing, when the input button BTN of the electronic pen 100 is pressed and then operated in the first direction as shown in FIG. 10A(b) (S1122), a signal sensed by the pressure sensor TSS The force value of righteousness increases (S1123).

Accordingly, the image display device IMD may zoom in the displayed object according to the level information of the signal sensed by the pressure sensor TSS (S1124).

When the input button BTN of the electronic pen 100 is pressed and then operated in a second direction opposite to the first direction (S1125), as shown in (b) of FIG. 10A, sensed by the pressure sensor TSS The force value of the signal may decrease (S1126).

Accordingly, the image display device IMD may zoom out the displayed object according to the level information of the signal sensed by the pressure sensor TSS (S1127).

11C is a flowchart illustrating an operation of displaying a menu according to a pointing mode in the electronic pen system.

Referring to the drawing, when the input button BTN of the electronic pen 100 is pressed and then operated in the first direction as shown in FIG. 10A(b) (S1132), a signal sensed by the pressure sensor TSS The force value of significance is maintained (S1133).

Accordingly, the image display device IMD may maintain the depth of the displayed object according to the level information of the signal sensed by the pressure sensor TSS (S1134).

In addition, the image display device IMD may point to a menu (S1135).

Next, when the input button BTN of the electronic pen 100 is pressed and then operated in a second direction opposite to the first direction (S1136), as shown in FIG. 10A(b), the communication unit 420, Level information of a signal sensed by the pressure sensor TSS may be transmitted to the outside together with motion information.

Accordingly, the image display device IMD may execute an operation corresponding to a predetermined item in the displayed menu according to the level information of the signal sensed by the pressure sensor TSS (S1137).

In the above, preferred embodiments of the present invention have been illustrated and described, but the present invention is not limited to the specific embodiments described above, and the present invention is generally in the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. Various modifications are possible by those skilled in the art of course, and these modifications should not be individually understood from the technical idea or perspective of the present invention.

Claims

case;

A pen tip disposed at one end of the case and having one end exposed to the outside;

A light output module disposed in the case and outputting light through the pen tip;

An optical sensor disposed in the case and sensing a received light corresponding to the light output from the optical output module through the pen tip;

An inertial sensor module disposed in the case and sensing movement;

An input button disposed on the case;

A pressure sensor sensing the pressure of the input button;

And a communication unit disposed in the case and exchanging data with an external electronic device.
The method of claim 1,

The communication unit,

In the pen mode, according to the operation of the optical output module and the optical sensor, the calculated coordinate information is transmitted to the outside,

In a pointing mode, the inertial sensor module transmits the calculated coordinate information to the outside.
The method of claim 1,

The communication unit,

In the pen mode operation, when pairing with the first electronic device is not performed, the electronic pen performs pairing with the first electronic device.
The method of claim 3,

The communication unit,

During the pen mode operation, when pairing with the first electronic device is not performed, an electronic pen that transmits a pairing request signal to the first electronic device and receives a pairing response signal from the first electronic device .
The method of claim 1,

The communication unit,

When the pointing mode is operated, when pairing with the second electronic device is not performed, the electronic pen performs pairing with the second electronic device.
The method of claim 5,

The communication unit,

When in the pointing mode operation, when pairing with the second electronic device is not performed, the electronic pen transmits a pairing request signal to the second electronic device and receives a pairing response signal from the second electronic device .
The method of claim 1,

A controller configured to operate in a pen mode when the level of the optical signal sensed by the optical sensor is greater than or equal to the reference level, and control to operate in a pointing mode when the level of the optical signal sensed by the optical sensor is less than the reference level; Electronic pen, characterized in that it further comprises.
The method of claim 1,

And a controller configured to control to operate in a pen mode according to a first operation of the input button, and to operate in a pointing mode according to a second operation of the input button.
The method of claim 1,

The pressure sensor further comprises a controller configured to operate in a pen mode when a first sensing signal is received, and a controller configured to operate in a pointing mode when a second sensing signal is received from the pressure sensor. Electronic pen.
The method of claim 1,

The inertial sensor module is an electronic pen, characterized in that, during a pen mode operation, continuously senses motion information.
The method of claim 1,

And a controller configured to control to operate in a standby mode when there is no movement sensed by the inertial sensor module during a pointing mode or a pen mode operation.
The method of claim 1,

The communication unit,

When the input button is pressed during pointing mode operation, the motion information sensed by the inertial sensor module and the input button operation information are transmitted to the outside.
The method of claim 1,

The communication unit,

When there is a signal sensed by the pressure sensor during pointing mode operation, the motion information sensed by the inertial sensor module and the sensing information of the pressure sensor are transmitted to the outside.
The method of claim 13,

The communication unit,

Electronic pen, characterized in that for transmitting the level information of the signal sensed by the pressure sensor to the outside together with the motion information.
An electronic pen including a light output module for outputting light, a light sensor for sensing received light corresponding to light output from the light output module, and an inertial sensor module for sensing movement;

A mobile terminal receiving coordinate information calculated based on information sensed by the optical sensor from the electronic pen in the handwriting mode;

And an image display device receiving motion information sansed by the inertial sensor module from the electronic pen in the pointing mode.
The method of claim 15,

During the pen mode operation, when the electronic pen and the mobile terminal are not paired, pairing is performed,

When the electronic pen and the image display device are not paired during the pointing mode operation, pairing is performed.
The method of claim 15,

In the handwriting mode, even when the electronic pen moves out of the display of the mobile terminal, the electronic pen system, wherein coordinate information calculated based on the information sensed by the optical sensor is transmitted to the mobile terminal.
The method of claim 15,

The electronic pen,

When there is a signal sensed by the pressure sensor of the electronic pen during the pointing mode operation, motion information sensed by the inertial sensor module and sensing information of the pressure sensor are transmitted to the outside,

The video display device,

The electronic pen system, characterized in that, based on the motion information and sensing information of the pressure sensor, zooming in or out of a displayed object, or changing a displayed image or a depth of the object.
The method of claim 18,

The video display device,

As the level of sensing information of the pressure sensor increases, the displayed object is zoomed in to increase the size of the object or the displayed image or the depth of the object.
The method of claim 15,

The electronic pen,

When an input button is pressed during the pointing mode operation, the motion information sensed by the inertial sensor module and the input button operation information are transmitted to the image display device,

The video display device,

The electronic pen system, characterized in that the object to be displayed is dragged and moved based on the motion information and the input button operation information.