WO2021167118A1 - Electronic pen and electronic pen system having same - Google Patents

Abstract

The present invention relates to an electronic pen and an electronic pen system having same. An electronic pen according to one embodiment of the present invention comprises: a case; a pen tip which is arranged at one end of the case, and which has one end exposed to the outside; an electromagnetic sensor which includes coils and capacitors and which changes the frequency or level of an inputted electromagnetic signal so as to output same to the outside; a light emission module which is arranged inside the case and which emits the light to the outside; an optical sensor which is arranged inside the case and which senses the received light corresponding to the light emitted from the light emission module; an inertia sensor module which is arranged inside the case and which senses movement; a button arranged on the case; and a communication unit which is arranged inside the case and which exchanges data with an external electronic device, wherein the communication unit transmits the calculated coordinate information to the outside according to operations of the light emission module and the optical sensor when the position of the pen tip is separated from the display of the external electronic device during a pen mode, and the inertia sensor module transmits the calculated coordinate information to the outside during a pointing mode. Therefore, the pen mode and the pointing mode can be performed by using one electronic pen.

Description

Electronic pen and electronic pen system having same

The present invention relates to an electronic pen and an electronic pen system having the same, and more particularly, to an electronic pen capable of performing a pen mode and a pointing mode using one electronic pen, and an electronic pen system having the same.

The electronic pen has a pen shape and is a device used to input characters or images corresponding to the movement of the electronic pen when writing on a display such as a mobile terminal.

The electronic pen method may be classified into a pressure-sensitive type, a capacitive type, an Electro Magnetic Resonance (EMR) method that does not require a separate power source, an Active Electrostatic Solution (AES) method using an internal power source, and the like.

On the other hand, in the case of Korean Patent Application Laid-Open No. 10-2018-0011730 (hereinafter referred to as 'prior literature'), an electromagnetic resonance type electronic pen is disclosed.

On the other hand, an electronic pen such as the prior art performs only writing on a display of a mobile terminal, etc., and there is a problem in that handwriting is not recognized when displayed outside of the mobile terminal.

An object of the present invention is to provide an electronic pen capable of performing a pen mode and a pointing mode using one electronic pen, and an electronic pen system including the same.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an electronic pen capable of writing in a pen mode even when out of a display area, and an electronic pen system including the same.

An electronic pen according to an embodiment of the present invention for achieving the above object includes a case, a pen tip disposed at one end of the case, one end of which is exposed to the outside, a coil and a capacitor, and the frequency of an input electromagnetic field signal Alternatively, an electromagnetic sensor outputting a variable level to the outside, a light output module disposed in the case and outputting light to the outside, and a light disposed in the case and sensing received light corresponding to the light output from the light output module It includes a sensor, an inertial sensor module disposed in the case and sensing motion, a button disposed on the case, and a communication unit disposed in the case and exchanging data with an external electronic device, wherein the communication unit operates in pen mode When the position of the pen tip is outside the display of the external electronic device, the calculated coordinate information is transmitted to the outside according to the operation of the optical output module and the optical sensor, and the calculated coordinates are performed by the inertial sensor module during the pointing mode operation transmit information to the outside.

Meanwhile, the electronic pen according to another embodiment of the present invention includes a case, a pen tip disposed at one end of the case, one end of which is exposed to the outside, a coil and a capacitor, and varying the frequency or level of an input electromagnetic field signal. an electromagnetic sensor for outputting to the outside; a light output module disposed in the case and outputting light to the outside; an optical sensor disposed in the case and sensing received light corresponding to light output from the light output module; It is disposed inside and includes an inertial sensor module for sensing movement, a button disposed on the case, and a communication unit disposed in the case and exchanging data with an external electronic device, wherein the communication unit is configured to output light when in pen mode. According to the operation of the module and the optical sensor, the calculated coordinate information is transmitted to the outside, and in the pointing mode, the inertial sensor module transmits the calculated coordinate information to the outside.

Meanwhile, the electronic pen system according to an embodiment of the present invention includes an electromagnetic sensor that varies the frequency or level of an electromagnetic field signal input from the outside and outputs it to the outside, an optical output module that outputs light, and an output from the optical output module An electronic pen including an optical sensor sensing received light corresponding to the emitted light, an inertial sensor module sensing movement, and a display, wherein when the electronic pen is in the display during pen mode operation, a frequency or A mobile terminal that receives a level-varied electromagnetic field signal and wirelessly receives coordinate information from the electronic pen when the electronic pen leaves the display during pen mode operation, and motion information sensed by the inertial sensor module from the electronic pen in pointing mode It includes an image display device for receiving.

The electronic pen according to an embodiment of the present invention includes a case, a pen tip disposed at one end of the case, a pen tip having one end exposed to the outside, a coil and a capacitor, and changing the frequency or level of an input electromagnetic field signal to external An electromagnetic sensor for outputting to, a light output module disposed in the case and outputting light to the outside, an optical sensor disposed in the case and sensing received light corresponding to light output from the light output module, and disposed in the case and an inertial sensor module for sensing motion, a button disposed on the case, and a communication unit disposed in the case and exchanging data with an external electronic device, wherein the communication unit determines the position of the pen tip during pen mode operation, When out of the display of the external electronic device, the calculated coordinate information is transmitted to the outside according to the operation of the light output module and the light sensor, and the calculated coordinate information is transmitted by the inertial sensor module during the pointing mode operation to the outside . Accordingly, the pen mode and the pointing mode can be performed using one electronic pen. In particular, even when the pen tip leaves the display area in the pen mode, writing is possible in the pen mode.

Meanwhile, the electronic pen according to an embodiment of the present invention further includes a control unit for calculating coordinate information based on operations of the light output module and the light sensor in pen mode operation, and the communication unit includes a pen tip during pen mode operation. When the position of is out of the display of the external electronic device, the calculated coordinate information may be transmitted to the outside according to the operation of the light output module and the light sensor. Accordingly, even when the pen tip leaves the display area in the pen mode, writing is possible in the pen mode.

Meanwhile, in the pen mode, the communication unit may stop transmitting the coordinate information when the button operates while the calculated coordinate information is transmitted to the outside according to the operations of the light output module and the optical sensor. Accordingly, it is possible to simply stop the transmission of coordinate information in the pen mode.

Meanwhile, when the position of the pen tip is within the display of the external electronic device during the pen mode operation, the communication unit may not transmit the calculated coordinate information to the outside. Accordingly, since there is no need to transmit coordinate information, power consumption can be reduced.

Meanwhile, when the level of the electromagnetic field signal input during the pen mode operation is equal to or less than the reference value, the communication unit may transmit the calculated coordinate information to the outside according to the operations of the light output module and the light sensor in the pen mode. Accordingly, it is determined that the pen tip leaves the display area in the pen mode, and even when the pen tip leaves the display area in the pen mode, writing is possible in the pen mode.

On the other hand, the communication unit transmits a pairing request signal to the electronic device when the position of the pen tip is out of the display of the external electronic device and is not paired with the electronic device during pen mode operation, and receives a pairing response signal from the electronic device. Upon reception, pairing is performed, and after pairing is performed, in the pen mode, the calculated coordinate information may be transmitted to the outside according to the operation of the light output module and the light sensor. Accordingly, when the pen tip leaves the display area in the pen mode, writing is possible in the pen mode through pairing.

On the other hand, the communication unit transmits a pairing request signal to the electronic device and receives a pairing response signal from the electronic device when pairing with the electronic device is not performed in a state where the level of the electromagnetic field signal input during the pen mode operation is less than or equal to the reference value. After performing the pairing, in the pen mode, the calculated coordinate information may be transmitted to the outside according to the operations of the light output module and the light sensor. Accordingly, when the pen tip leaves the display area in the pen mode, writing is possible in the pen mode through pairing.

On the other hand, the electronic pen according to an embodiment of the present invention is controlled to operate in the pen mode when the level of the optical signal sensed by the optical sensor is equal to or higher than the reference level, and the level of the optical signal sensed by the optical sensor is lower than the reference level. In this case, the controller may further include a control unit for controlling to operate in the pointing mode. Accordingly, it is possible to automatically enter the pen mode and the pointing mode based on the reference level.

Meanwhile, the electronic pen according to an embodiment of the present invention may further include a control unit that controls to operate in a pen mode according to a first operation of the button, and controls to operate in a pointing mode according to a second operation of the button. can Accordingly, it is possible to perform the pen mode or the pointing mode based on the operation of the button.

Meanwhile, the electronic pen according to an embodiment of the present invention includes a pressure sensor for sensing the pressure of a button, and controls to operate in a pen mode when a first sensing signal is received from the pressure sensor, and a second sensing from the pressure sensor When a signal is received, the control unit may further include a control unit for controlling to operate in a pointing mode. Accordingly, it is possible to perform the pen mode or the pointing mode based on the pressure of the button.

Meanwhile, the inertial sensor module may continuously sense motion information during the pen mode operation. Accordingly, even when the pen tip leaves the display area in the pen mode, writing is possible in the pen mode.

Meanwhile, the electronic pen according to an embodiment of the present invention may further include a control unit for controlling the operation in a standby mode when there is no movement sensed by the inertial sensor module during the pointing mode or pen mode operation. Accordingly, power consumption can be reduced.

Meanwhile, when the button is pressed during the pointing mode operation, the communication unit may transmit motion information sensed by the inertial sensor module and button operation information to the outside. Accordingly, it is possible to simply transmit the movement information and the button operation information to the outside.

Meanwhile, the electronic pen according to another embodiment of the present invention includes a case, a pen tip disposed at one end of the case, one end of which is exposed to the outside, a coil and a capacitor, and varying the frequency or level of an input electromagnetic field signal. an electromagnetic sensor for outputting to the outside; a light output module disposed in the case and outputting light to the outside; an optical sensor disposed in the case and sensing received light corresponding to light output from the light output module; It is disposed inside and includes an inertial sensor module for sensing movement, a button disposed on the case, and a communication unit disposed in the case and exchanging data with an external electronic device, wherein the communication unit is configured to output light when in pen mode. According to the operation of the module and the optical sensor, the calculated coordinate information is transmitted to the outside, and in the pointing mode, the inertial sensor module transmits the calculated coordinate information to the outside. Accordingly, the pen mode and the pointing mode can be performed using one electronic pen.

Meanwhile, the electronic pen system according to an embodiment of the present invention includes an electromagnetic sensor that varies the frequency or level of an electromagnetic field signal input from the outside and outputs it to the outside, an optical output module that outputs light, and an output from the optical output module An electronic pen including an optical sensor sensing received light corresponding to the emitted light, an inertial sensor module sensing movement, and a display, wherein when the electronic pen is in the display during pen mode operation, a frequency or A mobile terminal that receives a level-varied electromagnetic field signal and wirelessly receives coordinate information from the electronic pen when the electronic pen leaves the display during pen mode operation, and motion information sensed by the inertial sensor module from the electronic pen in pointing mode It includes an image display device for receiving. Accordingly, the pen mode and the pointing mode can be performed using one electronic pen. In particular, handwriting is performed on the mobile terminal in the pen mode, and a pointer can be displayed on the image display device in the pointing mode.

On the other hand, the electronic pen according to an embodiment of the present invention transmits a pairing request signal to the mobile terminal when the position of the electronic pen is out of the display of the mobile terminal and is not paired with the mobile terminal during pen mode operation, , may receive a pairing response signal from the mobile terminal to perform pairing, and after pairing is performed, in pen mode, calculated coordinate information may be transmitted to the outside according to operations of the light output module and the light sensor. Accordingly, even when the pen tip of the electronic pen is out of the display area, it is possible to write in the pen mode.

Meanwhile, in the electronic pen according to an embodiment of the present invention, if the electronic pen is not paired with the mobile terminal while the level of the electromagnetic field signal sensed by the electronic pen is less than or equal to the reference value during pen mode operation, the electronic pen moves the pairing request signal It is transmitted to the terminal, receives a pairing response signal from the mobile terminal, performs pairing, and after pairing is performed, in pen mode, the calculated coordinate information may be transmitted to the outside according to the operation of the light output module and the light sensor. Accordingly, even when the pen tip of the electronic pen is out of the display area, pairing is performed to enable writing in the pen mode.

Meanwhile, in the electronic pen according to an embodiment of the present invention, the electronic pen may operate in a pen mode or a pointing mode according to a button operation of the electronic pen. Accordingly, it is possible to conveniently operate the electronic pen in the pen mode or the pointing mode according to the button operation of the electronic pen.

Meanwhile, in the electronic pen according to an embodiment of the present invention, when there is no movement sensed by the inertial sensor module during the pointing mode or pen mode operation of the electronic pen, the electronic pen may operate in a standby mode. Accordingly, power consumption can be reduced.

1 is a diagram illustrating an electronic pen system according to an embodiment of the present invention.

2A to 2C are diagrams illustrating an electronic pen according to an embodiment of the present invention.

FIG. 3 is an internal block diagram of the electronic pen of FIG. 1 .

FIG. 4A is a diagram illustrating a pen mode operation method of the electronic pen of FIG. 1 .

FIG. 4B is a diagram illustrating a method of operating the electronic pen of FIG. 1 in a pointing mode.

5 to 12E are diagrams referenced for explaining the operation of the electronic pen according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "module" and "part" for the components used in the following description are given simply in consideration of the ease of writing the present specification, and do not give a particularly important meaning or role by themselves. Accordingly, the terms “module” and “unit” may be used interchangeably.

1 is a diagram illustrating an electronic pen system according to an embodiment of the present invention.

Referring to the drawings, the electronic pen system 10 may include an electronic pen 100 , an image display device (IMD), and a mobile terminal (MOB).

The electronic pen may be implemented in various ways, such as an electromagnetic resonance method, an active method, and a pressure sensitive method. However, the electromagnetic resonance method, the active method, the decompression method, etc. have a disadvantage in that handwriting recognition is not smoothly performed when the display DS of the mobile terminal MOB is out.

Accordingly, the present invention proposes a hybrid electronic pen 100 that operates by mixing an electromagnetic resonance method or an active method and an optical method.

Meanwhile, the electronic pen 100 according to an embodiment of the present invention is characterized in that, in addition to the pen mode, a pointing mode is additionally performed.

To this end, the electronic pen 100 according to an embodiment of the present invention includes a case CSE, a pen tip PTP disposed at one end of the case CSE, one end of which is exposed to the outside, a coil and a capacitor. An electromagnetic sensor (EMS) for outputting to the outside by varying the frequency or level of an input electromagnetic field signal, a light output module 458 disposed in the case (CSE) and outputting light to the outside, and the case (CSE) ) disposed in the optical sensor 448 for sensing the received light corresponding to the light output from the light output module 458, and an inertial sensor module (IMU) disposed in the case (CSE) for sensing motion; It includes a button BTN disposed on the case CSE, and a communication unit 420 disposed in the case CSE and exchanging data with an external electronic device.

On the other hand, the communication unit 420, when the position of the pen tip (PTP) during the pen mode operation, outside the display (IDS) of the external electronic device, according to the operation of the light output module 458 and the light sensor 448, The calculated coordinate information is transmitted to the outside, and during the pointing mode operation, the inertial sensor module (IMU) transmits the calculated coordinate information to the outside. Accordingly, the pen mode and the pointing mode can be performed using one electronic pen 100 . In particular, even when the pen tip PTP is out of the display IDS area in the pen mode, writing is possible in the pen mode.

For example, when the electronic pen 100 operates in the pen mode, writing content (eg, text, figure, etc.) will be shown.

In this case, the display DS of the mobile terminal MOB preferably includes an electronic pen sensing device that outputs an electromagnetic field signal and senses a frequency or level of a variable electromagnetic field signal.

As another example, when the electronic pen 100 operates in the pointing mode, a pointer corresponding to the movement of the electronic pen 100 may be displayed on the display DIS of the paired image display device IMD. Accordingly, the pointing mode is performed.

Meanwhile, the display DIS of the image display device IMD may be implemented as any one of various panels. For example, the display DIS may be any one of a liquid crystal display panel (LCD panel), an organic light emitting panel (OLED panel), an inorganic light emitting panel (LED panel), and the like.

Meanwhile, the display DS of the mobile terminal MOB may be implemented with any one of various panels. For example, the display DS may be any one of a liquid crystal display panel (LCD panel), an organic light emitting panel (OLED panel), an inorganic light emitting panel (LED panel), and the like.

Meanwhile, the image display device (IMD) of FIG. 1 may be a monitor, a TV, a vehicle display device, and the like, and the mobile terminal (MOB) may be a tablet PC, a mobile phone, a smart phone, or the like.

2A to 2C are diagrams illustrating an electronic pen according to an embodiment of the present invention.

First, referring to FIG. 2A , the electronic pen 100 according to an embodiment of the present invention is disposed at one end of the case CSE having a hollow at one end, and one end of the case CSE through the hollow, and one end of the electronic pen 100 is external. It may include a pen tip (PTP) exposed to, a cap (CAP) surrounding the other end of the pen tip (PTP), and a second case (RCS) coupled to the other end of the case (CSE). Accordingly, the appearance of the electronic pen 100 can be formed.

Meanwhile, a button BTN for user manipulation may be formed on one surface of the case CSE.

Next, referring to FIGS. 2B and 2C , the electronic pen 100 according to an embodiment of the present invention may include an optical module (OPU) including an optical output module 458 and an optical sensor 448 . have. In this case, the optical module OPU may be formed to be spaced apart from the pen tip PTP.

In the drawing, the optical module (OPU) is exemplified that is formed spaced apart from the lower side of the pen tip (PTP).

Meanwhile, the light output module 458 in the optical module OPU may output light, and the optical sensor 448 may sense received light corresponding to the light output from the light output module 458 .

Meanwhile, the pen tip PTP exposed to the outside may be electrically connected to the first circuit board EBD having the electromagnetic sensor EMS formed inside the case CSE.

Meanwhile, the second circuit board MBD may be spaced apart from the first circuit board EBD and disposed under the second circuit board MBD.

The second circuit board MBD may include an inertial sensor module IMU, a controller 480 , a battery BAT, and a communication unit 420 .

Meanwhile, a coil COL for wireless charging or near magnetic field communication may be disposed at an end of the second circuit board MBD. At this time, the coil COL may be electrically connected to the second circuit board MBD.

Meanwhile, in the electronic pen 100 according to an embodiment of the present invention, when the position of the pen tip PTP is within the display DS of an external electronic device during pen mode operation, through the electromagnetic sensor EMS, By varying the frequency or level of the input electromagnetic field signal, it can be output to the outside. Accordingly, characters or pictures are displayed on the display DS of the mobile terminal MOB, based on the frequency or level of the varying electromagnetic field signal.

Meanwhile, in the electronic pen 100 according to an embodiment of the present invention, when the position of the pen tip PTP is out of the display DS of the external electronic device during pen mode operation, the light output module 458 and the light According to the operation of the sensor 448, the calculated coordinate information may be transmitted to the outside. Accordingly, characters or pictures are displayed on the display DS of the mobile terminal MOB, based on the optical-based coordinate information.

Meanwhile, the electronic pen 100 according to an embodiment of the present invention may transmit coordinate information calculated by the inertial sensor module (IMU) to the outside during the pointing mode operation during the pointing mode operation. Accordingly, on the display IDS of the image display device IMD, based on the inertial sensor module (IMU-based coordinate information), a pointer may be displayed or a character may be input.

FIG. 3 is an internal block diagram of the electronic pen of FIG. 1 .

Referring to the drawings, the electronic pen 100 includes a communication unit 420 , a user input unit 435 , a sensor unit 440 , an output unit 450 , a power supply unit 460 , a storage unit 470 , and a control unit ( 480) may be included.

The communication unit 420 may perform pairing with a mobile terminal (MOB) or an image display device (IMD), and may exchange data with the paired device.

In particular, the communication unit 420 may transmit coordinate information or the like to a mobile terminal (MOB) or an image display device (IMD).

Meanwhile, the communication unit 420 may include an RF module 421 capable of transmitting and receiving signals to and from an image display device (IMD) according to the RF communication standard. For example, the communication unit 420 may perform Bluetooth communication.

Meanwhile, the communication unit 420 may include an IR module 423 capable of transmitting and receiving signals to and from an image display device (IMD) according to an IR communication standard.

When operating in the pointing mode, the communication unit 420 transmits coordinate information based on the inertial sensor module (IMU) or information on the movement of the electronic pen 100 through the RF module 421, such as an image display device (IMD), etc. send to

When operating in the pen mode, the communication unit 420 may transmit the calculated coordinate information through the RF module 421 according to the operations of the light output module 458 and the light sensor 448 .

Meanwhile, the communication unit 420 may receive a signal transmitted by the image display device IMD through the RF module 421 .

Meanwhile, the communication unit 420 may transmit commands related to power on/off, channel change, volume change, etc. to the image display device (IMD) through the IR module 423 as necessary.

The user input unit 435 may include a keypad, a button, a touch pad, or a touch screen.

The user may input a command related to the electronic pen 100 by manipulating the user input unit 435 .

For example, when the user input unit 435 includes a hard key button, the user may input a command related to the electronic pen 100 through a push operation of the hard key button.

The sensor unit 440 may include an electromagnetic sensor (EMS), an inertial sensor module (IMU), an optical module (OPU), a pressure sensor (TSS), and the like.

The electromagnetic sensor EMS may sense a surrounding electromagnetic field, and may output a frequency or level of an input electromagnetic field signal to the outside by varying the frequency or level.

For example, the electromagnetic sensor EMS may include a coil and a capacitor, and may sense an input electromagnetic field signal through the pen tip PTP.

In particular, the electromagnetic sensor EMS may sense an electromagnetic field signal from an electronic pen sensing device provided in the display DS of the mobile terminal MOB.

In addition, it is possible to sense a pen pressure indicating information about the pressed strength of the pen tip (PTP). At this time, as the intensity with which the pen tip PTP is pressed increases, the intensity of the signal of the sensed electromagnetic field increases, and accordingly, it can be sensed that the pen pressure becomes stronger.

Meanwhile, the electromagnetic sensor EMS may vary the frequency or level of an input electromagnetic field signal and output it to the outside.

For example, as the intensity with which the pen tip PTP is pressed increases, the variable amount of the level or frequency of the electric field signal may increase. That is, the stronger the pen pressure, the greater the variable amount of the level or frequency of the output electric field signal.

On the other hand, the inertial sensor module (IMU) is disposed in the case (CSE), it can sense the movement of the electronic pen (100).

To this end, the inertial sensor module (IMU) may include a gyro sensor 441 or an acceleration sensor 443 .

The gyro sensor 441 may sense information regarding the movement of the electronic pen 100 . For example, the gyro sensor 441 may sense information about the operation of the electronic pen 100 based on x, y, and z axes.

The acceleration sensor 443 may sense information about the moving speed of the electronic pen 100 .

The optical module OPU is disposed in the case CSE and includes an optical output module 458 for outputting light, and a reception light disposed in the case CSE and corresponding to the light output from the optical output module 458 . An optical sensor 448 for sensing may be provided.

The pressure sensor TSS is disposed under the button BTN disposed on the case CSE, and may sense the pressure of the button BTN.

For example, in the pressure sensor TSS, the level of the signal sensed by the pressure sensor TSS or the duty of the sensed signal may be varied according to the force of the button BTN.

The output unit 450 may output an image or audio signal corresponding to an operation of the user input unit 435 or a signal transmitted from the image display device (IMD). Through the output unit 450 , the user may recognize whether the user input unit 435 is manipulated or whether the image display device (IMD) is controlled.

For example, the output unit 450 is an LED module 451 that is turned on when the user input unit 435 is manipulated or a signal is transmitted or received with the image display device (IMD) through the wireless communication unit 420, and vibration generating vibration A module 453 , a sound output module 455 for outputting sound, or a display module 457 for outputting an image may be provided.

The power supply unit 460 supplies power to the inside of the electronic pen 100 . To this end, the power supply unit 460 may include a battery (BAT).

The power supply unit 460 may reduce power consumption by allowing the electronic pen 100 to enter a power saving mode in which the power supply is stopped when the electronic pen 100 does not move for a predetermined time.

Meanwhile, the power supply unit 460 may resume power supply when a predetermined key provided in the electronic pen 100 is operated.

The storage unit 470 may store various types of programs and application data required for control or operation of the electronic pen 100 .

For example, when the electronic pen 100 is paired with an image display device (IMD) or a mobile terminal (MOB) and wirelessly transmits and receives signals through the RF module 421 , the electronic pen 100 displays an image A signal is transmitted and received with a device (IMD) or a mobile terminal (MOB) through a predetermined frequency band.

On the other hand, the control unit 480, the electronic pen 100 and the paired image display device (IMD) or mobile terminal (MOB) and the storage unit 470 information about the frequency band in which a signal can be transmitted and received wirelessly is stored. and can be referenced.

The controller 480 controls all matters related to the control of the electronic pen 100 .

The control unit 480 transmits a signal corresponding to a predetermined key operation of the user input unit 435 or coordinate information or motion information sensed by the sensor unit 440 through the wireless communication unit 420 to a paired image display device (IMD) or It can be transmitted to a mobile terminal (MOB).

The user input interface unit (not shown) of the image display device (IMD) includes a communication unit (not shown) capable of wirelessly transmitting and receiving signals to and from the electronic pen 100 , and a pointer corresponding to the operation of the electronic pen 100 . A coordinate value calculator (not shown) capable of calculating a coordinate value may be provided.

The user input interface unit (not shown) may wirelessly transmit/receive a signal to and from the electronic pen 100 through an RF module (not shown). In addition, a signal transmitted by the electronic pen 100 according to the IR communication standard may be received through an IR module (not shown).

On the other hand, the coordinate value calculator (not shown) corrects the hand shake or error from the received signal corresponding to the operation of the electronic pen 100 to display the coordinate values (x, y) of the pointer 205 on the display 180 . ) can be calculated.

The electronic pen 100 transmission signal input to the image display device IMD through a user input interface unit (not shown) is transmitted to a signal processing unit (not shown) of the image display device IMD. The signal processing unit (not shown) may determine information about the operation and key manipulation of the electronic pen 100 from the signal transmitted from the electronic pen 100 , and may control the image display device IMD in response thereto.

As another example, the electronic pen 100 may calculate a pointer coordinate value corresponding to the operation and output it to a user input interface unit (not shown) of the image display device IMD. In this case, the user input interface unit (not shown) of the image display device (IMD) may transmit information about the received pointer coordinate values to the signal processing unit (not shown) without a separate hand shake or error correction process.

In addition, as another example, it is possible that the coordinate value calculating unit (not shown) is provided inside the signal processing unit (not shown), not the user input interface unit (not shown) unlike the drawing.

FIG. 4A is a diagram illustrating a pen mode operation method of the electronic pen of FIG. 1 .

Referring to the drawings, in pen mode operation, the electromagnetic sensor EMS includes a coil and a capacitor, and may sense an input electromagnetic field signal through the pen tip PTP. In addition, the electromagnetic sensor EMS may vary the frequency or level of the input electromagnetic field signal and output it to the outside.

In addition, the electronic pen sensing apparatus (not shown) of the mobile terminal MOB may calculate coordinate information corresponding to the handwritten content based on the frequency or level-varied electromagnetic field signal.

Accordingly, on the display DS of the mobile terminal MOB, as shown in (a) of FIG. 4A , characters such as “LG”, which are handwritten contents, are displayed.

Meanwhile, as shown in (b) of FIG. 4A , when the electronic pen 100 leaves the display DS of the mobile terminal MOB, the level of the electromagnetic field signal sensed by the electromagnetic sensor EMS may be less than or equal to the reference value.

That is, in the pen mode, when the level of the electromagnetic field signal sensed by the electromagnetic sensor EMS is less than or equal to the reference value, the controller 480 determines that the electronic pen 100 is out of the display DS of the mobile terminal MOB. can

Also, in the pen mode, when the level of the electromagnetic field signal sensed by the electromagnetic sensor EMS is equal to or less than a reference value, the controller 480 may control the optical module OCU to operate.

Accordingly, the controller 480 may calculate coordinate information based on the continuously received received light, and control the calculated coordinate information to be transmitted to the paired mobile terminal (MOB).

Accordingly, the communication unit 420 transmits coordinate information according to the pen mode to the paired mobile terminal (MOB) through the RF module 421 or the like.

Accordingly, on the display DS of the mobile terminal MOB, as shown in (b) of FIG. 4A , characters such as “LG”, which are handwritten contents, are displayed.

On the other hand, when the electronic pen 100 is out of the display DS of the mobile terminal MOB and is not paired with the mobile terminal MOB, the communication unit 420 transmits a pairing request signal to the electronic device, By receiving a pairing response signal from the electronic device, pairing is performed, and after pairing is performed, in pen mode, the calculated coordinate information may be transmitted to the outside according to the operations of the light output module 458 and the light sensor 448 . .

On the other hand, when the level of the electromagnetic field signal input during pen mode operation is below the reference value and the electronic device is not paired, the communication unit 420 transmits a pairing request signal to the electronic device and receives a pairing response signal from the electronic device Thus, the pairing is performed, and after the pairing is performed, in the pen mode, the calculated coordinate information may be transmitted to the outside according to the operations of the light output module 458 and the light sensor 448 .

FIG. 4B is a diagram illustrating a method of operating the electronic pen of FIG. 1 in a pointing mode.

Referring to the drawings, (a) of FIG. 4B illustrates that a pointer 205 corresponding to the electronic pen 100 is displayed on the display DIS of the image display device 100 .

The user may move or rotate the electronic pen 100 up and down, left and right ((b) of FIG. 4B), or forward and backward ((c) of FIG. 4B). The pointer 205 displayed on the display DIS of the image display device corresponds to the movement of the electronic pen 100 .

Since the corresponding pointer 205 is moved and displayed according to movement in 3D space, as shown in the drawing, the electronic pen 100 may be referred to as a pointing device operating in a pointing mode.

4B (b) illustrates that when the user moves the electronic pen 100 to the left, the pointer 205 displayed on the display DIS of the image display device IMD also moves to the left correspondingly.

Meanwhile, information about the movement of the electronic pen 100 detected through the sensor of the electronic pen 100 is transmitted to the image display device IMD through the wireless communication unit 420 . The image display device IMD may calculate the coordinates of the pointer 205 from information about the movement of the electronic pen 100 . The image display device IMD may display the pointer 205 to correspond to the calculated coordinates.

4B (c) illustrates a case in which the user moves the electronic pen 100 away from the display DIS while pressing a specific button in the electronic pen 100 . Accordingly, the selected area in the display DIS corresponding to the pointer 205 may be zoomed in and displayed.

Conversely, when the user moves the electronic pen 100 closer to the display DIS, a selected area in the display DIS corresponding to the pointer 205 may be zoomed out and displayed. Meanwhile, when the electronic pen 100 moves away from the display DIS, the selection area may be zoomed out, and when the electronic pen 100 approaches the display DIS, the selection area may be zoomed in.

Meanwhile, while a specific button in the electronic pen 100 is pressed, recognition of vertical and horizontal movements may be excluded. That is, when the electronic pen 100 moves away from or close to the display DIS, up, down, left, and right movements are not recognized, but only forward and backward movements may be recognized. In a state where a specific button in the electronic pen 100 is not pressed, only the pointer 205 moves according to the up, down, left, and right movement of the electronic pen 100 .

Meanwhile, the moving speed or moving direction of the pointer 205 may correspond to the moving speed or moving direction of the electronic pen 100 .

5 to 12E are diagrams referenced for explaining the operation of the electronic pen according to an embodiment of the present invention.

5A illustrates the pen mode operation of the electronic pen 100 .

Referring to the drawings, when handwriting is performed on the display DS of the mobile terminal MOB according to the pen mode operation of the electronic pen 100 , the electromagnetic sensor EMS of the electronic pen 100 includes a coil and It has a capacitor and can sense an input electromagnetic field signal through the pen tip (PTP). In addition, the electromagnetic sensor EMS may vary the frequency or level of the input electromagnetic field signal and output it to the outside.

In addition, the electronic pen sensing apparatus (not shown) of the mobile terminal MOB may calculate coordinate information corresponding to the handwritten content based on the frequency or level-varied electromagnetic field signal.

Accordingly, characters or pictures corresponding to handwriting are displayed on the display DS of the mobile terminal MOB.

On the other hand, unlike the drawing, when writing is performed on the floor while leaving the display DS of the mobile terminal MOB, the communication unit 420 of the electronic pen 100, in the pen mode, the light output module According to the operation of the 458 and the optical sensor 448, the calculated coordinate information may be transmitted to the outside.

Accordingly, on the display DS of the mobile terminal MOB, characters or pictures corresponding to handwriting according to the movement of the electronic pen 100 are displayed.

Meanwhile, when pairing with the mobile terminal MOB is not performed during the pen mode operation, the communication unit 420 may perform pairing with the mobile terminal MOB. Accordingly, writing according to the pen mode operation is performed in the mobile terminal (MOB).

Meanwhile, when pairing with the mobile terminal MOB is not performed, the communication unit 420 transmits a pairing request signal to the mobile terminal MOB and receives a pairing response signal from the mobile terminal MOB during pen mode operation. can do. Accordingly, writing according to the pen mode operation is performed in the mobile terminal (MOB).

Meanwhile, the inertial sensor module (IMU) may continue to sense motion information during the pen mode operation. Accordingly, it is possible to switch between the pen mode and the point mode.

FIG. 5B illustrates the pointing mode of the electronic pen 100 .

Referring to the drawings, when the electronic pen 100 is lifted and the button BTN is pressed during the pen mode operation of the electronic pen 100, the pointing mode may be switched.

When the electronic pen 100 moves according to the pointing mode operation of the electronic pen 100 , the communication unit 420 of the electronic pen 100 transmits coordinate information calculated by the inertial sensor module (IMU) in the pointing mode. can be transmitted externally.

Meanwhile, when pairing with the image display device IMD is not performed during the pointing mode operation, the communication unit 420 may perform pairing with the image display device IMD. Accordingly, pointing according to the pointing mode operation is performed in the image display device IMD.

On the other hand, the communication unit 420 transmits a pairing request signal to the image display device (IMD) when pairing with the image display device (IMD) is not performed during the pointing mode operation, and a pairing response from the image display device (IMD) signal can be received. Accordingly, pointing according to the pointing mode operation is performed in the image display device IMD.

Meanwhile, the electronic pen 100 according to an embodiment of the present invention may operate in a standby mode when there is no movement sensed by the inertial sensor module (IMU) during the pointing mode or pen mode operation. Thereby, it operates in the standby mode, and power consumption can be reduced.

Meanwhile, when the button BTN is pressed during the pointing mode operation, the communication unit 420 may transmit motion information sensed by the inertial sensor module IMU and operation information of the button BTN to the outside. Accordingly, a drag operation in the pointing mode is enabled.

Meanwhile, when there is a signal sensed by the pressure sensor TSS during the pointing mode operation, the communication unit 420 transmits the motion information sensed by the inertial sensor module IMU and the sensing information of the pressure sensor TSS to the outside. can Accordingly, zoom-in/zoom-out in the pointing mode, variable depth, and the like are possible.

Meanwhile, the communication unit 420 may transmit level information of a signal sensed by the pressure sensor TSS to the outside together with motion information. Accordingly, zoom-in/zoom-out in the pointing mode, variable depth, and the like are possible.

On the other hand, unlike FIG. 5B , when the level of the optical signal sensed by the optical sensor 448 is equal to or higher than the reference level, the electronic pen 100 operates in the pen mode, and When the level of the optical signal is less than the reference level, the pointing mode may be operated. Accordingly, it is possible to switch between the pen mode and the point mode.

Meanwhile, as shown in FIG. 6A , the electronic pen 100 may operate in the pen mode according to the first operation of the button BTN.

Next, as shown in FIG. 6B , the electronic pen 100 may operate in the pointing mode according to the second operation of the button BTN. Accordingly, it is possible to switch between the pen mode and the point mode.

The first operation of the button BTN and the second operation of the button BTN may be the same operation, for example, may be toggled to perform a mode change.

Alternatively, as shown in FIG. 6A , when the first sensing signal is received from the pressure sensor TSS, the electronic pen 100 may operate in the pen mode.

Meanwhile, as shown in FIG. 6B , the electronic pen 100 may operate in the pointing mode when the second sensing signal is received from the pressure sensor TSS. Accordingly, it is possible to switch between the pen mode and the point mode.

In this case, the first sensing signal and the second sensing signal may be the same signal. Accordingly, mode switching may be performed according to the toggle input based on the same signal.

Meanwhile, the first sensing signal and the second sensing signal may be signals having different at least one of signal strength, duty, and number of signals.

7 is a diagram illustrating various modes of the electronic pen.

Figure 7 (a) illustrates a pen mode in which the electronic pen 100 and the mobile terminal (MOB) are in contact, and in Figure 7 (b), the electronic pen 100 and the mobile terminal (MOB) are partially spaced apart. An example of the pen mode being

On the other hand, Fig. 7(c) illustrates the standby mode.

When there is no movement sensed by the inertial sensor module (IMU) during the pointing mode or pen mode operation, the electronic pen 100 according to an embodiment of the present invention, as shown in (c) of FIG. 7 . It can operate in standby mode. Thereby, it operates in the standby mode, and power consumption can be reduced.

Meanwhile, FIG. 7D illustrates a pointing mode according to the operation of the button BTN.

As shown in the figure, in the standby mode, when the electronic pen 100 moves and there is an input signal according to the operation of the button BTN, the controller 480 terminates the standby mode and enters the pointing mode. can

Meanwhile, FIG. 7E illustrates an operation in the pointing mode.

Meanwhile, the communication unit 420 may transmit coordinate information calculated by the inertial sensor module (IMU) to the outside in the pointing mode. Accordingly, it is possible to display a pointer, move an object, and the like in the paired image display device (IMD).

On the other hand, FIG. 7(f) exemplifies the pen mode.

Meanwhile, during the pointing mode operation, when rewriting is performed, the controller 480 may control to switch to the pen mode.

For example, the controller 480 controls the optical output module 458 and the optical sensor 448 to operate even during the pointing mode operation, and when the level of the optical signal sensed by the optical sensor 448 is less than the reference level , it can be controlled to continue operating in the pointing mode.

Meanwhile, during the pointing mode operation, when the level of the optical signal sensed by the optical sensor 448 is equal to or greater than the reference level, the controller 480 may control the mode to be switched to the pen mode.

Accordingly, when switching from the pointing mode to the pen mode, the controller 480 may terminate pairing with the paired image display device (IMD) and control the pairing with the mobile terminal (MOB) to be performed.

Then, after pairing with the mobile terminal (MOB) is completed, according to the pen mode, the communication unit 420 transmits the calculated coordinate information according to the operations of the light output module 458 and the light sensor 448 to the mobile terminal (MOB). will be sent to

8A to 8C are diagrams referenced to explain object movement in a pointing mode.

First, FIG. 8A illustrates selecting an object in a pointing mode.

Referring to the drawing, the communication unit 420 of the electronic pen 100 may transmit coordinate information calculated by the inertial sensor module IMU to the image display device IMD in the pointing mode.

Accordingly, a pointer or the like may be displayed on the image display device IMD.

On the other hand, in the pointing mode, when the button BTN of the electronic pen 100 operates, the image display device IMD performs a specific display displayed on the image display device IMD, as shown in FIG. 8A , based on coordinate information or the like. You can select an object (OBJ).

Next, FIG. 8B illustrates that the electronic pen 100 moves to the right while the button BTN is pressed.

Accordingly, in the pointing mode, the communication unit 420 of the electronic pen 100 may transmit the coordinate information calculated by the inertial sensor module IMU and the button operation information to the image display device IMD. .

The image display device IMD causes the selected object OHJ to be dragged to the right as shown in the drawing, based on the coordinate information and the button BTN operation information. Accordingly, a drag operation in the pointing mode is enabled.

Next, FIG. 8C illustrates a case in which the pointer is moved to the boundary of an object.

The communication unit 420 of the electronic pen 100 may transmit coordinate information calculated by the inertial sensor module IMU to the image display device IMD in the pointing mode.

On the other hand, the image display device (IMD) matches the coordinate information with the object, and when it is determined that the coordinate information of the pointer PT exists in the boundary region of the object, it displays guide information for object reduction, enlargement, etc. can

On the other hand, when the button BTN operates, the communication unit 420 of the electronic pen 100 displays, in the pointing mode, the coordinate information calculated by the inertial sensor module IMU and the button BTN operation information as an image. It can be transmitted to the device (IMD).

Accordingly, reduction or enlargement of the object may be selected, and eventually, the object OHJ may be reduced or enlarged.

9A (a) illustrates that the button BTN of the electronic pen 100 is pressed.

9A (b) illustrates that the button BTN of the electronic pen 100 moves in one direction while the button BTN is pressed.

9B shows an example of the structure of a button.

A pressure sensor TSS is disposed under the button BTN, and a tact switch TSW may be disposed at one side of the pressure sensor TSS.

In this case, one side of the pressure sensor TSS may correspond to the one direction of FIG. 9A (b).

The controller 480 of the electronic pen 100 may control to switch from the pen mode to the electronic pen mode when the button BTN is moved in one direction in a pressed state.

Meanwhile, when the button BTN is pressed during the pointing mode operation, the communication unit 420 may transmit motion information sensed by the inertial sensor module IMU and operation information of the button BTN to the outside.

Meanwhile, when there is a signal sensed by the pressure sensor TSS during the pointing mode operation, the communication unit 420 transmits the motion information sensed by the inertial sensor module IMU and the sensing information of the pressure sensor TSS to the outside. can Accordingly, zoom-in/zoom-out in the pointing mode, variable depth, and the like are possible.

Meanwhile, the communication unit 420 may transmit level information of a signal sensed by the pressure sensor TSS to the outside together with motion information. Accordingly, zoom-in/zoom-out in the pointing mode, variable depth, and the like are possible.

For example, when the force value of the signal sensed by the pressure sensor TSS increases, the depth in the pointing mode may increase.

As another example, when the force value of the signal sensed by the pressure sensor TSS is maintained, the depth in the pointing mode may be maintained.

As another example, when the force value of the signal sensed by the pressure sensor TSS decreases, the depth in the pointing mode may decrease.

On the other hand, as the amount of movement in one direction increases while the button BTN is pressed, it is also possible that the force value of the signal sensed by the pressure sensor TSS increases.

As another example, when the button BTN moves in one direction and the opposite direction in a pressed state, a force value of a signal sensed by the pressure sensor TSS may be reduced.

10 is a flowchart illustrating an example of a method of operating an electronic pen according to an embodiment of the present invention.

Referring to the drawing, the electronic pen 100 recognizes a hover input based on the optical module OCU (S1010).

When the electronic pen 100 gradually approaches the display DS or the bottom surface of the mobile terminal MOB, based on the optical output module 458 and the optical sensor 448 in the optical module OCU, reception The intensity of the received light may gradually increase.

For example, when the level of the optical signal sensed by the optical sensor 448 is less than the reference level, the controller 480 controls to operate in the pointing mode, and the level of the optical signal sensed by the optical sensor 448 is the reference level. When the level is higher than the level, the controller 480 may control to operate in the pen mode.

In addition, when the intensity of the received light gradually increases while the level of the optical signal sensed by the optical sensor 448 is equal to or greater than the reference level, the controller 480 may recognize a hover input, which is a previous stage of the pen input.

Next, after the intensity of the received light gradually increases while the level of the optical signal sensed by the sensor 448 is equal to or greater than the reference level, the electronic pen 100 comes into contact with the display DS or the bottom surface of the mobile terminal MOB. In this case, the control unit 480 may detect the pen pressure through the pen tip (PTP) (S1015).

For example, the controller 480 may sense the pen pressure according to the pressed strength of the pen tip PTP. At this time, as the intensity with which the pen tip PTP is pressed increases, the intensity of the signal of the sensed electromagnetic field increases, and accordingly, it can be sensed that the pen pressure becomes stronger.

Meanwhile, the controller 480 may calculate coordinate information according to the operations of the light output module 458 and the light sensor 448 ( S1020 ).

For example, when the level of the electromagnetic field signal input during the pen mode operation is equal to or less than the reference value, the controller 480 determines that the position of the pen tip PTP is out of the display IDS of the external electronic device during the pen mode operation and, according to the operations of the light output module 458 and the light sensor 448 , coordinate information may be calculated.

As another example, when the level of the electromagnetic field signal input during the pen mode operation exceeds the reference value, the controller 480 determines that the position of the pen tip PTP is within the display IDS of the external electronic device during the pen mode operation. and, according to the operations of the light output module 458 and the light sensor 448 , coordinate information may be calculated.

Next, the controller 480 corrects the calculated coordinate information according to the operations of the light output module 458 and the light sensor 448 based on the motion information sensed by the inertial sensor module (IMU) during the pen mode operation. It can be done (S1030).

For example, when the level of the electromagnetic field signal input during the pen mode operation is equal to or less than the reference value, the controller 480 determines that the position of the pen tip PTP is out of the display IDS of the external electronic device during the pen mode operation Then, coordinate information may be calculated according to the operations of the light output module 458 and the light sensor 448 , and the calculated coordinate information may be corrected based on the motion information sensed by the inertial sensor module (IMU).

As another example, when the level of the electromagnetic field signal input during the pen mode operation exceeds the reference value, the controller 480 determines that the position of the pen tip PTP is within the display IDS of the external electronic device during the pen mode operation. Then, coordinate information may be calculated according to the operations of the light output module 458 and the light sensor 448 , and the calculated coordinate information may be corrected based on the motion information sensed by the inertial sensor module (IMU).

Next, the communication unit 420 may transmit the calculated coordinate information to the paired mobile terminal (MOB) (S1035).

For example, the controller 480 may control the communication unit ( The 420 may transmit the calibrated coordinate information to the paired mobile terminal (MOB). Accordingly, the mobile terminal (MOB) can receive accurate coordinate information.

As another example, when the level of the electromagnetic field signal input during the pen mode operation exceeds the reference value, that is, when the position of the pen tip PTP is within the display IDS of an external electronic device, the communication unit 420 performs a correction operation The coordinate information may not be transmitted to the paired mobile terminal (MOB).

Instead, the electronic pen 100 may transmit an electromagnetic field signal of a frequency or level varied from the electromagnetic sensor EMS to a mobile terminal MOB having an electronic pen sensing device (not shown).

On the other hand, when the level of the electromagnetic field signal input during the pen mode operation exceeds the reference value, that is, even when the position of the pen tip PTP is within the display IDS of an external electronic device, the communication unit 420 performs the correction The calculated coordinate information may be transmitted to the paired mobile terminal (MOB).

Meanwhile, when the button operation is performed (S1038), the controller 480 may stop transmitting coordinate information to the paired mobile terminal (MOB) (S1040). Accordingly, it is possible to simply stop the transmission of coordinate information in the pen mode.

11 is a flowchart illustrating another example of an operating method of an electronic pen according to an embodiment of the present invention, and FIGS. 12A to 12E are diagrams referred to in the description of the operating method of FIG. 11 .

Referring to the drawing, the power is turned on according to the operation of the button BTN (S1105).

Then, the electronic pen 100 determines whether it is in the writing mode, that is, in the pen mode (S1110),

For example, the electronic pen 100 may determine whether the pen mode is the pen mode or the pointing mode based on the optical module OCU.

Specifically, when the level of the optical signal sensed by the optical sensor 448 is equal to or greater than the reference level, the controller 480 may control the writing mode or the pen mode to be performed.

Accordingly, the controller 480 may activate the electromagnetic sensor EMS (S1115) and activate the optical module OCU (S1120).

Next, the controller 480 senses the electromagnetic field through the electromagnetic sensor EMS, and when the sensed electromagnetic field strength exceeds the reference value, the electronic pen 100 is determined to be in the display DS of the mobile terminal MOB. After determining, the electromagnetic sensor EMS may vary the frequency or level of the input electromagnetic field signal and output it to the outside ( S1124 ).

12A illustrates that the electronic pen 100 gradually approaches the mobile terminal (MOB).

Accordingly, the level of the optical signal received by the optical sensor 448 gradually increases.

12B illustrates that the electronic pen 100 contacts the display DS of the mobile terminal MOB. In particular, it exemplifies that the pen tip PTP contacts the display DS of the mobile terminal MOB.

Accordingly, the electronic pen sensing device (not shown) of the mobile terminal (MOB) may calculate coordinate information corresponding to the handwritten content based on the frequency or level of the changed electromagnetic field signal.

Then, on the display DS of the mobile terminal MOB, as shown in FIG. 12B , characters such as “LG”, which are handwritten contents, are displayed.

Next, in step 1122 ( S1122 ), when the intensity of the sensed electromagnetic field is equal to or less than the reference value, the controller 480 may determine that the electronic pen 100 has moved out of the display DS of the mobile terminal MOB.

Then, in a state in which the electronic pen 100 is out of the display DS of the mobile terminal MOB, it is determined whether or not pairing with the mobile terminal is performed (S1126). If the pairing is not performed, the communication unit 420 ) may transmit a pairing request signal to the mobile terminal (MOB) and receive a pairing response signal from the mobile terminal (MOB) to perform pairing (S1128).

Next, after pairing is performed, the communication unit 420 may transmit the calculated coordinate information to the outside according to the operations of the light output module 458 and the light sensor 448 in the pen mode ( S1129 ).

That is, in the pen mode, when the level of the electromagnetic field signal sensed by the electromagnetic sensor EMS is less than or equal to the reference value, the controller 480 determines that the electronic pen 100 is out of the display DS of the mobile terminal MOB. can

And, in the pen mode, when the level of the electromagnetic field signal sensed by the electromagnetic sensor (EMS) is less than or equal to the reference value, the controller 480 calculates coordinate information based on the continuously received received light, and calculates the calculated coordinate information. , can be controlled to be transmitted to the paired mobile terminal (MOB).

Accordingly, the communication unit 420 transmits coordinate information according to the pen mode to the paired mobile terminal (MOB) through the RF module 421 or the like.

Accordingly, on the display DS of the mobile terminal MOB, as shown in FIG. 12C , characters such as “LG”, which are handwritten contents, are displayed.

Meanwhile, in step 1110 ( S1110 ), the controller 480 may determine whether it is a pointing mode instead of a writing mode or a pen mode ( S1130 ), and, if applicable, may control the controller 480 to operate in the pointing mode.

Specifically, when the level of the optical signal sensed by the optical sensor 448 is less than the reference level, the controller 480 may control the operation in the pointing mode.

Then, the controller 480 may control the inertial sensor module (IMU) to be activated (S1132).

And, the control unit 480, through the communication unit 230, may control to perform pairing with the image display device (IMD) (S1134),

Next, the communication unit 230 may transmit pointing information corresponding to the movement of the electronic pen 100 in the pointing mode to the paired image display device IMD (S1136).

12D illustrates selecting an object in the image display device IMD according to the pointing mode.

Referring to the drawings, the communication unit 420 of the electronic pen 100 may transmit coordinate information calculated based on sensing information of the inertial sensor module IMU to the image display device IMD in the pointing mode.

Accordingly, a pointer or the like may be displayed on the image display device IMD.

On the other hand, in the pointing mode, when the button BTN of the electronic pen 100 operates, the image display device IMD performs a specific display displayed on the image display device IMD as shown in FIG. 12D based on coordinate information or the like. You can select an object (OBJ).

Next, FIG. 12E illustrates that the electronic pen 100 moves to the right while the button BTN is pressed.

Accordingly, in the pointing mode, the communication unit 420 of the electronic pen 100 displays the calculated coordinate information and the button BTN operation information based on the sensing information of the inertial sensor module (IMU) to the image display device (IMD). ) can be transmitted.

The image display device IMD causes the selected object OHJ to be dragged to the right as shown in the drawing, based on the coordinate information and the button BTN operation information. Accordingly, a drag operation in the pointing mode is enabled.

In the above, preferred embodiments of the present invention have been illustrated and described, but the present invention is not limited to the specific embodiments described above, and it is common in the technical field to which the present invention pertains without departing from the gist of the present invention as claimed in the claims. Various modifications are possible by those having the knowledge of, of course, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

Claims (19)

1. case;

   a pen tip disposed on one end of the case, one end of which is exposed to the outside;

   an electromagnetic sensor having a coil and a capacitor, the electromagnetic sensor varying the frequency or level of the input electromagnetic field signal and outputting it to the outside;

   a light output module disposed in the case and outputting light to the outside;

   an optical sensor disposed in the case and configured to sense received light corresponding to the light output from the light output module;

   an inertial sensor module disposed in the case and sensing motion;

   a button disposed on the case;

   and a communication unit disposed in the case and exchanging data with an external electronic device;

   The communication unit,

   When the position of the pen tip is outside the display of the external electronic device during pen mode operation, the calculated coordinate information is transmitted to the outside according to the operations of the light output module and the light sensor,

   The electronic pen, characterized in that during the pointing mode operation, the inertial sensor module transmits the calculated coordinate information to the outside.
2. According to claim 1,

   In the pen mode operation, based on the operations of the light output module and the light sensor, a control unit for calculating coordinate information;

   When the position of the pen tip is out of the display of the external electronic device during the pen mode operation,

   The communication unit,

   The electronic pen according to the operation of the optical output module and the optical sensor, characterized in that the calculated coordinate information is transmitted to the outside.
3. According to claim 1,

   The communication unit,

   In the pen mode, when the button operates while transmitting the calculated coordinate information to the outside according to the operations of the optical output module and the optical sensor, the electronic pen stops transmitting the coordinate information.
4. According to claim 1,

   The communication unit,

   The electronic pen, characterized in that, when the position of the pen tip is within the display of the external electronic device during the pen mode operation, the calculated coordinate information is not transmitted to the outside.
5. According to claim 1,

   When the level of the input electromagnetic field signal is less than a reference value during the pen mode operation,

   The communication unit,

   In the pen mode, the electronic pen is characterized in that the calculated coordinate information is transmitted to the outside according to the operations of the light output module and the light sensor.
6. According to claim 1,

   When the position of the pen tip is out of the display of the external electronic device during the pen mode operation and is not paired with the electronic device,

   The communication unit,

   Transmitting a pairing request signal to the electronic device, receiving a pairing response signal from the electronic device, performing pairing, and after performing the pairing,

   In the pen mode, the electronic pen is characterized in that the calculated coordinate information is transmitted to the outside according to the operations of the light output module and the light sensor.
7. According to claim 1,

   When the level of the input electromagnetic field signal is less than or equal to a reference value during the pen mode operation and not paired with the electronic device,

   The communication unit,

   Transmitting a pairing request signal to the electronic device, receiving a pairing response signal from the electronic device, performing pairing, and after performing the pairing,

   In the pen mode, the electronic pen is characterized in that the calculated coordinate information is transmitted to the outside according to the operations of the light output module and the light sensor.
8. According to claim 1,

   When the level of the optical signal sensed by the optical sensor is greater than or equal to the reference level, control to operate in the pen mode, and control to operate in the pointing mode when the level of the optical signal sensed by the optical sensor is less than the reference level Control unit; Electronic pen characterized in that it further comprises.
9. According to claim 1,

   The electronic pen according to claim 1, further comprising: a control unit configured to operate in a pen mode according to a first operation of the button, and to operate in a pointing mode according to a second operation of the button.
10. According to claim 1,

    a pressure sensor sensing the pressure of the button;

    When the first sensing signal is received from the pressure sensor, the control unit controls to operate in the pen mode, and when the second sensing signal is received from the pressure sensor, a control unit for controlling the operation in the pointing mode; characterized by further comprising: electronic pen.
11. According to claim 1,

    wherein the inertial sensor module continuously senses motion information during pen mode operation.
12. According to claim 1,

    and a controller configured to operate in a standby mode when there is no motion sensed by the inertial sensor module during the pointing mode or the pen mode operation.
13. According to claim 1,

    The communication unit,

    The electronic pen, characterized in that when the button is pressed during the pointing mode operation, the movement information sensed by the inertial sensor module and the button operation information are transmitted to the outside.
14. case;

    a pen tip disposed on one end of the case, one end of which is exposed to the outside;

    an electromagnetic sensor having a coil and a capacitor, the electromagnetic sensor varying the frequency or level of the input electromagnetic field signal and outputting it to the outside;

    a light output module disposed in the case and outputting light to the outside;

    an optical sensor disposed in the case and configured to sense received light corresponding to the light output from the light output module;

    an inertial sensor module disposed in the case and sensing motion;

    a button disposed on the case;

    and a communication unit disposed in the case and exchanging data with an external electronic device;

    The communication unit,

    In the case of the pen mode, the calculated coordinate information is transmitted to the outside according to the operation of the light output module and the light sensor,

    In the pointing mode, the electronic pen characterized in that the inertial sensor module transmits the calculated coordinate information to the outside.
15. An electromagnetic sensor for outputting to the outside by varying the frequency or level of an electromagnetic field signal input from the outside, a light output module for outputting light, and an optical sensor for sensing received light corresponding to the light output from the light output module; an electronic pen including an inertial sensor module for sensing motion;

    A display is provided, wherein when the electronic pen is in the display during pen mode operation, a frequency or level-varied electromagnetic field signal is received from the electronic pen, and when the electronic pen leaves the display during the pen mode operation, the electronic pen a mobile terminal for wirelessly receiving coordinate information from a pen;

    and an image display device configured to receive motion information sensed by the inertial sensor module from the electronic pen in a pointing mode.
16. 16. The method of claim 15,

    When the position of the electronic pen is out of the display of the mobile terminal during the pen mode operation and is not paired with the mobile terminal,

    The electronic pen is

    Transmitting a pairing request signal to the mobile terminal, receiving a pairing response signal from the mobile terminal, performing pairing, and after performing the pairing,

    The electronic pen system, characterized in that in the pen mode, the calculated coordinate information is transmitted to the outside according to the operations of the light output module and the light sensor.
17. 16. The method of claim 15,

    When the level of the electromagnetic field signal sensed by the electronic pen is less than or equal to a reference value during the pen mode operation, and is not paired with the mobile terminal,

    The electronic pen is

    Transmitting a pairing request signal to the mobile terminal, receiving a pairing response signal from the mobile terminal, performing pairing, and after performing the pairing,

    The electronic pen system, characterized in that in the pen mode, the calculated coordinate information is transmitted to the outside according to the operations of the light output module and the light sensor.
18. 16. The method of claim 15,

    The electronic pen system, wherein the electronic pen operates in the pen mode or the pointing mode according to a button operation of the electronic pen.
19. 16. The method of claim 15,

    The electronic pen system, wherein the electronic pen operates in a standby mode when there is no movement sensed by the inertial sensor module during the pointing mode or the pen mode operation of the electronic pen.

Images