KR20240001638A - Electronic device recogniging electronic pen - Google Patents

Abstract

An electronic device according to an embodiment disclosed in this document includes a display panel, a touch panel, a digitizer panel, a memory, and a processor, wherein the processor receives a first signal from an electronic pen using the digitizer panel, and , receiving a second signal from the electronic pen using the touch panel, determining a first coordinate value of the electronic pen based on the first signal, and determining a second coordinate value of the electronic pen based on the second signal. A coordinate value may be determined, the first coordinate value and the second coordinate value may be compared, and the first coordinate value may be corrected through the comparison. In addition to this, various embodiments identified through the specification are possible.

Description

Electronic device recognizing an electronic pen {ELECTRONIC DEVICE RECOGNIGING ELECTRONIC PEN}

Various embodiments disclosed in this document relate to an electronic device that recognizes an electronic pen.

Electronic devices such as smartphones and tablet PCs can recognize a user's touch input through a touch panel or input using an electronic pen through a digitizer panel. Electronic pens can be implemented in various forms, such as electromagnetic resonance (EMR), pressure-sensitive, and capacitive. For example, in the case of the electromagnetic resonance method, the electronic device can recognize the coordinates of the electronic pen using the electromagnetic resonance of the electronic pen and the digitizer panel.

The electronic device can determine the coordinate value of the electronic pen using a signal transmitted from the electronic pen. If the signal transmitted from the electronic pen is distorted due to magnetic materials inside or around the electronic device, the coordinate values recognized by the electronic device may differ from the actual coordinate values of the electronic pen. For example, the signal that recognizes the electronic pen may be distorted in the vicinity of components containing magnetic materials (e.g., magnets), such as speakers, motors, or camera modules. For another example, when an accessory device such as a book cover/keyboard cover is attached to an electronic device, a signal that recognizes the electronic pen may be distorted due to the magnetic material attached to the accessory device.

To prevent distortion of the signal that recognizes the electronic pen, during the manufacturing process of electronic devices, calibration of the digitizer panel can be performed using samples with typical magnetic values of components containing magnetic materials such as speakers, motors, or camera modules. there is. Mapping values according to calibration may be stored in advance in the electronic device. In the process of using the electronic device, the electronic device may correct the coordinate value of the electronic pen by referring to the stored mapping value.

If the mapping value according to the calibration is stored in advance during the manufacturing process, the signal that recognizes the electronic pen may be distorted due to the large variation in magnetic force between magnetic materials. In addition, as large and thick shielding SUS (stainless) is applied to prevent magnetic force deviation as much as possible, there is a problem that the internal space of the electronic device is reduced. There is also a deviation in the attachment of the digitizer panel, so the mapping value by calibration may not be accurate.

The electronic device may include a component that detects attachment of an accessory device. For example, an electronic device can use a Hall IC to detect whether a book cover is attached to the electronic device. For another example, an electronic device can detect whether a keyboard cover is attached to the electronic device using a Hall IC and a pogo pin.

The electronic device can store calibration mapping values corresponding to each attached accessory device. When an accessory device is attached to an electronic device, the electronic device may determine the coordinate value of the electronic pen by referring to a mapping value corresponding to the attached accessory device. In this case, the electronic device may include components that detect the attachment of accessory devices (e.g., Hall ICs and passive components), increasing manufacturing costs.

Various embodiments may provide an electronic device that corrects distortion of an electronic pen detection signal caused by a magnetic material.

An electronic device according to various embodiments includes a display panel, a touch panel, a digitizer panel, a memory, and a processor, where the processor receives a first signal from an electronic pen using the digitizer panel and operates the touch panel. Receive a second signal from the electronic pen, determine a first coordinate value of the electronic pen based on the first signal, and determine a second coordinate value of the electronic pen based on the second signal, and , the first coordinate value and the second coordinate value can be compared, and the first coordinate value can be corrected by the comparison.

Electronic devices according to various embodiments disclosed in this document can accurately determine coordinate values of an electronic pen using a touch panel and a digitizer panel. Through this, the electronic device can accurately determine the position of the electronic pen without external jig connection or separate correction work.

The electronic device according to various embodiments disclosed in this document can accurately determine the coordinate value of the electronic pen by detecting a signal caused by a magnetic field and a signal caused by an electric field generated by the electronic pen.

Electronic devices according to various embodiments disclosed in this document can improve the accuracy of electronic pen recognition by performing calibration when the signal due to the magnetic field is distorted due to the surrounding magnetic material and a difference between the electric field signal and the magnetic field signal occurs. there is.

Electronic devices according to various embodiments disclosed in this document can increase material yield by generously setting the standard value (Gauss value) of magnetic materials, and include SUS (stainless) for shielding magnetic force and elements for confirming accessory attachment. material costs can be reduced.

1 is a block diagram of an electronic device in a network environment according to various embodiments.
2 shows an electronic device according to various embodiments.
Figure 3 shows a digitizer panel according to various embodiments.
Figure 4 illustrates the generation of a second signal in an electronic pen according to various embodiments.
Figure 5 is a flowchart showing a method of recognizing an electronic pen using a first signal and a second signal according to various embodiments.
FIG. 6 is a flowchart illustrating an electronic pen recognition method when storing the position of a magnetic body in advance according to various embodiments.
Figure 7 is an example of correction using a designated pattern according to various embodiments.
Figure 8 is a flowchart showing a method of recognizing an electronic pen using a first signal and a second signal according to various embodiments.
In relation to the description of the drawings, identical or similar reference numerals may be used for identical or similar components.

Hereinafter, various embodiments of this document are described with reference to the attached drawings. However, this is not intended to limit the technology described in this document to specific embodiments, and should be understood to include various modifications, equivalents, and/or alternatives to the embodiments of this document. . In connection with the description of the drawings, similar reference numbers may be used for similar components.

1 is a block diagram of an electronic device 101 in a network environment 100, according to various embodiments. Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 120 stores commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes a main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, co-processor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself, where artificial intelligence is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit signals or power to or receive signals or power from the outside (e.g., an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected to the plurality of antennas by, for example, the communication module 190. can be selected. Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., mmWave band), And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external electronic devices 102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external electronic devices 102, 104, or 108. For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

Figure 2 shows an electronic device according to various embodiments.

Referring to FIG. 2, the electronic device 201 (e.g., the electronic device 101 in FIG. 1) includes a housing (or main body portion) 205 and a display 210 (e.g., the display module 160 in FIG. 1). may include. The electronic device 201 may additionally include components such as a camera module, button, sensor, and microphone.

The housing 205 may expose at least a portion of the display 210 to the outside. The housing 205 has a processor (e.g., the processor 120 in FIG. 1), a memory (e.g., the memory 130 in FIG. 1), and a sensor module (e.g., the processor in FIG. 1) for driving the electronic device 201 therein. sensor module 176), a printed circuit board (e.g., printed circuit board (PCB), printed board assembly (PBA), flexible PCB (FPCB), or rigid-flexible PCB (RFPCB)), a battery (e.g., the battery of FIG. 1 (189)).

The display 210 (eg, the display module 160 in FIG. 1) can output various contents provided to the user. The display 210 may have a structure in which a plurality of layers are stacked. In one embodiment, display 210 may include a touch panel 260, a display panel 270, and a digitizer panel 280. FIG. 2 mainly shows layers related to recognition of the electronic pen 290, but is not limited thereto.

The touch panel 260 can detect input through contact with the user's body (eg, finger). The touch panel 260 may form an upper layer of the display panel 270.

For example, the touch panel 260 may be implemented in a capacitive manner. The touch panel 260 may include a plurality of transmitting electrodes and a plurality of receiving electrodes. A processor (e.g., processor 120 in FIG. 1) may sequentially transmit a driving voltage through a transmitting electrode and detect a change in capacitance due to a user's touch through a receiving electrode.

The display panel 270 may include a plurality of pixels. The display panel 270 can display images according to the color and luminance of each pixel. For example, the display panel 270 includes a plurality of pixels, each of which includes an organic light emitting diode (OLED), and can display an image by adjusting the amount of driving current flowing through the organic light emitting diode.

The digitizer panel 280 may form a lower layer of the display panel 270. For example, the digitizer panel 280 may be implemented using an electromagnetic resonance (EMR) method.

The digitizer panel 280 may include a plurality of coils therein. Additional information regarding digitizer panel 280 may be provided through FIG. 3 .

The electronic pen 290 may be implemented as a part of the electronic device 201 in a detachable form. Alternatively, the electronic pen 290 may be implemented as a separate device from the electronic device 201.

The electronic pen 290 may transmit a designated first signal (S1) or a second signal (S2) to the electronic device 201. The electronic device 201 determines the coordinate value of the position where the electronic pen 290 is adjacent to or touches the display 210 based on the first signal S1 or the second signal S2 received from the electronic pen 290. You can decide. The electronic device 201 may execute a designated function based on the determined coordinate values.

For example, the electronic device 201 may display a hovering image at a point adjacent to the tip 290a of the electronic pen 290. Alternatively, the electronic device 201 may execute a touch button corresponding to the point where the tip 290a of the electronic pen 290 is contacted.

According to one embodiment, the electronic pen 290 may transmit a first signal (S1) by a magnetic field or a second signal (S2) by an electric field to the electronic device 201. The first signal S1 may be a magnetic field signal induced by a signal generated from the digitizer panel 280 of the electronic device 201 (EMR method). The first signal S1 may be detected through the digitizer panel 280. The second signal S2 may be an electric field signal induced by a signal generated from the touch panel 260. Alternatively, the second signal S2 may be an electric field signal generated inside the electronic pen 290. The second signal S2 can be sensed through the touch panel 260.

The processor of the electronic device 201 (e.g., the processor 120 of FIG. 1) may enter a correction mode to correct the position of the electronic pen 290 according to a designated method. In the correction mode, the processor 120 can accurately recognize the coordinate value of the electronic pen 290 using the first signal S1 or the second signal S2. Additional information regarding correction mode can be provided through FIG. 5.

According to various embodiments, the electronic device 201 may further include a touch control circuit (not shown) that controls the touch panel 260 and processes signals received through the touch panel 260. Hereinafter, at least part of the operation of the processor 120 may be performed through a touch control circuit.

According to various embodiments, the electronic device 201 may further include a sensor circuit (not shown) that controls the digitizer panel 280 and processes signals received through the digitizer panel 280. Hereinafter, at least part of the operation of the processor 120 may be performed through a sensor circuit.

Figure 3 shows a digitizer panel according to various embodiments. Figure 3 is illustrative and not limited thereto.

Referring to FIG. 3, the digitizer panel 280 may include at least one loop coil capable of generating a magnetic field. The digitizer panel 280 can detect input from the electronic pen 290 using an Electro-Magnetic Resonance (EMR) method. The digitizer panel 280 may include a plurality of loop coils and a sensor circuit for position tracking the tip 290a of the electronic pen 290.

According to various embodiments, the digitizer panel 280 may include at least one vertical loop coil 281 and at least one horizontal loop coil 282. At least one vertical loop coil 281 and at least one horizontal loop coil 282 may be arranged in a matrix form by crossing each other. For example, the digitizer panel 280 includes a substrate 285, at least one vertical loop coil 281 is disposed on one side of the substrate 285, and at least one vertical loop coil 281 is disposed on the other side of the substrate 285. One horizontal loop coil 282 may be placed.

At least one vertical loop coil 281 and at least one horizontal loop coil 282 may generate a magnetic field signal S0 according to the input current. The generated magnetic field may be transmitted to the electronic pen 290. The electronic pen 290 may include a resonance circuit 290b having a capacitor and a coil. The resonance circuit 290b may generate a resonance signal (first signal, S1) corresponding to the magnetic field signal (S0) generated in the digitizer panel 280.

The first signal S1 generated from the electronic pen 290 may be detected through at least one vertical loop coil 281 and at least one horizontal loop coil 282. An electronic device (e.g., the electronic device 201 of FIG. 2) including the digitizer panel 280 determines whether the tip 290a of the electronic pen 290 is close or close based on signals detected by the loop coils 281 and 282. The coordinates of the touched location can be determined.

Figure 4 illustrates the generation of a second signal in an electronic pen according to various embodiments.

Referring to FIG. 4 , the electronic pens 410 and 420 may transmit second signals S2-1 and S2-2 to the touch panel 260. The second signals S2-1 and S2-2 may be electric field signals detected through the touch panel 260.

The first type electronic pen 410 may output a second signal S2-1 induced by the signal SE generated from the touch panel 260. The electronic pen 410 may include a resonance circuit 415 . The resonance circuit 415 may resonate with the electric field signal SE transmitted from the touch panel 260 to generate the second signal S2-1.

According to one embodiment, the electronic pen 410 may include a variable capacitor (VC) type pen pressure module. For example, the control circuit 261 of the touch panel 260 induces the second signal S2-1 through energy build-up in the first section, and induces the second signal S2-1 in the second section. Attenuation can be detected. The control circuit 261 of the touch panel 260 may detect a change in pen pressure based on a change in frequency of the second signal S2-1.

According to one embodiment, the resonance circuit 415 may also resonate with a magnetic field signal (eg, signal S0 in FIG. 3) generated from the digitizer panel 280. In this case, the resonance circuit 415 may generate a first signal (eg, the first signal S1 in FIG. 3) detected by the digitizer panel 280.

The second type electronic pen 420 may output a second signal S2-2, which is an electric field signal directly generated by the electronic pen 420. For example, the electronic pen 420 may include a battery 421, a control circuit 422, and a signal generator 425. The electronic pen 420 may generate a second signal S2-2, which is a designated electric field signal, using the power of the battery 421.

According to one embodiment, the electronic pen 420 may include an optical pen pressure module. For example, the control circuit 261 of the touch panel 260 may detect an optical signal generated by a photo diode of the pen pressure module.

According to one embodiment, the electronic pen 420 may include a separate resonance circuit (not shown). The resonance circuit may resonate with the magnetic field signal generated from the digitizer panel 280 to generate a first signal (eg, the first signal S1 in FIG. 3).

Figure 5 is a flowchart showing a method of recognizing an electronic pen using a first signal and a second signal according to various embodiments.

Referring to FIGS. 2 and 5 , in operation 510, the processor of the electronic device 201 (e.g., the processor 120 of FIG. 1 ) sends the first signal S1 or the second signal S2 according to specified conditions. You can enter a mode for correcting the coordinate values of the electronic pen 290 (hereinafter referred to as correction mode). For example, when the processor 120 recognizes the electronic pen 290 for the first time, when the electronic device 201 is set up for the first time after initialization, when recognizing an accessory device, or when detecting separation of an accessory device. , you can enter correction mode.

In operation 520, the processor 120 may receive the first signal S1 and the second signal S2 from the electronic pen 290. The processor 120 may detect the first signal S1 using the digitizer panel 280 and the second signal S2 using the touch panel 260.

When entering the correction mode, the processor 120 may guide the user to touch (or approach) the electronic pen 290 at a designated location. For example, the designated location may be determined based on the location of the magnetic material inside the electronic device 201.

The first signal S1 may be a magnetic field signal induced in response to the magnetic field signal S0 generated in the digitizer panel 280. The second signal S2 may be an electric field signal induced by a signal generated from the touch panel 260 or an electric field signal generated inside the electronic pen 290.

According to one embodiment, when the second signal S2 is an electric field signal generated inside the electronic pen 290, the processor 120 transmits a signal requesting the electronic pen 290 to output the second signal, and , In response to this, the second signal S2 output from the electronic pen 290 can be received.

In operation 530, the processor 120 may determine a first coordinate value based on the first signal S1 and a second coordinate value based on the second signal S2. The processor 120 may determine the first coordinate value by matching the first signal S1 received through the digitizer panel 280 with pre-stored first mapping data. The processor 120 may determine the second coordinate value by matching the second signal S2 received through the touch panel 260 with pre-stored second mapping data.

In operation 540, the processor 120 may compare the first coordinate value and the second coordinate value to determine a point at which the difference is greater than (or greater than) a reference value (hereinafter referred to as a signal distortion point). For example, the processor 120 may determine a point where the difference between the first coordinate value and the second coordinate value is 2 or more in coordinate distance as the signal distortion point.

In operation 550, the processor 120 may update the first mapping data at the signal distortion point. The processor 120 may update the coordinate value corresponding to the first signal S1 of the signal distortion point to the second coordinate value determined by the second signal.

FIG. 6 is a flowchart illustrating an electronic pen recognition method when storing the position of a magnetic body in advance according to various embodiments.

Referring to FIGS. 2 and 6 , in operation 605, the processor of the electronic device 201 (e.g., the processor 120 of FIG. 1 ) preliminarily creates an area adjacent to the magnetic material on the display 210 (hereinafter referred to as the magnetic material placement area). You can save it. For example, at the time of manufacturing the electronic device 201, the processor 120 may store a designated range around the location where the speaker is mounted as a magnetic material placement area.

In operation 610, the processor 120 may enter a correction mode in which the position of the electronic pen 290 is corrected using the first signal S1 according to a specified condition. For example, when the processor 120 recognizes the electronic pen 290 for the first time, when the electronic device 201 is set up for the first time after initialization, when recognizing an accessory device, or when detecting separation of an accessory device. , you can enter correction mode.

In operation 620, the processor 120 may display a designated pattern in the magnetic material placement area. For example, the specified pattern may be in the form of a grid.

In operation 630, the processor 120 may receive a designated input using the electronic pen 290 corresponding to the designated pattern. For example, if the designated pattern is in the form of a grid, the designated input may be an input of drawing along the lines of the grid using the electronic pen 290. For another example, when the designated pattern is in the form of a grid, the designated input may be an input that draws along lines between lines of the grid using the electronic pen 290. The processor 120 may output an example drawing or message that allows the user to generate a designated input using the electronic pen 290.

In operation 640, the processor 120 may detect the first signal S1 corresponding to the designated input using the digitizer panel 280. The first signal S1 may be a magnetic field signal that resonates in response to the magnetic field signal S0 generated in the digitizer panel 280.

In operation 650, the processor 120 compares the first coordinate value of the first signal S1 with a pre-stored reference coordinate value corresponding to a designated pattern, and selects a signal distortion point where the difference is greater than (or greater than) the reference value. You can decide. For example, the processor 120 may determine a point where the difference between the first coordinate value and the reference coordinate value is 2 or more in coordinate distance as the signal distortion point.

In operation 660, the processor 120 may update mapping data of the signal distortion point. The signal distortion point may be a point where distortion of the first signal S1 occurs due to a magnetic material. The processor 120 may apply a correction algorithm to attenuate the influence of the magnetic material and map the coordinate value corresponding to the first signal S1 at the signal distortion point to the reference coordinate value.

Figure 7 is an example of correction using a designated pattern according to various embodiments.

Referring to FIG. 7 , the processor 120 may store the magnetic material placement area 710 in the display 210 in advance. The processor 120 may display a pattern 720 on the magnetic material placement area 710 . For example, the pattern 720 may be in the form of a grid.

The processor 120 may receive designated input using the electronic pen 290. If the pattern 720 is in the form of a grid, the designated input may be an input of drawing along the lines of the grid using the electronic pen 290. The processor 120 may output an example drawing or message so that the user generates a designated input using the electronic pen 290.

The processor 120 may detect the first signal S1 corresponding to the designated input using the digitizer panel 280. The first signal S1 may be a magnetic field signal that resonates in response to the magnetic field signal generated in the digitizer panel 280.

The processor 120 may compare the first coordinate value of the first signal S1 with a pre-stored reference coordinate value corresponding to a designated pattern to determine a signal distortion point. For example, when the first point is a signal distortion point and the first coordinate value is determined to be (x5, y2), the processor 120 maps the first coordinate value to (x2, y2) by the reference coordinate value. can do.

Figure 8 is a flowchart showing a method of recognizing an electronic pen using a first signal and a second signal according to various embodiments.

Referring to FIGS. 2 and 8 , in operation 810, the processor 120 may receive a first signal S1 from the electronic pen 290. The first signal S1 may be a magnetic field signal that resonates in response to the magnetic field signal S0 generated in the digitizer panel 280. The processor 120 may detect the first signal S1 using the digitizer panel 280.

In operation 815, the processor 120 may determine a first coordinate value based on the first signal S1. The processor 120 may determine a first coordinate value for the first signal S1 received through the digitizer panel 280 by referring to pre-stored first mapping data.

In operation 820, the processor 120 may receive the second signal S2 from the electronic pen 290 according to a specified condition. For example, the specified condition may be the passage of a specified time or recognition of the electronic pen 290 in the magnetic material placement area.

The second signal S2 may be an electric field signal induced by a signal generated from the touch panel 260 or an electric field signal generated inside the electronic pen 290. The processor 120 may detect the second signal S2 using the touch panel 260.

In operation 825, the processor 120 may determine a second coordinate value using the second signal S2. The processor 120 may determine a second coordinate value by referring to pre-stored second mapping data for the second signal S2 received through the touch panel 260.

In operation 830, the processor 120 may compare the first coordinate value and the second coordinate value to determine a signal distortion point where the difference is greater than (or greater than) a reference value. For example, the processor 120 may determine a point where the difference between the first coordinate value and the second coordinate value is 2 or more in coordinate distance as the signal distortion point.

In operation 840, the processor 120 may change the coordinate value of the signal distortion point to the second coordinate value determined by the second signal S2 in real time. The processor 120 may update the coordinate value of the signal distortion point in the first mapping data to the second coordinate value.

An electronic device (e.g., the electronic device 101 of FIG. 1 and the electronic device 201 of FIG. 2) according to various embodiments includes a display panel (e.g., the display panel 270 of FIG. 2) and a touch panel (e.g., Touch panel 260 in FIG. 2), digitizer panel (e.g., digitizer panel 280 in FIG. 2), memory (e.g., memory 130 in FIG. 1), and processor (e.g., processor 120 in FIG. 1). It includes, and the processor (e.g., processor 120 of FIG. 1) uses the digitizer panel (e.g., digitizer panel 280 of FIG. 2) to operate an electronic pen (e.g., electronic pen 290 of FIG. 2). ), and receive a second signal from the electronic pen (e.g., the electronic pen 290 of FIG. 2) using the touch panel (e.g., the touch panel 260 of FIG. 2), The first coordinate value of the electronic pen (e.g., the electronic pen 290 of FIG. 2) is determined based on the first signal, and the electronic pen (e.g., the electronic pen (290) of FIG. 2) is determined based on the second signal. 290)), the second coordinate value may be determined, the first coordinate value and the second coordinate value may be compared, and the first coordinate value may be corrected through the comparison.

According to one embodiment, the processor (eg, processor 120 of FIG. 1) may simultaneously receive the first signal and the second signal.

According to one embodiment, the processor (e.g., processor 120 in FIG. 1) may receive the first signal at a first time and receive the second signal at a second time after the first time. there is.

According to one embodiment, the processor (e.g., processor 120 of FIG. 1) may enter a correction mode according to specified conditions and receive the first signal and the second signal.

According to one embodiment, the specified condition may be a condition related to recognition of the electronic pen (eg, the electronic pen 290 of FIG. 2) or recognition of an accessory device.

According to one embodiment, the first signal may be a signal derived in response to a magnetic field signal generated in the digitizer panel (eg, digitizer panel 280 of FIG. 2).

According to one embodiment, the second signal may be a signal induced in response to an electric field signal generated by the touch panel (eg, the touch panel 260 of FIG. 2).

According to one embodiment, the first signal and the second signal are transmitted to the electronic pen (e.g., the electronic device 101 in FIG. 1 and the electronic device 201 in FIG. 2) in response to a signal generated by the electronic device (e.g., the electronic device 101 in FIG. 1 and the electronic device 201 in FIG. 2). Example: It can be generated through a resonance circuit inside the electronic pen 290 of FIG. 2).

According to one embodiment, the second signal may be an electric field signal generated using power inside the electronic pen (eg, the electronic pen 290 of FIG. 2).

According to one embodiment, the processor (e.g., processor 120 in FIG. 1) may correct the first coordinate value when the first coordinate value and the second coordinate value differ by more than a specified range.

According to one embodiment, the processor (eg, processor 120 of FIG. 1) may update mapping data that determines the first coordinate value through the comparison.

According to one embodiment, the processor (e.g., processor 120 of FIG. 1) has a magnetic material disposed inside the electronic device (e.g., electronic device 101 of FIG. 1 and electronic device 201 of FIG. 2). The area can be stored in the memory (eg, memory 130 in FIG. 1).

According to one embodiment, the processor (eg, processor 120 in FIG. 1) may display a designated pattern in the area.

According to one embodiment, the pattern may be in the form of a grid.

According to one embodiment, the processor (e.g., processor 120 of FIG. 1) receives a designated input using the electronic pen (e.g., electronic pen 290 of FIG. 2) in the pattern, and The first coordinate value can be corrected by comparing the set coordinate value with the first coordinate value.

A method for recognizing an electronic pen (e.g., the electronic pen 290 of FIG. 2) according to various embodiments is performed in an electronic device (e.g., the electronic device 101 of FIG. 1 and the electronic device 201 of FIG. 2), An operation of entering a correction mode according to specified conditions, a digitizer panel (e.g., digitizer panel 280 of FIG. 2) of the electronic device (e.g., electronic device 101 of FIG. 1, electronic device 201 of FIG. 2) Receive the first signal from the electronic pen (e.g., the electronic pen 290 in FIG. 2) using and An operation of receiving a second signal from the electronic pen (e.g., the electronic pen 290 of FIG. 2) using a touch panel (e.g., the touch panel 260 of FIG. 2), and the electronic pen based on the first signal. Determine the first coordinate value of the pen (e.g., the electronic pen 290 in FIG. 2), and determine the second coordinate value of the electronic pen (e.g., the electronic pen 290 in FIG. 2) based on the second signal. It may include an operation of determining, and an operation of correcting the first coordinate value by comparing the first coordinate value and the second coordinate value.

According to one embodiment, the specified condition may be a condition related to recognition of the electronic pen (eg, the electronic pen 290 of FIG. 2) or recognition of an accessory device.

According to one embodiment, the first signal may be a signal derived in response to a magnetic field signal generated in the digitizer panel (eg, digitizer panel 280 of FIG. 2).

According to one embodiment, the second signal may be a signal induced in response to the electric field signal generated by the touch panel.

According to one embodiment, the second signal may be an electric field signal generated using power inside the electronic pen (eg, the electronic pen 290 of FIG. 2).

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one component from another, and to refer to that component in other respects (e.g., importance or order) is not limited. One (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.” When mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one or more instructions stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 10) including these. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and this term refers to cases where data is semi-permanently stored in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store (e.g. Play Store™) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar manner as those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

Claims (20)

In electronic devices,
display panel;
touch panel;
digitizer panel;
Memory; and
A processor electrically connected to the display panel, the touch panel, the digitizer panel, and the memory,
The processor,
Receiving a first signal from an electronic pen using the digitizer panel,
Receiving a second signal from the electronic pen using the touch panel,
Determine a first coordinate value of the electronic pen based on the first signal,
Determine a second coordinate value of the electronic pen based on the second signal,
Compare the first coordinate value and the second coordinate value,
An electronic device that corrects the first coordinate value by the comparison. The method of claim 1, wherein the processor
An electronic device that simultaneously receives the first signal and the second signal. The method of claim 1, wherein the processor
Receiving the first signal at a first time,
An electronic device that receives the second signal at a second time after the first time. The method of claim 1, wherein the processor
An electronic device that enters a correction mode and receives the first signal and the second signal according to specified conditions. The method of claim 4, wherein the specified conditions are
An electronic device that is a condition related to recognition of the electronic pen or recognition of the accessory device. The method of claim 1, wherein the first signal is
An electronic device in which a signal is induced in response to a magnetic field signal generated by the digitizer panel. The method of claim 1, wherein the second signal is
An electronic device that is a signal derived in response to an electric field signal generated by the touch panel. The method of claim 1, wherein the first signal and the second signal are
An electronic device generated through a resonance circuit inside the electronic pen in response to a signal generated by the electronic device. The method of claim 1, wherein the second signal is
An electronic device that is an electric field signal generated using power inside the electronic pen. The method of claim 1, wherein the processor
An electronic device that corrects the first coordinate value when the first coordinate value and the second coordinate value differ by more than a specified range. The method of claim 1, wherein the processor
An electronic device that updates mapping data that determines the first coordinate value by the comparison. The method of claim 1, wherein the processor
An electronic device that stores in the memory an area where a magnetic material is disposed inside the electronic device. The method of claim 12, wherein the processor
An electronic device that displays a designated pattern in the area. The method of claim 13, wherein the pattern is
An electronic device in the form of a grid. The method of claim 13, wherein the processor
Receiving a designated input using the electronic pen in the pattern,
An electronic device that corrects the first coordinate value by comparing the first coordinate value with a coordinate value preset in the pattern. In an electronic pen recognition method performed on an electronic device,
An operation to enter a correction mode according to specified conditions;
Receiving a first signal from an electronic pen using a digitizer panel of the electronic device and receiving a second signal from the electronic pen using a touch panel of the electronic device;
determining a first coordinate value of the electronic pen based on the first signal and determining a second coordinate value of the electronic pen based on the second signal; and
A method comprising: comparing the first coordinate value and the second coordinate value and correcting the first coordinate value; The method of claim 16, wherein the specified conditions are
A method that is a condition related to recognition of the electronic pen or recognition of the accessory device. The method of claim 16, wherein the first signal is
A method in which a signal is derived in response to a magnetic field signal generated in the digitizer panel. The method of claim 16, wherein the second signal is
A method in which a signal is induced in response to an electric field signal generated by the touch panel. The method of claim 16, wherein the second signal is
A method in which an electric field signal is generated using power inside the electronic pen.

Images