WO2023121216A1 - Dispositif électronique et procédé associé de prévention de perte de stylo électronique - Google Patents

Dispositif électronique et procédé associé de prévention de perte de stylo électronique Download PDF

Info

Publication number
WO2023121216A1
WO2023121216A1 PCT/KR2022/020824 KR2022020824W WO2023121216A1 WO 2023121216 A1 WO2023121216 A1 WO 2023121216A1 KR 2022020824 W KR2022020824 W KR 2022020824W WO 2023121216 A1 WO2023121216 A1 WO 2023121216A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic pen
electronic device
state
electronic
pen
Prior art date
Application number
PCT/KR2022/020824
Other languages
English (en)
Korean (ko)
Inventor
우광택
김성훈
이창호
최재호
안진완
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020220013708A external-priority patent/KR20230097927A/ko
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Publication of WO2023121216A1 publication Critical patent/WO2023121216A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/70—Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
    • G06F21/88—Detecting or preventing theft or loss
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Definitions

  • Various embodiments relate to an electronic device and a method for preventing the loss of an electronic pen thereof.
  • the electronic device can receive a user's input through a touch screen and supports an additional input means such as an electronic pen that can receive a user's input through wireless communication with the electronic device.
  • Electronic pens may be classified into built-in pens mounted in an internal or external space of an electronic device and external pens manufactured as a separate component.
  • Electronic devices evolve into various forms such as foldable, slideable, or rollable, and it may be difficult to secure an insertion space for an electronic pen inside the electronic device due to slimming of the electronic device.
  • users prefer an external pen that provides various functions to the built-in pen.
  • the built-in pen can be stored in a separate insertion space or attached to and/or detached from a part of the electronic device. this may occur.
  • An electronic device includes a display, a communication module, a sensor module, and a processor, and the processor connects an electronic pen through the communication module, and the electronic device turns on the display in a first state to generate the electronic pen.
  • Executing an interlocking application detecting a change of the electronic device from the first state to a second state through the sensor module while the electronic device is running the interlocking application with the electronic pen in a first state, and returning to the second state Based on the change, a non-use condition of the electronic pen may be recognized, and a loss warning function of the electronic pen may be executed in at least one of the electronic device and the electronic pen in response to the non-use condition recognition.
  • a method for preventing the loss of an electronic pen of an electronic device includes an operation of connecting the electronic device to an electronic pen; turning on the display in the first state of the electronic device to execute an electronic pen-linked application; detecting a change of the electronic device from the first state to a second state while the electronic pen-linked application is being executed on the electronic device in the first state; recognizing an unused state of the electronic pen based on the change to the second state; and executing a loss warning function of the electronic pen in at least one of the electronic device and the electronic pen in response to recognizing the non-use situation.
  • the electronic pen is not in use or the electronic device is using the electronic pen in a state in which the electronic pen connected to the electronic device is in use or in an active state in which electronic pen input is possible in conjunction with the electronic device (eg, a first state of the electronic device).
  • a warning alarm is provided to guide the user to the location of the electronic pen, thereby reducing the risk of losing the electronic pen and reducing the loss of the electronic pen. Usability and convenience can be increased.
  • FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.
  • FIG. 2 is a diagram illustrating an electronic device and an electronic pen according to various embodiments of the present disclosure.
  • 3 to 6 are diagrams illustrating electronic devices according to various embodiments.
  • FIG. 7 is a flowchart illustrating a method for preventing the loss of an electronic pen of an electronic device according to various embodiments of the present disclosure.
  • 8A and 8B are diagrams illustrating an electronic pen loss prevention environment of an electronic device according to various embodiments.
  • FIG. 9 is a flowchart illustrating a method for preventing the loss of an electronic pen of an electronic device according to various embodiments.
  • FIG. 10 is a flowchart illustrating a method for preventing loss of an electronic pen of an electronic device according to various embodiments.
  • 11 is a flowchart illustrating a method for preventing the loss of an electronic pen and an electronic device according to various embodiments.
  • FIG. 12 is a flowchart illustrating a method for preventing the loss of an electronic pen and an electronic device according to various embodiments.
  • FIG. 1 is a block diagram of an electronic device 101 within a network environment 100 according to various embodiments.
  • an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • a first network 198 eg, a short-range wireless communication network
  • a second network 199 e.g., a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included.
  • at least one of these components eg, the connection terminal 178) may be omitted or one or more other components may be added.
  • some of these components eg, sensor module 176, camera module 180, or antenna module 197) are integrated into one component (eg, display module 160). It can be.
  • the processor 120 for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, the processor 120 transfers commands or data received from other components (eg, sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 .
  • software eg, the program 140
  • the processor 120 transfers commands or data received from other components (eg, sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 .
  • the processor 120 may include a main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor).
  • a main processor 121 eg, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor.
  • NPU neural network processing unit
  • the secondary processor 123 may be implemented separately from or as part of the main processor 121 .
  • the secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, running an application). ) state, together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states.
  • the auxiliary processor 123 eg, an image signal processor or a communication processor
  • the auxiliary processor 123 may include a hardware structure specialized for processing an artificial intelligence model.
  • AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where artificial intelligence is performed, or may be performed through a separate server (eg, the server 108).
  • the learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited.
  • the artificial intelligence model may include a plurality of artificial neural network layers.
  • Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples.
  • the artificial intelligence model may include, in addition or alternatively, software structures in addition to hardware structures.
  • the memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 .
  • the data may include, for example, input data or output data for software (eg, program 140) and commands related thereto.
  • the memory 130 may include volatile memory 132 or non-volatile memory 134 .
  • the program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142 , middleware 144 , or an application 146 .
  • the input module 150 may receive a command or data to be used by a component (eg, the processor 120) of the electronic device 101 from the outside of the electronic device 101 (eg, a user).
  • the input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).
  • the sound output module 155 may output sound signals to the outside of the electronic device 101 .
  • the sound output module 155 may include, for example, a speaker or a receiver.
  • the speaker can be used for general purposes such as multimedia playback or recording playback.
  • a receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.
  • the display module 160 may visually provide information to the outside of the electronic device 101 (eg, a user).
  • the display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device.
  • the display module 160 may include a touch sensor configured to detect a touch or a pressure sensor configured to measure the intensity of force generated by the touch.
  • the audio module 170 may convert sound into an electrical signal or vice versa. According to an embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).
  • the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).
  • the sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do.
  • the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.
  • the interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102).
  • the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
  • HDMI high definition multimedia interface
  • USB universal serial bus
  • SD card interface Secure Digital Card interface
  • audio interface audio interface
  • connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102).
  • the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).
  • the haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses.
  • the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
  • the camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
  • the power management module 188 may manage power supplied to the electronic device 101 .
  • the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.
  • PMIC power management integrated circuit
  • the battery 189 may supply power to at least one component of the electronic device 101 .
  • the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
  • the communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported.
  • the communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication.
  • the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : a local area network (LAN) communication module or a power line communication module).
  • a wireless communication module 192 eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module
  • GNSS global navigation satellite system
  • wired communication module 194 eg, : a local area network (LAN) communication module or a power line communication module.
  • a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a telecommunications network such as a computer network (eg, a LAN or a WAN).
  • a telecommunications network such as a computer network (eg, a LAN or a WAN).
  • These various types of communication modules may be integrated as one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips).
  • the wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199.
  • subscriber information eg, International Mobile Subscriber Identifier (IMSI)
  • IMSI International Mobile Subscriber Identifier
  • the electronic device 101 may be identified or authenticated.
  • the wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology).
  • NR access technologies include high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low latency (URLLC)).
  • eMBB enhanced mobile broadband
  • mMTC massive machine type communications
  • URLLC ultra-reliable and low latency
  • -latency communications can be supported.
  • the wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example.
  • the wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported.
  • the wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199).
  • the wireless communication module 192 is a peak data rate for eMBB realization (eg, 20 Gbps or more), a loss coverage for mMTC realization (eg, 164 dB or less), or a U-plane latency for URLLC realization (eg, Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) may be supported.
  • eMBB peak data rate for eMBB realization
  • a loss coverage for mMTC realization eg, 164 dB or less
  • U-plane latency for URLLC realization eg, Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less
  • the antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device).
  • the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB).
  • the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna.
  • other components eg, a radio frequency integrated circuit (RFIC) may be additionally formed as a part of the antenna module 197 in addition to the radiator.
  • RFIC radio frequency integrated circuit
  • the antenna module 197 may form a mmWave antenna module.
  • the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a lower surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.
  • peripheral devices eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)
  • signal e.g. commands or data
  • commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 .
  • Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 .
  • all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external electronic devices 102 , 104 , or 108 .
  • the electronic device 101 when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself.
  • one or more external electronic devices may be requested to perform the function or at least part of the service.
  • One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 .
  • the electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed.
  • cloud computing distributed computing, mobile edge computing (MEC), or client-server computing technology may be used.
  • the electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing.
  • the external electronic device 104 may include an internet of things (IoT) device.
  • Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or server 108 may be included in the second network 199 .
  • the electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.
  • the electronic device 101 may further include other components necessary for operating the electronic device 101 in addition to the illustrated components.
  • the processor 120 may execute instructions (eg, instructions) stored in the memory 130 to implement a software module, and may execute function-related hardware (eg, the display module 160 and the communication module 190). )) can be controlled.
  • Operations of the processor 120 to be described later may be performed by loading instructions stored in the memory 130.
  • the memory 130 may store an electronic pen-linked application (or a program capable of inputting an electronic pen).
  • the memory 130 may include instructions for executing a program capable of inputting an electronic pen or instructions corresponding to a process for preventing loss of an electronic pen.
  • the processor 120 may, when an electronic pen (eg, the electronic pen 202 of FIG. 2 ) is located at a distance where a short-range communication connection with the electronic device 101 is possible, via the communication module 190 to the electronic device. Communication connection between 101 and the electronic pen may be performed, and electronic pen information (eg, electronic pen state information, sensor information, input information) may be received from the electronic pen.
  • an electronic pen eg, the electronic pen 202 of FIG. 2
  • Communication connection between 101 and the electronic pen may be performed, and electronic pen information (eg, electronic pen state information, sensor information, input information) may be received from the electronic pen.
  • the processor 120 controls the display module 160 based on the execution of a function corresponding to the electronic pen signal, and provides a user interface (UI) that works with the electronic pen to the display module 160.
  • UI user interface
  • the display module 160 is a touch screen display and can detect a touch or hovering (or proximity touch) input by a user's finger (or other body part) or an electronic pen.
  • the display module (160) for example, a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), a light-emitting diode (LED) display, a quantum dot (QD), ⁇ LED (micro LED), mini LED organic light-emitting diode (OLED) display, AMOLED (active matrix organic light emitted display) display, flexible display and 3-dimensional display (3-dimensional display) display) may be included.
  • LCD liquid crystal display
  • TFT-LCD thin film transistor LCD
  • LED light-emitting diode
  • QD quantum dot
  • ⁇ LED micro LED
  • mini LED organic light-emitting diode (OLED) display AMOLED (active matrix organic light emitted display) display
  • flexible display and 3-dimensional display (3-dimensional display) display may be included.
  • some of these displays may be configured as a transparent type or a light transmission type so that the outside can be seen. This may be configured in the form of a transparent display including a transparent OLED (TOLED).
  • the processor 120 detects an operating state (eg, power or temperature) or an external environment of the electronic device 101 through the sensor module 176, and an electrical signal corresponding to the sensed state or Data values can be received.
  • the sensor module 176 may generate data used to recognize a state (eg, a first state or a second state) of the electronic device 101 .
  • the sensor module 176 may include a folding/unfolding state of the electronic device, a sliding/unsliding state, a rollable/unrollable state, an expanding/contracting state of the display, a closed/open state of the electronic device, or a display At least one of the turn-on/turn-off states of may be detected.
  • the folding/unfolding state of the electronic device the sliding/unsliding state, the rollable/unrollable state, and the expansion/contraction of the display using the magnetic sensor (or hall IC) of the sensor module 176. state, and the closed/open state of the electronic device may be detected.
  • the sensor module 176 may detect a change in area or size of a display area where visual information is displayed on the display module 160 in response to a change in state of the electronic device 101 .
  • An electronic device (eg, the electronic device 101 of FIG. 1 ) according to various embodiments includes a display (eg, the display module 160 of FIG. 1 ), a communication module (eg, the communication module 190 of FIG. 1 ), and a sensor. It includes a module (eg, the sensor module 176 of FIG. 1) and a processor (eg, the processor 120 of FIG. 1), and the processor, via the communication module, an electronic pen (eg, the electronic pen of FIG.
  • the electronic device turns on the display in a first state to execute an electronic pen-linked application
  • the electronic device through the sensor module while the electronic pen-linked application is running in the first state detects a change from the first state to the second state, recognizes an unused state of the electronic pen based on the change to the second state, and performs a loss warning function of the electronic pen in response to recognizing the unused state. It may be set to be executed in at least one of the electronic device and the electronic pen.
  • the display may include a flexible display in which a display area in which visual information is displayed is variable.
  • the first state is a state in which the housings of the electronic device are unfolded, a state in which the flexible display is extended or drawn out, a state in which the flexible display is rolled out or slid out, or the electronic device
  • the cover case coupled to the device includes at least one of an open state
  • the second state includes a state in which the housings of the electronic device are folded, a state in which the flexible display is reduced or retracted, and a state in which the flexible display is rolled or slid out. state, or a state in which the cover case combined with the electronic device is closed.
  • the loss warning function of the electronic pen is a function of outputting information for guiding a loss warning on at least a part of the display, a function of outputting an alarm vibration, a function of outputting an alarm sound, or a function of light-emitting an LED.
  • the processor 120 generates a loss warning alarm object for guiding location check of the electronic pen in response to recognizing the non-use situation of the electronic pen, and displays the object in the notification bar or indicator area of the display. More can be set.
  • the processor 120 is further configured to output at least one of a loss warning alarm sound and an alarm vibration for guiding location determination of the electronic pen in response to recognizing the non-use situation of the electronic pen.
  • the processor 120 transmits a loss warning signal to the electronic pen through the communication module in response to recognizing the non-use situation of the electronic pen, and the electronic pen generates a loss warning alarm sound, vibration, or LED. At least one of the light emission can be controlled to be executed.
  • the electronic device 101 further includes a camera, and the processor 120 executes the camera based on the change of the electronic device from the first state to the second state to display the display.
  • a camera preview screen is displayed, it is checked whether an object corresponding to the electronic pen connected to the electronic device is identified in the camera preview screen, and when the electronic pen is identified in the camera preview screen, the electronic pen is displayed on the camera preview screen. It may be further set to display visual information indicating a location.
  • the processor 120 measures a distance separated from the electronic pen according to a wireless communication signal with the electronic pen based on the change of the electronic device from the first state to the second state, and , According to the distance to the electronic pen, the lost warning object may be visually displayed differently, a warning alarm sound may be output differently, or an alarm vibration intensity may be output differently.
  • the processor 120 when the electronic device changes from the first state to the second state, further checks whether the display satisfies a turn-on to turned-off condition, and the display When the turn-off condition is satisfied, it may be set to confirm that the non-use situation of the electronic pen is recognized.
  • the processor 120 determines whether the electronic device is connected to the accessory device, and determines whether the electronic device is connected to the accessory device. If the condition is satisfied, the location of the accessory device is determined, the location of the electronic pen is calculated based on the accessory device, and location information of the electronic pen is provided to the accessory device so that the accessory device can use the electronic pen.
  • the loss warning function can be controlled to output.
  • FIG. 2 is a diagram illustrating an electronic device and an electronic pen according to various embodiments of the present disclosure.
  • an electronic device 101 eg, the electronic device 101 of FIG. 1
  • an electronic pen eg, the electronic pen 202 of FIGS. 2 and 4
  • a wireless can be connected by communication.
  • the electronic device 101 and the electronic pen 202 may communicate with each other based on at least one of various types of short-range wireless communication.
  • the short-range wireless communication method may be at least one of bluetooth low energy (BLE) communication, infrared data association (IrDA) communication, wireless fidelity (WiFi)-direct communication, or near field communication (NFC), but is not limited thereto no.
  • the electronic pen 202 has a known pen shape, as shown in FIG. 2 , and may be implemented in a form separate from the electronic device 101 (eg, an external pen). According to another embodiment, the electronic pen 202 may be disposed in the inner space of the electronic device 101, and may be implemented in a detachable form (eg, a built-in pen) on one outer side of the electronic device 101. .
  • a detachable form eg, a built-in pen
  • the electronic device 101 is connected to the electronic pen 202 through wireless communication, and an activation signal of the electronic pen 202 (eg, the electronic pen 202 is separated/detached from the housing of the electronic device).
  • An application (or function) specified by a manufacturer and/or a user may be executed in response to receiving a signal, a button input signal provided in the electronic pen 202 .
  • the designated application may be an electronic pen interworking application capable of receiving electronic pen input, but is not limited thereto.
  • the electronic pen-linked application may be an application that supports electronic pen input, such as a note app, a memo app, a drawing app, a camera app, a web browser, or a shopping app, and may include various applications having an electronic pen use history. .
  • the electronic pen 202 includes components (eg, a communication module, a controller, a sensor module, a memory, an input/output device, a resonant circuit, or an antenna) for performing functions in conjunction with the electronic device 101. can do.
  • components eg, a communication module, a controller, a sensor module, a memory, an input/output device, a resonant circuit, or an antenna
  • the electronic pen 202 detects (or senses) user information using the electronic pen 202, and electronic pen information (eg, input information, electronic pen state information, sensor information) through wireless communication. ) may be transmitted to the electronic device 101.
  • electronic pen information eg, input information, electronic pen state information, sensor information
  • the electronic pen 202 may include motion information of the electronic pen 202, rotation information of the electronic pen 202, orientation information of the electronic pen 202, and/or electronic pen 202.
  • the location information (eg, the coordinates and/or displacement of the electronic pen 201) may be sensed (or sensed) and transmitted to the electronic device 101.
  • the electronic device 101 recognizes a non-use situation of the electronic pen 202 based on a state change of the electronic device 101, and uses the electronic device 101 or the electronic pen 202 to generate electronic data.
  • a loss warning that guides the positioning of the pen 202 may be notified (or an alarm output) to the user.
  • the electronic device 101 uses the electronic pen 202 by executing an electronic pen interlocking application in the first state, and the electronic device 101 is changed to the second state based on A loss warning function for guiding location check of the electronic pen 202 may be executed in response to the non-use situation of the electronic pen 202 .
  • the loss warning function may be at least one of loss warning information (eg, icon or text) output, vibration output, alarm sound output, or LED light emission, but is not limited thereto.
  • the electronic device 101 is lost using components of the electronic device 01 (eg, the display module 160, the audio module 170, and/or the haptic module 179 of FIG. 1). A warning may be notified/alarmed.
  • the electronic device 101 may transmit a loss warning signal to the electronic pen 202 using a communication module (eg, the communication module 190 of FIG. 1 ).
  • the electronic pen 202 may execute a loss warning function within the electronic pen 202 in response to a loss warning signal transmitted from the electronic device 101 .
  • the size of an area where a display (eg, a flexible display) is visually displayed (or an area where visual information is displayed) according to a state of the electronic device 101 may be an electronic device that is changed.
  • the term “state” may refer to a structural form, shape, or shape of the electronic device 101 (or display module 160).
  • the electronic device 101 may change to a first state in which the display is activated to operate the electronic device 101 and a second state in which the electronic device 101 is deactivated or the display is turned off.
  • the first state may be referred to as an unfolded state, an open state, an extended state, a drawn out state, or a roller/slide out state
  • a second state is a normal state, folded state. state, collapsed state, contracted state, retracted state, closed state, or roller/slide in state
  • the electronic device 101 may form a third state intermediate between the first state and the second state.
  • the third state may be referred to as an intermediate state or a free stop state.
  • the first housing 210 and the second housing 211 are disposed in a first direction A-A' with respect to each other. direction) may be a foldable electronic device coupled to be foldable, but is not limited thereto.
  • a foldable electronic device may be implemented to enable in-folding or out-folding combination.
  • 3 to 6 are diagrams illustrating electronic devices according to various embodiments.
  • a display can be bent, so that at least a portion of the display is folded, wound or rolled, at least partially expanded, and/or a housing (e.g. : It can also be applied to other types of electronic devices that can be accommodated inside the first housing 210 or the second housing 211 of FIG. 2 .
  • a housing e.g. : It can also be applied to other types of electronic devices that can be accommodated inside the first housing 210 or the second housing 211 of FIG. 2 .
  • Various embodiments may be applied to a foldable electronic device 101 in which the first housing 310 and the second housing 311 are coupled to be foldable in a second direction (BB' direction) with respect to each other.
  • the electronic device 101 uses an electronic pen (e.g., the electronic pen 202 of FIG. 2) by executing an electronic pen interlocking application in the first state as in ⁇ 3001>, and then changes to the second state as in ⁇ 3002>. recognizes the non-use situation of the electronic pen 202 and notifies the user of a loss warning that guides the location of the electronic pen 202 through the electronic device 101 or the electronic pen 202 can be printed out.
  • an electronic pen e.g., the electronic pen 202 of FIG. 2
  • the rollable electronic device 101 has a first state in which the second housing 411 extends outwardly (eg, in the first direction 420) with respect to the first housing 410 as shown in ⁇ 4001> and ⁇ 4002>.
  • the second housing 411 may be implemented to be changed into a second state in which the second housing 411 is received inside the first housing 410 (eg, in the second direction 425).
  • the slideable electronic device 101 includes a first state in which the first housing 510 slides out in the third direction 520 relative to the second housing 511 as shown in ⁇ 5001> and a first state as shown in ⁇ 5002>.
  • the housing 510 may be implemented to be changed into a second state in which the housing 510 slides in the fourth direction 525 with respect to the second housing 511 .
  • the rollable electronic device 101 or the slideable electronic device 101 uses the electronic pen 202 by executing the electronic pen interlocking application in the first state, and then changes to the second state so that the electronic pen 202 is not in use. may be recognized, and a notification or an alarm signal may be output to the user through the electronic device 101 or the electronic pen 202 of a loss warning that guides the location check of the electronic pen 202 .
  • FIG. 6 other embodiments may also be applied to a bar type electronic device 101 coupled with a cover case (or protective cover) 620 .
  • the electronic device 101 may activate or deactivate the electronic device 101 by detecting the open/closed state of the protective case 620 .
  • the electronic device 101 uses the electronic pen 202 by executing an electronic pen interlocking application in a first state where the protective case 620 is open as in ⁇ 6001>, and then uses the electronic pen 202 when the protective case 620 is closed as in ⁇ 6002>.
  • By changing to the 2 state it is possible to recognize the unused state of the electronic pen 202 and output a notification or an alarm signal to the user of a loss warning that guides the location of the electronic pen 202 to be checked.
  • FIG. 7 is a flowchart illustrating a method for preventing the loss of an electronic pen of an electronic device according to various embodiments of the present disclosure.
  • an electronic device eg, the electronic device 101 of FIG. 1
  • an electronic pen eg, the electronic pen 202 of FIG. 2
  • wireless communication can
  • the processor of the electronic device 101 determines whether an electronic pen-linked application capable of inputting an electronic pen 202 connected to the electronic device 101 is running. can decide At this time, the electronic device 101 activates a display (eg, the display module 160 of FIG. 1 ) to operate the electronic device 101 in a first state (eg, an unfolded state, an open state, or an extended state). state, withdrawal state, or roller/slide out state).
  • a display eg, the display module 160 of FIG. 1
  • the processor 120 may execute an electronic pen-linked application and display an execution screen (or user interface) on a display (eg, a foreground/top layer of the display).
  • the processor 120 may execute an electronic pen-linked application in response to an input signal of an electronic device or an input signal of an electronic pen (eg, an electronic pen button).
  • the electronic pen-linked application may be an application that supports electronic pen input, such as a note app, a memo app, a drawing app, a camera app, a web browser, or a shopping app, and may include various applications having an electronic pen use history. . It may include various applications in which the electronic pen use history exists.
  • the processor 120 proceeds to operation 730, and otherwise, the process of FIG. 7 may end.
  • the processor 120 disables the electronic pen 202 according to the state change of the electronic device 101 while the electronic pen interlocking application is being executed and displayed on the display (eg, the foreground/top layer of the display). You can determine if the situation is perceived.
  • the processor 120 may recognize an unused state of the electronic pen 202 according to state information of the electronic device 101, display on/off information, or location information of the electronic pen 202.
  • the processor 120 may detect a state change using a sensor module (eg, the sensor module 176 of FIG. 1 ) of the electronic device 101 .
  • the processor 120 activates the display to operate the electronic device 101 in a first state (eg, an unfolded state, an open state, an extended state, a drawn out state, or a roller/slide out state), the electronic device 101, or change to a second state that turns off the display (e.g., normal state, folded state, collapsed state, contracted state, retracted state, closed state, or roller/slide in state) can do.
  • a first state eg, an unfolded state, an open state, an extended state, a drawn out state, or a roller/slide out state
  • a second state that turns off the display e.g., normal state, folded state, collapsed state, contracted state, retracted state, closed state, or roller/slide in state
  • the processor 120 executes the electronic pen interlocking application in the first state in which the cover case is opened to use the electronic pen 202, and then uses the electronic pen 202 in the second state. may be in a state in which the cover case is closed.
  • the processor 120 may change to the second state after the electronic device 101 executes the electronic pen-linked application in the first state and displays it on the display (eg, the foreground/top layer of the display). , it can be recognized as an unused state of the electronic pen.
  • the electronic pen 202 may detect a state in which the user does not contact the electronic pen 202 for a set period of time (or an unused state, a state in which a body contact signal is not received). The electronic pen 202 may transmit an unused state of the electronic pen 202 to the electronic device 101 . When the processor 120 receives the user's non-contact signal from the connected electronic pen 202, it may recognize this as an unused state of the electronic pen 202.
  • the processor 120 may change the display to off state.
  • the processor 120 when the electronic device 101 executes an electronic pen-linked application in the first state and displays it on a display (eg, the foreground/top layer of the display) and then changes to the display off state due to no user manipulation, the processor 120 processes the electronic device 101. It can be recognized as an unused state of the electronic pen 202 .
  • the processor 120 proceeds to operation 740, and otherwise, the process of FIG. 7 may end.
  • the processor 120 responds to recognizing the non-use situation of the electronic pen 202 according to the state change of the electronic device 101, and activates a loss warning function for guiding location check of the electronic pen 202. It can be executed using device 101 or electronic pen 202 .
  • the loss warning function may be at least one of warning information display (eg, icon, text), vibration output, alarm sound output, or LED light emission, but is not limited thereto.
  • the processor 120 may transmit a loss warning signal to the electronic pen 202 in response to recognizing the non-use situation of the electronic pen 202 .
  • the electronic pen 202 may execute at least one loss warning function among LED light emission, vibration generation, and alarm sound output in response to the loss warning signal transmitted from the electronic device 101 .
  • the loss warning function may vary depending on the function assigned to the electronic pen 202 .
  • the processor 120 may execute a loss warning function specified in the electronic device 101 in response to recognizing the non-use situation of the electronic pen 202 .
  • the processor 120 may output notification information (eg, an electronic pen loss notification object) for guiding a risk of electronic pen loss through a display (eg, a notification bar area, an indicator area, a pop-up window).
  • the processor 120 may output a warning sound or generate vibration to inform the user of the risk of losing the electronic pen.
  • the user can find and store the electronic pen 202 by checking the loss warning notified by the electronic device 101 or the electronic pen 202 so that the electronic pen 202 is not lost.
  • 8A and 8B are diagrams illustrating an electronic pen loss prevention environment of an electronic device according to various embodiments.
  • an electronic device 101 eg, a foldable electronic device
  • a first housing 810 and a second housing 811 are In the folded first state, an application execution screen 821 may be displayed on the display 820 by executing an electronic pen-linked application.
  • the electronic pen-linked application may be a note app.
  • the electronic device 101 may receive an electronic pen input through an electronic pen interlocking application.
  • the electronic device 101 may detect that the electronic device 101 changes from an unfolded first state to a folded second state as shown in ⁇ 8002> while the electronic pen interlocking application is being executed.
  • the electronic device 101 recognizes an unused state of the electronic pen (eg, the electronic pen 202 of FIG. 2 ) by changing the electronic device 101 from the first state to the second state while the electronic pen interlocking application is running, A loss warning signal may be transmitted to the electronic pen 202 .
  • the electronic pen 202 may execute a loss warning function in response to receiving the loss warning signal to notify the user of its own location.
  • the electronic pen 202 may output at least one of vibration output, alarm sound output, and LED light emission.
  • the electronic pen 202 executes a loss warning alarm, thereby notifying/informing the user not to lose the electronic pen 202.
  • the electronic device 101 responds to recognizing the non-use situation of the electronic pen 202 independently or separately from the loss warning/alarm function of the electronic pen 202, and the risk of loss of the electronic pen 202 Loss warning information (eg, electronic pen location check/losing risk guidance information such as “Find the electronic pen”) may be displayed on the display 820 .
  • the electronic device 101 may output a warning alarm sound and/or vibration in addition to a loss warning notification.
  • the external display when the electronic device 101 is a foldable electronic device, when the non-use situation of the electronic pen 202 is recognized by changing to the second folded state, the external display ( A lost electronic pen icon 840 may be output to 830 and a vibration alarm may be output.
  • the external display 830 may be a display that is visually displayed when the electronic device 101 is in the second state.
  • the electronic pen 202 is not in use. If it is recognized, the display 850 is turned on and a pop-up window 860 guiding the possibility of losing the electronic pen is displayed or a lost electronic pen icon 865 is displayed in the indicator area to notify the user not to lose the electronic pen 202. / I can guide you.
  • FIG. 9 is a flowchart illustrating a method for preventing the loss of an electronic pen of an electronic device according to various embodiments.
  • a processor eg, the processor 120 of FIG. 1 of an electronic device (eg, the electronic device 101 of FIG. 1 ) according to an embodiment causes the electronic device 101 to In state 1, it may be determined whether an electronic pen interlocking application capable of inputting an electronic pen (eg, the electronic pen 202 of FIG. 2) is running.
  • the processor 120 may display an execution screen of an electronic pen-linked application on a display (eg, a foreground/top layer of the display) in response to the execution of the electronic pen-linked application.
  • a display eg, a foreground/top layer of the display
  • the process 120 proceeds to operation 920 if the electronic device 101 is running an electronic pen-linked application in the first state, otherwise the process of FIG. 9 may end.
  • the processor 120 may determine whether the electronic device 101 changes from the first state to the second state under the condition that the electronic pen-linked application is executed in the first state.
  • the processor 120 may recognize an unused state of the electronic pen 202 by changing the electronic device 101 from the first state to the second state.
  • the processor 120 may detect a change from an unfolded state to a folded state.
  • the processor 120 may detect a change from an extended display state to a reduced display state.
  • the processor 120 may detect that the cover case is changed from an open state to a closed state.
  • the process 120 proceeds to operation 930 when the electronic device 101 executes the electronic pen-linked application in the first state and then changes from the first state to the second state, otherwise, the process of FIG. 9 ends. can do.
  • the processor 120 may automatically execute a camera function to guide the location of the electronic pen 202 in response to a condition in which the electronic device 101 changes from the first state to the second state.
  • the processor 120 may control the electronic device 101 to change to a display-on state or to change from the second state to the first state in order to operate the electronic device 101 .
  • the processor 120 automatically turns on the display and controls the camera to run when an electronic pen is not used when the display is off due to a state change of the electronic device. can do.
  • the processor 120 may output a loss notification sound and/or vibration to notify the user that there is a risk of losing the electronic pen 202 in advance.
  • the processor 120 may execute the camera and display a camera preview screen on the display.
  • the processor 120 may check whether the electronic pen 202 connected to the electronic device 101 is identified in the camera preview screen.
  • the processor 120 checks the position of the electronic pen 202 and identifies an object having the shape of the electronic pen 202 when the electronic pen 202 is located within the camera preview screen, that is, within the viewing angle range of the camera. can do.
  • the processor 120 may display a visual object guiding the location of the identified electronic pen 202 on the camera preview screen.
  • the user may check whether the electronic pen 202 is not in use and look around through the camera of the electronic device 101 .
  • the processor 120 checks the position of the electronic pen 202 and determines where the electronic pen 202 exists.
  • Indicators eg, arrows, icons
  • the user may acquire the electronic pen 202 by going to a place (or location) where the electronic pen 202 is placed through an indicator provided on the camera preview screen.
  • FIG. 10 is a flowchart illustrating a method for preventing loss of an electronic pen of an electronic device according to various embodiments.
  • a processor eg, the processor 120 of FIG. 1 of an electronic device (eg, the electronic device 101 of FIG. 1 ) according to an embodiment causes the electronic device 101 to In state 1, it may be determined whether an electronic pen interlocking application capable of inputting an electronic pen (eg, the electronic pen 202 of FIG. 2) is running.
  • the processor 120 may display an execution screen of the electronic pen-linked application on a display (eg, a foreground/top layer of the display) in response to the execution of the electronic pen-linked application.
  • the processor 120 may proceed to operation 1020 if the electronic device 101 is running an electronic pen-linked application in the first state, otherwise the process of FIG. 9 may be terminated.
  • the processor 120 may determine whether the electronic device 101 changes from the first state to the second state under the condition that the electronic pen-linked application is executed in the first state.
  • the processor 120 may recognize an unused state of the electronic pen 202 by changing the electronic device 101 from the first state to the second state.
  • the processor 120 proceeds to operation 1030 when the electronic device 101 executes an electronic pen-linked application in the first state and then changes from the first state to the second state, otherwise, the process of FIG. 10 ends. can do.
  • the processor 120 may measure the distance to the electronic pen 202 based on the communication signal in response to a condition in which the electronic device 101 changes from the first state to the second state.
  • the processor 120 may predict a distance to the electronic pen 202 based on a signal strength (eg, received signal strength indicator (RSSI)) of wireless communication connected to the electronic pen 202 . For example, if the wireless communication signal strength (eg RSSI) is within a set first threshold value, the processor 120 determines that the electronic pen 202 is located in the first distance range and the wireless communication signal (eg RSSI) is within the first threshold value. Between the threshold value and the second threshold value, the electronic pen 202 is located in the second distance range, and if the wireless communication signal (eg RSSI) exceeds the second threshold value, the electronic pen 202 is located in the third distance range can be predicted by a signal strength (eg, received signal strength indicator (RSSI)) of wireless communication connected to the electronic pen 202 . For example, if the wireless communication signal strength (eg RSSI) is within a set first threshold value, the processor 120 determines that the electronic pen 202 is located in the first distance range and the wireless communication signal (eg RSSI) is within the
  • the processor 120 may differently output a loss warning function for guiding location determination of the electronic pen 202 according to the distance between the electronic device 101 and the electronic pen 202 (or communication signal strength). there is.
  • the processor 120 generates a loss warning object (eg, an alarm object) that guides the loss risk of the electronic pen 202 in response to recognizing the non-use situation of the electronic pen 202, and the loss warning object can be displayed on a display (eg indicator area, notification bar).
  • the processor 120 displays the lost warning object in green when the electronic pen 202 is located in the first distance range, and displays the lost warning object in yellow when the electronic pen 202 is located in the second distance range.
  • the pen 202 is located in the third distance range, it can be controlled to display in red.
  • the processor 120 provides an effect of repeatedly blinking the lost warning object when communication with the electronic pen 202 is impossible, and then displays the lost warning object in gray when communication with the electronic pen 202 is disconnected. , or a communication disconnection indicator may be additionally provided.
  • the processor 120 may provide a communication disconnection time with the electronic pen 202 through a notification bar.
  • the processor 120 may output a different sound or generate a different intensity of vibration when differently displaying warning information for guiding positioning of the electronic pen 202 .
  • the processor 120 may transmit a loss warning signal to the electronic pen 202 so that LED light emission of the electronic pen 202 is output differently in response to recognizing the non-use situation of the electronic pen 202 .
  • the electronic pen 202 may output a loss warning function differently according to a signal transmitted from the electronic device 101 .
  • 11 is a flowchart illustrating a method for preventing the loss of an electronic pen and an electronic device according to various embodiments.
  • an electronic device eg, electronic device 101 of FIG. 1
  • an electronic pen eg, electronic pen 202 of FIG. 2
  • wireless communication in operation 1110.
  • the electronic device 101 and the electronic pen 202 may communicate with each other based on at least one of various types of short-range wireless communication.
  • the short-range wireless communication method may be at least one of bluetooth low energy (BLE) communication, infrared data association (IrDA) communication, WiFi-Direct communication, or near field communication (NFC), but is not limited thereto.
  • the processor of the electronic device 101 determines whether the electronic device 101 is running an electronic pen interlocking application capable of inputting the electronic pen 202 in the first state. can be checked.
  • the processor 120 may display an execution screen of the electronic pen-linked application on a display (eg, a foreground/top layer of the display) in response to the execution of the electronic pen-linked application.
  • the processor 120 may detect that the electronic device 101 changes from the first state to the second state under the condition that the electronic pen-linked application is executed in the first state. .
  • the processor 120 may recognize an unused state of the electronic pen 202 by changing the electronic device 101 from the first state to the second state.
  • the processor 120 may transmit a loss warning signal to the electronic pen 202 in response to the change of the electronic device 101 from the first state to the second state.
  • the electronic pen 202 may execute a loss warning function in response to the loss warning signal transmitted from the electronic device 101.
  • the loss warning function may execute at least one of vibration output, alarm sound output, and LED lighting.
  • the user can easily check the location of the electronic pen by the loss warning generated from the electronic pen 202, and prevent it from being lost.
  • the electronic pen 202 can be placed in a different place and another function can be used by a text event or a call event. there is.
  • the electronic pen 202 emits at least one of an alarm sound, vibration, and LED light, so that the user recognizes the location of the electronic pen 202. You can do it, and you can take the electronic pen 202 without forgetting it.
  • FIG. 12 is a flowchart illustrating a method for preventing the loss of an electronic pen and an electronic device according to various embodiments.
  • an electronic device connects an electronic pen (eg, electronic pen 202 of FIG. 2 ) and a first wireless communication link in operation 1210.
  • the electronic device 101 and the electronic pen 202 may communicate with each other based on at least one of various types of short-range wireless communication.
  • the short-range wireless communication method may be at least one of bluetooth low energy (BLE) communication, infrared data association (IrDA) communication, WiFi-Direct communication, or near field communication (NFC), but is not limited thereto.
  • the electronic device 101 may be connected to the accessory device 104 through wireless communication.
  • the electronic device 101 and the accessory device 104 may be connected (eg, paired) through a second wireless communication link based on at least one of various types of wireless communication.
  • the electronic device 101 and the accessory device 104 may form a communication link (or transmission link) based on Bluetooth communication (eg, Bluetooth pairing).
  • the first wireless communication link and the second wireless communication link may be formed independently of each other.
  • the processor of the electronic device 101 receives an input from an electronic pen (eg, the electronic pen 202 of FIG. 2 ) when the electronic device 101 is in the first state. It is possible to check whether a possible electronic pen-linked application is running.
  • the processor 120 may display an execution screen of the electronic pen-linked application on a display (eg, a foreground/top layer of the display) in response to the execution of the electronic pen-linked application.
  • the processor 120 may detect that the electronic device 101 changes from the first state to the second state under the condition that the electronic pen-linked application is executed in the first state. .
  • the processor 120 may recognize an unused state of the electronic pen 202 by changing the electronic device 101 from the first state to the second state.
  • the processor 120 may determine whether the electronic device 101 is being connected to the accessory device 104 in response to a change from the first state to the second state.
  • the processor 120 may proceed to operation 1250.
  • the processor 120 satisfies a condition in which the electronic device 101 changes from the first state to the second state while using the electronic pen 202, and then the electronic device 101 connects to the accessory device 104.
  • the location of the accessory device 104 may be confirmed.
  • Positioning technologies are known technologies, such as global navigation satellite system (GNSS) satellite positioning technology, cell tower triangulation technology, and network-based positioning technology (e.g., Wi-Fi positioning technology). ), and other known techniques may be applied without being limited thereto.
  • GNSS global navigation satellite system
  • cell tower triangulation technology e.g., cell tower triangulation technology
  • network-based positioning technology e.g., Wi-Fi positioning technology
  • the processor 120 may calculate the position of the electronic pen 102 based on the position of the accessory device 104. For example, the processor 120 receives the location of the accessory device 104 and the location of the electronic pen 202 from each device, and uses the location of the accessory device 104 as the center through triangulation. ) can calculate the direction and distance where it is located.
  • the processor 120 may transmit location information of the electronic pen 202 and a loss warning signal to the accessory device 104.
  • the accessory device 104 outputs the location information of the electronic pen 202 in response to the location information and the loss warning signal of the electronic pen 202 transmitted from the electronic device 101, and executes a loss warning function.
  • the accessory device 104 may display a location where the electronic pen 202 is located on a display provided in the accessory device 104 and output an alarm sound or notification vibration.
  • the processor 120 may transmit a loss warning signal to the electronic pen 202.
  • the electronic pen 202 may execute a loss warning function in response to the loss warning signal transmitted from the electronic device 101.
  • the loss warning alarm may also be output from the electronic pen 202 at substantially the same time.
  • operations 1275 and 1275 may be omitted.
  • a method for preventing the loss of an electronic pen of an electronic device 101 includes an operation of connecting the electronic device to an electronic pen, an operation of turning on a display of the electronic device in a first state and executing an application linked to the electronic pen, and the An operation of detecting a change of the electronic device from the first state to a second state while the electronic pen interlocking application is running on the electronic device in the first state, and an unused state of the electronic pen based on the change to the second state An operation of recognizing and executing a loss warning function of the electronic pen in at least one of the electronic device and the electronic pen in response to the recognition of the non-use situation.
  • the display may include a flexible display in which a display area displaying visual information is variable.
  • the first state may be a state in which the housings of the electronic device are unfolded, a state in which the flexible display is extended or drawn out, a state in which the flexible display is rolled out or slid out, or the electronic device and a cover case combined with at least one of an open state, wherein the second state is a state in which the housings of the electronic device are folded, a state in which the flexible display is reduced or retracted, and a state in which the flexible display is rolled or slid out. , or a state in which the cover case coupled to the electronic device is closed.
  • the loss warning function of the electronic pen includes at least one of a function of outputting information for guiding a loss warning on at least a part of the display, a function of outputting an alarm vibration, a function of outputting an alarm sound, and a function of light-emitting an LED. may contain one.
  • the operation of executing the loss warning function of the electronic pen in at least one of the electronic device and the electronic pen is a loss warning that guides the location of the electronic pen in response to recognizing that the electronic pen is not in use.
  • An operation of generating an alarm object and an operation of displaying the loss warning alarm object in a notification bar or an indicator area of the display may be further included.
  • the operation of executing the loss warning function of the electronic pen in at least one of the electronic device and the electronic pen is a loss warning that guides the location of the electronic pen in response to recognizing that the electronic pen is not in use. It may be characterized in that at least one of an alarm sound and an alarm vibration is output.
  • the operation of executing the loss warning function of the electronic pen on at least one of the electronic device and the electronic pen causes the electronic pen to generate at least one of a loss warning alarm sound, vibration, and LED light emission.
  • An operation of transmitting a loss warning signal to the pen may be further included.
  • the operation of executing the loss warning function of the electronic pen on at least one of the electronic device and the electronic pen may include a change of the electronic device from the first state to the second state. Executing a camera to display a camera preview screen on the display, checking whether an object corresponding to the electronic pen connected to the electronic device is identified in the camera preview screen, and identifying the electronic pen in the camera preview screen , Displaying visual information indicating the location of the electronic pen on the camera preview screen.
  • the operation of executing the loss warning function of the electronic pen on at least one of the electronic device and the electronic pen may include the electronic pen based on a change of the electronic device from the first state to the second state. Further comprising an operation of measuring a distance away from the electronic pen according to a wireless communication signal with the electronic pen, and displaying the lost warning object differently depending on the distance from the electronic pen, or outputting a different alarm sound volume Alternatively, the alarm vibration strength may be output differently.
  • module used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits.
  • a module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions.
  • the module may be implemented in the form of an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • Various embodiments of this document provide one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). It may be implemented as software (eg, the program 140) including them. Methods according to various embodiments may be provided by being included in a computer program product.
  • each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is.
  • one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added.
  • a plurality of components eg modules or programs
  • the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. .
  • the actions performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the actions are executed in a different order, or omitted. or one or more other actions may be added.

Abstract

Un dispositif électronique selon un mode de réalisation comprend un écran d'affichage, un module de communication, un module de capteur et un processeur, le processeur pouvant être conçu pour : permettre une connexion d'un stylo électronique audit processeur par l'intermédiaire du module de communication ; exécuter une application liée au stylo électronique en activant l'écran d'affichage lorsque le dispositif électronique est dans un premier état ; détecter un changement du dispositif électronique du premier état à un second état par l'intermédiaire du module de capteur pendant l'exécution de l'application liée au stylo électronique lorsque le dispositif électronique est dans le premier état ; reconnaître une situation de non utilisation du stylo électronique, sur la base du passage au second état ; et exécuter une fonction d'avertissement de perte du stylo électronique dans le dispositif électronique et/ou le stylo électronique, en réponse à la reconnaissance de la situation de non utilisation.
PCT/KR2022/020824 2021-12-24 2022-12-20 Dispositif électronique et procédé associé de prévention de perte de stylo électronique WO2023121216A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR20210187094 2021-12-24
KR10-2021-0187094 2021-12-24
KR1020220013708A KR20230097927A (ko) 2021-12-24 2022-01-28 전자 장치 및 이의 전자 펜 분실 방지 방법
KR10-2022-0013708 2022-01-28

Publications (1)

Publication Number Publication Date
WO2023121216A1 true WO2023121216A1 (fr) 2023-06-29

Family

ID=86903398

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2022/020824 WO2023121216A1 (fr) 2021-12-24 2022-12-20 Dispositif électronique et procédé associé de prévention de perte de stylo électronique

Country Status (1)

Country Link
WO (1) WO2023121216A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5635959A (en) * 1993-02-26 1997-06-03 Sharp Kabushiki Kaisha Information-processing apparatus equipped with a cordless pen
JPH11134066A (ja) * 1997-10-31 1999-05-21 Matsushita Electric Ind Co Ltd 携帯情報端末装置
CN202563392U (zh) * 2012-05-03 2012-11-28 北京壹人壹本信息科技有限公司 一种手写笔防丢装置及便携式电子设备
KR20200024028A (ko) * 2018-08-27 2020-03-06 삼성전자주식회사 펜 입력 장치와 전자 장치 사이의 거리를 기반으로 화면의 속성을 제어하는 전자 장치 및 그 제어 방법
KR20200122688A (ko) * 2019-04-18 2020-10-28 삼성전자주식회사 폴더블 전자 장치의 상태 인식 방법 및 이를 지원하는 폴더블 전자 장치

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5635959A (en) * 1993-02-26 1997-06-03 Sharp Kabushiki Kaisha Information-processing apparatus equipped with a cordless pen
JPH11134066A (ja) * 1997-10-31 1999-05-21 Matsushita Electric Ind Co Ltd 携帯情報端末装置
CN202563392U (zh) * 2012-05-03 2012-11-28 北京壹人壹本信息科技有限公司 一种手写笔防丢装置及便携式电子设备
KR20200024028A (ko) * 2018-08-27 2020-03-06 삼성전자주식회사 펜 입력 장치와 전자 장치 사이의 거리를 기반으로 화면의 속성을 제어하는 전자 장치 및 그 제어 방법
KR20200122688A (ko) * 2019-04-18 2020-10-28 삼성전자주식회사 폴더블 전자 장치의 상태 인식 방법 및 이를 지원하는 폴더블 전자 장치

Similar Documents

Publication Publication Date Title
WO2022080616A1 (fr) Dispositif électronique et procédé d'induction d'entrée
WO2022124565A1 (fr) Procédé et dispositif permettant de commander la direction d'affichage en fonction d'un changement d'état de pliage
WO2021261949A1 (fr) Procédé d'utilisation selon l'état de pliage d'un afficheur et appareil électronique l'utilisant
WO2023022567A1 (fr) Dispositif électronique pliable et procédé de commande d'un dispositif électronique pliable à l'aide d'un capteur hall numérique
WO2023121216A1 (fr) Dispositif électronique et procédé associé de prévention de perte de stylo électronique
WO2022119276A1 (fr) Dispositif électronique d'affichage souple et procédé de fonctionnement associé
WO2022119311A1 (fr) Dispositif électronique comprenant un écran flexible, et procédé de fonctionnement associé
WO2022164055A1 (fr) Appareil électronique pliable et procédé pour fournir de l'énergie électrique à un appareil électronique externe à l'aide d'un appareil électronique pliable
WO2022080730A1 (fr) Dispositif électronique comprenant un écran souple et procédé
WO2022108192A1 (fr) Dispositif électronique et procédé de commande multi-fenêtre de dispositif électronique
WO2022050779A1 (fr) Appareil électronique à multiples pliages
WO2022098040A1 (fr) Procédé de commande d'écran enroulable de dispositif électronique enroulable, et dispositif électronique enroulable
WO2022240000A1 (fr) Appareil électronique coulissant et son procédé de fonctionnement
WO2022119147A1 (fr) Procédé et appareil de commande de glissement basé sur de multiples touchers
WO2023146142A1 (fr) Dispositif électronique, et procédé de notification et de connexion pour stylo électronique
WO2023063584A1 (fr) Dispositif électronique pour identifier un état en utilisant un capteur
WO2022225350A1 (fr) Procédé de commande d'un affichage flexible et dispositif électronique le prenant en charge
WO2023018173A1 (fr) Dispositif électronique et procédé permettant de faire fonctionner un stylo électronique
WO2023106830A1 (fr) Dispositif électronique prenant en charge un mode de fonctionnement à une seule main et procédé de fonctionnement du dispositif électronique
WO2024080553A1 (fr) Dispositif électronique et son procédé de fonctionnement
WO2022211239A1 (fr) Procédé et dispositif d'exploitation de contenu basé sur une communication à bande ultralarge (uwb)
WO2023068694A1 (fr) Dispositif électronique et procédé d'inspection de circuit de connexion de câble d'un dispositif électronique
WO2023063720A1 (fr) Procédé permettant d'étendre une unité d'affichage d'un dispositif électronique, et dispositif électronique permettant de le prendre en charge
WO2024019295A1 (fr) Procédé de fourniture de source d'alimentation électrique, et dispositif électronique pour exécuter un procédé
WO2022114509A1 (fr) Dispositif électronique conçu pour présenter un écran à visibilité modifiée en fonction de l'extension d'un affichage flexible et procédé de commande dudit dispositif

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22911849

Country of ref document: EP

Kind code of ref document: A1