WO2022065845A1 - Procédé de traitement de données d'entrée et dispositif électronique le prenant en charge - Google Patents

Procédé de traitement de données d'entrée et dispositif électronique le prenant en charge Download PDF

Info

Publication number
WO2022065845A1
WO2022065845A1 PCT/KR2021/012866 KR2021012866W WO2022065845A1 WO 2022065845 A1 WO2022065845 A1 WO 2022065845A1 KR 2021012866 W KR2021012866 W KR 2021012866W WO 2022065845 A1 WO2022065845 A1 WO 2022065845A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
external electronic
external
input
input data
Prior art date
Application number
PCT/KR2021/012866
Other languages
English (en)
Korean (ko)
Inventor
이재욱
강철
신원준
조대희
최훈
문민정
전하영
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Publication of WO2022065845A1 publication Critical patent/WO2022065845A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0231—Cordless keyboards
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03543—Mice or pucks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038—Indexing scheme relating to G06F3/038
    • G06F2203/0384—Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices

Definitions

  • the smart phone and/or tablet PC is equipped with a large-capacity memory and high-performance CPU compared to conventional electronic devices, and may be equipped with an operating system (OS) to support execution of various applications, voice and data communication, PC interworking, etc. .
  • OS operating system
  • HID Human Interface Devices
  • an electronic device eg, an input device (eg, a keyboard, a mouse, and/or a headset) connected to a tablet
  • an electronic device eg, an input device (eg, a keyboard, a mouse, and/or a headset) connected to a tablet
  • an external electronic device there is a difficulty in performing an incidental operation.
  • the user has a separate electronic device (eg, Bluetooth dongle) to connect the input device to an external electronic device, installs an input device sharing application, or performs a connection operation with a plurality of external electronic devices.
  • a separate electronic device eg, Bluetooth dongle
  • An electronic device is formed on one side of the electronic device for physical and electrical connection between an external input device including a touch screen display, a wireless communication circuit, and at least one coupling structure, and the electronic device a connection terminal, a processor, and a memory operatively coupled to the processor, wherein the memory, when executed, causes the processor to receive a first selection signal from the external input device through the connection terminal; a first external electronic device to perform wireless communication with the electronic device using a wireless communication circuit is determined based on the first selection signal, and a connection request signal is transmitted to the first external electronic device; Receives a response signal to the connection request signal from the electronic device, performs a pairing operation with the first external electronic device when the response signal is received, and uses the wireless communication circuit to communicate with the electronic device and the second device 1 Wirelessly connect an external electronic device and display a user interface including a connection state with the first external electronic device on the touch screen display as it is connected with the first external electronic device; one or more instructions for controlling to transmit data related to first input data
  • a method for providing a function for an electronic device to process input data includes: receiving a first selection signal from an external input device physically and electrically connected through a connection terminal; Determining a first external electronic device to perform wireless communication with the electronic device using a wireless communication circuit based on a first selection signal, transmitting a connection request signal to the first external electronic device, the first Receiving a response signal to the connection request signal from an external electronic device, and when the response signal is received, performing a pairing operation with the first external electronic device to connect the electronic device and the first external electronic device An operation of wirelessly connecting, an operation of displaying a user interface including a state of connection with the first external electronic device on a touch screen display in response to being connected to the first external electronic device, and an operation of the first After the connection with the external electronic device, data related to the first input data received from the external input device may be transmitted to the first external electronic device through the wireless communication circuit.
  • the electronic device directly transmits input data transmitted from the input device by communicating with the external electronic device, thereby providing convenience to a user using a plurality of terminals.
  • the electronic device having relatively high performance compared to the input device directly communicates with the external electronic device and transmits the input data transmitted from the input device, thereby overcoming the limitation in the number of external electronic devices connectable to the conventional input device. there is.
  • FIG. 1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure
  • FIG. 2 is a block diagram illustrating a program according to various embodiments of the present disclosure
  • FIG. 3 illustrates an electronic device and an input device according to various embodiments of the present disclosure
  • FIG. 4 is a block diagram of an electronic device, an input device, and an external electronic device according to various embodiments of the present disclosure
  • FIG. 5 is a block diagram illustrating a software structure in an electronic device, according to various embodiments of the present disclosure
  • FIG. 6 illustrates a user interface displayed on a display of an electronic device, according to various embodiments of the present disclosure
  • FIG. 7 illustrates a user interface displayed on a display of an electronic device, according to various embodiments of the present disclosure
  • FIG. 8 is a flowchart illustrating an operation of processing input data of an electronic device according to various embodiments of the present disclosure
  • FIG. 9 is a flowchart illustrating an operation of processing input data of an electronic device, according to various embodiments of the present disclosure.
  • FIG. 10 is a flowchart illustrating an operation of processing input data of an electronic device, according to various embodiments of the present disclosure
  • FIG. 11 is a flowchart illustrating an operation of processing input data of an external electronic device, according to various embodiments of the present disclosure
  • FIG 12 illustrates various user interfaces provided by an external electronic device, according to various embodiments of the present disclosure.
  • FIG. 1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments.
  • an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • a first network 198 eg, a short-range wireless communication network
  • a second network 199 e.g., a second network 199
  • the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included.
  • at least one of these components eg, the connection terminal 178
  • may be omitted or one or more other components may be added to the electronic device 101 .
  • some of these components are integrated into one component (eg, display module 160 ). can be
  • the processor 120 for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 .
  • software eg, a program 140
  • the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 .
  • the volatile memory 132 may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 .
  • the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor).
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, a neural network processing unit
  • NPU neural processing unit
  • an image signal processor e.g., a sensor hub processor, or a communication processor.
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, a neural network processing unit
  • NPU neural processing unit
  • an image signal processor e.g., a sensor hub processor, or a communication processor.
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123
  • the auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states.
  • the co-processor 123 eg, an image signal processor or a communication processor
  • may be implemented as part of another functionally related component eg, the camera module 180 or the communication module 190. there is.
  • the auxiliary processor 123 may include a hardware structure specialized for processing an artificial intelligence model.
  • Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108).
  • the learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited
  • the artificial intelligence model may include a plurality of artificial neural network layers.
  • Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example.
  • the artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.
  • the memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ).
  • the data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto.
  • the memory 130 may include a volatile memory 132 or a non-volatile memory 134 .
  • the program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .
  • the input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 .
  • the input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).
  • the sound output module 155 may output a sound signal to the outside of the electronic device 101 .
  • the sound output module 155 may include, for example, a speaker or a receiver.
  • the speaker can be used for general purposes such as multimedia playback or recording playback.
  • the receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.
  • the display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 .
  • the display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device.
  • the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.
  • the audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).
  • an external electronic device eg, a sound output module 155
  • a sound may be output through the electronic device 102 (eg, a speaker or headphones).
  • the sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do.
  • the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.
  • the interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ).
  • the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
  • HDMI high definition multimedia interface
  • USB universal serial bus
  • SD card interface Secure Digital Card
  • the connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ).
  • the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).
  • the haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense.
  • the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
  • the camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
  • the power management module 188 may manage power supplied to the electronic device 101 .
  • the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
  • PMIC power management integrated circuit
  • the battery 189 may supply power to at least one component of the electronic device 101 .
  • battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.
  • the communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel.
  • the communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication.
  • the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module).
  • GNSS global navigation satellite system
  • a corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN).
  • a first network 198 eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)
  • a second network 199 eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN).
  • a telecommunication network
  • the wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 .
  • the electronic device 101 may be identified or authenticated.
  • the wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR).
  • NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)).
  • eMBB enhanced mobile broadband
  • mMTC massive machine type communications
  • URLLC ultra-reliable and low-latency
  • the wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example.
  • a high frequency band eg, mmWave band
  • the wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna.
  • the wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ).
  • the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).
  • a peak data rate eg, 20 Gbps or more
  • loss coverage eg, 164 dB or less
  • U-plane latency for realizing URLLC
  • the antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device).
  • the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern.
  • the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna.
  • other components eg, a radio frequency integrated circuit (RFIC)
  • RFIC radio frequency integrated circuit
  • the antenna module 197 may form a mmWave antenna module.
  • the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.
  • peripheral devices eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)
  • GPIO general purpose input and output
  • SPI serial peripheral interface
  • MIPI mobile industry processor interface
  • the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 .
  • Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 .
  • all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 .
  • the electronic device 101 may perform the function or service itself instead of executing the function or service itself.
  • one or more external electronic devices may be requested to perform at least a part of the function or the service.
  • One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 .
  • the electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request.
  • cloud computing distributed computing, mobile edge computing (MEC), or client-server computing technology may be used.
  • the electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing.
  • the external electronic device 104 may include an Internet of things (IoT) device.
  • Server 108 may be an intelligent server using machine learning and/or neural networks.
  • the external electronic device 104 or the server 108 may be included in the second network 199 .
  • the electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.
  • the electronic device may have various types of devices.
  • the electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device.
  • a portable communication device eg, a smart phone
  • a computer device e.g., a smart phone
  • a portable multimedia device e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a wearable device e.g., a smart bracelet
  • a home appliance device e.g., a home appliance
  • first, second, or first or second may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.
  • module used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit.
  • a module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions.
  • the module may be implemented in the form of an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • one or more instructions stored in a storage medium may be implemented as software (eg, the program 140) including
  • a processor eg, processor 120
  • a device eg, electronic device 101
  • the one or more instructions may include code generated by a compiler or code executable by an interpreter.
  • the device-readable storage medium may be provided in the form of a non-transitory storage medium.
  • 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.
  • a signal eg, electromagnetic wave
  • the method according to various embodiments disclosed in this document may be provided as included in a computer program product.
  • Computer program products may be traded between sellers and buyers as commodities.
  • the computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play StoreTM) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly between smartphones (eg: smartphones) and online.
  • a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.
  • each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is.
  • one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added.
  • a plurality of components eg, a module or a program
  • the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. .
  • operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.
  • FIG. 2 is a block diagram 200 illustrating a program 140, according to various embodiments. Meanwhile, among the components shown in FIG. 2, components having the same reference numbers as those of FIG. 1 (eg, the program 140, the operating system 142, the middleware 144, and/or the application 146). The description may be referred to by the description of FIG. 1 .
  • the program 140 executes an operating system 142 for controlling one or more resources of the electronic device 101 , middleware 144 , or an application 146 executable in the operating system 142 .
  • Operating system 142 may include, for example, Android TM , iOS TM , Windows TM , Symbian TM , Tizen TM , or Bada TM .
  • At least some of the programs 140 are, for example, preloaded into the electronic device 101 at the time of manufacture, or an external electronic device (eg, the electronic device 102 or 104 ), or a server (eg, the electronic device 102 or 104 ) when used by a user ( 108)), or may be updated.
  • the operating system 142 may control management (eg, allocation or retrieval) of one or more system resources (eg, a process, memory, or power) of the electronic device 101 .
  • the operating system 142 may additionally or alternatively include other hardware devices of the electronic device 101 , for example, the input device 150 , the sound output device 155 , the display device 160 , and the audio module 170 . , sensor module 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or It may include one or more driver programs for driving the antenna module 197 .
  • the middleware 144 may provide various functions to the application 146 so that functions or information provided from one or more resources of the electronic device 101 may be used by the application 146 .
  • the middleware 144 includes, for example, an application manager 201 , a window manager 203 , a multimedia manager 205 , a resource manager 207 , a power manager 209 , a database manager 211 , and a package manager 213 . ), a connectivity manager 215 , a notification manager 217 , a location manager 219 , a graphics manager 221 , a security manager 223 , a call manager 225 , or a voice recognition manager 227 .
  • an application manager 201 includes, for example, an application manager 201 , a window manager 203 , a multimedia manager 205 , a resource manager 207 , a power manager 209 , a database manager 211 , and a package manager 213 .
  • a connectivity manager 215 a notification manager 217 , a
  • the application manager 201 may manage the life cycle of the application 146 , for example.
  • the window manager 203 may manage one or more GUI resources used in the screen, for example.
  • the multimedia manager 205 for example, identifies one or more formats required for playback of media files, and encodes or decodes a corresponding media file among the media files using a codec suitable for the selected format. can be done
  • the resource manager 207 may manage the space of the source code of the application 146 or the memory of the memory 130 , for example.
  • the power manager 209 may, for example, manage the capacity, temperature, or power of the battery 189 , and determine or provide related information necessary for the operation of the electronic device 101 by using the corresponding information. . According to an embodiment, the power manager 209 may interwork with a basic input/output system (BIOS) (not shown) of the electronic device 101 .
  • BIOS basic input/output system
  • the database manager 211 may create, retrieve, or change a database to be used by the application 146 , for example.
  • the package manager 213 may manage installation or update of an application distributed in the form of a package file, for example.
  • the connectivity manager 215 may manage, for example, a wireless connection or a direct connection between the electronic device 101 and an external electronic device.
  • the notification manager 217 may provide, for example, a function for notifying the user of the occurrence of a specified event (eg, an incoming call, a message, or an alarm).
  • the location manager 219 may manage location information of the electronic device 101 , for example.
  • the graphic manager 221 may manage, for example, one or more graphic effects to be provided to a user or a user interface related thereto.
  • Security manager 223 may provide, for example, system security or user authentication.
  • the telephony manager 225 may manage, for example, a voice call function or a video call function provided by the electronic device 101 .
  • the voice recognition manager 227 for example, transmits the user's voice data to the server 108, based at least in part on the voice data, a command corresponding to a function to be performed in the electronic device 101; Alternatively, the converted text data may be received from the server 108 based at least in part on the voice data.
  • the middleware 244 may dynamically delete some existing components or add new components.
  • at least a portion of the middleware 144 may be included as a part of the operating system 142 or implemented as software separate from the operating system 142 .
  • Application 146 includes, for example, home 251 , dialer 253 , SMS/MMS 255 , instant message (IM) 257 , browser 259 , camera 261 , alarm 263 . , contacts 265, voice recognition 267, email 269, calendar 271, media player 273, album 275, watch 277, health 279 (such as exercise or blood sugar) measuring biometric information), or environmental information 281 (eg, measuring atmospheric pressure, humidity, or temperature information).
  • the application 146 may further include an information exchange application (not shown) capable of supporting information exchange between the electronic device 101 and an external electronic device.
  • the information exchange application may include, for example, a notification relay application configured to transmit specified information (eg, call, message, or alarm) to an external electronic device, or a device management application configured to manage the external electronic device.
  • the notification relay application for example, transmits notification information corresponding to a specified event (eg, mail reception) generated in another application (eg, the email application 269 ) of the electronic device 101 to the external electronic device.
  • the notification relay application may receive notification information from the external electronic device and provide it to the user of the electronic device 101 .
  • the device management application is, for example, a power source (eg, turn-on or turn-on) of an external electronic device that communicates with the electronic device 101 or some components thereof (eg, the display device 160 or the camera module 180 ). -off) or a function (eg, brightness, resolution, or focus of the display device 160 or the camera module 180 ) may be controlled.
  • the device management application may additionally or alternatively support installation, deletion, or update of an application operating in an external electronic device.
  • FIG. 3 illustrates an electronic device 301 and an input device 302 according to various embodiments of the present disclosure.
  • the configurations of the electronic device 301 and the input device 302 shown in FIG. 3 are exemplary and embodiments of the present document are not limited thereto.
  • the electronic device 301 and the input device 302 may further include or include components not shown in FIG. 3 (eg, a microphone, a speaker, a touch pad, a camera module, and/or a sensor module). At least some of them may not be included.
  • the electronic device 301 may include a side member 310 , a display 360 (eg, the display module 160 of FIG. 1 ), and/or It may include a connection terminal 378 (eg, the connection terminal 178 of FIG. 1 ).
  • the connection terminal 378 may be formed in at least one region of the side member 310 .
  • the side member 310 may be referred to as at least a portion of the housing surrounding the space between the first surface (or front surface) and the second surface (or rear surface).
  • the side member 310 may include a connection terminal 378 in at least one region.
  • the display 360 may display various information related to an operation performed by the electronic device 301 .
  • the display 360 may display a user interface including information related to connection states of the electronic device 301 , the input device 302 , and the external electronic device.
  • the user interface is a graphical user interface (GUI) corresponding to at least one of a function of determining whether to connect the electronic device with at least one external electronic device, searching for an external electronic device to be additionally connected, and displaying a connection state with at least one external electronic device. ) may be included.
  • GUI graphical user interface
  • the user interface displayed on the display 360 may be referred to in more detail in the description of FIGS. 6 and 7 to be described later.
  • connection terminal 378 may be formed in one area of the side member 310 .
  • the connection terminal 378 may be formed in one region of the central portion of the long axis of the side member 310 .
  • the connection terminal 378 may include at least one pogo pin.
  • the pogo pin may include, for example, a pogo pin member and a recessed member.
  • the pogo pin member may be included in the recessed member.
  • the depression member may have a shape such that at least a portion of the pogo pin member (eg, a plunger) is exposed to the outside.
  • the electronic device 301 may be physically and electrically connected to the input device 302 through at least one pogo pin included in the connection terminal 378 .
  • a pogo pin member included in the at least one pogo pin may be coupled with a socket member included in the coupling structure 380 of the input device 302 so that the electronic device 301 and the input device 302 are physically and electrically connected to each other. can be connected to For example, at least a portion of the pogo pin member of the electronic device 301 may be inserted into the socket member of the input device 302 .
  • connection terminal 378 is illustrated in FIG. 3
  • the present invention is not limited thereto.
  • a connection terminal may be additionally or alternatively formed in a region other than the illustrated region (eg, one region of the central portion of the short axis of the side member 310 ).
  • the input device 302 may include a coupling structure 380 , a keyboard 382 , and/or a mouse pad 384 .
  • the mouse pad 384 is illustrated as being disposed under the keyboard 382, but this is not limited thereto, and is included in the upper portion of the keyboard 382 or at least a portion of the keyboard 382 area. can be placed.
  • the coupling structure 380 may include various coupling structures.
  • the coupling structure 380 may include at least one POGO structure, at least one magnetic, and/or at least one electrical connection member.
  • the electrical connection member may include an electrical connector that electrically connects the electronic device 301 and the input device 302 .
  • the electrical connector may include at least one movable conductive pin.
  • coupling structure 380 may include a recess, a moving member, and/or a retainer system. In the recess, for example, at least a portion of the side member 310 of the electronic device 301 may be seated.
  • the movable member may provide mobility to enable pivotal movement in a state in which the electronic device 301 is coupled to the input device 302 .
  • the retainer system may fix the structure so that the at least one or more POGO structures are not lifted.
  • the keyboard 382 may include a plurality of keys.
  • the input device 302 may transmit data input through the keyboard 382 to the outside (eg, the electronic device 301 ).
  • the input device 302 transmits data input through the keyboard 382 to the electronic device. It can be transmitted to (301).
  • the mouse track pad 384 may be formed on at least one area of the input device 302 .
  • the input device 302 may transmit data input through the mouse track pad 384 to the outside (eg, the electronic device 301 ).
  • the content of transmitting the input data to the outside may be referred to as the above-described content on the keyboard 382 .
  • a component defined as the input device 302 may be defined as an external input device.
  • FIG. 4 is a block diagram illustrating an electronic device 401 , an input device 402 , and an external electronic device 403 according to various embodiments of the present disclosure.
  • the external electronic device 403 (eg, the electronic device 102 of FIG. 1 ) may be substantially the same as the electronic device 401 . All or part of the operations performed by the electronic device 401 may be executed by the external electronic device 403 .
  • the electronic device 401 may perform at least one of an operation related to the specified function (eg, an operation of displaying data received from the input device 402 on a display) instead of or additionally executing the specified function by itself. A portion may be requested from the external electronic device 403 .
  • the electronic device 401 and the external electronic device 403 include the processors 420 and 422 (eg, the processor 120 of FIG. 1 ) and the memories 430 and 432 (eg, the memory of FIG. 1 ). 130 ), display modules 460 , 462 (eg, display module 160 of FIG. 1 ), and/or communication modules 490 , 492 (eg, communication module 190 of FIG. 1 ).
  • the electronic device 401 may further include a connection terminal 478 (eg, the connection terminal 178 of FIG. 1 ).
  • the components of the electronic device 401 and the external electronic device 403 illustrated in FIG. 4 are exemplary, and may further include components not shown, and may not include at least some of the illustrated components. there is.
  • the electronic device 401 and the input device 402 may further include a micro controller unit (MCU).
  • the MCU may include an input/output interface and/or memory used when a plurality of electronic devices transmit and/or receive data.
  • the electronic device 401 and the external electronic device 403 may store commands or data in the memories 430 and 432 .
  • the memories 430 and 432 may store data (eg, pairing information) related to a communication function between electronic devices.
  • the electronic device 401 may communicate with the external electronic device 403 using at least some of the data.
  • the memories 430 and 432 may store information corresponding to data (eg, coordinate data) received from the input device 402 .
  • the electronic device 401 may analyze input data received from the input device 402 using the information, and may generate new input data based on the analysis result.
  • the memories 430 and 432 may include volatile memory or non-volatile memory.
  • the electronic device 401 and the external electronic device 403 store at least a portion of commands or data transmitted or received from the communication modules 490 and 492 in a volatile memory, and process the commands or data stored in the memory. and the result data may be stored in a non-volatile memory.
  • the electronic device 401 may store at least a portion of commands or data transmitted/received to and from the input device 402 in a memory included in the MCU.
  • the MCU included in the electronic device 401 may be connected to the MCU included in the input device 402 .
  • the MCU included in the electronic device 401 and the MCU included in the input device 402 may be connected using 1-Wire communication.
  • the electronic device 401 may receive input data transmitted from the input device 402 through 1-Wire communication, process the input data using an MCU, and transmit it to the processor 420 .
  • the electronic device may transmit data processed using the MCU to the processor 420 using I2C (Inter-Integrated Circuit) communication.
  • I2C Inter-Integrated Circuit
  • the electronic device 460 and the external electronic device 403 may display user interfaces related to various functions using the display modules 460 and 462 .
  • the electronic device 460 may display a user interface including a connection state with the external electronic device 403 using the display module 460 .
  • the electronic device 401 displays a user interface including the state of the external electronic device 403 on the display module 460.
  • the connection with the external electronic device 403 is released and the connection state with the external electronic device 403 is displayed on the display module 460 .
  • the sleep state may be referred to as a state in which the external electronic device 403 does not operate for a predetermined time and waits (eg, an idle state).
  • the sleep state may be referred to as a state in which the external electronic device 403 operates using power less than or equal to a specified value (eg, a low power mode).
  • the user interface determines whether to connect to at least one external electronic device (eg, the external electronic device 403 ), searches for an additional external electronic device to be connected to the electronic device 401 , or the electronic device 401 and the at least one It may include a graphical user interface (GUI) corresponding to at least one of functions for displaying a connection state with an external electronic device.
  • GUI graphical user interface
  • the electronic device 401 may communicate with the external electronic device 403 using the communication modules 490 and 492 .
  • the communication modules 490 and 492 may support establishment of a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 401 and the external electronic device 403 and performing communication through the established communication channel.
  • the communication modules 490 and 492 may include a Bluetooth communication module.
  • the electronic device 401 and the external electronic device 403 may perform Bluetooth communication using the communication modules 490 and 492 .
  • the electronic device 401 may be connected to an external electronic device based on a Human Interface Device (HID) profile.
  • HID Human Interface Device
  • the electronic device 401 may be connected to an external device (eg, the input device 302 of FIG. 3 ) through the connection terminal 478 (eg, the connection terminal 378 of FIG. 3 ).
  • the connection terminal 478 may include various connection structures.
  • the connection terminal 478 may include at least one pogo pin.
  • the pogo pin may include, for example, a pogo pin member and a recessed member.
  • the pogo pin member may be included in the recessed member.
  • the depression member may have a shape such that at least a portion of the pogo pin member (eg, a plunger) is exposed to the outside.
  • the electronic device 401 may be physically and electrically connected to the input device 402 through at least one pogo pin included in the connection terminal 478 .
  • the pogo pin member included in the at least one pogo pin is coupled to the socket member included in the coupling structure of the input device 402 (eg, the coupling structure 380 of FIG. 3 ) to form the electronic device 401 and
  • the input device 402 may be physically and electrically connected.
  • at least a portion of the pogo pin member of the electronic device 401 may be inserted into the socket member of the input device 402 .
  • the electronic device 401 may perform various functions using components based on the control of the processor 420 .
  • the processor 420 may receive a first selection signal from an input device physically and electrically connected through the connection terminal 478 .
  • the first selection signal may include, for example, a selection signal for determining an external electronic device (eg, the external electronic device 403 ) to perform wireless communication with the electronic device 401 .
  • the processor 420 may perform a Bluetooth connection operation with the external electronic device 403 determined based on the first selection signal using the communication module 490 .
  • the electronic device 401 transmits a connection request signal to the external electronic device 403 , receives a response signal to the connection request signal from the external electronic device 403 , and when the response signal is received, the A pairing operation may be performed with the external electronic device 403 and wirelessly connected to the external electronic device 403 using the communication module 490 .
  • the connection request signal may include account information of the electronic device 401 .
  • the electronic device 401 performs a specified processing operation (eg, an encryption processing operation using a hash function) on the account information of the electronic device 401 in the connection request signal, and includes the data on which the processing operation is performed
  • the connection request signal may be transmitted (eg, broadcast).
  • the electronic device 401 receives a response signal from the external electronic device 403 including the same account information as the account information included in the connection request signal, and in response to the reception of the response signal, the external electronic device 403 It may perform a pairing operation with and wirelessly connect to the external electronic device 403 using the communication module. For example, when a response signal is received from the external electronic device 403 , the electronic device 401 may determine whether the external electronic device 403 includes the same account information as the electronic device 401 . After performing the reconfirmation operation, the electronic device 401 performs a wireless connection operation with the external electronic device 403 when it is determined that the external electronic device 403 includes the same account information as the electronic device 401 . can do.
  • the processor 420 When connected to the external electronic device 403 , the processor 420 displays a user interface including a connection state with the external electronic device 403 using the display module 460 , and after connecting to the external electronic device 403 , At least a portion of the first input data received from the input device 402 may be controlled to be transmitted to the external electronic device 403 .
  • the first input data may include, for example, coordinate data.
  • the coordinate data may be referred to as data including a coordinate value corresponding to a region to which a touch input is applied among keyboard regions included in the input device 402 .
  • the processor 420 may analyze the coordinate data included in the first input data, generate second input data based on the analysis result, and transmit the generated second input data to the external electronic device 403 .
  • the processor 420 uses pairing information stored in the memory 430 to A Bluetooth connection operation may be performed with the electronic device 403 .
  • the pairing information may include data related to a Bluetooth connection between the electronic device 401 and the external electronic device 403 (eg, BD_ADDR information, type, name, and/or MAC Address of the external electronic device).
  • the processor 420 may perform a connection with other external electronic devices in addition to the external electronic device 403 based on a selection signal received from the input device 402 .
  • the processor 420 releases the connection with the external electronic device 403 using the communication module 490 and An external electronic device (not shown) and the electronic device 401 may be connected via Bluetooth. After connection with the second external electronic device, the processor 420 may transmit at least a portion of the third input data received from the input device 402 to the second external electronic device. The processor 420 may analyze the coordinate data included in the third input data, generate fourth input data based on the analysis result, and transmit it to the second external electronic device.
  • the external electronic device 403 may receive a connection request signal from the electronic device 401 and identify various pieces of information included in the connection request signal. For example, the external electronic device 403 may identify account information included in the connection request signal and determine whether the account information is the same as the account information of the external electronic device 403 . When it is determined that the account information is the same as the account information of the external electronic device 403 , the external electronic device 403 determines whether to connect to the electronic device 401 using the display module 462 , the first user interface can be displayed.
  • connection request signal A response signal corresponding to may be generated and transmitted to the electronic device 401 .
  • the response signal may include account information of the external electronic device 403 .
  • the external electronic device 403 displays a user interface including information on whether to connect to the electronic device 401 using the display module 462 .
  • the external electronic device 403 may be wirelessly connected to the electronic device 401 (eg, a tablet electronic device) based on a Human Interface Device (HID) profile.
  • the external electronic device 403 recognizes the electronic device 401 as an input device (eg, a key input device and/or a pad input device) while wirelessly connected to the electronic device 401 , and connects to the electronic device 401 .
  • a screen generated by recognizing the electronic device 401 as an input device may be displayed through a user interface including information on whether or not the electronic device is present.
  • the electronic device 401 and the external electronic device 403 may use various data and/or user interfaces in the process of performing a wireless connection operation for the first time. Methods of using the various data and/or user interfaces may be sequentially described in the following paragraphs.
  • the electronic device 401 may first perform a connection operation with the external electronic device 403 based on a specified key input detected by the input device 402 .
  • the electronic device 401 may receive data generated based on a specified key input from the input device 402 .
  • the specified key input may be a key button combination set by a user.
  • the electronic device 401 may receive the data from the input device 402 and may transition to a state capable of performing a connection operation with at least some of the external electronic devices.
  • the electronic device 401 may receive the data from the input device 402 and activate a connection mode (eg, a Bluetooth connection mode).
  • the electronic device 401 may selectively display a user interface related to connection mode activation.
  • the electronic device 401 may activate the connection mode in response to an input (eg, a touch input by a user) sensed in the user interface related to the activation of the connection mode.
  • the electronic device 401 may transmit (eg, broadcast) a connection request signal.
  • the electronic device 401 receives data generated based on a specified key input from the input device 402 , performs a connection mode activation operation in response to the reception of the data, and performs Bluetooth Low Energy (BLE)
  • BLE Bluetooth Low Energy
  • a connection request signal may be transmitted to the outside using communication.
  • the connection request signal may include information related to the HID profile and/or account information of the electronic device 401 .
  • a specified processing operation eg, an encryption processing operation using a hash function
  • the connection request signal may be transmitted.
  • the external electronic device 403 may receive the connection request signal transmitted from the electronic device 401 and generate and transmit a response signal to the connection request signal.
  • the external electronic device 403 detects a connection request signal using a framework (eg, Multi Connectivity Framework (MCF)), and account information of the electronic device 401 included in the connection request signal. It may be determined whether is the same as the account information of the external electronic device 403 .
  • MCF Multi Connectivity Framework
  • the external electronic device 403 connects to the electronic device 401 using the display module 462 .
  • a first user interface for determining whether or not to do so may be displayed.
  • the first user interface may not be displayed.
  • the external electronic device 403 may provide a function for manually performing a connection with the electronic device 401 using a user interface designated by the user (eg, a user interface related to Bluetooth manual setting).
  • FIG. 5 is a block diagram 500 illustrating a software structure in the electronic device 501 according to various embodiments of the present disclosure.
  • the plurality of layers included in the electronic device 501 include the input sensing unit 510 , the input processing unit 520 , the operating system 530 (eg, the operating system 142 of FIG. 2 ), and a middle layer. It may include a wear 540 (eg, the middleware 144 of FIG. 2 ), and/or a communication unit 550 .
  • the input sensing unit 510 may detect data transmitted from the outside.
  • the input sensing unit 510 may include a key input sensing unit and/or a pad input sensing unit.
  • the key input detection unit may detect input data (eg, key input data) generated by a user using a keyboard included in the input device.
  • the pad input sensing unit may detect input data (eg, pad input data) generated by a user using a touch pad included in the input device.
  • the input sensor 510 may detect data transmitted from the input device 502 physically and/or electrically connected to the electronic device 501 . Data transmitted from input device 502 may include selection signals and/or input data.
  • the selection signal may include a control signal (eg, the first selection signal or the second selection signal of FIG. 4 ) for determining at least one of a plurality of external electronic devices for wireless communication with the electronic device 501 .
  • the input data (eg, the first input data or the third input data of FIG. 4 ) may include coordinate data including coordinate values corresponding to at least one region of the input device 502 .
  • the operating system 530 (eg, the operating system 142 of FIG. 2 ) manages at least one system resource (eg, a process, memory, and/or power) of the electronic device 501 . (e.g. allocation or recall) can be controlled.
  • the operating system 530 may include at least one driver program for driving a hardware device (eg, the input device 502 ) connected to the electronic device 501 .
  • the middleware 540 may provide various functions to an application so that a function or information provided from at least one resource of the electronic device 501 may be used by the application.
  • the electronic device 501 may process data transmitted from the input device 502 using the operating system 530 and the middleware 540 .
  • the operating system 530 detects the input data transmitted from the input processing unit 520 as an event, and the middleware 540 transmits at least a portion of the input data to the external ( For example, it can be processed so that it can be transmitted to the external electronic device 503).
  • the operating system 530 may include an OS input sensing unit and/or an OS input processing unit.
  • the OS input detection unit may detect input data (eg, key input data and/or pad input data) processed by the input processing unit 520 as an event for the operating system 530 .
  • the OS input processing unit may perform a processing operation on input data detected as an event.
  • the communication unit 550 may perform a function of allowing the electronic device 501 to communicate with the outside.
  • the communication unit 550 may transmit at least a portion of input data processed by the electronic device 501 to the external electronic device 503 .
  • the communication unit 550 may use a Bluetooth module and/or an HID profile.
  • the communication unit 550 may include a Bluetooth preprocessor and/or a Bluetooth connection module.
  • the Bluetooth preprocessor may perform a preprocessing operation on input data transmitted from the OS input processor included in the operating system 530 .
  • the Bluetooth connection module may transmit input data transmitted after being preprocessed by the Bluetooth preprocessor to the external electronic device.
  • FIG. 6 illustrates user interfaces 601 and 602 displayed on a display of an electronic device, according to various embodiments of the present disclosure.
  • an electronic device (eg, the electronic device 101 of FIG. 1 ) includes a connection state with an external electronic device (eg, the external electronic device 403 of FIG. 4 ).
  • a user interface can be displayed.
  • the electronic device may include a setting list 620 for controlling connection with a plurality of external electronic devices in a setting screen 610 including information related to the input device and display it on the display.
  • the setting list 620 for controlling connection with a plurality of external electronic devices may include a setting screen 622 corresponding to the first external electronic device and a setting screen 624 for additionally connecting an external electronic device. .
  • the electronic device may be connected to the first external electronic device via Bluetooth.
  • the electronic device may be Bluetooth-connected to the first external electronic device based on the HID profile.
  • the electronic device when an input 630 is detected on a setting screen 624 for additionally connecting an external electronic device, the electronic device is displayed in the setting list 620 to the second external electronic device.
  • a corresponding setting screen 640 may display an added user interface.
  • the electronic device causes the user to delete the setting screen 640 corresponding to the second external electronic device in one area of the setting screen 640 .
  • the interface 642 and the user interface 644 for changing and displaying the interface 642 and another external electronic device may be displayed.
  • FIG. 7 illustrates a user interface 700 displayed on a display of an electronic device according to various embodiments of the present disclosure.
  • the electronic device eg, the electronic device 101 of FIG. 1
  • displays a user interface including a connection state with an external electronic device on a display eg, the display module 160 of FIG. 1
  • a display eg, the display module 160 of FIG. 1
  • the electronic device includes icons 710a, 710b, 710c, 710d, 710e, and 710f) can be displayed.
  • a color change eg, a color change from a gray icon to a blue icon
  • the connection status can be used to display the connection status.
  • FIG. 8 is a flowchart illustrating an operation of processing input data of an electronic device 800 according to various embodiments of the present disclosure.
  • the electronic device may receive a first selection signal from an input device (eg, the input device 302 of FIG. 3 ).
  • the electronic device may be physically and electrically connected to the input device through a connection terminal (eg, the connection terminal 478 of FIG. 4 ).
  • the first selection signal may include a control signal for selecting the first external electronic device.
  • the electronic device may determine an external electronic device to communicate with based on the received first selection signal. For example, the electronic device may determine the external electronic device to communicate with as the first external electronic device based on the first selection signal.
  • the electronic device may be connected to the determined first external electronic device via Bluetooth.
  • the electronic device may connect the electronic device to the first external electronic device via Bluetooth using a wireless communication circuit.
  • the electronic device may display a user interface including a connection state with external electronic devices on a display (eg, the display module 160 of FIG. 1 ).
  • a user interface including a connection state with external electronic devices may be referred to with reference to the drawings shown in FIGS. 6 and 7 .
  • the electronic device may transmit data related to the first input data to the first external electronic device.
  • the first input data may be referred to as input data received from the input device after the electronic device is Bluetooth-connected to the first external electronic device.
  • the first input data may include coordinate data.
  • the electronic device may generate second input data based on the first input data and transmit it to the first external electronic device. The processing of the first input data may be described in more detail with reference to FIG. 9 to be described later.
  • FIG. 9 is a flowchart illustrating an operation of processing input data of an electronic device 900 according to various embodiments of the present disclosure.
  • the electronic device may analyze coordinate data included in the first input data.
  • the electronic device may store the coordinate data corresponding to the coordinate data in a memory (eg, the memory 430 of FIG. 4 ) and analyze the received coordinate data using the stored information.
  • the electronic device may generate second input data based on the analysis result of the coordinate data.
  • the second input data may include data (eg, text data) to be transmitted to the external electronic device.
  • the electronic device may transmit the generated second input data to the first external electronic device.
  • the electronic device is Bluetooth-connected to the first external electronic device based on a Human Interface Device (HID) profile, and in the Bluetooth-connected state, transmits second input data to the first external electronic device through Bluetooth communication.
  • HID Human Interface Device
  • FIG. 10 is a flowchart illustrating an operation of processing input data of an electronic device 1000 according to various embodiments of the present disclosure.
  • the electronic device eg, the electronic device 101 of FIG. 1
  • a first external electronic device eg, the external electronic device 403 of FIG. 4
  • the electronic device may be connected to the first external electronic device via Bluetooth based on a Human Interface Device (HID) profile.
  • HID Human Interface Device
  • the electronic device may perform operation 1015 .
  • the electronic device may continue to perform operation 1005 .
  • the electronic device may disconnect the first external electronic device and perform a Bluetooth connection with the second external electronic device.
  • the electronic device may be connected to the second external electronic device via Bluetooth based on a Human Interface Device (HID) profile.
  • HID Human Interface Device
  • the electronic device may transmit data associated with the third input data to the second external electronic device.
  • the third input data may be referred to as input data received from the input device after the electronic device is connected to the second external electronic device, for example.
  • the electronic device may analyze the coordinate data included in the third input data, generate fourth input data based on the analysis result, and transmit the fourth input data to the second external electronic device.
  • FIG. 11 is a flowchart illustrating an operation of processing input data of an external electronic device (eg, the external electronic device 403 of FIG. 4 ) according to various embodiments of the present disclosure.
  • an external electronic device eg, the external electronic device 403 of FIG. 4
  • an operation performed by an external electronic device eg, the external electronic device 403 of FIG. 4 based on a specified signal transmitted from the electronic device (eg, the electronic device 401 of FIG. 4 ) may be described. .
  • the external electronic device may receive a connection request signal transmitted from the electronic device.
  • the external electronic device may detect a connection request signal using a framework (eg, Multi Connectivity Framework (MCF)).
  • MCF Multi Connectivity Framework
  • the connection request signal may include account information of the electronic device.
  • the electronic device performs a specified processing operation (eg, an encryption processing operation using a hash function) on the account information of the electronic device in the connection request signal, includes the data on which the processing operation is performed, and then transmits the connection request signal (eg broadcast).
  • a specified processing operation eg, an encryption processing operation using a hash function
  • the external electronic device may identify account information included in the connection request signal. For example, the external electronic device may determine whether account information (eg, account information of the electronic device) included in the connection request signal is the same as account information of the external electronic device.
  • account information eg, account information of the electronic device
  • the external electronic device may perform operation 1120 .
  • the external electronic device may perform operation 1125 .
  • the external electronic device may transmit an external response signal to the electronic device.
  • the external electronic device may automatically generate a response signal and transmit it to the electronic device.
  • the external electronic device uses a display module (eg, the display module 462 of FIG. 4 ) to the electronic device A first user interface for determining whether to connect to the user interface may be displayed.
  • the external electronic device generates a response signal corresponding to the connection request signal when an input (eg, a touch input by a user) is sensed in at least a part of the first user interface for determining whether to connect to the electronic device and generates an electronic device. can be sent to the device.
  • the response signal may include account information of the external electronic device.
  • the external electronic device after being wirelessly connected to the electronic device in response to the response signal, the external electronic device may display a user interface including information on whether to connect to the electronic device using a display module.
  • an external electronic device may be wirelessly connected to an electronic device (eg, a tablet electronic device) based on a Human Interface Device (HID) profile.
  • HID Human Interface Device
  • the external electronic device recognizes the electronic device as an input device (eg, a key input device and/or a pad input device) while wirelessly connected to the electronic device, and a user interface including information on whether to connect to the electronic device Through , a screen generated by recognizing the electronic device as an input device may be displayed.
  • an input device eg, a key input device and/or a pad input device
  • the external electronic device may transmit a response signal to the electronic device based on a specified input. For example, when it is determined that the account information included in the connection request signal is not the same as the account information of the external electronic device 403 , the external electronic device may not display the first user interface.
  • the external electronic device may transmit a response signal generated based on a specified input (eg, a touch input by a user) to the electronic device.
  • the external electronic device may generate a response signal based on an input to the second user interface (eg, a user interface related to Bluetooth manual setting). That is, the external electronic device may provide a function to manually connect to the electronic device based on an input to the second user interface.
  • FIG. 12 illustrates various user interfaces 1201 and 1202 provided by an external electronic device (eg, the external electronic device 403 of FIG. 4 ) according to various embodiments of the present disclosure.
  • an external electronic device eg, the external electronic device 403 of FIG. 4
  • the external electronic device may use various user interfaces 1201 and 1202 through the display module 1260 (eg, the display module 462 of FIG. 4 ). ) can be displayed.
  • the display module 1260 e.g, the display module 462 of FIG. 4
  • the external electronic device performs user interfaces ( 1201 and 1202) can be displayed.
  • the external electronic device displays the display module (
  • the first user interface 1210 may be displayed through 1260 .
  • the first user interface 1210 may include a plurality of buttons (a first button 1213 and a second button 1215 ) for determining whether an external electronic device and the electronic device are wirelessly connected.
  • the first user interface 1210 may include a graphic user interface (GUI) corresponding to an input device (eg, the input device 402 of FIG. 4 ) connected to the electronic device.
  • GUI graphic user interface
  • the external electronic device may not perform a wireless connection operation with the electronic device. there is.
  • the external electronic device when an input is sensed on the second button 1215 of the first user interface 1210 , the external electronic device generates a response signal corresponding to the connection request signal transmitted from the electronic device and transmits the generated response signal to the electronic device.
  • the external electronic device displays the first user interface 1210 on the display module 1260 .
  • the external electronic device when it is determined that the account information included in the connection request signal transmitted from the electronic device is the same as the account information of the external electronic device, the external electronic device does not display the first user interface 1210 and automatically responds with a signal may be generated and transmitted to the electronic device.
  • a second user interface 1230 (eg, a user interface related to Bluetooth manual setting) may be displayed on the module 1260 .
  • the second user interface 1230 may include a GUI (eg, a third button 1231 ) corresponding to a plurality of external electronic devices to perform a wireless connection operation with the external electronic device.
  • the external electronic device may not display the first user interface.
  • the external electronic device may display the second user interface 1230 based on an input to the manual connection button 1220 (eg, a touch input by a user). For example, the external electronic device may generate a response signal based on an input to at least one area (eg, the third button 1231 ) of the second user interface 1230 . That is, the external electronic device may provide a function of transmitting a response signal for wirelessly connecting to the electronic device corresponding to the third button 1231 manually based on an input to at least one region of the second user interface 1230 .
  • the manual connection button 1220 eg, a touch input by a user
  • the external electronic device may generate a response signal based on an input to at least one area (eg, the third button 1231 ) of the second user interface 1230 . That is, the external electronic device may provide a function of transmitting a response signal for wirelessly connecting to the electronic device corresponding to the third button 1231 manually based on an input to at least one region of the second user interface 1230 .
  • the electronic device (eg, the electronic device 101 of FIG. 1 ) includes a touch screen display, a wireless communication circuit, and an external input device (eg, the electronic device 101 of FIG. 3 ) including at least one coupling structure.
  • an external input device eg, the electronic device 101 of FIG. 3
  • a connection terminal formed on one side of the electronic device, a processor, and a memory operatively connected to the processor may be included.
  • the processor when the memory is executed, receives a first selection signal from the external input device through the connection terminal, and performs wireless communication with the electronic device using the wireless communication circuit determining a first external electronic device to be selected based on the first selection signal, transmitting a connection request signal to the first external electronic device, and receiving a response signal to the connection request signal from the first external electronic device; , when the response signal is received, performing a pairing operation with the first external electronic device, wirelessly connecting the electronic device and the first external electronic device using the wireless communication circuit, and the first external electronic device Upon connection with the electronic device, a user interface including a connection state with the first external electronic device is displayed on the touch screen display, and after connection with the first external electronic device, the external input One or more instructions for controlling to transmit data related to the first input data received from the device to the first external electronic device through the wireless communication circuit may be stored.
  • the first input data includes coordinate data
  • the processor analyzes the coordinate data included in the first input data, and the It may be configured to generate second input data based on the analysis result and transmit the generated second input data to the first external electronic device.
  • connection terminal includes at least one pogo pin, and the pogo pin member included in the at least one pogo pin is coupled with the socket member included in the at least one coupling structure. It may be physically and electrically connected to the external input device.
  • the memory further stores pairing information with the first external electronic device, and when the one or more instructions are executed, the processor causes the processor to send the first information from the external input device.
  • the 1st selection signal When the 1st selection signal is received, it may be set to connect to the first external electronic device via Bluetooth using the pairing information stored in the memory.
  • the external input device may include at least one of a keyboard and a mouse track pad.
  • the third input data includes coordinate data
  • the processor analyzes the coordinate data included in the third input data, and the It may be configured to generate fourth input data based on the analysis result and transmit the generated fourth input data to the second external electronic device.
  • the display of the first external electronic device is displayed on the display.
  • a user interface including a state is displayed, and when it is determined that the first external electronic device continues to be in the sleep state after a specified time has elapsed, the connection with the first external electronic device is released and the first external electronic device is displayed on the display. 1 It may be set to display a user interface including a connection state with an external electronic device.
  • connection request signal further includes account information of the electronic device, and when the one or more instructions are executed, the processor causes the account included in the connection request signal to be executed.
  • receiving a response signal including account information identical to the information from the first external electronic device performing a pairing operation with the first external electronic device in response to the reception of the response signal, and using the wireless communication circuit It may be configured to wirelessly connect the electronic device and the first external electronic device.
  • a method for providing a function for an electronic device to process input data includes: receiving a first selection signal from an external input device physically and electrically connected through a connection terminal; Determining a first external electronic device to perform wireless communication with the electronic device using a wireless communication circuit based on a first selection signal, transmitting a connection request signal to the first external electronic device, the first Receiving a response signal to the connection request signal from an external electronic device, and when the response signal is received, performing a pairing operation with the first external electronic device to connect the electronic device and the first external electronic device
  • An operation of wirelessly connecting, an operation of displaying a user interface including a state of connection with the first external electronic device on a touch screen display in response to being connected to the first external electronic device, and an operation of the first after connecting to the external electronic device, transmitting data related to the first input data received from the external input device to the first external electronic device through the wireless communication circuit; may include
  • the first input data includes coordinate data
  • transmitting at least a portion of the first input data to the first external electronic device includes the coordinate data included in the first input data.
  • analyzing , generating second input data based on the analysis result, and transmitting the generated second input data to the first external electronic device may further include.
  • the Bluetooth connection of the electronic device to the determined first external electronic device using the wireless communication circuit may include connecting the electronic device and the first external electronic device to a Human Interface Device (HID) profile ( profile) may further include an operation of connecting based on the.
  • HID Human Interface Device
  • connection terminal includes at least one pogo pin, and the pogo pin member included in the at least one pogo pin is coupled with the socket member included in the at least one coupling structure. It may be physically and electrically connected to the external input device.
  • a method for providing a function for an electronic device to process input data when the first selection signal is received from the external input device, pairing with the first external electronic device stored in a memory ) using the information to connect to the first external electronic device via Bluetooth.
  • the external input device may include at least one of a keyboard and a mouse track pad.
  • a method for providing a function for an electronic device to process input data when receiving a second selection signal including a selection signal for determining a second external electronic device from the external input device, the After releasing the connection with the first external electronic device using a wireless communication circuit, performing Bluetooth connection with the second external electronic device, and connecting with the second external electronic device, the second external electronic device received from the external input device 3
  • the method may further include transmitting data related to the input data to the second external electronic device.
  • the third input data includes coordinate data
  • transmitting at least a portion of the third input data to the second external electronic device includes the coordinate data included in the third input data.
  • generating fourth input data based on the analysis result and transmitting the generated fourth input data to the second external electronic device.
  • a method for providing a function for an electronic device to process input data when it is determined that the first external electronic device is in a sleep state, the display of the first external electronic device is displayed on the display.
  • the connection with the first external electronic device is released and the display is displayed on the display.
  • displaying a user interface including a connection state with a first external electronic device may further include.
  • connection request signal further includes account information of the electronic device
  • operation of wirelessly connecting the electronic device and the first external electronic device using the wireless communication circuit includes: An operation of receiving a response signal including account information identical to the account information included in the connection request signal from the first external electronic device and a pairing operation with the first external electronic device in response to the reception of the response signal and wirelessly connecting the electronic device and the first external electronic device using the wireless communication circuit.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Telephone Function (AREA)

Abstract

Est divulgué un dispositif électronique comprenant une unité d'affichage à écran tactile, un circuit de communication sans fil, un terminal de connexion, un processeur et une mémoire. Le dispositif électronique peut : recevoir un premier signal de sélection en provenance d'un dispositif d'entrée externe par l'intermédiaire du terminal de connexion ; déterminer, en fonction du premier signal de sélection, un premier dispositif électronique externe devant effectuer une communication sans fil ; transmettre un signal de demande de connexion au premier dispositif électronique externe ; recevoir, en provenance du premier dispositif électronique externe, un signal de réponse en réponse au signal de demande de connexion ; lorsque le signal de réponse est reçu, effectuer un appariement au premier dispositif électronique externe ; connecter sans fil le dispositif électronique et le premier dispositif électronique externe ; lorsque la connexion au premier dispositif électronique externe est réalisée, afficher, sur l'unité d'affichage à écran tactile, une interface utilisateur comprenant un état de la connexion au premier dispositif électronique externe ; et après la connexion au premier dispositif électronique externe, transmettre, au premier dispositif électronique externe, des données associées à des premières données d'entrée reçues en provenance du dispositif d'entrée externe. Divers autres modes de réalisation identifiés dans l'invention sont également possibles.
PCT/KR2021/012866 2020-09-23 2021-09-17 Procédé de traitement de données d'entrée et dispositif électronique le prenant en charge WO2022065845A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020200122752A KR20220040038A (ko) 2020-09-23 2020-09-23 입력 데이터 처리 방법 및 이를 지원하는 전자 장치
KR10-2020-0122752 2020-09-23

Publications (1)

Publication Number Publication Date
WO2022065845A1 true WO2022065845A1 (fr) 2022-03-31

Family

ID=80845636

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2021/012866 WO2022065845A1 (fr) 2020-09-23 2021-09-17 Procédé de traitement de données d'entrée et dispositif électronique le prenant en charge

Country Status (2)

Country Link
KR (1) KR20220040038A (fr)
WO (1) WO2022065845A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024027207A1 (fr) * 2022-08-04 2024-02-08 荣耀终端有限公司 Procédé et appareil de transmission de données

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110114042A (ko) * 2010-04-12 2011-10-19 (주) 지.티 텔레콤 마운팅형 송수신 블루투스유니트
US20140364060A1 (en) * 2013-06-07 2014-12-11 Apple Inc. Ordering a List of Wireless Devices for Display in a Graphical User Interface
KR20150081204A (ko) * 2014-01-03 2015-07-13 삼성전자주식회사 전자 장치
KR101595483B1 (ko) * 2014-10-29 2016-02-19 올토주식회사 이동 단말기를 사용한 전자기기를 제어하는 방법
KR102003978B1 (ko) * 2012-10-19 2019-10-01 삼성전자주식회사 전자 장치 및 이를 이용한 운용 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110114042A (ko) * 2010-04-12 2011-10-19 (주) 지.티 텔레콤 마운팅형 송수신 블루투스유니트
KR102003978B1 (ko) * 2012-10-19 2019-10-01 삼성전자주식회사 전자 장치 및 이를 이용한 운용 방법
US20140364060A1 (en) * 2013-06-07 2014-12-11 Apple Inc. Ordering a List of Wireless Devices for Display in a Graphical User Interface
KR20150081204A (ko) * 2014-01-03 2015-07-13 삼성전자주식회사 전자 장치
KR101595483B1 (ko) * 2014-10-29 2016-02-19 올토주식회사 이동 단말기를 사용한 전자기기를 제어하는 방법

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024027207A1 (fr) * 2022-08-04 2024-02-08 荣耀终端有限公司 Procédé et appareil de transmission de données

Also Published As

Publication number Publication date
KR20220040038A (ko) 2022-03-30

Similar Documents

Publication Publication Date Title
WO2021075786A1 (fr) Dispositif électronique et procédé de traitement d'une fenêtre surgissante utilisant une multi-fenêtre de celui-ci
WO2022108192A1 (fr) Dispositif électronique et procédé de commande multi-fenêtre de dispositif électronique
AU2018321518B2 (en) Method for determining input detection region corresponding to user interface and electronic device thereof
WO2022065845A1 (fr) Procédé de traitement de données d'entrée et dispositif électronique le prenant en charge
WO2022154264A1 (fr) Dispositif électronique et procédé de fonctionnement d'un dispositif électronique
WO2023058860A1 (fr) Dispositif électronique pour le traitement d'un fichier apk à signatures multiples, et son procédé de fonctionnement
WO2022177299A1 (fr) Procédé de commande de fonction d'appel et dispositif électronique le prenant en charge
WO2022103019A1 (fr) Dispositif électronique et procédé d'exécution d'application pour dispositif électronique
WO2022196939A1 (fr) Dispositif électronique pour fournir un contenu alternatif, et son procédé de fonctionnement
WO2022030890A1 (fr) Procédé de capture d'image à fenêtres multiples et dispositif électronique associé
WO2022080683A1 (fr) Procédé et appareil de commande d'une connexion d'un dispositif de sortie audio sans fil
WO2022086057A1 (fr) Dispositif électronique et procédé d'enregistrement d'appel
WO2022119084A1 (fr) Dispositif électronique comprenant un écran extensible et procédé de fonctionnement associé
WO2023054905A1 (fr) Procédé et dispositif électronique pour utiliser des données d'un dispositif électronique externe
WO2023163375A1 (fr) Procédé et dispositif électronique de transfert de données de dispositif portable
WO2021177640A1 (fr) Procédé de commande d'application de dispositif électronique externe, et dispositif électronique prenant en charge ce dernier
WO2023013945A1 (fr) Dispositif électronique pour la régulation du bruit dû à une communication sans fil, et son procédé de fonctionnement
WO2024053931A1 (fr) Procédé de commutation de microphone et dispositif électronique
WO2022025375A1 (fr) Dispositif électronique de conversion d'un certain nombre de canaux audio et procédé de fonctionnement de dispositif électronique
WO2022119416A1 (fr) Dispositif électronique utilisant un stylo électronique et procédé correspondant
WO2022119147A1 (fr) Procédé et appareil de commande de glissement basé sur de multiples touchers
WO2022191400A1 (fr) Processeur pour déterminer un niveau de réactivité et dispositif électronique le comprenant
WO2023214675A1 (fr) Dispositif électronique et procédé de traitement d'entrée tactile
WO2024101916A1 (fr) Procédé de configuration de dispositif et dispositif électronique le prenant en charge
WO2022177061A1 (fr) Dispositif électronique préchargeant une application anormale en arrière-plan, et son procédé de fonctionnement

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21872873

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21872873

Country of ref document: EP

Kind code of ref document: A1