KR20220040038A - The method for processing input data and the electronic device supporting the same - Google Patents

Abstract

Disclosed is an electronic device including a touch screen display, a wireless communication circuit, a connector, a processor, and a memory operatively connected to the processor. The electronic device may receive a first selection signal from an external input device through a connector, determine a first external electronic device, which is to perform wireless communication, based on a first selection signal, transmit a connection request signal to the first external electronic device, receive a response signal to the connection request signal from the first external electronic device, perform a pairing operation with the first external electronic device, when the response signal is received, connect the electronic device with the first external electronic device wirelessly, display a user interface including a connection state with the first external electronic device on a touch screen display, as the user interface is connected to the first external electronic device, and transmit data associated with first input data received from the external input device to the first external electronic device, after connection with the first external electronic device. Besides, various embodiments detected through the specification may possible.

Description

Methods for processing input data and electronic devices supporting the same

Various embodiments disclosed in this document relate to an input data processing method and an electronic device supporting the same.

Recently, the number of users of terminal devices such as smart phones and tablet PCs that combine the functions of an electronic device and a function of a personal digital assistant (PDA) is increasing. The smart phone and/or tablet PC is equipped with a large-capacity memory and high-performance CPU compared to conventional electronic devices, and may be equipped with an operating system (OS) to support execution of various applications, voice and data communication, PC interworking, etc. .

When using smartphones and tablet PCs, separate input and output devices are often connected and used, especially Bluetooth headsets, Bluetooth hands-free, Bluetooth speakers, Bluetooth keyboards, and/or Bluetooth based on Bluetooth communication. HID (Human Interface Devices) devices, such as a mouse, are being developed.

In order for a user to connect an electronic device (eg, an input device (eg, a keyboard, a mouse, and/or a headset) connected to a tablet) to an external electronic device, there is a difficulty in performing an incidental operation.

For example, the user has a separate electronic device (eg, Bluetooth dongle) to connect the input device to an external electronic device, installs an input device sharing application, or performs a connection operation with a plurality of external electronic devices. There was a inconvenience of having to separately provide an input device that can be used.

An electronic device according to an embodiment disclosed in this document is formed on one side of the electronic device for physical and electrical connection between an external input device including a touch screen display, a wireless communication circuit, and at least one coupling structure, and the electronic device a connection terminal, a processor, and a memory operatively coupled to the processor, wherein the memory, when executed, causes the processor to receive a first selection signal from the external input device through the connection terminal; a first external electronic device to perform wireless communication with the electronic device using a wireless communication circuit is determined based on the first selection signal, and a connection request signal is transmitted to the first external electronic device; Receives a response signal to the connection request signal from the electronic device, performs a pairing operation with the first external electronic device when the response signal is received, and uses the wireless communication circuit to communicate with the electronic device and the second device 1 Wirelessly connect an external electronic device and display a user interface including a connection state with the first external electronic device on the touch screen display as it is connected with the first external electronic device; one or more instructions for controlling to transmit data related to first input data received from the external input device to the first external electronic device through the wireless communication circuit after connection with the first external electronic device can be saved.

A method for providing a function for an electronic device to process input data according to an embodiment disclosed in this document includes: receiving a first selection signal from an external input device physically and electrically connected through a connection terminal; Determining a first external electronic device to perform wireless communication with the electronic device using a wireless communication circuit based on a first selection signal, transmitting a connection request signal to the first external electronic device, the first Receiving a response signal to the connection request signal from an external electronic device, and when the response signal is received, performing a pairing operation with the first external electronic device to connect the electronic device and the first external electronic device An operation of wirelessly connecting, an operation of displaying a user interface including a state of connection with the first external electronic device on a touch screen display in response to being connected to the first external electronic device, and an operation of the first After the connection with the external electronic device, data related to the first input data received from the external input device may be transmitted to the first external electronic device through the wireless communication circuit.

According to various embodiments disclosed in this document, the electronic device directly transmits input data transmitted from the input device by communicating with the external electronic device, thereby providing convenience to a user using a plurality of terminals.

In addition, the electronic device having relatively high performance compared to the input device directly communicates with the external electronic device and transmits the input data transmitted from the input device, thereby overcoming the limitation in the number of external electronic devices connectable to the conventional input device. there is.

In addition, various effects directly or indirectly identified through this document may be provided.

1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure;
2 is a block diagram illustrating a program according to various embodiments of the present disclosure;
3 illustrates an electronic device and an input device according to various embodiments of the present disclosure;
4 is a block diagram of an electronic device, an input device, and an external electronic device according to various embodiments of the present disclosure;
5 is a block diagram illustrating a software structure in an electronic device, according to various embodiments of the present disclosure;
6 illustrates a user interface displayed on a display of an electronic device, according to various embodiments of the present disclosure;
7 illustrates a user interface displayed on a display of an electronic device, according to various embodiments of the present disclosure;
8 is a flowchart illustrating an operation of processing input data of an electronic device according to various embodiments of the present disclosure;
9 is a flowchart illustrating an operation of processing input data of an electronic device, according to various embodiments of the present disclosure;
10 is a flowchart illustrating an operation of processing input data of an electronic device, according to various embodiments of the present disclosure;
11 is a flowchart illustrating an operation of processing input data of an external electronic device, according to various embodiments of the present disclosure;
12 illustrates various user interfaces provided by an external electronic device, according to various embodiments of the present disclosure.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Hereinafter, various embodiments of the present document will be described with reference to the accompanying drawings. However, this is not intended to limit the technology described in this document to specific embodiments, and it should be understood that various modifications, equivalents, and/or alternatives of the embodiments of this document are included. .

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 may use less power than the main processor 121 or may be set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the co-processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101) may be implemented as software (eg, the program 140) including For example, a processor (eg, processor 120 ) of a device (eg, electronic device 101 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store™) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly between smartphones (eg: smartphones) and online. In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

2 is a block diagram 200 illustrating a program 140, according to various embodiments. Meanwhile, among the components shown in FIG. 2, components having the same reference numbers as those of FIG. 1 (eg, the program 140, the operating system 142, the middleware 144, and/or the application 146). The description may be referred to by the description of FIG. 1 .

According to an embodiment, the program 140 executes an operating system 142 for controlling one or more resources of the electronic device 101 , middleware 144 , or an application 146 executable in the operating system 142 . may include Operating system 142 may include, for example, Android ^TM , iOS ^TM , Windows ^TM , Symbian ^TM , Tizen ^TM , or Bada ^TM . At least some of the programs 140 are, for example, preloaded into the electronic device 101 at the time of manufacture, or an external electronic device (eg, the electronic device 102 or 104 ), or a server (eg, the electronic device 102 or 104 ) when used by a user ( 108)) or may be updated.

The operating system 142 may control management (eg, allocation or retrieval) of one or more system resources (eg, a process, memory, or power) of the electronic device 101 . The operating system 142 may additionally or alternatively include other hardware devices of the electronic device 101 , for example, the input device 150 , the sound output device 155 , the display device 160 , and the audio module 170 . , sensor module 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or It may include one or more driver programs for driving the antenna module 197 .

The middleware 144 may provide various functions to the application 146 so that functions or information provided from one or more resources of the electronic device 101 may be used by the application 146 . The middleware 144 includes, for example, an application manager 201 , a window manager 203 , a multimedia manager 205 , a resource manager 207 , a power manager 209 , a database manager 211 , and a package manager 213 . ), a connectivity manager 215 , a notification manager 217 , a location manager 219 , a graphics manager 221 , a security manager 223 , a call manager 225 , or a voice recognition manager 227 . can

The application manager 201 may manage the life cycle of the application 146 , for example. The window manager 203 may manage one or more GUI resources used in the screen, for example. The multimedia manager 205, for example, identifies one or more formats required for playback of media files, and encodes or decodes a corresponding media file among the media files using a codec suitable for the selected format. can be done The resource manager 207 may manage the space of the source code of the application 146 or the memory of the memory 130 , for example. The power manager 209 may, for example, manage the capacity, temperature, or power of the battery 189 , and determine or provide related information necessary for the operation of the electronic device 101 by using the corresponding information. . According to an embodiment, the power manager 209 may interwork with a basic input/output system (BIOS) (not shown) of the electronic device 101 .

The database manager 211 may create, retrieve, or change a database to be used by the application 146 , for example. The package manager 213 may manage installation or update of an application distributed in the form of a package file, for example. The connectivity manager 215 may manage, for example, a wireless connection or a direct connection between the electronic device 101 and an external electronic device. The notification manager 217 may provide, for example, a function for notifying the user of the occurrence of a specified event (eg, an incoming call, a message, or an alarm). The location manager 219 may manage location information of the electronic device 101 , for example. The graphic manager 221 may manage, for example, one or more graphic effects to be provided to a user or a user interface related thereto.

Security manager 223 may provide, for example, system security or user authentication. The telephony manager 225 may manage, for example, a voice call function or a video call function provided by the electronic device 101 . The voice recognition manager 227, for example, transmits the user's voice data to the server 108, based at least in part on the voice data, a command corresponding to a function to be performed in the electronic device 101; Alternatively, the converted text data may be received from the server 108 based at least in part on the voice data. According to an embodiment, the middleware 244 may dynamically delete some existing components or add new components. According to an embodiment, at least a portion of the middleware 144 may be included as a part of the operating system 142 or implemented as software separate from the operating system 142 .

Application 146 includes, for example, home 251 , dialer 253 , SMS/MMS 255 , instant message (IM) 257 , browser 259 , camera 261 , alarm 263 . , contacts 265, voice recognition 267, email 269, calendar 271, media player 273, album 275, watch 277, health 279 (such as exercise or blood sugar) measuring biometric information), or environmental information 281 (eg, measuring atmospheric pressure, humidity, or temperature information). According to an embodiment, the application 146 may further include an information exchange application (not shown) capable of supporting information exchange between the electronic device 101 and an external electronic device. The information exchange application may include, for example, a notification relay application configured to transmit specified information (eg, call, message, or alarm) to an external electronic device, or a device management application configured to manage the external electronic device. there is. The notification relay application, for example, transmits notification information corresponding to a specified event (eg, mail reception) generated in another application (eg, the email application 269 ) of the electronic device 101 to the external electronic device. can Additionally or alternatively, the notification relay application may receive notification information from the external electronic device and provide it to the user of the electronic device 101 .

The device management application is, for example, a power source (eg, turn-on or turn-on) of an external electronic device that communicates with the electronic device 101 or some components thereof (eg, the display device 160 or the camera module 180 ). -off) or a function (eg, brightness, resolution, or focus of the display device 160 or the camera module 180 ) may be controlled. The device management application may additionally or alternatively support installation, deletion, or update of an application operating in an external electronic device.

3 illustrates an electronic device 301 and an input device 302 according to various embodiments of the present disclosure.

The configurations of the electronic device 301 and the input device 302 shown in FIG. 3 are exemplary and embodiments of the present document are not limited thereto. For example, the electronic device 301 and the input device 302 may further include or include components not shown in FIG. 3 (eg, a microphone, a speaker, a touch pad, a camera module, and/or a sensor module). At least some of them may not be included.

According to various embodiments, the electronic device 301 (eg, the electronic device 101 of FIG. 1 ) may include a side member 310 , a display 360 (eg, the display module 160 of FIG. 1 ), and/or It may include a connection terminal 378 (eg, the connection terminal 178 of FIG. 1 ). The connection terminal 378 may be formed in at least one region of the side member 310 .

According to an embodiment, the side member 310 may be referred to as at least a portion of the housing surrounding the space between the first surface (or front surface) and the second surface (or rear surface). The side member 310 may include a connection terminal 378 in at least one region.

According to an embodiment, the display 360 may display various information related to an operation performed by the electronic device 301 . For example, the display 360 may display a user interface including information related to connection states of the electronic device 301 , the input device 302 , and the external electronic device. The user interface is a graphical user interface (GUI) corresponding to at least one of a function of determining whether to connect the electronic device with at least one external electronic device, searching for an external electronic device to be additionally connected, and displaying a connection state with at least one external electronic device. ) may be included. The user interface displayed on the display 360 may be referred to in more detail in the description of FIGS. 6 and 7 to be described later.

According to an embodiment, the connection terminal 378 may be formed in one area of the side member 310 . For example, the connection terminal 378 may be formed in one region of the central portion of the long axis of the side member 310 . The connection terminal 378 may include at least one pogo pin. The pogo pin may include, for example, a pogo pin member and a recessed member. The pogo pin member may be included in the recessed member. The depression member may have a shape such that at least a portion of the pogo pin member (eg, a plunger) is exposed to the outside. The electronic device 301 may be physically and electrically connected to the input device 302 through at least one pogo pin included in the connection terminal 378 . For example, a pogo pin member included in the at least one pogo pin may be coupled with a socket member included in the coupling structure 380 of the input device 302 so that the electronic device 301 and the input device 302 are physically and electrically connected to each other. can be connected to For example, at least a portion of the pogo pin member of the electronic device 301 may be inserted into the socket member of the input device 302 .

Although one connection terminal 378 is illustrated in FIG. 3 , the present invention is not limited thereto. For example, a connection terminal (not shown) may be additionally or alternatively formed in a region other than the illustrated region (eg, one region of the central portion of the short axis of the side member 310 ).

According to various embodiments, the input device 302 may include a coupling structure 380 , a keyboard 382 , and/or a mouse pad 384 . In FIG. 3, the mouse pad 384 is illustrated as being disposed under the keyboard 382, but this is not limited thereto, and is included in the upper portion of the keyboard 382 or at least a portion of the keyboard 382 area. can be placed.

According to an embodiment, the coupling structure 380 may include various coupling structures. For example, the coupling structure 380 may include at least one POGO structure, at least one magnetic, and/or at least one electrical connection member. For example, the electrical connection member may include an electrical connector that electrically connects the electronic device 301 and the input device 302 . The electrical connector may include at least one movable conductive pin. For example, coupling structure 380 may include a recess, a moving member, and/or a retainer system. In the recess, for example, at least a portion of the side member 310 of the electronic device 301 may be seated. The movable member, for example, may provide mobility to enable pivotal movement in a state in which the electronic device 301 is coupled to the input device 302 . The retainer system, for example, may fix the structure so that the at least one or more POGO structures are not lifted.

According to an embodiment, the keyboard 382 may include a plurality of keys. The input device 302 may transmit data input through the keyboard 382 to the outside (eg, the electronic device 301 ). For example, when the electronic device 301 and the input device 302 are physically and electrically connected through the coupling structure 380 , the input device 302 transmits data input through the keyboard 382 to the electronic device. It can be transmitted to (301).

According to one embodiment, the mouse track pad 384 may be formed on at least one area of the input device 302 . The input device 302 may transmit data input through the mouse track pad 384 to the outside (eg, the electronic device 301 ). The content of transmitting the input data to the outside may be referred to as the above-described content on the keyboard 382 .

Hereinafter, the method of processing input data of the electronic device 301 , the input device 302 , and the external electronic device 303 will be described below. Meanwhile, in various embodiments disclosed in this document, a component defined as the input device 302 may be defined as an external input device.

4 is a block diagram illustrating an electronic device 401 , an input device 402 , and an external electronic device 403 according to various embodiments of the present disclosure.

According to various embodiments of the present disclosure, the external electronic device 403 (eg, the electronic device 102 of FIG. 1 ) may be substantially the same as the electronic device 401 . All or part of the operations performed by the electronic device 401 may be executed by the external electronic device 403 . For example, the electronic device 401 may perform at least one of an operation related to the specified function (eg, an operation of displaying data received from the input device 402 on a display) instead of or additionally executing the specified function by itself. A portion may be requested from the external electronic device 403 .

According to an embodiment, the electronic device 401 and the external electronic device 403 include the processors 420 and 422 (eg, the processor 120 of FIG. 1 ) and the memories 430 and 432 (eg, the memory of FIG. 1 ). 130 ), display modules 460 , 462 (eg, display module 160 of FIG. 1 ), and/or communication modules 490 , 492 (eg, communication module 190 of FIG. 1 ). can The electronic device 401 may further include a connection terminal 478 (eg, the connection terminal 178 of FIG. 1 ). The components of the electronic device 401 and the external electronic device 403 illustrated in FIG. 4 are exemplary, and may further include components not shown, and may not include at least some of the illustrated components. there is. For example, the electronic device 401 and the input device 402 may further include a micro controller unit (MCU). The MCU may include an input/output interface and/or memory used when a plurality of electronic devices transmit and/or receive data.

According to an embodiment, the electronic device 401 and the external electronic device 403 may store commands or data in the memories 430 and 432 . For example, the memories 430 and 432 may store data (eg, pairing information) related to a communication function between electronic devices. The electronic device 401 may communicate with the external electronic device 403 using at least some of the data. As another example, the memories 430 and 432 may store information corresponding to data (eg, coordinate data) received from the input device 402 . The electronic device 401 may analyze input data received from the input device 402 using the information, and may generate new input data based on the analysis result. The memories 430 and 432 may include volatile memory or non-volatile memory. For example, the electronic device 401 and the external electronic device 403 store at least a portion of commands or data transmitted or received from the communication modules 490 and 492 in a volatile memory, and process the commands or data stored in the memory. and the result data may be stored in a non-volatile memory. As another example, the electronic device 401 may store at least a portion of commands or data transmitted/received to and from the input device 402 in a memory included in the MCU. The MCU included in the electronic device 401 may be connected to the MCU included in the input device 402 . For example, the MCU included in the electronic device 401 and the MCU included in the input device 402 may be connected using 1-Wire communication. The electronic device 401 may receive input data transmitted from the input device 402 through 1-Wire communication, process the input data using an MCU, and transmit it to the processor 420 . For example, the electronic device may transmit data processed using the MCU to the processor 420 using I2C (Inter-Integrated Circuit) communication.

According to an embodiment, the electronic device 460 and the external electronic device 403 may display user interfaces related to various functions using the display modules 460 and 462 . For example, the electronic device 460 may display a user interface including a connection state with the external electronic device 403 using the display module 460 . For example, when it is determined that the external electronic device 403 is in a sleep state, the electronic device 401 displays a user interface including the state of the external electronic device 403 on the display module 460, When it is determined that the external electronic device 403 continues to be in the sleep state after a specified time elapses, the connection with the external electronic device 403 is released and the connection state with the external electronic device 403 is displayed on the display module 460 . You can display a user interface that includes For example, the sleep state may be referred to as a state in which the external electronic device 403 does not operate for a predetermined time and waits (eg, an idle state). As another example, the sleep state may be referred to as a state in which the external electronic device 403 operates using power less than or equal to a specified value (eg, a low power mode). The user interface determines whether to connect to at least one external electronic device (eg, the external electronic device 403 ), searches for an additional external electronic device to be connected to the electronic device 401 , or the electronic device 401 and the at least one It may include a graphical user interface (GUI) corresponding to at least one of functions for displaying a connection state with an external electronic device. When an input (eg, a touch input) is detected in at least one area of the display module 460 , the processor 420 may control to execute a function corresponding to the GUI area in which the input is sensed among the plurality of functions. .

According to an embodiment, the electronic device 401 may communicate with the external electronic device 403 using the communication modules 490 and 492 . The communication modules 490 and 492 may support establishment of a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 401 and the external electronic device 403 and performing communication through the established communication channel. For example, the communication modules 490 and 492 may include a Bluetooth communication module. The electronic device 401 and the external electronic device 403 may perform Bluetooth communication using the communication modules 490 and 492 . For example, the electronic device 401 may be connected to an external electronic device based on a Human Interface Device (HID) profile.

According to an embodiment, the electronic device 401 may be connected to an external device (eg, the input device 302 of FIG. 3 ) through the connection terminal 478 (eg, the connection terminal 378 of FIG. 3 ). . The connection terminal 478 may include various connection structures. For example, the connection terminal 478 may include at least one pogo pin. The pogo pin may include, for example, a pogo pin member and a recessed member. The pogo pin member may be included in the recessed member. The depression member may have a shape such that at least a portion of the pogo pin member (eg, a plunger) is exposed to the outside. The electronic device 401 may be physically and electrically connected to the input device 402 through at least one pogo pin included in the connection terminal 478 . For example, the pogo pin member included in the at least one pogo pin is coupled to the socket member included in the coupling structure of the input device 402 (eg, the coupling structure 380 of FIG. 3 ) to form the electronic device 401 and The input device 402 may be physically and electrically connected. For example, at least a portion of the pogo pin member of the electronic device 401 may be inserted into the socket member of the input device 402 .

According to an embodiment, the electronic device 401 may perform various functions using components based on the control of the processor 420 . For example, the processor 420 may receive a first selection signal from an input device physically and electrically connected through the connection terminal 478 . The first selection signal may include, for example, a selection signal for determining an external electronic device (eg, the external electronic device 403 ) to perform wireless communication with the electronic device 401 . The processor 420 may perform a Bluetooth connection operation with the external electronic device 403 determined based on the first selection signal using the communication module 490 . For example, the electronic device 401 transmits a connection request signal to the external electronic device 403 , receives a response signal to the connection request signal from the external electronic device 403 , and when the response signal is received, the A pairing operation may be performed with the external electronic device 403 and wirelessly connected to the external electronic device 403 using the communication module 490 . For example, the connection request signal may include account information of the electronic device 401 . After the electronic device 401 performs a specified processing operation (eg, an encryption processing operation using a hash function) on the account information of the electronic device 401 in the connection request signal, and includes the data on which the processing operation is performed The connection request signal may be transmitted (eg, broadcast). The electronic device 401 receives a response signal from the external electronic device 403 including the same account information as the account information included in the connection request signal, and in response to the reception of the response signal, the external electronic device 403 It may perform a pairing operation with and wirelessly connect to the external electronic device 403 using the communication module. For example, when a response signal is received from the external electronic device 403 , the electronic device 401 may determine whether the external electronic device 403 includes the same account information as the electronic device 401 . After performing the reconfirmation operation, the electronic device 401 performs a wireless connection operation with the external electronic device 403 when it is determined that the external electronic device 403 includes the same account information as the electronic device 401 . can do. When connected to the external electronic device 403 , the processor 420 displays a user interface including a connection state with the external electronic device 403 using the display module 460 , and after connecting to the external electronic device 403 , At least a portion of the first input data received from the input device 402 may be controlled to be transmitted to the external electronic device 403 . The first input data may include, for example, coordinate data. The coordinate data may be referred to as data including a coordinate value corresponding to a region to which a touch input is applied among keyboard regions included in the input device 402 . The processor 420 may analyze the coordinate data included in the first input data, generate second input data based on the analysis result, and transmit the generated second input data to the external electronic device 403 . When the first selection signal is received from the input device 402 after the electronic device 401 and the external electronic device 403 are first connected, the processor 420 uses pairing information stored in the memory 430 to A Bluetooth connection operation may be performed with the electronic device 403 . For example, the pairing information may include data related to a Bluetooth connection between the electronic device 401 and the external electronic device 403 (eg, BD_ADDR information, type, name, and/or MAC Address of the external electronic device). there is. According to an embodiment, the processor 420 may perform a connection with other external electronic devices in addition to the external electronic device 403 based on a selection signal received from the input device 402 . For example, when the electronic device 401 receives the second selection signal from the input device 402 , the processor 420 releases the connection with the external electronic device 403 using the communication module 490 and An external electronic device (not shown) and the electronic device 401 may be connected via Bluetooth. After connection with the second external electronic device, the processor 420 may transmit at least a portion of the third input data received from the input device 402 to the second external electronic device. The processor 420 may analyze the coordinate data included in the third input data, generate fourth input data based on the analysis result, and transmit it to the second external electronic device.

According to an embodiment, the external electronic device 403 may receive a connection request signal from the electronic device 401 and identify various pieces of information included in the connection request signal. For example, the external electronic device 403 may identify account information included in the connection request signal and determine whether the account information is the same as the account information of the external electronic device 403 . When it is determined that the account information is the same as the account information of the external electronic device 403 , the external electronic device 403 determines whether to connect to the electronic device 401 using the display module 462 , the first user interface can be displayed. For example, when an input (eg, a touch input by a user) is sensed in at least a portion of the first user interface for determining whether to connect the external electronic device 403 with the electronic device 401 , the connection request signal A response signal corresponding to may be generated and transmitted to the electronic device 401 . The response signal may include account information of the external electronic device 403 .

According to an embodiment, after being wirelessly connected to the electronic device 401 , the external electronic device 403 displays a user interface including information on whether to connect to the electronic device 401 using the display module 462 . can do. For example, the external electronic device 403 may be wirelessly connected to the electronic device 401 (eg, a tablet electronic device) based on a Human Interface Device (HID) profile. The external electronic device 403 recognizes the electronic device 401 as an input device (eg, a key input device and/or a pad input device) while wirelessly connected to the electronic device 401 , and connects to the electronic device 401 . A screen generated by recognizing the electronic device 401 as an input device may be displayed through a user interface including information on whether or not the electronic device is present.

According to an embodiment, the electronic device 401 and the external electronic device 403 may use various data and/or user interfaces in the process of performing a wireless connection operation for the first time. Methods of using the various data and/or user interfaces may be sequentially described in the following paragraphs.

According to an embodiment, the electronic device 401 may first perform a connection operation with the external electronic device 403 based on a specified key input detected by the input device 402 . For example, the electronic device 401 may receive data generated based on a specified key input from the input device 402 . The specified key input may be a key button combination set by a user. The electronic device 401 may receive the data from the input device 402 and may transition to a state capable of performing a connection operation with at least some of the external electronic devices. For example, the electronic device 401 may receive the data from the input device 402 and activate a connection mode (eg, a Bluetooth connection mode). For example, the electronic device 401 may selectively display a user interface related to connection mode activation. The electronic device 401 may activate the connection mode in response to an input (eg, a touch input by a user) sensed in the user interface related to the activation of the connection mode.

According to an embodiment, after activation of the connection mode, the electronic device 401 may transmit (eg, broadcast) a connection request signal. For example, the electronic device 401 receives data generated based on a specified key input from the input device 402 , performs a connection mode activation operation in response to the reception of the data, and performs Bluetooth Low Energy (BLE) A connection request signal may be transmitted to the outside using communication. For example, the connection request signal may include information related to the HID profile and/or account information of the electronic device 401 . After the electronic device 401 performs a specified processing operation (eg, an encryption processing operation using a hash function) on the account information of the electronic device 401 in the connection request signal, and includes the data on which the processing operation is performed The connection request signal may be transmitted.

According to an embodiment, the external electronic device 403 may receive the connection request signal transmitted from the electronic device 401 and generate and transmit a response signal to the connection request signal. For example, the external electronic device 403 detects a connection request signal using a framework (eg, Multi Connectivity Framework (MCF)), and account information of the electronic device 401 included in the connection request signal. It may be determined whether is the same as the account information of the external electronic device 403 . For example, when it is determined that the account information included in the connection request signal is the same as the account information of the external electronic device 403 , the external electronic device 403 connects to the electronic device 401 using the display module 462 . A first user interface for determining whether or not to do so may be displayed. As another example, when it is determined that the account information included in the connection request signal is not the same as the account information of the external electronic device 403 , the first user interface may not be displayed. Alternatively, the external electronic device 403 may provide a function for manually performing a connection with the electronic device 401 using a user interface designated by the user (eg, a user interface related to Bluetooth manual setting).

5 is a block diagram 500 illustrating a software structure in the electronic device 501 according to various embodiments of the present disclosure.

According to an embodiment, the electronic device 501 may have a software structure including a plurality of layers. The electronic device 501 may perform various functions through a software structure. For example, the electronic device 501 may process a signal and/or data received from the outside (eg, the input device 502 ) through all or part of a software structure.

According to an embodiment, the plurality of layers included in the electronic device 501 include the input sensing unit 510 , the input processing unit 520 , the operating system 530 (eg, the operating system 142 of FIG. 2 ), and a middle layer. It may include a wear 540 (eg, the middleware 144 of FIG. 2 ), and/or a communication unit 550 .

According to an embodiment, the input sensing unit 510 may detect data transmitted from the outside. For example, the input sensing unit 510 may include a key input sensing unit and/or a pad input sensing unit. For example, the key input detection unit may detect input data (eg, key input data) generated by a user using a keyboard included in the input device. As another example, the pad input sensing unit may detect input data (eg, pad input data) generated by a user using a touch pad included in the input device. For example, the input sensor 510 may detect data transmitted from the input device 502 physically and/or electrically connected to the electronic device 501 . Data transmitted from input device 502 may include selection signals and/or input data. As an example, the selection signal may include a control signal (eg, the first selection signal or the second selection signal of FIG. 4 ) for determining at least one of a plurality of external electronic devices for wireless communication with the electronic device 501 . there is. The input data (eg, the first input data or the third input data of FIG. 4 ) may include coordinate data including coordinate values corresponding to at least one region of the input device 502 .

According to an embodiment, the input processing unit 520 may process data sensed by the input sensing unit 510 . For example, the input processing unit 520 may process a selection signal and/or input data sensed by the input detection unit 510 and transmit it to the operating system 530 . The input processing unit 520 may analyze coordinate data included in the input data and perform a processing operation of generating input data (eg, the second input data or the fourth input data of FIG. 4 ) using the analysis result. . For example, the input processing unit 520 may include a key input processing unit and/or a pad input processing unit. For example, the key input processing unit may perform a processing operation on key input data detected by the key input detection unit included in the input detection unit 510 . As another example, the pad input processing unit may perform a processing operation on pad input data sensed by the pad input sensing unit included in the input sensing unit 510 .

According to an embodiment, the operating system 530 (eg, the operating system 142 of FIG. 2 ) manages at least one system resource (eg, a process, memory, and/or power) of the electronic device 501 . (e.g. allocation or recall) can be controlled. The operating system 530 may include at least one driver program for driving a hardware device (eg, the input device 502 ) connected to the electronic device 501 . According to an embodiment, the middleware 540 may provide various functions to an application so that a function or information provided from at least one resource of the electronic device 501 may be used by the application. The electronic device 501 may process data transmitted from the input device 502 using the operating system 530 and the middleware 540 . For example, the operating system 530 detects the input data transmitted from the input processing unit 520 as an event, and the middleware 540 transmits at least a portion of the input data to the external ( For example, it can be processed so that it can be transmitted to the external electronic device 503). For example, the operating system 530 may include an OS input sensing unit and/or an OS input processing unit. For example, the OS input detection unit may detect input data (eg, key input data and/or pad input data) processed by the input processing unit 520 as an event for the operating system 530 . As another example, the OS input processing unit may perform a processing operation on input data detected as an event.

According to an embodiment, the communication unit 550 may perform a function of allowing the electronic device 501 to communicate with the outside. For example, the communication unit 550 may transmit at least a portion of input data processed by the electronic device 501 to the external electronic device 503 . In order to allow the electronic device 501 to communicate with the outside, the communication unit 550 may use a Bluetooth module and/or an HID profile. For example, the communication unit 550 may include a Bluetooth preprocessor and/or a Bluetooth connection module. For example, the Bluetooth preprocessor may perform a preprocessing operation on input data transmitted from the OS input processor included in the operating system 530 . As another example, the Bluetooth connection module may transmit input data transmitted after being preprocessed by the Bluetooth preprocessor to the external electronic device.

6 illustrates user interfaces 601 and 602 displayed on a display of an electronic device, according to various embodiments of the present disclosure.

Referring to reference numeral 601 , according to an embodiment, an electronic device (eg, the electronic device 101 of FIG. 1 ) includes a connection state with an external electronic device (eg, the external electronic device 403 of FIG. 4 ). A user interface can be displayed. For example, the electronic device may include a setting list 620 for controlling connection with a plurality of external electronic devices in a setting screen 610 including information related to the input device and display it on the display. The setting list 620 for controlling connection with a plurality of external electronic devices may include a setting screen 622 corresponding to the first external electronic device and a setting screen 624 for additionally connecting an external electronic device. . For example, when an input (eg, a user's touch input) is detected on the setting screen 622 corresponding to the first external electronic device, the electronic device may be connected to the first external electronic device via Bluetooth. For example, the electronic device may be Bluetooth-connected to the first external electronic device based on the HID profile.

Referring to reference numeral 602 , according to an embodiment, when an input 630 is detected on a setting screen 624 for additionally connecting an external electronic device, the electronic device is displayed in the setting list 620 to the second external electronic device. A corresponding setting screen 640 may display an added user interface. When an input is detected on the setting screen 640 corresponding to the second external electronic device, the electronic device causes the user to delete the setting screen 640 corresponding to the second external electronic device in one area of the setting screen 640 . The interface 642 and the user interface 644 for changing and displaying the interface 642 and another external electronic device may be displayed.

7 illustrates a user interface 700 displayed on a display of an electronic device according to various embodiments of the present disclosure.

According to an embodiment, the electronic device (eg, the electronic device 101 of FIG. 1 ) displays a user interface including a connection state with an external electronic device on a display (eg, the display module 160 of FIG. 1 ) can do.

With reference to reference number 710, according to an embodiment, the electronic device includes icons 710a, 710b, 710c, 710d, 710e, and 710f) can be displayed. For example, when the electronic device is Bluetooth-connected to the second external electronic device, a color change (eg, a color change from a gray icon to a blue icon) of the icon 710b corresponding to the connection state with the second external electronic device is detected. can be used to display the connection status.

Referring to reference number 720, according to an embodiment, the electronic device may display a user interface including information of an external electronic device to communicate on the display. For example, when the electronic device is Bluetooth-connected to the first external electronic device (eg, the external electronic device 403 in FIG. 4 ), the electronic device displays a text including a connection state with the first external electronic device on the display; A user interface including a name and/or a type of the first external electronic device may be displayed.

8 is a flowchart illustrating an operation of processing input data of an electronic device 800 according to various embodiments of the present disclosure.

According to an embodiment, in operation 805 , the electronic device (eg, the electronic device 101 of FIG. 1 ) may receive a first selection signal from an input device (eg, the input device 302 of FIG. 3 ). The electronic device may be physically and electrically connected to the input device through a connection terminal (eg, the connection terminal 478 of FIG. 4 ). For example, the first selection signal may include a control signal for selecting the first external electronic device.

According to an embodiment, in operation 810, the electronic device may determine an external electronic device to communicate with based on the received first selection signal. For example, the electronic device may determine the external electronic device to communicate with as the first external electronic device based on the first selection signal.

According to an embodiment, in operation 815, the electronic device may be connected to the determined first external electronic device via Bluetooth. For example, the electronic device may connect the electronic device to the first external electronic device via Bluetooth using a wireless communication circuit.

According to an embodiment, in operation 820 , the electronic device may display a user interface including a connection state with external electronic devices on a display (eg, the display module 160 of FIG. 1 ). For example, a user interface including a connection state with external electronic devices may be referred to with reference to the drawings shown in FIGS. 6 and 7 .

According to an embodiment, in operation 825, the electronic device may transmit data related to the first input data to the first external electronic device. The first input data may be referred to as input data received from the input device after the electronic device is Bluetooth-connected to the first external electronic device. For example, the first input data may include coordinate data. The electronic device may generate second input data based on the first input data and transmit it to the first external electronic device. The processing of the first input data may be described in more detail with reference to FIG. 9 to be described later.

9 is a flowchart illustrating an operation of processing input data of an electronic device 900 according to various embodiments of the present disclosure.

According to an embodiment, in operation 905 , the electronic device (eg, the electronic device 101 of FIG. 1 ) may receive first input data from an input device (eg, the input device 402 of FIG. 4 ). For example, the first input data may include coordinate data. The coordinate data may be referred to as data including a coordinate value corresponding to a region to which a touch input is applied among keyboard regions included in the input device.

According to an embodiment, in operation 910, the electronic device may analyze coordinate data included in the first input data. For example, the electronic device may store the coordinate data corresponding to the coordinate data in a memory (eg, the memory 430 of FIG. 4 ) and analyze the received coordinate data using the stored information.

According to an embodiment, in operation 915 , the electronic device may generate second input data based on the analysis result of the coordinate data. For example, the second input data may include data (eg, text data) to be transmitted to the external electronic device.

According to an embodiment, in operation 920, the electronic device may transmit the generated second input data to the first external electronic device. For example, the electronic device is Bluetooth-connected to the first external electronic device based on a Human Interface Device (HID) profile, and in the Bluetooth-connected state, transmits second input data to the first external electronic device through Bluetooth communication. can be transmitted

10 is a flowchart illustrating an operation of processing input data of an electronic device 1000 according to various embodiments of the present disclosure.

According to an embodiment, in operation 1005 , the electronic device (eg, the electronic device 101 of FIG. 1 ) may be connected to a first external electronic device (eg, the external electronic device 403 of FIG. 4 ). For example, the electronic device may be connected to the first external electronic device via Bluetooth based on a Human Interface Device (HID) profile.

In operation 1010 , when it is determined that the second selection signal has been received from the input device (eg, the input device 402 of FIG. 4 ) (eg, operation 1010 - Yes), the electronic device may perform operation 1015 .

In operation 1010 , when it is determined that the second selection signal has not been received from the input device (eg, operation 1010 -No), the electronic device may continue to perform operation 1005 .

According to an embodiment, in operation 1015 , the electronic device may disconnect the first external electronic device and perform a Bluetooth connection with the second external electronic device. For example, the electronic device may be connected to the second external electronic device via Bluetooth based on a Human Interface Device (HID) profile.

According to an embodiment, in operation 1020, the electronic device may transmit data associated with the third input data to the second external electronic device. The third input data may be referred to as input data received from the input device after the electronic device is connected to the second external electronic device, for example. The electronic device may analyze the coordinate data included in the third input data, generate fourth input data based on the analysis result, and transmit the fourth input data to the second external electronic device.

11 is a flowchart illustrating an operation of processing input data of an external electronic device (eg, the external electronic device 403 of FIG. 4 ) according to various embodiments of the present disclosure.

Hereinafter, an operation performed by an external electronic device (eg, the external electronic device 403 of FIG. 4 ) based on a specified signal transmitted from the electronic device (eg, the electronic device 401 of FIG. 4 ) may be described. .

According to an embodiment, in operation 1105, the external electronic device may receive a connection request signal transmitted from the electronic device. For example, the external electronic device may detect a connection request signal using a framework (eg, Multi Connectivity Framework (MCF)). For example, the connection request signal may include account information of the electronic device. The electronic device performs a specified processing operation (eg, an encryption processing operation using a hash function) on the account information of the electronic device in the connection request signal, includes the data on which the processing operation is performed, and then transmits the connection request signal (eg broadcast).

According to an embodiment, in operation 1110, the external electronic device may identify account information included in the connection request signal. For example, the external electronic device may determine whether account information (eg, account information of the electronic device) included in the connection request signal is the same as account information of the external electronic device.

In operation 1115 , when it is determined that the account information of the external electronic device is the same as the account information of the electronic device (eg, operation 1115 - Yes), the external electronic device may perform operation 1120 .

If it is determined in operation 1115 that the account information of the external electronic device is not the same as the account information of the electronic device (eg, operation 1115 - No), the external electronic device may perform operation 1125 .

According to an embodiment, in operation 1120, the external electronic device may transmit an external response signal to the electronic device. For example, when the external electronic device determines that the account information included in the connection request signal is the same as the account information with the external electronic device, the external electronic device may automatically generate a response signal and transmit it to the electronic device. For another example, when the external electronic device determines that the account information included in the connection request signal is the same as the account information with the external electronic device, the external electronic device uses a display module (eg, the display module 462 of FIG. 4 ) to the electronic device A first user interface for determining whether to connect to the user interface may be displayed. The external electronic device generates a response signal corresponding to the connection request signal when an input (eg, a touch input by a user) is sensed in at least a part of the first user interface for determining whether to connect to the electronic device and generates an electronic device. can be sent to the device. The response signal may include account information of the external electronic device. According to an embodiment, after being wirelessly connected to the electronic device in response to the response signal, the external electronic device may display a user interface including information on whether to connect to the electronic device using a display module. For example, an external electronic device may be wirelessly connected to an electronic device (eg, a tablet electronic device) based on a Human Interface Device (HID) profile. The external electronic device recognizes the electronic device as an input device (eg, a key input device and/or a pad input device) while wirelessly connected to the electronic device, and a user interface including information on whether to connect to the electronic device Through , a screen generated by recognizing the electronic device as an input device may be displayed.

According to an embodiment, in operation 1125 , the external electronic device may transmit a response signal to the electronic device based on a specified input. For example, when it is determined that the account information included in the connection request signal is not the same as the account information of the external electronic device 403 , the external electronic device may not display the first user interface. Alternatively, the external electronic device may transmit a response signal generated based on a specified input (eg, a touch input by a user) to the electronic device. For example, the external electronic device may generate a response signal based on an input to the second user interface (eg, a user interface related to Bluetooth manual setting). That is, the external electronic device may provide a function of manually connecting to the electronic device based on an input to the second user interface.

12 illustrates various user interfaces 1201 and 1202 provided by an external electronic device (eg, the external electronic device 403 of FIG. 4 ) according to various embodiments of the present disclosure.

According to an embodiment, the external electronic device (eg, the external electronic device 403 of FIG. 4 ) may use various user interfaces 1201 and 1202 through the display module 1260 (eg, the display module 462 of FIG. 4 ). ) can be displayed. For example, in the process of performing a wireless connection operation with the electronic device (eg, the electronic device 401 of FIG. 4 ), the external electronic device performs user interfaces ( 1201 and 1202) can be displayed.

Referring to reference numeral 1201 , according to an embodiment, when it is determined that account information included in a connection request signal transmitted from the electronic device is the same as the account information of the external electronic device, the external electronic device displays the display module ( The first user interface 1210 may be displayed through 1260 . The first user interface 1210 may include a plurality of buttons (a first button 1213 and a second button 1215 ) for determining whether to wirelessly connect an external electronic device and the electronic device. The first user interface 1210 may include a graphic user interface (GUI) corresponding to an input device (eg, the input device 402 of FIG. 4 ) connected to the electronic device. For example, when an input (eg, a touch input by a user) is detected on the first button 1213 of the first user interface 1210 , the external electronic device may not perform a wireless connection operation with the electronic device. there is. As another example, when an input is sensed on the second button 1215 of the first user interface 1210 , the external electronic device generates a response signal corresponding to the connection request signal transmitted from the electronic device and transmits the generated response signal to the electronic device. can At reference numeral 1201 , when it is determined that the account information included in the connection request signal transmitted from the electronic device is the same as the account information of the external electronic device, the external electronic device displays the first user interface 1210 on the display module 1260 . Although it is described as being displayed, this is exemplary and various embodiments of the present document are not limited thereto. For example, when it is determined that the account information included in the connection request signal transmitted from the electronic device is the same as the account information of the external electronic device, the external electronic device automatically responds without displaying the first user interface 1210 . may be generated and transmitted to the electronic device.

Referring to reference numeral 1202 , according to an embodiment, when it is determined that account information included in a connection request signal transmitted from the electronic device is not the same as the account information of the external electronic device, the external electronic device displays A second user interface 1230 (eg, a user interface related to Bluetooth manual setting) may be displayed on the module 1260 . The second user interface 1230 may include a GUI (eg, a third button 1231 ) corresponding to a plurality of external electronic devices to perform a wireless connection operation with the external electronic device. For example, when it is determined that the account information included in the connection request signal transmitted from the electronic device is not the same as the account information of the external electronic device, the external electronic device may not display the first user interface. Alternatively, the external electronic device may display the second user interface 1230 based on an input to the manual connection button 1220 (eg, a touch input by a user). For example, the external electronic device may generate a response signal based on an input to at least one area (eg, the third button 1231 ) of the second user interface 1230 . That is, the external electronic device may provide a function of transmitting a response signal for wirelessly connecting to the electronic device corresponding to the third button 1231 manually based on an input to at least one region of the second user interface 1230 . can

According to various embodiments of the present disclosure, the electronic device (eg, the electronic device 101 of FIG. 1 ) includes a touch screen display, a wireless communication circuit, and an external input device (eg, the electronic device 101 of FIG. 3 ) including at least one coupling structure. For a physical and electrical connection between the input device 302) and the electronic device, a connection terminal formed on one side of the electronic device, a processor, and a memory operatively connected to the processor may be included.

According to an embodiment, when the memory is executed, the processor receives a first selection signal from the external input device through the connection terminal, and performs wireless communication with the electronic device using the wireless communication circuit determining a first external electronic device to be selected based on the first selection signal, transmitting a connection request signal to the first external electronic device, and receiving a response signal to the connection request signal from the first external electronic device; , when the response signal is received, performing a pairing operation with the first external electronic device, wirelessly connecting the electronic device and the first external electronic device using the wireless communication circuit, and the first external electronic device Upon connection with the electronic device, a user interface including a connection state with the first external electronic device is displayed on the touch screen display, and after connection with the first external electronic device, the external input One or more instructions for controlling to transmit data related to the first input data received from the device to the first external electronic device through the wireless communication circuit may be stored.

According to an embodiment, the first input data includes coordinate data, and when the one or more instructions are executed, the processor analyzes the coordinate data included in the first input data, and the It may be configured to generate second input data based on the analysis result and transmit the generated second input data to the first external electronic device.

According to an embodiment, when the one or more instructions are executed, the processor may be configured to connect the electronic device and the first external electronic device based on a Human Interface Device (HID) profile. can

According to an embodiment, the connection terminal includes at least one pogo pin, and the pogo pin member included in the at least one pogo pin is coupled with the socket member included in the at least one coupling structure. It may be physically and electrically connected to the external input device.

According to an embodiment, the memory further stores pairing information with the first external electronic device, and when the one or more instructions are executed, the processor causes the processor to send the first information from the external input device. When the first selection signal is received, it may be set to connect to the first external electronic device via Bluetooth using the pairing information stored in the memory.

According to an embodiment, the external input device may include at least one of a keyboard and a mouse track pad.

According to an embodiment, the memory further stores pairing information with a second external electronic device, and when the one or more instructions are executed, the processor sends the second information from the external input device. Upon receiving a second selection signal including a selection signal for determining an external electronic device, the connection with the first external electronic device is released using the wireless communication circuit and a Bluetooth connection with the second external electronic device is received, After connection with the second external electronic device, data related to the third input data received from the external input device may be configured to be transmitted to the second external electronic device.

According to an embodiment, the third input data includes coordinate data, and when the one or more instructions are executed, the processor analyzes the coordinate data included in the third input data, and the It may be configured to generate fourth input data based on the analysis result and transmit the generated fourth input data to the second external electronic device.

According to an embodiment, when the processor determines that the first external electronic device is in a sleep state when the one or more instructions are executed, the display of the first external electronic device is displayed on the display. A user interface including a state is displayed, and when it is determined that the first external electronic device continues to be in the sleep state after a specified time has elapsed, the connection with the first external electronic device is released and the first external electronic device is displayed on the display. 1 It may be set to display a user interface including a connection state with an external electronic device.

According to an embodiment, the connection request signal further includes account information of the electronic device, and when the one or more instructions are executed, the processor causes the account included in the connection request signal to be executed. receiving a response signal including account information identical to the information from the first external electronic device, performing a pairing operation with the first external electronic device in response to the reception of the response signal, and using the wireless communication circuit It may be configured to wirelessly connect the electronic device and the first external electronic device.

According to various embodiments of the present disclosure, a method for providing a function for an electronic device to process input data includes: receiving a first selection signal from an external input device physically and electrically connected through a connection terminal; Determining a first external electronic device to perform wireless communication with the electronic device using a wireless communication circuit based on a first selection signal, transmitting a connection request signal to the first external electronic device, the first Receiving a response signal to the connection request signal from an external electronic device, and when the response signal is received, performing a pairing operation with the first external electronic device to connect the electronic device and the first external electronic device An operation of wirelessly connecting, an operation of displaying a user interface including a state of connection with the first external electronic device on a touch screen display in response to being connected to the first external electronic device, and an operation of the first after connecting to the external electronic device, transmitting data related to the first input data received from the external input device to the first external electronic device through the wireless communication circuit; may include

According to an embodiment, the first input data includes coordinate data, and transmitting at least a portion of the first input data to the first external electronic device includes the coordinate data included in the first input data. analyzing , generating second input data based on the analysis result, and transmitting the generated second input data to the first external electronic device; may further include.

According to an embodiment, the Bluetooth connection of the electronic device to the determined first external electronic device using the wireless communication circuit may include connecting the electronic device and the first external electronic device to a Human Interface Device (HID) profile ( profile) may further include an operation of connecting based on the.

According to an embodiment, the connection terminal includes at least one pogo pin, and the pogo pin member included in the at least one pogo pin is coupled with the socket member included in the at least one coupling structure. It may be physically and electrically connected to the external input device.

According to an embodiment of the present disclosure, in a method for providing a function for an electronic device to process input data, when the first selection signal is received from the external input device, pairing with the first external electronic device stored in a memory ) information to connect to the first external electronic device via Bluetooth.

According to an embodiment, the external input device may include at least one of a keyboard and a mouse track pad.

According to an embodiment, in a method for providing a function for an electronic device to process input data, when receiving a second selection signal including a selection signal for determining a second external electronic device from the external input device, the After releasing the connection with the first external electronic device using a wireless communication circuit, performing Bluetooth connection with the second external electronic device, and connecting with the second external electronic device, the second external electronic device received from the external input device 3 The method may further include transmitting data related to the input data to the second external electronic device.

According to an embodiment, the third input data includes coordinate data, and transmitting at least a portion of the third input data to the second external electronic device includes the coordinate data included in the third input data. , generating fourth input data based on the analysis result, and transmitting the generated fourth input data to the second external electronic device.

According to an embodiment, in a method for providing a function for an electronic device to process input data, when it is determined that the first external electronic device is in a sleep state, the display of the first external electronic device is displayed on the display. When it is determined that the first external electronic device continues to be in the sleep state after an operation of displaying a user interface including a state and a specified time elapses, the connection with the first external electronic device is released and the display is displayed on the display. displaying a user interface including a connection state with a first external electronic device; may further include.

According to an embodiment, the connection request signal further includes account information of the electronic device, and the operation of wirelessly connecting the electronic device and the first external electronic device using the wireless communication circuit includes: An operation of receiving a response signal including account information identical to the account information included in the connection request signal from the first external electronic device and a pairing operation with the first external electronic device in response to the reception of the response signal and wirelessly connecting the electronic device and the first external electronic device using the wireless communication circuit.

Claims (20)

In an electronic device,
touch screen display;
wireless communication circuitry;
a connection terminal formed on one side of the electronic device for physical and electrical connection between an external input device including at least one coupling structure and the electronic device;
processor; and
a memory operatively coupled to the processor; including,
The memory, when executed, causes the processor to:
receiving a first selection signal from the external input device through the connection terminal;
determining a first external electronic device to perform wireless communication with the electronic device using the wireless communication circuit based on the first selection signal;
Transmitting a connection request signal to the first external electronic device, receiving a response signal to the connection request signal from the first external electronic device, and pairing with the first external electronic device when the response signal is received performing an operation, and wirelessly connecting the electronic device and the first external electronic device using the wireless communication circuit,
displaying a user interface including a connection state with the first external electronic device on the touch screen display as it is connected to the first external electronic device;
one or more instructions for controlling to transmit data related to first input data received from the external input device to the first external electronic device through the wireless communication circuit after connection with the first external electronic device to store, electronic devices.
The method according to claim 1,
The first input data includes coordinate data,
The one or more instructions, when executed, cause the processor to:
Analyze the coordinate data included in the first input data, and generate second input data based on the analysis result,
an electronic device configured to transmit the generated second input data to the first external electronic device.
The method according to claim 1,
The one or more instructions, when executed, cause the processor to:
The electronic device is configured to connect the electronic device and the first external electronic device based on a Human Interface Device (HID) profile.
The method according to claim 1,
The connection terminal includes at least one pogo pin, and the pogo pin member included in the at least one pogo pin is coupled to the socket member included in the at least one coupling structure to physically connect with the external input device. and an electronic device that is electrically connected.
The method according to claim 1,
The memory further stores pairing information with the first external electronic device,
The one or more instructions, when executed, cause the processor to:
When the first selection signal is received from the external input device, the electronic device is configured to connect to the first external electronic device via Bluetooth using the pairing information stored in the memory.
The method according to claim 1,
The electronic device of claim 1, wherein the external input device includes at least one of a keyboard and a mouse track pad.
The method according to claim 1,
The memory further stores pairing information with a second external electronic device,
The one or more instructions, when executed, cause the processor to:
Upon receiving a second selection signal including a selection signal for determining the second external electronic device from the external input device, the connection with the first external electronic device is released using the wireless communication circuit and the second selection signal is received. Bluetooth connection with an external electronic device,
The electronic device is configured to transmit data related to the third input data received from the external input device to the second external electronic device after the connection with the second external electronic device is performed.
8. The method of claim 7,
The third input data includes coordinate data,
The one or more instructions, when executed, cause the processor to:
analyzing the coordinate data included in the third input data, and generating fourth input data based on the analysis result;
an electronic device configured to transmit the generated fourth input data to the second external electronic device.
The method according to claim 1,
The one or more instructions, when executed, cause the processor to:
When it is determined that the first external electronic device is in a sleep state, displaying a user interface including the state of the first external electronic device on the display;
When it is determined that the first external electronic device continues to be in the sleep state after a specified time elapses, the connection with the first external electronic device is released and the connection state with the first external electronic device is displayed on the display An electronic device configured to display a user interface that
The method according to claim 1,
The connection request signal further includes account information of the electronic device,
The one or more instructions, when executed, cause the processor to:
receiving a response signal including the same account information as the account information included in the connection request signal from the first external electronic device;
The electronic device is configured to perform a pairing operation with the first external electronic device in response to the reception of the response signal, and wirelessly connect the electronic device and the first external electronic device using the wireless communication circuit.
A method for providing an electronic device with the ability to process input data, the method comprising:
receiving a first selection signal from an external input device physically and electrically connected through a connection terminal;
determining a first external electronic device to perform wireless communication with the electronic device using a wireless communication circuit based on the first selection signal;
transmitting a connection request signal to the first external electronic device;
receiving a response signal to the connection request signal from the first external electronic device;
when the response signal is received, performing a pairing operation with the first external electronic device to wirelessly connect the electronic device with the first external electronic device;
displaying a user interface including a connection state with the first external electronic device on a touch screen display in response to being connected to the first external electronic device; and
transmitting data related to first input data received from the external input device to the first external electronic device through the wireless communication circuit after connection with the first external electronic device; A method comprising
12. The method of claim 11,
The first input data includes coordinate data,
Transmitting at least a portion of the first input data to the first external electronic device includes:
analyzing the coordinate data included in the first input data and generating second input data based on the analysis result; and
transmitting the generated second input data to the first external electronic device; A method further comprising:
12. The method of claim 11,
The operation of Bluetooth connection of the electronic device with the determined first external electronic device using the wireless communication circuit includes:
connecting the electronic device and the first external electronic device based on a Human Interface Device (HID) profile; A method further comprising:
12. The method of claim 11,
The connection terminal includes at least one pogo pin, and the pogo pin member included in the at least one pogo pin is coupled to the socket member included in the at least one coupling structure to physically connect with the external input device. and electrically connected.
12. The method of claim 11,
A method for providing an electronic device with the ability to process input data, the method comprising:
when the first selection signal is received from the external input device, performing a Bluetooth connection with the first external electronic device using pairing information with the first external electronic device stored in a memory; A method further comprising:
12. The method of claim 11,
wherein the external input device comprises at least one of a keyboard or a mouse track pad.
12. The method of claim 11,
A method for providing an electronic device with the ability to process input data, the method comprising:
Upon receiving a second selection signal including a selection signal for determining a second external electronic device from the external input device, the connection with the first external electronic device is released using the wireless communication circuit and the second external electronic device is received. Bluetooth connection with the electronic device; and
transmitting data related to third input data received from the external input device to the second external electronic device after connection with the second external electronic device; A method further comprising:
18. The method of claim 17,
The third input data includes coordinate data,
Transmitting at least a portion of the third input data to the second external electronic device includes:
analyzing the coordinate data included in the third input data and generating fourth input data based on the analysis result; and
transmitting the generated fourth input data to the second external electronic device; A method further comprising:
12. The method of claim 11,
A method for providing an electronic device with the ability to process input data, the method comprising:
displaying a user interface including the state of the first external electronic device on the display when it is determined that the first external electronic device is in a sleep state; and
When it is determined that the first external electronic device continues to be in the sleep state after a specified time elapses, the connection with the first external electronic device is released and the connection state with the first external electronic device is displayed on the display displaying a user interface to A method further comprising:
12. The method of claim 11,
The connection request signal further includes account information of the electronic device,
The operation of wirelessly connecting the electronic device and the first external electronic device using the wireless communication circuit includes:
receiving a response signal including account information identical to the account information included in the connection request signal from the first external electronic device; and
performing a pairing operation with the first external electronic device in response to the reception of the response signal, and wirelessly connecting the electronic device and the first external electronic device with the wireless communication circuit; A method further comprising:

Images