WO2021154005A1 - Procédé de reconnaissance de ressources d'un dispositif électronique externe, et appareil électronique le prenant en charge - Google Patents

Procédé de reconnaissance de ressources d'un dispositif électronique externe, et appareil électronique le prenant en charge Download PDF

Info

Publication number
WO2021154005A1
WO2021154005A1 PCT/KR2021/001139 KR2021001139W WO2021154005A1 WO 2021154005 A1 WO2021154005 A1 WO 2021154005A1 KR 2021001139 W KR2021001139 W KR 2021001139W WO 2021154005 A1 WO2021154005 A1 WO 2021154005A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
external electronic
resource
data
processor
Prior art date
Application number
PCT/KR2021/001139
Other languages
English (en)
Korean (ko)
Inventor
김근우
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Publication of WO2021154005A1 publication Critical patent/WO2021154005A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38—Information transfer, e.g. on bus
    • G06F13/382—Information transfer, e.g. on bus using universal interface adapter
    • G06F13/387—Information transfer, e.g. on bus using universal interface adapter for adaptation of different data processing systems to different peripheral devices, e.g. protocol converters for incompatible systems, open system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/14—Handling requests for interconnection or transfer
    • G06F13/36—Handling requests for interconnection or transfer for access to common bus or bus system
    • G06F13/362—Handling requests for interconnection or transfer for access to common bus or bus system with centralised access control
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38—Information transfer, e.g. on bus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38—Information transfer, e.g. on bus
    • G06F13/382—Information transfer, e.g. on bus using universal interface adapter
    • G06F13/385—Information transfer, e.g. on bus using universal interface adapter for adaptation of a particular data processing system to different peripheral devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38—Information transfer, e.g. on bus
    • G06F13/42—Bus transfer protocol, e.g. handshake; Synchronisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38—Information transfer, e.g. on bus
    • G06F13/42—Bus transfer protocol, e.g. handshake; Synchronisation
    • G06F13/4204—Bus transfer protocol, e.g. handshake; Synchronisation on a parallel bus
    • G06F13/4221—Bus transfer protocol, e.g. handshake; Synchronisation on a parallel bus being an input/output bus, e.g. ISA bus, EISA bus, PCI bus, SCSI bus

Definitions

  • Various embodiments of the present disclosure relate to a method of recognizing a resource included in an external electronic device and an electronic device supporting the same.
  • An electronic device such as a smart phone may perform data communication with an external electronic device.
  • the electronic device may be functionally connected to the external electronic device through a communication interface (eg, universal serial bus (USB)) to recognize various resources included in the external electronic device, and recognize from the external electronic device. It is possible to obtain data related to one resource.
  • a communication interface eg, universal serial bus (USB)
  • the existing electronic device when the existing electronic device is connected to the external electronic device through a communication interface, the external electronic device may be recognized only as a device for performing one function (eg, file transmission/reception). That is, the existing electronic device may recognize only one resource included in the external electronic device at a time. Therefore, in order to use other functions supported by the external electronic device (eg, other resources included in the external electronic device), the existing electronic device has no choice but to recognize the external electronic device through a separate program. In addition, in order to use another resource while using any one resource included in the external electronic device, for example, in order to transmit/receive data related to another resource to/from the external electronic device, the existing electronic device uses an existing connection (eg, USB connection) had to be disconnected.
  • an existing connection eg, USB connection
  • Various embodiments of the present disclosure provide a method for an electronic device to identify a plurality of resources included in an external electronic device through an integrated driver, and a method for recognizing a resource of an external electronic device that processes data related to the plurality of resources, and a method for supporting the same An electronic device may be provided.
  • various embodiments of the present disclosure may provide a method for recognizing a resource of an external electronic device that dynamically uses a plurality of resources included in the recognized external electronic device without disconnection, and an electronic device supporting the same.
  • An electronic device includes a communication module, a processor, and a memory, the processor checks whether an external electronic device is connected through the communication module, and when the external electronic device is connected, the integrated driver Recognizes a plurality of resources included in the external electronic device through It may include an electronic device configured to process the data through .
  • the method for recognizing a resource of an external electronic device includes the steps of checking whether the external electronic device is connected to the external electronic device through a communication module, and when connected to the external electronic device, the external electronic device is connected to the external electronic device through an integrated driver. Recognizing a plurality of resources included in an electronic device, receiving data related to at least one of the plurality of resources through the communication module while connected to the external electronic device, and receiving the data Then, it may include an operation of processing the data through the integrated driver.
  • FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure
  • FIG. 2 is a block diagram of an electronic device related to a method for recognizing an external electronic device according to an embodiment of the present invention.
  • FIG. 3 is a block diagram of an electronic device and an external electronic device according to an embodiment of the present invention.
  • FIG. 4 is a diagram for explaining a method of recognizing a resource related to fingerprint authentication of an external electronic device according to an embodiment of the present invention.
  • FIG. 5 is a diagram for explaining a method of receiving and processing data from an external electronic device, according to an embodiment of the present invention.
  • FIG. 6 is a diagram for describing a method of selecting at least one resource from among a plurality of resources included in an external electronic device, according to an embodiment of the present invention.
  • FIG. 7 is a diagram for describing a method for an electronic device to recognize a plurality of resources included in an external electronic device, according to an embodiment of the present invention.
  • FIG. 8 is a diagram for explaining a method of selecting a camera device included in an electronic device and an external electronic device according to an embodiment of the present invention.
  • FIG. 9 is a flowchart of a method of recognizing an external electronic device according to an embodiment of the present invention.
  • FIG. 1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments.
  • the electronic device 101 communicates with the electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with at least one of the electronic device 104 and the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 .
  • at least one of these components eg, the connection terminal 178
  • some of these components are integrated into one component (eg, display module 160 ). can be
  • the processor 120 executes software (eg, the program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 .
  • software eg, the program 140
  • the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 .
  • the volatile memory 132 may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 .
  • the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor).
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, a neural network processing unit
  • NPU neural processing unit
  • an image signal processor e.g., a sensor hub processor, or a communication processor.
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, a neural network processing unit
  • NPU neural processing unit
  • an image signal processor e.g., a sensor hub processor, or a communication processor.
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123
  • the auxiliary processor 123 may be, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states.
  • the coprocessor 123 eg, an image signal processor or a communication processor
  • the auxiliary processor 123 may include a hardware structure specialized for processing an artificial intelligence model.
  • Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108).
  • the learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited
  • the artificial intelligence model may include a plurality of artificial neural network layers.
  • Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example.
  • the AI model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.
  • the memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176 ) of the electronic device 101 .
  • the data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto.
  • the memory 130 may include a volatile memory 132 or a non-volatile memory 134 .
  • the program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .
  • the input module 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 .
  • the input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).
  • the sound output module 155 may output a sound signal to the outside of the electronic device 101 .
  • the sound output module 155 may include, for example, a speaker or a receiver.
  • the speaker can be used for general purposes such as multimedia playback or recording playback.
  • the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.
  • the display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 .
  • the display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device.
  • the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.
  • the audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 .
  • the electronic device 102) eg, a speaker or headphones
  • the electronic device 102 may output a sound.
  • the sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do.
  • the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.
  • the interface 177 may support one or more specified protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ).
  • the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
  • the connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ).
  • the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).
  • the haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense.
  • the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
  • the camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
  • the power management module 188 may manage power supplied to the electronic device 101 .
  • the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
  • PMIC power management integrated circuit
  • the battery 189 may supply power to at least one component of the electronic device 101 .
  • the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.
  • the communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication through the established communication channel.
  • the communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication.
  • the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a local area network (LAN) communication module, or a power line communication module).
  • a wireless communication module 192 eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module
  • GNSS global navigation satellite system
  • wired communication module 194 eg, : It may include a local area network (LAN) communication module, or a power line communication module.
  • a corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or WAN).
  • a first network 198 eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)
  • a second network 199 eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or WAN).
  • a telecommunication network such as a
  • the wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 .
  • subscriber information eg, International Mobile Subscriber Identifier (IMSI)
  • IMSI International Mobile Subscriber Identifier
  • the electronic device 101 may be identified or authenticated.
  • the wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR).
  • NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)).
  • eMBB enhanced mobile broadband
  • mMTC massive machine type communications
  • URLLC ultra-reliable and low-latency
  • the wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate.
  • a high frequency band eg, mmWave band
  • the wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna.
  • the wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ).
  • the wireless communication module 192 includes a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) may be supported.
  • a peak data rate eg, 20 Gbps or more
  • loss coverage eg, 164 dB or less
  • U-plane latency for realizing URLLC
  • the antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device).
  • the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern.
  • the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna.
  • other components eg, a radio frequency integrated circuit (RFIC)
  • RFIC radio frequency integrated circuit
  • the antenna module 197 may form a mmWave antenna module.
  • the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving a signal of the designated high frequency band. can do.
  • peripheral devices eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)
  • GPIO general purpose input and output
  • SPI serial peripheral interface
  • MIPI mobile industry processor interface
  • the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 .
  • Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 .
  • all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 .
  • the electronic device 101 may perform the function or service itself instead of executing the function or service itself.
  • one or more external electronic devices may be requested to perform at least a part of the function or the service.
  • One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 .
  • the electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request.
  • cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used.
  • the electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing.
  • the external electronic device 104 may include an Internet of things (IoT) device.
  • the server 108 may be an intelligent server using machine learning and/or neural networks.
  • the external electronic device 104 or the server 108 may be included in the second network 199 .
  • the electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.
  • FIG. 2 is a block diagram of an electronic device related to a method for recognizing an external electronic device according to an embodiment of the present invention.
  • the electronic device 200 (eg, the electronic device 101 of FIG. 1 ) includes a dex application 210 , an OS application programming interface (OS API) 220 , and a driver loader process ( A driver loader process 230 , a program area including a system service 240 , a driver framework 250 , a device driver layer 260 , and a hardware abstraction (HAL) layer) 270 and a hardware region physically connected to the external electronic device 280 through a communication module (or communication interface) (eg, USB).
  • OS API OS application programming interface
  • HAL hardware abstraction
  • the external electronic device 280 While the external electronic device 280 (eg, a smartphone) is connected to the electronic device 200 (eg, a PC) through a communication module (eg, USB/IP)
  • the processor of the external electronic device 280 may transmit data related to the selected resource to the electronic device 200 through the communication module.
  • the processor (eg, the processor 120 of FIG. 1 ) of the electronic device 200 transmits the data (eg, data related to a selected resource) to the device driver layer ( 260) can be transferred.
  • the HAL 270 is an abstraction layer between the physical hardware of the electronic device 200 and software executed in the electronic device 200, and prevents the software from directly accessing the physical hardware, and provides an application program A platform (eg, a DEX service) on which (eg, the DEX application 210) can operate may be provided.
  • the processor of the external electronic device 280 may provide the data to the driver loader process 230 through a communication bus through the HAL 270 and the device driver layer 260 .
  • the driver loader process 230 may process the data transmitted from the external electronic device 280 .
  • the driver loader process 230 includes a device driver executable library 231 , an I/O interface 232 , and a plug & play power manager 233 . ) may be included.
  • the processor of the electronic device 200 receives the data from the external electronic device 280 through the input/output interface 232 . can do.
  • the processor of the electronic device 200 When the processor of the electronic device 200 receives data related to the selected resource through the input/output interface 232 , the data (eg, data related to the selected resource) based on the executable library 231 of the device driver ) can be dealt with.
  • a resource type eg, a camera, a fingerprint sensor
  • the processor of the electronic device 200 redirects the input/output of the data identified by the resource type through the plug and play power manager 233 so that the electronic device 200 is identified according to the resource type. You can send and receive data. Accordingly, a plurality of resources can be dynamically identified and processed without disconnection of a connection for data transmission/reception related to an existing resource.
  • the plug and play power manager 233 Based on the data identified according to the resource type (eg, camera, fingerprint sensor), the plug and play power manager 233 provides the DEX service 241 included in the system service 240 to the type of the identification data. Accordingly, execution of the driver may be requested.
  • the resource type eg, camera, fingerprint sensor
  • the processor of the electronic device 200 determines the resource type (eg, fingerprint sensor) of the data through the executable library 231 of the device driver.
  • the resource type eg, fingerprint sensor
  • input/output of data may be redirected through the plug and play power manager 233 .
  • the processor of the electronic device 200 transmits the data through a USB/IP service 242 included in the system service 240 , and includes the data included in the USB/IP service 242 .
  • a socket 242a and the socket 241a of the Dex service 241 the data may be provided to the Dex service 241 .
  • the Dex service 241 may set the resource selected by the external electronic device 280 as a resource to be used by the electronic device 200 based on the data. Also, when the resource included in the external electronic device 280 is set as a resource to be used in the electronic device 200 , the processor of the electronic device 200 transmits information related to the resource installed in the electronic device 200 . It may be provided through an application (eg, the Dex application 210).
  • the processor of the electronic device 200 when the data is data related to the fingerprint sensor of the external electronic device 280, the processor of the electronic device 200 performs the socket 241a of the Dex service 241 and the system service ( The socket 243a of the biometric authentication service 243 included in 240 may be connected.
  • the processor of the electronic device 200 may determine whether data stored in a key store 244 matches data related to the fingerprint sensor through the biometric authentication service 243 .
  • the Dex service 241 releases the lock mode of the electronic device 200 and provides the user with the Dex application 210 . ), a message indicating that the lock mode of the electronic device 200 is released may be provided.
  • the electronic device includes a communication module (eg, communication module 190), a processor (eg, processor 120), and a memory (eg, memory). 130), wherein the processor checks whether an external electronic device is connected through the communication module, and when the external electronic device (eg, the electronic device 102 or 104) is connected, through an integrated driver Recognizing a plurality of resources included in the external electronic device, and receiving data related to at least one of the plurality of resources through the communication module while the external electronic device is connected, through the integrated driver It can be configured to process the data.
  • a communication module eg, communication module 190
  • a processor eg, processor 120
  • a memory eg, memory
  • the integrated driver may recognize a plurality of resources included in the external electronic device and include information for using the recognized plurality of resources.
  • the plurality of resources include at least one of a camera module (eg, the camera module 180), an audio module (eg, the audio module 170), or a sensor module (eg, the sensor module 176). may include.
  • the processor may be configured to identify the type of the at least one resource among the plurality of resources based on the identifier included in the data through the integrated driver.
  • the processor while receiving the first data about a first resource among the plurality of resources through the communication module, maintains the communication connection through the communication module, the communication module It may be configured to receive second data regarding a second resource among the plurality of resources through .
  • the processor may be configured to receive the first data and the second data in parallel through the communication module.
  • a display (eg, the display module 160 ) for outputting recognition information on the plurality of resources may be further included.
  • the processor may be configured to activate or deactivate at least one resource among the plurality of resources based on a user input.
  • the processor may be configured to receive information about the at least one resource to be processed by the electronic device from the external electronic device through the communication module.
  • the processor when an application capable of using a first resource included in the electronic device having the same resource type or a second resource included in the external electronic device is executed, the processor is configured to include the first resource and the It may be configured to provide a user interface including a second resource.
  • a communication module eg, the communication module 190
  • a processor eg, the processor 120
  • a memory eg, the memory 130
  • the processor transmits data related to at least one resource among a plurality of resources included in the electronic device to the external electronic device through the communication module. It can be set to transmit.
  • FIG. 3 is a block diagram of an electronic device and an external electronic device according to an embodiment of the present invention.
  • an electronic device 300 (eg, the electronic device 200 of FIG. 2 ) includes a plurality of resources included in the external electronic device 350 (eg, the external electronic device 280 of FIG. 2 ). of at least one resource may be recognized, and data for using the recognized resource of the external electronic device 350 may be processed.
  • the processor of the electronic device 300 recognizes at least one of a plurality of resources included in the external electronic device 350 through the integrated driver. can do.
  • the integrated driver is a device driver dynamic loader 307 including data for executing a plurality of resources included in the external electronic device 350
  • the external electronic device 350 includes
  • the processor of the electronic device 300 may recognize all of the plurality of resources included in the external electronic device 350 through the device driver dynamic loader 307 . Also, the processor of the electronic device 300 may identify a resource type of data related to a resource selected by the user through the device driver dynamic loader 307 .
  • a separate program recognizes only one resource among a plurality of resources included in the external electronic device 350 . . Accordingly, in order to recognize at least one of a plurality of resources included in the external electronic device 350, separate programs corresponding thereto are required. In addition, when the user selects at least one of the plurality of resources, since a separate program recognizes only one resource, when another resource is selected, another separate program is executed while the data for the existing resource is stored. The send/receive connection was disconnected.
  • the processor of the electronic device 300 connects to the external electronic device 350 through the integrated driver. Since it is possible to recognize all the included plurality of resources and process data related to the plurality of recognized resources, the existing connection is not released due to additional resource selection, and the plurality of resources included in the external electronic device 350 are not released. resources can be used dynamically.
  • the processor of the external electronic device 350 receives a user input through an application 357, and the external electronic device 350 ) may recognize that at least one resource is selected from among a plurality of resources included in the .
  • the external electronic device 350 binds the application 357 and the DFP service 355 to the electronic device 300 through a DFP setting/manager 356. can control
  • the DFP service 355 may determine a command requested from the application 357 while controlling predefined services of the external electronic device 350 , so that the processor of the external electronic device 350 controls the DFP service.
  • a resource may be recognized by receiving a user input through 355 .
  • the predefined services mentioned in the present invention may include a camera service 355d, an audio service 355e, and a biometric service 355f, and the predefined services
  • the services can be controlled under the management of a camera manager 355a, an audio manager 355b, and a biometric manager 355c, respectively, and the camera manager 355a, audio
  • the manager 355b and the biometric authentication manager 355c may be managed by the DFP service 355 .
  • the processor of the external electronic device 350 may transmit data related to the selected resource to the DFP daemon 354 .
  • the DFP daemon 354 can perform various tasks in the background of the electronic device 300 without direct control by the user, so that the DFP service 355 is based on data in the selected resource according to the requirements of the DFP service 355 .
  • the external electronic device 350 may be set as a resource of the electronic device 300 supporting the selected function.
  • the DFP HAL 354a included in the external electronic device 350 includes HALs (eg, a camera HAL (camera HAL) 351f) of a resource predefined in the external electronic device 350, and an audio HAL (audio HAL).
  • HAL) 351g, sensors HAL (sensors HAL) 351h, and/or fingerprint authentication HAL (fingerprint HAL) 352b) may be created and managed.
  • the DFP HAL 354a is an abstraction layer between the physical hardware of the external electronic device 350 and software executed in the external electronic device 350, and prevents the software from directly accessing the physical hardware and , may provide a platform (eg, DFP service (355)) on which an application (eg, application (357)) can operate.
  • a platform eg, DFP service (355)
  • an application eg, application (357)
  • the Android common hardware (Android common h/w) 351 may include a sensor, a camera, audio, and a universal serial bus (USB) disposed in the external electronic device 350 .
  • the Android common hardware 351 may include a hardware device included in the electronic device.
  • the Android biometrics devices 352 may include a fingerprint recognition device and a face recognition device.
  • a camera driver 351c may be a program that operates as a part of a kernel in the external electronic device 350 to control a camera included in the external electronic device 350 .
  • the audio driver 351d may be a program that operates as a part of a kernel in the external electronic device 350 to control an audio module included in the external electronic device 350 .
  • a sensor driver 351e is configured to control various sensors included in the external electronic device 350, such as a biometric sensor, a gyro sensor, an optical sensor, and a pressure sensor, the external electronic device ( 350) may be a program running as a part of the kernel.
  • the fingerprint driver 352b may be a program that operates as a part of a kernel in the external electronic device 350 to control the fingerprint recognition module included in the external electronic device 350 .
  • a camera HAL (camera HAL) 351f is an application 357 included in the external electronic device 350 that processes data acquired through the camera module of the external electronic device 350 directly accesses the camera module. it can be prevented Also, a consistent platform (eg, DFP service 355) may be provided so that the application 357 can use the data acquired from the camera module.
  • a consistent platform eg, DFP service 355
  • the audio HAL (audio HAL) 351g is a method in which an application 357 included in the external electronic device 350 that processes data acquired through the audio module of the external electronic device 350 directly accesses the audio module. it can be prevented Also, a consistent platform (eg, DFP service 355) may be provided so that the application 357 can use the data obtained from the audio module.
  • a consistent platform eg, DFP service 355
  • a sensor HAL (sensors HAL) 351h is configured to process data obtained from various sensor modules included in the external electronic device 350, for example, a biometric sensor, an optical sensor, a gyro sensor, and a pressure sensor. It is possible to prevent the application 357 included in the electronic device 350 from directly accessing the sensors. In addition, a consistent platform (eg, DFP service 355) may be provided so that the application 357 may process the data obtained from the sensor.
  • a consistent platform eg, DFP service 355
  • the fingerprint recognition HAL (fingerprint HAL) 352b is an application 357 included in the external electronic device 350 that processes data acquired from the fingerprint recognition module included in the external electronic device 350 is the fingerprint recognition module. direct access to the In addition, a consistent platform (eg, DFP service 355) may be provided so that the application 357 may process the data obtained from the fingerprint recognition module.
  • a consistent platform eg, DFP service 355
  • the processor of the external electronic device 350 when the processor of the external electronic device 350 receives an input related to a user request to use a fingerprint sensor among a plurality of resources included in the external electronic device 350, the external electronic device ( The processor of 350 may recognize the biometric authentication service 355f from among the predefined services managed by the DFP service 355 based on the request.
  • the processor of the external electronic device 350 When the processor of the external electronic device 350 recognizes the biometric authentication service 355f through the DFP service 355 , it transmits a request to use the biometric authentication service 355f to the DFP daemon 354 . and the processor of the external electronic device 350 may process the request through the DFP daemon 354 .
  • the processor of the external electronic device 350 may register and authenticate the requirement to use the fingerprint sensor included in the external electronic device 350 .
  • the processor of the external electronic device 350 that has performed the operation may process data related to the fingerprint sensor managed by the DFP HAL 354a. In this process, the processor of the external electronic device 350 may set the external electronic device 350 as a resource supporting a function related to at least one resource among a plurality of resources.
  • the processor of the external electronic device 350 transmits data related to the fingerprint sensor through USB/IP (eg, a communication module). It can be transmitted to the electronic device 300 .
  • the method of transmitting the data is not limited to the USB/IP method and may include a wired network and/or a wireless network.
  • the processor of the electronic device 300 uses the device driver dynamic loader 307 to drive the electronic device 300 . can be dynamically applied as a driver related to the fingerprint sensor, so that the processor of the electronic device 300 can recognize the external electronic device 350 as a resource supporting the fingerprint sensor function.
  • the processor of the electronic device 300 When the processor of the electronic device 300 recognizes the external electronic device 350 as a resource, the data transmitted from the external electronic device 350 is used as a resource of the data through the device driver dynamic loader 307 . type can be identified. Thereafter, the driver of the electronic device 300 may be dynamically applied based on the identified data so that the electronic device 300 can dynamically use the plurality of resources included in the external electronic device 350 . there is.
  • the processor of the electronic device 300 transfers the data transmitted from the external electronic device 350 to the device driver dynamic loader 307 through a streamer 304 .
  • the streamer 304 may include an A/V streamer 304a and sensor streamers 304b and 304c.
  • the A/V streamer 304a may convert audio data and video data to be suitable for the selected device driver dynamic loader 307 .
  • the sensor streamers 304b and 304c may convert sensor data obtained from a sensor included in the external electronic device, such as a gyro sensor, an optical sensor, and a biometric sensor, to be suitable for the selected device driver dynamic loader 307. there is.
  • the DFP service 305 included in the electronic device 300 identifies the data according to a resource type, and provides raw data according to the type to the device driver dynamic loader 307, so that the device The driver dynamic loader 307 may process the raw data.
  • the external electronic device 350 when the electronic device 300 recognizes the external electronic device 350 as a resource supporting a fingerprint sensor function, transmits data related to the fingerprint sensor by a user input.
  • the processor of the external electronic device 350 controls a USB/IP daemon 353 to provide a USB service 353a and a USB driver 351a.
  • data related to the fingerprint sensor may be transmitted to the USB host controller 301 of the electronic device 300 .
  • the USB host controller 301 may transmit data related to the fingerprint sensor to the DFP service 305 through a USB driver stack 302, and the data related to the fingerprint sensor is transmitted to the streamer ( 304 ) to suit the device driver dynamic loader 307 .
  • the user mode driver 311 included in the electronic device 300 includes an audio/video driver 311a, a biometrics driver 311b, and a sensor driver 311c. may include.
  • the electronic device 300 may enter a user mode.
  • the user mode may be a mode for preventing the application application 308 included in the electronic device 300 from directly accessing the operating system data of the electronic device 300 to modify or delete data.
  • the user mode driver 311 may be a program that operates when the electronic device 300 is in a user mode.
  • the audio/video driver 311a included in the user mode driver 311 may be a program that allows the electronic device 300 to control an audio module and a video module of the external electronic device 350 .
  • the biometric driver 311b enables the electronic device 300 to control a biometric module of the external electronic device 350, for example, a module related to iris recognition, a module related to voice recognition, and a module related to face recognition. It could be a program that
  • the sensor driver 311c may be a program that enables the electronic device 300 to control sensors included in the external electronic device 350 , for example, a gyro sensor, a proximity sensor, an acceleration sensor, and an RGB sensor.
  • the sensor is not limited thereto.
  • the processor of the electronic device 300 may control a plurality of resources included in the external electronic device 350 through the application 308 of the electronic device 300 .
  • the processor of the electronic device 300 controls the application application 308 to receive data related to the resource selected by the user received by the USB/IP library (USB/IP LIB) 310 through the socket 309 . can do. Also, by controlling the application application 308 , at least one resource among a plurality of resources of the external electronic device 350 may be controlled through the socket 309 and the USB/IP library 310 .
  • the socket 309 included in the electronic device 300 may be an abstract port for transmitting data received by the USB/IP library to the application application 308 .
  • the device driver dynamic loader 307 included in the electronic device 300 is a driver of the electronic device 300 .
  • the processor of the electronic device 300 may control at least one of a plurality of resources of the external electronic device 300 through the application program 300 .
  • the processor of the electronic device 300 converts the converted data (eg, data related to a fingerprint sensor converted to be suitable for a device driver dynamic loader) according to a resource type (eg, a fingerprint sensor) as raw data of the converted data.
  • a resource type eg, a fingerprint sensor
  • the DFP library 306 may be an API library that allows the device driver dynamic loader 307 and the DFP service 305 to communicate data.
  • the device driver dynamic loader 307 that has received the raw data through the DFP library 306 may process the raw data and use the external electronic device 350 as a resource supporting a fingerprint sensor function.
  • the processor of the external electronic device 350 transmits data related to the fingerprint sensor to the electronic device 300 while transmitting data related to the fingerprint sensor to the plurality of resources included in the external electronic device 350 .
  • a user input for additionally selecting a camera may be received. It can recognize that the camera is selected by the received user input through the DFP setting manager 356 that binds the application 357 and the DFP service 355 included in the external electronic device 350 . .
  • the processor of the external electronic device 350 recognizing that the camera is additionally selected by the user input may transmit data related to the camera to the DFP daemon 354 .
  • the camera may be set as a resource of the electronic device 300 .
  • the processor of the external electronic device 350 performs the existing transmission of the fingerprint through a wired network and/or a wireless network. Data related to the sensor and data related to the additionally set camera may be transmitted to the electronic device 300 .
  • the processor of the electronic device 300 determines the resource type of the data related to the camera through the device driver dynamic loader 307 . (eg cameras) can be identified and processed.
  • the processor of the electronic device 300 that has performed the above process may additionally apply a driver related to the camera through the device driver dynamic loader 307 .
  • the processor of the electronic device 300 additionally applies a driver related to a camera, and then redirects the input/output of the data to receive the data related to the fingerprint sensor and the data related to the camera from the external electronic device 350, Since raw data can be processed, the external electronic device 350 can be used as a resource without switching data input/output according to resource addition.
  • FIGS. 4 and 5 are diagrams of a method of setting the external electronic device as a resource of the electronic device based on a user input.
  • FIG. 4 is a diagram for explaining a method of recognizing a resource related to fingerprint authentication of an external electronic device according to an embodiment of the present invention.
  • the processor of the external electronic device 450 selects a fingerprint sensor through an application (eg, a Dex app 451 ).
  • the electronic device 400 eg, the electronic device 200 of FIG. 2
  • sets the external electronic device 450 eg, the external electronic device 280 of FIG. 2
  • data related to the fingerprint sensor may be received from the external electronic device 450 .
  • the processor of the external electronic device 450 prints the fingerprint of the external electronic device 450 through the Dex application 451 . It may receive a user input to use it as a sensor.
  • the communication method between the electronic device 400 and the external electronic device 450 is not limited to the USB/IP method, and may be connected through a wireless network and/or a wired network method.
  • the processor of the external electronic device 450 receiving the user input through the Dex application 451 may transmit a request 451a to set the external electronic device as a fingerprint sensor to the Dex service 452. there is.
  • the Dex service 452 may transmit a request 452a to receive the data stream of the fingerprint sensor to the Dex daemon 453 in order to use the external electronic device as the fingerprint sensor.
  • the Dex daemon 453 requests the Android HAL 454 to execute a driver related to the fingerprint sensor 453a to process the data related to the fingerprint sensor, and the external electronic device ( 450 ) may be set as the fingerprint sensor of the electronic device 400 .
  • the Android HAL 454 may check ( 454a ) whether the external electronic device 450 maintains a communication connection with the electronic device 400 .
  • the DEX service 452 of the external electronic device 450 transmits a request 452b to set the external electronic device 450 as the fingerprint sensor to the DEX system service 401 of the electronic device 400 .
  • the DEX system service 401 sends a request 401a to dynamically load a driver related to the fingerprint sensor to the dynamic loader process 402, and the driver kernel 403 may transmit a request 401b for registering a driver related to the fingerprint sensor to the driver kernel 403 .
  • the driver kernel 403 redirects input/output of data in order to receive the data related to the fingerprint sensor from the external electronic device 450 (403a) and USB input/output related to the fingerprint sensor.
  • a system call 403b may be requested to the dynamic loader process 402 .
  • the driver kernel 403 may transmit to the Dex system service 401 that the driver related to the fingerprint sensor has been registered (403c). There is. Thereafter, the DEX system service 401 transmits to the driver kernel 403 that the ready to receive data related to the fingerprint sensor is completed (401c), and the DEX service 452 of the external electronic device 450 is ) can be transmitted that the readiness to receive data related to the fingerprint sensor is completed (401d).
  • the Dex service 452 When the Dex service 452 receives that the data related to the fingerprint sensor is ready (401d) from the Dex system service 401, when the user performs fingerprint authentication using the external electronic device 450, The data stream related to the fingerprint sensor may be transmitted (452c) to the DEX system service 401, and the electronic device 400 may use the external electronic device 450 as a fingerprint sensor.
  • FIG. 5 is a diagram for explaining a method of receiving and processing data from an external electronic device, according to an embodiment of the present invention.
  • Data may be received and processed from the external electronic device 550 .
  • a DFP windows service 530 is transmitted from the DFP device driver 520 to the external electronic device 550 .
  • the processor of the electronic device 500 may receive a user input for requesting a preview image 500a through an application application (eg, a 3rd app) 510 installed in the electronic device 500 .
  • the processor of the electronic device 500 that has received the request 500a through the application application 510 is a resource related to the request 500a among a plurality of resources included in the external electronic device 550 .
  • a request 510a to use the camera may be sent to the DFP device driver 520 .
  • the processor of the electronic device 500 may request a preview image from the DFP device driver 520 ( 510b ).
  • the DFP device driver 520 Upon receiving the requests 510a and 510b, the DFP device driver 520 uses the camera of the external electronic device 550 for the DFP window service 530 based on the requests 510a and 510b. data may be called for ( 520a ).
  • the DFP window service 530 Upon receiving the call 510c, the DFP window service 530 sends (530b) a packet of a preview image via USB to the external electronic device 550 in order to call the camera-related data. It may make a request to the DFP android service (DFP android service) 560 .
  • DFP android service DFP android service
  • the DFP Android service 560 of the external electronic device 550 that has received the request 530b from the DFP window service 530 checks (560a) the received request 530b, and the external electronic device
  • the 550 may send a request to perform the preview 560b to the Android hardware camera (android.hardware.camera) 570 .
  • the Android hardware camera 570 may identify a resource to process the request 560b and recognize a service for the identified resource.
  • the Android hardware camera 570 that has received the request 560b identifies a camera that is the resource type of the request 560b and performs a preview 570a on the camera service 580 of the external electronic device 550 . You can send a request to
  • the camera service 580 receiving the request 570a may transmit a request 580a to operate the camera device of the external electronic device 550 to the camera HAL 590 .
  • the camera service 580 may request the camera HAL 590 to start a preview (580b).
  • the camera HAL 590 receiving the request 580b may acquire raw data of the preview image acquired by the camera device 590a.
  • the camera service 580 may transmit a preview image to the Android hardware camera 570 (580c).
  • the Android hardware camera 570 that has received the preview image transmits (570b) the preview image to the DFP Android service 560, and the DFP Android service 560 that has received the preview image transmits the preview image.
  • it may be determined that the response to the request transmitted by the electronic device 500 has been processed (560c).
  • the DFP Android service 560 which determines that the response to the request has been processed (560c), transmits the preview image to the DFP window service 530 of the electronic device 500 by applying the TCP method through USB to the packet. (560d) can be done.
  • the DFP window service 530 may parse the packet of the preview image into raw data (530c).
  • the DFP window service 530 may transmit the preview image as a raw data stream to the DFP device driver 520 ( 530d).
  • the application application 510 may receive the preview image 520b from the DFP device driver 520 that has received the raw data stream of the preview image, and provide the preview image to the user.
  • an operation 560a of confirming a request transmitted by the electronic device 500 and an operation 560c of resolving a response to the request are performed.
  • the processor of the external electronic device 550 executes the request transmitted by the electronic device 500 and resolves a response to the request, between the electronic device 500 and the external electronic device 550 . It can also be used as an operation to determine whether the communication connection is maintained or not.
  • FIG. 6 is a diagram for describing a method of selecting at least one resource from among a plurality of resources included in an external electronic device, according to an embodiment of the present invention.
  • the processor of the external electronic device provides the user with a plurality of resources included in the external electronic device to the application 600 (eg, the application 357 of FIG. 3 ). )) to provide a display object (eg, an icon) corresponding to the plurality of resources to request input from the user.
  • the form of the plurality of resources provided to the user through the application 600 may include, but is not limited to, text, voice, and message as well as icons.
  • the display object corresponding to the plurality of resources provided to the user through the application 600 is a camera 601 (eg, the camera module 180 of FIG. 1 ), a speaker 602 (eg, : the sound output module 155 of FIG. 1 ), the microphone 603 (eg the input module 150 of FIG. 1 ), the fingerprint sensor 604 (eg the sensor module 176 of FIG. 1 ) and game controls ( 605).
  • the fingerprint sensor 604 can be selected.
  • the processor of the external electronic device may apply a graphic effect 610 to the selected icon output through the application.
  • the selected icon may be made translucent compared to other icons, and the shadow around the fingerprint sensor 604 icon may be changed to visually provide an effect of selecting the icon by the user.
  • the processor of the external electronic device may perform the operation described above with reference to FIG. 4 .
  • the processor of the electronic device dynamically applies the driver of the electronic device through the integrated driver, and when the user authenticates the fingerprint through the external electronic device, Security of the electronic device may be released by receiving data related to the fingerprint sensor 604 .
  • the processor of the electronic device when the processor of the electronic device is using the external electronic device as a fingerprint sensor and additionally receives a user input for selecting the speaker 602 through the application 600, the processor of the electronic device is The speaker 602 of the external electronic device may be recognized as a resource to be additionally used. In a state in which the speaker 602 of the external electronic device is set as a resource of the electronic device, when a user input for playing audio content is received in the electronic device, the audio content is transmitted to the speaker 602 of the external electronic device ) can be output.
  • the processor of the electronic device processes the data related to the fingerprint sensor 604 from the external electronic device, and dynamically applies the integrated driver according to the resource type of the additionally selected data (eg, the speaker 602 ). It is possible to process data related to the speaker 602 while processing data related to the fingerprint sensor 604 . That is, the processor of the electronic device may dynamically apply the integrated driver according to the resource type, so that data related to the fingerprint sensor 604 from the external electronic device and data related to the speaker 602 from the external electronic device can be received and processed in parallel.
  • FIG. 7 is a diagram for describing a method for an electronic device to recognize a plurality of resources included in an external electronic device, according to an embodiment of the present invention.
  • a processor of the electronic device may include a plurality of devices included in the external electronic device through the integrated driver. resources can be identified. Accordingly, the processor of the electronic device provides a plurality of resources recognized to the user through the device manager 700, receives a user input, and activates or deactivates at least one of the plurality of resources based on the user input. can
  • the processor of the electronic device may recognize all of the plurality of resources included in the external electronic device through an integrated driver installed in the electronic device.
  • the processor of the electronic device recognizes a biometric sensor 710a and a camera 710b among a plurality of resources included in the external electronic device, and provides the recognition to the user through the device manager 700 . It is possible to provide the recognition information 710 including the biometric sensor 710a and the camera 710b.
  • the recognition information 710 is not limited to including the biometric sensor 710a and the camera 710b, and may include all of a plurality of resources included in an external electronic device connected to the electronic device.
  • the electronic device may be connected to at least one or more external electronic devices to recognize all of a plurality of resources included in the connected external electronic devices.
  • the processor of the electronic device receives a user input while being connected to the external electronic device functionally connected to another external electronic device (eg, a wearable device), and receives at least one of a plurality of resources included in the other external electronic device. one can recognize
  • the processor of the electronic device provides information (eg, recognition information 710) on the plurality of resources through the device manager 700, and when a user input is received, a resource selected by the user based on the user input It can be enabled or disabled.
  • the processor of the electronic device may deactivate the camera 710b.
  • the camera 710b is deactivated, since the processor of the electronic device does not process data related to the camera 710b received from the external electronic device through the integrated driver, the camera 710b of the external electronic device may not be used as a resource.
  • the processor of the electronic device when the processor of the electronic device receives the user input again through the device manager 700 and activates the deactivated camera 710b again, the processor of the electronic device sends the camera ( It is possible to receive data related to 710b) and process the data, so that the camera 710b of the external electronic device can be set as a resource of the electronic device.
  • FIG. 8 is a diagram for explaining a method of selecting a camera device included in an electronic device and an external electronic device according to an embodiment of the present invention.
  • the processor of the electronic device 800 asks the user whether to check the preview image through the camera 801 of the electronic device 800 through the UI, the external electronic device 850 ) through the camera 851 may request a selection whether to check the preview image.
  • the processor of the electronic device 800 may receive a user input for executing the program 810 related to the camera. there is.
  • the processor of the electronic device 800 provides the user with a message 811a related to the camera 801 of the electronic device 800 and the camera of the external electronic device 850 to the user.
  • a separate device selection window 811 including a message 811b related to 851 may be provided.
  • the processor of the electronic device 800 performs a message 811a related to the camera 801 of the electronic device 800 and a camera 851 related to the camera 851 of the external electronic device 850 through the device selection window 811 .
  • the processor of the electronic device 800 based on the user input, the camera 801 of the electronic device 800 and/or the external electronic device ( A preview image may be acquired from the camera 851 of the 850 , and the acquired preview image may be provided to the user through a program 810 related to the camera.
  • the electronic device 800 and the external electronic device 850 are connected and a plurality of resources having the same type are recognized, which resource among the resources having the same type is recognized by the user. You can provide a UI whether to use .
  • FIG. 9 is a flowchart of a method of recognizing an external electronic device according to an embodiment of the present invention.
  • the processor of the electronic device connects to the external electronic device (eg, the communication module 190 of FIG. 1 ) through a communication module (eg, the communication module 190 of FIG. 1 ). For example, whether the external electronic device 280 of FIG. 2 is connected to the electronic device may be checked.
  • the processor of the electronic device After the processor of the electronic device checks whether or not the connection with the external electronic device is present, the processor of the electronic device performs a plurality of functions included in the external electronic device through the integrated driver already installed in the electronic device in operation 903 . resources can be identified.
  • the integrated driver is a driver including data related to a plurality of resources included in the external electronic device, and when the external electronic device is connected to the electronic device, the processor of the electronic device is configured to operate the external electronic device based on the integrated driver. All of the plurality of resources included in the electronic device may be recognized.
  • operation 905 when the processor of the electronic device recognizes a plurality of resources included in the external electronic device, data related to at least one resource among the recognized plurality of resources may be received.
  • the processor of the electronic device may process the received data through the integrated driver in operation 907 .
  • a user input for selecting at least one resource from among a plurality of resources included in the external electronic device through an application of the external electronic device may set the external electronic device as the selected resource of the electronic device based on data related to the selected resource.
  • the processor of the external electronic device transmits data related to the selected resource to the electronic device through the communication module
  • the processor of the electronic device identifies the resource type of the data through the integrated driver, and the resource
  • the external electronic device may be used as a resource by dynamically applying a driver of the electronic device according to a type to process data related to the selected resource transmitted from the external electronic device.
  • a method of recognizing a resource of an external electronic device includes the external electronic device through a communication module (eg, the communication module 190 ). an operation of checking whether a plurality of resources are connected to the external electronic device, an operation of recognizing a plurality of resources included in the external electronic device through an integrated driver when connected to the external electronic device, an operation of recognizing a plurality of resources included in the external electronic device through an integrated driver, and an operation of recognizing the plurality of resources included in the external electronic device through the communication module while connected to the external electronic device receiving data related to at least one of the resources; and when receiving the data, processing the data through the integrated driver.
  • a communication module eg, the communication module 190
  • the integrated driver may recognize a plurality of resources included in the external electronic device and include information for using the recognized plurality of resources.
  • the plurality of resources include at least one of a camera module (eg, the camera module 180), an audio module (eg, the audio module 170), or a sensor module (eg, the sensor module 176). may include.
  • the recognizing of the plurality of resources may include identifying the type of at least one resource among the plurality of resources based on an identifier included in the data through the integrated driver.
  • the receiving of the data related to the at least one resource includes, while receiving the first data related to a first resource among the plurality of resources through the communication module, communication through the communication module and receiving second data regarding a second resource among the plurality of resources through the communication module while maintaining the connection.
  • the operation of receiving the data related to the at least one resource may include receiving the first data and the second data in parallel through the communication module.
  • the receiving of the data related to the at least one resource includes, through the communication module, receiving information on the at least one resource to be processed by the electronic device from the external electronic device. may include
  • the method of recognizing a resource of the external electronic device may further include activating or deactivating at least one resource among the plurality of resources based on a user input.
  • an application capable of using a first resource included in the electronic device having the same resource type or a second resource included in the external electronic device is executed and providing a user interface including the first resource and the second resource when the application is executed.
  • the electronic device may have various types of devices.
  • the electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device.
  • a portable communication device eg, a smart phone
  • a computer device e.g., a smart phone
  • a portable multimedia device e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a wearable device e.g., a smart bracelet
  • a home appliance device e.g., a home appliance
  • first”, “second”, or “first” or “second” may simply be used to distinguish the component from other such components, and refer to the component in another aspect (e.g., importance or order) is not limited. It is said that one (eg, first) component is “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.
  • module used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit.
  • a module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions.
  • the module may be implemented in the form of an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • Various embodiments of the present document include one or more stored in a storage medium (eg, the internal memory 136 or the external memory 138) readable by a machine (eg, the electronic device 101). It may be implemented as software (eg, program 140) including instructions.
  • the processor eg, the processor 120
  • the device may call at least one of one or more instructions stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the at least one command called.
  • the one or more instructions may include code generated by a compiler or code executable by an interpreter.
  • the device-readable storage medium may be provided in the form of a non-transitory storage medium.
  • 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.
  • a signal eg, electromagnetic wave
  • the method according to various embodiments disclosed in this document may be provided as included in a computer program product.
  • Computer program products may be traded between sellers and buyers as commodities.
  • the computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly between smartphones, eg between smartphones.
  • a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.
  • each component eg, a module or a program of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is.
  • one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added.
  • a plurality of components eg, a module or a program
  • the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. .
  • operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)

Abstract

L'invention concerne un appareil électronique comprenant un module de communication, un processeur et une mémoire, le processeur étant configuré pour : déterminer si un dispositif électronique externe est connecté par l'intermédiaire du module de communication ; lorsque le dispositif électronique externe est connecté, reconnaître, par l'intermédiaire d'un pilote intégré, une pluralité de ressources comprises dans le dispositif électronique externe ; et lorsque des données relatives à au moins une ressource parmi la pluralité de ressources sont reçues par l'intermédiaire du module de communication dans un état dans lequel le dispositif électronique externe est connecté, traiter les données par l'intermédiaire du pilote intégré. Divers autres modes de réalisation de l'invention sont également possibles.
PCT/KR2021/001139 2020-01-29 2021-01-28 Procédé de reconnaissance de ressources d'un dispositif électronique externe, et appareil électronique le prenant en charge WO2021154005A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020200010576A KR20210096917A (ko) 2020-01-29 2020-01-29 외부 전자 장치의 리소스를 인식하는 방법 및 이를 지원하는 전자 장치
KR10-2020-0010576 2020-01-29

Publications (1)

Publication Number Publication Date
WO2021154005A1 true WO2021154005A1 (fr) 2021-08-05

Family

ID=77079921

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2021/001139 WO2021154005A1 (fr) 2020-01-29 2021-01-28 Procédé de reconnaissance de ressources d'un dispositif électronique externe, et appareil électronique le prenant en charge

Country Status (2)

Country Link
KR (1) KR20210096917A (fr)
WO (1) WO2021154005A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090074394A (ko) * 2008-01-02 2009-07-07 모다정보통신 주식회사 저장장치를 구비한 ｕｓｂ 와이브로 모뎀 장치
KR20090132897A (ko) * 2008-06-23 2009-12-31 양성현 기능별 선택 가능한 소비자 맞춤형 멀티미디어 단말기
KR101130474B1 (ko) * 2004-04-29 2012-03-27 마이크로소프트 코포레이션 총칭 ｕｓｂ 드라이버
KR101621875B1 (ko) * 2014-12-11 2016-05-17 현대자동차주식회사 차량에 탑재된 멀티미디어 단말, 그 제어 방법 및 기록 매체
KR101761126B1 (ko) * 2011-08-12 2017-07-25 삼성전자 주식회사 Ｕｓｂ 장치, 및 그것을 포함하는 ｕｓｂ 시스템

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101130474B1 (ko) * 2004-04-29 2012-03-27 마이크로소프트 코포레이션 총칭 ｕｓｂ 드라이버
KR20090074394A (ko) * 2008-01-02 2009-07-07 모다정보통신 주식회사 저장장치를 구비한 ｕｓｂ 와이브로 모뎀 장치
KR20090132897A (ko) * 2008-06-23 2009-12-31 양성현 기능별 선택 가능한 소비자 맞춤형 멀티미디어 단말기
KR101761126B1 (ko) * 2011-08-12 2017-07-25 삼성전자 주식회사 Ｕｓｂ 장치, 및 그것을 포함하는 ｕｓｂ 시스템
KR101621875B1 (ko) * 2014-12-11 2016-05-17 현대자동차주식회사 차량에 탑재된 멀티미디어 단말, 그 제어 방법 및 기록 매체

Also Published As

Publication number Publication date
KR20210096917A (ko) 2021-08-06

Similar Documents

Publication Publication Date Title
WO2021075786A1 (fr) Dispositif électronique et procédé de traitement d'une fenêtre surgissante utilisant une multi-fenêtre de celui-ci
WO2022080634A1 (fr) Procédé pour entraîner un réseau neuronal artificiel et dispositif électronique le prenant en charge
WO2022030890A1 (fr) Procédé de capture d'image à fenêtres multiples et dispositif électronique associé
WO2021075905A1 (fr) Procédé d'optimisation d'application et dispositif électronique le prenant en charge
WO2023058860A1 (fr) Dispositif électronique pour le traitement d'un fichier apk à signatures multiples, et son procédé de fonctionnement
WO2021154005A1 (fr) Procédé de reconnaissance de ressources d'un dispositif électronique externe, et appareil électronique le prenant en charge
WO2022177162A1 (fr) Processeur pour initialiser un fichier modèle d'application, et dispositif électronique le comprenant
WO2021177640A1 (fr) Procédé de commande d'application de dispositif électronique externe, et dispositif électronique prenant en charge ce dernier
WO2024071927A1 (fr) Dispositif électronique et procédé de protection de données l'utilisant
WO2023068507A1 (fr) Dispositif électronique permettant d'assurer une fonction rcs et son procédé de fonctionnement
WO2023054905A1 (fr) Procédé et dispositif électronique pour utiliser des données d'un dispositif électronique externe
WO2024111872A1 (fr) Dispositif électronique, procédé et support de stockage non transitoire lisible par ordinateur pour acquérir une clé dans un environnement sans fil
WO2022177145A1 (fr) Procédé de gestion d'informations de groupe persistant d'un dispositif électronique
WO2024090787A1 (fr) Dispositif électronique et procédé de fonctionnement d'ui d'authentification biométrique correspondant
WO2022191455A1 (fr) Dispositif électronique pour effectuer une rédaction de fichier et son procédé de fonctionnement
WO2023054936A1 (fr) Dispositif électronique de reconstruction de données de bloc dans un réseau à chaîne de blocs et son procédé de fonctionnement
WO2022191540A1 (fr) Dispositif électronique de partage d'application
WO2022177206A2 (fr) Appareil électronique et procédé de fonctionnement d'appareil électronique
WO2022154383A1 (fr) Dispositif électronique et procédé de chargement de module de noyau du dispositif électronique
WO2023106621A1 (fr) Serveur en nuage destiné à l'authentification d'un utilisateur et procédé de mise en œuvre correspondant
WO2023054839A1 (fr) Dispositif électronique et procédé pour la fourniture adaptative d'un processus d'authentification de service en fonction d'une situation, et support de stockage lisible par ordinateur non transitoire
WO2024076008A1 (fr) Dispositif électronique, procédé et support de stockage lisible par ordinateur non transitoire pour partager un fichier
WO2020184984A1 (fr) Dispositif électronique permettant de traiter des données audio et son procédé de fonctionnement
WO2023048485A1 (fr) Dispositif électronique pour transmettre des données au moyen d'une communication sans fil à courte portée, et son procédé de fonctionnement
WO2024063516A1 (fr) Dispositif et procédé de fourniture de logiciel de personnalisation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21747563

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21747563

Country of ref document: EP

Kind code of ref document: A1