CN115703006A

CN115703006A - Equipment connection method, device and system

Info

Publication number: CN115703006A
Application number: CN202110929468.9A
Authority: CN
Inventors: 卞苏成; 刘丰恺
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2021-08-13
Filing date: 2021-08-13
Publication date: 2023-02-17

Abstract

The application provides a device connection method, device and system, which are applied to the technical field of terminals and can improve the connection efficiency between electronic devices. The method comprises the following steps: detecting an interaction event; under the condition that a preset interaction event is detected, sending a first message to second electronic equipment, wherein the first message is used for indicating the preset interaction event, so that the second electronic equipment controls third electronic equipment to be connected with the first electronic equipment; and interacting the first data with the third electronic equipment through the connection with the third electronic equipment.

Description

Equipment connection method, device and system

Technical Field

The present application relates to the field of terminal technologies, and in particular, to a device connection method, apparatus, and system.

Background

At present, games are increasingly favored by users. In daily life, a user often connects a handle to an electronic device (e.g., a mobile phone, a tablet computer, and a notebook computer), and plays a game running on the electronic device through the handle.

In some scenarios, a user may use the handle to operate a game on multiple electronic devices, such as currently running game 1 on a television, and the user may operate the handle to establish a connection with the television to operate the game on the television via the handle. Then, the user needs to operate the game on the computer, and the user needs to operate the handle again to establish connection with the computer so as to operate the game on the computer through the handle. It can be seen that in order to operate a game on a plurality of electronic devices through a handle, a plurality of connection establishment operations may be required, making the process of establishing a connection more complicated and time consuming. How to provide a more efficient connection establishment scheme in a multi-device scenario becomes an urgent problem to be solved.

Disclosure of Invention

The embodiment of the application provides a device connection method, device and system, which can solve the problem of low connection efficiency between the devices at present and improve the connection efficiency between the devices.

In order to achieve the purpose, the technical scheme is as follows:

in a first aspect, a device connection method is provided. The method is applicable to a first electronic device or a component (such as a chip system) capable of implementing the functions of the first electronic device, and comprises the following steps: and detecting an interaction event, and sending a first message to the second electronic device under the condition that a preset interaction event is detected, wherein the first message is used for indicating the preset interaction event, so that the second electronic device controls the third electronic device to be connected with the first electronic device. And then, interacting the first data with the third electronic equipment through the connection between the third electronic equipment and the third electronic equipment.

According to the technical scheme of the embodiment of the application, after the first electronic device detects the preset interaction event, the first message can be automatically sent to the second electronic device so as to trigger the second electronic device to control the first electronic device to be connected with the third electronic device. Compared with the prior art, in order to connect the first electronic device (such as a mobile phone) with the third electronic device (such as a handle), more operations such as opening a Bluetooth setting interface and clicking a Bluetooth signal are required to be executed.

In one possible design, the third electronic device is connected with the first electronic device through the second electronic device;

interacting first data with a third electronic device through a connection with the third electronic device, including: and interacting the first data with the third electronic equipment through the second electronic equipment.

In this way, the second electronic device forwards the first data from the third electronic device to the first electronic device, and direct connection such as bluetooth connection between the third electronic device and the first electronic device is not required to be established, so that the switching connection can be completed even if the bluetooth switch of the first electronic device is turned off, the third electronic device can be switched and connected without extra operations such as turning on the bluetooth switch of the mobile phone by a user, and the operation complexity of switching connection of the third electronic device is reduced.

In one possible design, the method further includes:

receiving identification information of a third electronic device from the second electronic device;

and analyzing the first data according to the identification information of the third electronic equipment.

In one possible design, a third connection is established between the third electronic device and the first electronic device;

interacting first data with a third electronic device through a connection with the third electronic device, including: and interacting the first data with a third electronic device through a third connection.

In this way, a direct communication connection can be established between the third electronic device and the first electronic device. In this way, after the third electronic device is switched to be connected to the first electronic device, the state of the second electronic device does not affect the control of the third electronic device (such as a handle) on the first electronic device (such as a mobile phone). For example, the second electronic device may turn off the bluetooth, or turn off the second electronic device, without affecting the control of the third electronic device on the first electronic device.

In one possible design, the method further includes: presenting a first interface after a preset interaction event is detected, wherein the first interface is used for prompting whether a third electronic device is connected or not;

sending a first message comprising: and after detecting the first operation instruction, sending a first message, wherein the first operation instruction is an operation instruction for indicating connection of the first electronic equipment.

Through the interface prompting mode, the problem caused by mistaken touch of the user can be reduced.

In one possible design, the method further includes:

after the third electronic equipment is connected, presenting a second interface, wherein the second interface is used for prompting whether to control the third electronic equipment to be connected with the second electronic equipment or not;

and after detecting a second operation instruction, controlling the third electronic device to be connected with the second electronic device, wherein the second operation instruction is an operation instruction for indicating the third electronic device to be connected with the second electronic device.

In some cases, the problem caused by the mistaken touch of the user can be reduced by the interface prompting mode. Or, even if the user does not touch the touch screen by mistake, the user can switch the third electronic device to be connected with the initially connected second electronic device through interface operation.

In one possible design, the first message is further used to indicate a time of the preset interactivity event. The first electronic device sends the first message to enable other devices in the group to determine the time of each interactive event, so that the focus device (i.e. the device which has the preset interactive event) at the corresponding time can be accurately determined according to the timestamp.

In one possible design, the predetermined interaction event is associated with a third electronic device.

Optionally, the association of the preset interaction event with the electronic device (such as a peripheral) means that a device function corresponding to the preset interaction event needs to be assisted by the associated peripheral for input and/or output. Taking the preset interaction event as an example of opening a game application, opening a device function corresponding to a game as a game function, optionally, for better game interaction experience, the device may control game operations on the device by means of a handle. Here, the handle may be referred to as a peripheral device associated with a preset interaction event of opening the game application. Taking opening the document editing application as an example, opening the device function corresponding to the document editing application as a document input function, optionally, in order to improve input efficiency, the device may input text to the device by means of a keyboard. Here, the keyboard may be referred to as a peripheral device associated with a preset interaction event of opening a document editing application.

In one possible design, the method further includes:

and presenting a third interface, wherein the third interface is used for setting the incidence relation between the preset interaction event and the third electronic equipment. By providing a setting entrance for the user, the user can set a personalized association relation according to the self requirement. Therefore, when a preset interaction event occurs to a certain device, the device (such as a mobile phone) can share a third electronic device (such as a peripheral) connected in the network and corresponding to the event, and interaction experience of a user is improved.

In one possible design, the preset interaction event includes any one or more of the following events: the method comprises the steps of presetting a touch event, presetting a voice input event, opening a preset application, opening a preset function of the preset application, lighting a screen, detecting the touch event at a preset position of the screen, inputting a preset gesture by a user, and executing a preset operation by the user through the preset application.

In a second aspect, a device connection method is provided, which is applied in a second electronic device or a system-on-a-chip, and includes: receiving a first message from a first electronic device under the condition that the first electronic device detects a preset interaction event; the first message is used for indicating a preset interaction event; and controlling a third electronic device associated with the preset interaction event to be connected with the first electronic device according to the first message.

In one possible design, controlling a third electronic device associated with a preset interaction event to connect with the first electronic device according to the first message includes:

receiving first data from the third electronic device through the first connection, and sending the first data to the first electronic device through the second connection according to the first message;

or receiving first data from the first electronic device through the second connection, and sending the first data to the third electronic device through the first connection according to the first message;

and the connection between the second electronic equipment and the first electronic equipment is a second connection.

In one possible design, the method further includes:

sending identification information of a third electronic device to the first electronic device; the identification information of the third electronic device is used for the first electronic device to analyze the first data.

and sending a second message to the third electronic equipment according to the first message, wherein the second message is used for indicating the third electronic equipment to establish a third connection with the first electronic equipment.

In one possible design, the method further includes:

sending address information of the first electronic device to a third electronic device; the address information is used for the third electronic device to establish the third connection.

In one possible design, the first message is further used to indicate a time of the preset interactivity event.

In a third aspect, a device connection system is provided, comprising:

the first electronic equipment is used for sending a first message under the condition that a preset interaction event is detected, wherein the first message is used for indicating the preset interaction event;

the second electronic equipment is connected with the third electronic equipment in a first connection mode and used for receiving the first message from the first electronic equipment and controlling the third electronic equipment to be connected with the first electronic equipment according to the first message;

and the third electronic equipment is used for interacting the first data with the first electronic equipment through the connection with the first electronic equipment.

the third electronic device is used for interacting first data with the first electronic device through connection with the first electronic device, and comprises: and interacting the first data with the first electronic equipment through the second electronic equipment.

In one possible design, the second electronic device is configured to control a third electronic device to connect to the first electronic device according to the first message, and the second electronic device includes: receiving first data from the third electronic device through the first connection, and sending the first data to the first electronic device through the second connection according to the first message;

or, receiving first data from the first electronic device through the second connection, and sending the first data to the third electronic device through the first connection according to the first message;

In one possible design, the second electronic device is further configured to send identification information of a third electronic device to the first electronic device;

a first electronic device further to: receiving identification information of a third electronic device from the second electronic device; and analyzing the first data according to the identification information of the third electronic equipment.

In one possible design, the third electronic device is further configured to receive a second message from the second electronic device, where the second message is used to instruct the third electronic device to establish a third connection with the first electronic device;

the third electronic equipment is also used for establishing a third connection according to the second message;

the third electronic device is used for interacting first data with the first electronic device through connection with the first electronic device, and comprises: and interacting the first data with the first electronic device through the third connection.

In one possible design, the second electronic device is configured to control a third electronic device to connect to the first electronic device according to the first message, and the second electronic device includes:

and sending a second message to the third electronic equipment according to the first message.

In one possible design, the second electronic device is further configured to: transmitting address information of the first electronic device to a third electronic device,

a third electronic device configured to establish a third connection according to the second message, including: and the third electronic equipment establishes a third connection according to the address information of the first electronic equipment.

In one possible design, the first electronic device is further configured to: presenting a first interface after a preset interaction event is detected, wherein the first interface is used for prompting whether a third electronic device is connected or not;

In one possible design, the first electronic device is further configured to: after the third electronic equipment is connected, presenting a second interface, wherein the second interface is used for prompting whether to control the third electronic equipment to be connected with the second electronic equipment or not;

In one possible design, the first message is further used to indicate a time of the preset interaction event.

In a possible design, the first electronic device is further configured to present a third interface, and the third interface is configured to set an association relationship between the preset interaction event and the third electronic device.

In a fourth aspect, the present application provides an electronic device having a function of implementing the device connection method in any of the above aspects and any one of the possible implementations. The function can be realized by hardware, and can also be realized by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the functions described above.

In a fifth aspect, the present application provides a computer-readable storage medium, which includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the device connection method according to any one of the above aspects and any one of the possible implementations thereof.

In a sixth aspect, the present application provides a computer program product for causing an electronic device to perform a device connecting method according to any one of the above aspects and any one of their possible implementations when the computer program product is run on the electronic device.

In a seventh aspect, there is provided circuitry comprising processing circuitry configured to perform the device connection method of any of the above aspects and any one of their possible implementations.

In an eighth aspect, an embodiment of the present application provides a chip system, including at least one processor and at least one interface circuit, where the at least one interface circuit is configured to perform a transceiving function and send an instruction to the at least one processor, and when the at least one processor executes the instruction, the at least one processor performs the device connection method according to any of the foregoing aspects and any one of the possible implementations of the foregoing aspects.

Drawings

FIG. 1 is a schematic diagram of a system architecture provided in an embodiment of the present application;

fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 3 is a schematic diagram of a software architecture of an electronic device according to an embodiment of the present application;

fig. 4 is another schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 5 is a schematic view of a scenario to which the device connection method provided in the embodiment of the present application is applied;

fig. 6 and fig. 7 are schematic flow charts of a device connection method according to an embodiment of the present application;

fig. 8-10 are schematic diagrams illustrating scenarios to which the device connection method provided in the embodiment of the present application is applied;

FIG. 11 is a schematic diagram of a set of interfaces provided by an embodiment of the present application;

FIG. 12 is a schematic view of an apparatus provided by an embodiment of the present application;

fig. 13 is a schematic diagram of a chip system according to an embodiment of the present application.

Detailed Description

The embodiment of the application provides a device connection method, which can be applied to a system comprising a plurality of devices. A peripheral may be connected to each of the plurality of devices. Multiple devices may share each other's peripherals. Fig. 1 is a schematic diagram of an exemplary system provided in an embodiment of the present application. Referring to fig. 1, the system includes a plurality of electronic devices (fig. 1 takes electronic devices 101 to 103 as an example) and an electronic device external device (may be simply referred to as a peripheral).

Wherein a plurality of electronic devices can establish a communication connection. Optionally, the manner of establishing the connection between the devices includes, but is not limited to, one or more of the following: the method comprises the steps of establishing communication connection by scanning two-dimensional codes or bar codes, establishing connection by wireless fidelity (Wi-Fi) protocols, bluetooth and other communication protocols, and establishing connection by near field communication service (near service). After the communication connection is established, data transmission can be performed between the devices.

The embodiment of the present application does not limit the way of establishing connection between electronic devices.

Optionally, the electronic device may be a mobile phone, a tablet computer, a desktop, a laptop, a handheld computer, a notebook, a netbook, a Personal Digital Assistant (PDA), a television, and the like, and the embodiment of the present application does not specially limit the specific form of the electronic device. Fig. 1 illustrates an exemplary form of an electronic device, in which the electronic device 101 is a television, the electronic device 102 is a tablet, and the electronic device 103 is a mobile phone, but the form of the electronic device is not limited.

In the embodiment of the application, the electronic device may be connected with a peripheral. The communication connection established between the electronic device and the peripheral device may be a wired connection or a wireless connection, which is not limited herein. The communication protocol used to establish the connection between the electronic device and the peripheral is not limited. Optionally, the communication protocol includes, but is not limited to, the bluetooth protocol.

Optionally, the peripheral devices include, but are not limited to, a handle, a smart pen, a remote controller, an earphone, a speaker, a microphone, a keyboard, and a mouse. Illustratively, a microphone, a keyboard, a handle, etc. may be considered an input device. Headphones may be considered an output device when playing audio and an input device when used as a key. In fig. 1, the handle is used as an example, but this does not limit the external form and structure. The handle is taken as an example, and the handle can be connected with electronic equipment (such as a computer) in a wireless mode. Taking the headset as an example, the wired headset may be connected to the electronic device (e.g., a mobile phone) in a wired manner, and the wireless headset (e.g., a bluetooth headset) may be connected to the electronic device in a wireless manner (e.g., a bluetooth manner).

Optionally, the networked devices may share device-related information with each other. The device-related information includes, but is not limited to, information of a peripheral to which the device is connected, and information of the device. The information of the peripheral includes, but is not limited to, identification information of the peripheral. The information of the device includes, but is not limited to, identification information of the device. Optionally, the identification information of the device includes, but is not limited to, a bluetooth address, an IP address, etc. of the device.

For example, taking a computer and a mobile phone as an example of networking, the mobile phone may send the identifier of the mobile phone to the computer, and the computer may also send the identifier of the computer to the mobile phone. Taking the example that the device is a computer and the connected peripheral is a handle, the computer can send the identifier of the tablet and the mobile phone in the intranet where the computer is located to the handle.

In some scenarios, the external device 104 is currently connected to the electronic device 101, and the user wants to operate the electronic device 103 using the peripheral device 104, then the user needs to manually pair the electronic device 103 with the external device 104. Taking the external device 104 as a handle and the electronic device 103 as a mobile phone as an example, the user controls the handle to enter the pairing mode by an operation such as pressing a "pairing button" on the handle for 5 seconds. After the handle is paired in the mode, a Bluetooth pairing signal is sent. Then, the user unlocks the mobile phone, turns on a Bluetooth switch of the mobile phone, and controls the mobile phone to search the Bluetooth pairing signal of the handle. After the mobile phone searches the bluetooth pairing signal of the handle, the user needs to input the pairing code of the bluetooth. Therefore, in order to establish connection between the handle and the mobile phone, a user needs to manually perform a plurality of operations, which consumes a long time and has low connection efficiency.

In order to improve the connection efficiency between the electronic equipment and the peripheral equipment and reduce the operation complexity of a user. The embodiment of the application provides a device connection method, which can be applied to the system shown in fig. 1. Taking an electronic device as a mobile phone as an example, please refer to fig. 2, which is a schematic structural diagram of an exemplary mobile phone provided in an embodiment of the present application. As shown in fig. 2, the electronic device 103 may include: a processor, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a Subscriber Identity Module (SIM) card interface 195.

The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and other sensors.

It is to be understood that the illustrated structure of the embodiment of the present invention does not specifically limit the electronic device 103. In other embodiments of the present application, the electronic device 103 may include more or fewer components than shown, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor may include one or more processing units, such as: the processor may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. Wherein, the different processing units may be independent devices or may be integrated in one or more processors.

Wherein the controller may be a neural center and a command center of the electronic device 103. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in the processor for storing instructions and data. In some embodiments, the memory in the processor is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor. If the processor needs to reuse the instruction or data, it can be called directly from memory. Avoiding repeated accesses reduces the latency of the processor and thus increases the efficiency of the system.

In some embodiments, a processor may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

It should be understood that the connection relationship between the modules according to the embodiment of the present invention is only illustrative, and is not limited to the structure of the electronic device 103. In other embodiments of the present application, the electronic device 103 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The charging management module 140 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 103. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In other embodiments, the power management module 141 may be disposed in the processor. In other embodiments, the power management module 141 and the charging management module 140 may be disposed in the same device.

The wireless communication function of the electronic device 103 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, the baseband processor, and the like.

The

antennas

1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 103 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied on the electronic device 103. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in a processor. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be separate from the processor and may be disposed in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 may provide solutions for wireless communication applied to the electronic device 103, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), global Navigation Satellite System (GNSS), frequency Modulation (FM), near Field Communication (NFC), infrared (IR), and the like.

The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor.

The wireless communication module 160 may also receive a signal to be transmitted from the processor, frequency-modulate and amplify the signal, and convert the signal into electromagnetic waves via the antenna 2 to radiate the electromagnetic waves.

In some embodiments, antenna 1 of electronic device 103 is coupled to mobile communication module 150 and antenna 2 is coupled to wireless communication module 160 so that electronic device 103 can communicate with networks and other devices through wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), general Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. GNSS may include Global Positioning System (GPS), global navigation satellite system (GLONASS), beidou satellite navigation system (BDS), quasi-zenith satellite system (QZSS), and/or Satellite Based Augmentation System (SBAS).

The electronic device 103 implements display functions via the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the electronic device 103 may include 1 or N display screens 194, N being a positive integer greater than 1.

The electronic device 103 may implement a shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, the application processor, and the like.

The ISP is used to process the data fed back by the camera 193. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the electronic device 103 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the electronic device 103 selects a frequency bin, the digital signal processor is used to perform fourier transform or the like on the frequency bin energy.

Video codecs are used to compress or decompress digital video. The electronic device 103 may support one or more video codecs. In this way, the electronic device 103 may play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. The NPU can implement applications such as intelligent recognition of the electronic device 103, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the storage capability of the electronic device 103. The external memory card communicates with the processor through the external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are saved in an external memory card.

The internal memory 121 may be used to store computer-executable program code, which includes instructions. The processor executes various functional applications of the electronic device 103 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, phone book, etc.) created during use of the electronic device 103, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

In some embodiments of the present application, the memory may store identification information of the electronic device 103. Such as a bluetooth address that can be used to uniquely identify the electronic device 103. In addition, the memory may also store connection data with an electronic device that has been successfully paired before the electronic device 103. For example, the connection data may be a bluetooth address of an electronic device that has successfully paired with the electronic device 103. Based on the connection data, the electronic device 103 can be automatically paired with the electronic device without having to configure a connection therewith, such as for validity verification or the like. The bluetooth address may be a Media Access Control (MAC) address.

The electronic device 103 may implement audio functions via the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor, or some functional modules of the audio module 170 may be disposed in the processor.

The speaker 170A, also called a "horn", is used to convert the audio electrical signal into a sound signal. The electronic device 103 can listen to music through the speaker 170A or listen to a hands-free call.

The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the electronic device 103 answers a call or voice information, it can answer the voice by placing the receiver 170B close to the ear of the person.

The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal to the microphone 170C by speaking near the microphone 170C through the mouth. The electronic device 103 may be provided with at least one microphone 170C. In other embodiments, the electronic device 103 may be provided with two microphones 170C to achieve a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 103 may further include three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, perform directional recording, and the like.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be the USB interface 130, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used for sensing a pressure signal, and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A can be of a wide variety, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 103 determines the intensity of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic apparatus 103 detects the intensity of the touch operation from the pressure sensor 180A. The electronic device 103 may also calculate the touched position from the detection signal of the pressure sensor 180A. In some embodiments, the touch operations that are applied to the same touch position but different touch operation intensities may correspond to different operation instructions. For example: and when the touch operation with the touch operation intensity smaller than the pressure threshold value acts on the short message application icon, executing an instruction for viewing the short message. And when the touch operation with the touch operation intensity larger than or equal to the pressure threshold value acts on the short message application icon, executing an instruction of newly building the short message.

The gyro sensor 180B may be used to determine the motion attitude of the electronic device 103. In some embodiments, the angular velocity of the electronic device 103 about three axes (i.e., x, y, and z axes) may be determined by the gyroscope sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. Illustratively, when the shutter is pressed, the gyro sensor 180B detects the shake angle of the electronic device 103, calculates the distance to be compensated for by the lens module according to the shake angle, and allows the lens to counteract the shake of the electronic device 103 through a reverse movement, thereby achieving anti-shake. The gyroscope sensor 180B may also be used for navigation, somatosensory gaming scenes.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 103 calculates altitude, aiding in positioning and navigation, from barometric pressure values measured by the barometric pressure sensor 180C.

The magnetic sensor 180D includes a hall sensor. The electronic device 103 may detect the opening and closing of the flip holster using the magnetic sensor 180D. In some embodiments, when the electronic device 103 is a flip phone, the electronic device 103 may detect the opening and closing of the flip according to the magnetic sensor 180D. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.

The acceleration sensor 180E can detect the magnitude of acceleration of the electronic device 103 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the electronic device 103 is stationary. The method can also be used for identifying the posture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and the like.

A distance sensor 180F for measuring a distance. The electronic device 103 may measure the distance by infrared or laser. In some embodiments, such as in filming a scene, the electronic device 103 may utilize the distance sensor 180F to range to achieve fast focus.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 103 emits infrared light to the outside through the light emitting diode. The electronic device 103 detects infrared reflected light from a nearby object using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 103. When insufficient reflected light is detected, the electronic device 103 may determine that there are no objects near the electronic device 103. The electronic device 103 can utilize the proximity light sensor 180G to detect that the user holds the electronic device 103 close to the ear for talking, so as to automatically turn off the screen to achieve the purpose of saving power. The proximity light sensor 180G may also be used in a holster mode, a pocket mode automatically unlocks and locks the screen.

The ambient light sensor 180L is used to sense the ambient light level. The electronic device 103 may adaptively adjust the brightness of the display screen 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust the white balance when taking a picture. The ambient light sensor 180L may also cooperate with the proximity light sensor 180G to detect whether the electronic device 103 is in a pocket to prevent inadvertent contact.

The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 103 can utilize the collected fingerprint characteristics to unlock the fingerprint, access the application lock, photograph the fingerprint, answer an incoming call with the fingerprint, and so on.

The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 103 implements a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 103 performs a reduction in performance of a processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, the electronic device 103 heats the battery 142 when the temperature is below another threshold to avoid an abnormal shutdown of the electronic device 103 due to low temperatures. In other embodiments, the electronic device 103 performs a boost on the output voltage of the battery 142 when the temperature is below a further threshold to avoid an abnormal shutdown due to low temperature.

The touch sensor 180K is also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation applied thereto or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided via the display screen 194. In other embodiments, the touch sensor 180K may be disposed on the surface of the electronic device 103 at a different position than the display screen 194.

The bone conduction sensor 180M can acquire a vibration signal. In some embodiments, the bone conduction sensor 180M may acquire a vibration signal of the human vocal part vibrating the bone mass. The bone conduction sensor 180M may also contact the human pulse to receive the blood pressure pulsation signal. In some embodiments, the bone conduction sensor 180M may also be disposed in a headset, integrated into a bone conduction headset. The audio module 170 may analyze a voice signal based on the vibration signal of the bone mass vibrated by the sound part acquired by the bone conduction sensor 180M, so as to implement a voice function. The application processor can analyze heart rate information based on the blood pressure beating signals acquired by the bone conduction sensor 180M, and the heart rate detection function is realized.

The keys 190 include a power-on key, a volume key, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The electronic device 103 may receive a key input, and generate a key signal input related to user settings and function control of the electronic device 103.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration cues, as well as for touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also respond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be brought into and out of contact with the electronic device 103 by being inserted into the SIM card interface 195 or being pulled out of the SIM card interface 195. The electronic device 103 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support a Nano SIM card, a Micro SIM card, a SIM card, etc. The same SIM card interface 195 can be inserted with multiple cards at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 may also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The electronic device 103 interacts with the network through the SIM card to implement functions such as communication and data communication. In some embodiments, the electronic device 103 employs esims, namely: an embedded SIM card. The eSIM card can be embedded in the electronic device 103 and cannot be separated from the electronic device 103.

The software system of the electronic device 103 may employ a hierarchical architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the present application, a layered system architecture (such as an android or hong meng system) is taken as an example to exemplarily illustrate a software structure of the electronic device 103.

Fig. 3 is a block diagram of a software structure of the electronic device 103 according to an embodiment of the present disclosure. The layered architecture can divide the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the layered system may include three layers, which are an application layer (referred to as an application layer), an application framework layer (referred to as a framework layer), and a kernel layer (also referred to as a driver layer) from top to bottom.

Wherein the application layer may comprise a series of application packages. For example, the application package may be a camera, gallery, calendar, phone call, map, navigation, WLAN, bluetooth, music, video, short message, and desktop Launcher (Launcher) application. In an embodiment of the application, the application program comprises an application related to a preset interaction event, such as a game, a text application.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions. As shown in fig. 3, the framework layer may include a Window Manager (WMS), an Activity Manager (AMS), and the like. Optionally, the framework layer may further include a content provider, a view (view) system, a phone manager, a resource manager, a notification manager, etc. (not shown in the drawings).

In embodiments of the present application, the framework layer may receive the interaction event from the kernel layer.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver. The kernel layer is a layer between hardware and software. The kernel layer may include display drivers, input/output device drivers (e.g., keyboard, touch screen, headphones, speakers, microphone, handle, etc.), camera drivers, audio drivers, and sensor drivers, among others.

In this embodiment, an HID file may be created for an HID device at a kernel layer according to a device identifier of a Human Interface Device (HID). The system can analyze the interactive event according to the HID file and transmit the interactive event to the framework layer for processing.

The above-mentioned fig. 3 is only one possible example of the software architecture of the electronic device 103, and does not constitute a limitation on the software architecture of the electronic device 103. It is understood that the software architecture of the electronic device 103 may be other as well. For example, in a layered software architecture, the software architecture may be further divided into more or fewer layers, and the specific functions of each layer are not limited.

For example, the electronic device 103 is only used to illustrate the hardware and software structure of the electronic device in the embodiment of the present application, but the structure and form of the electronic device are not limited. The embodiment of the present application does not limit the structure and form of the electronic device. Illustratively, FIG. 4 shows another exemplary configuration of an electronic device. As shown in fig. 4, the electronic apparatus includes: a processor 501, a memory 502, and a transceiver 503. The processor 501 and the memory 502 can be realized by referring to the processor and the memory of the electronic device 103. A transceiver 503 for the electronic device to interact with other devices, such as the electronic device 101. The transceiver 503 may be a device based on a communication protocol such as Wi-Fi, bluetooth, or others.

In other embodiments of the present application, an electronic device may include more or fewer components than shown, or some components may be combined, some components may be split, some components may be replaced, or a different arrangement of components may be used. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The technical scheme of the embodiment of the application can be applied to a networking system needing to switch the connection relation of the peripheral equipment, and is explained mainly by taking the case that the networking system comprises a mobile phone, a tablet and a notebook computer and the handle is initially connected with the computer as an example. The technical solution of the embodiment of the present application can be applied to various scenes, and here, a game scene is first described as an example.

Exemplarily, as shown in (1) of fig. 5, a connection is established between a tablet, a computer, and a mobile phone, and a connection is established between the computer and the handle. Wherein an application game 1 is run on the computer. The user can operate the game 1 on the computer through the handle. Then, as shown in fig. 5 (2), the user opens the application game 2 on the mobile phone, and after detecting the operation of opening the game 2 by the user, the mobile phone may send information of an event (referred to as event 1) of opening the game 2 on the mobile phone to a tablet and a computer in the networking.

In some embodiments, after receiving the event 1 message (i.e., the game application has been opened on the mobile phone), the computer may deduce that the mobile phone is likely to need to connect the handle, so as to more conveniently control and operate the game on the mobile phone. Then, the computer can be used as a relay role, the handle event is forwarded to the mobile phone, and the mobile phone responds to the handle event to execute corresponding operation, so that the handle can communicate with the mobile phone through the computer and control and operate the game on the mobile phone. For example, when a user presses a key on the handle, the handle sends information of a key pressing event to the computer, and the computer forwards the information of the key pressing event to the mobile phone, so that the mobile phone can perform a corresponding operation (such as changing the advancing direction of a game character) according to the information of the key pressing event. Optionally, the key press event carries a key identifier pressed by the user.

Optionally, the computer may no longer respond to the handle event after receiving the information of event 1. For example, when the user presses a key on the handle, the handle sends information of the key pressing event to the computer, and the computer no longer performs a corresponding operation (such as changing the advancing direction of the game character) according to the information of the key pressing event.

In other embodiments, after receiving the event 1 message (i.e., the game application has been opened on the mobile phone), the computer may deduce that the mobile phone is likely to need to connect the handle, so as to more conveniently control and operate the game on the mobile phone. Then, the computer can send indication information to the handle, and the indication handle is communicated with the mobile phone according to the identification information of the mobile phone. Taking the identification information of the mobile phone as the bluetooth address as an example, after knowing that the game application is opened on the mobile phone, the computer 1 can send indication information to the handle, and the indication handle is connected with the mobile phone in a matching way according to the bluetooth address of the mobile phone. Thus, after the bluetooth connection is established, the handle can communicate directly with the handset. After the handle generates a key pressing event, the information of the key pressing event can be directly sent to the mobile phone, and the mobile phone can execute corresponding operation according to the key pressing information.

It should be noted that the thick solid line between the mobile phone and the handle shown in (2) of fig. 5 may represent a path for the handle to forward a handle event (such as a key pressing event) to the mobile phone through the computer, or may represent a path for the handle to directly send the handle event to the mobile phone.

Alternatively, as shown in (3) of fig. 5, the user may also open a game application on a tablet within the networking. After detecting an event (event 2 for short) that a game application is opened on the tablet, the tablet can send information of the event 2 to a computer and a mobile phone in a networking. The computer can send instruction information to the handle based on the information of event 2 so as to instruct the handle to establish connection with the tablet. Therefore, the handle can be connected with the tablet according to the indication information, the handle can interact data (such as handle event sending) with the tablet through the connection, and then game operation on the tablet can be controlled through the handle. Alternatively, after receiving the information of the event 2, the computer may monitor the handle event based on the information of the event 2 and forward the handle event to the tablet, and the tablet may control the operation of the tablet, such as controlling the game operation, based on the handle event.

The event of opening the game application described above may be referred to as a preset interaction event. The device generating the preset interaction event may be referred to as a focus device. For example, in the scenario shown in (1) of fig. 5, the user opens the game application on the computer, and the computer may be referred to as a focus device. In the scenario shown in (2) of fig. 5, the user opens the game application on the mobile phone, and the mobile phone may be referred to as a focus device. In the scenario shown in (3) of fig. 5, the user opens the game application on the tablet, and the tablet may be referred to as a focus device. Optionally, the number of the focus devices in the networking may be one or more at the same time.

It can be seen that the focal point device may change at different times, in different scenarios. In the embodiment of the present application, when the focus device is changed and the focus device is not connected to the target peripheral device, a device currently connected to the target peripheral device (a connected non-focus device for short) may automatically control the target peripheral device to be connected to the focus device, so that the focus device can use the target peripheral device to complete a function corresponding to a preset interaction event. That is to say, according to the technical solution of the embodiment of the present application, the focus device may be detected according to the preset interaction event, and the target peripheral device required by the focus device may be automatically controlled to switch to be connected to the focus device. Taking a game scene as an example, the user can directly control the game on the mobile phone without additional handle pairing actions (such as inputting a bluetooth code), thereby reducing complex interaction steps.

Taking the first electronic device as a mobile phone, the second electronic device as a notebook computer, and the third electronic device as a handle as an example, initially, a first connection is established between the notebook computer and the handle, and subsequently, the mobile phone needs to be connected to the handle, and the notebook computer can control the handle to switch the connection, that is, the handle is controlled to be connected to the mobile phone. The notebook computer controls the connection of the mobile phone and the handle, and at least two modes can be provided. The first way is to establish a direct connection (third connection) between the notebook computer control handle and the mobile phone. And the handle and the mobile phone are connected through a third connection to exchange data. The second mode is that the handle and the mobile phone are not directly connected through communication, the handle is connected with the mobile phone through a computer, and the handle interacts data with the mobile phone through the computer. Namely, the computer is used as the transfer equipment between the handle and the mobile phone.

These two connection switching modes are described separately as follows. For the second connection switching manner, referring to fig. 6, the process of switching the connection by the handle includes:

s101, connection (namely first connection) is established between the notebook computer and the mobile phone.

According to the embodiment of the application, connection can be established among a plurality of devices. Illustratively, taking the example that a notebook computer and a mobile phone perform networking in a "neighbor service" manner, the notebook computer may obtain an IP address of the mobile phone through the "neighbor service", and the mobile phone may obtain the IP address of the notebook computer through the "neighbor service"; then, the notebook computer and the mobile phone create a socket connection according to the respective acquired IP addresses. Then, the notebook computer and the mobile phone can transmit interactive data through the socket between the notebook computer and the mobile phone.

S102, the notebook computer is connected with the handle.

The process of establishing the connection between the notebook computer and the handle can be referred to in the prior art, and is not described herein again. After the notebook computer is connected with the handle, data can be interacted between the handle and the notebook computer.

Taking the example of (1) in fig. 5, in the initial scene, the notebook computer, the tablet and the mobile phone are networked, and the notebook computer is connected with a peripheral device, i.e., a handle, so that the user can perform game operations on the notebook computer by operating the handle.

S103, the notebook computer monitors the interaction event.

Wherein the interaction event comprises an input event and/or an output event. Input events include, but are not limited to, any one or more of the following: mouse events, handle events, keyboard events, touch events. Output events include, but are not limited to, playing audio, playing video, and the like.

As a possible implementation, the notebook computer monitors the interaction events through the interface of the system. For example, with

System for example, notebook computer calling

The interface monitors mouse events and calls

The interface listens for handle events. Taking listening for mouse events as an example, the interface may create a window to use to listen for mouse events. Optionally, the window for listening for the interactive event may be a hidden window, i.e. the window is not visible to the user.

And S104, the mobile phone monitors the interaction event.

As a possible implementation, the mobile phone may call a system interface to monitor the interaction event.

S105, the mobile phone monitors an event (an example of a preset interaction event) for opening the game application and sends a first message to the notebook computer.

Correspondingly, the notebook computer receives the first message from the mobile phone.

Optionally, the first message is used to indicate a preset interaction event. In the embodiments of the present application, reference to a message for a certain purpose means that the message can be used for the purpose, but it is not intended that the message is a dedicated message dedicated to the purpose. The message may be a dedicated message or a generic message. The message may also serve other purposes and/or the message may include other content.

Optionally, the first message is a general message and can be used for requesting connection with the handle by the mobile phone.

Optionally, the first message is a dedicated message and may carry an identifier of the handle. The receiving party can know that the first message is a message for requesting to be connected with a certain peripheral equipment after receiving the special message, and can determine that the sending party requests to be connected with the handle according to the handle identification carried by the first message.

In some embodiments, devices within a network group may share peripheral information that is connected to each other. Specifically, each device broadcasts information of its connected peripheral to other devices within the network. And, when the peripheral device to which the device is connected changes, it may broadcast the latest peripheral connection situation to other devices within the web. In this way, each device in the group network can sense the information of all the peripherals connected in the group network and the devices connected with the corresponding peripherals.

Illustratively, table 1 shows peripherals to which the devices within the networking are respectively connected.

TABLE 1

Devices within a group network	Connected peripheral
		Notebook computer	Handle (CN)
Mobile phone	Is free of
		Flat plate	Is free of

It can be understood that in the embodiment of the present application, a preset interaction event of a device may be set (flexibly set). Optionally, the preset interaction event is associated with one or more peripherals. The association means that the device function corresponding to the preset interaction event needs the associated peripheral to assist in inputting and/or outputting. Taking the preset interaction event as an example of opening a game application, and opening a device function corresponding to a game as a game function, optionally, for better game interaction experience, the device may control game operations on the device by means of a handle. Here, the handle may be referred to as a peripheral associated with a preset interaction event of opening the game application. Taking opening the document editing application as an example, opening the device function corresponding to the document editing application as a document input function, optionally, in order to improve input efficiency, the device may input text to the device by means of a keyboard. Here, the keyboard may be referred to as a peripheral device associated with a preset interaction event of opening the document editing application.

In the embodiment of the application, when the device monitors the preset interaction event of the device, it is determined that the device needs to use the target peripheral corresponding to the preset interaction event. In this case, if the device is not connected to the desired target peripheral, the device may request the device connected to the target peripheral to use the target peripheral. Taking the example of (2) in fig. 5, the user opens the game application on the mobile phone, and after the mobile phone detects the preset interaction event that the user opens the game application, the peripheral device corresponding to the game function can be determined as the handle, and the device currently connected to the handle can be queried as the notebook computer. Then, the mobile phone can request the notebook computer to use the handle, so that the subsequent game operation on the mobile phone is controlled by using the handle.

S106, the notebook computer sends the identification information of the handle to the mobile phone.

Accordingly, the mobile phone receives the identification information of the handle from the notebook computer. The identification information of the handle may be used to resolve a handle event of the handle. As a possible implementation mode, the mobile phone creates an HID file according to the identification information of the handle, and analyzes the handle event of the handle according to the HID file.

Optionally, the identification information of the peripheral may be an HID device descriptor. Wherein device descriptors can be used to distinguish between different peripherals. For example, to distinguish between the identities, vendors, types, etc. of the different peripherals. Illustratively, the HID device descriptor is distinguishable

A handle,

The handle and other game handles can also distinguish whether the peripheral equipment is a keyboard, a mouse or the handle and the like.

Illustratively, the laptop sends the HID identifier of the connected handle to the cell phone via a socket connection.

S107, the mobile phone creates the HID file of the handle according to the HID descriptor of the handle.

Among other things, the HID file includes, but is not limited to, an HID report.

In the embodiment of the application, considering that the handle does not establish a direct communication connection with the mobile phone, in order to enable the mobile phone to identify the handle event, an HID file of the handle may be created in, for example, a kernel layer, and then, the mobile phone may identify the handle event according to the HID file. The HID file is created for the handle in the kernel layer, and a virtual handle (an object generated by a subsequent handle event) can be created in the kernel layer, and a subsequent mobile phone can recognize the event of the virtual handle.

Optionally, after the HID file of the handle is successfully created in the kernel layer, the system may notify the application layer that the HID file is successfully created, and then the application notifies the notebook computer, so that the notebook computer may know that the handle is connected to the mobile phone. Then, the notebook computer intercepts the handle event, which means that the handle event cannot be transmitted to the game of the computer but is transmitted to the game of the mobile phone.

In step S107, the step

The HID file is created for recognizing the input event in the system for example, and in other systems, the mobile phone may perform other operations to recognize the input event such as the handle.

S108, the notebook computer receives information (an example of the first data) of the handle event through the first connection.

Illustratively, as shown in (2) of fig. 5, when a user presses a button 1 of a handle, the handle sends information of a handle event to a notebook computer through a first connection, and the notebook computer can monitor the information of the handle event from the handle through an interface.

And S109, the notebook computer sends the handle event information to the mobile phone according to the first message.

Optionally, the notebook computer sends the handle event information to the mobile phone through a second connection with the mobile phone.

Illustratively, the notebook computer encapsulates the handle event into a transmittable format and sends information of the handle event to the handset via a socket connection with the handset.

Optionally, the window for monitoring the interaction event is set to focus, so that the game window on the computer loses focus accordingly and no longer responds to the handle event.

And S110, the mobile phone analyzes the handle event according to the HID file of the handle and executes the operation corresponding to the handle event.

As a possible implementation manner, the mobile phone parses the handle event according to the HID file of the handle, and can report the parsed handle event to the game application of the application layer through the framework layer, and the game application can respond to the handle event to execute a corresponding operation. For example, as shown in (2) of fig. 5, when the user presses the key 1, the handle may forward a handle event corresponding to the pressing of the key 1 through the notebook computer, and the mobile phone may perform an operation corresponding to the pressing of the key 1 based on the handle event (e.g., control the game character to move left).

The embodiment of the application does not limit the time for creating the HID file. The mobile phone can create the HID file of the handle immediately after receiving the HID descriptor of the handle, or create the HID file after a preset period.

In addition, in S110, the handle event is analyzed according to the HID file in the linux system, and a corresponding operation is performed, for example, in other systems, the handle event may be analyzed in other manners. The embodiments of the present application do not limit the way the handle event is resolved.

In the embodiment corresponding to fig. 6, an event of opening the game application is detected on the mobile phone, which means that the mobile phone needs to use the handle to assist in operating the game. In this case, the mobile phone may request the notebook computer connected to the handle to use the handle, and then the notebook computer may forward the handle event to the mobile phone after monitoring the handle event. Therefore, the mobile phone can receive the handle event and can respond to the handle event to execute corresponding operation, and the control of the handle on the game of the mobile phone is realized.

It can be seen that in the embodiment corresponding to fig. 6, before the connection is switched by the handle, the communication connection is established between the handle and the computer. The computer can monitor the handle event and execute the operation corresponding to the handle event. And after the handle is switched to be connected, the handle is connected with the mobile phone. Wherein, communication connection still exists between the handle and the computer, and the computer can still monitor handle events. However, the computer no longer responds to the handle event, that is, the operation corresponding to the handle event is no longer executed, and the computer forwards the monitored handle event to the mobile phone, and the mobile phone responds to the handle event to execute the corresponding operation. According to the analysis, after the handle is switched and connected, the handle is connected with the mobile phone through the computer. The connection between the handle and the handset may be referred to as an indirect connection.

In the embodiment corresponding to fig. 6, the handle instruction is transmitted to the mobile phone through the notebook computer (which may be referred to as a relay device), and the direct bluetooth connection between the handle and the mobile phone is not required to be established, so that the switching control can be completed even if the bluetooth switch of the mobile phone is turned off, and the handle can be switched and connected without additional operations such as turning on the bluetooth switch of the mobile phone by a user, thereby reducing the operation complexity of switching and connecting the handle.

On the other hand, the relay device can send a handle instruction to a plurality of focus devices, so that the effect of simultaneously controlling a plurality of focus devices by one handle can be achieved.

In this embodiment, the handle may be connected to the mobile phone, and the mobile phone may directly monitor the handle event without using the notebook computer as a forwarding device for the handle event. Still taking the scenes shown in (1) and (2) of fig. 5 as an example, referring to fig. 7, the device connection method provided in this embodiment includes:

s201, establishing a second connection between the notebook computer and the mobile phone.

Taking the case that the notebook computer and the mobile phone establish connection through the bluetooth protocol as an example, the notebook computer and the mobile phone can acquire the bluetooth address of the opposite device based on the bluetooth protocol, and establish connection with the opposite device based on the bluetooth address of the opposite device.

S202, the notebook computer and the handle are connected in a first connection mode.

S203, the notebook computer sends the Bluetooth address of the mobile phone to the handle.

In this embodiment, the device may acquire address information of other devices in the network, where the address information includes, but is not limited to, an IP address, a bluetooth address, and the like. The device may send address information of the other device to the peripheral to which it is connected, and the peripheral may establish a connection with the other device based on the address information of the other device. In the embodiment corresponding to fig. 7, the example that the notebook computer sends the bluetooth address of the mobile phone to the connected handle, and the subsequent handle establishes connection with the mobile phone based on the bluetooth address of the mobile phone is taken as an example for explanation, in this embodiment, the type of the address information of the device is not limited, and the specific implementation of establishing connection between the peripheral and the device based on the address information of the device is not limited.

Optionally, after receiving the bluetooth address of the mobile phone from the notebook computer, the handle may record the bluetooth address of the mobile phone.

And S204, the notebook computer monitors the handle event.

S205, responding to the monitored handle event, and executing the operation corresponding to the handle event by the notebook computer.

For example, as shown in (1) of fig. 5, in a normal case, the handle is connected to a notebook computer, and when a game is run on the notebook computer, the notebook computer may perform an operation corresponding to the handle event (for example, perform an operation in which a game character moves forward in the game interface) after monitoring the handle event.

S206, the mobile phone monitors a preset interaction event for opening the game application.

S207, in response to the preset interaction event of opening the game application, the mobile phone sends a first message to the notebook computer.

Optionally, the first message is for requesting connection to the handle. The first message may also be used to request use of the handle.

And S208, the notebook computer sends a second message to the handle according to the first message.

Accordingly, the handle receives a second message from the notebook computer.

Optionally, the second message is used to instruct the handle to establish a third connection with the handset.

As a possible implementation manner, after receiving the request from the mobile phone to use the handle, the notebook computer may determine that the mobile phone needs to be connected to the handle according to the first message, and then the notebook computer may send a second message to the handle according to the first message, so as to instruct the handle to establish connection with the mobile phone based on the bluetooth address of the mobile phone. Optionally, after the notebook computer sends the second message to the handle, the notebook computer may disconnect the connection with the handle. For example, as shown in (2) of fig. 5, after the mobile phone detects the event of opening the game application, the mobile phone may request the notebook computer to use the handle, and the notebook computer may instruct the handle to establish a connection with the mobile phone through a second message, so that the handle interacts data with the mobile phone through the connection.

And S209, the handle establishes a third connection with the mobile phone according to the second message.

As a possible implementation, the handle establishes the third connection with the mobile phone based on the bluetooth address of the mobile phone. Optionally, the bluetooth address of the mobile phone may be carried in the second message, or may be carried in another message besides the second message.

S210, the mobile phone receives information (first data) of the handle event from the handle through the third connection.

It can be understood that after the third connection is established between the mobile phone and the handle, the handle can send the information of the handle event to the mobile phone through the third connection.

And S211, responding to the monitored handle event, and executing the operation corresponding to the handle event.

In the embodiment corresponding to fig. 7, a direct communication connection can be established between the handle and the focus device (mobile phone). Therefore, after the handle is switched and connected to the mobile phone, the equipment state of the notebook computer does not influence the control of the handle on the mobile phone. For example, the notebook computer can be turned off or turned off, and the control of the handle on the mobile phone is not affected.

It should be noted that the steps in the above method flow are only exemplary. Some of the steps may be replaced with other steps, or portions of steps may be added or subtracted.

Some operations in the flows of the above-described method embodiments are optionally combined, and/or the order of some operations is optionally changed.

The execution order between the steps of each flow is only exemplary, and does not limit the execution order between the steps, and other execution orders between the steps may be possible. And is not intended to imply that the order of execution is the only order in which the operations may be performed. One of ordinary skill in the art will recognize a variety of ways to reorder the operations herein. Further, it should be noted that for a certain method, the details of other processes herein in connection with other methods herein also apply in a similar manner to the above in connection with the method.

Further illustratively, in some embodiments, a device in a network may not only listen for its input/output event, but may also broadcast the input/output event to other devices in the network. Therefore, each device in the networking can monitor the input and output events of the device, can sense the input and output events of other devices, and judges whether the other devices need to use corresponding peripheral equipment according to the input and output events of the other devices.

Still taking fig. 6 as an example, after the mobile phone monitors the event of opening the game application, the event may be broadcasted to the notebook computer and the tablet in the networking. The notebook computer can determine that the mobile phone needs to use the handle connected with the notebook computer according to the event. Then, after subsequently monitoring the handle event, the notebook computer can forward the handle event to the mobile phone. That is, step S105 of fig. 6 may be replaced with: the mobile phone sends an event for opening the game application to the notebook computer. Similarly, step S207 in fig. 7 may be replaced with: the mobile phone sends an event for opening the game application to the notebook computer.

Optionally, the device broadcasts its own interaction event, and may also carry a timestamp of the event in the broadcast message. In this way, other devices within the group can determine the time at which each interaction event occurred so as to accurately determine the focal device for the corresponding time based on the timestamp.

Illustratively, table 2 shows one possible structure of each device broadcast message.

TABLE 2

It should also be noted that, in the embodiments of the present application, specific steps included in the method flow and the execution sequence between the steps are not limited. For example, step S203 may be performed before S207 or after S207, or simultaneously with S207. S207-S211 may be performed before S205 or after S205.

In order to reduce the probability of false switching, after the mobile phone (focus device) monitors an event (preset interaction event) for opening a game application, the mobile phone (focus device) may also inquire whether a user connects a handle (target peripheral device), and after detecting that the user indicates an operation for connecting the handle, the mobile phone requests a notebook computer connected with the handle to use the handle. That is, optionally, step S301 may be added to the flow shown in fig. 6, and the mobile phone presents a prompt interface, where the prompt interface is used to prompt whether to connect the handle. Also, step S105 shown in fig. 6 may be replaced with: s302, after detecting that the user indicates the operation of connecting the handle, requesting the notebook computer to use the handle. Or, optionally, step S401 may be added to the flow shown in fig. 7, and the mobile phone presents a prompt interface, where the prompt interface is used to prompt whether to connect the handle. Also, step S207 shown in fig. 7 may be replaced with: s402, after detecting the event of opening the game application and detecting the operation of the user indicating the connection handle, requesting the notebook computer to use the handle.

Illustratively, in the networking shown in (1) of fig. 8, the handle is connected to a notebook computer. After the mobile phone monitors an event (preset interaction event) of opening game 3, an interface 801 (one example of a first interface) is presented to prompt the user whether to connect a handle. If an operation instruction (an example of a first operation instruction) of the user such as clicking a "yes" button is detected, the cellular phone sends a first message to the notebook computer to request connection to use the handle. In one scheme, the notebook computer can forward the handle event to the mobile phone, and this scheme can be regarded as that the handle is connected with the mobile phone through the notebook computer, which can be called as an indirect connection between the handle and the mobile phone. In another arrangement, the laptop computer may instruct the handle to establish a connection with the handset, which may be referred to as a direct connection between the handle and the handset. The connection between the handle and the handset is shown as (2) of fig. 8. The connection may be a direct connection between the handle and the handset, or an indirect connection.

The embodiment of the application also provides another equipment connection method, and in the method, the method can provide switching protection and reduce the probability of false switching. As a possible implementation manner, after the handle (target peripheral) is successfully connected to the mobile phone (focus device), the mobile phone may display a prompt interface for prompting the user that the handle is connected to the mobile phone. Optionally, the notebook computer connected before the handle is switched to connect can also display a prompt interface. The prompt interface may further include a retraction control for the handle to resume a previous connection relationship. Taking fig. 6 as an example, the handle is restored to the connection with the notebook computer. Optionally, the connection relationship between the handle and the notebook computer may be maintained until the notebook computer opens a new application, or the notebook computer locks the screen, or a new focus device is generated.

It should be noted that, the disconnection between the handle and the mobile phone means that the mobile phone no longer responds to the handle event and executes the operation corresponding to the handle event. The handle restores the connection relation with the notebook computer before, which means that the notebook computer can respond to the handle event and execute the operation corresponding to the handle event.

Illustratively, in the networking shown in (1) of fig. 9, the handle is connected to a notebook computer. After the mobile phone monitors the event of opening the game 3, the mobile phone can request the notebook computer to establish connection with the handle. As shown in (2) of fig. 9, the handset has established a connection with the handle. Optionally, the handset displays an interface 901 (an example of a second interface) to prompt the user that the handle is connected to the handset. Optionally, the interface includes a withdrawal control 902 for prompting whether to connect the control handle to the notebook computer, i.e. prompting whether to restore the previous connection relationship between the control handle and the notebook computer. Optionally, a computer display interface 903.

In some examples, if a scheme of forwarding the handle event by means of a laptop computer such as that shown in fig. 6 is adopted, in the scenario shown in (2) of fig. 9, when the mobile phone detects an operation instruction (one example of a second operation instruction) of the user such as clicking the withdrawal control 902, the mobile phone may control the handle to connect with the mobile phone. The process of connecting the control handle of the mobile phone with the computer can be referred to as the process of connecting the control handle of the computer with the mobile phone. That is, the handset may instruct the handle to resume direct communication with the computer. Or the handle does not restore the direct communication connection with the computer, the mobile phone can be used as the transfer equipment of the handle and the computer, and the handle is connected with the computer through the mobile phone.

Optionally, the mobile phone may explicitly or implicitly indicate to the notebook computer that the previous connection relationship of the handle needs to be restored. Explicit directions of indication include, but are not limited to, the cell phone sending an indication to the laptop. After the computer determines that the connection relation between the computer and the handle needs to be restored, because the connection exists between the computer and the handle, the computer directly restores the response to the handle event (for example, the game window is set as the focus), and the communication connection does not need to be reestablished.

In some examples, if a scenario such as that shown in fig. 6 in which the handle event is forwarded by using a laptop computer is adopted, in a scenario shown in (2) in fig. 9, after the computer detects an operation of the user, such as clicking a withdrawal control 904 by a remote controller, and the computer determines that a connection relationship between the computer and the handle needs to be restored, since there is a connection between the computer and the handle, the computer may directly restore a response to the handle event without reestablishing a communication connection.

In some examples, if a scheme is adopted in which the handle directly sends a handle event to the mobile phone, such as the one shown in fig. 7, in the scenario shown in (2) of fig. 9, when the mobile phone detects an operation of the user, such as clicking on the withdrawal control 902, the mobile phone may implicitly or explicitly indicate to the computer that the connection relationship between the handle and the computer needs to be restored. The handset can also instruct the handle to establish a connection with the computer based on the bluetooth address of the computer. In this way, the computer can monitor the handle event through the connection between the computer and the handle and execute corresponding operation in response to the handle event.

In some examples, if a scenario is adopted in which the handle directly sends a handle event to the mobile phone, such as the one shown in fig. 7, in the scenario shown in (2) of fig. 9, when the computer detects an operation of the user, such as clicking the withdrawal control 904 with an air gesture, the computer may instruct the handle to re-establish a communication connection with the computer according to the address, such as bluetooth address, of the computer as shown in (3) of fig. 9. Then, the computer can monitor the handle event through the connection and respond to the handle event to execute corresponding operation.

In the embodiment of the application, the electronic device can set the relevant information shared by the peripheral equipment. As shown in fig. 11, the mobile phone is taken as an example of the shared setting. As shown in fig. 11 (1), the mobile phone may provide a switch 1001 for sharing the peripheral device, and after turning on the switch, the mobile phone may share the peripheral device with the in-network device. As shown in (2) of fig. 11, the handset may also provide an application or function setting control 1002. The user can set the application or application function needing to share the peripheral equipment by operating the control. Upon detecting a user operation, such as a click operation, of control 1002, the cell phone may present an interface 1005, such as that shown in fig. 11 (3). Optionally, interface 1005 includes control 1003 and control 1004. Upon detecting a user's operation such as clicking on the control 1003, the mobile phone may present an interface (an example of a third interface) such as that shown in (4) of fig. 11, through which the user can set a peripheral to which a function in the application 1 is associated (i.e., set an association relationship of an interaction event with the peripheral). Subsequently, when detecting that the text editing function is used, the mobile phone can request other devices in the networking to share the keyboard, so that the user can edit the text in the mobile phone by using the keyboard. When the text browsing function is detected to be used, the mobile phone can request other devices in the networking to share the mouse, so that a user can browse texts in the mobile phone by using the mouse.

The technical solution of the embodiment of the present application is mainly described above by taking opening a game application as a preset interaction event, and taking a peripheral device corresponding to the preset interaction event as a handle. The preset interaction event may be other. Optionally, the preset interaction event includes, but is not limited to, any one or more of the following: the method comprises the steps of presetting a touch event, presetting a voice input event, opening a preset application, opening a preset function of the preset application, displaying an interface of the preset function of the preset application, lighting a screen, lighting the screen through a first preset gesture (such as a specific pattern password and the like), detecting the touch event at a preset position of the screen, detecting a second preset gesture, and detecting a preset operation executed by a user through the preset application. The preset interaction event is not limited in the embodiment of the application, and it should be understood that any interaction event that can trigger the calling of the target peripheral device can be regarded as the preset interaction event.

The preset operation performed by the user through the preset application may be, for example, an operation of inputting a text through a text editing application, and when the electronic device detects that the user performs the operation of inputting the text, the electronic device may request a corresponding peripheral (e.g., a keyboard) of another device in the group. As another example, the preset operation performed by the user through the preset application may be an operation of browsing a text through a text editing application. As another example, it may be an operation in which the user plays music through a music application.

The preset touch event may be defined by the system or the user. For example, when listening to a song using a music application, a user may perform a preset touch operation such as long press on a current interface (which may be a music interface or a desktop), and in response to the preset touch operation, the electronic device may request to share a peripheral (e.g., a sound box) of another device in the group associated with the touch operation.

The preset voice input event may be, for example, that the user inputs a voice instruction "connect speaker" to the electronic device while listening to a song using a music application, and the electronic device may request sharing of speakers of other devices in the group in response to the voice instruction.

For example, the sound box is taken as an example, as shown in (1) of fig. 10, the sound box is currently connected to the computer, and the sound box can play audio on the computer. The user opens the music application on the mobile phone, the mobile phone detects an event of opening the music application, and after detecting that the user indicates an operation of connecting to the sound box (such as clicking a "yes" button), the user may request the computer to connect to the sound box. Through the interaction among the computer, the mobile phone, and the sound box, as shown in fig. 10 (2), the sound box can be connected to the mobile phone (either through the computer or directly), and then the music on the mobile phone can be played through the sound box.

As another example, the bluetooth headset is set as an external bluetooth headset, the bluetooth headset is currently connected to a mobile phone, and a user can open a music application on the mobile phone and listen to music on the mobile phone through the bluetooth headset. The user opens the music application on the tablet, and after the tablet detects the event of opening the music application, the tablet can request the mobile phone to share the Bluetooth headset, so that the user can listen to the music on the tablet through the Bluetooth headset.

As another example, the microphone is set as an example, the microphone is currently connected to the mobile phone, and the user may open the audio recording application and input audio to the mobile phone through the microphone. The user opens the audio recording application on the tablet, and after the tablet detects an event of opening the audio recording application, the tablet can request the mobile phone to share the microphone, so that the user can input audio to the tablet through the microphone.

In other embodiments, there may be multiple focal point devices over a period of time. If the target peripherals required by the plurality of focal devices are different, each focal device may request the target peripheral to be shared from the device to which the target peripheral is connected, according to the method of the above embodiment. In an exemplary system composed of a mobile phone, a tablet and a computer, the computer is connected with a handle, a keyboard and a mouse. Thereafter, user a opens the game application on the cell phone and user B opens the text editing application on the tablet. Then, the mobile phone can request the computer to connect with the required handle, and the tablet can request the computer to connect with the required keyboard and mouse. In another exemplary system, the mobile phone, the tablet and the computer are connected to the handle, and the tablet is connected to the mouse and the mouse. Then, the user A opens the game application on the mobile phone, and the user B opens the text editing application on the computer. Then, the mobile phone may request the computer to connect to the required handle, and the computer may request the tablet to connect to the required keyboard and mouse. In another example, the mobile phone, the tablet, the computer and the television are networked, the computer is connected with the handle A, the keyboard and the mouse are connected, and the tablet is connected with the handle B. And then, the user A opens the game application on the mobile phone, and the user B opens the game application on the television. Then, the mobile phone can request the computer to connect with the required handle A, and the television can request the tablet to connect with the required handle B.

In other embodiments, there may be multiple focal point devices over a period of time. If the target peripherals needed by the plurality of focus devices are the same, the call priorities can be set for the plurality of focus devices. Invoking the focus device with the highest priority may preferentially connect the target peripheral. In an exemplary system composed of a mobile phone, a tablet and a computer, the computer is connected with a handle, a keyboard and a mouse. After that, the user a opens the game application on the mobile phone, and the user B opens the game application on the tablet. Then, the mobile phone and the tablet can both request the computer to connect the handle. If the calling priority of the mobile phone is higher than that of the tablet, the computer control handle is connected with the mobile phone.

The technical solution of the embodiments of the present application is described above by mainly taking an external device (third electronic device) as an input device, that is, a handle, as an example, in other embodiments, the external device may also be an output device.

For example, taking the first electronic device as a mobile phone, the second electronic device as a tablet, and the third electronic device as a speaker as an example, initially, the tablet is connected to the speaker. After a user opens a music application on the mobile phone, the mobile phone is triggered to send a first message to the tablet, and after the tablet receives the first message, the tablet determines that the mobile phone needs to be connected with the sound box. Subsequently, after the tablet receives the audio data from the mobile phone through the second connection between the tablet and the mobile phone, the tablet can send the audio data to the sound box through the first connection between the tablet and the sound box according to the first message. Therefore, the sound box can play the audio on the mobile phone.

Or after receiving the first message, the tablet sends a second message to the sound box through the first connection with the sound box to indicate the sound box to establish a third connection with the mobile phone. After the loudspeaker box receives the second message, a third connection with the mobile phone can be established accordingly, and subsequently, the loudspeaker box can directly receive audio data from the mobile phone through the third connection.

Other embodiments of the present application provide an apparatus, which may be the electronic device (e.g., a folding screen handset) described above. The apparatus may include: a display screen, a memory, and one or more processors. The display screen, memory and processor are coupled. The memory is for storing computer program code comprising computer instructions. When the processor executes the computer instructions, the electronic device may perform various functions or steps performed by the mobile phone in the above-described method embodiments. The structure of the electronic device may refer to the electronic device shown in fig. 2 or fig. 4.

The core structure of the electronic device may be represented as the structure shown in fig. 12, and the core structure may include: a processing module 1301, an input module 1302, a storage module 1303, and a display module 1304.

The processing module 1301 may include at least one of a Central Processing Unit (CPU), an Application Processor (AP), or a Communication Processor (CP). Processing module 1301 may perform operations or data processing related to control and/or communication of at least one of the other elements of the consumer electronic device. Specifically, the processing module 1301 may be configured to control content displayed on the home screen according to a certain trigger condition. Or determine the content displayed on the screen according to preset rules. The processing module 1301 is further configured to process the input instruction or data, and determine a display style according to the processed data.

In the embodiment of the present application, if the structure shown in fig. 12 is a first electronic device or a chip system, the processing module 1301 may be configured to detect an interaction event.

Optionally, the processing module 1301 is further configured to analyze the first data according to the identification information of the third electronic device.

Optionally, the processing module 1301 is further configured to control the third electronic device to connect to the second electronic device after detecting a second operation instruction, where the second operation instruction is an operation instruction indicating that the third electronic device is connected to the second electronic device.

In this embodiment, if the structure shown in fig. 12 is a second electronic device or a chip system, the processing module 1301 may be configured to control a third electronic device associated with a preset interaction event to be connected to the first electronic device according to the first message.

Controlling a third electronic device associated with a preset interaction event to be connected with the first electronic device according to the first message, wherein the method comprises the following steps:

optionally, according to the first message, controlling a third electronic device associated with the preset interaction event to be connected to the first electronic device includes:

The input module 1302 is configured to obtain an instruction or data input by a user, and transmit the obtained instruction or data to another module of the electronic device. Specifically, the input mode of the input module 1302 may include touch, gesture, proximity to a screen, and the like, or may be voice input. For example, the input module may be a screen of the electronic device, acquire an input operation of a user, generate an input signal according to the acquired input operation, and transmit the input signal to the processing module 1301.

The storage module 1303 may include volatile memory and/or nonvolatile memory. The storage module is used for storing instructions or data related to at least one of other modules of the user terminal equipment, and particularly, the storage module can record the position of an interface where a terminal interface element UI is located.

The display module 1304 may include, for example, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, an Organic Light Emitting Diode (OLED) display, a micro-electro-mechanical systems (MEMS) display, or an electronic paper display. For displaying content (e.g., text, images, videos, icons, symbols, etc.) viewable by a user.

In this embodiment of the application, if the structure shown in fig. 12 is a first electronic device or a chip system, the display module 1304 is configured to present a first interface after detecting a preset interaction event, where the first interface is used to prompt whether to connect to a third electronic device;

the display module 1304 is further configured to present a second interface after the connection with the third electronic device, where the second interface is used to prompt whether to control the connection between the third electronic device and the second electronic device;

the display module 1304 is further configured to present a third interface, where the third interface is used to set an association relationship between a preset interaction event and a third electronic device.

Optionally, the structure shown in fig. 12 may further include a communication module 1305 for supporting the electronic device to communicate with other electronic devices. For example, the communication module may be connected to a network via wireless communication or wired communication to communicate with other personal terminals or a network server. The wireless communication may employ at least one of cellular communication protocols, such as Long Term Evolution (LTE), long term evolution-advanced (LTE-a), code Division Multiple Access (CDMA), wideband Code Division Multiple Access (WCDMA), universal Mobile Telecommunications System (UMTS), wireless broadband (WiBro), or global system for mobile communications (GSM). The wireless communication may include, for example, short-range communication. The short-range communication may include at least one of wireless fidelity (Wi-Fi), bluetooth, near Field Communication (NFC), magnetic Stripe Transmission (MST), or GNSS.

In this embodiment of the application, if the structure shown in fig. 12 is a first electronic device or a chip system, the communication module 1305 is configured to send a first message to a second electronic device when a preset interaction event is detected, where the first message is used to indicate the preset interaction event, so that the second electronic device controls a third electronic device to be connected to the first electronic device;

and interacting the first data with the third electronic equipment through the connection between the third electronic equipment and the first electronic equipment.

Optionally, the interacting, by the connection with the third electronic device, the first data with the third electronic device includes: and interacting the first data with the third electronic equipment through the second electronic equipment.

Optionally, sending the first message includes: and after detecting the first operation instruction, sending a first message, wherein the first operation instruction is an operation instruction for indicating connection of the first electronic equipment.

Optionally, the communication module 1305 is further configured to receive, from the second electronic device, identification information of a third electronic device.

In this embodiment of the application, if the structure shown in fig. 12 is a second electronic device or a chip system, the communication module 1305 is configured to receive a first message from a first electronic device when the first electronic device detects a preset interaction event; the first message is used for indicating a preset interaction event;

optionally, the communication module 1305 is further configured to send identification information of a third electronic device to the first electronic device; the identification information of the third electronic device is used for the first electronic device to analyze the first data.

Optionally, the communication module 1305 is further configured to send address information of the first electronic device to the third electronic device; the address information is used for the third electronic device to establish the third connection.

It should be noted that descriptions of steps in the method embodiments of the present application may be referred to as modules corresponding to the apparatus, and are not repeated herein.

Embodiments of the present application further provide a chip system, as shown in fig. 13, where the chip system includes at least one processor 1401 and at least one interface circuit 1402. The processor 1401 and the interface circuit 1402 may be interconnected by lines. For example, the interface circuit 1402 may be used to receive signals from other devices (e.g., a memory of an electronic device). Also for example, the interface circuit 1402 may be used to send signals to other devices, such as the processor 1401. Illustratively, the interface circuit 1402 may read instructions stored in memory and send the instructions to the processor 1401. The instructions, when executed by the processor 1401, may cause the electronic device to perform the various steps in the embodiments described above. Of course, the chip system may further include other discrete devices, which is not specifically limited in this embodiment of the present application.

The embodiment of the present application further provides a computer storage medium, where the computer storage medium includes computer instructions, and when the computer instructions are run on the electronic device, the electronic device is enabled to execute each function or step executed by the mobile phone in the foregoing method embodiment.

Embodiments of the present application further provide a computer program product, which, when running on a computer, enables the computer to execute each function or step executed by the mobile phone in the foregoing method embodiments.

Through the description of the above embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a module or a unit is only one type of logical functional division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another apparatus, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

Units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed to a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or partially contributed to by the prior art, or all or part of the technical solutions may be embodied in the form of a software product, where the software product is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a variety of media that can store program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A device connection system, comprising:

the first electronic device is used for sending a first message under the condition that a preset interaction event is detected, wherein the first message is used for indicating the preset interaction event;

the second electronic equipment is connected with third electronic equipment in a first mode and used for receiving the first message from the first electronic equipment and controlling the third electronic equipment to be connected with the first electronic equipment according to the first message;

and the third electronic equipment is used for interacting first data with the first electronic equipment through the connection with the first electronic equipment.

2. The system of claim 1, wherein the third electronic device is connected to the first electronic device through the second electronic device;

the third electronic device is configured to interact first data with the first electronic device through a connection with the first electronic device, and includes: and interacting the first data with the first electronic equipment through the second electronic equipment.

3. The system according to claim 1 or 2, wherein the second electronic device is configured to control the third electronic device to connect with the first electronic device according to the first message, and comprises: receiving the first data from the third electronic device through the first connection, and sending the first data to the first electronic device through a second connection according to the first message;

or, receiving the first data from the first electronic device through the second connection, and sending the first data to the third electronic device through the first connection according to the first message;

4. The system according to any one of claims 1-3,

the second electronic device is further configured to send identification information of the third electronic device to the first electronic device;

the first electronic device is further configured to: receiving identification information of the third electronic device from the second electronic device; and analyzing the first data according to the identification information of the third electronic equipment.

5. The system according to any one of claims 1-4,

the third electronic device is further configured to receive a second message from the second electronic device, where the second message is used to instruct the third electronic device to establish a third connection with the first electronic device;

the third electronic device is further configured to establish the third connection according to the second message;

the third electronic device is configured to interact with the first electronic device through a connection with the first electronic device, and includes: and interacting first data with the first electronic equipment through the third connection.

6. The system according to claim 5, wherein the second electronic device is configured to control the third electronic device to connect with the first electronic device according to the first message, and comprises:

and sending the second message to the third electronic equipment according to the first message.

7. The system of claim 5 or 6,

the second electronic device is further configured to: transmitting address information of the first electronic device to the third electronic device,

the third electronic device, configured to establish the third connection according to the second message, includes: and the third electronic equipment establishes the third connection according to the address information of the first electronic equipment.

8. The system of any of claims 1-7, wherein the first electronic device is further configured to: presenting a first interface after the preset interaction event is detected, wherein the first interface is used for prompting whether to connect the third electronic equipment or not;

sending a first message comprising: and after a first operation instruction is detected, sending the first message, wherein the first operation instruction is an operation instruction for indicating connection of the first electronic equipment.

9. The system according to any one of claims 1-8,

the first electronic device is further configured to: after the third electronic equipment is connected, presenting a second interface, wherein the second interface is used for prompting whether to control the third electronic equipment to be connected with the second electronic equipment or not;

and after a second operation instruction is detected, controlling the third electronic device to be connected with the second electronic device, wherein the second operation instruction is an operation instruction for indicating the third electronic device to be connected with the second electronic device.

10. The system according to any of claims 1-9, wherein said first message is further adapted to indicate a time of said preset interaction event.

11. The system according to any of claims 1-10, wherein the preset interaction event is associated with the third electronic device.

12. The system according to any one of claims 1-11, wherein the first electronic device is further configured to present a third interface, and the third interface is configured to set an association relationship between the preset interaction event and the third electronic device.

13. The system according to any one of claims 1-12, wherein the preset interaction event comprises any one or more of the following events: the method comprises the steps of presetting a touch event, presetting a voice input event, opening a preset application, opening a preset function of the preset application, lighting a screen, detecting the touch event at a preset position of the screen, a preset gesture input by a user, and a preset operation executed by the user through the preset application.

14. A device connection method is applied to a first electronic device, and comprises the following steps:

detecting an interaction event;

under the condition that a preset interaction event is detected, sending a first message to second electronic equipment, wherein the first message is used for indicating the preset interaction event, so that the second electronic equipment controls the third electronic equipment to be connected with the first electronic equipment;

and interacting first data with the third electronic equipment through the connection with the third electronic equipment.

15. The method of claim 14, wherein the third electronic device is connected to the first electronic device through the second electronic device;

interacting first data with the third electronic device through a connection with the third electronic device, including: interacting, by the second electronic device, the first data with the third electronic device.

16. The method according to claim 14 or 15, characterized in that the method further comprises:

receiving identification information of the third electronic device from the second electronic device;

17. The method according to any of claims 14-16, wherein a third connection is established between the third electronic device and the first electronic device;

interacting first data with the third electronic device through a connection with the third electronic device, including: and interacting first data with the third electronic device through the third connection.

18. The method according to any one of claims 14-17, further comprising: presenting a first interface after the preset interaction event is detected, wherein the first interface is used for prompting whether to connect the third electronic equipment or not;

sending a first message comprising: and after detecting a first operation instruction, sending the first message, wherein the first operation instruction is an operation instruction for indicating connection of the first electronic device.

19. The method according to any one of claims 14-18, further comprising:

20. The method according to any of claims 14-19, wherein the first message is further used to indicate a time of the preset interaction event.

21. The method according to any of claims 14-20, wherein the preset interaction event is associated with the third electronic device.

22. The method according to any one of claims 14-21, further comprising:

and presenting a third interface, wherein the third interface is used for setting the incidence relation between the preset interaction event and the third electronic equipment.

23. The method according to any one of claims 14-22, wherein the preset interaction event comprises any one or more of the following events: the method comprises the steps of presetting a touch event, presetting a voice input event, opening a preset application, opening a preset function of the preset application, lighting a screen, detecting the touch event at a preset position of the screen, inputting a preset gesture by a user, and executing a preset operation by the user through the preset application.

24. A device connection method applied to a second electronic device, the method comprising:

receiving the first message from the first electronic device under the condition that the first electronic device detects a preset interaction event; the first message is used for indicating the preset interaction event;

and controlling a third electronic device associated with the preset interaction event to be connected with the first electronic device according to the first message.

25. The method of claim 24,

controlling a third electronic device associated with the preset interaction event to be connected with the first electronic device according to the first message, wherein the method comprises the following steps:

receiving the first data from the third electronic device through the first connection, and sending the first data to the first electronic device through a second connection according to the first message;

wherein the connection between the second electronic device and the first electronic device is a second connection.

26. The method of claim 24 or 25, further comprising:

sending identification information of the third electronic device to the first electronic device; the identification information of the third electronic device is used for the first electronic device to analyze the first data.

27. The method according to any of claims 24-26, wherein controlling a third electronic device associated with the preset interaction event to connect with the first electronic device according to the first message comprises:

and sending the second message to the third electronic device according to the first message, wherein the second message is used for indicating the third electronic device to establish a third connection with the first electronic device.

28. The method of claim 27, further comprising:

sending address information of the first electronic device to the third electronic device; the address information is used for the third electronic device to establish the third connection.

29. The method of any of claims 24-28, wherein the first message is further used to indicate a time of the preset interaction event.

30. An electronic device, comprising:

one or more processors;

a memory;

and one or more computer programs, wherein the one or more computer programs are stored on the memory and, when executed by the one or more processors, cause the electronic device to perform the method of any of claims 14-29.

31. A computer-readable storage medium, comprising a computer program or instructions which, when run on a computer, cause the computer to perform the method of any one of claims 14-29.

32. A computer program product, the computer program product comprising: computer program or instructions which, when run on a computer, cause the computer to perform the method of any one of claims 14-29.