CN118075916A

CN118075916A - Equipment connection method, equipment and system

Info

Publication number: CN118075916A
Application number: CN202211475139.2A
Authority: CN
Inventors: 蔡鹏程; 黎亮齐; 芦东泽; 方峰; 裴政
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2022-11-23
Filing date: 2022-11-23
Publication date: 2024-05-24
Also published as: WO2024109443A1

Abstract

The application provides a device connection method, device and system, wherein the method comprises the following steps: the first device displays an interface, the interface comprises media data, and the second device is a device which establishes wireless connection with the first device; the first device responds to a first operation on the media data, sends a first message to the third device and sends a second message to the second device, wherein the first message comprises media information and device information of the second device, the first message is used for indicating the third device to display the media data and establish wireless connection with the second device, and the media information comprises the media data or identification of the media data; the second message includes device information of the third device, and the second message is used to instruct the second device to establish a wireless connection with the third device. By implementing the embodiment of the application, under the scene that the first equipment shares data with the third equipment, the user controls the second equipment to establish communication with the third equipment through the first equipment, so that the connection between the equipment can be realized conveniently and efficiently.

Description

Equipment connection method, equipment and system

Technical Field

Embodiments of the present application relate to communications technologies, and in particular, to a device connection method, device, and system.

Background

When a user uses the device, other devices can be added as accessory devices of the device, so that the device and the accessory devices can perform data transmission. For example, when a user exercises by using a motion application program of the mobile phone, the mobile phone can be in communication connection with the wearable device, and then the wearable device is added as an accessory device of the mobile phone; furthermore, after the wearable device collects exercise information such as heart rate, calories, exercise posture, exercise duration, step number, activity hour number and the like of the user, the exercise information can be sent to the mobile phone; the mobile phone can display the motion information sent by the wearable device so that the user can exercise.

Users may wish to share data of a device and data of an accessory device of the device to other devices in some scenarios. For example, when a user exercises based on an application program of a mobile phone and motion information of a wearable device, the user wants to share the application program of the mobile phone and the motion information of the wearable device on a large screen device due to the small screen of the mobile phone and inconvenience in holding the mobile phone during exercise. However, the current sharing method often requires a user to manually adjust the connection relationship between the mobile phone, the wearable device and the large-screen device, and is complex to operate and poor in real-time performance.

Therefore, how to conveniently and efficiently realize the connection between multiple devices is a problem to be solved at present.

Disclosure of Invention

In the device connection method, under the condition that the first device shares data with the third device, a user can control the second device to establish communication with the third device through the first device, the second device and the third device do not need to be operated manually, connection between the devices can be realized conveniently and efficiently, and user experience is improved.

A first aspect provides a device connection method, the method comprising: the first device displays an interface, the interface comprises media data, and the second device is a device which establishes wireless connection with the first device; the first device responds to a first operation on the media data, sends a first message to the third device, and sends a second message to the second device, wherein the first message comprises media information and device information of the second device, the first message is used for indicating the third device to display the media data and establish wireless connection with the second device, and the media information comprises the media data or identification of the media data; the second message includes device information of the third device, and the second message is used to instruct the second device to establish a wireless connection with the third device.

By implementing the embodiment of the application, the first device can display the media data; further, in response to a user operation for the media data by the user, the media data or an identification of the media data is transmitted to the third device, and the second device and the third device are controlled to establish a communication connection. According to the method, when the user shares data with the second device through the first device, the user only needs to operate on the first device, wireless connection between the second device and the third device can be achieved, the user does not need to manually operate the second device and the third device, connection between the devices can be achieved conveniently and efficiently, and user experience is improved.

In one possible implementation, the first device sends a first message to the third device in response to a first operation on media data; after the first message is sent to the third device, a second message is sent to the second device.

In one possible implementation, the first device sends a second message to the second device in response to a first operation on the media data; after the second message is sent to the second device, the first message is sent to the third device.

In one possible implementation, the first device sends the first message to the third device at the same time as the second message to the second device in response to the first operation on the media data.

With reference to the first aspect, in a possible implementation manner, the method further includes:

The first device displaying a connectable device of the first device and an accessory device of the first device in response to a second operation on the media data; the connectable device comprises a third device; the auxiliary equipment is equipment which has established connection with the first equipment and comprises second equipment; the first device determining that the selected connectable device is the third device in response to a third operation on the connectable device; the first device determines that the selected accessory device is the second device in response to a fourth operation on the accessory device.

By implementing the embodiment of the application, the first device can display the discovered connectable device and the accessory device which has established the connection, and further, in response to the user operation, the third device is determined from the connectable devices, and the second device is determined from the accessory device, so as to determine the two devices which the user wants to establish the connection.

With reference to the first aspect, in one possible implementation manner, the first message further includes indication information for indicating to turn on a directional connectable broadcast for the second device; the method further comprises the steps of: the first device receives a first response message sent by the third device, wherein the first response message is used for indicating that the third device starts a directional connectable broadcast aiming at the second device; the first device sending a second message to the second device comprising: the first device sends a second message to the second device after receiving the first response message; the second message is for instructing the second device to initiate a bluetooth connection to the third device.

By implementing the embodiment of the application, the first device can enable the third device to start the directional connectable broadcast for the second device by carrying the indication information for indicating to start the directional connectable broadcast for the second device in the first message; the third device may send a first response message to the first device upon turning on the directionally connectable broadcast to cause the first device to send a second message to the second device after determining that the second device has turned on the broadcast; the second message is for instructing the second device to initiate a bluetooth connection to the third device. In the method, the first device can control the second device and the third device to establish Bluetooth communication connection, wherein the second device initiates connection after the third device opens directional connectable broadcast, so that the success rate of connection establishment can be improved, and the power consumption in the connection process of the second device and the third device can be reduced.

With reference to the first aspect, in a possible implementation manner, the second message further includes indication information for indicating to turn on a directional connectable broadcast for the third device; the method further comprises the steps of: the first device receives a second response message sent by the second device after sending the second message, wherein the second response message is used for indicating that the second device starts a directional connectable broadcast aiming at the third device; the first device sending a first message to a third device comprising: the first device sends a first message to the third device after receiving the second response message; the first message is for the third device to initiate a bluetooth connection to the second device.

By implementing the embodiment of the application, the first device can control the second device and the third device to establish Bluetooth communication connection, wherein the third device can initiate connection after the second device starts directional connectable broadcast, so that the success rate of establishing connection can be improved, and the power consumption in the connection process of the second device and the third device can be reduced.

With reference to the first aspect, in a possible implementation manner, the second message is further used to instruct the second device to send data collected by the second device to the third device, where the third device is used to display the data collected by the second device; the method further comprises the steps of:

the first device receives data collected from the second device; the first device displays media data and data collected by the second device.

By implementing the embodiment of the application, the first equipment can display the media data and the data acquired by the second equipment; and further, in response to the user operation, the media data or the identification of the media data is sent to the third device, and the second device and the third device are controlled to establish wireless connection so that the second device sends the data collected by the second device to the third device, so that the third device can display the media data and the data collected by the second device only by operating on the first device. The method can conveniently and efficiently send the display content of the first device to the third device, wherein the display content comprises the media data of the first device and the data of the auxiliary device (namely the second device).

With reference to the first aspect, in one possible implementation manner, the media data includes display data and audio data of the target video; the first message is also for instructing a third device to send audio data to a second device, the second device being for playing the audio data, the third device being for displaying the display data.

A second aspect provides a device connection method, the method comprising:

The second device receives a second message sent by the first device, the second message comprising device information of a third device, the second message being used for instructing the second device to establish a wireless connection with the third device, the first device being used for sending a first message to the third device when receiving a first operation on media data, the media data being displayed on a display interface of the first device, the first message comprising media information and device information of the second device, the first message being used for instructing the third device to display the media data and to establish a wireless connection with the second device, the media information comprising the media data or an identification of the media data; the second device establishes a wireless connection with the third device in response to the second message.

With reference to the second aspect, in one possible implementation manner, the second message further includes indication information for instructing the second device to initiate a bluetooth connection to the third device, where the second message is sent by the first device to the second device after receiving a first response message from the third device, where the first response message is used to indicate that the third device has turned on a directional connectable broadcast for the second device; the second device establishing a wireless connection with a third device in response to the second message, comprising:

the second device initiates a bluetooth connection to the third device in response to the second message.

With reference to the second aspect, in a possible implementation manner, the second message further includes indication information for indicating to turn on a directional connectable broadcast for the third device; the second device establishing a wireless connection with a third device in response to the second message, comprising:

The second device responding to the second message, starting a directional connectable broadcast for the third device; the second device sending a second response message to the first device, the second response message indicating that the second device has turned on a directional connectible broadcast for the third device; the second device establishes a bluetooth communication connection with the third device when the third device initiates a bluetooth connection.

With reference to the second aspect, in a possible implementation manner, the second message is further used to instruct the second device to send, to the third device, data collected by the second device, and the method further includes:

the second equipment collects motion data of the user; after the second device establishes wireless connection with the third device, the second device sends data collected by the second device to the third device, and the third device is used for displaying the data collected by the second device.

A third aspect provides a device connection method, the method comprising:

The third device receives a first message sent by the first device, wherein the first message is used for indicating the third device to establish wireless connection with the second device, the first message comprises media information and device information of the second device, the second device is the device for establishing wireless connection with the first device, and the media information comprises media data or identification of the media data; the third device displaying media data in response to the first message; the third device establishes a wireless connection with the second device.

With reference to the third aspect, in one possible implementation manner, the first message further includes indication information indicating that a directional connectable broadcast for the second device is turned on; the third device establishes a wireless connection with the second device, comprising:

The third device responding to the first message, starting a directional connectable broadcast for the second device; the third device sends a first response message to the first device, wherein the first response message is used for indicating that the third device starts the directional connectable broadcast; and the third device establishes Bluetooth communication connection with the second device when the second device initiates Bluetooth connection.

With reference to the third aspect, in one possible implementation manner, the first message further includes indication information for instructing the second device to initiate a bluetooth connection to the third device, where the first message is sent by the first device to the third device after receiving a second response message from the second device, where the second response message is used to indicate that the second device has opened a directional connectable broadcast; the third device establishes a wireless connection with the second device, comprising: the second device initiates a bluetooth connection to the third device in response to the first message.

With reference to the third aspect, in one possible implementation manner, the method further includes: the third equipment receives the motion data sent by the second equipment, wherein the motion data is the data acquired by the second equipment; the third device displays the motion data.

With reference to the third aspect, in one possible implementation manner, the media data includes display data and audio data corresponding to the target video; the first message is also used for instructing the third device to send audio data to the second device;

The third device displaying media data in response to the first message, comprising: the third device displays the display data;

the method further comprises the steps of: the third device sends audio data to the second device, which is used to play the audio data.

A fourth aspect provides a device comprising one or more functional modules operable to perform a device connection method as in any one of the above aspects or any one of the possible implementations thereof.

A fifth aspect provides a storage medium comprising instructions which, when run on a device, cause the device to perform the device connection method of any one of the above aspects or any one of the possible implementations of any one of the aspects.

A sixth aspect provides a program product which, when run on a device, causes the device to perform the device connection method of any one of the above aspects or any one of the possible implementations of any one of the aspects.

A seventh aspect provides a chip comprising: a processor and an interface, the processor and the interface cooperating with each other, so that the chip performs the device connection method in any one of the above aspects or any one of the possible implementation manners of any one of the above aspects.

The eighth aspect also provides a device connection system including a first device, a second device, and a third device. Wherein the first device is configured to implement the method described in the first aspect or any one of the possible implementation manners of the first aspect; the second device implements the method of the second aspect or any one of the possible implementations of the second aspect; the third device is configured to implement the method described in the third aspect or any one of the possible implementation manners of the third aspect.

It will be appreciated that the apparatus provided in the fourth aspect, the readable storage medium provided in the fifth aspect, the program product provided in the sixth aspect, and the chip provided in the seventh aspect are all configured to perform the method provided by the embodiment of the present application. Therefore, the advantages achieved by the method can be referred to as the advantages of the corresponding method, and will not be described herein.

Drawings

FIG. 1 is a block diagram of a device connection system provided in an embodiment of the present application;

fig. 2 is a schematic hardware structure of an apparatus 100 according to an embodiment of the present application;

FIG. 3 is a block diagram of the software architecture of the device 100 provided by an embodiment of the present application;

fig. 4 is a schematic hardware structure of an apparatus 200 according to an embodiment of the present application;

FIG. 5 is a schematic view of a video scene according to the present application;

FIG. 6 is a schematic flow chart of a sports scene provided by the application;

7A-7D are user interfaces for adding accessory devices provided by exemplary embodiments of the present application;

8A-8C are user interfaces implemented on a first device provided by exemplary embodiments of the present application;

FIG. 9 is a user interface implemented on a third device provided by an exemplary embodiment of the present application;

fig. 10 is a schematic flow chart of a device connection method according to an embodiment of the present application;

Fig. 11 is a flowchart of a method for establishing communication connection between a wearable device and a large-screen device according to an embodiment of the present application.

Detailed Description

The technical solutions of the embodiments of the present application will be clearly and thoroughly described below with reference to the accompanying drawings. Wherein, in the description of the embodiments of the present application, unless otherwise indicated, "/" means or, for example, a/B may represent a or B; the text "and/or" is merely an association relation describing the associated object, and indicates that three relations may exist, for example, a and/or B may indicate: the three cases where a exists alone, a and B exist together, and B exists alone, and furthermore, in the description of the embodiments of the present application, "plural" means two or more than two.

The terms "first," "second," and the like, are used below for descriptive purposes only and are not to be construed as implying or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature, and in the description of embodiments of the application, unless otherwise indicated, the meaning of "a plurality" is two or more.

The term "User Interface (UI)" in the following embodiments of the present application is a media interface for interaction and information exchange between an application program or an operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user. The user interface is a source code written in a specific language such as java, extensible markup language (extensible markup language, XML) and the like, and the interface source code is analyzed and rendered on the device to finally be presented as content which can be identified by a user. A commonly used presentation form of a user interface is a graphical user interface (graphic user interface, GUI), which refers to a user interface related to operations that is displayed in a graphical manner. It may be a visual interface element of text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc., displayed in the display of the device.

In order to more clearly and specifically describe the device connection method provided by the embodiment of the present application, the device connection system provided by the embodiment of the present application is described below.

Referring to fig. 1, fig. 1 is a frame diagram of a device connection system according to an embodiment of the present application.

As shown in fig. 1, the device connection system may include a first device 10, an accessory device 20, and a third device 30.

Wherein the accessory device 20 may include one or more devices; the accessory device 20 is a device that establishes a communication connection with the first device 10. For convenience of description, in the following embodiments, the auxiliary device of the first device is simply referred to as an auxiliary device, and will not be described again.

Wherein the first device 10 may be an input-enabled device (fig. 1 illustrates that the first device 10 is a mobile phone); accessory device 20 may be a wireless headset, a smart watch, a sound box, etc. (fig. 1 illustrates accessory device 20 as a smart watch and a wireless headset); the third device 30 may be a display enabled device (fig. 1 exemplarily shows that the third device 30 is a large screen device).

In some embodiments, the first device 10 may establish a communication connection with one or more accessory devices 20, as shown in fig. 1, the first device 10 establishing a communication connection with an accessory device 20 (e.g., a smart watch, wireless headset).

Further, the first device 10 may determine the second device from among the accessory devices 20 in response to a user operation for the second device; the first device 10, upon detecting a user operation for the third device 30, transmits device information of the second device to the third device 30 in response to the user operation; the first device 10 may transmit the device information of the third device 30 to the second device; further, the third device 30 may initiate a directional bluetooth broadcast based on the device information of the second device, and the second device may initiate a bluetooth connection request to the third device 30 based on the device information of the third device 30, thereby establishing a communication connection between the third device 30 and the second device. The device information of the second device may be a name or a media access Control Address (MAC) of the second device, and the device information of the third device 30 may be a name or a MAC Address of the third device 30. Wherein the second device may be some or all of the accessory devices 20.

It should be appreciated that the accessory device 20 and the first device 10 may both be devices of the same user; the accessory device 20 and the first device 10 may also be devices that are used by different users.

It should be noted that the first device 10, the accessory device 20, and the third device 30 may be different devices, may be the same device, or any two devices of the first device 10, the accessory device 20, and the third device 30 may be the same device, and may specifically be determined according to different application scenarios, which is not limited herein.

Such devices may include, but are not limited to, cell phones, wearable devices (e.g., smart watches, etc.), personal computers (Personal Computer, PCs), tablets, displays, televisions, desktop computers, laptop computers, handheld computers, notebook computers, ultra mobile personal computers, netbooks, augmented reality devices, virtual reality devices, artificial intelligence devices, vehicle devices, smart home devices, etc.

It should be understood that the device connection system architecture in fig. 1 is only an exemplary implementation of an embodiment of the present application, and the device connection system architecture in the embodiment of the present application includes, but is not limited to, the above device connection system architecture.

The following exemplary device 100 is presented as an example of the device of fig. 1. Fig. 2 shows a schematic hardware configuration of the apparatus 100.

The embodiment will be specifically described below by taking the apparatus 100 as an example. It should be understood that the device 100 may have more or fewer components than shown, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The device 100 may include: processor 110, external memory interface 120, internal memory 121, universal serial bus (universal serial bus, USB) interface 130, charge management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, wireless headset interface 170D, sensor module 180, keys 190, motor 191, indicator 192, camera 193, display 194, and subscriber identity module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It should be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation on the apparatus 100. In other embodiments of the application, the apparatus 100 may include more or less components than illustrated, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (IMAGE SIGNAL processor, ISP), a controller, a memory, a video codec, a digital signal processor (DIGITAL SIGNAL processor, DSP), a baseband processor, and/or a neural Network Processor (NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

Wherein the controller may be a neural hub and command center of the device 100. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-INTEGRATED CIRCUIT, I2C) interface, an integrated circuit built-in audio (inter-INTEGRATED CIRCUIT SOUND, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is only illustrative and not limiting on the structure of the apparatus 100. In other embodiments of the present application, the device 100 may also employ different interfaces in the above embodiments, or a combination of interfaces.

The charge management module 140 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger.

The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like.

The wireless communication functions of the device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution for wireless communication, including 2G/3G/4G/5G, as applied to the device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional module, independent of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (WIRELESS FIDELITY, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation SATELLITE SYSTEM, GNSS), frequency modulation (frequency modulation, FM), near field communication (NEAR FIELD communication, NFC), infrared (IR), etc., as applied to the device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, antenna 1 and mobile communication module 150 of device 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, such that device 100 may communicate with a network and other devices via wireless communication techniques.

The device 100 implements display functionality via a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel.

The device 100 may implement shooting functions through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the device 100 is selecting a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The device 100 may support one or more video codecs. In this way, the device 100 may play or record video in a variety of encoding formats.

The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Intelligent awareness of the device 100, etc. applications may be implemented by the NPU, for example: face recognition, and the like.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to enable the memory capabilities of the expansion device 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions.

The internal memory 121 may be used to store executable program code including instructions. The processor 110 executes various functional applications of the device 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store, among other things, an application required for at least one function (such as a fingerprint recognition function, etc.) of the operating system. The storage data area may store data created during use of the device 100 (e.g., fingerprint information templates, etc.), and so on. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, and the like.

The device 100 may implement audio functionality through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a wireless headset interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110. The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. A receiver 170B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. Microphone 170C, also referred to as a "microphone" or "microphone", is used to convert sound signals into electrical signals. The wireless earphone interface 170D is used to connect a wired wireless earphone. The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. The gyro sensor 180B may be used to determine a motion gesture of the device 100. The air pressure sensor 180C is used to measure air pressure. The magnetic sensor 180D includes a hall sensor. The acceleration sensor 180E may detect the magnitude of acceleration of the device 100 in various directions (typically three axes). A distance sensor 180F for measuring a distance. The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The ambient light sensor 180L is used to sense ambient light level. The fingerprint sensor 180H is used to collect a fingerprint. The temperature sensor 180J is for detecting temperature. The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The keys 190 include a power-on key, a volume key, etc. The motor 191 may generate a vibration cue. The indicator 192 may be an indicator light, may be used to indicate a state of charge, a change in charge, may be used to synthesize a request, missed an incoming call, a notification, etc. The SIM card interface 195 is used to connect a SIM card. In an embodiment of the present application, the device 100 may perform the device connection method through the processor 110.

Fig. 3 is a block diagram of a software architecture of the apparatus 100 according to an embodiment of the present application.

The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun rows (Android runtime) and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages.

As shown in fig. 3, the application package may include applications for cameras, gallery, calendar, phone calls, maps, navigation, WLAN, bluetooth, music, video, short messages, sports health, etc.

In some embodiments, the first device 10 is a device 100, and a user may add a device such as a cell phone or a smart watch as an accessory device to the device 100 through the sports health application of the device 100; the user may also send data to other devices through the sports health application, such as an identification of media data and device information of the accessory device to the third device.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for the application of the application layer. The application framework layer includes a number of predefined functions.

As shown in fig. 3, the application framework layer may include a display (display) manager, a sensor (sensor) manager, a cross-device connection manager, an event manager, a task (activity) manager, a window manager, a content provider, a view system, a resource manager, a notification manager, and the like.

The display manager is used for the display management of the system and is responsible for the management of all display related transactions, including creation, destruction, direction switching, size and state change and the like. Typically, there will be only one default display module on a single device, the main display module.

The sensor manager is responsible for the state management of the sensor, manages the application to monitor the sensor event, and reports the event to the application in real time.

The cross-device connection manager is used to establish communication connections with other devices.

The event manager is used for event management service of the system, and is responsible for receiving events uploaded by the bottom layer and distributing the events to each window to complete the works of receiving and distributing the events and the like.

The task manager is used for the management of task (Activity) components, including startup management, lifecycle management, task direction management, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like. The window manager is also responsible for window display management, including management related to window display mode, display size, display coordinate position, display hierarchy, and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window.

Android run time includes a core library and virtual machines. Android runtime is responsible for scheduling and management of the android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library (which may also be referred to as a data management layer) may include a plurality of functional modules. For example: surface manager (surface manager), media library (Media Libraries), three-dimensional graphics processing library (e.g., openGL ES), 2D graphics engine (e.g., SGL), event data, and the like.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio video encoding formats, such as: MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The hardware structure and software structure of the third device 30 will be described below using the device 200 as an example in the embodiment of the present application.

As shown in fig. 4, the apparatus 200 may include: processor 222, memory 223, wireless communication module 224, power switch 225, display screen 229, audio module 230. In some embodiments, the device 200 may also include a wired LAN communication processing module 226, a high definition multimedia interface (high definition multimedia interface, HDMI) communication processing module 227, a USB communication processing module 228, and the like. The above modules may be connected by a bus. Wherein:

The processor 222 may be used to read and execute readable instructions. In particular implementations, processor 222 may include primarily controllers, operators, and registers. The controller is mainly responsible for instruction decoding and sending out control signals for operations corresponding to the instructions. The arithmetic unit is mainly responsible for performing fixed-point or floating-point arithmetic operations, shift operations, logic operations, and the like, and may also perform address operations and conversions. The register is mainly responsible for storing register operands, intermediate operation results and the like temporarily stored in the instruction execution process. In particular implementations, the hardware architecture of the processor 222 may be an Application Specific Integrated Circuit (ASIC) architecture, MIPS architecture, ARM architecture, NP architecture, or the like.

In an embodiment of the present application, the processor 222 may be configured to parse a signal received by the wireless communication module 224, such as a new URL sent by the device 100, and obtain a plurality of videos and associated videos in the playlist according to the new URL.

The wireless communication module 224 may include a WLAN communication processing module. Optionally, the wireless communication module 224 may also include a Bluetooth (BT) communication processing module, an NFC processing module, a cellular mobile communication processing module (not shown), and so forth.

In an embodiment of the present application, the wireless communication module 224 may be used to establish a communication connection with the device 100. The communication connection established by the wireless communication module 224 and the device 100 may be various. For example, a WLAN communication processing module may be used to establish a Wi-Fi direct communication connection with device 100, a Bluetooth (BT) communication processing module may be used to establish a bluetooth communication connection with device 100, an NFC processing module may be used to establish an NFC connection with device 100, and so on.

In an embodiment of the present application, the wireless communication module 224 may also be configured to establish a communication connection with the device 100 and receive a video stream sent by the device 100 based on the communication connection. The communication connection established by the wireless communication module 224 and the device 100 may be data transmission based on the HTTP protocol, and the present application does not impose any limitation on the type of communication connection between devices and the data transmission protocol.

A memory 223 is coupled to the processor 222 for storing various software programs and/or sets of instructions. In particular implementations, memory 223 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 223 may store an operating system, such as an embedded operating system, uCOS, vxWorks, RTLinux. Memory 223 may also store communication programs that may be used to communicate with device 100, one or more servers, or additional devices.

The power switch 225 may be used to control the power supplied by the power source to the device 200.

The wired LAN communication processing module 226 may be used to communicate with other devices in the same LAN through a wired LAN, and may also be used to connect to the WAN through a wired LAN, and may communicate with devices in the WAN.

The HDMI communication processing module 227 can be used to communicate with other devices through an HDMI interface (not shown).

The USB communication processing module 228 may be used to communicate with other devices via a USB interface (not shown).

The display screen 229 may be used for drop pages, videos, and the like. The display 229 may be a LCD, OLED, AMOLED, FLED, QLED or the like. The content displayed on the display 229 may be referred to in connection with the description of the method embodiments that follow.

In the embodiment of the present application, the display screen 229 may implement continuous playing of multiple videos according to the wireless communication module 224 receiving the video streams of the multiple videos such as the play list and the associated video sent by the server.

An audio module 230. The audio module 230 may be configured to output audio signals via an audio output interface, which may enable the device 200 to support audio playback. The audio module 230 may also be used to receive audio data through an audio input interface. The audio module 230 may include, but is not limited to: microphones, speakers, receivers, etc.

In some embodiments, device 200 may also include a serial interface such as an RS-232 interface. The serial interface can be connected to other devices, such as audio playback devices, such as speakers, so that the display and the audio playback devices cooperate to play audio and video.

It will be appreciated that the configuration illustrated in fig. 4 does not constitute a particular limitation of the apparatus 200. In other embodiments of the application, the device 200 may include more or less components than illustrated, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

In some embodiments, device 200 may include the hardware included in device 100 shown in FIG. 3, described above. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The software system of the device 200 may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, a cloud architecture, or the like. Illustratively, the software system of device 200 may include, but is not limited to Linux, or other operating systems. /(I)Is a hong Mongolian system.

In some embodiments, the device 200 is an Android system, divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun rows and system libraries, and a kernel layer, respectively. The application layer may include an application of screen-cast management for device connection and screen-cast display, the application framework layer may include a cross-device connection manager, an event manager, a window manager, a display manager, and the like, the system library may include a media library, event data, and the like, and the kernel layer is used for device discovery, device authentication, device connection, and the like, where details of each part may be specifically referred to in the related description in fig. 3, and are not repeated herein.

Based on the foregoing device connection system and the software and hardware structures of the device 100, the device connection method provided by the embodiment of the present application is described in detail below.

The device connection method provided by the embodiment of the application can be applied to various scenes, including but not limited to:

(1) Video watching scene

The first device is a device with an input function, such as a device (such as a mobile phone) with a touch screen or a keyboard and the like capable of receiving user operation; the third device is a device (such as a large screen device or a PC) with a display function; the accessory device is a device (such as a wireless earphone or a sound box) with playing function.

In some embodiments, the first device may establish a communication connection with the third device in response to a user operation when the user operation is detected; transmitting device information of the media resource and the accessory device to the third device, wherein the media resource comprises an image resource and an audio resource; the third device may play the image asset; the third device transmits the audio asset to the accessory device based on the accessory device's device information such that the user may view the image asset through the third device and listen to the audio asset through the accessory device.

In connection with the system shown in fig. 1, a viewing scenario shown in fig. 5 is exemplarily shown, where the mobile phone in fig. 5 is the first device 10 in fig. 1, the wireless headset in fig. 5 is the accessory device 20 in fig. 1, and the large screen device in fig. 5 is the third device 30 in fig. 1.

As shown in fig. 5, the wireless earphone can be paired with the mobile phone, that is, the wireless earphone is an accessory device of the mobile phone, and a user can wear the wireless earphone to listen to the audio when the mobile phone plays the recording sheet; furthermore, when the user wants to watch the documentary through the large screen device and listen to the audio of the documentary through the wireless earphone, the mobile phone can send the media resource of the documentary and the device information of the wireless earphone to the large screen device, wherein the media resource comprises the image resource and the audio resource of the documentary; after the large-screen device acquires the media resource, the large-screen device can establish communication connection with the wireless earphone based on the device information of the wireless earphone, and the audio resource is sent to the wireless earphone; further, the large screen device may play the image asset and the wireless headset may play the audio asset.

By using the device connection method provided by the embodiment of the application in the film watching scene, the data (such as audio resources) of the first device can be transmitted to the auxiliary device (such as a wireless earphone or a sound box) through the first device, the auxiliary device and the third device do not need to be operated manually by a user, the film watching requirement of the user can be met, for example, the film watching requirement of a user who wants to watch a film through a large screen in a home environment but does not want to disturb the family can be improved, and the user experience can be improved.

(2) Sports scene

The first device is a device with an input function and a display function, and can display a motion video; the accessory equipment can be wearing equipment with information acquisition function, and the wearing equipment can acquire motion data of a user; the third device may be a large screen device with display functionality.

In some embodiments, the first device may send the motion video to the large screen device after establishing a communication connection with the large screen device in response to a user operation; the first device can also respond to the user operation to realize the communication connection between the large-screen device and the wearable device, so that the wearable device can send the motion data of the user to the large-screen device; then the large screen device may display the motion video and the user's motion data.

In connection with the system shown in fig. 1, an exemplary motion scenario shown in fig. 6 is shown, where the handset in fig. 6 is the first device 10 in fig. 1, the smart watch in fig. 6 is the accessory device 20 in fig. 1, and the large screen device in fig. 6 is the third device 30 in fig. 1.

As shown in fig. 6, when a user exercises at home using a mobile phone and a smart watch, the smart watch is used as an accessory device of the mobile phone, and the smart watch can send motion data of the user to the mobile phone, and further, the mobile phone can display motion videos and motion data for the user to exercise. When a user wants to send the motion video and the motion data to large-screen equipment (such as a smart screen), the mobile phone can establish communication connection with the smart screen so as to send the motion video to the smart screen, and can also control the smart screen and the smart watch to establish communication connection so as to enable the smart watch to send the motion data to the smart screen; furthermore, the smart screen can display the motion video sent by the mobile phone and the motion data sent by the smart watch.

By using the device connection method provided by the embodiment of the application in a motion scene, the data of the accessory device can be transmitted to the third device through the first device, so that the time delay caused by the data of the accessory device being transmitted to the third device through the first device can be avoided, and the real-time performance of the data transmission can be ensured; the auxiliary equipment and the third equipment do not need to be operated manually by a user, so that the user experience can be improved.

It can be understood that the above scenario is only an example, and the device connection method provided in the embodiment of the present application may also be applied to other scenarios, which are not limited herein.

Taking the sports scenario shown in fig. 6 as an example, some user interfaces on a first device (such as a mobile phone) and a third device (such as a large screen device) provided in the embodiments of the present application are described below.

Fig. 7A-7D illustrate one implementation of a first device adding an accessory device.

FIG. 7A illustrates an exemplary user interface 71 on a first device for exposing installed applications. The user interface 71 shows: icons 711 for sports health applications, status bars, icons for other applications, etc. Wherein the status bar may include: one or more signal strength indicators of mobile communication signals (also may be referred to as cellular signals), one or more signal strength indicators of Wi-Fi signals, battery status indicators, time indicators, and the like.

As shown in fig. 7A, the first device may detect a user operation of an icon 711 acting on the sports health application and display a user interface 72 shown in fig. 7B in response to the user operation. The user interface 72 may include an add control 721 and other controls, such as a health control 722A, a motion control 722B, a device control 722C, and a my control 722D, among others, wherein the add control 721 is used to establish a communication connection with other devices; health control 722A is used to display a health related user interface, sports control 722B is used to display a sports related user interface, device control 722C is used to display a device added user interface (such as user interface 72 shown in FIG. 7B), and My control 722D is used to display personal information.

It should be noted that, the first device may also display the user interface 72 in response to other controls (such as the device control 722C) or through other manners, and the user interface 72 is merely one user interface provided by way of example in the embodiment of the present application, which is not limited to the present application.

In some embodiments, as shown in fig. 7B, the first device may detect a user operation on the add control 721, in response to which the first device discovers nearby connectable devices, and may display a user interface 73 as shown in fig. 7C. The user interface 73 may display discovered devices and the corresponding connection controls for the devices. Fig. 7C illustrates that the devices sent by the first device include a weight scale, a wireless headset, and a smart watch, and the user interface 73 includes a connection control 731 corresponding to the weight scale, a connection control 732 corresponding to the wireless headset, and a connection control 733 corresponding to the smart watch.

The method by which the first device discovers nearby devices is not limited herein. For example, the first device may discover nearby bluetooth devices through bluetooth, and when the weight scale, the wireless headset, and the smart watch are within bluetooth discovery range of the first device and all turn on bluetooth, then the first device may discover the weight scale, the wireless headset, and the smart watch through bluetooth, and in turn, display a user interface 73 as shown in fig. 7C.

As shown in fig. 7C, upon detecting a user operation for the connection control 733, the first device establishes a communication connection with the smart watch in response to the user operation, and further, displays a user interface 74 as shown in fig. 7D. The user interface 74 includes an accessory bar 741 and an add control 721, wherein the accessory bar 741 is for displaying devices that have established a communication connection, such as a smart watch displayed by the accessory bar 741.

In some embodiments, the first device may receive data from the accessory device after adding the accessory device, and in turn, display the data of the accessory device. For example, after adding the smart watch as the accessory device, the first device may display the smart watch data sent by the smart watch in the accessory device column 741 when receiving the smart watch data sent by the smart watch, as shown in fig. 7D.

In other embodiments, the user may also establish a communication connection with a plurality of devices, i.e., add the plurality of devices as an accessory device to the first device, through a selection control on the user interface 73, which is not limited in the embodiments of the present application. For convenience of description, the embodiment of the present application is illustrated by adding only one device.

Fig. 8A-8C and 9 illustrate an implementation of a first device, an accessory device, and a third device connection. 8A-8C are user interfaces implemented on an exemplary first device, and FIG. 9 is a user interface implemented on an exemplary third device.

Fig. 8A illustrates one user interface 81 in a healthy sports application, the user interface 81 may be a user interface that the first device displays upon detecting a user operation for a sports control 722B as in the user interface 72. User interface 81 may include controls for multiple lessons, such as lesson control 811.

As shown in fig. 8A, the first device can display a user interface 82 as shown in fig. 8B in response to a user operation for the lesson control 811 upon detection of the user operation. The user interface 82 may include a play window 821, a share control 822, and a display window 823. The play window 821 is used for playing video, such as yoga courses shown in fig. 8B; the sharing control 822 is used for sending video resources corresponding to the current playing window 821 to other devices; the display window 823 is used for displaying data sent by the accessory device, for example, if the accessory device of the current first device is a smart watch, the display window 823 may be smart watch data as shown in fig. 8B, and the smart watch data may include a heart rate and calories obtained by the smart watch in real time, and the like.

As shown in fig. 8B, the first device may, upon detecting a user operation for the sharing control 822, display a user interface 83 as shown in fig. 8C in response to the user operation. The user interface 83 may include device information 831 to be shared, accessory device information 832, and connection controls 833. The device to be shared information 831 is used for displaying devices discovered by the first device; accessory device information 832 is used to display the accessory device of the first device; the connection control 833 is used to establish a connection with a selected device to be shared and a connection between the selected device to be shared and a selected accessory device.

As shown in fig. 8C, the device information 831 to be shared exemplarily shows that the nearby devices sent by the first device are a large-screen device a, a large-screen device B and a PC, and exemplarily shows a selection control 831A corresponding to the large-screen device a, a selection control 831B corresponding to the large-screen device B and a selection control 831C corresponding to the PC; the accessory device information 832 illustratively shows that the accessory device to which the first device is currently connected is a smart watch and a wireless headset, and illustratively shows a selection control 832A corresponding to the smart watch and a selection control 832B corresponding to the wireless headset.

In some embodiments, the user may select the large screen device a as the third device and select the smart watch as the second device, and the first device may display the user interface 83 shown in fig. 8C, and as shown in fig. 8C, the selection control 831A corresponding to the large screen device a and the selection control 832A corresponding to the smart watch are displayed in a selected state and the selection control not marked with "Γ" is in an unselected state. As shown in fig. 8C, when detecting a user operation of the user on the connection control 833, the first device may respond to the user operation, and send the video resource corresponding to the current playing window 821 and the device information of the smart watch to the large screen device a, so that the large screen device a plays the video resource corresponding to the current playing window 821, and the large screen device a establishes a wireless connection with the smart watch based on the device information of the smart watch to obtain the smart watch data.

In some embodiments, after the large screen device a receives the video resource sent by the first device and the smart watch data sent by the smart watch, a user interface 90 as shown in fig. 9 may be displayed. The user interface 90 may include a main window 901 and an auxiliary window 902, where the main window 901 is used to display data sent by the first device, such as yoga courses shown in fig. 9; the auxiliary window 902 is used to display data sent by the auxiliary device, such as the smart watch data shown in fig. 9.

The device connection method provided by the embodiment of the application is described in detail below based on the scenario of fig. 6, where the selected accessory device is taken as an example of a smart watch, and the third device is taken as a large-screen device.

Fig. 10 illustrates a device connection method provided by an embodiment of the present application. The device connection method may include some or all of the following steps:

S101, wireless connection is established between the first device and the wearable device.

Wherein the wearable device may include one or more devices, including but not limited to smart watches, smart bracelets, smart glasses, and the like; the wireless connection established between the first device and the wearable device may include, but is not limited to: wi-Fi P2P wireless connection, bluetooth wireless connection, etc.

In some embodiments, the first device has installed thereon a sports health application, through the user interface of which the user can establish a wireless connection with the wearable device, i.e., add the wearable device as an accessory device to the first device. For example, reference may be made to the relevant descriptions of fig. 7A to 7D, which are not repeated here.

And S102, the wearable device sends the user data to the first device.

The user data may include, among other things, the name of the user and the athletic data of the user, which may include heart rate, calories, and number of athletic steps, among others.

In one implementation, the wearable device may send the user data to the first device after establishing the connection with the first device. For example, the wearable device is a smart watch, and the user wears the smart watch to perform sports; after the connection is established between the intelligent watch and the first device, the collected motion data of the user can be sent to the first device in real time, and accordingly, the first device can display the motion data of the user after receiving the user data from the intelligent watch.

In some embodiments, the wearable device may display a prompting message when the wearable device establishes a connection with the first device for the first time, where the prompting message is used to prompt the user whether to send the user device to the first device; the wearable device may send the user data to the first device when receiving a user operation in which the user agrees to send the user data; in the subsequent connection, the user data can be directly transmitted to the first device in real time after the wearable device establishes a connection with the first device.

The first device displays media data and user data S103.

In some embodiments, the first device may display a first interface that includes media data and user data. Wherein the media data may be video or image, and the content of the media data is not limited herein.

By way of example, the first interface may be a user interface 82 as shown in FIG. 8B, the first device displaying the user interface 82, the user interface 82 may include a play window 821 and a display window 823. The play window 821 is used for displaying media data, for example, the media data is yoga course shown in fig. 8B; the display window 823 is used for displaying data sent by the accessory device, for example, if the accessory device of the current first device is a smart watch, the display window 823 may be smart watch data as shown in fig. 8B, and the smart watch data may include a heart rate and calories obtained by the smart watch in real time, and the like.

And S104, the first device responds to the sharing operation for the media data, and displays the device information to be shared and the auxiliary device information, wherein the auxiliary device information comprises wearing devices, and the device information to be shared comprises large-screen devices.

In some embodiments, the first device may display a second interface including device information to be shared and accessory device information, where the accessory device information includes a wearable device and the device information to be shared includes a large screen device.

The device information to be shared may include one or more devices to be shared, and the accessory device information may include one or more accessory devices; the device to be shared is a device capable of establishing communication connection with the first device, and the auxiliary device is a device capable of establishing wireless connection with the first device.

Illustratively, the second interface may be a user interface 83 as shown in fig. 8C, and the user interface 83 may include device information 831 to be shared, and accessory device information 832. The device to be shared information 831 is used for displaying devices discovered by the first device; the accessory device information 832 is used to display the accessory device of the first device. It should be noted that, in other implementations, the first interface and the second interface may be the same interface, and the user interface 82 and the user interface 83 are only interfaces provided by way of example in the embodiments of the present application, and should not be construed as limiting the present application.

In some embodiments, the first device may respond to the sharing operation for the media data (e.g., the user operation for the sharing control 822 shown in fig. 8B) by scanning devices available for connection within a preset range in the vicinity of the device discovery function, for example, performing device discovery through a local area network or bluetooth; further, the first device may display device information to be shared and auxiliary device information, where the device information to be shared includes one or more devices discovered through device discovery function scanning, and the auxiliary device information includes one or more devices to which the first device is currently connected.

For example, the devices found by the first device are a large screen device a, a large screen device B and a PC, and the accessory devices of the first device are a smart watch and a wireless earphone, then the first device may display a user interface 83 as shown in fig. 8C, where the user interface 83 includes device information 831 to be shared and accessory device information 832, and the device information 831 to be shared is used to display the devices found by the first device; the accessory device information 832 is used to display the accessory device of the first device.

In one implementation, the first device may determine, from the discovered devices, a device having a display function as a device to be shared; that is, the devices in the device information to be shared are all devices with display functions. If the device scanned by the device discovery function of the first device does not have the display function, the first device does not display the device.

S105, the first device responds to the user operation of the selected wearable device, and determines that the second device is the wearable device.

Wherein the wearable device may be one or more. It should be noted that, taking the wearable device as an example, in other embodiments, the device selected by the user may be other accessory devices, such as a sound box, etc.

In some embodiments, the user may select one or more wearable devices from the accessory device information displayed by the first device, and accordingly, the first device determines that the shared accessory device is the wearable device in response to a user operation of the user selecting the wearable device. For example, the accessory device information displayed by the first device, which includes the smart watch and the wireless headset, is shown in fig. 8C, and the first device determines the smart watch as the second device in response to a user's selection operation with respect to the smart watch.

The first device may determine that the third device is the large screen device in response to a user operation for the large screen device S106.

In some embodiments, the first device may display device information to be shared, where the device information to be shared includes a large screen device; and the first device determines that the third device is the large-screen device when detecting the user operation of the user on the large-screen device.

And S107, the first device responds to the user operation shared to the large-screen device and sends a first message to the large-screen device, wherein the first message comprises the identification of the media data and the device information of the wearable device.

The device information of the wearable device may include a name or MAC address of the wearable device; the identification of the media data is used to obtain the media data, e.g., the identification of the media data may be a uniform resource identifier (Uniform Resource Identifier, URI), e.g., the media data is a video, then the identification of the media data may be the URI of the video.

In one implementation, a first device sends an identification of media data to a large screen device along with device information of a wearable device in response to a user operation shared to the large screen device. For example, referring to fig. 8C, the first device, upon detecting a user operation for the connection control 833, transmits media data and device information of the smart watch to the large screen device a.

In another implementation, the first device may also send the identification of the media data and the device information of the wearable device to the large screen device, respectively. For example, the first device may first send media data to the large screen device when it is determined that the third device is the large screen device; and when the second device is determined to be the wearing device, the device information of the wearing device is sent to the large-screen device.

In other embodiments, the first device may send the media data and the device information of the wearable device to the large screen device, where the media data may be stored locally by the first device or may be acquired by the first device from another device, which is not limited herein.

And S108, the large screen device plays the media data based on the identification of the media data.

In some embodiments, the large screen device may obtain the media data based on the identification of the media data after receiving the identification of the media data from the first device; further, the media data is played. For example, the URI of the video is identified as the media data, and the large screen device may acquire the video from the server based on the URI after receiving the URI of the video; further, the video is played.

In other embodiments, the large screen device may play the media data after receiving the media data from the first device. For example, the media data is video, and the large screen device may play the video after receiving the video.

And S109, after receiving the device information of the wearable device, the large-screen device transmits connectable directional broadcast.

The device information of the wearable device is used for verifying whether the connecting device is the wearable device or not when the large-screen device receives the connection request; the connectible directional broadcast includes device information for the large screen device.

In some embodiments, the large screen device, upon receiving the device information of the wearable device, may send a directional connectible broadcast for the wearable device for allowing only the wearable device to connect.

It should be noted that broadcast types can be divided into four types: connectable Undirected EVENT TYPE (connectible Non-oriented), connectable DIRECTED EVENT TYPE (connectible oriented), scannable Undirected EVENT TYPE (scannable Non-oriented), and Non-connectable Undirected EVENT TYPE (Non-connectible Non-oriented). In the embodiment of the application, the large-screen equipment adopts connectable orientation type for broadcasting.

And S110, the large-screen device sends a response message to the first device, wherein the response message is used for indicating that the large-screen device starts connectable directional broadcasting.

In some embodiments, the large screen device may send a connection request to the first device after broadcasting the connectable signal, the connection request being for requesting the wearable device to connect.

And S111, after receiving the response message, the first device sends a second message to the wearable device, wherein the second message is used for indicating the wearable device to establish wireless connection with the large-screen device, and the second message comprises the device information of the large-screen device.

In some embodiments, the first device sends device information of the large screen device to the accessory device after receiving the connection request. The device information of the large-screen device may include a name or a MAC address of the large-screen device.

In one implementation, the first device sends a second message, specifically a bluetooth instruction, to the wearable device through bluetooth communication.

And S112, after the wearable device receives the second message, the Bluetooth communication connection is established with the large-screen device based on the device information of the large-screen device.

In some embodiments, after the wearable device obtains the device information of the large-screen device from the second message, initiating connection to the large-screen device, that is, sending a connection request to the large-screen device, where the connection request includes the device information of the wearable device; and when verifying that the equipment in the connection request is equipment information of the wearable equipment sent by the first equipment, the large-screen equipment establishes Bluetooth communication connection with the wearable equipment.

In other embodiments, after the wearable device obtains the device information of the large-screen device from the second message, the wearable device discovers the large-screen device through bluetooth, that is, determines that the device information in the connectable directional broadcast is the device information of the large-screen device; furthermore, initiating connection to the large-screen device, namely sending a connection request to the large-screen device, wherein the connection request comprises device information of the wearable device; and when verifying that the equipment in the connection request is equipment information of the wearable equipment sent by the first equipment, the large-screen equipment establishes Bluetooth communication connection with the wearable equipment.

And S113, the wearable device sends user data to the large-screen device based on the Bluetooth communication connection.

In some embodiments, the wearable device may send the user data sent to the first device to the large screen device after establishing communication with the large screen device. The user data sent by the wearable device to the large-screen device may be the same as the user data sent to the first device in step S102, which is not described herein.

It should be noted that, after the wearable device sends the user data to the large-screen device, the wearable device may stop sending the user data to the first device; the user data may also continue to be sent to the first device, not limited herein.

And S114, after receiving the user data from the wearable device, the large screen device displays the user data.

In some embodiments, after receiving the user data from the wearable device, the large screen device may simultaneously display the media data sent by the first device and the user data sent by the wearable device on the display screen.

For example, after receiving yoga courses transmitted from the first device and user data from the smart watch, the large screen device may display a user interface 90 as shown in fig. 9, where the user interface 90 may include a main window 901 and an auxiliary window 902, where the main window 901 is used to display the yoga courses; the auxiliary window 902 is used to display smart watch data.

In other embodiments, after receiving the data of the accessory device, the third device may play the data through the microphone, where the processing of the received data by the third device is not limited.

As shown in fig. 10, in the method embodiment shown in fig. 10, a first device sends a first message to a large screen device; and when receiving the response message sent by the large-screen device, sending a second message to the wearable device. It should be noted that, the first device may not need to wait for a response message from the wearable device or the large-screen device, and the first device may send the first message to the large-screen device and send the second message to the wearable device at the same time.

In other embodiments, the first device may also send the second message to the wearable device first, and then send the first message to the large-screen device, which may specifically be referred to in the embodiment shown in fig. 11 below. Note that the first message in fig. 10 is different from the first message in fig. 11, and the second message in fig. 10 is different from the second message in fig. 11. Taking the first message as an example, the first messages in fig. 10 and fig. 11 are used for indicating the large-screen device to establish a communication connection with the wearable device, but specific contents carried by the first messages in fig. 10 and fig. 11 may be different, and the first message in fig. 10 is specifically used for indicating the large-screen device to send a connectable directional broadcast for the wearable device; the first message in fig. 11 is specifically used to initiate a bluetooth connection to the wearable device, and specifically can refer to the related descriptions in fig. 10 and fig. 11, which are not described herein.

It should be noted that, the foregoing steps S104 to S107 exemplarily provide one implementation of determining, by the first device, the media data, the third device, and the second device based on the user operation, and should not be construed as limiting the embodiments of the present application.

In other embodiments, the third device and the second device may be default.

For example, the third device and the second device are a third device (such as a large screen device) and a second device (such as a wearable device) that the first device last shared data; a third device and a second device that last shared data by the first device may also be included in the user interface 82 shown in fig. 8B; the sharing control 822 is used for indicating to share the video resource corresponding to the current playing window 821 to the third device and the second device that last share data by the first device. Then, the first device may display the user interface 82, and further, when detecting the user operation of the user on the sharing control 822, step S107 is performed, where the first device sends the media data and the device information of the wearable device to the large-screen device in response to the user operation of the sharing control 822, that is, the user operation of the sharing control 822 is the user operation of the sharing to the large-screen device.

In the embodiment of the present application, the wireless connection between the wearable device and the large-screen device includes, but is not limited to, bluetooth connection, and other connection modes, such as a local area network, etc., which are not limited herein.

The following examples provide other implementations of a wearable device establishing a wireless connection with a large screen device.

In the embodiment shown in fig. 10, the wearable device is a device having a master (master) role and a slave (slave) role, and in wireless connection between the wearable device and the first device, the wearable device is a slave; in steps S109 to S112, the wearable device is a master. Wherein master is a device that actively initiates a connection, slave is a device that broadcasts to be discovered by other devices to connect.

In other embodiments, the wearable device does not have the capability of switching roles of a master (master) and a slave (slave), and the wearable device can establish a bluetooth communication connection between the wearable device and the large-screen device through the following method of fig. 11.

Referring to fig. 11, fig. 11 is a flowchart of a method for establishing wireless connection between a wearable device and a large-screen device according to an embodiment of the present application. It should be noted that, steps S109 to S112 may be replaced by steps S202 to S205.

And S201, the first device sends a second message to the wearable device, wherein the second message comprises device information of the large-screen device.

And S202, broadcasting the connectable directional broadcast by the wearable device after receiving the device information of the large-screen device.

The specific implementation of step S202 may refer to the relevant content of step S109, which is not described herein.

And S203, the wearable device sends a response message to the first device, wherein the response message is used for indicating that the wearable device starts the connectable directional broadcast.

The specific implementation of step S203 may refer to the relevant content of step S110, which is not described herein.

And S204, after receiving the response message, the first device sends a first message to the large-screen device, wherein the first message is used for indicating the wearable device to establish wireless connection with the large-screen device.

And S205, the large screen device responds to the first message and establishes Bluetooth communication connection with the wearable device.

In some embodiments, after receiving the first message, the large screen device initiates a bluetooth connection to the wearable device to establish a bluetooth communication connection with the wearable device. The device information of the wearable device may be sent by the first device to the large screen device in step S107; the first message may also be, but not limited to, the first message carrying the device information of the wearable device so as to be sent to the large-screen device in step S204.

In still other embodiments, the wearable device and the large screen device may establish a wireless connection over a local area network.

In one implementation, a first device may send a first message to a large screen device, the first message including a multicast address of a local area network. Furthermore, the large-screen device can broadcast a multicast message based on the multicast address of the local area network, wherein the multicast message comprises the device information of the large-screen device; the large screen device sends a response message to the first device, wherein the response message is used for indicating that the large screen device starts multicast. After receiving the response message, the first device sends a second message to the wearable device, wherein the second message is used for indicating the wearable device to establish wireless connection with the large-screen device, and the second message comprises device information of the large-screen device. After receiving the second message, the large screen device can start to monitor the multicast message; and when the device information in the multicast message is monitored to be the device information of the large-screen device, establishing wireless connection with the large-screen device. The device information of the large-screen device may be a MAC address of the large-screen device.

The embodiment of the application also provides equipment, which comprises one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, the one or more memories being operable to store program code, the program code comprising instructions that, when executed by the one or more processors, cause the apparatus to perform the methods described in the above embodiments.

The embodiments of the present application also provide a program product comprising instructions which, when run on a device, cause the device to perform the method described in the above embodiments.

The embodiment of the application also provides a readable storage medium comprising instructions which, when executed on a device, cause the device to perform the method described in the above embodiment.

It is understood that the embodiments of the present application may be arbitrarily combined to achieve different technical effects.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a program product. The program product includes one or more instructions. The program instructions, when loaded and executed on a device, produce, in whole or in part, a process or function in accordance with the present application. The program instructions may be stored in a readable storage medium or transmitted from one readable storage medium to another. The readable storage medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk Solid STATE DISK), etc.

Those skilled in the art will appreciate that implementing all or part of the above-described embodiment methods may be accomplished by a program to instruct related hardware, the program may be stored in a readable storage medium, and the program may include the above-described embodiment methods when executed. And the aforementioned readable storage medium includes: ROM or random access memory RAM, magnetic or optical disk, etc.

In summary, the foregoing description is only exemplary embodiments of the present application and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of the present application should be included in the protection scope of the present application.

Claims

1.A method of device connection, the method comprising:

the method comprises the steps that a first device displays an interface, wherein the interface comprises media data, and a second device is a device which establishes wireless connection with the first device;

The first device sends a first message to a third device and a second message to the second device in response to a first operation on the media data, wherein,

The first message comprises media information and equipment information of the second equipment, the first message is used for indicating the third equipment to display the media data and establish wireless connection with the second equipment, and the media information comprises the media data or identification of the media data;

The second message includes device information of the third device, and the second message is used for indicating that the second device establishes wireless connection with the third device.

2. The method according to claim 1, wherein the method further comprises:

the first device displaying a connectable device of the first device and an accessory device of the first device in response to a second operation on the media data, the connectable device including the third device, the accessory device being a device that has established a connection with the first device, the accessory device including the second device;

the first device determining, in response to a third operation on the connectable device, that the selected connectable device is the third device;

The first device determines that the selected accessory device is the second device in response to a fourth operation on the accessory device.

3. The method of claim 1 or 2, wherein the first message further comprises indication information for indicating turning on a directional connectible broadcast for the second device, the method further comprising:

The first device receiving a first response message from the third device, the first response message being for indicating that the third device has turned on a directional connectable broadcast for the second device;

The sending a second message to the second device includes: and the first equipment sends the second message to the second equipment after receiving the first response message.

4. The method of claim 1 or 2, wherein the second message further comprises indication information for indicating turning on a directional connectible broadcast for the third device, the method further comprising:

The first device receives a second response message sent by the second device after sending the second message, wherein the second response message is used for indicating that the second device has started a directional connectable broadcast for the third device;

the sending the first message to the third device includes: and the first device sends the first message to the third device after receiving the second response message.

5. The method of any of claims 1-4, wherein the second message is further for instructing the second device to send data collected by the second device to the third device, the third device for displaying the data collected by the second device, the method further comprising:

The first device receives data collected from the second device;

the first device displays the media data and the data collected by the second device.

6. The method of any of claims 1-4, wherein the media data comprises display data and audio data of a target video; the first message is further used for indicating the third device to send the audio data to the second device, the second device is used for playing the audio data, and the third device is used for displaying the display data.

7. A method of device connection, the method comprising:

A second device receives a second message sent by a first device, wherein the second message comprises device information of a third device, the second message is used for indicating the second device to establish wireless connection with the third device, the first device is used for sending a first message to the third device when receiving a first operation on media data, the media data is displayed on a display interface of the first device, the first message comprises media information and device information of the second device, the first message is used for indicating the third device to display the media data and establish wireless connection with the second device, and the media information comprises the media data or an identification of the media data;

the second device establishes a wireless connection with the third device in response to the second message.

8. The method of claim 7, wherein the second message further comprises indication information for indicating that the second device initiates a bluetooth connection to the third device, the second message being sent to the second device by the first device after receiving a first response message from the third device, the first response message indicating that the third device has turned on a directionally-connectible broadcast for the second device;

The second device establishing a wireless connection with the third device in response to the second message, comprising:

9. The method of claim 7, wherein the second message further comprises indication information for indicating turning on a directional connectible broadcast for the third device;

The second device responding to the second message, starting a directional connectable broadcast for the third device;

The second device sending a second response message to the first device, the second response message indicating that the second device has turned on a directional connectible broadcast for the third device;

and the second equipment establishes Bluetooth communication connection with the third equipment when the third equipment initiates Bluetooth connection.

10. The method of any of claims 7-9, wherein the second message is further for instructing the second device to send data collected by the second device to the third device, the method further comprising:

The second equipment collects motion data of a user;

And after the second device establishes wireless connection with the third device, the second device sends the data acquired by the second device to the third device, and the third device is used for displaying the data acquired by the second device.

11. A method of device connection, the method comprising:

A third device receives a first message sent by a first device, wherein the first message is used for indicating the third device to establish wireless connection with a second device, the first message comprises media information and device information of the second device, the second device is a device for establishing wireless connection with the first device, and the media information comprises media data or an identifier of the media data;

The third device displaying the media data in response to the first message;

the third device establishes a wireless connection with the second device.

12. The method of claim 11, wherein the first message further comprises indication information indicating that a directional connectible broadcast is turned on for the second device,

The third device establishes a wireless connection with the second device, comprising:

The third device, in response to the first message, initiating a directional connectible broadcast for the second device;

The third device sending a first response message to the first device, the first response message being used to indicate that the third device has turned on the directionally connectable broadcast;

And the third device establishes Bluetooth communication connection with the second device when the second device initiates Bluetooth connection.

13. The method of claim 11, wherein the first message further comprises indication information for indicating that the second device initiates a bluetooth connection to the third device, the first message being sent to the third device by the first device after receiving a second response message from the second device, the second response message indicating that the second device has turned on the directionally-connectable broadcast;

The second device initiates a bluetooth connection to the third device in response to the first message.

14. The method according to any one of claims 11-13, further comprising:

The third device receives motion data sent by the second device, wherein the motion data is data acquired by the second device;

The third device displays the motion data.

15. The method of any of claims 11-13, wherein the media data includes display data and audio data corresponding to the target video; the first message is further used for instructing the third device to send the audio data to the second device;

The third device displaying the media data in response to the first message, comprising:

the third device displays the display data;

The method further comprises the steps of: the third device sends the audio data to the second device, and the second device is used for playing the audio data.

16. An apparatus comprising one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, the one or more memories to store program code comprising instructions that, when executed by the one or more processors, cause the apparatus to perform the method of any of claims 1-15.

17. A readable storage medium comprising instructions which, when executed on a device, cause the device to perform the method of any of claims 1-15.

18. A device connection system, characterized in that the system comprises a first device for performing the method of any of claims 1-6, a second device for performing the method of any of claims 7-10, and a third device for performing the method of any of claims 11-15.