WO2024109443A1

WO2024109443A1 - Device connection method, device and system

Info

Publication number: WO2024109443A1
Application number: PCT/CN2023/127427
Authority: WO
Inventors: 蔡鹏程; 黎亮齐; 芦东泽; 方峰; 裴政
Original assignee: 华为技术有限公司
Priority date: 2022-11-23
Filing date: 2023-10-28
Publication date: 2024-05-30
Also published as: CN118075916A

Abstract

The present application provides a device connection method, a device and a system. The method comprises: a first device displays an interface, wherein the interface comprises media data, and a second device is a device that establishes a wireless connection with the first device; and in response to a first operation for the media data, the first device sends a first message to a third device and sends a second message to the second device, wherein the first message comprises media information and device information of the second device, the first message is used for instructing the third device to display the media data and establish a wireless connection with the second device, the media information comprises the media data or an identifier of the media data, the second message comprises device information of the third device, and the second message is used for instructing the second device to establish a wireless connection with the third device. By implementing embodiments of the present application, in the scene that a first device shares data with a third device, a user controls, by means of the first device, a second device to establish communication with the third device, so that the connection between devices can be easily and efficiently realized.

Description

Device connection method, device and system

This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on November 23, 2022, with application number 202211475139.2, and priority to the Chinese patent application with the invention name “A device connection method, device and system”, all contents of which are incorporated by reference in this application.

Technical Field

The embodiments of the present application relate to communication technology, and more particularly to a device connection method, device and system.

Background technique

When using a device, the user can add other devices as the accessory devices of the device, so that the device and the accessory devices can transmit data. For example, when a user uses a sports application on a mobile phone to exercise, the mobile phone can establish a communication connection with the wearable device, and then the wearable device is added as an accessory device of the mobile phone; then, after collecting the user's heart rate, calories, exercise posture, exercise duration, number of steps, and number of active hours, the wearable device can send the exercise information to the mobile phone; the mobile phone can display the exercise information sent by the wearable device for the user to exercise.

In some scenarios, users want to share the data of a device and its attached devices with other devices. For example, when a user exercises based on the mobile phone application and the exercise information of the wearable device, due to the small screen of the mobile phone and the inconvenience of holding the mobile phone while exercising, the user wants to share the mobile phone application and the exercise information of the wearable device with a large-screen device. However, the current sharing method often requires the user to manually adjust the connection relationship between the mobile phone, wearable device and large-screen device, which is complicated to operate and has poor real-time performance.

Therefore, how to conveniently and efficiently achieve connections between multiple devices is a problem that needs to be solved urgently.

Summary of the invention

The present application provides a device connection method, device and system. In the device connection method, in a scenario where a first device shares data with a third device, a user can control a second device to establish communication with a third device through the first device without manually operating the second device and the third device. The connection between devices can be achieved conveniently and efficiently, thereby improving the user experience.

A first aspect provides a device connection method, the method comprising: a first device displays an interface, the interface includes media data, and a second device is a device that establishes a wireless connection with the first device; the first device sends a first message to a third device in response to a first operation on the media data, and sends a second message to the second device, wherein the first message includes media information and device information of the second device, the first message is used to instruct the third device to display media data and establish a wireless connection with the second device, the media information includes media data or an identifier of media data; the second message includes device information of the third device, and the second message is used to instruct the second device to establish a wireless connection with the third device.

By implementing the embodiment of the present application, the first device can display media data; then, in response to the user operation on the media data, the media data or the identifier of the media data is sent to the third device, and the second device and the third device are controlled to establish a communication connection. In this method, when the user shares data with the second device through the first device, the user only needs to operate on the first device, and the wireless connection between the second device and the third device can be realized. The user does not need to manually operate the second device and the third device, and the connection between the devices can be realized conveniently and efficiently, thereby improving the user experience.

In a possible implementation, in response to a first operation on media data, the first device first sends a first message to a third device; after sending the first message to the third device, the first device sends a second message to the second device.

In a possible implementation, in response to a first operation on media data, the first device first sends a second message to the second device; after sending the second message to the second device, the first device sends the first message to the third device.

In a possible implementation, in response to a first operation on media data, the first device sends a first message to a third device while sending a second message to a second device.

In combination with the first aspect, in a possible implementation manner, the method further includes:

The first device displays the connectable devices of the first device and the accessory devices of the first device in response to the second operation on the media data; the connectable devices include the third device; the accessory devices are devices that have established a connection with the first device, and the accessory devices include the second device; the first device determines that the selected connectable device is the third device in response to the third operation on the connectable devices; the first device determines that the selected accessory device is the second device in response to the fourth operation on the accessory device.

In the implementation of the present application, the first device may display the discovered connectable devices and the attached devices with which the connection has been established, and then, in response to The user operates to determine the third device from the connectable devices and the second device from the attached devices, so as to determine two devices with which the user wishes to establish a connection.

In combination with the first aspect, in a possible implementation, the first message also includes indication information for indicating the start of a directed connectible broadcast for the second device; the method also includes: the first device receives a first response message sent from a third device, the first response message is used to indicate that the third device has started a directed connectible broadcast for the second device; the first device sends a second message to the second device, including: after receiving the first response message, the first device sends the second message to the second device; the second message is used to instruct the second device to initiate a Bluetooth connection to the third device.

In implementing the embodiment of the present application, the first device can carry in the first message the indication information for indicating the start of the directional connectable broadcast for the second device, so that the third device can start the directional connectable broadcast for the second device; the third device can start the directional connectable broadcast and send a first response message to the first device, so that the first device sends a second message to the second device after determining that the second device has started the broadcast; the second message is used to instruct the second device to initiate a Bluetooth connection to the third device. In this method, the first device can control the second device and the third device to establish a Bluetooth communication connection, wherein the second device initiates the connection after the third device starts the directional connectable broadcast, which can improve the success rate of establishing the connection and reduce the power consumption during the connection between the second device and the third device.

In combination with the first aspect, in a possible implementation, the second message also includes indication information for indicating the start of a directed connectible broadcast for a third device; the method also includes: after sending the second message, the first device receives a second response message sent by the second device, the second response message is used to indicate that the second device has started a directed connectible broadcast for the third device; the first device sends a first message to the third device, including: after receiving the second response message, the first device sends the first message to the third device; the first message is used for the third device to initiate a Bluetooth connection to the second device.

By implementing the embodiments of the present application, the first device can control the second device and the third device to establish a Bluetooth communication connection, wherein the third device initiates a connection after the second device turns on a directional connectable broadcast, thereby improving the success rate of establishing a connection and reducing power consumption during the connection between the second device and the third device.

In combination with the first aspect, in a possible implementation manner, the second message is further used to instruct the second device to send data collected by the second device to a third device, and the third device is used to display the data collected by the second device; and the method further includes:

The first device receives data collected from the second device; the first device displays the media data and the data collected by the second device.

By implementing the embodiment of the present application, the first device can display media data and data collected by the second device; then, in response to user operation, the media data or the identifier of the media data is sent to the third device, and the second device and the third device are controlled to establish a wireless connection so that the second device sends the data collected by the second device to the third device, thereby realizing that only the operation is performed on the first device, and the third device can display the media data and the data collected by the second device. This method can conveniently and efficiently send the display content of the first device to the third device, wherein the display content includes the media data of the first device and the data of the auxiliary device (i.e., the second device).

In combination with the first aspect, in a possible implementation, the media data includes display data and audio data of the target video; the first message is also used to instruct the third device to send audio data to the second device, the second device is used to play the audio data, and the third device is used to display the display data.

A second aspect provides a device connection method, the method comprising:

The second device receives a second message sent by the first device, the second message includes device information of the third device, the second message is used to instruct the second device to establish a wireless connection with the third device, the first device is used to send a first message to the third device upon receiving a first operation on media data, the media data is displayed on a display interface of the first device, the first message includes media information and device information of the second device, the first message is used to instruct the third device to display media data and establish a wireless connection with the second device, the media information includes media data or an identifier of media data; the second device responds to the second message to establish a wireless connection with the third device.

In combination with the second aspect, in a possible implementation manner, the second message further includes instruction information for instructing the second device to initiate a Bluetooth connection to the third device, the second message is sent by the first device to the second device after receiving a first response message from the third device, and the first response message is used to indicate that the third device has enabled a directional connectable broadcast for the second device; the second device establishes a wireless connection with the third device in response to the second message, including:

In response to the second message, the second device initiates a Bluetooth connection to the third device.

In combination with the second aspect, in a possible implementation manner, the second message further includes instruction information for instructing to start a directional connectable broadcast for the third device; and the second device establishes a wireless connection with the third device in response to the second message, including:

The second device responds to the second message and starts a directed connectible broadcast for the third device; the second device sends a second response message to the first device, and the second response message is used to indicate that the second device has started a directed connectible broadcast for the third device; when the third device initiates a Bluetooth connection, the second device establishes a Bluetooth communication connection with the third device.

In conjunction with the second aspect, in a possible implementation manner, the second message is further used to instruct the second device to send a second device acquisition The method further comprises:

The second device collects the user's motion data; after establishing a wireless connection with the third device, the second device sends the data collected by the second device to the third device, and the third device is used to display the data collected by the second device.

A third aspect provides a device connection method, the method comprising:

The third device receives a first message sent by the first device, where the first message is used to instruct the third device to establish a wireless connection with the second device, the first message includes media information and device information of the second device, the second device is a device that establishes a wireless connection with the first device, and the media information includes media data or an identifier of media data; the third device responds to the first message and displays the media data; the third device establishes a wireless connection with the second device.

In combination with the third aspect, in a possible implementation manner, the first message further includes instruction information for instructing to start a directional connectable broadcast for the second device; and the third device establishes a wireless connection with the second device, including:

The third device responds to the first message and starts a directional connectable broadcast for the second device; the third device sends a first response message to the first device, and the first response message is used to indicate that the third device has started a directional connectable broadcast; when the second device initiates a Bluetooth connection, the third device establishes a Bluetooth communication connection with the second device.

In combination with the third aspect, in a possible implementation, the first message also includes instruction information for instructing the second device to initiate a Bluetooth connection to the third device. The first message is sent by the first device to the third device after receiving a second response message from the second device. The second response message is used to indicate that the second device has turned on directional connectable broadcasting; the third device establishes a wireless connection with the second device, including: the second device initiates a Bluetooth connection to the third device in response to the first message.

In combination with the third aspect, in a possible implementation, the method further includes: a third device receives motion data sent by the second device, where the motion data is data collected by the second device; and the third device displays the motion data.

In conjunction with the third aspect, in a possible implementation manner, the media data includes display data and audio data corresponding to the target video; the first message is further used to instruct the third device to send the audio data to the second device;

The third device displays the media data in response to the first message, including: the third device displays the display data;

The method also includes: the third device sends audio data to the second device, and the second device is used to play the audio data.

A fourth aspect provides a device, comprising one or more functional modules, which can be used to execute a device connection method as in any of the above aspects or any possible implementation of any of the aspects.

A fifth aspect provides a storage medium, comprising instructions, which, when executed on a device, enable the device to execute a device connection method in any of the above aspects or in any possible implementation manner of any of the aspects.

A sixth aspect provides a program product, which, when executed on a device, enables the device to execute a device connection method in any of the above aspects or in any possible implementation manner of any of the aspects.

A seventh aspect provides a chip, comprising: a processor and an interface, wherein the processor and the interface cooperate with each other so that the chip executes the device connection method in any of the above aspects or any possible implementation of any of the aspects.

The eighth aspect also provides a device connection system, comprising a first device, a second device and a third device. The first device is used to implement the method described in the first aspect or any possible implementation of the first aspect; the second device implements the method described in the second aspect or any possible implementation of the second aspect; the third device is used to implement the method described in the third aspect or any possible implementation of the third aspect.

It is understandable that the device provided in the fourth aspect, the readable storage medium provided in the fifth aspect, the program product provided in the sixth aspect, and the chip provided in the seventh aspect are all used to execute the method provided in the embodiment of the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a framework diagram of a device connection system provided in an embodiment of the present application;

FIG2 is a schematic diagram of the hardware structure of a device 100 provided in an embodiment of the present application;

FIG3 is a software structure block diagram of the device 100 provided in an embodiment of the present application;

FIG4 is a schematic diagram of the hardware structure of a device 200 provided in an embodiment of the present application;

FIG5 is a schematic diagram of a movie-watching scene provided by the present application;

FIG6 is a schematic diagram of a flow chart of a sports scene provided by the present application;

7A-7D are user interfaces for adding an auxiliary device provided by the present application;

8A-8C are user interfaces implemented on a first device exemplarily provided by the present application;

FIG9 is a user interface implemented on a third device exemplarily provided by the present application;

FIG10 is a schematic diagram of a flow chart of a device connection method provided in an embodiment of the present application;

FIG11 is a flow chart of a method for establishing a communication connection between a wearable device and a large-screen device provided in an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, "/" means or, for example, A/B can mean A or B; "and/or" in the text is only a description of the association relationship of the associated objects, indicating that there can be three relationships, for example, A and/or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

The term "user interface (UI)" in the following embodiments of the present application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on the device and finally presented as content that can be recognized by the user. The commonly used form of user interface is graphical user interface (GUI), which refers to an operation-related user interface displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of the device.

In order to more clearly and in detail introduce the device connection method provided in the embodiment of the present application, the device connection system provided in the embodiment of the present application is first introduced below.

Please refer to Figure 1, which is a framework diagram of a device connection system provided in an embodiment of the present application.

As shown in FIG. 1 , the device connection system may include a first device 10 , an auxiliary device 20 , and a third device 30 .

The accessory device 20 may include one or more devices; the accessory device 20 is a device that establishes a communication connection with the first device 10. For the convenience of description, the accessory device of the first device is referred to as the accessory device in the following embodiments, and no further description is given.

Among them, the first device 10 can be a device with input function (Figure 1 exemplarily shows that the first device 10 is a mobile phone); the accessory device 20 can be a wireless headset, a smart watch, a speaker and other devices (Figure 1 exemplarily shows that the accessory device 20 is a smart watch and a wireless headset); the third device 30 can be a device with display function (Figure 1 exemplarily shows that the third device 30 is a large-screen device).

In some embodiments, the first device 10 can establish a communication connection with one or more accessory devices 20. As shown in FIG. 1, the first device 10 establishes a communication connection with an accessory device 20 (eg, a smart watch, a wireless headset).

Furthermore, the first device 10 may determine the second device from the accessory device 20 in response to a user operation on the second device; when the first device 10 detects a user operation on the third device 30, in response to the user operation, the device information of the second device is sent to the third device 30; the first device 10 may send the device information of the third device 30 to the second device; further, the third device 30 may initiate a directional Bluetooth broadcast based on the device information of the second device, and the second device may initiate a Bluetooth connection request to the third device 30 based on the device information of the third device 30, thereby establishing a communication connection between the third device 30 and the second device. The device information of the second device may be the name or Media Access Control Address (MAC) of the second device, and the device information of the third device 30 may be the name or MAC address of the third device 30. The second device may be part or all of the devices in the accessory device 20.

It should be understood that the auxiliary device 20 and the first device 10 may both be devices of the same user; the auxiliary device 20 and the first device 10 may also be devices used by different users.

It should be noted that the first device 10, the auxiliary device 20 and the third device 30 can be different devices, or the same devices, or any two of the first device 10, the auxiliary device 20 and the third device 30 can be the same devices. The specific details can be determined according to different application scenarios and are not limited here.

The above-mentioned devices may include but are not limited to mobile phones, wearable devices (such as smart watches, etc.), personal computers (PC), tablets, monitors, televisions, desktop computers, laptop computers, handheld computers, notebook computers, super mobile personal computers, netbooks, augmented reality devices, virtual reality devices, artificial intelligence devices, vehicle-mounted devices, smart home devices and other devices.

It can be understood that the device connection system architecture in Figure 1 is only an exemplary implementation in the embodiment of the present application. The device connection system architecture in the embodiment of the present application includes but is not limited to the above device connection system architecture.

The following describes the device in FIG1 by taking the device 100 as an example. FIG2 shows a schematic diagram of the hardware structure of the device 100.

The following is a detailed description of the embodiment using the device 100 as an example. It should be understood that the device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

The device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a wireless headset interface 170D, Sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194 and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the device 100. In other embodiments of the present application, the device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated in one or more processors.

The controller may be the nerve center and command center of the device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (SIM) interface, and/or a universal serial bus (USB) interface, etc.

It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the device 100. In other embodiments of the present application, the device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The charging management module 140 is used to receive charging input from a charger, where the charger can be a wireless charger or a wired charger.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.

The wireless communication function of the device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

The mobile communication module 150 can provide solutions for wireless communications including 2G/3G/4G/5G applied on the device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) and the like applied on the device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify the signal, and convert it into electromagnetic waves for radiation through the antenna 2.

In some embodiments, antenna 1 of device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that device 100 can communicate with the network and other devices through wireless communication technology.

The device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel.

The device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

The ISP is used to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, and the light signal is converted into an electrical signal. The camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye.

The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element converts the optical signal into an electrical signal, which is then transmitted to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format.

The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

Video codecs are used to compress or decompress digital videos. Device 100 may support one or more video codecs. In this way, device 100 may play or record videos in multiple coding formats.

NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. The NPU can realize applications such as intelligent cognition of the device 100, such as face recognition, etc.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function.

The internal memory 121 can be used to store executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, applications required for at least one function (such as a fingerprint recognition function, etc.), etc. The data storage area can store data created during the use of the device 100 (such as fingerprint information templates, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, etc.

The device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the wireless headset interface 170D, and the application processor.

The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be set in the processor 110, or some functional modules of the audio module 170 are set in the processor 110. The speaker 170A, also known as the "speaker", is used to convert audio electrical signals into sound signals. The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 170C, also known as the "microphone" and "microphone", is used to convert sound signals into electrical signals. The wireless headset interface 170D is used to connect wired wireless headsets. The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. The gyroscope sensor 180B can be used to determine the motion posture of the device 100. The air pressure sensor 180C is used to measure the air pressure. The magnetic sensor 180D includes a Hall sensor. The acceleration sensor 180E can detect the magnitude of the acceleration of the device 100 in all directions (generally three axes). Distance sensor 180F, used to measure distance. Proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. Ambient light sensor 180L is used to sense ambient light brightness. Fingerprint sensor 180H is used to collect fingerprints. Temperature sensor 180J is used to detect temperature. Touch sensor 180K, also known as a "touch panel". Touch sensor 180K may be provided on display screen 194, and touch sensor 180K and display screen 194 form a touch screen, also known as a "touch screen". Touch sensor 180K is used to detect touch operations acting on or near it. Buttons 190 include a power button, a volume button, etc. Motor 191 can generate a vibration prompt. Indicator 192 can be an indicator light, which can be used to indicate the charging status, power change, and can also be used to synthesize requests, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card. In the embodiment of the present application, the device 100 can execute the device connection method through the processor 110.

FIG. 3 is a software structure block diagram of the device 100 provided in an embodiment of the present application.

The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

The application layer can include a series of application packages.

As shown in FIG. 3 , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, and sports health.

In some embodiments, the first device 10 is device 100, and the user can add devices such as mobile phones or smart watches as accessory devices of device 100 through the sports health application of device 100; the user can also send data to other devices through the sports health application, such as sending the identification of media data and the device information of the accessory device to a third device.

The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

As shown in Figure 3, the application framework layer may include a display manager, a sensor manager, a cross-device connection manager, an event manager, an activity manager, a window manager, a content provider, a view system, a resource manager, a notification manager, etc.

The display manager is used for system display management and is responsible for managing all display-related affairs, including creation, destruction, direction switching, size and state changes, etc. Generally speaking, there is only one default display module on a single device, that is, the main display module.

The sensor manager is responsible for the status management of the sensor, and manages the application to monitor sensor events and report the events to the application in real time.

The cross-device connection manager is used to establish communication connections with other devices.

The event manager is used for the system's event management service. It is responsible for receiving events uploaded from the bottom layer and distributing them to each window, completing tasks such as event reception and distribution.

The task manager is used to manage task (Activity) components, including startup management, life cycle management, task direction management, etc.

The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The window manager is also responsible for window display management, including window display mode, display size, display coordinate position, display level, etc.

Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of an icon or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window.

Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

The system library (also called the data management layer) can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL) and event data.

The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

A 2D graphics engine is a drawing engine for 2D drawings.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

Next, the embodiment of the present application takes the device 200 as an example to introduce the hardware structure and software structure of the third device 30.

As shown in FIG4 , the device 200 may include: a processor 222, a memory 223, a wireless communication module 224, a power switch 225, a display screen 229, and an audio module 230. In some embodiments, the device 200 may also include a wired LAN communication processing module 226, a high definition multimedia interface (HDMI) communication processing module 227, a USB communication processing module 228, etc. The above modules may be connected via a bus. Among them:

The processor 222 can be used to read and execute readable instructions. In a specific implementation, the processor 222 can mainly include a controller, an arithmetic unit and a register. Among them, the controller is mainly responsible for decoding instructions and sending control signals for operations corresponding to the instructions. The arithmetic unit is mainly responsible for performing fixed-point or floating-point arithmetic operations, shift operations, and logical operations, etc., and can also perform address operations and conversions. The register is mainly responsible for storing register operands and intermediate operation results temporarily stored during the execution of instructions. In a specific implementation, the hardware architecture of the processor 222 can be an application-specific integrated circuit (ASIC) architecture, a MIPS architecture, an ARM architecture, or an NP architecture, etc.

In an embodiment of the present application, the processor 222 can be used to parse the signal received by the wireless communication module 224, such as the new URL sent by the device 100, and obtain multiple videos and associated videos in the playlist according to the new URL.

The wireless communication module 224 may include a WLAN communication processing module. Optionally, the wireless communication module 224 may also include a Bluetooth (BT) communication processing module, an NFC processing module, a cellular mobile communication processing module (not shown), and the like.

In the embodiment of the present application, the wireless communication module 224 can be used to establish a communication connection with the device 100. The communication connection established by the wireless communication module 224 and the device 100 can be multiple. For example, the WLAN communication processing module can be used to establish a Wi-Fi direct communication connection with the device 100, the Bluetooth (BT) communication processing module can be used to establish a Bluetooth communication connection with the device 100, and the NFC processing module can be used to establish an NFC connection with the device 100, and so on.

In the embodiment of the present application, the wireless communication module 224 can also be used to establish a communication connection with the device 100, and receive a video stream sent by the device 100 based on the communication connection. The communication connection established between the wireless communication module 224 and the device 100 can be based on the HTTP protocol for data transmission, and the present application does not impose any restrictions on the communication connection type and data transmission protocol between devices.

The memory 223 is coupled to the processor 222 and is used to store various software programs and/or multiple sets of instructions. In a specific implementation, the memory 223 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices or other non-volatile solid-state storage devices. The memory 223 may store an operating system, such as an embedded operating system such as uCOS, VxWorks, RTLinux, etc. The memory 223 may also store a communication program, which may be used to communicate with the device 100, one or more servers, or an additional device.

The power switch 225 may be used to control the supply of power to the device 200 .

The wired LAN communication processing module 226 may be used to communicate with other devices in the same LAN via the wired LAN, and may also be used to connect to a WAN via the wired LAN and communicate with devices in the WAN.

The HDMI communication processing module 227 may be used to communicate with other devices via an HDMI interface (not shown).

The USB communication processing module 228 may be used to communicate with other devices via a USB interface (not shown).

The display screen 229 can be used to project pages, videos, etc. The display screen 229 can be LCD, OLED, AMOLED, FLED, QLED, etc. The content displayed on the display screen 229 can refer to the relevant description of the subsequent method embodiment.

In the embodiment of the present application, the display screen 229 can continuously play multiple videos based on the video streams of multiple videos such as the play list and associated videos sent by the server received by the wireless communication module 224.

Audio module 230. The audio module 230 can be used to output audio signals through the audio output interface, so that the device 200 can support audio playback. The audio module 230 can also be used to receive audio data through the audio input interface. The audio module 230 may include but is not limited to: a microphone, a speaker, a receiver, etc.

In some embodiments, the device 200 may also include a serial interface such as an RS-232 interface. The serial interface may be connected to other devices, such as an audio player such as a speaker, so that the display and the audio player cooperate to play audio and video.

It is understood that the structure shown in FIG4 does not constitute a specific limitation on the device 200. In other embodiments of the present application, the device 200 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

In some embodiments, device 200 may include the hardware included in device 100 shown in Figure 3. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

The software system of the device 200 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture, etc. Exemplarily, the software system of the device 200 may include but is not limited to Linux or other It operates the system. It is Huawei's Hongmeng system.

In some embodiments, the device 200 is an Android system, which is divided into four layers, namely, from top to bottom, an application layer, an application framework layer, an Android runtime and a system library, and a kernel layer. Among them, the application layer may include a screen projection management application for device connection and screen projection display, the application framework layer may include a cross-device connection manager, an event manager, a window manager and a display manager, etc., the system library may include a media library and event data, etc., and the kernel layer is used for device discovery, device authentication and device connection, etc. The specific contents of each part can be found in the relevant description in Figure 3, which will not be repeated here.

Based on the device connection system and the software and hardware structure of the device 100 described above, the device connection method provided in the embodiment of the present application is described in detail below.

The device connection method provided in the embodiment of the present application can be applied to a variety of scenarios, including but not limited to:

(1) Movie viewing scene

The first device is a device with input function, such as a device with a touch screen or keyboard that can receive user operations (such as a mobile phone, etc.); the third device is a device with display function (such as a large-screen device or PC); the auxiliary device is a device with playback function (such as wireless headphones or speakers).

In some embodiments, when a user operation is detected, the first device can establish a communication connection with a third device in response to the user operation; send media resources and device information of the accessory device to the third device, the media resources including image resources and audio resources; the third device can play the image resources; the third device sends the audio resources to the accessory device based on the device information of the accessory device, so that the user can view the image resources through the third device and listen to the audio resources through the accessory device.

In combination with the system shown in Figure 1, the movie-watching scene shown in Figure 5 is exemplarily shown, wherein the mobile phone in Figure 5 is the first device 10 in Figure 1, the wireless headset in Figure 5 is the accessory device 20 in Figure 1, and the large-screen device in Figure 5 is the third device 30 in Figure 1.

As shown in Figure 5, the wireless headset can be paired with a mobile phone, that is, the wireless headset is an accessory device of the mobile phone, and the user can wear the wireless headset to listen to the audio of the documentary played by the mobile phone; further, when the user wants to watch the documentary through a large-screen device and listen to the audio of the documentary through the wireless headset, the mobile phone can send the media resources of the documentary and the device information of the wireless headset to the large-screen device, and the media resources include the image resources and audio resources of the documentary; after obtaining the media resources, the large-screen device can establish a communication connection with the wireless headset based on the device information of the wireless headset and send the audio resources to the wireless headset; further, the large-screen device can play the image resources, and the wireless headset can play the audio resources.

By using the device connection method provided in the embodiment of the present application in a movie-watching scenario, the data of the first device (such as audio resources) can be transmitted to the auxiliary device (such as wireless headphones or speakers, etc.) through the first device, without the user having to manually operate the auxiliary device and the third device, thereby meeting the user's movie-watching needs. For example, if the user wants to watch a movie on a large screen in a home environment but does not want to disturb the viewing needs of family members, the user experience can be improved.

(2) Sports scenes

The first device is a device with input and display functions, and the first device can display sports videos; the auxiliary device can be a wearable device with information collection function, and the wearable device can collect the user's sports data; the third device can be a large-screen device with display function.

In some embodiments, the first device can respond to user operations, establish a communication connection with the large-screen device, and then send the motion video to the large-screen device; the first device can also respond to user operations to achieve a communication connection between the large-screen device and the wearable device, so that the wearable device sends the user's motion data to the large-screen device; then, the large-screen device can display the motion video and the user's motion data.

In combination with the system shown in Figure 1, the sports scene shown in Figure 6 is exemplarily shown, wherein the mobile phone in Figure 6 is the first device 10 in Figure 1, the smart watch in Figure 6 is the accessory device 20 in Figure 1, and the large-screen device in Figure 6 is the third device 30 in Figure 1.

As shown in Figure 6, when a user uses a mobile phone and a smart watch to exercise at home, the smart watch, as an accessory device of the mobile phone, can send the user's exercise data to the mobile phone, and then the mobile phone can display exercise videos and exercise data for the user to exercise. When the user wants to send exercise videos and exercise data to a large-screen device (such as a smart screen), the mobile phone can establish a communication connection with the smart screen to send the exercise video to the smart screen, and can also control the smart screen and the smart watch to establish a communication connection so that the smart watch sends the exercise data to the smart screen; then, the smart screen can display the exercise video sent by the mobile phone and the exercise data sent by the smart watch.

By using the device connection method provided in the embodiment of the present application in a sports scene, the data of the accessory device can be transmitted to the third device through the first device, which can avoid the delay caused by the data of the accessory device being sent to the third device via the first device, and the real-time nature of the data transmission can be ensured; the user does not need to manually operate the accessory device and the third device, which can improve the user experience.

It is understandable that the above scenarios are only examples, and the device connection method provided in the embodiments of the present application can also be applied to other scenarios, which are not limited here.

Taking the sports scene shown in FIG. 6 as an example, some user interfaces on the first device (such as a mobile phone) and the third device (such as a large-screen device) provided in an embodiment of the present application are introduced below.

7A-7D show an implementation method of adding an auxiliary device to a first device.

FIG7A shows an exemplary user interface 71 for displaying installed applications on the first device. The user interface 71 displays: an icon 711 of a sports health application, a status bar, and icons of other applications, etc. The status bar may include: one or more signal strength indicators of a mobile communication signal (also referred to as a cellular signal), one or more signal strength indicators of a Wi-Fi signal, a battery status indicator, a time indicator, etc.

As shown in FIG7A , the first device can detect a user operation acting on the icon 711 of the sports health application, and in response to the user operation, display the user interface 72 shown in FIG7B . The user interface 72 may include an add control 721 and other controls, such as a health control 722A, a sports control 722B, a device control 722C, and a my control 722D, etc., wherein the add control 721 is used to establish a communication connection with other devices; the health control 722A is used to display a health-related user interface, the sports control 722B is used to display a sports-related user interface, the device control 722C is used to display a user interface added by the device (the user interface 72 shown in FIG7B ), and the my control 722D is used to display personal information.

It should be noted that the first device can also display the user interface 72 in response to other controls (such as device control 722C) or through other methods. The user interface 72 is only an exemplary user interface provided in the embodiment of the present application and does not constitute a limitation on the present application.

In some embodiments, as shown in FIG7B , the first device may detect a user operation acting on the add control 721. In response to the user operation, the first device discovers nearby connectable devices and may display a user interface 73 as shown in FIG7C . The user interface 73 may display the discovered devices and the connection controls corresponding to the devices. FIG7C exemplarily shows that the devices sent by the first device include a weight scale, a wireless headset, and a smart watch, and the user interface 73 includes a connection control 731 corresponding to the weight scale, a connection control 732 corresponding to the wireless headset, and a connection control 733 corresponding to the smart watch.

The method for the first device to discover nearby devices is not limited here. For example, the first device can discover nearby Bluetooth devices via Bluetooth. When a weight scale, a wireless headset, and a smart watch are within the Bluetooth discovery range of the first device and Bluetooth is turned on, the first device can discover the weight scale, the wireless headset, and the smart watch via Bluetooth, and then display the user interface 73 shown in FIG7C.

As shown in FIG7C , when the first device detects a user operation on the connection control 733, it responds to the user operation, establishes a communication connection with the smart watch, and then displays a user interface 74 as shown in FIG7D . The user interface 74 includes an accessory device column 741 and an add control 721, wherein the accessory device column 741 is used to display devices with established communication connections, such as the smart watch displayed in the accessory device column 741.

In some embodiments, after adding an accessory device, the first device can receive data from the accessory device and then display the data of the accessory device. For example, after adding a smartwatch as an accessory device, when the first device receives smartwatch data sent by the smartwatch, as shown in FIG7D , the smartwatch data sent by the smartwatch can be displayed in the accessory device column 741.

In other embodiments, the user may also establish communication connections with multiple devices through the selection control on the user interface 73, that is, add the multiple devices as auxiliary devices of the first device, which is not limited in the present embodiment. For the convenience of description, the present embodiment only takes adding one device as an example.

Figures 8A-8C and 9 show a method for implementing the connection between a first device, an auxiliary device and a third device, wherein Figures 8A-8C are exemplary user interfaces implemented on the first device, and Figure 9 is an exemplary user interface implemented on the third device.

8A exemplarily shows a user interface 81 in a health and exercise application, which may be a user interface displayed by the first device when detecting a user operation on the exercise control 722B in the user interface 72. The user interface 81 may include controls for multiple courses, such as a course control 811.

As shown in FIG8A , when the first device detects a user operation on the course control 811, in response to the user operation, the first device may display a user interface 82 as shown in FIG8B . The user interface 82 may include a play window 821, a share control 822, and a display window 823. The play window 821 is used to play a video, such as a yoga course as shown in FIG8B ; the share control 822 is used to send the video resource corresponding to the current play window 821 to other devices; the display window 823 is used to display data sent by an accessory device. For example, if the accessory device of the current first device is a smart watch, the display window 823 may be the smart watch data as shown in FIG8B , and the smart watch data may include the heart rate and calories obtained by the smart watch in real time.

As shown in FIG8B , when the first device detects a user operation on the sharing control 822, in response to the user operation, the first device may display a user interface 83 as shown in FIG8C . The user interface 83 may include device information 831 to be shared, accessory device information 832, and a connection control 833. The device information 831 to be shared is used to display the devices discovered by the first device; the accessory device information 832 is used to display the accessory devices of the first device; and the connection control 833 is used to establish a connection with the selected device to be shared and to establish a connection between the selected device to be shared and the selected accessory device.

As shown in Figure 8C, the device information 831 to be shared exemplarily shows that the nearby devices sent by the first device are large-screen device A, large-screen device B and PC, and exemplarily shows the selection control 831A corresponding to large-screen device A, the selection control 831B corresponding to large-screen device B and the selection control 831C corresponding to PC; the accessory device information 832 exemplarily shows that the accessory devices currently connected to the first device are a smart watch and a wireless headset, and exemplarily shows the selection control 832A corresponding to the smart watch and the selection control 832B corresponding to the wireless headset.

In some embodiments, the user can select the large-screen device A as the third device and the smart watch as the second device. The first device can display The user interface 83 shown in FIG8C is shown. As shown in FIG8C , the selection control 831A corresponding to the large-screen device A and the selection control 832A corresponding to the smart watch are displayed as selected, and the selection control not marked with “√” is not selected. As shown in FIG8C , when the first device detects a user operation on the connection control 833, in response to the user operation, the video resource corresponding to the current playback window 821 and the device information of the smart watch are sent to the large-screen device A, so that the large-screen device A plays the video resource corresponding to the current playback window 821, and the large-screen device A establishes a wireless connection with the smart watch based on the device information of the smart watch to obtain the smart watch data.

In some embodiments, after receiving the video resource sent by the first device and the smartwatch data sent by the smartwatch, the large-screen device A may display a user interface 90 as shown in FIG9 . The user interface 90 may include a main window 901 and an auxiliary window 902, wherein the main window 901 is used to display the data sent by the first device, such as the yoga course shown in FIG9 ; the auxiliary window 902 is used to display the data sent by the auxiliary device, such as the smartwatch data shown in FIG9 .

The following is based on the scenario of Figure 6, taking the selected accessory device as a smart watch and the third device as a large-screen device as an example, a detailed introduction to the device connection method provided in an embodiment of the present application.

FIG10 exemplarily shows a device connection method flow provided in an embodiment of the present application. The device connection method may include some or all of the following steps:

S101: The first device and the wearable device establish a wireless connection.

Among them, the wearable device may include one or more devices, including but not limited to smart watches, smart bracelets, and smart glasses; the wireless connection established between the first device and the wearable device may include but is not limited to: Wi-Fi P2P wireless connection, Bluetooth wireless connection, etc.

In some embodiments, a sports health application is installed on the first device, and the user can establish a wireless connection with the wearable device through the user interface of the application, that is, add the wearable device as an auxiliary device of the first device. For example, see the relevant description of Figures 7A to 7D, which will not be repeated here.

S102: The wearable device sends the user data to the first device.

The user data may include the user's name and the user's exercise data, and the exercise data may include heart rate, calories, and exercise steps, etc.

In one implementation, the wearable device can send the user data to the first device after establishing a connection with the first device. For example, the wearable device is a smart watch, and the user wears the smart watch to exercise; then, after establishing a connection with the first device, the smart watch can send the collected user's exercise data to the first device in real time, and accordingly, after receiving the user data from the smart watch, the first device can display the user's exercise data.

In some embodiments, when the wearable device establishes a connection with the first device for the first time, a prompt message may be displayed, where the prompt message is used to prompt the user whether to send the user data to the first device; when the wearable device receives a user operation in which the user agrees to send the user data, the wearable device may send the user data to the first device; in subsequent connections, after the wearable device establishes a connection with the first device, the user data may be directly transmitted to the first device in real time.

S103: The first device displays the media data and the user data.

In some embodiments, the first device may display a first interface, which includes media data and user data, wherein the media data may be a video or an image, and the content of the media data is not limited here.

Exemplarily, the first interface may be a user interface 82 as shown in FIG8B , and the first device displays the user interface 82, which may include a play window 821 and a display window 823. The play window 821 is used to display media data, such as the yoga course shown in FIG8B ; the display window 823 is used to display data sent by an accessory device, such as a smart watch if the accessory device of the current first device is a smart watch, and the display window 823 may include smart watch data as shown in FIG8B , and the smart watch data may include heart rate and calories obtained in real time by the smart watch.

S104: In response to the sharing operation for the media data, the first device displays the device information to be shared and the accessory device information, wherein the accessory device information includes the wearable device, and the device information to be shared includes the large-screen device.

In some embodiments, the first device may display a second interface, which includes device information to be shared and accessory device information, wherein the accessory device information includes a wearable device, and the device information to be shared includes a large-screen device.

The device information to be shared may include one or more devices to be shared, and the accessory device information may include one or more accessory devices; the device to be shared is a device that can establish a communication connection with the first device, and the accessory device is a device that currently establishes a wireless connection with the first device.

Exemplarily, the second interface may be a user interface 83 as shown in FIG8C , and the user interface 83 may include device information 831 to be shared and accessory device information 832. The device information 831 to be shared is used to display the devices discovered by the first device; the accessory device information 832 is used to display the accessory devices of the first device. It should be noted that in other implementations, the first interface and the second interface may also be the same interface, and the user interface 82 and the user interface 83 are only exemplary interfaces provided in the embodiments of the present application, and should not constitute a limitation of the present application.

In some embodiments, the first device may respond to a sharing operation for the media data (eg, a sharing control 822 as shown in FIG. 8B ). The first device may scan the devices available for connection within a preset range nearby through a device discovery function, such as device discovery through a local area network or Bluetooth; further, the first device may display device information to be shared and accessory device information, wherein the device information to be shared includes one or more devices discovered through scanning by the device discovery function, and the accessory device information includes one or more devices currently connected to the first device.

For example, the devices discovered by the first device are large-screen device A, large-screen device B and PC, and the accessory devices of the first device are smart watches and wireless headphones. The first device can display a user interface 83 as shown in Figure 8C, where the user interface 83 includes device information 831 to be shared and accessory device information 832, wherein the device information 831 to be shared is used to display the devices discovered by the first device; the accessory device information 832 is used to display the accessory devices of the first device.

In one implementation, the first device can determine a device with a display function from the discovered devices as a device to be shared; that is, the devices in the device information to be shared are all devices with a display function. If the device scanned by the first device through the device discovery function does not have a display function, the first device does not display the device.

S105: In response to a user operation of selecting a wearable device, the first device determines that the second device is the wearable device.

The wearable device may be one or more. It should be noted that the wearable device is taken as an example here, and in other embodiments, the device selected by the user may also be other auxiliary devices, such as a speaker.

In some embodiments, the user can select one or more wearable devices from the accessory device information displayed by the first device, and accordingly, the first device determines that the shared accessory device is the wearable device in response to the user operation of selecting the wearable device. For example, the accessory device information displayed by the first device is shown in FIG8C, and the accessory device information includes a smart watch and a wireless headset. In response to the user's selection operation for the smart watch, the first device determines the smart watch as the second device.

S106: The first device may determine that the third device is the large-screen device in response to a user operation on the large-screen device.

In some embodiments, the first device may display device information to be shared, where the device information to be shared includes a large-screen device; when the first device detects a user operation on the large-screen device, the first device determines that the third device is the large-screen device.

S107: In response to the user operation of sharing to the large-screen device, the first device sends a first message to the large-screen device, where the first message includes an identifier of the media data and device information of the wearable device.

Among them, the device information of the wearable device may include the name or MAC address of the wearable device; the identifier of the media data is used to obtain the media data. For example, the identifier of the media data may be a Uniform Resource Identifier (URI). If the media data is a video, the identifier of the media data may be the URI of the video.

In one implementation, the first device sends the media data identifier and the device information of the wearable device to the large-screen device in response to the user operation of sharing to the large-screen device. For example, referring to FIG8C , when the first device detects the user operation on the connection control 833, the media data and the device information of the smart watch are sent to the large-screen device A.

In another implementation, the first device may also send the identifier of the media data and the device information of the wearable device to the large-screen device respectively. For example, when the first device determines that the third device is a large-screen device, it may first send the media data to the large-screen device; and then, when the first device determines that the second device is a wearable device, it may send the device information of the wearable device to the large-screen device.

In other embodiments, the first device can send media data and device information of the wearable device to the large-screen device, wherein the media data can be locally stored in the first device or obtained by the first device from other devices, which is not limited here.

S108: The large-screen device plays the media data based on the identifier of the media data.

In some embodiments, after receiving the identifier of the media data from the first device, the large-screen device can obtain the media data based on the identifier of the media data, and then play the media data. For example, if the identifier of the media data is a URI of a video, after receiving the URI of the video, the large-screen device can obtain the video from the server based on the URI, and then play the video.

In other embodiments, after receiving the media data from the first device, the large-screen device can play the media data. For example, if the media data is a video, the large-screen device can play the video after receiving the video.

S109: After receiving the device information of the wearable device, the large-screen device sends a connectable directional broadcast.

Among them, the device information of the wearable device is used to verify whether the connecting device is a wearable device when the large-screen device receives a connection request; the device information of the large-screen device can be connected to the directional broadcast.

In some embodiments, after receiving the device information of the wearable device, the large-screen device may send a directional connectable broadcast to the wearable device, where the directional connectable broadcast is used to allow only the wearable device to connect.

It should be noted that the broadcast type can be divided into four types: Connectable Undirected Event Type, Connectable Directed Event Type, Scannable Undirected Event Type and Non-connectable Undirected Event Type. In the embodiment of the present application, the large-screen device uses the connectable directional type for broadcasting.

S110: The large-screen device sends a response message to the first device, where the response message is used to indicate that the large-screen device has enabled connectable directional broadcasting.

In some embodiments, after broadcasting a connectable signal, the large-screen device may send a connection request to the first device, where the connection request is used to request the wearable device to connect.

S111: After receiving the response message, the first device sends a second message to the wearable device, where the second message is used to instruct the wearable device to establish a wireless connection with the large-screen device, and the second message includes device information of the large-screen device.

In some embodiments, after receiving the connection request, the first device sends the device information of the large-screen device to the auxiliary device, wherein the device information of the large-screen device may include the name or MAC address of the large-screen device.

In one implementation, the first device sends the second message to the wearable device via Bluetooth communication, and the second message is specifically a Bluetooth instruction.

S112: After receiving the second message, the wearable device establishes a Bluetooth communication connection with the large-screen device based on the device information of the large-screen device.

In some embodiments, after the wearable device obtains the device information of the large-screen device from the above-mentioned second message, it initiates a connection to the large-screen device, that is, sends a connection request to the large-screen device, and the connection request includes the device information of the wearable device; when the large-screen device verifies that the device in the connection request is the device information of the wearable device sent by the first device, it establishes a Bluetooth communication connection with the wearable device.

In other embodiments, after the wearable device obtains the device information of the large-screen device from the above-mentioned second message, it first discovers the large-screen device through Bluetooth, that is, determines that the device information in the above-mentioned connectable directional broadcast is the device information of the large-screen device; then, initiates a connection to the large-screen device, that is, sends a connection request to the large-screen device, and the connection request includes the device information of the wearable device; when the large-screen device verifies that the device in the connection request is the device information of the wearable device sent by the first device, it establishes a Bluetooth communication connection with the wearable device.

S113: The wearable device sends user data to the large-screen device based on the above Bluetooth communication connection.

In some embodiments, after the wearable device establishes communication with the large-screen device, the user data sent to the first device may be sent to the large-screen device. The user data sent by the wearable device to the large-screen device may be the same as the user data sent to the first device in step S102, and will not be repeated here.

It should be noted that after sending user data to the large-screen device, the wearable device can stop sending user data to the first device; or it can continue to send user data to the first device, which is not limited here.

S114: After receiving the user data from the wearable device, the large-screen device displays the user data.

In some embodiments, after receiving the user data from the wearable device, the large-screen device can simultaneously display the media data sent by the first device and the user data sent by the wearable device on the display screen.

For example, after receiving the yoga course sent from the first device and the user data from the smart watch, the large-screen device can display the user interface 90 as shown in Figure 9, which may include a main window 901 and a subsidiary window 902, wherein the main window 901 is used to display the yoga course; the subsidiary window 902 is used to display the smart watch data.

In other embodiments, after receiving the data from the auxiliary device, the third device may also play the data through a microphone. The processing of the received data by the third device is not limited here.

As shown in Figure 10, in the method embodiment shown in Figure 10, the first device first sends a first message to the large-screen device; when receiving a response message sent by the large-screen device, the first device sends a second message to the wearable device. It should be noted that the first device does not need to wait for a response message from the wearable device or the large-screen device. The first device can send the second message to the wearable device while sending the first message to the large-screen device.

In other embodiments, the first device may also send the second message to the wearable device first, and then send the first message to the large-screen device. For details, please refer to the embodiment shown in Figure 11 below. It should be noted that the first message in Figure 10 is different from the first message in Figure 11, and the second message in Figure 10 is different from the second message in Figure 11. Exemplarily, taking the first message as an example, the first messages in Figures 10 and 11 are both used to instruct the large-screen device to establish a communication connection with the wearable device, but the specific content carried by the first messages in Figures 10 and 11 may be different. The first message in Figure 10 is specifically used to instruct the large-screen device to send a connectable directional broadcast to the wearable device; the first message in Figure 11 is specifically used to initiate a Bluetooth connection to the wearable device. For details, please refer to the relevant descriptions in Figures 10 and 11, which will not be repeated here.

It should be noted that the above steps S104 to S107 exemplarily provide an implementation of the first device determining the media data, the third device and the second device based on the user operation, which should not limit the embodiments of the present application.

In other embodiments, the third device and the second device may be the default.

For example, the third device and the second device are the third device (such as a large-screen device) and the second device (such as a wearable device) with which the first device last shared data; the user interface 82 shown in FIG8B may also include the third device and the second device with which the first device last shared data; the sharing control 822 is used to indicate that the video resource corresponding to the current playback window 821 is shared with the third device and the second device with which the first device last shared data. Then, the first device may display the user interface 82, and then, upon detecting a user operation on the sharing control 822, execute S107: the first device sends the media data and the device information of the wearable device to the large-screen device in response to the user operation on the sharing control 822, that is, the user operation on the sharing control 822 is the above-mentioned user operation on the sharing control 822.

In the embodiment of the present application, the wireless connection established between the wearable device and the large-screen device includes but is not limited to a Bluetooth connection, and may also be other connection methods, such as a local area network, etc., which are not limited here.

The following examples provide other implementations of establishing a wireless connection between a wearable device and a large-screen device.

It should be noted that in the embodiment shown in FIG10 , the wearable device is a device capable of switching between the roles of a master and a slave. In the wireless connection between the wearable device and the first device, the wearable device is a slave; in steps S109 to S112, the wearable device is a master. The master is a device that actively initiates a connection, and the slave is a device that broadcasts to be discovered by other devices and then connected.

In other embodiments, the wearable device does not have the ability to switch between the master and slave roles, and the wearable device can establish a Bluetooth communication connection between the wearable device and the large-screen device through the method shown in FIG. 11 below.

Please refer to Figure 11, which is a flow chart of a method for establishing a wireless connection between a wearable device and a large-screen device provided in an embodiment of the present application. It should be noted that steps S109 to S112 in the above text can be replaced by steps S202 to S205 in the above text.

S201: The first device sends a second message to the wearable device, where the second message includes device information of the large-screen device.

S202: After receiving the device information of the large-screen device, the wearable device can connect the broadcast to the directional broadcast.

The specific implementation of step S202 can refer to the relevant content of step S109, which will not be repeated here.

S203: The wearable device sends a response message to the first device, where the response message is used to indicate that the wearable device has enabled connectable directional broadcasting.

The specific implementation of step S203 can refer to the relevant content of step S110, which will not be repeated here.

S204: After receiving the response message, the first device sends a first message to the large-screen device, where the first message is used to instruct the wearable device to establish a wireless connection with the large-screen device.

S205: The large-screen device establishes a Bluetooth communication connection with the wearable device in response to the first message.

In some embodiments, after receiving the first message, the large-screen device initiates a Bluetooth connection to the wearable device to establish a Bluetooth communication connection with the wearable device. The device information of the wearable device can be sent from the first device to the large-screen device in step S107, or the first message can carry the device information of the wearable device and be sent to the large-screen device in step S204, which is not limited here.

In some other embodiments, the wearable device and the large-screen device can establish a wireless connection through a local area network.

In one implementation, the first device may send a first message to the large-screen device, and the first message includes a multicast address of a local area network. Furthermore, the large-screen device may broadcast a multicast message based on the multicast address of the local area network, and the multicast message includes the device information of the large-screen device; the large-screen device sends a response message to the first device, and the response message is used to indicate that the large-screen device has turned on multicast. After receiving the response message, the first device sends a second message to the wearable device, and the second message is used to indicate that the wearable device establishes a wireless connection with the large-screen device, and the second message includes the device information of the large-screen device. After receiving the above-mentioned second message, the large-screen device may start to monitor the multicast message; when the device information in the multicast message is monitored as the device information of the large-screen device, a wireless connection is established with the large-screen device. Among them, the device information of the large-screen device may be the MAC address of the large-screen device.

An embodiment of the present application also provides a device, which includes one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store program codes, and the program codes include instructions. When the one or more processors execute the instructions, the device executes the method described in the above embodiment.

The embodiment of the present application also provides a program product including instructions, which, when executed on a device, enables the device to execute the method described in the above embodiment.

An embodiment of the present application also provides a readable storage medium, including instructions, which, when executed on a device, enable the device to execute the method described in the above embodiment.

It can be understood that the various embodiments of the present application can be combined arbitrarily to achieve different technical effects.

In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a program product. The program product includes one or more instructions. When the program instructions are loaded and executed on the device, the process or function described in this application is generated in whole or in part. The program instructions can be stored in a readable storage medium, or transferred from one readable storage medium to another readable storage medium. The readable storage medium can be a magnetic medium (for example, a floppy disk, a hard disk, a tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state drive Solid State Disk), etc.

Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by a program to instruct the relevant hardware, and the program can be stored in a readable storage medium. When the program is executed, it can include the processes of the above-mentioned method embodiments. The aforementioned readable storage medium includes: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

In short, the above is only an embodiment of the technical solution of this application, and is not intended to limit the protection scope of this application. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of this application should be included in the protection scope of this application.

Claims

A device connection method, characterized in that the method comprises:

The first device displays an interface, the interface includes media data, and the second device is a device that establishes a wireless connection with the first device;

In response to the first operation on the media data, the first device sends a first message to the third device and sends a second message to the second device, wherein:

The first message includes media information and device information of the second device, the first message is used to instruct the third device to display the media data and establish a wireless connection with the second device, and the media information includes the media data or an identifier of the media data;

The second message includes device information of the third device, and the second message is used to instruct the second device to establish a wireless connection with the third device.
The method according to claim 1, characterized in that the method further comprises:

In response to the second operation on the media data, the first device displays a connectable device of the first device and an accessory device of the first device, wherein the connectable device includes the third device, the accessory device is a device that has established a connection with the first device, and the accessory device includes the second device;

In response to a third operation on the connectable device, the first device determines that the selected connectable device is the third device;

In response to a fourth operation on the accessory device, the first device determines that the selected accessory device is the second device.
The method according to claim 1 or 2, characterized in that the first message further includes indication information for indicating to start a directional connectable broadcast for the second device, and the method further includes:

The first device receives a first response message sent by the third device, where the first response message is used to indicate that the third device has started a directional connectable broadcast for the second device;

The sending the second message to the second device includes: after the first device receives the first response message, the first device sends the second message to the second device.
The method according to claim 1 or 2, characterized in that the second message also includes indication information for indicating to start a directional connectable broadcast for the third device, and the method further includes:

After sending the second message, the first device receives a second response message sent by the second device, where the second response message is used to indicate that the second device has enabled a directional connectable broadcast for the third device;

The sending the first message to the third device includes: after the first device receives the second response message, sending the first message to the third device.
The method according to any one of claims 1 to 4, characterized in that the second message is further used to instruct the second device to send the data collected by the second device to the third device, and the third device is used to display the data collected by the second device, and the method further includes:

The first device receives data collected from the second device;

The first device displays the media data and the data collected by the second device.
The method according to any one of claims 1-4 is characterized in that the media data includes display data and audio data of the target video; the first message is also used to instruct the third device to send the audio data to the second device, the second device is used to play the audio data, and the third device is used to display the display data.
A device connection method, characterized in that the method comprises:

The second device receives a second message sent by the first device, the second message includes device information of the third device, the second message is used to instruct the second device to establish a wireless connection with the third device, the first device is used to send a first message to the third device when receiving a first operation on media data, the media data is displayed on a display interface of the first device, the first message includes media information and device information of the second device, the first message is used to instruct the third device to display the media data and establish a wireless connection with the second device, and the media information includes the media data or an identifier of the media data;

The second device establishes a wireless connection with the third device in response to the second message.
The method according to claim 7 is characterized in that the second message also includes instruction information for instructing the second device to initiate a Bluetooth connection to the third device, and the second message is sent by the first device to the second device after receiving a first response message from the third device, and the first response message is used to indicate that the third device has enabled a directional connectable broadcast for the second device;

The second device establishes a wireless connection with the third device in response to the second message, including:

The second device initiates a Bluetooth connection to the third device in response to the second message.
The method according to claim 7, characterized in that the second message further includes instruction information for instructing to start a directional connectable broadcast for the third device;

The second device establishes a wireless connection with the third device in response to the second message, including:

In response to the second message, the second device starts a directed connectable broadcast for the third device;

The second device sends a second response message to the first device, where the second response message is used to indicate that the second device has enabled a directional connectable broadcast for the third device;

When the third device initiates a Bluetooth connection, the second device establishes a Bluetooth communication connection with the third device.
The method according to any one of claims 7 to 9, wherein the second message is further used to instruct the second device to send data collected by the second device to the third device, and the method further comprises:

The second device collects motion data of the user;

After establishing a wireless connection with the third device, the second device sends the data collected by the second device to the third device, and the third device is used to display the data collected by the second device.
A device connection method, characterized in that the method comprises:

The third device receives a first message sent by the first device, where the first message is used to instruct the third device to establish a wireless connection with a second device, the first message includes media information and device information of the second device, the second device is a device that establishes a wireless connection with the first device, and the media information includes the media data or an identifier of the media data;

The third device displays the media data in response to the first message;

The third device establishes a wireless connection with the second device.
The method according to claim 11, characterized in that the first message further includes instruction information for instructing to start a directional connectable broadcast for the second device,

The third device establishes a wireless connection with the second device, including:

In response to the first message, the third device starts a directional connectable broadcast for the second device;

The third device sends a first response message to the first device, where the first response message is used to indicate that the third device has turned on the directional connectable broadcast;

When the second device initiates a Bluetooth connection, the third device establishes a Bluetooth communication connection with the second device.
The method according to claim 11, characterized in that the first message also includes instruction information for instructing the second device to initiate a Bluetooth connection to the third device, the first message is sent by the first device to the third device after receiving a second response message from the second device, and the second response message is used to indicate that the second device has turned on the directional connectable broadcast;

The third device establishes a wireless connection with the second device, including:

The second device initiates a Bluetooth connection to the third device in response to the first message.
The method according to any one of claims 11 to 13, characterized in that the method further comprises:

The third device receives the motion data sent by the second device, where the motion data is data collected by the second device;

The third device displays the motion data.
The method according to any one of claims 11 to 13, characterized in that the media data includes display data and audio data corresponding to the target video; the first message is also used to instruct the third device to send the audio data to the second device;

The third device displays the media data in response to the first message, including:

The third device displays the display data;

The method further includes: the third device sending the audio data to the second device, and the second device is used to play the audio data.
A device, characterized in that the device comprises one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store program codes, and the program codes include instructions, and when the one or more processors execute the instructions, the device executes the method as described in any one of claims 1-15.
A readable storage medium comprises instructions, wherein when the instructions are executed on a device, the device is caused to execute the method as claimed in any one of claims 1 to 15.
A device connection system, characterized in that the system includes a first device, a second device and a third device, the first device is used to execute the method as described in any one of claims 1-6, the second device is used to execute the method as described in any one of claims 7-10, and the third device is used to execute the method as described in any one of claims 11-15.