WO2022110939A1 - 一种设备推荐方法及电子设备 - Google Patents

一种设备推荐方法及电子设备 Download PDF

Info

Publication number
WO2022110939A1
WO2022110939A1 PCT/CN2021/114838 CN2021114838W WO2022110939A1 WO 2022110939 A1 WO2022110939 A1 WO 2022110939A1 CN 2021114838 W CN2021114838 W CN 2021114838W WO 2022110939 A1 WO2022110939 A1 WO 2022110939A1
Authority
WO
WIPO (PCT)
Prior art keywords
service
electronic devices
parameters
recommended
quality
Prior art date
Application number
PCT/CN2021/114838
Other languages
English (en)
French (fr)
Inventor
孙雪
余艳辉
Original Assignee
荣耀终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 荣耀终端有限公司 filed Critical 荣耀终端有限公司
Priority to EP21896443.5A priority Critical patent/EP4152756A4/en
Priority to US17/928,745 priority patent/US20230232066A1/en
Publication of WO2022110939A1 publication Critical patent/WO2022110939A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2807—Exchanging configuration information on appliance services in a home automation network
    • H04L12/2809—Exchanging configuration information on appliance services in a home automation network indicating that an appliance service is present in a home automation network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2805—Home Audio Video Interoperability [HAVI] networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1069—Session establishment or de-establishment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44227—Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4518—Management of client data or end-user data involving characteristics of one or more peripherals, e.g. peripheral type, software version, amount of memory available or display capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L2012/284—Home automation networks characterised by the type of medium used
    • H04L2012/2841—Wireless
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L2012/2847—Home automation networks characterised by the type of home appliance used
    • H04L2012/2849—Audio/video appliances

Definitions

  • the present application relates to the field of terminals, and in particular, to a device recommendation method and an electronic device.
  • the mobile phone and other devices can be triggered to jointly execute the screencasting service.
  • the mobile phone can project the display data played in the video to the TV in the home, and at the same time, the audio data played in the video can be projected to the speakers in the home for playback, so as to obtain a better video viewing experience.
  • service quality problems such as poor audio quality, poor display quality, or out-of-sync audio and video may occur due to differences in device performance.
  • the delay 1 generated by the speaker playing the above-mentioned audio data may be greater than that generated by the TV playing the above-mentioned display data.
  • delay 2 which causes the display data played by the TV to be out of sync with the audio data played by the speaker. Therefore, how to improve the service quality when multiple devices work together in a distributed scenario has become an urgent problem to be solved.
  • the present application provides a device recommendation method and an electronic device, which can recommend devices with higher service quality to users according to business requirements in a distributed scenario, so as to improve the service quality when multiple devices work together and improve the user experience. Use experience.
  • the present application provides a device recommendation method, which includes: a first device can receive a first operation of a user to open a first service; in response to the first operation, the first device can request data from N(N) located in the same communication network. It is an integer greater than 0) and obtains the device parameters associated with the first service respectively in the electronic devices; and then, the first device can predict, according to the obtained device parameters, the performance of each electronic device in the above-mentioned N electronic devices when the first service is performed.
  • the first device may display a device list according to the service quality of each electronic device in the N electronic devices performing the first service, where the device list includes the device identifier of at least one electronic device among the N electronic devices, so as to provide The user recommends a specific device suitable for executing the first service.
  • the above-mentioned first service may be a service related to an audio function, such as an audio playing service, a recording service, and the like.
  • the above-mentioned first service may be a service related to a display function, such as a video playing service, a video calling service, a game service, and the like.
  • the above-mentioned first service may be a service related to a camera function, such as a video call service, a video recording service, and the like.
  • the above-mentioned device parameters may include one or more of audio parameters related to audio functions, display parameters related to display functions, and camera parameters related to camera functions.
  • the first device as the master device can obtain relevant device parameters of the slave devices (for example, the above N electronic devices), so as to predict the service quality of each slave device when executing the service.
  • the first device can recommend the specific device that executes the service to the user by displaying the device list, thereby improving the service when multiple devices work together in a distributed scenario. quality, while improving the user experience.
  • the above-mentioned N electronic devices may include a second device; the device parameters obtained by the first device from the second device may include M (M is an integer greater than 0) parameters; in this case, The first device predicts the service quality of the first service performed by the second device according to the device parameters, including: the first device determines M scores corresponding to the M parameters one-to-one; further, the first device can calculate the first score according to the M scores.
  • the second device executes the service quality score of the first service; when the service quality score is higher, the service quality of the first service is higher.
  • the first device may score the M parameters of the second device one by one to obtain the corresponding M scores, and then the first device may perform a weighted average of the M scores according to the preset weights to obtain:
  • the second device executes the service quality score of the first service.
  • the service quality scores of other devices in the above N electronic devices that perform the first service can also be calculated according to the above method, which is not limited in this application.
  • the above-mentioned N electronic devices may further include a third device; when the service quality score of the second device executing the first service is higher than the service quality score of the third device executing the first service, the third device The arrangement order of the second device in the device list is before the third device. That is to say, the first device may recommend devices that perform related services to the user through the order of the devices in the displayed device list.
  • the second device when the service quality score of the second device executing the first service is higher than the service quality score of other electronic devices executing the first service among the N electronic devices, it is indicated that the second device is the above N electronic devices. If the device is the most suitable for executing the first service among the devices, the second device may be marked as a recommended device in the above device list, thereby prompting the user to use the recommended device to execute the first service.
  • the above-mentioned M parameters may include a first parameter corresponding to the first function, for example, a display parameter corresponding to the display function; then, when the score of the first parameter of the second device is higher than When the score of the first parameter of other electronic devices among the N electronic devices indicates that the second device performs the first function of the first service with high service quality, the first device can display the first prompt information in the above device list , and the first prompt information is used to recommend the user to use the second device to implement the first function. That is to say, the first device may recommend to the user a device with a more prominent function when executing the first service.
  • the above-mentioned M parameters include a first parameter corresponding to the first function, for example, a display parameter corresponding to the display function; then, when the score of the first parameter of the second device is lower than N
  • the first device can display the second prompt information in the above device list,
  • the second prompt information includes the reason why the user is not recommended to use the second device to implement the first function. That is, the first device may prompt the user for a specific reason why it is not recommended to use a certain device to perform the first service.
  • the above-mentioned N electronic devices include a second device; after the first device displays the device list according to the quality of service of each electronic device in the N electronic devices performing the first service, the device further includes: A device receives a second operation of the user selecting the second device in the device list; then, in response to the second operation, the first device may switch the first service to the second device for execution. In this way, the user can switch the first service to the second device based on the device recommended by the first device in the device list, so as to realize a distributed service scenario in which multiple devices work together.
  • the method further includes: the first device can download from the current slave device (for example, N number of devices located in the same communication network as the mobile phone) again.
  • the device parameters associated with the first service are respectively obtained from the electronic device); similarly, the first device can predict the service quality of each of the current N electronic devices executing the first service according to the obtained device parameters; when the second device If it is not the electronic device with the highest service quality among the above N electronic devices that executes the first service, it means that the first service is currently not suitable to be executed on the second device, then the first device can display the first prompt message, and the first prompt message uses For prompting the user to use the recommended device to perform the first service, the recommended device is one or more of the N electronic devices.
  • the first device as the master device, can obtain the relevant device parameters of each slave device in real time during the process of cooperating with other devices (such as the above-mentioned second device) to perform a certain service, so as to predict that each slave device will execute the service. quality of business.
  • the first device can recommend to the user a recommended device that executes the service by displaying a prompt message, thereby improving the service quality when multiple devices work together in a distributed scenario.
  • the user experience is improved.
  • the first device predicts, according to the device parameters, the service quality of each electronic device in the N electronic devices executing the first service, including: the first device may, according to the device parameters obtained from each electronic device, A service quality score for each electronic device to perform the first service is calculated. For example, the first device may score each of the device parameters corresponding to each electronic device, and then perform a weighted average of all scores to calculate a service quality score of the corresponding electronic device executing the first service.
  • the N electronic devices include a third device; when the service quality score of the third device executing the first service is higher than that of other electronic devices in the N electronic devices, the recommended device is the third device. three devices; or, when the service quality score of the third device performing the first subtask in the first service is higher than that of other electronic devices in the N electronic devices, the above-mentioned recommended device is the third device. That is to say, when a certain device other than the second device among the above-mentioned N electronic devices executes the first service, or the service quality of a certain subtask in the first service is relatively high, the first device may determine the device as recommended device, so that the user is recommended to use the recommended device to perform the first service.
  • the above-mentioned first service may include a first subtask and a second subtask.
  • the screen projection service may include an audio playback task and a display task;
  • the above-mentioned N electronic devices may include a third subtask device and fourth device.
  • the above recommended device is a device group composed of a third device and a fourth device. That is, when multiple devices cooperate to perform the first service, higher service quality can be obtained, the first device may recommend to the user in the form of a device group to use multiple devices to jointly execute the above-mentioned first service.
  • the above method further includes: the first device predicts a service quality score of the first device executing the first service; wherein, when the service quality score of the first device executing the first service is higher than the above N electronic devices device, the above-mentioned recommended device may be the first device. That is to say, the master device (ie, the first device) can also be used as a candidate device for the recommended device, and when the first device executes the target service (for example, the first service) with high service quality, it can also prompt the user to use the first device The device executes the above-mentioned first service.
  • the above-mentioned first prompt message may include a device identifier of the recommending device; after the first device displays the first prompt message, the method further includes: the first device receiving the user's selection of a recommendation in the first prompt message A third operation of the device; in response to the third operation, the first device switches the first service to the recommended device for execution.
  • the user can quickly switch the first service to the recommended device with higher service quality for execution through the device identifier of the recommended device in the first prompt message.
  • the above method further includes: the first device may notify the second device of the above-mentioned recommended device, so that the second device displays a second prompt message, where the second prompt message is used to prompt the user to use the recommended device to perform the first service.
  • the user can quickly switch the first service to the recommended device with higher service quality through the second prompt message in the second device for execution.
  • the above-mentioned device parameters may include one or more of audio parameters, display parameters, camera parameters or time delay.
  • the audio parameters may include one or more of the sound effect algorithm supported by the slave device, the number of channels, the sampling rate, the mixing strategy, the codec algorithm of audio data, the number and model of microphones, and the number and model of speakers.
  • the above-mentioned display parameters may include one or more items such as the resolution, frame rate, and codec algorithm of the display data supported by the slave device.
  • the above camera parameters may include one or more items such as image processing algorithms supported by the slave device, the number of cameras, the resolution of the cameras, or the FOV of the cameras.
  • the present application provides an electronic device (such as the above-mentioned first device), comprising: a communication module, a display screen, one or more processors, one or more memories, and one or more computer programs; wherein, The processor is coupled to the communication module, the display screen and the memory, the one or more computer programs described above are stored in the memory, and when the first device is running, the processor executes the one or more computer programs stored in the memory to make The first device executes the device recommendation method described in any of the above aspects.
  • the present application provides a computer-readable storage medium, including computer instructions, which, when the computer instructions are executed on the above-mentioned first device, cause the first device to execute the device recommendation method described in any one of the above-mentioned aspects.
  • the present application provides a computer program product that, when the computer program product runs on the above-mentioned first device, causes the first device to execute the device recommendation method described in any one of the above-mentioned aspects.
  • FIG. 1 is a schematic diagram of the architecture of a recommendation system provided by an embodiment of the present application
  • FIG. 2 is an interactive schematic diagram of a device recommendation method provided by an embodiment of the present application
  • FIG. 3 is a schematic structural diagram 1 of an electronic device provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram 1 of the architecture of an operating system of an electronic device according to an embodiment of the present application.
  • FIG. 5 is a second schematic diagram of the architecture of an operating system of an electronic device according to an embodiment of the present application.
  • FIG. 6 is a third schematic diagram of the architecture of an operating system of an electronic device according to an embodiment of the present application.
  • FIG. 7 is a schematic diagram 1 of an application scenario of an electronic device provided by an embodiment of the present application.
  • FIG. 8 is a fourth schematic diagram of the architecture of an operating system of an electronic device according to an embodiment of the present application.
  • FIG. 9 is a second schematic diagram of an application scenario of an electronic device according to an embodiment of the present application.
  • FIG. 10 is a schematic diagram 3 of an application scenario of an electronic device provided by an embodiment of the present application.
  • FIG. 11 is a fourth schematic diagram of an application scenario of an electronic device provided by an embodiment of the application.
  • FIG. 12 is a schematic diagram 5 of an application scenario of an electronic device provided by an embodiment of the present application.
  • FIG. 13 is a sixth schematic diagram of an application scenario of an electronic device provided by an embodiment of the application.
  • FIG. 14 is a seventh schematic diagram of an application scenario of an electronic device provided by an embodiment of the present application.
  • FIG. 15 is a schematic diagram eight of an application scenario of an electronic device provided by an embodiment of the present application.
  • FIG. 16 is a schematic diagram 9 of an application scenario of an electronic device provided by an embodiment of the present application.
  • FIG. 17 is a schematic diagram ten of an application scenario of an electronic device provided by an embodiment of the present application.
  • FIG. 18 is a schematic diagram eleventh of an application scenario of an electronic device provided by an embodiment of the present application.
  • FIG. 19 is a schematic diagram twelve of an application scenario of an electronic device provided by an embodiment of the present application.
  • FIG. 20 is a schematic diagram thirteen of an application scenario of an electronic device according to an embodiment of the present application.
  • FIG. 21 is a fourteenth schematic diagram of an application scenario of an electronic device provided by an embodiment of the application.
  • 22 is a fifteenth schematic diagram of an application scenario of an electronic device provided by an embodiment of the present application.
  • FIG. 23 is a second schematic structural diagram of an electronic device according to an embodiment of the present application.
  • a device recommendation method provided by this embodiment of the present application can be applied to the recommendation system 200 shown in FIG. 1 .
  • the recommendation system 200 may include a master device (master) 101 and N slave devices (slaves) 102 , where N is an integer greater than 0. Communication between the master device 101 and any one of the slave devices 102 may be performed in a wired manner or wirelessly.
  • a wired connection may be established between the master device 101 and the slave device 102 using a universal serial bus (USB).
  • the master device 101 and the slave device 102 can use the global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (code division multiple access) multiple access, CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), Bluetooth, wireless fidelity (Wi-Fi), NFC, voice over Internet protocol (VoIP), and communication protocols that support network slicing architecture establish wireless connections.
  • GSM global system for mobile communications
  • GPRS general packet radio service
  • code division multiple access code division multiple access
  • CDMA code division multiple access
  • WCDMA wideband code division multiple access
  • time division code division multiple access time-division code division multiple access
  • TD-SCDMA time-division code division multiple access
  • LTE long term evolution
  • Bluetooth wireless
  • the master device 101 may specifically be a mobile phone, a tablet computer, a TV (also referred to as a smart screen, a smart TV, or a large-screen device), a laptop, and an Ultra-mobile Personal computer.
  • Computer, UMPC handheld computer
  • netbook personal digital assistant
  • PDA Personal Digital Assistant
  • wearable electronic device vehicle-mounted device
  • virtual reality device virtual reality device and other electronic devices, which are not limited in the embodiments of the present application.
  • the master device 101 can switch one or more of its own services (for example, an audio playback service, a recording service, a video playback service, or a camera service, etc.) to be executed on the slave device 102, thereby presenting multiple devices.
  • a certain service may correspond to one or more functions in the application.
  • a video APP can provide a video playback service for realizing the screen projection function.
  • the audio APP may provide an audio playback service for implementing an audio playback function, and may also provide a karaoke service for implementing an audio recording function.
  • the master device 101 can switch a certain service to the slave device 102. At this time, the master device 101 can cooperate with the slave device 102 to execute the service.
  • the master device 101 may send the audio data being played to the slave device 102 , and the slave device 102 plays the audio data, thereby switching the audio playback service of the master device 101 to the slave device 102 for execution.
  • the master device 101 can send the display data in the video to one slave device 102 for playback, and simultaneously send the audio data in the video to another slave device 102 for playback, thereby switching the video playback service of the master device 101 to multiple slave devices.
  • Executed on device 102 .
  • a business may include one or more subtasks.
  • the above video playback service may include a display subtask related to a display function and an audio subtask related to an audio function.
  • the master device 102 may use the microphone of the slave device 102 to collect audio data, and send the collected audio data to the master device 101 for saving or playback, thereby switching the recording service of the master device 101 to the slave device 102 for execution.
  • the master device 102 may use the camera of the slave device 102 to collect captured images, and send the captured images to the master device 101 for display, thereby switching the camera service of the master device 101 to be executed on the slave device 102 .
  • the audio quality may deteriorate
  • the display quality may deteriorate
  • the audio and video may be out of sync, or time delay may occur due to differences in device performance and other reasons. Long-term and other service quality problems.
  • the master device 101 can predict the service quality when the current service is switched to a different slave device 102 for execution, and then the master device 101 can recommend to the user one or more of the above-mentioned services according to the prediction result. electronic device. In this way, the user can select an appropriate device according to the recommendation of the master device 101 to cooperate with the master device 101 to execute corresponding services, thereby improving the service quality when the master device 101 and the slave device 102 work together in a distributed scenario.
  • the master device 101 may establish a network connection with one or more slave devices 102 . Furthermore, when the master device 101 is ready to switch the service 1 to one or more slave devices 102 for execution, the master device 101 can acquire the device parameters associated with the service 1 from each slave device 102 .
  • the device parameters associated with the service 1 may include image processing algorithms supported by the slave device 102, the number of cameras, the resolution of the cameras, or the FOV of the cameras, and the like.
  • the device parameters associated with the service 1 may include the sound effect algorithm supported by the slave device 102, the number of channels, the sampling rate, the sound mixing strategy, and the speaker model.
  • the device parameters associated with the service 1 may include a voice processing algorithm supported by the slave device 102, an encoding and decoding algorithm for audio data, the number of microphones, and the like.
  • the device parameters associated with the service 1 may include the resolution, frame rate, and codec algorithm of the display data supported by the slave device 102 .
  • the master device 101 can predict the service quality of each slave device 102 executing the service 1 according to the acquired device parameters. Further, the master device 101 may determine the corresponding recommended device according to the service quality of each slave device 102 executing the service 1 . For example, the master device 101 may determine the slave device 102 that performs the service 1 with the highest service quality as the recommended device. Alternatively, after the master device 101 switches the service 1 to a certain slave device 102 for execution, that is, during the process of the master device 101 and the slave device 102 cooperating to execute a certain service, the master device 101 may obtain the data associated with the service 1 from each slave device 102. equipment parameters, and determine the corresponding recommended equipment according to the above method.
  • the main device 101 After the main device 101 determines the corresponding recommended device, it can recommend the determined recommended device to the user. For example, the main device 101 may display a prompt message, and the prompt message may carry the identifier of the recommended device. If it is detected that the user clicks on the identifier of the recommended device, the main device 101 can be triggered to switch the service 1 to the corresponding recommended device again for execution.
  • the user can timely know the specific device suitable for executing the above-mentioned service 1 in the current distributed scenario through the above-mentioned prompt message.
  • the user can quickly switch the specific device that executes the above-mentioned service 1 through the identifier in the above-mentioned prompt message, thereby improving the service quality when multiple devices work together in a distributed scenario, and at the same time improving the user's use experience.
  • FIG. 3 shows a schematic structural diagram of the mobile phone.
  • the mobile phone may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, Microphone 170C, headphone jack 170D, sensor module 180, etc.
  • a processor 110 an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, Microphone 170C, headphone jack 170D, sensor module 180, etc.
  • USB universal serial bus
  • the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the mobile phone.
  • the mobile phone may include more or less components than shown, or some components may be combined, or some components may be separated, or different component arrangements.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processor
  • graphics processor graphics processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
  • the wireless communication function of the mobile phone can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the mobile phone.
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .
  • the wireless communication module 160 can provide applications on the mobile phone including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system ( global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN wireless local area networks
  • Wi-Fi wireless fidelity
  • BT wireless fidelity
  • GNSS global navigation satellite system
  • frequency modulation frequency modulation
  • FM near field communication technology
  • NFC near field communication technology
  • infrared technology infrared, IR
  • the antenna 1 of the mobile phone is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the mobile phone can communicate with the network and other devices through wireless communication technology.
  • the mobile phone realizes the display function through the GPU, the display screen 194, and the application processor.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • Display screen 194 is used to display images, videos, and the like.
  • Display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
  • LED diode AMOLED
  • flexible light-emitting diode flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on.
  • the handset may include 1 or N display screens 194, where N is a positive integer greater than 1.
  • the mobile phone can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194 and the application processor.
  • Camera 193 is used to capture still images or video.
  • the object is projected through the lens to generate an optical image onto the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the mobile phone may include 1 or N cameras 193 , where N is a positive integer greater than 1.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example to save files like music, video etc in external memory card.
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the processor 110 executes various functional applications and data processing of the mobile phone by executing the instructions stored in the internal memory 121 .
  • the mobile phone can implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor. Such as music playback, recording, etc.
  • the audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .
  • Speaker 170A also referred to as a “speaker” is used to convert audio electrical signals into sound signals.
  • the mobile phone can listen to music through the speaker 170A, or listen to hands-free calls.
  • the receiver 170B also referred to as "earpiece" is used to convert audio electrical signals into sound signals.
  • the voice can be received by placing the receiver 170B close to the human ear.
  • the microphone 170C also called “microphone” or “microphone” is used to convert sound signals into electrical signals.
  • the user can make a sound by approaching the microphone 170C through a human mouth, and input the sound signal into the microphone 170C.
  • the mobile phone may be provided with at least one microphone 170C.
  • the mobile phone can be provided with two microphones 170C, which can realize noise reduction function in addition to collecting sound signals.
  • the mobile phone can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.
  • the earphone jack 170D is used to connect wired earphones.
  • the earphone interface 170D can be the USB interface 130, or can be a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
  • the mobile phone may also include a charging management module, a power management module, a battery, a button, an indicator, and one or more SIM card interfaces, which are not limited in this embodiment of the present application.
  • the software system of the above mobile phone may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the embodiments of the present application take an Android system with a layered architecture as an example to exemplarily describe the software structure of a mobile phone.
  • Android system with a layered architecture as an example to exemplarily describe the software structure of a mobile phone.
  • the functions implemented by each functional module are similar to the embodiments of the present application.
  • FIG. 4 is a block diagram of a software structure of a mobile phone according to an embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces.
  • the Android system is divided into five layers, from top to bottom, the application layer, the application framework layer (framework), the Android runtime (Android runtime) and the system library (libraries), HAL (hardware abstraction) layer, hardware abstraction layer) and the kernel layer (kernel).
  • the application layer can include a series of application packages.
  • APPs applications
  • applications such as calls, memos, browsers, contacts, cameras, gallery, calendars, maps, Bluetooth, music, videos, and short messages can be installed in the application layer.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • a display module 401 As shown in FIG. 4 , functional modules such as a display module 401 , a camera module 402 , and an audio module 403 are set in the application framework layer.
  • the display module 401 may include a graphics processor (SurfaceFlinger).
  • the APP of the application layer can call SurfaceFlinger to draw the corresponding display interface to realize the display function.
  • the camera module 402 may include a camera service (CameraService).
  • the APP at the application layer can call CameraService to start the camera to perform operations such as previewing, taking pictures or recording, and realize the corresponding camera functions.
  • the audio module 403 may include an audio recorder (AudioRecord), an audio track (AudioTrack), and an audio processor (AudioFlinger).
  • the APP at the application layer can call AudioTrack to start the audio playback function. AudioTrack can send the received audio data to AudioFlinger for mixing, sampling, etc. AudioFlinger sends the processed audio data to devices such as speakers for playback.
  • the APP at the application layer can call AudioRecord to enable the recording function. AudioFlinger can mix and sample the audio data recorded by devices such as microphones, and then AudioFlinger can send the processed audio data to AudioRecord for recording.
  • the HAL of the mobile phone provides HALs corresponding to different hardware modules of the mobile phone, such as audio (Audio) HAL, camera (Camera) HAL, display (Display) HAL, Wi-Fi HAL (in Figure 4 not shown) etc.
  • Audio HAL can correspond to the audio input device or audio output device of the mobile phone
  • Camera HAL can correspond to the camera of the mobile phone
  • Display HAL can correspond to the display output device of the mobile phone.
  • the display module 401 (such as SurfaceFlinger) can call the Display HAL to send display data to the Display HAL, and the Display HAL sends the display data to a corresponding display device (such as a display screen, etc.) for playback.
  • a display device such as a display screen, etc.
  • the camera module 402 (eg, CameraService) can call the Camera HAL, and the Camera HAL reports the captured images collected by the camera and other devices to the CameraService.
  • CameraService can send the captured image to the corresponding APP for display or saving.
  • the audio module 403 can call the Audio HAL to send the audio data to the Audio HAL, and the Audio HAL sends the audio data to the corresponding audio output device (for example, speakers, headphones, etc.) for playback.
  • AudioFlinger can call the Audio HAL, and the Audio HAL reports the audio data recorded by the audio input device (such as a microphone) to AudioFlinger. AudioFlinger can send the acquired audio data to the corresponding APP.
  • the application framework layer may also include a window manager, a content provider, a view system, a resource manager, a notification manager, and the like, which are not limited in this embodiment of the present application.
  • the above-mentioned window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc.
  • the above content providers are used to store and retrieve data and make these data accessible to applications.
  • the data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system described above can be used to build the display interface of an application.
  • Each display interface can consist of one or more controls.
  • controls may include interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.
  • the above resource managers provide various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager described above enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a short stay without user interaction.
  • the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, prompt text information in the status bar, send out a sound, vibrate, and flash the indicator light, etc.
  • the Android runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.
  • the core library consists of two parts: one is the function functions that the java language needs to call, and the other is the core library of Android.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • the virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.
  • a system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • surface manager surface manager
  • media library Media Libraries
  • 3D graphics processing library eg: OpenGL ES
  • 2D graphics engine eg: SGL
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is located under the HAL and is the layer between hardware and software.
  • the kernel layer may also include display drivers, camera drivers, audio drivers, sensor drivers, etc., which is not limited in this embodiment of the present application.
  • a device virtualization for realizing various services in a distributed scenario may be installed in the application layer of the mobile phone APP, which can be called DV APP later.
  • DV APP can run in the mobile phone as a system application.
  • the functions implemented by the DV APP can also be resident in the mobile phone in the form of system services.
  • the DV APP in the mobile phone can use the one or more electronic devices as the slave device of the mobile phone to establish a network connection with the mobile phone.
  • the DV APP can obtain the relevant capability parameters of the slave device based on the network connection.
  • the capability parameter can be used to reflect the slave device.
  • the DV APP can call the preset interface in the HAL, and input the acquired capability parameters into the preset interface, thereby creating a HAL corresponding to the slave device 1 in the HAL.
  • the HAL created by the DV APP according to the capability parameters of the slave device 1 can be called DMSDP (Distributed Mobile Sensing Development Platform) HAL1.
  • DMSDP HAL 1 Different from the traditional HAL in the mobile phone (such as Audio HAL, Camera HAL, Display HAL in Figure 4), DMSDP HAL 1 does not correspond to the actual hardware device of the mobile phone, but corresponds to the slave device 1 currently connected to the mobile phone. .
  • the mobile phone can be used as the master device to send and receive data with the slave device 1 through the DMSDP HAL 1, and the slave device 1 can be used as a virtual device of the mobile phone to cooperate with the slave device 1 to complete various services in the distributed scenario.
  • the DV APP can also obtain the capability parameters of other slave devices according to the above method, and create the corresponding DMSDP HAL in the HAL according to the obtained capability parameters, so as to conduct data with each slave device. send and receive.
  • the master device (such as the above-mentioned mobile phone) obtains the capability parameters of the slave device, and creates a DMSDP HAL according to the capability parameters of the slave device and the specific process of sending and receiving data from the slave device can refer to the relevant description of the application document with application number CN202010628962.7, Therefore, it will not be repeated here.
  • a prediction perception module 601 may be set in the application framework layer. After the mobile phone establishes a network connection with one or more slave devices, the predictive sensing module 601 can detect the currently running service in real time. For example, audio playback service, video call service, live broadcast service or recording service, etc.
  • the predictive perception module 601 may acquire, from each slave device, device parameters corresponding to the service according to the currently running service.
  • the device parameters may include one or more parameters such as audio parameters, display parameters, or camera parameters.
  • the above-mentioned audio parameters may include one or more items such as the sound effect algorithm supported by the device, the number of channels, the sampling rate, the sound mixing strategy, the codec algorithm of the audio data, the number and model of microphones, and the number and model of speakers. Audio parameters can reflect the audio capabilities of the slave device (eg playback capability or recording capability).
  • the above-mentioned display parameters may include one or more items such as the resolution, frame rate, and codec algorithm of the display data supported by the slave device.
  • Display parameters can reflect the display capability of the slave device.
  • the above camera parameters may include one or more items such as image processing algorithms supported by the slave device, the number of cameras, the resolution of the cameras, or the FOV (field of view, field of view) of the cameras.
  • the camera parameters can reflect the shooting capability of the slave device.
  • the device parameters can be obtained from the corresponding slave devices through the corresponding DMSDP HAL.
  • the predictive perception module 601 can send an acquisition request to the slave device 1 through the DMSDP HAL 1, and the slave device 1 can respond to the acquisition request by sending its own device parameters to the DMSDP HAL 1 of the mobile phone, and then the DMSDP HAL 1 HAL 1 sends the device parameters of device 1 to the predictive perception module 601.
  • the prediction sensing module 601 can acquire the device parameters corresponding to the current service from each slave device.
  • the prediction and perception module 601 may predict the service quality when each slave device performs the above service according to the obtained device parameters. For example, the predictive perception module 601 can score the service quality when the slave device performs the above service according to the device parameters of each slave device. Furthermore, the predictive perception module 601 may recommend one or more slave devices with higher scores to the user as recommended devices. For example, the predictive perception module 601 may report the determined recommended device to an APP (eg, a camera APP) running the current service, and the APP will carry the above-mentioned recommended device in a prompt message, and display the prompt message on the display interface.
  • an APP eg, a camera APP
  • the user can know the recommended device suitable for executing the above service in the current distributed scenario, so as to switch the current service to the recommended device determined by the prediction perception module 601 for execution, so as to improve the service quality when multiple devices work together in the distributed scenario , while improving the user experience.
  • the user may select one or more electronic devices in the mobile phone as slave devices of the mobile phone.
  • the mobile phone detects the user's operation of opening the control center, it can detect the electronic device currently connected to the same communication network as the mobile phone.
  • a cell phone can search for one or more electronic devices that are on the same Wi-Fi network as the cell phone.
  • the mobile phone may query the server for one or more electronic devices that are logged into the same account (eg, a Huawei account) as the mobile phone.
  • the mobile phone can display the detected one or more electronic devices in the control center 701 .
  • the user can select one or more electronic devices in the control center 701 as the slave devices of the mobile phone.
  • the control center 701 displays the TV 702 , the speaker 703 , the watch 704 and the TV 705 detected by the mobile phone. If it is detected that the user clicks on the TV 702, the DV APP of the mobile phone can use the TV 702 as a slave device to establish a network connection with the TV 702. Further, as shown in FIG. 8 , the DV APP of the mobile phone can obtain the capability parameters of the TV 702 from the TV 702 based on the network connection, for example, the shooting capability parameters, audio capability parameters, and display capability parameters of the TV 702. Subsequently, the DV APP of the mobile phone can create a corresponding DMSDP HAL 1 in the HAL according to the capability parameters of the TV 702, so that the mobile phone can interact with the TV 702 through the DMSDP HAL 1.
  • the mobile phone can obtain the capability parameters of the speaker 703 according to the above method, and create the corresponding DMSDP HAL 2 in the HAL according to the capability parameters of the speaker 703. If it is also detected that the user clicks on the TV 705, the mobile phone can obtain the capability parameters of the TV 705 according to the above method, and create a corresponding DMSDP HAL 3 in the HAL according to the capability parameters of the TV 705. In this way, the mobile phone can be used as the master device to interact with the three slave devices of the TV 702, the speaker 703 and the TV 705 through the corresponding DMSDP HAL, so as to realize various services in the distributed scenario.
  • Businesses performed on a cell phone or slave device typically involve one or more of audio functionality, display functionality, or camera functionality.
  • the services related to the audio function may include services such as audio playback, recording, karaoke, games, voice calls or video calls.
  • the services related to the display function may include services such as video playing, video calling, and games.
  • the services related to the camera function may include services such as photographing, video recording, live broadcasting, code scanning, or video calling.
  • the predictive perception module 601 in the mobile phone can detect in real time the specific services (In subsequent embodiments, it may be referred to as the target service).
  • the predictive perception module 601 may acquire the identifier of the application running on the mobile phone (for example, the package name of the application), and then determine the target service being executed according to the identifier of the application. For example, if the running application is a video APP, the predictive perception module 601 may determine that the target service is a video playback service.
  • the predictive perception module 601 may also acquire the usage status of each device in the mobile phone, and determine the target service being executed in combination with the usage status of the device. For example, when the mobile phone is running the WeChat APP, if the front camera of the mobile phone is in working state, the predictive sensing module 601 may determine that the target service is a video call service. Correspondingly, if the rear camera of the mobile phone is in a working state, the prediction sensing module 601 may determine that the target service is a code scanning service.
  • the equipment parameters that affect the service quality may be different when different services are running. For example, for the audio playback service, the number of speakers of the device, the sound effect algorithm and the sound mixing strategy have a great influence on the service quality. For another example, for the live broadcast service, the display resolution of the device, the model of the camera, the image processing algorithm and the delay have a great influence on the service quality.
  • the correspondence between different services and associated device parameters may be pre-stored in the mobile phone.
  • the prediction and perception module 601 of the mobile phone determines the current target service
  • specific device parameters associated with the target service can be determined according to the corresponding relationship shown in Table 1.
  • the predictive perception module 601 of the mobile phone can acquire the device parameters associated with the target service from each slave device through the corresponding DMSDP HAL.
  • the target service as an example of the audio playback service
  • the user can switch the song A to play on the TV 702 through the audio switching function.
  • the prediction perception module 601 of the mobile phone identifies that the current target service is the audio playback service, it can determine that the device parameters related to the audio playback service include the number of speakers, the sound effect algorithm and the mixing strategy according to the corresponding relationship shown in Table 1. audio parameters.
  • the predictive perception module 601 of the mobile phone can obtain the device parameter 1 of the TV 702 from the TV 702 by calling the DMSDP HAL 1, and the device parameter 1 includes the number of speakers of the TV 702, the sound effect algorithm and the mixing strategy.
  • the predictive perception module 601 of the mobile phone can obtain the device parameter 2 of the speaker 703 from the speaker 703 by calling the DMSDP HAL 2, and the device parameter 2 includes the number of speakers of the speaker 703, the sound effect algorithm and the mixing strategy.
  • the predictive perception module 601 of the mobile phone can obtain the device parameter 3 of the TV 705 from the TV 705 by calling the DMSDP HAL 3.
  • the device parameter 3 includes the number of speakers of the TV 705, the sound effect algorithm and the mixing strategy.
  • the prediction perception module 601 of the mobile phone can predict the service quality when each slave device performs the audio playback service according to the obtained device parameter 1, device parameter 2 and device parameter 3.
  • quality parameters corresponding to various device parameters in different services may be pre-stored in the mobile phone.
  • the quality parameters of each device parameter associated with the service are preset, and each quality parameter can reflect the requirements of the corresponding service for the device parameters.
  • the quality parameter corresponding to the number of speakers can be set to 2 or more, indicating that the 2 or more speakers can meet the service requirements of the audio playback service.
  • the quality parameter corresponding to the delay can be set within 500ms, indicating that the delay within 500ms can meet the service requirements of the live broadcast service.
  • the predictive perception module 601 of the mobile phone can predict the service quality when the TV 702 uses the device parameter 1 to perform the audio playback service in combination with various quality parameters corresponding to the audio playback service in Table 2. Score 1.
  • the predictive perception module 601 can score each device parameter in the device parameter 1 in combination with various quality parameters corresponding to the audio playback service in Table 2, that is, determine the service quality score of each device parameter. For example, if the number of speakers in device parameter 1 is 0, the score F1 of the device parameter number of speakers is 0; if the number of speakers in device parameter 1 is 2, then the number of speakers is a device parameter of 0. The score F1 is 60 points; if the number of speakers in the device parameter 1 is 4, the score F1 of the device parameter of the number of speakers is 80 points.
  • the prediction perception module 601 can obtain the score F1 for the number of speakers in the device parameter 1, the score F2 for the sound effect algorithm in the device parameter 1, and the score F3 for the mixing strategy in the device parameter 1. Furthermore, the predictive perception module 601 can calculate the service quality score 1 when the television 702 uses the device parameter 1 to perform the audio playback service according to the score F1, the score F2 and the score F3. For example, the predictive perception module 601 may calculate the weighted average of the scores F1 , F2 and F3 according to a preset weight, and use the calculated weighted average as the service quality score 1 .
  • the prediction perception module 601 can predict the service quality score 2 when the speaker 703 uses the device parameter 2 to perform the audio playback service according to the above method.
  • the predictive perception module 601 obtains the device parameter 3 from the TV 705, it can predict the service quality score 3 when the TV 705 uses the device parameter 3 to perform the audio playback service according to the above method.
  • the quality parameter scoring curve or scoring rule corresponding to each device parameter in different services may also be pre-stored in the mobile phone.
  • the corresponding relationship between the number of different speakers and the quality parameter score is a curve 1 .
  • the predictive perception module 601 can determine, according to the curve 1, the fraction F1 of the device parameter related to the number of speakers in the device parameter 1. As shown in (b) of FIG. 10 , it is the scoring rule 1 between different sound effect algorithms and quality parameter scoring in the audio playback service.
  • the predictive perception module 601 can determine the score F2 of the device parameter related to the sound effect algorithm in the device parameter 1 according to the scoring rule 1 .
  • the predictive perception module 601 can determine the score F3 of the device parameter of the mixing strategy in the device parameter 1 according to the scoring rule 2 .
  • the predictive perception module 601 can calculate the service quality score 1 when the television 702 uses the device parameter 1 to perform the audio playback service according to the score F1, the score F2 and the score F3.
  • the predictive perception module 601 can also obtain the service quality score 2 when the speaker 703 uses the device parameter 2 to perform the audio playback service, and the TV 705 uses the device parameter 3 to perform the audio playback service quality score 3 according to the above method.
  • the prediction perception module 601 of the mobile phone can determine the recommended device corresponding to the current audio playback service according to these service quality scores. For example, if the service quality score 2>the service quality score 1>the service quality score 3, it means that the service quality of the audio playback service performed by the speaker 703 is higher than the service quality of the audio playback service performed by the current TV 702, the prediction perception module 601 can be the speaker 703. Determined as recommended equipment. At this time, as still shown in FIG. 8 , the predictive perception module 601 may report the determined identification of the recommended device (ie, the speaker 703 ) to the running APP (ie, the music APP).
  • the music APP may display a prompt message 1101 in the display interface 1101 according to the recommended device reported by the prediction sensing module 601 .
  • the prompt message 1101 is used to prompt the user to use the speaker 703 with higher service quality to execute the current audio playback service.
  • the prompt message 1101 may include the identification 1102 of the speaker 703 . In this way, in a distributed scenario, the user can perceive the service quality when other slave devices perform a certain service through the prompt message 1101 .
  • the mobile phone can switch the current audio playback service to the speaker 703 and continue to execute, and at the same time stops the continuous execution of the above audio playback service on the TV 702, thereby improving the service of the audio playback service. quality.
  • the prediction perception module 601 of the mobile phone may also determine the corresponding recommended device according to the service quality score of a certain device parameter. For example, if the score of the device parameter of the sound mixing strategy of the speaker 703 is higher than the score of the device parameter of the sound mixing strategy of other slave devices, but the score of the device parameter of the sound effect algorithm of the TV 702 is higher than that of the sound effect of other slave devices. The scoring of the device parameter of the algorithm indicates that the sound mixing capability of the speaker 703 is relatively high, while the sound effect processing capability of the TV 702 for audio data is relatively high.
  • the prediction perception module 601 can use the speaker 703 as a recommended device, and notify the music APP that the mixing capability of the speaker 703 is higher than that of other slave devices. Furthermore, as shown in FIG. 12 , the music APP can prompt the user in the prompt message 1201 that the speaker 703 has a stronger mixing capability in the audio playback service. Of course, the music APP can also prompt the user in the prompt message 1201 that the TV 702 currently playing audio data has a stronger sound effect processing capability.
  • a user can perceive different service capabilities of different slave devices when executing a certain service, and thus selectively select a corresponding slave device to execute the service.
  • the predictive perception module 601 may notify other APPs of the determined recommended device (eg, the speaker 703 ), for example, a system APP such as a notification center APP.
  • a system APP such as a notification center APP.
  • the notification center APP can prompt the user to use a speaker with higher service quality in the form of a notification message.
  • 703 Executes the current audio playback service, which is not limited in this embodiment of the present application.
  • the predictive perception module 601 may also notify the TV 702 that is performing the audio playback service of the determined recommended device through the corresponding DMSDP HAL 1. Furthermore, as shown in FIG. 13 , after obtaining the identification of the recommended device sent by the mobile phone, the TV 702 can display a prompt message 1301 to prompt the user to use the speaker 703 with higher service quality to perform the current audio playback service. Subsequently, if the television 702 detects that the user selects the identifier of the speaker 703 in the prompt message 1301, the television 702 can stop executing the above audio playback service. At the same time, the TV 702 can send a service switching message to the mobile phone, so that the mobile phone can switch the current audio playing service to the speaker 703 in response to the service switching message, thereby improving the service quality of the audio playing service.
  • the predictive perception module 601 determines that the TV 702 currently performing the audio playback service is the device with the highest service quality, the predictive perception module 601 can notify the music APP that the TV 702 currently performing the audio playback service is the optimal device. At this point, the mobile phone or TV 702 may no longer recommend other devices to the user to perform the audio playback service.
  • the predictive perception module 601 of the mobile phone can not only predict the service quality score when each slave device (such as the TV 702, the speaker 703, and the TV 705) performs the audio playback service, but also can predict the mobile phone itself to perform the audio playback service. quality of service score.
  • the predictive perception module 601 of the mobile phone may also acquire the device parameter 4 associated with the current audio playback service, that is, the number of speakers in the mobile phone, the sound effect algorithm, and the sound mixing strategy. Furthermore, the prediction perception module 601 can predict the service quality score 4 when the mobile phone uses the device parameter 4 to perform the audio playback service according to the above method. Subsequently, the prediction perception module 601 may determine the recommended device this time by combining the service quality score 4 and the service quality score corresponding to each slave device. That is to say, the main device (that is, the mobile phone) can also be used as a candidate device for the recommended device. When the service quality of the target service (for example, the above-mentioned audio playback service) performed by the main device is relatively high, the user can also be prompted to use the main device to perform the above-mentioned target service. .
  • the service quality of the target service for example, the above-mentioned audio playback service
  • the audio playback service is used as an example for description. It can be understood that when the mobile phone executes other services in a distributed scenario, it can also recommend to the user a recommendation with higher service quality when executing other services according to the above method. equipment.
  • the mobile phone when the mobile phone runs the video APP, the mobile phone can project the video B played in the video APP to the TV 702 for playing in response to the user's screen projection operation.
  • the mobile phone can send the display data of the video B to the TV 702 through the DMSDP HAL 1, and at the same time, the mobile phone can send the audio data of the video B to the TV 702 through the DMSDP HAL 1.
  • the prediction perception module 601 of the mobile phone can identify that the current target service is a video playback service. Furthermore, the predictive perception module 601 can determine the device parameters associated with the video playback service according to the corresponding relationship shown in Table 1.
  • the device parameters associated with the video playback service may include display parameters related to display functions such as the resolution of the display screen, and may also include audio parameters related to audio functions such as the number of microphones and sound effect algorithms.
  • the mobile phone's predictive perception module 601 determines the device parameters associated with the video playback service
  • the corresponding DMSDP HAL can be obtained from each slave device.
  • Device parameters associated with the playback service Further, the prediction perception module 601 can predict the service quality score when each slave device performs the video playback service according to the obtained device parameters according to the method in the above-mentioned embodiment, and according to the service quality when each slave device performs the video playback service The score determines the corresponding recommended device.
  • the prediction perception module 601 can determine the TV 705 as the recommended device for executing the video playback service this time.
  • the predictive perception module 601 can notify the video APP that the current recommended device is a TV 705, so that the video APP can display a prompt message 1501 in the display interface, prompting the user to use a higher quality service
  • the TV 705 performs the current video playback service.
  • the prompt message 1501 may include the identification of the television 705 . If it is detected that the user clicks the logo of the TV 705, the mobile phone can switch the current video playback service to the TV 705 and continue to execute it, and at the same time stop the continuous execution of the above-mentioned video playback service on the TV 702, thereby improving the service quality of this video playback service. .
  • the predictive perception module 601 may notify the TV 702 that is performing the video playback service of the determined recommended device through the corresponding DMSDP HAL 1.
  • a prompt message 1502 may be displayed to prompt the user to use the TV 705 with higher service quality to execute the current video playing service.
  • the television 702 detects that the user selects the identification of the television 705 in the prompt message 1502, the television 702 can stop executing the above-mentioned video playing service.
  • the TV 702 can send a service switching message to the mobile phone, so that the mobile phone can switch the current video playing service to the TV 705 for continuous execution in response to the service switching message, thereby improving the service quality of the audio playing service.
  • the predictive perception module 601 determines that the TV 702 currently performing the video playback service is the device with the highest service quality, the predictive perception module 601 can notify the video APP that the TV 702 currently performing the video playback service is the optimal device. At this point, the mobile phone or TV 702 may no longer recommend other devices to the user to perform the video playing service.
  • the predictive perception module 601 of the mobile phone may also determine that multiple slave devices execute the current video playback service (ie, the target service) according to the service quality scores of different device parameters in different slave devices. At this time, there may be multiple recommended devices determined by the predictive perception module 601 .
  • the predictive perception module 601 can obtain the device parameter 1 associated with the video playback service from the TV 702 .
  • Device parameter 1 includes audio parameters and display parameters of the television 702 .
  • the predictive perception module 601 can acquire the device parameter 2 associated with the video playback service from the speaker 703 .
  • Device parameter 2 includes audio parameters and display parameters of the speaker 703 . If the predictive perception module 601 scores the service quality of the displayed parameter in device parameter 1 higher than the service quality of the displayed parameter in device parameter 2, it means that the display capability of the TV 702 is higher than that of the speaker 703. If the predictive perception module 601 scores the service quality of the audio parameter in the device parameter 2 higher than the service quality of the audio parameter in the device parameter 1, it means that the audio capability of the speaker 703 is higher than the display capability of the TV 702 .
  • the predictive perception module 601 can determine both the speaker 703 and the TV 702 as recommended devices, wherein the TV 702 can be used to perform the first subtask related to the display function in the video playback service, and the speaker 703 can be used to perform The second subtask related to the audio function in the video playback service. Furthermore, the predictive perception module 601 can notify the video APP of the mobile phone that the TV 702 is the recommended device for performing the first subtask, and the speaker 703 is the recommended device for performing the second subtask. Furthermore, as shown in FIG. 16 , the video APP can display a prompt message 1601 according to the recommended device notified by the prediction sensing module 601 . The prompt message 1601 may prompt the user to use a device group consisting of "TV 702 + speaker 703" to perform the above-mentioned video playback service cooperatively, so that the user can enjoy the best video playback service quality.
  • the mobile phone can switch the display data in the currently playing video B to the TV 702 for playback (that is, switch the first subtask in the video playback service to the TV 702) , at the same time, switch the audio data in video B to the speaker 703 for playback (ie, switch the second subtask in the video playback service to the speaker 703 ), and improve the service quality of the video playback service by means of multi-device cooperative work.
  • the master device (such as a mobile phone) can divide the current target service into multiple subtasks, and then determine the best recommended device for each subtask according to the device parameters of each slave device, so as to distribute the target service to multiple recommended devices It can improve the service quality of the target service through the collaborative work of multiple devices.
  • the mobile phone can recommend the corresponding recommended device according to the device parameters of the slave device.
  • the mobile phone can also recommend the user according to the above method. High recommended equipment.
  • the user can turn on the video call function of the WeChat APP to make a video call with a contact (eg, contact Sam).
  • a contact eg, contact Sam
  • the mobile phone can use the camera of the TV 702 to collect image data, and the mobile phone can use the display screen of the TV 702 to display the video call interface.
  • the mobile phone can obtain the image data collected by the camera of the TV 702 through the DMSDP HAL 1, and the mobile phone can send the display data of the video call interface to the TV 702 for display through the DMSDP HAL 1.
  • the predictive sensing module 601 of the mobile phone can identify the current target service as a video call service. Furthermore, the predictive perception module 601 can determine the device parameters associated with the video call service according to the corresponding relationship shown in Table 1.
  • the device parameters associated with the video call service may include display parameters related to display functions such as the resolution of the display screen, and may also include audio parameters related to audio functions such as the number of microphones and sound effect algorithms, and may also include the number of cameras. and other camera parameters related to the camera function, and may also include parameters such as time delay.
  • the mobile phone's predictive perception module 601 determines the device parameters associated with the video call service
  • the corresponding DMSDP HAL can be obtained from each slave device.
  • Device parameters associated with the call service Further, the prediction perception module 601 can predict the service quality score when each slave device performs the video call service according to the method in the above embodiment, and determine the recommended device according to the service quality score when each slave device performs the video call service.
  • the prediction perception module 601 can determine the TV 705 as the recommended device for performing the video call service this time.
  • the predictive perception module 601 can notify the WeChat APP that the current recommended device is a TV 705, so that the WeChat APP can display a prompt message 1701 on the display interface, prompting the user to use a higher quality service
  • the TV 705 performs the current video call service.
  • the predictive perception module 601 may notify the TV 702 that is executing the video call service of the determined recommended device through the corresponding DMSDP HAL 1, and the TV 702 displays the prompt message 1702 to show The user is prompted to use the TV 705 with higher service quality to perform the current video call service.
  • the prediction sensing module 601 of the mobile phone can also predict the delay required to execute the corresponding service, and recommend corresponding recommendations based on the predicted delay. equipment. That is to say, for a service with high real-time requirements, the delay required by each device to execute the service can be used as a criterion for judging the quality of the service. For example, the mobile phone can set the weight value of the device parameter of delay to 1 when calculating the service quality score of each device executing the service. At this time, the service quality of the current service completely depends on the device parameter of delay.
  • the prediction perception module 601 of the mobile phone after the prediction perception module 601 of the mobile phone recognizes that the current target service is the video call service, it can obtain the network delay with each slave device, and the processing of each slave device executing the video call service. time delay. In this way, in the distributed scenario, the delay of each slave device executing the video call service is the sum of the network delay and the processing delay.
  • the predictive sensing module 601 of the mobile phone can call the Wi-Fi HAL to detect the network delay L11 between the mobile phone and the TV 702 .
  • the predictive perception module 601 can obtain the processing delay L12 of the video call service performed by the TV 702 from the TV 702 through the DMSDP HAL 1.
  • the predictive perception module 601 can also calculate the delay L2 for the speaker 703 to perform the video call service and the delay L3 for the TV 705 to perform the video call service according to the above method.
  • the quality parameter of the delay in the video call service is set to be within 500ms in Table 2, it means that the delay within 500ms can meet the service quality requirement of the video call service. Then, if the predictive sensing module 601 of the mobile phone calculates that the delay L1 for the TV 702 to execute the video call service is greater than 500ms, and the delay L3 for the TV 705 to execute the video call service is less than 500ms, then the predictive sensing module 601 can determine the TV 705 as this Recommended device for secondary video calling service. At this time, as shown in FIG.
  • the predictive perception module 601 can notify the WeChat APP that the current recommended device is the TV 705, so that the WeChat APP displays a prompt message 1801 in the display interface according to the recommended device, prompting the user to use a lower-latency device.
  • the TV 705 performs the current video call service.
  • the above prompt message may also be displayed on the TV 702 that is executing the video call service, which is not limited in this embodiment of the present application.
  • the predictive sensing module 601 of the mobile phone may further analyze the specific reason why the delay L1 exceeds 500ms. For example, if the delay L1 exceeds 500ms because the network delay L11 between the TV 702 and the mobile phone is greater than the threshold 1, it means that the current network state is poor, and the delay when interacting with each slave device is long. Module 601 may determine the mobile phone itself as the recommended device for executing the video call service. At this time, as shown in (a) of FIG.
  • the predictive perception module 601 can notify the WeChat APP (or TV 702 ) in the mobile phone to display a prompt message 1901, and the prompt message 1901 prompts the user that the current network status is poor, and it is recommended to The user uses the mobile phone to perform the current video calling service.
  • the predictive sensing module 601 can simplify the processing of the TV 702 executing the video call service.
  • the predictive perception module 601 can determine the video call strategy 1, in which the TV 702 does not need to perform sound effect processing on the audio data.
  • the predictive perception module 601 can determine the video call strategy 2, and in the video call strategy 2, the TV 702 can use the specified codec algorithm to encode and decode the display data. Further, as shown in (b) of FIG.
  • the predictive perception module 601 can notify the WeChat APP (or TV 702 ) in the mobile phone to display a prompt message 1902 according to the determined video call strategy, and prompt the user to simplify the TV in the prompt message 1902 702 Executes the processing procedure of the video call service, so as to reduce the delay of executing the video call service.
  • the predictive sensing module 601 can send the above-mentioned video call strategy to the TV 702 through the corresponding DMSDP HAL 1, so that the TV 702 can simplify the execution of the video call according to the video call strategy The service processing process, thereby reducing the delay of the entire video call service and improving the service quality of the video call service.
  • the predictive sensing module 601 of the mobile phone can also directly send the above video call strategy to the TV 702 after determining the video call strategy that simplifies the processing of the video call service, so that the TV 702 can simplify the process of executing the video call service according to the video call strategy. processing.
  • the mobile phone or TV 702 may display a prompt message to prompt the user that the processing process of the video call service has been simplified, so as to reduce the delay of the entire video call service.
  • the predictive sensing module 601 can select other slave devices to execute the video call. A slave device with a service time delay of less than 500ms is recommended. Furthermore, similar to FIG. 19 , the predictive sensing module 601 can notify the WeChat APP (or TV 702 ) in the mobile phone to display a corresponding prompt message, prompting the user to use an electronic device with a lower time to perform the current video call service.
  • the mobile phone as the master device recommends to the user a recommended device that is more suitable for executing a certain service in the process of cooperating with the slave device to perform a certain service.
  • the mobile phone may also be When it is detected that the mobile phone will be used as the main device to execute a certain service, a recommended device that is more suitable for executing the service is recommended to the user in advance.
  • the slave devices of the mobile phone include the TV 702, the speaker 703 and the TV 705, as shown in (a) of FIG. If it is detected that the user clicks the screen-casting button 2002, it means that the mobile phone has enabled the screen-casting function and is ready to perform the screen-casting service (eg, a video playback service).
  • the predictive perception module 601 of the mobile phone can obtain the device parameters associated with the screencasting service from each slave device according to the method in the above-mentioned embodiment, and predict the service when each slave device performs the screencasting service according to the obtained device parameters. quality score, so as to recommend the corresponding recommended device to the user according to the predicted service quality score.
  • the prediction perception module 601 predicts that the service quality score 1 when the TV 705 performs the screen projection service is higher than the service quality score 2 when the TV 702 performs the screen projection service, and the service quality score 2 when the TV 702 performs the screen projection service is higher
  • the service quality score when the speaker 703 performs the screen projection service is 3
  • the mobile phone can display a device list 2003 in response to the user's operation of clicking the screen-casting button 2002 .
  • the mobile phone can arrange each slave device in descending order of the service quality score of performing the screen projection service.
  • the user can choose which slave device to project the content in the mobile phone to.
  • the above arrangement order can recommend the user to use the device with a higher service quality score to perform this screencasting service, so as to improve the service of the subsequent screencasting service. quality.
  • the prediction perception module 601 of the mobile phone can predict the specific service quality of different slave devices when performing the screen projection service according to the obtained device parameters.
  • the predictive perception module 601 may predict, according to the device parameters of the TV 702, that the TV 702 may experience a phenomenon that the audio and video are out of sync when the TV 702 performs the screen projection service.
  • the predictive perception module 601 may predict that the loudspeaker 703 cannot display display data when performing the screen projection service according to the device parameters of the loudspeaker 703 .
  • the mobile phone can display a device list 2003 in response to the user's operation of clicking the screen-casting button 2002 . In the device list 2003, the mobile phone can prompt the user for the specific service quality of each slave device performing this screen casting service.
  • the mobile phone as the master device can predict the specific service quality when the service is switched to each slave device before executing a service, so that when the user selects the slave device that executes the service At the same time, it prompts the user of the slave device with better service quality.
  • the mobile phone can recommend the recommended device suitable for executing the service to the user before working with multiple devices, so as to facilitate the user to switch the current service to the recommended device for execution, so as to improve the service when multiple devices work together in a distributed scenario. quality, while improving the user experience.
  • the mobile phone is used as an example in the distributed scenario.
  • the example does not impose any restrictions on this.
  • the Android system is used as an example to illustrate the specific method for implementing positioning between functional modules. It can be understood that the above positioning method can also be implemented by setting corresponding functional modules in other operating systems. As long as the functions implemented by various devices and functional modules are similar to the embodiments of the present application, they fall within the scope of the claims of the present application and their technical equivalents.
  • the embodiment of the present application discloses an electronic device, and the electronic device may be the main device (for example, a mobile phone) in the above-mentioned embodiment.
  • the electronic device may specifically include a processor, and a memory, an input device, and an output device connected to the processor.
  • the input device and the output device can be integrated into one device, for example, a touch sensor can be used as an input device, a display screen can be used as an output device, and the touch sensor and the display screen can be integrated into a touch screen.
  • the above electronic device may include: a touch screen 2201, the touch screen 2201 includes a touch sensor 2206 and a display screen 2207; one or more processors 2202; a memory 2203; a communication module 2208; one or more processors 2202; and one or more computer programs 2204, each of which may be connected by one or more communication buses 2205.
  • the one or more computer programs 2204 are stored in the aforementioned memory 2203 and configured to be executed by the one or more processors 2202, the one or more computer programs 2204 include instructions that can be used to perform the aforementioned implementations The relevant steps performed by the master device in the example.
  • the processor 2202 may be the processor 110 shown in FIG. 3, the memory 2203 may be the internal memory 121 shown in FIG. 3, the display screen 2207 may be the display screen 194 shown in FIG.
  • the touch sensor 2206 may specifically be a touch sensor in the sensor module 180 shown in FIG. 3 , which is not limited in this embodiment of the present application.
  • Each functional unit in each of the embodiments of the embodiments of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as an independent product, may be stored in a computer-readable storage medium.
  • a computer-readable storage medium includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: flash memory, removable hard disk, read-only memory, random access memory, magnetic disk or optical disk and other media that can store program codes.

Abstract

一种设备推荐方法及电子设备，涉及终端领域，可在分布式场景中根据业务需求向用户推荐多设备协同工作时业务质量更高的设备，从而提高多设备协同工作时的业务质量。该方法包括：第一设备接收用户打开第一业务的第一操作；响应于第一操作，第一设备从N个电子设备中分别获取与第一业务关联的设备参数，N个电子设备与第一设备位于同一通信网络；第一设备根据设备参数预测N个电子设备中每个电子设备执行第一业务的业务质量；第一设备按照N个电子设备中每个电子设备执行第一业务的业务质量显示设备列表，设备列表中包括N个电子设备中至少一个电子设备的设备标识。

Description

一种设备推荐方法及电子设备
本申请要求于2020年11月27日提交国家知识产权局、申请号为202011360717.9、发明名称为“一种设备推荐方法及电子设备”的中国专利申请的优先权，以及于2021年04月30日提交国家知识产权局、申请号为202110483159.3、发明名称为“一种设备推荐方法及电子设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端领域，尤其涉及一种设备推荐方法及电子设备。
背景技术
随着通信技术的飞速发展，一个用户或家庭中往往具备多个能够互相通信的电子设备，这些电子设备可以协同工作完成分布式场景中的各项业务。以投屏业务举例，用户使用手机中的视频APP观看视频时，可触发手机与其他设备共同执行投屏业务。例如，手机可将视频中播放的显示数据投射至家中的电视播放，同时，可将视频中播放的音频数据投射至家中的音箱播放，获得更好的视频观看体验。
但是，当多设备通过协同的方式共同执行某一业务时，可能会因为设备性能的差别等原因出现音频质量变差、显示质量变差或者音画不同步等业务质量问题。例如，在上述投屏业务中，当音箱对音频数据的处理能力较弱而电视对显示数据的处理能力较强时，音箱播放上述音频数据产生的时延1可能会大于电视播放上述显示数据产生的时延2，从而导致电视播放的显示数据与音箱播放的音频数据不同步等问题。因此，在分布式场景中如何提高多设备协同工作时的业务质量成为亟需解决的问题。
发明内容
本申请提供一种设备推荐方法及电子设备，可在分布式场景中根据业务需求向用户推荐多设备协同工作时业务质量更高的设备，从而提高多设备协同工作时的业务质量，提高用户的使用体验。
为达到上述目的，本申请采用如下技术方案：
第一方面，本申请提供一种设备推荐方法，包括：第一设备可接收用户打开第一业务的第一操作；响应于第一操作，第一设备可从位于同一通信网络中的N(N为大于0的整数)个电子设备中分别获取与第一业务关联的设备参数；进而，第一设备可根据获取到的设备参数预测上述N个电子设备中每个电子设备执行第一业务时的业务质量；后续，第一设备可按照N个电子设备中每个电子设备执行第一业务的业务质量显示设备列表，该设备列表中包括N个电子设备中至少一个电子设备的设备标识，从而向用户推荐适合执行第一业务的具体设备。
示例性的，上述第一业务可以是与音频功能相关的业务，例如音频播放业务、录音业务等。或者，上述第一业务可以是与显示功能相关的业务，例如视频播放业务、视频通话业务、游戏业务等。或者，上述第一业务可以是与相机功能相关的业务，例如视频通话业务、录像业务等。
示例性的，上述设备参数可以包括与音频功能相关的音频参数，与显示功能相关显示参数以及与相机功能相关相机参数等一项或多项。
也就是说，第一设备作为主设备在执行某一业务之前，可获取从设备(例如上述N个电子设备)的相关设备参数，从而预测各个从设备执行该业务时的业务质量。这样，第一设备可基于预测出的各个从设备执行该业务时的业务质量，通过显示设备列表的方式向用户推荐执行该业务的具体设备，从而提高分布式场景中多设备协同工作时的业务质量，同时提高了用户的使用体验。
在一种可能的实现方式中，上述N个电子设备中可以包括第二设备；第一设备从第二设备获取到的设备参数可以包括M(M为大于0的整数)项参数；此时，第一设备根据设备参数预测第二设备执行第一业务的业务质量，包括：第一设备确定与M项参数一一对应的M项分数；进而，第一设备可根据这M项分数计算第二设备执行第一业务的业务质量分数；当业务质量分数越高时，第一业务的业务质量越高。
示例性的，第一设备可以对第二设备的M项参数一一进行打分，得到对应的M项分数，进而，第一设备可将这M项分数按照预设的权重进行加权平均，得到第二设备执行第一业务的业务质量分数。当然，上述N个电子设备中其他设备执行第一业务的业务质量分数也可按照上述方法计算，本申请对此不做任何限制。
在一种可能的实现方式中，上述N个电子设备中还可以包括第三设备；当第二设备执行第一业务的业务质量分数高于第三设备执行第一业务的业务质量分数时，第二设备在设备列表中的排列顺序位于第三设备之前。也就是说，第一设备可以在显示的设备列表中通过设备之间的先后排列顺序向用户推荐执行相关业务的设备。
在一种可能的实现方式中，当第二设备执行第一业务的业务质量分数高于N个电子设备中其他电子设备执行第一业务的业务质量分数时，说明第二设备为上述N个电子设备中最适合执行第一业务的设备，则第二设备在上述设备列表中可被标记为推荐设备，从而提示用户使用推荐设备执行第一业务。
在一种可能的实现方式中，上述M项参数中可以包括与第一功能对应的第一参数，例如，与显示功能对应的显示参数；那么，当第二设备的第一参数的分数高于N个电子设备中其他电子设备的第一参数的分数时，说明第二设备在执行第一业务的第一功能时业务质量较高，则第一设备可在上述设备列表中显示第一提示信息，第一提示信息用于推荐用户使用第二设备实现第一功能。也就是说，第一设备可以向用户推荐在执行第一业务时某一功能较为突出的设备。
在一种可能的实现方式中，上述M项参数中包括与第一功能对应的第一参数，例如，与显示功能对应的显示参数；那么，当第二设备的第一参数的分数低于N个电子设备中其他电子设备的第一参数的分数时，说明第二设备在执行第一业务的第一功能时业务质量较低，则第一设备可在上述设备列表中显示第二提示信息，第二提示信息包括不推荐用户使用第二设备实现第一功能的原因。也就是说，第一设备可以向用户提示不推荐使用某一设备执行第一业务的具体原因。
在一种可能的实现方式中，上述N个电子设备中包括第二设备；在第一设备按照N个电子设备中每个电子设备执行第一业务的业务质量显示设备列表之后，还包括：第一设备接收用户在设备列表中选择第二设备的第二操作；那么，响应于第二操作， 第一设备可将第一业务切换至第二设备中执行。这样，用户可以基于第一设备在设备列表中推荐的设备，将第一业务切换至第二设备中，实现多设备协同工作的分布式业务场景。
在一种可能的实现方式中，在第一设备将第一业务切换至第二设备中执行之后，还包括：第一设备可再次从当前的从设备(例如与手机位于同一通信网络的N个电子设备)中分别获取与第一业务关联的设备参数；同样，第一设备可根据获取到的设备参数预测当前N个电子设备中每个电子设备执行第一业务的业务质量；当第二设备不是上述N个电子设备中执行第一业务的业务质量最高的电子设备时，说明第一业务目前不适合在第二设备上执行，则第一设备可显示第一提示消息，第一提示消息用于提示用户使用推荐设备执行第一业务，推荐设备为N个电子设备中的一个或多个。
也就是说，第一设备作为主设备可以在与其他设备(例如上述第二设备)协同执行某一业务的过程中，实时的获取各个从设备的相关设备参数，从而预测各个从设备执行该业务时的业务质量。这样，第一设备可基于预测出的各个从设备执行该业务时的业务质量，通过显示提示消息向用户推荐执行该业务的推荐设备，从而提高分布式场景中多设备协同工作时的业务质量，同时提高了用户的使用体验。
在一种可能的实现方式中，第一设备根据设备参数预测N个电子设备中每个电子设备执行第一业务的业务质量，包括：第一设备可以根据从每个电子设备获取的设备参数，计算每个电子设备执行第一业务的业务质量分数。例如，第一设备可以根对每个电子设备对应的设备参数中的每一项参数进行打分，进而对所有的打分进行加权平均后计算出对应电子设备执行第一业务的业务质量分数。
在一种可能的实现方式中，上述N个电子设备中包括第三设备；当第三设备执行第一业务的业务质量分数高于N个电子设备中的其他电子设备时，上述推荐设备为第三设备；或者，当第三设备执行第一业务中第一子任务的业务质量分数高于N个电子设备中的其他电子设备时，上述推荐设备为第三设备。也就是说，当上述N个电子设备中除第二设备的某一设备执行第一业务，或第一业务中某一子任务的业务质量较高时，第一设备可将该设备确定为推荐设备，从而推荐用户使用该推荐设备执行第一业务。
在一种可能的实现方式中，上述第一业务可以包括第一子任务和第二子任务，例如，投屏业务中可以包括音频播放任务和显示任务；上述N个电子设备中可以包括第三设备和第四设备。当第三设备执行第一子任务的业务质量分数高于N个电子设备中的其他电子设备，且第四设备执行第二子任务的业务质量分数高于N个电子设备中的其他电子设备时，上述推荐设备为第三设备和第四设备组成的设备组。也就是说，当多个设备协同执行第一业务时可以获得较高的业务质量时，第一设备可以以设备组的形式向用户推荐使用多个设备共同执行上述第一业务。
在一种可能的实现方式中，上述方法还包括：第一设备预测第一设备执行第一业务的业务质量分数；其中，当第一设备执行第一业务的业务质量分数高于上述N个电子设备时，上述推荐设备可以为第一设备。也就是说，主设备(即第一设备)也可以作为推荐设备的一个候选设备，当第一设备执行目标业务(例如上述第一业务)的业 务质量较高时，也可以提示用户使用第一设备执行上述第一业务。
在一种可能的实现方式中，上述第一提示消息中可以包括推荐设备的设备标识；在第一设备显示第一提示消息之后，还包括：第一设备接收用户在第一提示消息中选择推荐设备的第三操作；响应于第三操作，第一设备将第一业务切换至推荐设备中执行。这样，用户通过第一提示消息中推荐设备的设备标识可以快速将第一业务切换至业务质量较高的推荐设备中执行。
在一种可能的实现方式中，当第二设备不是N个电子设备中执行第一业务的业务质量最高的电子设备时，上述方法还包括：第一设备可以向第二设备通知上述推荐设备，以使得第二设备显示第二提示消息，第二提示消息用于提示用户使用推荐设备执行第一业务。同样，用户可以在第二设备中通过第二提示消息快速将第一业务切换至业务质量较高的推荐设备中执行。
在一种可能的实现方式中，上述设备参数可以包括音频参数、显示参数、相机参数或时延中的一个或多个。其中，音频参数可以包括从设备支持的音效算法、声道数目、采样率、混音策略、音频数据的编解码算法、麦克风的数目和型号以及喇叭的数目和型号等一项或多项。上述显示参数可以包括从设备支持的分辨率、帧率以及显示数据的编解码算法等一项或多项。上述相机参数可以包括从设备支持的图像处理算法、摄像头的数目、摄像头的分辨率或者摄像头的FOV等一项或多项。
第二方面，本申请提供一种电子设备(例如上述第一设备)，包括：通信模块、显示屏、一个或多个处理器、一个或多个存储器、以及一个或多个计算机程序；其中，处理器与通信模块、显示屏以及存储器均耦合，上述一个或多个计算机程序被存储在存储器中，当第一设备运行时，该处理器执行该存储器存储的一个或多个计算机程序，以使第一设备执行上述任一方面中所述的设备推荐方法。
第三方面，本申请提供一种计算机可读存储介质，包括计算机指令，当计算机指令在上述第一设备上运行时，使得第一设备执行上述任一方面中所述的设备推荐方法。
第四方面，本申请提供一种计算机程序产品，当计算机程序产品在上述第一设备上运行时，使得第一设备执行上述任一方面中所述的设备推荐方法。
可以理解地，上述各个方面所提供电子设备、计算机可读存储介质以及计算机程序产品均应用于上文所提供的对应方法，因此，其所能达到的有益效果可参考上文所提供的对应方法中的有益效果，此处不再赘述。
附图说明
图1为本申请实施例提供的一种推荐系统的架构示意图；
图2为本申请实施例提供的一种设备推荐方法的交互示意图；
图3为本申请实施例提供的一种电子设备的结构示意图一；
图4为本申请实施例提供的一种电子设备的操作系统的架构示意图一；
图5为本申请实施例提供的一种电子设备的操作系统的架构示意图二；
图6为本申请实施例提供的一种电子设备的操作系统的架构示意图三；
图7为本申请实施例提供的一种电子设备的应用场景示意图一；
图8为本申请实施例提供的一种电子设备的操作系统的架构示意图四；
图9为本申请实施例提供的一种电子设备的应用场景示意图二；
图10为本申请实施例提供的一种电子设备的应用场景示意图三；
图11为本申请实施例提供的一种电子设备的应用场景示意图四；
图12为本申请实施例提供的一种电子设备的应用场景示意图五；
图13为本申请实施例提供的一种电子设备的应用场景示意图六；
图14为本申请实施例提供的一种电子设备的应用场景示意图七；
图15为本申请实施例提供的一种电子设备的应用场景示意图八；
图16为本申请实施例提供的一种电子设备的应用场景示意图九；
图17为本申请实施例提供的一种电子设备的应用场景示意图十；
图18为本申请实施例提供的一种电子设备的应用场景示意图十一；
图19为本申请实施例提供的一种电子设备的应用场景示意图十二；
图20为本申请实施例提供的一种电子设备的应用场景示意图十三；
图21为本申请实施例提供的一种电子设备的应用场景示意图十四；
图22为本申请实施例提供的一种电子设备的应用场景示意图十五；
图23为本申请实施例提供的一种电子设备的结构示意图二。
具体实施方式
下面将结合附图对本实施例的实施方式进行详细描述。
本申请实施例提供的一种设备推荐方法，可应用于图1所示的推荐系统200中。如图1所示，该推荐系统200中可包括主设备(master)101和N个从设备(slave)102，N为大于0的整数。主设备101与任意一个从设备102之间可通过有线的方式通信，也可以通过无线的方式通信。
示例性的，主设备101与从设备102之间可以使用通用串行总线(universal serial bus，USB)建立有线连接。又例如，主设备101与从设备102之间可以通过全球移动通讯系统(global system for mobile communications，GSM)、通用分组无线服务(general packet radio service，GPRS)、码分多址接入(code division multiple access，CDMA)、宽带码分多址(wideband code division multiple access，WCDMA)，时分码分多址(time-division code division multiple access，TD-SCDMA)，长期演进(long term evolution，LTE)、蓝牙、无线保真(wireless fidelity，Wi-Fi)、NFC、基于互联网协议的语音通话(voice over Internet protocol，VoIP)、支持网络切片架构的通信协议建立无线连接。
示例性的，主设备101(或从设备102)具体可以为手机、平板电脑、电视(也可称为智慧屏、智能电视或大屏设备)、笔记本电脑、超级移动个人计算机(Ultra-mobile Personal Computer，UMPC)、手持计算机、上网本、个人数字助理(Personal Digital Assistant，PDA)、可穿戴电子设备、车载设备、虚拟现实设备等电子设备，本申请实施例对此不做任何限制。
在本申请实施例中，主设备101可将自身的一项或多项业务(例如，音频播放业务、录音业务、视频播放业务或相机业务等)切换至从设备102上执行，从而呈现多设备协同工作的分布式场景。其中，某一业务可与应用中的一项或多项功能对应。例如，视频APP可提供用于实现投屏功能的视频播放业务。又例如，音频APP可提供用于实现音频播放功能的音频播放业务，也可以提供用于实现音频录制功能的K歌业务。在分布式场景下，主设备101可将某一业务切换至从设备102上，此时，主设备 101可与从设备102协同执行该业务。
示例性的，主设备101可将正在播放的音频数据发送至从设备102，由从设备102播放该音频数据，从而将主设备101的音频播放业务切换至从设备102上执行。又例如，主设备101可将视频中的显示数据发送至一个从设备102播放，同时将视频中的音频数据发送至另一个从设备102播放，从而将主设备101的视频播放业务切换至多个从设备102上执行。其中，一项业务中可以包括一个或多个子任务。例如，上述视频播放业务可以包括与显示功能相关的显示子任务以及与音频功能相关的音频子任务。
又例如，主设备102可使用从设备102的麦克风采集音频数据，并将采集到的音频数据发送至主设备101保存或播放，从而将主设备101的录音业务切换至从设备102上执行。又例如，主设备102可使用从设备102的摄像头采集拍摄图像，并将拍摄图像发送至主设备101显示，从而将主设备101的相机业务切换至从设备102上执行。
但是，在上述分布式场景中，主设备101在向从设备102切换某一业务时，可能会因为设备性能的差别等原因出现音频质量变差、显示质量变差、音画不同步或时延较长等业务质量问题。
对此，在本申请实施例中，主设备101可以预测将当前业务切换至不同从设备102上执行时的业务质量，进而，主设备101可以根据预测结果向用户推荐执行上述业务的一个或多个电子设备。这样，用户可以按照主设备101的推荐选择合适的设备与主设备101协同工作执行相应的业务，从而提高分布式场景中主设备101与从设备102协同工作时的业务质量。
示例性的，如图2所示，主设备101可以与一个或多个从设备102建立网络连接。进而，当主设备101准备将业务1切换至一个或多个从设备102上执行时，主设备101可以从每个从设备102获取与业务1关联的设备参数。
例如，当业务1为相机业务时，与业务1关联的设备参数可以包括从设备102支持的图像处理算法、摄像头的数目、摄像头的分辨率或者摄像头的FOV等。
又例如，当业务1为音频播放业务时，与业务1关联的设备参数可以包括从设备102支持的音效算法、声道数目、采样率、混音策略以及喇叭的型号等。
又例如，当业务1为录音业务时，与业务1关联的设备参数可以包括从设备102支持的语音处理算法、音频数据的编解码算法以及麦克风的数目等。
又例如，当业务1为显示业务时，与业务1关联的设备参数可以包括从设备102支持的分辨率、帧率以及显示数据的编解码算法等。
仍如图2所示，主设备101从每个从设备102获取到与业务1关联的设备参数后，可根据获取到的设备参数预测各个从设备102执行业务1的业务质量。进而，主设备101可根据各个从设备102执行业务1的业务质量确定对应的推荐设备。例如，主设备101可以将执行业务1的业务质量最高的从设备102确定为推荐设备。或者，主设备101也可以在将业务1切换至某一从设备102执行后，即主设备101与从设备102协同执行某一业务的过程中，从每个从设备102获取与业务1关联的设备参数，并按照上述方法确定对应的推荐设备。
主设备101确定出对应的推荐设备后，可将确定出的推荐设备推荐给用户。例如，主设备101可显示提示消息，提示消息中可以携带推荐设备的标识。如果检测到用户 点击推荐设备的标识，则可触发主设备101将业务1重新切换至对应的推荐设备执行。
这样，用户可以通过上述提示消息及时获知当前分布式场景下适合执行上述业务1的具体设备。并且，用户可以通过上述提示消息中的标识快速切换执行上述业务1的具体设备，从而提高分布式场景中多设备协同工作时的业务质量，同时提高了用户的使用体验。
其中，主设备101获取各个从设备102的设备参数，以及确定对应推荐设备向用户进行推荐的具体过程将在后续实施例中详细阐述，故此处不予赘述。
示例性的，以手机作为上述录屏系统200中的主设备101举例，图3示出了手机的结构示意图。
手机可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180等。
可以理解的是，本发明实施例示意的结构并不构成对手机的具体限定。在本申请另一些实施例中，手机可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了系统的效率。
手机的无线通信功能可以通过天线1，天线2，移动通信模块150，无线通信模块160，调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。
移动通信模块150可以提供应用在手机上的包括2G/3G/4G/5G等无线通信的解决方案。在一些实施例中，移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中，移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
无线通信模块160可以提供应用在手机上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。
在一些实施例中，手机的天线1和移动通信模块150耦合，天线2和无线通信模块160耦合，使得手机可以通过无线通信技术与网络以及其他设备通信。
手机通过GPU，显示屏194，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏194和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器110可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像，视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，手机可以包括1个或N个显示屏194，N为大于1的正整数。
手机可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device，CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。在一些实施例中，手机可以包括1个或N个摄像头193，N为大于1的正整数。
外部存储器接口120可以用于连接外部存储卡，例如Micro SD卡，实现扩展手机的存储能力。外部存储卡通过外部存储器接口120与处理器110通信，实现数据存储功能。例如将音乐，视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令，从而执行手机的各种功能应用以及数据处理。手机可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中，音频模块170可以设置于处理器110中，或将音频模块170的部分功能模块设置于处理器110中。
扬声器170A，也称“喇叭”，用于将音频电信号转换为声音信号。手机可以通过扬声器170A收听音乐，或收听免提通话。
受话器170B，也称“听筒”，用于将音频电信号转换成声音信号。当手机接听电话或语音信息时，可以通过将受话器170B靠近人耳接听语音。
麦克风170C，也称“话筒”，“传声器”，用于将声音信号转换为电信号。当拨打电话或发送语音信息时，用户可以通过人嘴靠近麦克风170C发声，将声音信号输入到麦克风170C。手机可以设置至少一个麦克风170C。在另一些实施例中，手机可 以设置两个麦克风170C，除了采集声音信号，还可以实现降噪功能。在另一些实施例中，手机还可以设置三个，四个或更多麦克风170C，实现采集声音信号，降噪，还可以识别声音来源，实现定向录音功能等。
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130，也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform，OMTP)标准接口，美国蜂窝电信工业协会(cellular telecommunications industry association of the USA，CTIA)标准接口。
传感器模块180中可以包括压力传感器，陀螺仪传感器，气压传感器，磁传感器，加速度传感器，距离传感器，接近光传感器，指纹传感器，温度传感器，触摸传感器，环境光传感器，骨传导传感器等。
当然，手机还可以包括充电管理模块、电源管理模块、电池、按键、指示器以及1个或多个SIM卡接口等，本申请实施例对此不做任何限制。
上述手机的软件系统可以采用分层架构，事件驱动架构，微核架构，微服务架构，或云架构。本申请实施例以分层架构的Android系统为例，示例性说明手机的软件结构。当然，在其他操作系统中，只要各个功能模块实现的功能和本申请的实施例类似。
图4是本申请实施例的手机的软件结构框图。
分层架构将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将Android系统分为五层，从上至下分别为应用程序层，应用程序框架层(framework)，安卓运行时(Android runtime)和系统库(libraries)，HAL(hardware abstraction layer，硬件抽象层)以及内核层(kernel)。
应用程序层可以包括一系列应用程序包。
如图4所示，应用程序层中可以安装通话，备忘录，浏览器，联系人，相机，图库，日历，地图，蓝牙，音乐，视频，短信息等APP(应用，application)。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图4所示，应用程序框架层中设置有显示模块401、相机模块402以及音频模块403等功能模块。
例如，显示模块401可以包括图形处理器(SurfaceFlinger)。应用程序层的APP可以调用SurfaceFlinger绘制相应的显示界面，实现显示功能。
例如，相机模块402可以包括相机服务(CameraService)。应用程序层的APP可以调用CameraService启动摄像头执行预览、拍照或录像等操作，实现相应的相机功能。
例如，音频模块403可以包括音频录制器(AudioRecord)、音轨(AudioTrack)以及音频处理器(AudioFlinger)。应用程序层的APP可以调用AudioTrack开启音频播放功能。AudioTrack可将接收到的音频数据发送至AudioFlinger进行混音、采样等处理，由AudioFlinger将处理后的音频数据发送至扬声器等器件播放。类似的，应用程序层的APP可以调用AudioRecord开启录音功能。AudioFlinger可对麦克风等器件录制的音频数据进行混音、采样等处理，进而AudioFlinger可将处理后的音频数据发送至AudioRecord进行录制。
仍如图4所示，手机的HAL提供了与手机的不同硬件模块对应的HAL，例如，音频(Audio)HAL、相机(Camera)HAL、显示(Display)HAL、Wi-Fi HAL(图4中未示出)等。其中，Audio HAL可与手机的音频输入设备或音频输出设备对应，Camera HAL可与手机的摄像头对应，Display HAL可与手机的显示输出设备对应。
例如，显示模块401(例如SurfaceFlinger)可调用Display HAL，将显示数据发送给Display HAL，由Display HAL将显示数据发送给对应的显示设备(例如显示屏等)进行播放。
又例如，相机模块402(例如CameraService)可调用Camera HAL，由Camera HAL将摄像头等器件采集到的拍摄画面上报给CameraService。CameraService可将获取到的拍摄画面发送给对应的APP进行显示或保存。
类似的，音频模块403(例如AudioFlinger)可调用Audio HAL，将音频数据发送给Audio HAL，由Audio HAL将音频数据发送给对应的音频输出设备(例如扬声器、耳机等)进行播放。或者，AudioFlinger可调用Audio HAL，由Audio HAL将音频输入设备(例如麦克风)录制的音频数据上报给AudioFlinger。AudioFlinger可将获取到的音频数据发送给对应的APP。
另外，应用程序框架层还可以包括窗口管理器，内容提供器，视图系统，资源管理器，通知管理器等，本申请实施例对此不做任何限制。
例如，上述窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕等。上述内容提供器用来存放和获取数据，并使这些数据可以被应用程序访问。所述数据可以包括视频，图像，音频，拨打和接听的电话，浏览历史和书签，电话簿等。上述视图系统可用于构建应用程序的显示界面。每个显示界面可以由一个或多个控件组成。一般而言，控件可以包括图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏、微件(Widget)等界面元素。上述资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。上述通知管理器使应用程序可以在状态栏中显示通知信息，可以用于传达告知类型的消息，可以短暂停留后自动消失，无需用户交互。比如通知管理器被用于告知下载完成，消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知，例如后台运行的应用程序的通知，还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息，发出提示音，振动，指示灯闪烁等。
Android runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。
核心库包含两部分：一部分是java语言需要调用的功能函数，另一部分是安卓的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理，堆栈管理，线程管理，安全和异常的管理，以及垃圾回收等功能。
系统库可以包括多个功能模块。例如：表面管理器(surface manager)，媒体库(Media Libraries)，三维图形处理库(例如：OpenGL ES)，2D图形引擎(例如：SGL)等。
其中，表面管理器用于对显示子系统进行管理，并且为多个应用程序提供了2D和3D图层的融合。媒体库支持多种常用的音频，视频格式回放和录制，以及静态图像文件等。媒体库可以支持多种音视频编码格式，例如:MPEG4，H.264，MP3，AAC，AMR，JPG，PNG等。三维图形处理库用于实现三维图形绘图，图像渲染，合成，和图层处理等。2D图形引擎是2D绘图的绘图引擎。
内核层位于HAL之下，是硬件和软件之间的层。内核层中除了可以包含上述超声波驱动外，还可以包括显示驱动，摄像头驱动，音频驱动，传感器驱动等，本申请实施例对此不做任何限制。
基于图4所示的Android系统的软件架构，在本申请实施例中，如图5所示，手机的应用程序层中可安装用于实现分布式场景中各项业务的设备虚拟化(DeviceVirtualization)APP，后续可称为DV APP。DV APP可作为系统应用常驻在手机中运行。或者，也可将DV APP实现的功能以系统服务的形式常驻在手机中运行。
当手机需要协同一个或多个电子设备实现某一业务时，手机中的DV APP可将这一个或多个电子设备作为手机的从设备与手机建立网络连接。以从设备1举例，仍如图5所示，手机的DV APP与从设备1建立网络连接后，DV APP可基于该网络连接获取从设备的相关能力参数，例如，该能力参数可用于反映从设备1的显示能力、音频能力以及拍摄能力等一项或多项。进而，DV APP可调用HAL中的预设接口，向预设接口中输入获取到的能力参数，从而在HAL中创建与从设备1对应的HAL。
本申请实施例中可将DV APP按照从设备1的能力参数创建的HAL称为DMSDP(Distributed Mobile Sensing Development Platform，分布式移动传感开发平台)HAL1。与手机中传统的HAL(例如图4中的Audio HAL、Camera HAL、Display HAL)不同的是，DMSDP HAL 1并不与手机实际的硬件设备相对应，而是与手机当前连接的从设备1对应。手机可作为主设备通过DMSDP HAL 1与从设备1进行数据收发，将从设备1作为手机的一个虚拟设备，与从设备1协同完成分布式场景中的各项业务。
类似的，当手机有多个从设备时，DV APP还可以按照上述方法获取其他从设备的能力参数，并按照获取到的能力参数在HAL中创建对应的DMSDP HAL，从而与各个从设备进行数据收发。
其中，主设备(例如上述手机)获取从设备的能力参数，以及根据从设备的能力参数创建DMSDP HAL与从设备进行数据收发的具体过程可参见申请号为CN202010628962.7的申请文件的相关描述，故此处不予赘述。
在本申请实施例中，在图5所示的软件架构的基础上，如图6所示，可以在应用程序框架层中设置预测感知模块601。当手机与一个或多个从设备建立网络连接后，预测感知模块601可以实时检测当前运行的业务。例如，音频播放业务、视频通话业务、直播业务或录音业务等。
进而，预测感知模块601可以根据当前运行的业务，从各个从设备中获取与该业务对应的设备参数。例如，设备参数可以包括音频参数、显示参数或者相机参数等一项或多项参数。
其中，上述音频参数可以包括从设备支持的音效算法、声道数目、采样率、混音策略、音频数据的编解码算法、麦克风的数目和型号以及喇叭的数目和型号等一项或 多项。音频参数可以反映出从设备的音频能力(例如放音能力或录音能力)。
上述显示参数可以包括从设备支持的分辨率、帧率以及显示数据的编解码算法等一项或多项。显示参数可以反映出从设备的显示能力。
上述相机参数可以包括从设备支持的图像处理算法、摄像头的数目、摄像头的分辨率或者摄像头的FOV(field of view，视场角)等一项或多项。相机参数可以反映出从设备的拍摄能力。
示例性的，手机的预测感知模块601确定出与当前业务对应的设备参数后，可通过对应的DMSDP HAL从对应的从设备中获取该设备参数。例如，仍如图6所示，预测感知模块601可以通过DMSDP HAL 1向从设备1发送获取请求，从设备1可响应该获取请求将自身的设备参数发送至手机的DMSDP HAL 1，再由DMSDP HAL 1将从设备1的设备参数发送至预测感知模块601。这样，按照上述方法，预测感知模块601可以从各个从设备获取到与当前业务对应的设备参数。
后续，预测感知模块601可根据获取到的设备参数预测各个从设备执行上述业务时的业务质量。例如，预测感知模块601可根据每个从设备的设备参数，对该从设备执行上述业务时的业务质量进行打分。进而，预测感知模块601可将打分较高的一个或多个从设备作为推荐设备推荐给用户。例如，预测感知模块601可将确定出的推荐设备上报给正在运行当前业务的APP(例如相机APP)，由APP将上述推荐设备携带在提示消息中，并将该提示消息显示在显示界面中。
这样，用户可以获知当前分布式场景下适合执行上述业务的推荐设备，从而将当前的业务切换至预测感知模块601确定的推荐设备上执行，以提高分布式场景中多设备协同工作时的业务质量，同时提高了用户的使用体验。
以下将结合具体场景和示例详细阐述手机在分布式场景中向用户推荐执行不同业务时推荐设备的方法。
示例性的，用户可以在手机中选择一个或多个电子设备作为手机的从设备。例如，手机检测到用户打开控制中心的操作后，可以检测当前与手机接入同一通信网络的电子设备。例如，手机可以搜索与手机位于同一Wi-Fi网络中的一个或多个电子设备。又例如，手机可以在服务器中查询与手机登录同一账号(例如华为账号)的一个或多个电子设备。进而，如图7所示，手机可将检测到的一个或多个电子设备显示在控制中心701中。此时，用户可以在控制中心701中选择一个或多个电子设备作为手机的从设备。
仍如图7所示，控制中心701中显示有手机检测到的电视702、音箱703、手表704以及电视705。如果检测到用户点击电视702，则手机的DV APP可将电视702作为一个从设备与电视702建立网络连接。进而，如图8所示，手机的DV APP可基于该网络连接从电视702获取电视702的能力参数，例如，电视702的拍摄能力参数、音频能力参数以及显示能力参数等。后续，手机的DV APP可按照电视702的能力参数在HAL中创建对应的DMSDP HAL 1，使得手机可通过DMSDP HAL 1与电视702交互。
类似的，如果还检测到用户点击音箱703，仍如图8所示，则手机可按照上述方法获取音箱703的能力参数，并按照音箱703的能力参数在HAL中创建对应的DMSDP  HAL 2。如果还检测到用户点击电视705，则手机可按照上述方法获取电视705的能力参数，并按照电视705的能力参数在HAL中创建对应的DMSDP HAL 3。这样一来，手机可作为主设备可通过对应的DMSDP HAL与电视702、音箱703和电视705这三个从设备进行交互，实现分布式场景下的各项业务。
手机或从设备执行的业务一般涉及音频功能、显示功能或相机功能中的一项或多项。例如，与音频功能相关的业务可包括音频播放、录音、K歌、游戏、语音通话或视频通话等业务。例如，与显示功能相关的业务可包括视频播放、视频通话、游戏等业务。又例如，与相机功能相关的业务可包括拍照、录像、直播、扫码或视频通话等业务。
在本申请实施例中，手机与上述从设备(例如电视702、音箱703和电视705)建立网络连接后，手机中的预测感知模块601可实时检测手机在分布式场景下正在执行的具体业务(后续实施例中可称为目标业务)。
示例性的，预测感知模块601可以获取手机正在运行的应用的标识(例如应用的包名)，进而根据应用的标识确定正在执行的目标业务。例如，如果正在运行的应用为视频APP，则预测感知模块601可确定目标业务为视频播放业务。
或者，预测感知模块601还可以获取手机中各个器件的使用状态，结合器件的使用状态确定正在执行的目标业务。例如，当手机正在运行微信APP时，如果手机的前置摄像头为工作状态，则预测感知模块601可确定目标业务为视频通话业务。相应的，如果手机的后置摄像头为工作状态，则预测感知模块601可确定目标业务为扫码业务。
不同业务在运行时影响业务质量的设备参数可能不同。例如，对于音频播放业务，设备的喇叭数目、音效算法以及混音策略对业务质量的影响较大。又例如，对于直播业务，设备的显示分辨率、摄像头的型号、图像处理算法以及时延对业务质量的影响较大。
那么，如表1所示，手机中可预先存储不同业务与相关联的设备参数之间的对应关系。手机的预测感知模块601确定出当前的目标业务后，可以根据表1所示的对应关系确定与目标业务关联的具体设备参数。进而，仍如图8所示，手机的预测感知模块601可通过对应的DMSDP HAL从每个从设备中获取与目标业务关联的设备参数。
表1
业务 设备参数
业务A 设备参数A、设备参数B
业务B 设备参数A、设备参数B、设备参数C
…… ……
以目标业务为音频播放业务举例，如图9所示，手机在运行音乐APP播放歌曲A时，用户可通过音频切换功能将歌曲A切换至电视702中播放。手机的预测感知模块601识别出当前的目标业务为音频播放业务后，可根据表1所示的对应关系确定出与音频播放业务相关的设备参数包括喇叭数目、音效算法以及混音策略这三项音频参数。进而，手机的预测感知模块601通过调用DMSDP HAL 1，可从电视702中获取电视702的设备参数1，设备参数1中包括电视702的喇叭数目、音效算法以及混音策略。并且，手机的预测感知模块601通过调用DMSDP HAL 2，可从音箱703中获取音箱 703的设备参数2，设备参数2中包括音箱703的喇叭数目、音效算法以及混音策略。同样，手机的预测感知模块601通过调用DMSDP HAL 3，可从电视705中获取电视705的设备参数3，设备参数3中包括电视705的喇叭数目、音效算法以及混音策略。
进而，手机的预测感知模块601可根据获取到的设备参数1、设备参数2以及设备参数3，预测各个从设备执行音频播放业务时的业务质量。示例性的，手机中可预先存储不同业务中与各个设备参数对应的质量参数。例如，如表2所示，针对不同的业务，预先设置了与业务关联的各个设备参数的质量参数，每项质量参数可反映出对应业务对设备参数的需求。例如，在音频播放业务中，可设置与喇叭数目对应的质量参数为2个或2个以上，说明2个或2个以上的喇叭能够满足音频播放业务的业务需求。又例如，在直播业务中，可设置与时延对应的质量参数为500ms以内，说明500ms以内的时延可以满足直播业务的业务需求。
表2
Figure PCTCN2021114838-appb-000001
那么，手机的预测感知模块601从电视702中获取到设备参数1后，可结合表2中与音频播放业务对应的各项质量参数，预测电视702使用设备参数1执行音频播放业务时的业务质量分数1。
例如，预测感知模块601可结合表2中与音频播放业务对应的各项质量参数，对设备参数1中的每一项设备参数进行打分，即确定每一项设备参数的业务质量分数。例如，如果设备参数1中的喇叭数目为0个，则喇叭数目这一项设备参数的分数F1为0分；如果设备参数1中的喇叭数目为2个，则喇叭数目这一项设备参数的分数F1为60分；如果设备参数1中的喇叭数目为4个，则喇叭数目这一项设备参数的分数F1为80分。
按照上述打分方法，预测感知模块601可以得到对设备参数1中喇叭数目打分的分数F1、对设备参数1中音效算法打分的分数F2以及对设备参数1中混音策略打分的分数F3。进而，预测感知模块601可根据分数F1、分数F2以及分数F3计算电视702使用设备参数1执行音频播放业务时的业务质量分数1。例如，预测感知模块601可以按照预设的权重，计算分数F1、分数F2以及分数F3的加权平均值，并将计算出的加权平均值作为业务质量分数1。
类似的，预测感知模块601从音箱703中获取到设备参数2后，可按照上述方法预测音箱703使用设备参数2执行音频播放业务时的业务质量分数2。并且，预测感知模块601从电视705中获取到设备参数3后，可按照上述方法预测电视705使用设 备参数3执行音频播放业务时的业务质量分数3。
在另一些实施例中，手机中也可预先存储不同业务中与各个设备参数对应的质量参数打分曲线或打分规则。仍以音频播放业务举例，如图10中的(a)所示，在音频播放业务中，不同喇叭数目与质量参数打分之间的对应关系为曲线1。预测感知模块601可以根据曲线1，确定与设备参数1中喇叭数目这一项设备参数的分数F1。如图10中的(b)所示，为音频播放业务中，不同音效算法与质量参数打分之间的打分规则1。预测感知模块601可以根据打分规则1，确定与设备参数1中音效算法这一项设备参数的分数F2。类似的，如图10中的(c)所示，为音频播放业务中，不同混音策略与质量参数打分之间的打分规则2。预测感知模块601可以根据打分规则2，确定与设备参数1中混音策略这一项设备参数的分数F3。
进而，预测感知模块601可根据分数F1、分数F2以及分数F3计算电视702使用设备参数1执行音频播放业务时的业务质量分数1。当然，预测感知模块601还可以按照上述方法获取音箱703使用设备参数2执行音频播放业务时的业务质量分数2，以及电视705使用设备参数3执行音频播放业务时的业务质量分数3。
手机的预测感知模块601获取到上述业务质量分数1、业务质量分数2以及业务质量分数3后，可根据这些业务质量分数确定与当前音频播放业务对应的推荐设备。例如，如果业务质量分数2＞业务质量分数1＞业务质量分数3，说明音箱703执行音频播放业务的业务质量高于当前电视702执行音频播放业务的业务质量，则预测感知模块601可将音箱703确定为推荐设备。此时，仍如图8所示，预测感知模块601可将确定出的推荐设备(即音箱703)的标识上报给正在运行的APP(即音乐APP)。
进而，如图11所示，音乐APP可根据预测感知模块601上报的推荐设备，在显示界面1101中显示提示消息1101。提示消息1101用于提示用户使用业务质量更高的音箱703执行当前的音频播放业务。例如，提示消息1101中可以包括音箱703的标识1102。这样，在分布式场景中用户通过提示消息1101可以感知到其他从设备执行某一业务时的业务质量。后续，如果检测到用户点击音箱703的标识1102，则手机可将当前的音频播放业务切换至音箱703中继续执行，同时停止在电视702上继续执行上述音频播放业务，从而提高音频播放业务的业务质量。
在一些实施例中，手机的预测感知模块601也可以根据某一项设备参数的业务质量分数确定对应的推荐设备。例如，如果音箱703的混音策略这一设备参数的打分高于其他从设备的混音策略这一设备参数的打分，但电视702的音效算法这一设备参数的打分高于其他从设备的音效算法这一设备参数的打分，说明音箱703的混音能力较高，而电视702对音频数据的音效处理能力较高。此时，预测感知模块601可将音箱703作为推荐设备，并向音乐APP通知音箱703的混音能力高于其他从设备。进而，如图12所示，音乐APP可在提示消息1201中提示用户音箱703在音频播放业务中的混音能力更强。当然，音乐APP还可以在提示消息1201中提示用户当前播放音频数据的电视702的音效处理能力更强。
这样，在分布式场景中用户可以感知到不同从设备执行某一业务时的不同业务能力，从而有选择性的选择相应的从设备执行该业务。
或者，预测感知模块601可将确定出的推荐设备(例如音箱703)通知给其他APP， 例如，通知中心APP等系统APP。以通知中心APP举例，通知中心APP接收到来自预测感知模块601发送的推荐设备的标识后，与图11或图12类似的，通知中心APP可以通知消息的形式提示用户使用业务质量更高的音箱703执行当前的音频播放业务，本申请实施例对此不做任何限制。
又或者，预测感知模块601还可以将确定出的推荐设备通过对应的DMSDP HAL 1通知给正在执行音频播放业务的电视702。进而，如图13所示，电视702获取到手机发送的推荐设备的标识后可以显示提示消息1301，提示用户使用业务质量更高的音箱703执行当前的音频播放业务。后续，如果电视702检测到用户选中提示消息1301中音箱703的标识，则电视702可停止执行上述音频播放业务。同时，电视702可向手机发送业务切换消息，使得手机可响应该业务切换消息将当前的音频播放业务切换至音箱703中继续执行，从而提高音频播放业务的业务质量。
当然，如果预测感知模块601确定出当前正在执行音频播放业务的电视702为业务质量最高的设备，则预测感知模块601可以向音乐APP通知当前执行音频播放业务的电视702已为最优设备。此时，手机或电视702可以不再向用户推荐其他设备执行该音频播放业务。
在另一些实施例中，手机的预测感知模块601除了可以预测各个从设备(例如电视702、音箱703以及电视705)执行音频播放业务时的业务质量分数外，还可以预测手机自身执行音频播放业务时的业务质量分数。
例如，手机的预测感知模块601还可以获取与当前的音频播放业务关联的设备参数4，即手机中的喇叭数目、音效算法以及混音策略。进而，预测感知模块601可按照上述方法预测手机使用设备参数4执行音频播放业务时的业务质量分数4。后续，预测感知模块601可结合业务质量分数4以及与各个从设备对应的业务质量分数确定本次的推荐设备。也就是说，主设备(即手机)也可以作为推荐设备的一个候选设备，当主设备执行目标业务(例如上述音频播放业务)的业务质量较高时，也可以提示用户使用主设备执行上述目标业务。
上述实施例中是以音频播放业务为例进行说明的，可以理解的是，当手机在分布式场景中执行其他业务时，也可以按照上述方法向用户推荐执行其他业务时业务质量更高的推荐设备。
示例性的，如图14所示，手机在运行视频APP时，手机可响应用户的投屏操作将视频APP中播放的视频B投射至电视702中播放。在投屏过程中，手机可通过DMSDP HAL 1将视频B的显示数据发送给电视702，同时，手机可通过DMSDP HAL 1将视频B的音频数据发送给电视702。
并且，在投屏过程中，手机的预测感知模块601可识别出当前的目标业务为视频播放业务。进而，预测感知模块601可根据表1所示的对应关系确定出与视频播放业务关联的设备参数。例如，与视频播放业务关联的设备参数可以包括显示屏的分辨率等与显示功能相关的显示参数，还可以包括麦克风的数目、音效算法等与音频功能相关的音频参数。
仍以手机的从设备包括电视702、音箱703以及电视705举例，手机的预测感知模块601确定出与视频播放业务关联的设备参数后，可通过对应的DMSDP HAL从每 个从设备中获取与视频播放业务关联的设备参数。进而，预测感知模块601可按照上述实施例中的方法，根据获取到的设备参数预测每个从设备执行视频播放业务时的业务质量分数，并根据每个从设备执行视频播放业务时的业务质量分数确定相应的推荐设备。
例如，如果电视705执行视频播放业务时的业务质量分数高于电视702执行视频播放业务时的业务质量分数，并且，电视705执行视频播放业务时的业务质量分数高于音箱703执行视频播放业务时的业务质量分数，则预测感知模块601可将电视705确定为本次执行视频播放业务的推荐设备。
进而，如图15中的(a)所示，预测感知模块601可向视频APP通知当前的推荐设备为电视705，使得视频APP可在显示界面中显示提示消息1501，提示用户使用业务质量更高的电视705执行当前的视频播放业务。其中，提示消息1501中可以包括电视705的标识。如果检测到用户点击电视705的标识，则手机可将当前的视频播放业务切换至电视705中继续执行，同时停止在电视702上继续执行上述视频播放业务，从而提高本次视频播放业务的业务质量。
或者，如图15中的(b)所示，预测感知模块601可将确定出的推荐设备通过对应的DMSDP HAL 1通知给正在执行视频播放业务的电视702。电视702确定本次执行视频播放业务的推荐设备为电视705后，可以显示提示消息1502，以提示用户使用业务质量更高的电视705执行当前的视频播放业务。类似的，如果电视702检测到用户选中提示消息1502中电视705的标识，则电视702可停止执行上述视频播放业务。同时，电视702可向手机发送业务切换消息，使得手机可响应该业务切换消息将当前的视频播放业务切换至电视705中继续执行，从而提高音频播放业务的业务质量。
当然，如果预测感知模块601确定出当前正在执行视频播放业务的电视702为业务质量最高的设备，则预测感知模块601可以向视频APP通知当前执行视频播放业务的电视702已为最优设备。此时，手机或电视702可以不再向用户推荐其他设备执行该视频播放业务。
在另一些实施例中，手机的预测感知模块601也可以根据不同从设备中不同设备参数的业务质量分数，确定多个从设备执行当前的视频播放业务(即目标业务)。此时，预测感知模块601确定出的推荐设备可以有多个。
例如，预测感知模块601可以从电视702中获取与视频播放业务关联的设备参数1。设备参数1中包括电视702的音频参数和显示参数。同样，预测感知模块601可以从音箱703中获取与视频播放业务关联的设备参数2。设备参数2中包括音箱703的音频参数和显示参数。如果预测感知模块601对设备参数1中显示参数的业务质量打分高于对设备参数2中显示参数的业务质量打分，则说明电视702的显示能力比音箱703的显示能力高。如果预测感知模块601对设备参数2中音频参数的业务质量打分高于对设备参数1中音频参数的业务质量打分，则说明音箱703的音频能力比电视702的显示能力高。
此时，预测感知模块601可以将音箱703和电视702这两个设备均确定为推荐设备，其中，电视702可用于执行视频播放业务中与显示功能相关的第一子任务，音箱703可用于执行视频播放业务中与音频功能相关的第二子任务。进而，预测感知模块 601可向手机的视频APP通知电视702为执行第一子任务的推荐设备，音箱703为执行第二子任务的推荐设备。进而，如图16所示，视频APP可按照预测感知模块601通知的推荐设备显示提示消息1601。提示消息1601中可提示用户使用“电视702+音箱703”组成的设备组协同执行上述视频播放业务，使得用户可以享受到最优的视频播放业务质量。
后续，如果检测到用户选择提示消息1601中的确认按钮1602，则手机可将正在播放的视频B中的显示数据切换至电视702播放(即将视频播放业务中的第一子任务切换至电视702)，同时，将视频B中的音频数据切换至音箱703播放(即将视频播放业务中的第二子任务切换至音箱703)，通过多设备协同工作的方式提高视频播放业务的业务质量。
也就是说，主设备(例如手机)可以将当前的目标业务划分为多个子任务，进而根据各个从设备的设备参数为各个子任务确定最佳的推荐设备，从而将目标业务分布至多个推荐设备中执行，通过多设备协同工作的方式提高目标业务的业务质量。
除了在上述音频播放业务和视频播放业务中手机可以根据从设备的设备参数推荐对应的推荐设备外，当手机在执行与相机功能相关的业务时，手机也可以按照上述方法向用户推荐业务质量更高的推荐设备。
示例性的，手机在运行微信APP时，用户可打开微信APP的视频通话功能与联系人(例如联系人Sam)进行视频通话。如图17所示，在视频通话的过程中，手机可使用电视702的摄像头采集图像数据，并且，手机可使用电视702的显示屏显示视频通话界面。此时，手机可通过DMSDP HAL 1获取电视702的摄像头采集到的图像数据，并且，手机可通过DMSDP HAL 1将视频通话界面的显示数据发送至电视702中显示。
在视频通话的过程中，手机的预测感知模块601可识别出当前的目标业务为视频通话业务。进而，预测感知模块601可根据表1所示的对应关系确定出与视频通话业务关联的设备参数。例如，与视频通话业务关联的设备参数可以包括显示屏的分辨率等与显示功能相关的显示参数，还可以包括麦克风的数目、音效算法等与音频功能相关的音频参数，还可以包括摄像头的数目等与相机功能相关的相机参数，还可以包括时延等参数。
仍以手机的从设备包括电视702、音箱703以及电视705举例，手机的预测感知模块601确定出与视频通话业务关联的设备参数后，可通过对应的DMSDP HAL从每个从设备中获取与视频通话业务关联的设备参数。进而，预测感知模块601可按照上述实施例中的方法，预测每个从设备执行视频通话业务时的业务质量分数，并根据每个从设备执行视频通话业务时的业务质量分数确定推荐设备。
例如，如果电视705执行视频通话业务时的业务质量分数高于电视702执行视频通话业务时的业务质量分数，并且，电视705执行视频通话业务时的业务质量分数高于音箱703执行视频通话业务时的业务质量分数，则预测感知模块601可将电视705确定为本次执行视频通话业务的推荐设备。
进而，如图18中的(a)所示，预测感知模块601可向微信APP通知当前的推荐设备为电视705，使得微信APP可在显示界面中显示提示消息1701，提示用户使用业 务质量更高的电视705执行当前的视频通话业务。或者，如图18中的(b)所示，预测感知模块601可将确定出的推荐设备通过对应的DMSDP HAL 1通知给正在执行视频通话业务的电视702，由电视702显示提示消息1702，以提示用户使用业务质量更高的电视705执行当前的视频通话业务。
另外，对于视频通话业务、直播业务或K歌业务等实时性需求较高的业务，手机的预测感知模块601还可以预测执行对应业务所需的时延，基于预测出的时延推荐相应的推荐设备。也就是说，对于实时性需求较高的业务，可将各个设备执行该业务所需的时延作为该业务质量高低的判断标准。例如，手机在计算各个设备执行该业务的业务质量分数时可将时延这一设备参数的权重值设置为1，此时，当前业务的业务质量完全依赖于时延这一设备参数。
仍以视频通话业务举例，手机的预测感知模块601识别出当前的目标业务为视频通话业务后，可获取与每个从设备之间的网络时延，以及每个从设备执行视频通话业务的处理时延。这样，在分布式场景下每个从设备执行视频通话业务的时延为网络时延与处理时延之和。
以电视702与手机之间的网络连接为Wi-Fi连接举例，手机的预测感知模块601可调用Wi-Fi HAL检测手机与电视702之间的网络时延L11。并且，预测感知模块601可通过DMSDP HAL 1从电视702获取电视702执行视频通话业务的处理时延L12。进而，预测感知模块601可计算出电视702执行视频通话业务的时延L1＝L11+L12。类似的，预测感知模块601还可以按照上述方法计算出音箱703执行视频通话业务的时延L2以及电视705执行视频通话业务的时延L3。
示例性的，如果表2中设置了视频通话业务中时延的质量参数为500ms以内，说明500ms以内的时延可以满足视频通话业务的业务质量需求。那么，如果手机的预测感知模块601计算出电视702执行视频通话业务的时延L1大于500ms，而电视705执行视频通话业务的时延L3小于500ms，则预测感知模块601可将电视705确定为本次视频通话业务的推荐设备。此时，如图19所示，预测感知模块601可向微信APP通知当前的推荐设备为电视705，使得微信APP按照该推荐设备在显示界面中显示提示消息1801，提示用户使用时延更低的电视705执行当前的视频通话业务。当然，也可以在正在执行视频通话业务的电视702中显示上述提示消息，本申请实施例对此不做任何限制。
在一些实施例中，当电视702执行视频通话业务的时延L1大于500ms时，手机的预测感知模块601还可以进一步分析时延L1超过500ms的具体原因。例如，如果是因为电视702与手机之间的网络时延L11大于阈值1导致时延L1超过500ms，说明当前的网络状态较差，与各个从设备交互时的时延均较长，则预测感知模块601可将手机自身确定为执行本次视频通话业务的推荐设备。此时，如图20中的(a)所示，预测感知模块601可通知手机中的微信APP(或电视702)显示提示消息1901，在提示消息1901中提示用户当前的网络状态较差，建议用户使用手机执行当前的视频通话业务。
或者，如果是因为电视702执行视频通话业务的处理时延L12大于阈值2导致时延L1超过500ms，则预测感知模块601可简化电视702执行视频通话业务的处理过程。 例如，预测感知模块601可确定视频通话策略1，在视频通话策略1中电视702无需对音频数据进行音效处理。又例如，预测感知模块601可确定视频通话策略2，在视频通话策略2中电视702可使用指定的编解码算法对显示数据进行编解码处理。进而，如图20中的(b)所示，预测感知模块601可通知手机中的微信APP(或电视702)按照确定出的视频通话策略显示提示消息1902，在提示消息1902中提示用户简化电视702执行视频通话业务的处理过程，以降低执行视频通话业务的时延。后续，如果检测到用户选择提示消息1902中的确认按钮1903，则预测感知模块601可通过对应的DMSDP HAL 1向电视702发送上述视频通话策略，使得电视702可按照该视频通话策略简化执行视频通话业务的处理过程，从而降低整个视频通话业务的时延，提高视频通话业务的业务质量。
当然，手机的预测感知模块601也可以在确定出简化视频通话业务处理过程的视频通话策略后，直接向电视702发送上述视频通话策略，使得电视702可以按照该视频通话策略简化执行视频通话业务的处理过程。此时，手机(或电视702)可显示提示消息提示用户已经简化了视频通话业务的处理过程，以降低整个视频通话业务的时延。
又或者，如果电视702与手机之间的网络时延L11大于阈值1，且电视702执行视频通话业务的处理时延L12大于阈值2，则预测感知模块601可在其他从设备中选择执行视频通话业务时时延小于500ms的从设备作为推荐设备。进而，与图19类似的，预测感知模块601可通知手机中的微信APP(或电视702)显示对应的提示消息，提示用户使用时间更低的电子设备执行当前的视频通话业务。
上述实施例中是以手机作为主设备在与从设备协同执行某一项业务的过程中向用户推荐更适合执行该业务的推荐设备为例说明的，在另一些实施例中，手机还可以在检测到手机将作为主设备执行某一业务时，提前向用户推荐更适合执行该业务的推荐设备。
仍以手机的从设备包括电视702、音箱703以及电视705举例，如图21中的(a)所示，手机的下拉菜单2001中可以设置投屏按钮2002。如果检测到用户点击投屏按钮2002，说明手机开启了投屏功能准备执行投屏业务(例如视频播放业务)。此时，手机的预测感知模块601可按照上述实施例中的方法从各个从设备中获取与投屏业务关联的设备参数，并且根据获取到的设备参数预测各个从设备执行投屏业务时的业务质量分数，从而按照预测出的业务质量分数向用户推荐对应的推荐设备。
例如，当预测感知模块601预测出电视705执行投屏业务时的业务质量分数1高于电视702执行投屏业务时的业务质量分数2，且电视702执行投屏业务时的业务质量分数2高于音箱703执行投屏业务时的业务质量分数3时，说明电视705、电视702以及音箱703这三个从设备执行投屏业务的业务质量依次降低。那么，如图21中的(b)所示，手机可响应用户点击投屏按钮2002的操作显示设备列表2003。在设备列表2003中，手机可以按照执行投屏业务的业务质量分数由高至低的顺序排列各个从设备。用户可在设备列表2003中选择将手机中的内容投射至哪个从设备中播放，上述排列顺序可推荐用户使用业务质量分数较高的设备执行本次投屏业务，以提高后续投屏业务的业务质量。
又或者，手机的预测感知模块601可根据获取到的设备参数预测不同从设备在执行投屏业务时的具体业务质量。例如，预测感知模块601可根据电视702的设备参数预测电视702在执行投屏业务时可能出现音画不同步的现象。又例如，预测感知模块601可根据音箱703的设备参数预测音箱703在执行投屏业务时无法显示显示数据。进而，如图22所示，手机可响应用户点击投屏按钮2002的操作显示设备列表2003。在设备列表2003中，手机可向用户提示每一从设备执行本次投屏业务的具体业务质量。
也就是说，在分布式场景中，手机作为主设备可以在执行某一业务之前，预测出将该业务切换至各个从设备上执行时的具体业务质量，从而在用户选择执行该业务的从设备时向用户提示业务质量较好的从设备。这样，手机可以在与多设备协同工作之前向用户推荐适合执行本次业务的推荐设备，从而方便用户将本次业务切换至推荐设备上执行，以提高分布式场景中多设备协同工作时的业务质量，同时提高用户的使用体验。
需要说明的是，上述实施例中是以手机为分布式场景中的主设备举例说明的，可以理解的是，分布式场景中的主设备还可以是平板电脑、电视等电子设备，本申请实施例对此不做任何限制。
另外，上述实施例中是以Android系统为例阐述的各个功能模块之间实现定位的具体方法，可以理解的是，也可以在其他操作系统中设置相应的功能模块实现上述定位方法。只要各个设备和功能模块实现的功能和本申请的实施例类似，即属于本申请权利要求及其等同技术的范围之内。
本申请实施例公开了一种电子设备，该电子设备可以为上述实施例中的主设备(例如手机)。该电子设备具体可以包括处理器，以及与处理器相连的存储器、输入设备和输出设备。其中，输入设备和输出设备可集成为一个设备，例如，可将触摸传感器作为输入设备，将显示屏作为输出设备，并将触摸传感器和显示屏集成为触摸屏。
示例性的，如图23所示，上述电子设备可以包括：触摸屏2201，所述触摸屏2201包括触摸传感器2206和显示屏2207；一个或多个处理器2202；存储器2203；通信模块2208；一个或多个应用程序(未示出)；以及一个或多个计算机程序2204，上述各器件可以通过一个或多个通信总线2205连接。其中该一个或多个计算机程序2204被存储在上述存储器2203中并被配置为被该一个或多个处理器2202执行，该一个或多个计算机程序2204包括指令，该指令可以用于执行上述实施例中主设备执行的相关步骤。
其中，上述处理器2202具体可以为图3所示的处理器110，上述存储器2203具体可以为图3所示的内部存储器121，上述显示屏2207具体可以为图3所示的显示屏194，上述触摸传感器2206具体可以为图3所示的传感器模块180中的触摸传感器，本申请实施例对此不做任何限制。
通过以上的实施方式的描述，所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请实施例各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本申请实施例的具体实施方式，但本申请实施例的保护范围并不局限于此，任何在本申请实施例揭露的技术范围内的变化或替换，都应涵盖在本申请实施例的保护范围之内。因此，本申请实施例的保护范围应以所述权利要求的保护范围为准。

Claims (18)

  1. 一种设备推荐方法，其特征在于，包括：
    第一设备接收用户打开第一业务的第一操作；
    响应于所述第一操作，所述第一设备从N个电子设备中分别获取与所述第一业务关联的设备参数，所述N个电子设备与所述第一设备位于同一通信网络，N为大于0的整数；
    所述第一设备根据所述设备参数预测所述N个电子设备中每个电子设备执行所述第一业务的业务质量；
    所述第一设备按照所述N个电子设备中每个电子设备执行所述第一业务的业务质量显示设备列表，所述设备列表中包括所述N个电子设备中至少一个电子设备的设备标识。
  2. 根据权利要求1所述的方法，其特征在于，所述N个电子设备中包括第二设备；所述第一设备从所述第二设备获取到的设备参数包括M项参数，M为大于0的整数；
    其中，所述第一设备根据所述设备参数预测所述第二设备执行所述第一业务的业务质量，包括：
    所述第一设备确定与所述M项参数一一对应的M项分数；
    所述第一设备根据所述M项分数计算所述第二设备执行所述第一业务的业务质量分数；当所述业务质量分数越高时，所述第一业务的业务质量越高。
  3. 根据权利要求2所述的方法，其特征在于，所述N个电子设备中还包括第三设备；
    当所述第二设备执行所述第一业务的业务质量分数高于所述第三设备执行所述第一业务的业务质量分数时，所述第二设备在所述设备列表中的排列顺序位于所述第三设备之前。
  4. 根据权利要求2所述的方法，其特征在于，
    当所述第二设备执行所述第一业务的业务质量分数高于所述N个电子设备中其他电子设备执行所述第一业务的业务质量分数时，所述第二设备在所述设备列表中被标记为推荐设备。
  5. 根据权利要求2所述的方法，其特征在于，所述M项参数中包括与第一功能对应的第一参数；
    当所述第二设备的第一参数的分数高于所述N个电子设备中其他电子设备的第一参数的分数时，所述设备列表中包括第一提示信息，所述第一提示信息用于推荐用户使用所述第二设备实现所述第一功能。
  6. 根据权利要求2所述的方法，其特征在于，所述M项参数中包括与第一功能对应的第一参数；
    当所述第二设备的第一参数的分数低于所述N个电子设备中其他电子设备的第一参数的分数时，所述设备列表中包括第二提示信息，所述第二提示信息包括不推荐用户使用所述第二设备实现所述第一功能的原因。
  7. 根据权利要求1-6中任一项所述的方法，其特征在于，所述N个电子设备中包括第二设备；
    在所述第一设备按照所述N个电子设备中每个电子设备执行所述第一业务的业务质量显示设备列表之后，还包括：
    所述第一设备接收用户在所述设备列表中选择所述第二设备的第二操作；
    响应于所述第二操作，所述第一设备将所述第一业务切换至所述第二设备中执行。
  8. 根据权利要求7所述的方法，其特征在于，在所述第一设备将所述第一业务切换至所述第二设备中执行之后，还包括：
    所述第一设备从所述N个电子设备中分别获取与所述第一业务关联的设备参数；
    所述第一设备根据所述设备参数预测所述N个电子设备中每个电子设备执行所述第一业务的业务质量；
    当所述第二设备不是所述N个电子设备中执行所述第一业务的业务质量最高的电子设备时，所述第一设备显示第一提示消息，所述第一提示消息用于提示用户使用推荐设备执行所述第一业务，所述推荐设备为所述N个电子设备中的一个或多个。
  9. 根据权利要求8所述的方法，其特征在于，所述第一设备根据所述设备参数预测所述N个电子设备中每个电子设备执行所述第一业务的业务质量，包括：
    所述第一设备根据从每个电子设备获取的设备参数，计算每个电子设备执行所述第一业务的业务质量分数。
  10. 根据权利要求9所述的方法，其特征在于，所述N个电子设备中包括第三设备；
    当所述第三设备执行所述第一业务的业务质量分数高于所述N个电子设备中的其他电子设备时，所述推荐设备为所述第三设备；或者，
    当所述第三设备执行所述第一业务中第一子任务的业务质量分数高于所述N个电子设备中的其他电子设备时，所述推荐设备为所述第三设备。
  11. 根据权利要求9所述的方法，其特征在于，所述第一业务包括第一子任务和第二子任务，所述N个电子设备中包括第三设备和第四设备；
    当所述第三设备执行所述第一子任务的业务质量分数高于所述N个电子设备中的其他电子设备，且所述第四设备执行所述第二子任务的业务质量分数高于所述N个电子设备中的其他电子设备时，所述推荐设备为所述第三设备和所述第四设备。
  12. 根据权利要求9-11中任一项所述的方法，其特征在于，所述方法还包括：
    所述第一设备预测所述第一设备执行所述第一业务的业务质量分数；
    其中，当所述第一设备执行所述第一业务的业务质量分数高于所述N个电子设备时，所述推荐设备为所述第一设备。
  13. 根据权利要求8-12中任一项所述的方法，其特征在于，所述第一提示消息中包括所述推荐设备的设备标识；
    在所述第一设备显示第一提示消息之后，还包括：
    所述第一设备接收用户在所述第一提示消息中选择所述推荐设备的第三操作；
    响应于所述第三操作，所述第一设备将所述第一业务切换至所述推荐设备中执行。
  14. 根据权利要求8-13中任一项所述的方法，其特征在于，当所述第二设备不是所述N个电子设备中执行所述第一业务的业务质量最高的电子设备时，所述方法还包括：
    所述第一设备向所述第二设备通知所述推荐设备，以使得所述第二设备显示第二提示消息，所述第二提示消息用于提示用户使用推荐设备执行所述第一业务。
  15. 根据权利要求1-14中任一项所述的方法，其特征在于，所述设备参数包括音频参数、显示参数、相机参数或时延中的一个或多个。
  16. 一种电子设备，其特征在于，所述电子设备包括：
    显示屏；
    一个或多个处理器；
    存储器；
    通信模块；
    其中，所述存储器中存储有一个或多个计算机程序，所述一个或多个计算机程序包括指令，当所述指令被所述电子设备执行时，使得所述电子设备执行如权利要求1-15中任一项所述第一设备执行的一种设备推荐方法。
  17. 一种计算机可读存储介质，所述计算机可读存储介质中存储有指令，其特征在于，当所述指令在电子设备上运行时，使得所述电子设备执行如权利要求1-15中任一项所述第一设备执行的一种设备推荐方法。
  18. 一种包含指令的计算机程序产品，其特征在于，当所述计算机程序产品在电子设备上运行时，使得所述电子设备执行如权利要求1-15中任一项所述第一设备执行的一种设备推荐方法。
PCT/CN2021/114838 2020-11-27 2021-08-26 一种设备推荐方法及电子设备 WO2022110939A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP21896443.5A EP4152756A4 (en) 2020-11-27 2021-08-26 DEVICE RECOMMENDATION METHOD AND ELECTRONIC DEVICE
US17/928,745 US20230232066A1 (en) 2020-11-27 2021-08-26 Device recommendation method and electronic device

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202011360717 2020-11-27
CN202011360717.9 2020-11-27
CN202110483159.3 2021-04-30
CN202110483159.3A CN114567619B (zh) 2020-11-27 2021-04-30 一种设备推荐方法及电子设备

Publications (1)

Publication Number Publication Date
WO2022110939A1 true WO2022110939A1 (zh) 2022-06-02

Family

ID=81711864

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/114838 WO2022110939A1 (zh) 2020-11-27 2021-08-26 一种设备推荐方法及电子设备

Country Status (4)

Country Link
US (1) US20230232066A1 (zh)
EP (1) EP4152756A4 (zh)
CN (1) CN114567619B (zh)
WO (1) WO2022110939A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024046182A1 (zh) * 2022-08-30 2024-03-07 华为技术有限公司 一种音频播放方法、系统及相关装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080039018A1 (en) * 2006-08-08 2008-02-14 Samsung Electronics Co., Ltd. Method and apparatus for automatic connection between mobile communication terminal and bluetooth handsfree device
CN109120970A (zh) * 2018-09-30 2019-01-01 珠海市君天电子科技有限公司 一种无线投屏方法、终端设备及存储介质
CN109922205A (zh) * 2018-11-29 2019-06-21 努比亚技术有限公司 投屏实现方法、移动终端及计算机可读存储介质
WO2020082373A1 (zh) * 2018-10-26 2020-04-30 华为技术有限公司 一种通信系统的切换方法和终端设备
CN111294625A (zh) * 2020-01-09 2020-06-16 华为技术有限公司 组合设备服务能力的方法、装置、终端设备和存储介质

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9519728B2 (en) * 2009-12-04 2016-12-13 Time Warner Cable Enterprises Llc Apparatus and methods for monitoring and optimizing delivery of content in a network
EP2560404A3 (en) * 2010-01-19 2013-02-27 LG Electronics Electronic device and operating method of the same
FR3022717A1 (fr) * 2014-06-23 2015-12-25 Orange Procede de selection dynamique par un appelant parmi une pluralite de terminaux d' un appele
KR102289474B1 (ko) * 2015-02-27 2021-08-13 삼성전자주식회사 오디오를 출력하는 방법 및 이를 위한 전자 장치
JP6399204B2 (ja) * 2015-03-18 2018-10-03 株式会社リコー 情報処理装置、画面切り替え方法、プログラム、伝送システム
KR102347069B1 (ko) * 2015-12-14 2022-01-04 삼성전자주식회사 전자 장치 및 그 동작방법
KR101751620B1 (ko) * 2015-12-15 2017-07-11 라인 가부시키가이샤 시각적 또는 청각적 효과의 양방향 전달을 이용한 영상 통화 방법 및 시스템
CN113504851A (zh) * 2018-11-14 2021-10-15 华为技术有限公司 一种播放多媒体数据的方法及电子设备
US11510279B2 (en) * 2019-05-14 2022-11-22 Qubercomm Technologies, Inc. System and method for selecting a path in a communication network
US11212330B2 (en) * 2020-02-06 2021-12-28 Lenovo (Singapore) Pte. Ltd. Casting content based on device capabilities
CN111580923B (zh) * 2020-05-18 2023-02-17 联想(北京)有限公司 一种控制方法、装置及电子设备
CN111796784A (zh) * 2020-06-12 2020-10-20 彭程 投屏方法、电子设备及投屏终端

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080039018A1 (en) * 2006-08-08 2008-02-14 Samsung Electronics Co., Ltd. Method and apparatus for automatic connection between mobile communication terminal and bluetooth handsfree device
CN109120970A (zh) * 2018-09-30 2019-01-01 珠海市君天电子科技有限公司 一种无线投屏方法、终端设备及存储介质
WO2020082373A1 (zh) * 2018-10-26 2020-04-30 华为技术有限公司 一种通信系统的切换方法和终端设备
CN109922205A (zh) * 2018-11-29 2019-06-21 努比亚技术有限公司 投屏实现方法、移动终端及计算机可读存储介质
CN111294625A (zh) * 2020-01-09 2020-06-16 华为技术有限公司 组合设备服务能力的方法、装置、终端设备和存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4152756A4

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024046182A1 (zh) * 2022-08-30 2024-03-07 华为技术有限公司 一种音频播放方法、系统及相关装置

Also Published As

Publication number Publication date
EP4152756A4 (en) 2023-12-06
CN114567619A (zh) 2022-05-31
US20230232066A1 (en) 2023-07-20
EP4152756A1 (en) 2023-03-22
CN114567619B (zh) 2023-01-17

Similar Documents

Publication Publication Date Title
US11880628B2 (en) Screen mirroring display method and electronic device
US11907604B2 (en) Screen mirroring display method using layer orders of target controls and electronic device
CN110377250B (zh) 一种投屏场景下的触控方法及电子设备
CN110381197B (zh) 多对一投屏中音频数据的处理方法、装置及系统
EP4044609A1 (en) Cross-device content projection method and electronic device
WO2021078284A1 (zh) 一种内容接续方法及电子设备
EP4246957A1 (en) Photographing method, system, and electronic device
WO2022089271A1 (zh) 无线投屏方法、移动设备及计算机可读存储介质
CN112398855B (zh) 应用内容跨设备流转方法与装置、电子设备
WO2022143883A1 (zh) 一种拍摄方法、系统及电子设备
JP7361890B2 (ja) 通話方法、通話装置、通話システム、サーバ及びコンピュータプログラム
WO2022037463A1 (zh) 一种功能切换入口的确定方法与电子设备
CN112995727A (zh) 一种多屏协同方法、系统及电子设备
JP7234379B2 (ja) スマートホームデバイスによってネットワークにアクセスするための方法および関連するデバイス
EP4254927A1 (en) Photographing method and electronic device
CN110413383B (zh) 事件处理方法、装置、终端及存储介质
CN113391743B (zh) 一种显示方法及电子设备
WO2022110939A1 (zh) 一种设备推荐方法及电子设备
WO2023005711A1 (zh) 一种服务的推荐方法及电子设备
US20230362782A1 (en) Data Sharing Method, Electronic Device, and System
CN115242994A (zh) 视频通话系统、方法和装置
US20230297324A1 (en) Audio Control Method, System, and Electronic Device
WO2024022307A1 (zh) 一种投屏方法及电子设备
WO2024037352A1 (zh) 一种分屏显示方法及相关装置
CN117811947A (zh) 一种多设备组网系统、方法及终端设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21896443

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021896443

Country of ref document: EP

Effective date: 20221213

NENP Non-entry into the national phase

Ref country code: DE