WO2021190466A1 - 一种设备间多媒体内容续播的方法 - Google Patents

一种设备间多媒体内容续播的方法 Download PDF

Info

Publication number
WO2021190466A1
WO2021190466A1 PCT/CN2021/082246 CN2021082246W WO2021190466A1 WO 2021190466 A1 WO2021190466 A1 WO 2021190466A1 CN 2021082246 W CN2021082246 W CN 2021082246W WO 2021190466 A1 WO2021190466 A1 WO 2021190466A1
Authority
WO
WIPO (PCT)
Prior art keywords
multimedia content
smart
playback
control card
broadcast control
Prior art date
Application number
PCT/CN2021/082246
Other languages
English (en)
French (fr)
Inventor
陈闽江
刘兴宇
宁明印
江洪泽
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to US17/914,438 priority Critical patent/US20230119300A1/en
Priority to BR112022019309A priority patent/BR112022019309A2/pt
Priority to CN202180020838.5A priority patent/CN115552915A/zh
Priority to EP21774473.9A priority patent/EP4114023A4/en
Priority to JP2022558009A priority patent/JP7494313B2/ja
Publication of WO2021190466A1 publication Critical patent/WO2021190466A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43078Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen for seamlessly watching content streams when changing device, e.g. when watching the same program sequentially on a TV and then on a tablet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4222Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44204Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks

Definitions

  • the embodiments of the present application relate to the field of electronic technology, in particular to a method for replaying multimedia content between devices.
  • Some of these electronic devices can be used to play multimedia content (for example, pictures, audio, and video, etc.).
  • multimedia content played on one electronic device can be replayed on another electronic device, which will enhance the user experience.
  • the embodiment of the present application provides a method for replaying multimedia content between devices, which relates to the field of electronic technology, and can replay multimedia content between devices, so that the playback of multimedia content is more flexible and the user experience is better.
  • the following technical solutions are adopted in the embodiments of this application:
  • the first device first receives the first playback information sent by the second device, where the first playback information corresponds to the first multimedia content played by the second device, and the first device and the second device are in the same wireless network .
  • the first device displays a first play control card corresponding to the first multimedia content.
  • the first play control card includes a first control and a second control.
  • the second control is used to control the playback of the first multimedia content.
  • the first device obtains the first multimedia content from the server based on the first play information, and continues to play the first multimedia content based on the first play information.
  • the first device is a mobile phone and the second device is a smart TV.
  • the mobile phone first receives the first playback information sent by the smart TV.
  • the first playback information corresponds to the TV program played by the smart TV.
  • the mobile phone and the smart TV are connected to the same WLAN.
  • the mobile phone displays the first broadcast control card corresponding to the TV program being played on the smart TV.
  • the first broadcast control card includes the resume option, the playback option and the pause playback option.
  • the playback option and the pause playback option can be used to control the playback of the smart TV. TV show.
  • the mobile phone displays the broadcast control card can be displayed when the mobile phone is on when the screen is off, or it can receive the user's operation gestures and display it on the control center interface.
  • the mobile phone When the mobile phone responds to the user input of the user clicking the replay option, the mobile phone obtains the content of the TV program according to the URL address or the multimedia content identifier in the first play information, and resumes the TV program according to the video play progress in the first play information.
  • the multimedia content played on the second device can be continuously played on the first device, and the user experience can be improved.
  • the second device synchronizes the first playback information to the second device, including: the second device detects that the first playback information changes; the second device uses the wireless network Send the first play information to the first device.
  • the second device periodically synchronizes the first playback information to the second device, including: the second device starts a loop timer; when the loop timer reaches the timing, the second device sends the second device through the wireless network. -Play information to the first device.
  • the second device may also synchronize the first playback information to the first device based on the request of the first device, and the method further includes: the first device starts an event listener to monitor any of the following events: The event that the device unlocks the screen, the event that the first device joins the wireless network, and the event that the first device disconnects the wireless network; when the event listener is triggered, the first device sends a request to obtain the first playback information; the second device passes The wireless connection sends the first play information to the first device.
  • the first device displaying the first broadcast control card corresponding to the first multimedia content includes: responding to a sliding action on the main interface of the first device from left to right to the first interface. Gesture, the first device displays the first broadcast control card on the first interface.
  • the first interface is the control center interface. By centrally displaying the broadcast control card on the control center interface, it can bring a good visual experience to the user. And the operation of opening/closing the control center interface is convenient.
  • the second control includes at least one of the following items: a volume icon, a volume size display bar, a playback icon, a playback progress display bar, a rewind icon, a fast forward icon, or a next set icon.
  • the electronic device can control the playback of the first multimedia content by receiving the playback control command that the user acts on the second control.
  • the first playback information includes the identifier of the first multimedia content and the playback progress of the first multimedia content.
  • the first playback information further includes at least one of the following items: the source address of the first multimedia content, the playback status of the first multimedia content, and the volume of the first multimedia content Status, or the playback volume of the first multimedia content.
  • the more content included in the first playback information the more information about the multimedia content played on the second device can be provided to the user on the first device, which can bring a better user experience to the user. Can see more information about the first multimedia content.
  • the playback progress of the first multimedia content replayed by the first device is the same as the playback progress of the first multimedia content played by the second device.
  • the first device continues to play the first multimedia content from the same playback progress, and the user does not need to adjust the playback progress anymore, the connection is more appropriate, and it can bring the user a better user experience.
  • the first device opens the application program for playing the first multimedia content in response to the first user input acting on the first control.
  • the first device realizes that the first multimedia content is replayed in the application program.
  • the first device may also optionally continue to broadcast the first multimedia content on the broadcast control card.
  • the first interface also displays a second broadcast control card, and the second broadcast control card corresponds to the second multimedia content played by the third device.
  • the control center interface also displays a second broadcast control card, which corresponds to the audio played by the smart speaker. In this way, multiple cards can be displayed on the control center interface at the same time, which facilitates user operations.
  • the second device is associated with the first area
  • the third device is associated with the second area.
  • the display effects of the first broadcast control card and the second broadcast control card are based on the first device and the first area and the The positional relationship of the two areas is determined.
  • the display effects of the first broadcast control card and the second broadcast control card are determined based on the positional relationship between the first device and the first area and the second area, including: when the first device is located in the first area, The display position of the first broadcast control card on the first interface is above the display position of the second broadcast control card.
  • the display position of the second broadcast control card on the first interface is above the display position of the first broadcast control card, and the first device displays the first prompt message ,
  • the first prompt information is used to prompt whether to continue playing the first multimedia content on the third device.
  • the smart TV’s broadcast control card is displayed above the smart projector’s broadcast control card; when the mobile phone is in the second room
  • the play control card of the smart projector is displayed above the play control card of the smart TV, and after the user stays for a period of time, the user is asked whether he needs to continue broadcasting the multimedia content played on the smart TV on the smart projector.
  • the user can adjust the arrangement sequence of the broadcast control card in different areas and electronic devices in different areas, which is more convenient to view and makes the user experience better.
  • the first device sends a broadcast control command to the second device in response to the second user input acting on the second control; the first device does not receive a response message corresponding to the broadcast control command, and the first device The first prompt message is displayed, and the first prompt message is used to prompt the broadcast control failure.
  • the first device detects that it is disconnected from the wireless network; the first device displays a third broadcast control card corresponding to the first multimedia content played by the second device, and the third broadcast control card includes The first control, but does not include the second control.
  • the first play control card includes the first control (for example, the first control is a replay option), and the replay can also be supported in response to the input acting on the first control after the first device disconnects from the network. After the user reconnects to the network, the first device can also generate a broadcast control card. At this time, the first multimedia content can be controlled through the second control, but the resume function is not supported, so that the user can focus on the second device (For example, smart TV), the experience is better.
  • the first control for example, the first control is a replay option
  • the replay can also be supported in response to the input acting on the first control after the first device disconnects from the network. After the user reconnects to the network, the first device can also generate a broadcast control card. At this time, the first multimedia content can be controlled through the second control, but the resume function is not supported, so that the user can focus on the second device (For example, smart TV), the experience is better.
  • the first device receives the second playback information sent by the second device, where the second device is simultaneously playing the first multimedia content and the third multimedia content, and the second playback information corresponds to The third multimedia content played by the second device; the first device displays the first broadcast control card corresponding to the first multimedia content played by the second device and the third broadcast control card corresponding to the third multimedia content ; The first device responds to the input of the third user, while continuing to play the first multimedia content and the third multimedia content.
  • the first device can display multiple broadcast control cards for the user to operate. This makes this application applicable to multiple multimedia content broadcasting situations.
  • the screen area of the second device includes a first screen area and a second screen area
  • the first screen area plays the first multimedia content
  • the second screen area plays the third multimedia content, that is, the first multimedia
  • the content and the third multimedia content are played on the second device at the same time (for example, when the second device is a TV, the user can watch the first multimedia content and the third multimedia content on the TV through a split screen. Video program).
  • the first device can display a first broadcast control card corresponding to the first multimedia content played by the second device and a third broadcast control card corresponding to the third multimedia content.
  • the first device can play the first multimedia content and the third multimedia content at the same time (for example, when the first device is a mobile phone, in response to the third user input, the user can split the screen on the mobile phone). Watch two video programs, the first multimedia content and the third multimedia content).
  • the first device receives the third playback information sent by the fourth device, where the fourth device is playing the first multimedia content, and the third playback information corresponds to the first multimedia content played by the fourth device.
  • Media content the first device displays the fourth broadcast control card corresponding to the first multimedia content played by the second device and the fourth device.
  • the playback progress of the first multimedia content played by the fourth device is the same as the playback progress of the first multimedia content played by the second device.
  • the first device and the second device log in to the same user account, such as a Huawei account, a glory account, and an Apple ID.
  • This design can make the data interaction between the first device and the second device more secure and protect the privacy of the user.
  • the wireless network is a wireless fidelity Wi-Fi wireless network.
  • Wi-Fi technology is a common technical means to realize data interaction between electronic devices in the prior art.
  • This means can also be Bluetooth technology (Bluetooth, BT), near field communication technology (NFC), ultra-wideband technology (ultra wideband, UWB), infrared technology (infrared, IR), ZigBee technology, general 2.4G/5G frequency band wireless communication technology, etc.
  • Bluetooth technology Bluetooth, BT
  • NFC near field communication technology
  • UWB ultra-wideband technology
  • infrared technology infrared, IR
  • ZigBee technology general 2.4G/5G frequency band wireless communication technology
  • the first device is a mobile phone and the second device is a TV. In one possible design, the first device is a mobile phone and the second device is a smart speaker. In one possible design, the first device is a mobile phone and the second device is a smart projector. In one possible design, the first device is a mobile phone and the second device is VR glasses.
  • the first device is a tablet and the second device is a TV. In one possible design, the first device is a tablet and the second device is a smart speaker. In one possible design, the first device is a tablet and the second device is a smart projector. In one possible design, the first device is a tablet and the second device is VR glasses.
  • this application also includes an electronic device that includes a memory and one or more processors; wherein the memory is used to store computer program codes, and the computer program codes include computer instructions; when the computer instructions are When the processor executes, the electronic device executes the method of resuming multimedia content between the devices.
  • this application also includes a computer-readable storage medium, including computer instructions, which when the computer instructions run on an electronic device, cause the electronic device to perform a method for resuming multimedia content between devices.
  • this application also includes a computer program product, which when the computer program product runs on a computer, causes the computer to execute a method for resuming multimedia content between devices.
  • the second device is configured to send first playback information to the first device, where the first playback information corresponds to the first multimedia content played by the second device, and the first device and the second device
  • the two devices are in the same wireless network;
  • the first device is configured to: display a first broadcast control card corresponding to the first multimedia content, the first broadcast control card includes a first control and a second control, and the second control is used for control Play the first multimedia content; in response to the first user input acting on the first control, obtain the first multimedia content from the server based on the first play information, and continue to play the first multimedia content based on the first play information .
  • Figure 1A shows a schematic diagram of an exemplary family scenario according to some embodiments
  • Figure 1B shows a user interface diagram of an exemplary application according to some embodiments
  • Figure 2A shows a hardware structure diagram of a portable electronic device according to some embodiments
  • Figure 2B shows a hardware structure diagram of an intelligent multimedia playback device according to some embodiments
  • Figure 3A shows an exemplary user interface diagram of a portable electronic device according to some embodiments
  • 3B shows a schematic diagram of a portable electronic device detecting a user's operation gesture according to some embodiments
  • 3C shows a schematic diagram of a portable electronic device displaying a control center interface according to some embodiments
  • FIG. 4A shows a schematic diagram of a user watching a smart TV according to some embodiments
  • Figure 4B shows a schematic diagram of a user picking up a mobile phone to enter the control center interface according to some embodiments
  • FIG. 4C shows a schematic diagram of a smart TV generating a broadcast control card in a scene smart interface according to some embodiments
  • FIG. 4D shows a schematic diagram of a user remotely controlling a smart TV through a remote control according to some embodiments
  • 4E shows a schematic diagram of changes in the broadcast control card of the smart TV after the remote control takes effect according to some embodiments
  • FIG. 4F shows a schematic diagram of a user playing and controlling a smart TV through a broadcast control card according to some embodiments
  • FIG. 4G shows a schematic diagram of changes in the playback information of the smart TV after the broadcast control takes effect according to some embodiments
  • Figure 4H shows an exemplary interface diagram of a video playback application according to some embodiments
  • FIG. 4I shows a schematic diagram of a broadcast control failure according to some embodiments.
  • 4J shows a schematic diagram of a broadcast control failure according to some embodiments.
  • FIG. 4K shows a schematic diagram of a broadcast control failure according to some embodiments.
  • Fig. 4L shows a schematic diagram of a broadcast control card displayed on a lock screen interface according to some embodiments
  • FIG. 4M shows a schematic diagram of the broadcast control card displayed on the notification center interface according to some embodiments.
  • FIG. 5A shows a schematic diagram of a scene in which a user uses a mobile phone after leaving home according to some embodiments
  • FIG. 5B shows a schematic diagram of a smart TV generating a broadcast control card in a scene smart interface after a user leaves home according to some embodiments
  • FIG. 5C shows a schematic diagram of another smart TV generating a broadcast control card in a scene smart interface after a user leaves home according to some embodiments
  • FIG. 5D shows a schematic diagram of a resuming failure situation according to some embodiments.
  • FIG. 5E shows a schematic diagram of a scenario where a user goes home again after leaving home according to some embodiments
  • FIG. 5F shows a schematic diagram of a smart TV generating a broadcast control card on a scene smart interface after a user leaves home and goes home again according to some embodiments;
  • FIG. 6A shows a schematic diagram of displaying one of the broadcast control cards generated by multiple smart multimedia playback devices on the scene smart interface according to some embodiments
  • FIG. 6B shows a schematic diagram showing all of the broadcast control cards generated by multiple smart multimedia playback devices on the scene smart interface according to some embodiments
  • FIG. 6C shows a schematic diagram of a user's movement track in a home scene according to some embodiments
  • FIG. 6D shows a schematic diagram of the sequence of playing and controlling cards changing after the user moves according to some embodiments
  • 6E shows a schematic diagram of a portable electronic device prompting a user to continue playing multimedia content among multimedia playback devices according to some embodiments
  • FIG. 6F shows a schematic diagram of a scene in which a user realizes replay of multimedia content between multimedia playback devices according to some embodiments
  • 6G shows a schematic diagram of multiple smart multimedia playback devices displaying a broadcast control card on a scene smart interface according to some embodiments
  • FIG. 6H shows a schematic diagram of a scene where a user uses a smart TV to watch a video in a split screen according to some embodiments
  • 6I-6K show schematic diagrams of generating a broadcast control card on the scene smart interface when a user uses a smart TV to watch a video in a split screen according to some embodiments;
  • 6L-6O show a schematic diagram of a user resuming multi-screen playing multimedia content on a portable electronic device according to some embodiments
  • 6P shows a schematic diagram of configuring a smart multimedia playback device to generate a broadcast control card function on a portable electronic device according to some embodiments
  • FIG. 6Q shows a schematic diagram of configuring a replay function of a smart multimedia playback device on a portable electronic device according to some embodiments
  • 6R-6U show schematic diagrams of multiple intelligent multimedia playback devices playing the same multimedia content and generating a broadcast control card in a scene intelligent interface according to some embodiments;
  • Figure 7A shows a flowchart of an example of the present application according to some embodiments.
  • FIG. 7B shows a flow chart of a smart multimedia player device according to some embodiments to synchronously play information to a portable electronic device
  • Figure 7C shows a flow chart of a smart multimedia playback device synchronizing playback information to a portable electronic device according to some embodiments
  • FIG. 7D shows a flowchart of a portable electronic device collecting information played by a smart multimedia playback device according to some embodiments
  • FIG. 7E shows an example diagram of data interaction between a portable electronic device and a smart multimedia playback device according to some embodiments
  • Figure 8 shows a flow chart of a portable electronic device displaying and refreshing a play control card according to some embodiments
  • FIG. 9 shows a flowchart of resuming multimedia content on a portable electronic device according to some embodiments.
  • Figure 10 shows a flow chart of a portable electronic device playing and controlling an intelligent multimedia playback device according to some embodiments
  • FIG. 11-12 show schematic structural diagrams of portable electronic devices according to some embodiments.
  • FIGS 13-14 show schematic structural diagrams of smart multimedia playback devices according to some embodiments.
  • first and second are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined with “first” and “second” may explicitly or implicitly include one or more of these features. In the description of the present embodiment, unless otherwise specified, “plurality” means two or more.
  • the smart multimedia playback device is a smart electronic device that can play multimedia content (such as pictures, audio, video, etc.), such as smart speakers, smart TVs, smart projectors, smart VR glasses, smart cars Display screen, etc.
  • multimedia content is optionally stored on the smart multimedia playback device, optionally shared by other smart electronic devices and the smart multimedia playback device, and optionally obtained from the server for the smart multimedia playback device.
  • these smart multimedia playback devices can also interact with other smart electronic devices through their communication functions. Users can control and/or manage smart multimedia playback devices through portable electronic devices (such as mobile phones, tablets, wearable devices, etc.). In some possible implementations, the smart multimedia playback device may also be a type of portable electronic device.
  • the smart multimedia playback device can log in to an account, and when the portable electronic device and the smart multimedia playback device log in to the same account, data interaction can be performed between the devices.
  • the smart multimedia playback device cannot log in to the account, and the portable electronic device optionally does not need to verify the account to interact with the device.
  • the smart multimedia playback device can optionally support the playback of one type of multimedia content, for example, a smart speaker can support the playback of audio files.
  • the smart multimedia playback device can support the playback of multiple types of multimedia content.
  • a smart TV can support the playback of pictures, audio files, and video files.
  • smart multimedia playback devices usually include a wireless communication module, and a near field connection is established with other smart multimedia playback devices and/or portable electronic devices through the wireless communication module. After the near field connection is established, data interaction can be carried out between the devices.
  • wireless local area network wireless local area network
  • WLAN wireless local area network
  • Bluetooth technology Bluetooth, BT
  • near-field communication technology Near field communication, NFC
  • ultra-wideband technology ultra wideband, UWB
  • infrared technology infrared, IR
  • ZigBee technology general 2.4G/5G band wireless communication technology, etc.
  • one manifestation of the near field connection is that data interaction is performed between devices, optionally direct transmission between devices, and optionally indirect transmission between devices. This way of interaction makes data not transmitted through the cloud platform or server.
  • Near-field connection can ensure data security to a certain extent, and is especially suitable for transmitting data that involves user privacy.
  • the embodiment of the present application introduces a method for replaying multimedia content between devices.
  • a home scenario will be used as an exemplary scenario
  • a WLAN will be used as an exemplary technology for establishing a near field connection.
  • the home scene is optionally divided into one or more areas, one or more of which optionally includes one or more smart multimedia playback devices.
  • FIG. 1A shows an exemplary family scene 100, which is optionally divided into five areas: a first room 110, a second room 120, a third room 130, a fourth room 140 and the connecting room Corridor 150.
  • the first room 110 optionally includes a smart TV 111 and a smart speaker 113
  • the second room 120 optionally includes a smart TV 121 and a smart speaker 123
  • the third room 130 optionally, a smart TV 131 is included
  • the fourth room 140 may optionally include a smart projector 141 and a smart speaker 143.
  • the above smart multimedia playback device is in the same WLAN and the WLAN is optionally provided by the router 145 in the fourth room 140 in FIG. 1A.
  • the application program is installed in the user's portable electronic device as a way to control and/or manage the smart multimedia playback device.
  • the following will take the "Smart Life” application provided by Huawei Technologies Co., Ltd as an example. It is understandable that, in addition to controlling and/or managing smart multimedia playback devices, the application can also be used to control and/or manage other types of smart electronic devices, such as smart home devices.
  • FIG. 1B shows an exemplary user interface diagram 151 of the "Smart Life" application according to some embodiments.
  • the user interface 151 optionally includes a family scene name 153 (the exemplary family scene name 153 here is "My Home").
  • the application program can optionally allow the user to modify the family scene name 153, and optionally allow the user to set the family scene 100 through the "room management" option. For example, add a room, delete a room, change the name of the room.
  • the room mentioned here is generated based on a room in reality, for example, a room calculated after the user creates a raster map/point cloud map of the family scene 100 in the "Smart Life" application.
  • the room mentioned here is virtual, which is a virtual location tag created by the user according to his own needs.
  • the smart electronic device in the home scene 100 has a virtual location tag that can be configured by the user, and the smart electronic devices with the same virtual location tag are in the same virtual room.
  • the user interface 151 optionally includes an indicator 157 indicating the number of smart electronic devices and the number of smart scenes in the home scene 100 (here, an example of the home scene 100 is "8 devices
  • the user interface 151 optionally includes a "home” icon 159, a "mall” icon 161, a “smart” icon 163 and a “my” icon 165, a total of four icons that can respond to user operations.
  • a "home” icon 159 When the portable electronic device detects that the user clicks on the above The operation of the icon will jump to the interface corresponding to the icon.
  • FIG. 1B shows the interface corresponding to the "home” icon 159.
  • the "home” icon 159 is optionally selected (here, the exemplary performance of the selected icon is that the "home” icon 159 is filled).
  • each smart electronic device in the home scene 100 and associated with the "smart life” application will generate a card, which can optionally be used by the user to view the device name, The status of the equipment and the room in which it is located.
  • the device name is optional and can be set according to user preferences.
  • the device status can optionally include online status and offline status.
  • the online status can optionally mean that the device is powered on and connected to the WLAN, for example, the smart TV 111 in the home scenario 100 in FIG. 1A is powered on and Connecting to the WLAN provided by the router 145, the smart TV 111 is optionally in a standby state/playing state/pause state.
  • the offline state optionally refers to that the device is powered off and/or not in the WLAN.
  • the smart TV 111 in the home scenario 100 in FIG. 1A is in the power off state and/or the smart TV 111 is not connected to the WLAN provided by the router 145.
  • the smart TV 111 located in the first room 110 corresponds to the card 167 shown in FIG. 1B, in which “TV in the first room” is the name of the smart TV 111, “online” is the device status, and “first room” The room in which it is located;
  • the smart TV 121 located in the second room 120 corresponds to the card 169 shown in FIG. 1B, where "TV in the second room” is the name of the smart TV 121, “online” is the device status, and "second room” The room in which it is located;
  • the smart TV 131 located in the third room 130 corresponds to the card 171 shown in FIG. 1B, in which “TV in the third room” is the name of the smart TV 131, “online” is the device status, and “third room” The room in which it is located;
  • the smart speaker 113 in the first room 110 corresponds to the card 173 shown in FIG. 1B, where "the speaker in the first room” is the name of the smart speaker 113, "offline” is the device status, and "the first room” The room in which it is located;
  • the smart speaker 123 in the second room 120 corresponds to the card 175 shown in FIG. 1B, where "the speaker in the second room” is the name of the smart speaker 123, “offline” is the device status, and "the second room” The room in which it is located;
  • the smart speaker 143 located in the fourth room 140 corresponds to the card 177 shown in FIG. 1B, in which "the speaker in the fourth room” is the name of the smart speaker 143, "offline” is the device status, and "the fourth room” The room in which it is located;
  • the smart projector 141 located in the fourth room 140 corresponds to the card 179 shown in FIG. "Four rooms” is the room in which it is located.
  • smart electronic devices can also generate cards in the interface corresponding to the "home" icon 159.
  • the router 145 in the fourth room 140 corresponds to the card 181 shown in FIG. 1B, where "Huawei router” Is the name of the router 145, “online” is the device status, and “fourth room” is the room in which it is located.
  • the user can view and/or purchase smart multimedia playback devices and other types of smart electronic devices on the market.
  • the "Smart Life” application can optionally provide users with the function of setting smart scenes, such as the homecoming scene (the user turns on the smart TV 111 and smart speakers after going home 113), leaving home scene (the user turns off all smart multimedia playback devices after leaving home).
  • the homecoming scene the user turns on the smart TV 111 and smart speakers after going home 113
  • leaving home scene the user turns off all smart multimedia playback devices after leaving home.
  • smart scenes are optionally divided into manual scenes and automatic scenes according to the execution mode.
  • Manual scene means that after the user sets the scene parameters, the smart scene requires the user to manually start/stop.
  • Automatic scene means that after the user sets the scene parameters, the smart scene automatically starts/stops according to some conditions (connection/disconnection of WLAN, local time, etc.).
  • the scene parameters can optionally be the start-stop and/or operating parameters of one or more devices.
  • the "smart life” application is optionally available for users to view existing smart scenes, optionally for users to add/delete smart scenes, and optionally for users to set one or more smart scenes.
  • the scene parameters of the scene are optionally available for users to view existing smart scenes, optionally for users to add/delete smart scenes, and optionally for users to set one or more smart scenes.
  • the "Smart Life” application allows the user to perform account related settings, such as logging in to the account, modifying the account, and logging out of the logged-in account.
  • the portable electronic device when the portable electronic device detects that the user clicks on the "more” icon 183, more options will appear, such as “add device”, “create smart” and “connect to three-party platform”.
  • the "add device” option is optionally available for the user to add and associate a new smart electronic device.
  • the "Share device” option optionally allows the user to share the control rights of one or more smart electronic devices in the home scene 100 to other users, so that other users can manage and/or share the one or more smart electronic devices. Control, so as to meet the family scene 100 to meet the needs of multiple users.
  • the "Connect to Three-Party Platform” option allows users to optionally link accounts in other applications used to manage home smart devices to the "Smart Life” application, so that the "Smart Life” application can manage more smart electronics equipment.
  • the above describes the exemplary home scene 100 of the present application and the schematic diagram of the interface of an exemplary application program for controlling and/or managing the intelligent multimedia playback device.
  • the hardware structure of the portable electronic device and the intelligent multimedia playback device will be described below.
  • portable electronic devices include, but are not limited to, mobile phones, tablet computers, smart wearable devices (such as earphones, watches, bracelets), and the like.
  • FIG. 2A shows a schematic structural diagram of a portable electronic device 200 according to some embodiments.
  • the portable electronic device 200 may include a processor 201, an external memory interface 203, an internal memory 205, a universal serial bus (USB) interface 207, a charging management module 209, a power management module 211, a battery 213, an antenna 1, an antenna 2.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the portable electronic device 200.
  • the portable electronic device 200 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the mobile phone may include a processor 201, an external memory interface 203, an internal memory 205, a universal serial bus (USB) interface 207, a charging management module 209, a power management module 211, and a battery 213 , Antenna 1, antenna 2, mobile communication module 215, wireless communication module 217, audio module 219, speaker 219A, receiver 219B, microphone 219C, earphone interface 219D, sensor module 221, camera 223 and display screen 225 and so on.
  • a processor 201 an external memory interface 203, an internal memory 205, a universal serial bus (USB) interface 207, a charging management module 209, a power management module 211, and a battery 213 , Antenna 1, antenna 2, mobile communication module 215, wireless communication module 217, audio module 219, speaker 219A, receiver 219B, microphone 219C, earphone interface 219D, sensor module 221, camera 223 and display screen 225 and so on.
  • USB universal serial bus
  • the tablet computer may include a processor 201, an external memory interface 203, an internal memory 205, a universal serial bus (USB) interface 207, a charging management module 209, a power management module 211, and a battery 213, wireless communication module 217, audio module 219, speaker 219A, receiver 219B, microphone 219C, earphone interface 219D, sensor module 221, camera 223, display screen 225 and so on.
  • a processor 201 an external memory interface 203, an internal memory 205, a universal serial bus (USB) interface 207, a charging management module 209, a power management module 211, and a battery 213, wireless communication module 217, audio module 219, speaker 219A, receiver 219B, microphone 219C, earphone interface 219D, sensor module 221, camera 223, display screen 225 and so on.
  • USB universal serial bus
  • the processor 201 may include one or more processing units.
  • the processor 201 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait.
  • AP application processor
  • modem processor modem processor
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the different processing units may be independent devices or integrated in one or more processors.
  • a memory may also be provided in the processor 201 to store instructions and data.
  • the memory in the processor 201 is a cache memory.
  • the memory can store instructions or data that have just been used or recycled by the processor 201. If the processor 201 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 201 is reduced, and the efficiency of the system is improved.
  • the processor 201 may include one or more interfaces.
  • the interface can include an integrated circuit (I2C) interface, an integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, and a universal asynchronous transmitter (universal asynchronous) interface.
  • I2C integrated circuit
  • I2S integrated circuit sound
  • PCM pulse code modulation
  • UART integrated circuit
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB Universal Serial Bus
  • the charging management module 209 is used to receive charging input from the charger.
  • the charger can be a wireless charger or a wired charger.
  • the charging management module 209 may receive the charging input of the wired charger through the USB interface 207.
  • the charging management module 209 may receive the wireless charging input through the wireless charging coil of the portable electronic device 200. While the charging management module 209 charges the battery 213, it can also supply power to the portable electronic device 200 through the power management module 211.
  • the power management module 211 is used to connect the battery 213, the charging management module 209 and the processor 201.
  • the power management module 211 receives input from the battery 213 and/or the charge management module 209, and supplies power to the processor 201, the internal memory 205, the external memory, the display screen 225, the camera 223, and the wireless communication module 217.
  • the power management module 211 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the power management module 211 may also be provided in the processor 201.
  • the power management module 211 and the charging management module 209 may also be provided in the same device.
  • the wireless communication function of the portable electronic device 200 can be realized by the antenna 1, the antenna 2, the mobile communication module 215, the wireless communication module 217, the modem processor, and the baseband processor.
  • the antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the portable electronic device 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna can be used in combination with a tuning switch.
  • the mobile communication module 215 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the portable electronic device 200.
  • the mobile communication module 215 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.
  • the mobile communication module 215 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation.
  • the mobile communication module 215 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic wave radiation via the antenna 1.
  • at least part of the functional modules of the mobile communication module 215 may be provided in the processor 201.
  • at least part of the functional modules of the mobile communication module 215 and at least part of the modules of the processor 201 may be provided in the same device.
  • the wireless communication module 217 can provide applications on the portable electronic device 200 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), and global navigation. Satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module 217 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 217 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 201.
  • the wireless communication module 217 may also receive the signal to be sent from the processor 201, perform frequency modulation, amplify it, and convert it into electromagnetic waves to radiate through the antenna 2.
  • the antenna 1 of the portable electronic device 200 is coupled with the mobile communication module 215, and the antenna 2 is coupled with the wireless communication module 217, so that the portable electronic device 200 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite-based augmentation systems
  • the portable electronic device 200 implements a display function through a GPU, a display screen 225, an application processor, and the like.
  • the GPU is an image processing microprocessor, which is connected to the display screen 225 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations and is used for graphics rendering.
  • the processor 201 may include one or more GPUs, which execute program instructions to generate or change display information.
  • the display screen 225 is used to display images, videos, and the like.
  • the display screen 225 includes a display panel.
  • the display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • active-matrix organic light-emitting diode active-matrix organic light-emitting diode
  • AMOLED flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc.
  • the portable electronic device 200 may include one or more display screens 225.
  • the portable electronic device 200 can implement a shooting function through an ISP, a camera 223, a video codec, a GPU, a display screen 225, and an application processor.
  • the ISP is used to process the data fed back by the camera 223. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing and is converted into an image visible to the naked eye.
  • ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 223.
  • the camera 223 is used to capture still images or videos.
  • the object generates an optical image through the lens and is projected to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transfers the electrical signal to the ISP to convert it into a digital image signal.
  • ISP outputs digital image signals to DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the portable electronic device 200 may include one or more cameras 223.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the portable electronic device 200 selects the frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the portable electronic device 200 may support one or more video codecs. In this way, the portable electronic device 200 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.
  • MPEG moving picture experts group
  • MPEG2 MPEG2, MPEG3, MPEG4, and so on.
  • the external memory interface 203 may be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the portable electronic device 200.
  • the external memory card communicates with the processor 201 through the external memory interface 203 to realize the data storage function. For example, save music, video and other files in an external memory card.
  • the internal memory 205 may be used to store computer executable program code, the executable program code including instructions.
  • the processor 201 executes various functional applications and data processing of the portable electronic device 200 by running instructions stored in the internal memory 205.
  • the internal memory 205 may include a program storage area and a data storage area.
  • the storage program area can store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required by at least one function, and the like.
  • the data storage area can store data (such as audio data, phone book, etc.) created during the use of the portable electronic device 200.
  • the internal memory 205 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
  • UFS universal flash storage
  • the portable electronic device 200 can implement audio functions through an audio module 219, a speaker 219A, a receiver 219B, a microphone 219C, a headphone interface 219D, and an application processor. For example, playing audio files, recording and so on.
  • the audio module 219 is used for converting digital audio information into an analog audio signal for output, and is also used for converting an analog audio input into a digital audio signal.
  • the audio module 219 can also be used to encode and decode audio signals.
  • the audio module 219 may be provided in the processor 201, or part of the functional modules of the audio module 219 may be provided in the processor 201.
  • the speaker 219A also called “speaker” is used to convert audio electrical signals into sound signals.
  • the portable electronic device 200 can listen to music through the speaker 219A, or listen to a hands-free call.
  • the receiver 219B also called “earpiece” is used to convert audio electrical signals into sound signals.
  • the portable electronic device 200 answers a call or voice message, it can receive the voice by bringing the receiver 219B close to the human ear.
  • the microphone 219C also called “microphone”, “microphone”, is used to convert sound signals into electrical signals.
  • the user can approach the microphone 219C through the mouth to make a sound, and input the sound signal to the microphone 219C.
  • the portable electronic device 200 may be provided with at least one microphone 219C.
  • the portable electronic device 200 can be provided with two microphones 219C, which can realize noise reduction functions in addition to collecting sound signals.
  • the portable electronic device 200 can also be provided with three, four or more microphones 219C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions.
  • the earphone interface 219D is used to connect wired earphones.
  • the earphone interface 219D can be a USB interface 207, or a 3.5mm open mobile terminal platform (OMTP) standard interface, and a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface .
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA, CTIA
  • the sensor module 221 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.
  • the aforementioned portable electronic device 200 may also include one or more devices such as buttons, motors, indicators, and SIM card interfaces, which are not limited in the embodiment of the present application.
  • FIG. 2B shows a schematic structural diagram of an intelligent multimedia playback device 250 according to some embodiments.
  • the intelligent multimedia playback device 250 may include a processor 251, an external memory interface 253, an internal memory 255, a universal serial bus (USB) interface 257, a charging management module 259, a power management module 261, a battery 263, an antenna, and wireless Communication module 265, audio module 267, speaker 267A, microphone 267B, earphone interface 267C, sensor module 269, camera 271, display screen 273 and so on.
  • USB universal serial bus
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the intelligent multimedia playback device 250.
  • the smart multimedia playback device 250 may include more or less components than those shown in the figure, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • smart speakers can optionally include wired Bluetooth speakers and wireless Bluetooth speakers.
  • the wired Bluetooth speaker may include a processor 251, an external memory interface 253, an internal memory 255, a charging management module 259, a power management module 261, a wireless communication module 265, an audio module 267, a speaker 267A, a microphone 267B, a sensor module 269, and so on.
  • a wireless Bluetooth speaker can include a battery 263 and the like in addition to the above-mentioned components.
  • the smart TV may include a processor 251, an external memory interface 253, an internal memory 255, a universal serial bus (USB) interface 257, a charging management module 259, a power management module 261, and wireless Communication module 265, audio module 267, speaker 267A, microphone 267B, earphone interface 267C, sensor module 269, camera 271, display screen 273 and so on.
  • a processor 251 an external memory interface 253, an internal memory 255, a universal serial bus (USB) interface 257, a charging management module 259, a power management module 261, and wireless Communication module 265, audio module 267, speaker 267A, microphone 267B, earphone interface 267C, sensor module 269, camera 271, display screen 273 and so on.
  • USB universal serial bus
  • the processor 251 may include one or more processing units.
  • the processor 251 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait.
  • AP application processor
  • modem processor modem processor
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the different processing units may be independent devices or integrated in one or more processors.
  • a memory may also be provided in the processor 251 to store instructions and data.
  • the memory in the processor 251 is a cache memory.
  • the memory can store instructions or data that have just been used or recycled by the processor 251. If the processor 251 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 251 is reduced, and the efficiency of the system is improved.
  • the processor 251 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter/receiver (universal asynchronous) interface.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter/receiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB Universal Serial Bus
  • the charging management module 259 is used to receive charging input from the charger.
  • the charger can be a wireless charger or a wired charger.
  • the charging management module 259 may receive the charging input of the wired charger through the USB interface 257.
  • the charging management module 259 may receive the wireless charging input through the wireless charging coil of the smart multimedia playback device 250. While the charging management module 259 charges the battery 263, it can also supply power to the smart multimedia playback device 250 through the power management module 261.
  • the power management module 261 is used to connect the battery 263, the charging management module 259 and the processor 251.
  • the power management module 261 receives the input of the battery 263 and/or the charging management module 259, and supplies power to the processor 251, the internal memory 255, the external memory, the display screen 273, the camera 271, and the wireless communication module 265.
  • the power management module 261 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the power management module 261 may also be provided in the processor 251.
  • the power management module 261 and the charging management module 259 may also be provided in the same device.
  • the wireless communication function of the smart multimedia playback device 250 can be realized through an antenna, a wireless communication module 265, and the like.
  • the wireless communication module 265 can provide applications on the smart multimedia playback device 250, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), and global Navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module 265 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 265 receives electromagnetic waves via an antenna, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 251.
  • the wireless communication module 265 may also receive the signal to be sent from the processor 251, perform frequency modulation, amplify, and convert it into electromagnetic waves to radiate through the antenna.
  • the display screen 273 of the intelligent multimedia playback device 250 is driven by a display driver chip for displaying images, videos, and the like.
  • the display screen 273 includes a display panel.
  • the display panel can use liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • AMOLED flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc.
  • the smart multimedia playback device 250 may include one or more display screens 273.
  • the external memory interface 253 may be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the smart multimedia playback device 250.
  • the external memory card communicates with the processor 251 through the external memory interface 253 to realize the data storage function. For example, save music, video and other files in an external memory card.
  • the internal memory 255 may be used to store computer executable program code, the executable program code including instructions.
  • the processor 251 executes various functional applications and data processing of the intelligent multimedia playback device 250 by running instructions stored in the internal memory 255.
  • the internal memory 255 may include a program storage area and a data storage area.
  • the storage program area can store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required by at least one function, and the like.
  • the data storage area can store data (such as audio data, phone book, etc.) created during the use of the smart multimedia playback device 250.
  • the internal memory 255 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
  • UFS universal flash storage
  • the intelligent multimedia playback device 250 can implement audio functions through an audio module 267, a speaker 267A, a microphone 267B, a headphone interface 267C, and an application processor. For example, music playback, recording, etc.
  • the audio module 267 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal.
  • the audio module 267 can also be used to encode and decode audio signals.
  • the audio module 267 may be provided in the processor 251, or part of the functional modules of the audio module 267 may be provided in the processor 251.
  • the speaker 267A also called “speaker”
  • the smart multimedia playback device 250 can play multimedia content through the speaker 267A.
  • the microphone 267B also called “microphone”, “microphone”, is used to convert sound signals into electrical signals.
  • the user can make a sound by approaching the microphone 267B through the human mouth, and input the sound signal into the microphone 267B.
  • the smart multimedia playback device 250 may be provided with at least one microphone 267B.
  • the smart multimedia playback device 250 can be provided with two microphones 267B, which can implement noise reduction functions in addition to collecting sound signals.
  • the smart multimedia playback device 250 can also be equipped with three, four or more microphones 267B to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.
  • the sensor module 269 may include a pressure sensor, a gyro sensor, a magnetic sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a touch sensor, an ambient light sensor, and the like.
  • the hardware structure of the portable electronic device 200 and the intelligent multimedia playback device 250 are described above.
  • the software implementation of the present application will be introduced below, taking a mobile phone as an embodiment of the portable electronic device 200 for description.
  • FIG. 3A shows an exemplary user interface 301 of the portable electronic device 200 according to some embodiments, the user interface 301 being optionally displayed on the display screen 225 of the portable electronic device 200. As shown in FIG.
  • the user interface 301 optionally includes the following elements or a subset or a superset thereof:
  • signal strength such as mobile network, Wi-Fi
  • current time 305 used to indicate the amount of power of the battery 213 Indicator 307;
  • Main interface applications Clock 309, Calendar 311, Gallery 313, Memo 315, File Management 317, Email 319, Music 321, Wallet 323, Huawei Video 325, Sports Health 327, Weather 329, Browser 331, Smart Life 333, setting 335, recorder 337, application store 339;
  • the main interface applications include clock 309, calendar 311, gallery 313, memo 315, file management 317, email 319, music 321, wallet 323, Huawei video 325, sports health 327, weather 329, browser 331, Smart Life 333, Settings 335, Voice Recorder 337, App Store 339.
  • the indicator 349 indicating the current interface points to the switched interface
  • the icons fixed in the status bar at the top of the user interface 301 remain unchanged
  • the common applications fixed at the bottom of the user interface 301 The procedure remains unchanged.
  • the portable electronic device 200 when the portable electronic device 200 detects that the user clicks on the application, it will start the application and display its running interface. For example, the portable electronic device 200 detects the user's operation of clicking the smart life icon 333, and optionally displays the exemplary user interface 151 shown in FIG. 1B.
  • a card is an interactive design module with a closed shape used to display information. It is usually used to display system/application information, and optionally provides a convenient way for users to interact with the system/application. In terms of visual design, the card has a flexible size. Using a card as an information carrier is convenient to operate and can improve the user experience.
  • each device generates the card shape according to its own rules, processes the data with the same data structure, and displays the data in the card.
  • control center interface/notification center interface can optionally provide system information (such as time, weather, power) of the user device, and optionally provide information of the user application (such as the information pushed by the application). Notification, the status of the application); optionally for the user to complete some quick operations on the control center interface/notification center interface.
  • the card can optionally be displayed on the control center interface/notification center interface of the portable electronic device 200. The embodiment of this application takes the control center interface as an example for description.
  • control center interface can be triggered and displayed by detecting a user's gesture.
  • the portable electronic device 200 in FIG. 3B detects a sliding gesture from the left to the right on the user interface 301, and the exemplary control center interface 353 in FIG. 3C is obtained.
  • the gesture in Figure 3B is an exemplary triggering method of the control center interface/notification center interface, and can also be other gesture types (such as pinch, long press, rotation, user-defined gestures, air gestures, etc.) ), it can also be other trigger directions (for example, from the upper side to the lower side, and from the lower side to the upper side).
  • the triggering method can also be button triggering, voice recognition triggering, image recognition triggering and brain wave triggering.
  • control center interface 353 in FIG. 3C The content in the control center interface 353 in FIG. 3C will be described below.
  • the control center interface 353 optionally includes a greeting tag 355, a user avatar 357, and a local or online content search box 359.
  • the control center interface 353 optionally includes shortcut operations of some applications, for example: "Scan” 361, "Payment Code” 363, and "Mobile Phone Recharge” 365.
  • “mobile phone recharge” 365 is optionally associated with the application wallet 323.
  • the control center interface 353 also includes a "more” icon 367 showing more shortcut operations. These applications that support quick operations are optionally manually selected by the user, optionally recently used by the user, or optionally used by the user frequently.
  • the control center interface 353 optionally includes a contextual smart interface 369 and one or more contextual smart cards with a closed shape generated by the system/application in the contextual smart interface 369.
  • the contextual smart interface 369 can optionally automatically refresh the contextual smart card, such as adding/deleting cards, for example, modifying the content in the card; the refreshing method can optionally be refresh when the user interface 301 is the control center interface 353, or optionally Refresh in the background.
  • the contextual smart card can optionally be an application usage detail card 371, which provides the user with a total usage time of the portable electronic device 200 and a usage ratio of each application.
  • the contextual smart card can optionally be a parking card 373, which reflects the parking location of the user's travel tool, the length of parking, the distance to the user, a local map, and the location of the travel tool in the map.
  • the parking card 373 may also optionally include a "navigation" icon 375.
  • the portable electronic device 200 detects the user's operation of clicking the "navigation" icon 375, the portable electronic device 200 opens the map software and guides the user to the parking position.
  • the content in the contextual smart card also includes a "more" icon 377.
  • a selection list will pop up and provide the user with more
  • the options in the options table can optionally include the following options or their subsets or supersets: ignore this time, share, put on top, display on lock screen, cancel subscription, display on other interfaces, etc.
  • the content in the contextual smart interface 369 is first explained above, and then some exemplary contextual smart cards are displayed.
  • the usage scenarios of the smart playing multimedia device 250 and the correspondingly generated scenario smart card in the scenario smart interface 369 will be described below.
  • FIG. 4A shows a schematic diagram of a scene in the home scene 100 where the user is watching the smart TV 111 in the first room 110.
  • the smart TV 111 is playing "Stride Bravely" through Huawei Video.
  • the Huawei Video here can be the same as the application Huawei Video 325 on the mobile phone side, it can also be a version of Huawei Video suitable for Smart TV 111, and it can also be other video playback applications.
  • the smart TV 111 in FIG. 4A exemplarily displays a frame 401 in "Stride Bravely".
  • the play icon 403 of the smart TV 111 (the play state at this time is playing, the playing state is also optionally paused, and the playing state is also optionally buffering), the playback progress display bar 405 and the slider 405A
  • the position of the slider 405A relative to the playback progress display bar 405 indicates the playback progress of the video "Stride Bravely" on the smart TV 111.
  • the smart TV 111 is connected to the WLAN provided by the router 145.
  • FIG. 4B shows that the user picks up the mobile phone 407, and the mobile phone 407 is also in the WLAN provided by the router 145 at this time.
  • the user hopes that the video "Stride Bravely" played on the smart TV 111 can be continued on the mobile phone 407.
  • the method for resuming multimedia content between devices provided in the embodiments of the present application can meet this demand of users.
  • FIG. 4C shows an exemplary broadcast control card 409 corresponding to the scene smart interface 369 of the smart TV 111. The content of the broadcast control card 409 will be described below.
  • the playback control card 409 optionally includes the name 411 of the application program used to play multimedia content, and the corresponding icon 413.
  • Huawei Video 325 is used as an example of the application program for playing video and the icon corresponding to Huawei Video 325 is used as an example.
  • the broadcast control card 409 optionally includes the name 415 of the multimedia content and the associated picture 417 of the multimedia content.
  • the associated picture can optionally be a cover image of the multimedia content, optionally one of the frames of the multimedia content, and optionally
  • the mobile phone 407 receives the picture set by the user, which corresponds to the video "Stride Bravely" played by the smart TV 111 and its video cover image.
  • the video cover image includes a cyclist. It is understandable that the associated picture 417 of the multimedia content may be unchanged; it may be continuously changing. At this time, it is equivalent to playing "Stride Bravely" in the broadcast control card 409.
  • the broadcast control card 409 optionally includes the name 419 of the smart multimedia playback device 250, which here exemplarily corresponds to the name “TV in the first room” of the smart TV 111.
  • the play control card 409 optionally includes a volume icon 421.
  • the playback control card 409 displays the volume icon 421
  • the smart multimedia playback device 250 can play the audio corresponding to the multimedia content (for example, through a built-in speaker 267A, an external headset, an external speaker, etc.), for example, the smart TV 111 plays the video while playing The audio corresponding to the video.
  • the volume icon 421 is optionally an icon that can receive user operations.
  • the mobile phone 407 detects that the user clicks on the volume icon 421, the mute icon 441 shown in FIG. 4F will appear. At this time, the multimedia content can optionally be played normally. The audio corresponding to the content cannot be played.
  • the play control card 409 optionally includes a play icon 423.
  • the play control card 409 displays the play icon 423
  • the smart TV 111 plays the multimedia content.
  • the play icon 423 is optionally an icon that can respond to user operations.
  • the mobile phone 407 detects that the user clicks on the play icon 423, the pause icon 445 shown in FIG. 4F will appear, and the multimedia content is paused at this time.
  • the play control card 409 optionally includes a volume display bar 425.
  • the volume level display bar 425 optionally displays the percentage of the current volume to the maximum volume through the slider 425A, and optionally also displays a quantifiable volume (for example, 50 decibels).
  • the volume level display bar 425 can optionally be an icon that can respond to user operations. For example, the mobile phone 407 receives a drag gesture of the user on the slider 425A to adjust the volume.
  • the slider 425A is optionally displayed on the leftmost side of the volume display bar 425, and returns to the original position after the volume icon 421 appears.
  • the play control card 409 optionally includes a play progress display bar 427.
  • the playback progress display bar 427 optionally uses a slider 427A to display the playback progress in units of time (for example, seconds, minutes), and optionally also displays the playback progress in proportions.
  • the playback progress display bar 427 can optionally be an icon that can respond to user operations, for example, receiving a drag gesture of the user on the slider 427A to realize the adjustment of the playback progress.
  • the play control card 409 optionally includes a rewind icon 429.
  • a rewind icon 429 For example, when the mobile phone 407 detects that the user clicks the rewind icon 429, the playback progress goes back to the previous frame or multiple frames of the current video frame and continues to play the video, the slider 425A on the playback progress display bar 425 will also slide to the left .
  • the fast rewind icon 429 optionally recognizes the user's tap operation, and the mobile phone 407 rewinds the video progress once every time the mobile phone 407 detects that the user clicks the fast rewind icon 429.
  • the fast rewind icon 429 can optionally identify the user's long press operation.
  • the mobile phone 407 detects the user pressing the fast rewind icon 429, records the long press time until the user lifts it up, and calculates the number of video frames that need to be rewinded, optionally in the long press Rewind the playback progress during the pressing process, optionally after the long press is over.
  • the play control card 409 optionally includes a fast forward icon 431.
  • a fast forward icon 431 For example, when the mobile phone 407 detects that the user has clicked the fast forward icon 431, the playback progress will advance to one or more frames after the current video frame and continue to play the video, the slider 425A on the playback progress display bar 425 will also slide to the right .
  • the fast-forward icon 431 optionally recognizes the user's tap operation, and the mobile phone 407 advances the video progress once every time the mobile phone 407 detects the user's operation of clicking the fast-forward icon 431.
  • the fast-forward icon 431 can optionally identify the user’s long-press operation.
  • the mobile phone 407 detects the user’s pressing the fast-forward icon 431, records the long-press time until the user lifts it up, and calculates the number of video frames that need to be advanced. Advance the playback progress during the pressing process, optionally after the long press ends.
  • the play control card 409 optionally includes the next set of icons 433. For example, when the mobile phone 407 detects that the user clicks on the next episode icon 433, the smart TV 111 will play the next video, and the broadcast control card 409 will refresh and display the play information of the video currently played by the smart TV 111.
  • the next video is optionally the next episode of the same episode, optionally the next video recommended by other video playback applications (Huawei Video 325), and optionally the next episode set by the user.
  • the broadcast control card 409 optionally includes a resume icon 435.
  • the mobile phone 407 detects the user's operation of clicking the resume icon 435, it can optionally enter the video playback application (Huawei Video 325) for the mobile phone 407 to resume the video being played on the smart TV 111.
  • the smart TV 111 does not change after the mobile phone 407 continues to play the video, and continues to play the video currently being played.
  • the smart TV 111 ends playing the video after the mobile phone 407 continues to play the video.
  • the smart TV 111/mobile phone 407 prompts the user whether to end playing the video played on the smart TV 111.
  • the play control card 409 optionally includes a "more" icon 377.
  • the mobile phone 407 detects the user's click on the "More" icon 377, the following options or their subsets or supersets are optionally displayed: ignore this time, share, put on top, display when the screen is locked, unsubscribe, in other interfaces Display etc.
  • FIG. 4L shows an exemplary interface displayed by the broadcast control card 409 when the screen is locked.
  • 4L shows the lock screen interface 453 of the mobile phone 407.
  • the lock screen interface 453 includes a broadcast control card 409, and also includes an indicator 455 that prompts the mobile phone 407 to be on the lock screen interface 453.
  • the content in the indicator 455 is exemplarily "slide Unlock".
  • the play control card 409 is an exemplary embodiment. In other embodiments, it may optionally have more/less play information, optionally have different names for the play information, and optionally play Information is presented in different styles and/or layouts.
  • FIG. 4M shows an exemplary interface diagram displayed by the broadcast control card 409 on the notification center interface 457.
  • the notification center interface 457 includes a broadcast control card 409.
  • the notification center interface 457 can be obtained from the user interface 301 shown in FIG. 3A by detecting the user's sliding gesture from top to bottom through the mobile phone 407.
  • 4D shows the playback progress display bar 405 of the smart TV 111 after receiving the remote control command, the slider 405A on the playback progress display bar 405, the volume icon 437, the volume size display bar 439, and the volume size display bar 439 on the display bar 439.
  • the slider 439A Compared with the broadcast control card 409 corresponding to the smart TV 111 in FIG. 4B shown in FIG. 4C, it can be seen that the playback progress and volume of the smart TV 111 have changed.
  • the smart TV 111 will synchronize the playback information to the mobile phone 407 through the wireless communication module 265 after the playback information changes.
  • FIG. 4E shows the volume size display bar 425 of the play control card 409 of the smart TV 111 after the playback information is synchronized, the slider 425A on the volume size display bar 425, the playback progress display bar 427, and the slide on the playback progress display bar 427 Block 427A.
  • the playback information displayed by the smart TV 111 in FIG. 4D and the playback control card 409 in FIG. 4E are basically the same, and the corresponding slider positions are basically the same, indicating that the playback information of the smart TV 111 is synchronized to the playback control card 409 in real time .
  • Such real-time synchronization can be understood as real-time synchronization within a certain error tolerance due to the influence of factors such as information transmission and/or processing.
  • 4F-4G show the process of the user playing and controlling the smart TV 111 through the playing control card 409.
  • the smart TV 111 when the mobile phone 407 detects that the user clicks the volume icon 421 in FIG. 4C, the volume icon 421 of the playback control card 409 will change to the mute icon 441 shown in FIG. 4F. After the mobile phone 407 sends the broadcast control command to the smart TV 111 through the wireless communication module, the smart TV 111 will also display the mute icon 443 shown in FIG. 4G.
  • the play icon 423 of the play control card 409 will change to the pause play icon 445 in FIG. 4F.
  • the play icon 403 of the smart TV 111 will also change to the pause play icon 447 shown in FIG. 4G.
  • the following describes the process of the user replaying the video being played in the smart TV 111 through the play control card 409.
  • the mobile phone 407 when the mobile phone 407 detects that the user clicks the resume icon 435 in FIG. 4C, it will jump into the video playback application and continue to play the video.
  • the playback information shown in FIG. 4D as an example, after the user clicks the resume icon 435 on the playback control card 409 on the mobile phone 407, the exemplary user interface 449 of Huawei Video 325 shown in FIG. 4H appears, and the user can The video "Stride Bravely" is continued in the user interface 449.
  • the playback information shown in Huawei Video 325 in FIG. 4H is basically the same as the playback information shown in FIG. 4D. It is understandable that this kind of agreement is the agreement within a certain error tolerance.
  • the user’s application for playing multimedia content on the mobile phone and the application for playing multimedia content on the TV are exactly the same application, that is, the application supports both use on the mobile phone and on the TV. use.
  • the user's application for playing multimedia content on the mobile phone and the application for playing multimedia content on the TV are different versions of the same application.
  • the application on the mobile phone is the mobile version of Huawei Video 325
  • the application on the TV is the TV version of Huawei Video.
  • the user’s application for playing multimedia content on the mobile phone and the application for playing multimedia content on the TV are related applications.
  • the multimedia content is played on the TV through the first application, and the mobile phone receives the playing information.
  • the playing information includes The multimedia content identifier, which can be used on the mobile phone to continue to broadcast the multimedia content in the second application.
  • the multimedia content replayed by the user on the mobile phone and the multimedia content played on the smart TV are of the same type.
  • the multimedia content played by the user on the mobile phone and the multimedia content played on the smart TV are of different types.
  • the multimedia content played on the TV is the 4K version of "Stride Bravely”.
  • the renewed multimedia content is the 1080P version of "Stride Bravely”; for example, the content played on TV is the VR version of "Stride Bravely", and the multimedia content renewed on the mobile phone is the VR version of "Stride Bravely”.
  • the flat version corresponding to the version for example, the content played in the smart VR glasses is the panoramic video version of "Stride Bravely" including depth data, and the multimedia content replayed on the mobile phone is the panoramic video version of "Stride Bravely”.
  • the smart TV 111 may experience unexpected situations such as power failure or disconnection of the WLAN. At this time, the smart TV 111 is offline relative to the mobile phone 407. The mobile phone 407 controls the smart TV 111. The command is invalid.
  • the broadcast control card 409 can optionally stop displaying; optionally one or more icons become unacceptable for user operations; optionally, one or more icons change color, For example, the volume icon 421, the playback icon 423, the volume size display bar 425, the slider 425A, the playback progress display bar 427, the slider 427A, the fast rewind icon 429, and the fast forward icon 431 in the play control card 409 shown in FIG. 4I.
  • the next set of icons 433 turns gray; optionally, one or more icons stop displaying, such as the volume icon 421, the playback icon 423, the volume display bar 425, the slider 425A, and the playback progress in the playback control card 409 in Figure 4C.
  • the content in the prompt box 451 is exemplified as "Prompt: Not in the same WLAN, broadcast control failed!, and the content can also be exemplified as "XXX device offline, broadcast control failed!; optional
  • the ground is one or more combinations of the above embodiments, and can also be other embodiments.
  • the mobile phone 407 may fail to resume playback, such as loss of video source, video parsing error, and lack of permission to open the video playback application.
  • a solution similar to that shown in FIG. 4K is optionally adopted.
  • a prompt box 451 is generated on the control center interface 353/the user interface 449 of the video application program to prompt the user that the replay fails. For example, "video parsing error, playback failed", I won't repeat it here.
  • An embodiment of the application provides a method for resuming multimedia content between devices.
  • the portable electronic device 200 retains the playback information of the smart multimedia playback device 250 for a certain period of time, so that the user disconnects the WLAN/smart multimedia playback device for the last time 250 exits the playback state/smart multimedia playback device 250 can continue to play multimedia content within a certain period of time when the power is off, for example, after the user turns off the smart TV 111 and leaves home (disconnects WLAN), the user can still use the mobile phone for a period of time.
  • 407 continues to broadcast "Stride Bravely". The following description will be given by continuing to watch the video recently played on the smart TV 111 on the mobile phone 407 after the user leaves home.
  • the user hopes to be able to rebroadcast the video played on the smart TV 111 within a period of time after leaving home. For example, the scene shown in FIG. The video played and left home. At this time, the user's mobile phone 407 and smart TV 111 are not in the same WLAN, and the device status of the smart TV 111 relative to the mobile phone 407 is offline.
  • FIG. 5B also shows the broadcast control card 409 under the scene smart interface 369.
  • the mobile phone 407 and the smart TV 111 are not in the same WLAN, and the user cannot realize the broadcasting control of the smart TV 111 through the broadcasting control card 409.
  • the volume icon 421, the volume size display bar 425, the slider 425A, the fast rewind icon 429, the fast forward icon 431, the next set icon 433, the play icon 423, the play progress display bar 427, and the slider 427A stop displaying.
  • 5C retains the play icon 423, the play progress display bar 427, and the slider 427A.
  • the mobile phone 407 collects the most recent play information stored locally through the slider. 427A indicates the playback progress of the recently played video, which brings a better visual experience to the user.
  • the mobile phone 407 When the mobile phone 407 detects the user's operation of clicking the resume icon 435 in FIG. 5B, it optionally displays the user interface 449 of the video playback application Huawei Video 325 shown in FIG. 4H. It is understandable that the information displayed in the user interface 449 can be more real-time playback information, which is basically the same as the playback information when the user leaves home/the smart TV 111 is turned off (because the playback information occurred during a period of time before leaving home. Synchronization), or earlier playback information (the playback information synchronization has not occurred within a period of time before leaving home).
  • the mobile phone 407 may fail to resume playback, for example, the video source is lost, the video is parsed incorrectly, and it does not have the permission to open the video playback application.
  • the broadcast control card 409 can optionally stop displaying, and the prompt box 501 shown in FIG. 5D is optionally generated. Failed!, it can also optionally be other implementation schemes, which will not be repeated here.
  • Figure 5E shows a schematic diagram of the user returning to the home scene 100 after leaving home.
  • the user picks up the mobile phone 407 again to view the broadcast control card 409 of the smart TV 111.
  • the mobile phone 407 and the smart TV 111 are in the same WLAN.
  • the indicator used to indicate the WLAN connection in the signal strength indicator 303 in 5F is redisplayed.
  • the play control card 409 is changed from the play control card 409 shown in Figure 5B/ Figure 5C to the play control card 409 shown in Figure 5F.
  • volume icon 421, the play icon 423, the volume size display bar 425, slide Block 425A, playback progress display bar 427, slider 427A, fast rewind icon 429, fast forward icon 431, next episode icon 433 is redisplayed, and the broadcast control information is synchronized again at this time, and the user can broadcast through the broadcast control card.
  • Control smart TV 111 Control smart TV 111.
  • all broadcast control cards are optionally displayed.
  • one or more of them are optionally displayed, and the remaining cards are displayed on the scene intelligent interface 369 in a form of, for example, "expand-collapse”.
  • one or more of them are displayed, and the remaining cards are displayed on an interface other than the contextual smart interface 369 by means of, for example, "display all-return”.
  • FIG. 6A shows an implementation when there are multiple broadcast control cards to be displayed.
  • the scene intelligent interface 369 in FIG. 6A includes a play control card 409 and an "expand" icon 601.
  • the contextual smart interface 369 shown in FIG. 6B appears.
  • the scene intelligent interface 369 includes the broadcast control card 409 corresponding to the smart TV 111; includes the broadcast control card 603 corresponding to the smart speaker 113, plays an exemplary audio "Yoga Accompaniment" 607, and displays an exemplary picture 609; includes the corresponding smart projector 141
  • the broadcast control card 605, plays an exemplary video "Beautiful Scenery" 611, and displays an exemplary picture 613.
  • the contextual smart interface 369 also includes a "collapse" icon 615. When the mobile phone 407 detects the user's operation of clicking the "retract” icon 615, the contextual smart interface 369 returns to the interface shown in FIG. 6A.
  • the multimedia content whose file type is video can be played through a video playback application, such as Huawei Video 325.
  • the multimedia content whose file type is audio can be played through an audio playing application, such as music 321.
  • the mobile phone 407 needs to determine the type of multimedia content through the processor 201, and use the corresponding application to play the type of multimedia content.
  • the order of the broadcast control cards needs to be considered.
  • the method for sorting the broadcast control cards is optionally to sort according to the name 419 of the smart multimedia playback device 250 (for example, length, initials, etc.); optionally, to sort according to the playback status of the device (playing/pausing/buffering); It is also optional to sort according to device status (online/offline), where online devices support broadcast control and/or replay, and offline devices can optionally support replay for a period of time; optionally according to The rooms where the user is located are sorted; optionally, the broadcast control card can be placed on top of the broadcast control card through the "more" icon 377 on the broadcast control card to artificially change the arrangement order.
  • 6C-FIG. 6D show an implementation of sorting broadcast control cards according to the location of the user.
  • FIG. 6C shows the movement track 617 of the user in the home scene 100.
  • the user leaves the first room 110, passes through the corridor 150, and finally reaches the fourth room 140.
  • the contextual smart interface 369 exemplarily displays the user interface shown in FIG. 6B.
  • the arrangement sequence is first the broadcast control card 409 corresponding to the smart TV 111 in the first room 110, and then the first room The broadcast control card 603 corresponding to the smart speaker 113 of 110, and finally the broadcast control card 605 corresponding to the smart projector 141 of the fourth room 140.
  • FIG. 6D shows the scene smart interface 369 shown by the user in the fourth room 140.
  • the arrangement sequence is first the broadcast control card 605 corresponding to the smart projector 141 in the fourth room 140, and then the smart TV 111 in the first room 110.
  • Indoor positioning technology includes but not limited to Wi-Fi positioning technology, RFID positioning technology, infrared technology, ultrasonic technology, Bluetooth technology, inertial navigation technology, UWB positioning technology , Image recognition positioning technology.
  • the positioning technology can be implemented by the portable electronic device 200 and/or the smart multimedia playback device 250.
  • other devices such as using home Camera to achieve auxiliary positioning.
  • the room to be processed by the positioning technology is a virtual location tag, and the relative location can be determined by judging the distance between the portable electronic device 200 and one or more devices.
  • the room to be processed by the positioning technology is a physical room.
  • the specific position of the portable electronic device 200 in the home scene 100 can be determined through inertial navigation technology in the positioning technology, RFID positioning technology, etc.
  • the portable electronic device 200 can continue to play the multimedia content played on the first smart multimedia playback device 250 on the second smart multimedia playback device 250. It is understandable that the second smart multimedia playback device 250 needs to support the playback of the type of multimedia content played on the first smart multimedia playback device 250. For example, after the user shown in FIG. 6E moves from the first room 110 to the fourth room 140, the contextual smart interface 369 of the mobile phone 407 displays a prompt box 619, asking whether the user needs to continue playing the smart TV 111 on the smart projector 141. Played "Stride Bravely". FIG.
  • 6F shows a schematic diagram of a scene where the smart projector 141 continues to play "Stride Bravely” played on the smart TV 111 after the portable electronic device 200 receives an operation of clicking "Yes” by the user.
  • 6F shows the play icon 621 of the smart projector 141, the play progress display bar 623, and the slider 623A on the play progress display bar 623.
  • the playback information of the smart projector 141 shown in FIG. 6F and the playback information of the smart TV 111 shown in FIG. 6D are basically the same.
  • FIG. 6G shows the play control card displayed in the scene smart interface 369 after the portable electronic device 200 receives the user's operation of clicking "Yes".
  • the playback information displayed on the play control card 605 of the smart projector 141 is refreshed, which is basically consistent with the play information shown on the play control card 409 of the smart TV 111, realizing that the smart projector 141 continues to play on the smart TV 111 Multimedia content to be played.
  • the second smart multimedia playback device 250 continues to play the multimedia content of the first multimedia playback device 250.
  • the first smart multimedia playback device 250 remains unchanged and continues to play multimedia content.
  • the first smart multimedia playback device 250 stops playing multimedia content.
  • the portable electronic device 200/first smart multimedia playback device 250/second smart multimedia playback device 250 asks the user whether the first smart multimedia playback device 250 needs to end playback.
  • FIG. 6H shows a scene where a user uses the smart TV 111 in a split-screen mode.
  • the first split-screen 625 of the smart TV 111 is playing the video "Stride Bravely”
  • the second split-screen 627 of the smart TV 111 is playing the video. "football”.
  • the audio corresponding to the video being played by the first split screen 625 and the second split screen 627 is optionally output by the same device, for example, output through the smart TV 111; optionally, output by different devices, such as the first split screen 625
  • the audio corresponding to the played video is output through the smart speaker 113
  • the audio corresponding to the video played by the second split screen 627 is output through the smart TV 111, and may also be output through other devices such as speakers, earphones, and the like.
  • Figure 6I shows that the smart TV 111 in the scene smart interface 369 respectively corresponds to the play control card 629 of the first split screen 625 and the play control card 631 of the second split screen 627.
  • the names of the smart multimedia playback devices in the play control cards are both 111 for the TV in the first room.
  • the play control card 629 corresponding to the first split screen 625 is displayed above the play control card 631 corresponding to the second split screen 627.
  • it is also optional to mark "first split screen” and "second split screen” in the broadcast control card 629 and the broadcast control card 631, respectively, for prompting the user (this solution is not shown in FIG. 6I). show).
  • FIG. 6J shows that the smart TV 111 displays the broadcast control card 633 corresponding to the first split screen 625 and the second split screen 627 on the scene smart interface 369.
  • the broadcast control card 633 includes both the first split screen 625 and the second split screen. Play information.
  • a plurality of different multimedia contents in a smart multimedia playback device 250 may optionally be displayed in a broadcast control card.
  • the scene smart interface 369 includes the play control card 635 corresponding to the first split screen 625 and The broadcast control card 637 corresponding to the second split screen 627.
  • the associated picture 639 of the multimedia content corresponds to a frame in the video played in the first split screen 625 corresponding to the playback progress in real time
  • the associated picture 641 of the multimedia content corresponds to the video playback progress in the video played in the second split screen 627.
  • One frame in real time In this way, users can watch multimedia content in real-time in the broadcast control card.
  • the portable electronic device 200 detects the user's long-pressing of the resume icon 643, the portable electronic device 200 shows the interface shown in FIG. 6L, and the first area 645 of the interface playing corresponds to the first For the video played in the split screen 625, the second area 647 of the interface corresponds to the user interface 301.
  • the portable electronic device 200 detects the user's gesture 649 of sliding from left to right in the second area 647, the second area 647 is displayed as the control center interface 353 shown in FIG. 6M, and the control center interface 353 includes the play control card 651.
  • the long press is optionally an exemplary way of expression, and it is also optionally a voice input whose semantics is split-screen viewing, and it is also optionally a case that the portable electronic device 200 detects that the user presses the resume icon. 643, then drag to the operation of the broadcast control card 637.
  • the portable electronic device 200 detects that the user clicks on the replay icon 653.
  • the portable electronic device 200 shows the interface shown in FIG. For the video played in the screen 625, the second area 647 of the interface plays the video corresponding to the video played in the second split screen 627. It is understandable that clicking is optionally an exemplary way of expression, and optionally also a voice input whose semantics are split-screen viewing.
  • the portable electronic device 200 may also be displayed in the form of one or more floating windows, such as the interface shown in FIG. 60.
  • the interface includes a first floating window 655 and a second floating window 657.
  • the portable electronic device 200 can optionally detect user input, and realize the adjustment of the size and position of the floating window. It can be understood that the portable electronic device 200 optionally includes more or fewer floating windows than those shown in FIG. 60.
  • the portable electronic device 200 may receive the user's operation and decide whether to generate the play control card of the smart multimedia playback device 250 on the portable electronic device 200, for example, the play control card setting interface 659 shown in FIG. 6P ,
  • the interface 659 includes the interface identifier "broadcast control card settings" 661, and the interface 659 displays the intelligent multimedia playback device 250 associated with the "Smart Life” application and used for configuration, such as the TV 111 in the first room and the TV 121 in the second room. Wait.
  • the portable electronic device 200 may also receive user operations to determine whether the play control card supports the replay function.
  • the replay function setting interface 663 shown in FIG. 6Q the interface 663 includes the interface identifier "Continue” "Play function settings” 665, the interface 663 includes the interface identification "Broadcast control card settings” 665, and the interface 663 displays the smart multimedia playback device 250 associated with the "Smart Life” application and used for configuration, such as the TV 111 in the first room. The TV 121 in the second room and so on.
  • the intelligent multimedia playback device 250 can support the replay function only on the premise of generating a play control card. In some possible implementations, the smart multimedia playback device 250 can also support the replay function without displaying the play control card. For example, the replay function is realized through voice input. For example, the portable electronic device 200 receives the user's voice "small”. Yi Xiaoyi, continue to play the "Brave Stride" on the TV on the mobile phone, and the portable electronic device 200 can continue to play the video content on the TV.
  • multiple smart multimedia playback devices 250 of the same type play the same multimedia content and the same playback information, and the multiple smart multimedia playback devices 250 are displayed in a play control card.
  • This kind of scenario can realize that family members in multiple rooms can watch the same multimedia content at the same time through the multimedia equipment in each room in a large-sized family, and the playback progress or volume of the multimedia content in each room is the same, at this time, the broadcast control card The volume and playback progress can be displayed.
  • the playback progress or volume of the multimedia content in each room may also be different (for example, the first room’s Users like loud volume, the TV in the first room can turn up the volume when playing "Brave Stride").
  • the broadcast control card may not display the volume and playback progress.
  • the TV 111 in the first room and the TV 121 in the second room are playing the same multimedia content, and the broadcast control card 667 is displayed in the scene intelligent interface 369. In this way, multiple smart multimedia playback devices can be broadcast and controlled in one broadcast control card.
  • multiple smart multimedia playback devices 250 of different types play the same multimedia content, for example, a smart TV is playing a video of the multimedia content, and a smart speaker is playing an audio corresponding to the multimedia content.
  • multiple intelligent multimedia playback devices 250 are displayed in one broadcast control card.
  • the TV 111 in the first room and the speaker 113 in the first room are playing the same multimedia content
  • the broadcast control card 669 is displayed in the scene intelligent interface 369.
  • the play control card 669 optionally includes a volume display bar corresponding to each smart multimedia playback device 250, so as to be able to receive user input to distinguish the volume of each smart multimedia playback device 250. Adjustment.
  • multiple smart multimedia playback devices 250 of different types play the same multimedia content
  • multiple smart multimedia playback devices 250 can optionally be displayed in a play control card.
  • the TV 111 and the smart projector 141 in the first room are playing the same multimedia content
  • a broadcast control card 671 is displayed in the scene intelligent interface 369.
  • the broadcast control card 671 includes an area 671A for displaying multimedia content and a display The area 671B where the TV 111 in one room broadcasts information and the area 671C where the projector 141 in the fourth room displays information is different. At this time, at least one of the broadcast information of the smart TV 111 and the projector 141 is different.
  • the broadcast control card 669 shown in 6S is shown.
  • the display sequence of the area 671B and the area 671C can be adjusted and displayed according to the position of the portable electronic device 200 in the home scene 100.
  • the portable electronic device 200 is in the first room 110, the user is watching "Brave Stride” through the smart TV 111, and the area 671B is displayed above the area 671C.
  • the portable electronic device 200 is in the fourth room 140, the user is watching "Brave Stride” through the projector 141, and the area 671C is displayed above the area 671B, thereby giving the user a better viewing experience.
  • the playback information optionally includes the name of the multimedia content (for example, the name 415 "Stride Bravely" in the playback control card 409 shown in FIG. 4C), the identifier of the multimedia content, the type of the multimedia content (such as audio, video), and the multimedia content Duration, the associated picture of the multimedia content (for example, the associated picture 417 of the playing video in the broadcast control card 409 shown in FIG.
  • the source address of the multimedia content, etc. optionally including the playback status (for example, play/pause, optionally by playing Icon 423/pause icon 445), playback progress (for example, displayed by the playback progress display bar 427), volume status (for example, unmute state/mute state, displayed by the volume icon 421/mute icon 441), playback volume (for example, through The volume level display bar 425 displays).
  • playback status for example, play/pause, optionally by playing Icon 423/pause icon 445
  • playback progress for example, displayed by the playback progress display bar 427
  • volume status for example, unmute state/mute state, displayed by the volume icon 421/mute icon 441
  • playback volume for example, through The volume level display bar 425 displays.
  • the multimedia content identifier and the multimedia content source address can enable the device or other devices to obtain the multimedia content from the server.
  • the device information optionally includes the device name (for example, the name 419 of the smart multimedia playback device 250, exemplarily the name of the smart TV 111 "TV in the first room"), the device identifier, and the device type (for example, the smart TV 111, the smart speaker 113).
  • the device name for example, the name 419 of the smart multimedia playback device 250, exemplarily the name of the smart TV 111 "TV in the first room
  • the device identifier for example, the smart TV 111, the smart speaker 113.
  • Step 701 is an optional execution step.
  • the portable electronic device 200 establishes (step 701) a near-field connection with the intelligent multimedia playback device 250, and the devices that establish the near-field connection can interact with each other.
  • the user mobile phone 407 in FIG. 4B accesses the WLAN provided by the router 145 shown in FIG. 1A through the wireless communication module 217, and the smart TV 111 and the smart speaker 113 access the router 145 shown in FIG. 1A through the wireless communication module 265.
  • WLAN provided.
  • the mobile phone 407, the smart TV 111 and the smart speaker 113 are in the same wireless network, and data interaction can be carried out among the devices.
  • the portable electronic device 200 and the smart multimedia playback device 250 can log in to the same user account (for example, a Huawei account or a Huawei video account).
  • the same user account for example, a Huawei account or a Huawei video account.
  • the smart multimedia playback device 250 is playing (step 703) the first multimedia content. It is understandable that the smart multimedia playback device 250 may have been playing multimedia content before step 701 occurs, and may also start to play multimedia content after step 701 occurs.
  • the smart TV 111 in FIG. 4A is playing the video file "Stride Bravely", and one of the frames 401 is displayed. It is understandable that the smart TV 111 may have played "Stride Bravely” before being in the same WLAN with the mobile phone 407, and may also start playing "Stride Bravely” after being in the same WLAN with the mobile phone 407.
  • the portable electronic device 200 receives (step 705) the first playback information sent by the smart multimedia playback device 250, where the first playback information corresponds to the first multimedia content played by the smart multimedia playback device 250.
  • the acquisition method can optionally be that the smart multimedia playback device 250 periodically sends the playback information to the portable electronic device 200; optionally, the smart multimedia playback device 250 sends the playback information to the portable electronic device 200 after the playback information changes; optionally, the portable electronic device 200 After the electronic device 200 sends the acquisition request, the smart multimedia playback device 250 sends playback information to the portable electronic device 200.
  • the first playback information includes the identifier of the first multimedia content and the playback progress of the first multimedia content, and optionally includes the source address of the first multimedia content, the playback status of the first multimedia content, and the first The volume status of the multimedia content, or the playback volume of the first multimedia content.
  • the portable electronic device 200 displays (step 707) a first broadcast control card corresponding to the first multimedia content.
  • the first broadcast control card includes a first control and a second control.
  • the second control is used to control the first The playback of multimedia content.
  • the first control is a replay option
  • the second control is used to display or control the first multimedia content.
  • the scene smart interface 369 of the control center interface 353 displays the play control card 409 corresponding to the smart TV 111 shown in FIG. 4C, and the play control card 409 includes the resume icon 435.
  • the broadcast control card 409 can also be displayed on other interfaces of the mobile phone 407, such as the notification center interface.
  • the portable electronic device 200 responds (step 709) to the first user input acting on the first control, obtains the first multimedia content from the server based on the first playback information, and continues to play the first multimedia content based on the first playback information .
  • the playback progress of the first multimedia content replayed by the first device is the same as the playback progress of the first multimedia content played by the second device.
  • to replay a video take the play control card 409 and play information corresponding to the smart TV 111 shown in FIG. 4D as an example.
  • the mobile phone 407 responds to the user's operation of clicking the replay icon 435 to open Huawei Video 325 for playing the video. And realize the resuming (the user interface 449 shown in FIG.
  • the multimedia content can be replayed.
  • the portable electronic device 200 can obtain playback information of other multimedia playback devices and generate a corresponding playback control card. For example, in addition to obtaining the playing information of the smart TV 111 to generate the playing control card of the smart TV 111, the portable electronic device 200 can also obtain the playing information of the audio content played by the smart speaker 123 and generating the playing control card of the smart speaker 113.
  • the broadcast control card of the smart TV 111 and the broadcast control card of the smart speaker 123 can be displayed on the scene smart interface 369 at the same time, as shown in FIG. 6D.
  • the contextual smart interface 369 displays multiple broadcast control cards.
  • the contextual smart interface 369 displays a first broadcast control card corresponding to the smart TV 111 and a second broadcast control card corresponding to the smart speaker 123.
  • the display effects of the first broadcast control card and the second broadcast control card are based on the first area (for example, the first room 110) corresponding to the portable electronic device 200 and the smart TV 111 and the second area (for example, the second area corresponding to the smart speaker 123).
  • the positional relationship of the room 120) is determined.
  • the display effects of the first broadcast control card and the second broadcast control card are given below based on the first area (for example, the first room 110) corresponding to the portable electronic device 200 and the smart TV 111 and the second area (for example, the second area corresponding to the smart speaker 123).
  • the portable electronic device 200 after the portable electronic device 200 is disconnected from the wireless network, it can display a play control card corresponding to the smart multimedia playback device 250, and the play control card includes the first control (ie, the replay option).
  • the portable electronic device 200 is in a wireless network, the displayed play control card corresponding to the smart multimedia playback device 250 does not include the first control (that is, the replay option). In this way, when the user is at home, he can focus on the content played by the smart multimedia playback device 250, and when the user leaves home, he can continue to play the multimedia content through the replay option of the play control card.
  • the following will illustrate the process of the portable electronic device 200 obtaining the playback information of the multimedia content played on the smart multimedia playback device 250 in conjunction with FIGS. 7B-7D.
  • FIG. 7B shows the process of synchronously playing information to the portable electronic device 200 after the playing information of the smart multimedia playing device 250 changes.
  • the intelligent multimedia playback device 250 calls (step 711) the playback information subscription interface provided by the video playback application program after the device is started.
  • the smart multimedia playback device 250 receives a notification from the playback information subscription interface.
  • a change in the playback information can optionally occur when the smart multimedia playback device 250 changes from not playing multimedia content to playing multimedia content, optionally occurs when the smart multimedia playback device 250 plays multimedia content, and optionally occurs when the smart multimedia playback device 250 plays multimedia content. It occurs when the device 250 changes from playing multimedia content to not playing multimedia content.
  • the intelligent multimedia playback device 250 acquires and stores the changed playback information, and refreshes the current UTC timestamp of the playback information. For example, after the smart TV 111 is started, the playback information subscription interface provided by Huawei Video on the side of the smart TV 111 is invoked.
  • FIG. 4D shows the scene after the user remotely controls the smart TV 111 through the remote control. After the remote control, the position of the slider 405A on the playback progress display bar 405 has changed compared with the position of the slider 405A shown in the original FIG. 4A, and the volume size display bar The slider 439A on the 439 changes (the volume size display bar 439 in FIG. 4A is not shown, but the volume size display bar 427 of the broadcast control card 409 shown in FIG.
  • the smart TV 111 After receiving the notification from the playback information subscription interface, the smart TV 111 obtains and stores the changed playback information, and refreshes the current UTC time stamp of the playback information.
  • the smart multimedia playback device 250 directly synchronizes the playback information to the portable electronic device 200, but due to the existence of some continuously changing playback information (such as the playback progress of the multimedia content: the multimedia content being played, the playback progress Will always change), which brings about the problem of excessively high synchronization frequency, resulting in increased power consumption.
  • some continuously changing playback information such as the playback progress of the multimedia content: the multimedia content being played, the playback progress Will always change
  • the smart multimedia playback device 250 after the smart multimedia playback device 250 obtains and stores the changed playback information, it will first determine (step 713) whether this synchronization is required, when there is only continuously changing playback information (for example, playback progress) When there is an incremental change over time, synchronization is not required.
  • the smart multimedia playback device 250 may determine whether to synchronize the playback information according to the type of the playback information.
  • the smart multimedia playback device 250 discovers (step 715) smart electronic devices under the same network, and collects device information of these smart electronic devices.
  • the smart TV 111 discovers through the wireless communication module 265 that other devices under the WLAN provided by the router 145 include a smart speaker 113 and a mobile phone 407.
  • the smart TV 111 collects and stores the device information of the two devices.
  • the smart multimedia playback device 250 connects (step 717) to the portable electronic device 200 under the same network.
  • the connection method can optionally be that the smart multimedia playback device 250 sends the login account bound to the device to the portable electronic device 200. If the portable electronic device 200 determines that the received login account is the same as the login account of the device, the connection can be established.
  • the smart TV 111 sends the login account of the device to the mobile phone 407, and the mobile phone 407 optionally returns a return code indicating a successful connection after verification, and optionally returns a return code indicating a connection failure after the verification fails.
  • the smart multimedia playback device 250 is connected to a device whose device type is the portable electronic device 200. In some possible implementations, the smart multimedia playback device 250 is connected to other types of smart electronic devices in addition to the devices whose device type is the portable electronic device 200.
  • the smart multimedia playback device 250 sends (step 719) playback information to the portable electronic device 200 that is successfully connected.
  • the smart TV 111 sends the playback information collected in step 711 to the mobile phone 407 through the wireless communication module 265.
  • the portable electronic device 200 stores (step 721) the playback information. After the portable electronic device 200 receives the playback information sent by the smart multimedia playback device 250 in step 721, it stores the playback information received this time, sets the device status of the smart multimedia device that sent the playback information to online, and refreshes the playback information. The current UTC timestamp of the machine. Optionally, the portable electronic device 200 sends a return code indicating successful synchronization after storage. For example, after receiving the playback information sent by the smart TV 111, the mobile phone 407 stores the playback information received this time, sets the device status of the TV 111 to online, and refreshes the current UTC timestamp of the playback information.
  • FIG. 7C shows a process in which the intelligent multimedia playback device 250 periodically synchronously plays information to the portable electronic device 200.
  • the portable electronic device 200 stores the playback information of the smart multimedia playback device 250 that is not time-sensitive. For example, when the smart multimedia playback device 250 is forcibly shut down, the smart multimedia playback device 250 has not synchronized the playback information to the portable electronic device for a long time. Equipment 200.
  • the smart multimedia playback device 250 periodically synchronously plays information to the portable electronic device 200, which can be used as a basis for the portable electronic device 200 to determine whether the smart multimedia playback device 250 is online.
  • the intelligent multimedia playback device 250 starts (step 723) a loop timer.
  • the period of the exemplary loop timer is 30 minutes.
  • the cycle timer may be generated by the processor 251, and may also be generated by other timer modules/chips connected to the processor 251.
  • the smart multimedia playback device 250 discovers (step 725) that it finds the smart electronic device under the same network, connects (step 727) to the portable electronic device 200 under the same network, and sends (step 729) the playback information.
  • the portable electronic device 200 stores (step 731) the playback information. Step 725 to step 731 are the same as step 715 to step 721 shown in FIG. 7B, and will not be repeated here.
  • the portable electronic device 200 may also actively collect the playback information of the multimedia playback device 250.
  • Figure 7D shows this active acquisition process.
  • the portable electronic device 200 sets (step 733) an event listener after the device is started, which is optionally used to monitor the screen unlock event of the portable electronic device 200 and the event of the portable electronic device 200 establishing/exiting the near field connection, and can also be used for other triggers event.
  • an event listener after the device is started, which is optionally used to monitor the screen unlock event of the portable electronic device 200 and the event of the portable electronic device 200 establishing/exiting the near field connection, and can also be used for other triggers event.
  • the portable electronic device 200 receives a notification from the listeners.
  • the portable electronic device 200 receives the notification from the event listener; when the portable electronic device 200 accesses the WLAN provided by the router 145, the portable electronic device 200 receives the notification from the event listener; The portable electronic device 200 disconnects the WLAN provided by the router 145, and the portable electronic device 200 receives a notification from the event listener.
  • the portable electronic device 200 determines (step 735) whether it is necessary to collect and play information. When the monitor is triggered, the portable electronic device 200 determines whether it has established a near-field connection with surrounding devices. If the near-field connection is established, continue with the following steps. If the near-field connection is not established/disconnected, skip the following steps and end this time. The process of active collection.
  • the portable electronic device 200 accesses/exits the WLAN more frequently, or the user unlocks the screen more frequently, which needs to be suppressed.
  • the shortest collection period T S can be set. For example, the current UTC timestamp of the local machine of the last locally stored playback information is T 0 , and the current UTC timestamp of the local machine that is initiated to determine whether to collect this time is T 1 , it is judged whether T 1 -T 0 is greater than or equal to the shortest acquisition period T S , if greater than or equal to the shortest acquisition period T S, the acquisition will be performed; if less than, the following steps will be skipped and the active acquisition process will be completed.
  • the portable electronic device 200 discovers (step 737) the smart electronic devices under the same network, and collects the device information of these smart electronic devices.
  • the mobile phone 407 finds through the wireless communication module 217 that other devices under the WLAN provided by the router 145 include the smart TV 111 and the smart speaker 113.
  • the mobile phone 407 collects and stores the device information of the two devices.
  • the portable electronic device 200 is connected (step 739) to the intelligent multimedia playback device 250 under the same network.
  • the connection method can optionally be that the portable electronic device 200 sends the login account bound to the device to the smart multimedia playback device 250. If the smart multimedia playback device 250 determines that the received login account is the same as the login account of the device, the connection can be established. For example, the mobile phone 407 sends the login account of the device to the smart TV 111 and the smart speaker 113. After the smart TV 111 and the smart speaker 113 pass the verification, it can optionally return a return code indicating that the connection is successful. If the verification fails, it can optionally return the connection failure. Return code.
  • the portable electronic device 200 only connects to devices whose device type is the smart multimedia playback device 250. In some possible implementations, the portable electronic device 200 is connected to other types of smart electronic devices in addition to the devices whose device type is the smart multimedia playback device 250. In other embodiments, the portable electronic device 200 is connected to all types of smart electronic devices.
  • some smart electronic devices do not have the ability to log in to an account, and the portable electronic device 200 can optionally be connected to these smart electronic devices, and optionally may not be connected to these smart electronic devices due to security considerations.
  • some smart electronic devices and applications can be regarded as having a device account for installing the application after being associated.
  • the portable electronic device 200 is optionally connected to these smart electronic devices, and optionally for security reasons. Consider not connecting these smart electronic devices.
  • the portable electronic device 200 sends (step 741) a request for acquiring playback information to the smart multimedia playback device 250 and receives the playback information sent by the smart multimedia playback device 250.
  • the portable electronic device 200 sends a request for acquiring playback information.
  • the intelligent multimedia playback device 250 collects and returns the playback information.
  • the portable electronic device 200 After receiving the returned playback information, the portable electronic device 200 sets the device status of the multimedia playback device 250 that successfully sent the playback information to online, and refreshes the current UTC time stamp of the playback information; Connecting (step 739) success/sending (step 741) the multimedia playback device 250 with successful playback information, the device status is set to offline, and the current UTC timestamp of the local machine of the playback information is not refreshed.
  • the portable electronic device 200 can obtain the time-sensitive playback information of the intelligent multimedia playback device 250.
  • FIG. 7E shows an example diagram of data interaction between the portable electronic device 200 and the intelligent multimedia playback device 250.
  • the unit of the number is optionally minutes.
  • the time difference between T0, T1, T2... is optionally 10 minutes.
  • the smart multimedia playback device 250 sends playback information to the portable electronic device 200.
  • the state at this time can optionally be that the smart multimedia playback device 250 changes from an idle state to a state of broadcasting and controlling multimedia content, or smart The multimedia playback device 250 and the portable electronic device 200 access the same WLAN, which triggers the process shown in FIG. 7B.
  • the smart multimedia playback device 250 sends playback information to the portable electronic device 200.
  • the state at this time can optionally be that the user controls the smart multimedia playback device 250 through a remote control.
  • the playback information of the multimedia content changes, triggering the image The flow shown in 7B.
  • the intelligent multimedia playback device 250 synchronously plays the information to the portable electronic device 200. At this time, it just reaches the time for periodic transmission, and the process shown in FIG. 7C is triggered.
  • the portable electronic device 200 unlocks the screen and triggers the process shown in FIG. 7D.
  • the portable electronic device 200 sends a request to obtain playback information to the smart multimedia playback device 250, and the smart multimedia playback device 250 returns after receiving the request Play information.
  • the intelligent multimedia playback device 250 synchronously plays the information to the portable electronic device 200. At this time, it just reaches the time for periodic transmission, which triggers the process shown in FIG. 7C. It is explained that the processes shown in FIGS. 7B-7D are executed in parallel. When there is a conflict, optionally execute any one of them, and optionally execute all of them in order.
  • FIG. 8 shows a process in which the portable electronic device 200 displays and refreshes the play control card.
  • the portable electronic device 200 responds (step 801) to the user input and displays the control center interface.
  • the user input can optionally be the exemplary gesture 351 shown in FIG. 3B.
  • an exemplary control center interface 353 is displayed.
  • Exemplary control center interface 353 includes contextual intelligence interface 369. It is understandable that the control center interface 353 is only an exemplary interface, and may also be other interfaces, such as a notification center interface.
  • the portable electronic device 200 queries (step 803) the playback information stored last time by each smart multimedia playback device 250, and displays a playback control card.
  • the playback control card includes playback information and/or icons that can respond to user operations.
  • the mobile phone 407 inquires the current UTC timestamp of the local device that was last refreshed by the smart TV 111, and selects the playback information corresponding to the current UTC timestamp of the local device.
  • a play control card 409 is displayed on the scene intelligent interface 369, and the play control card 409 includes play information and/or icons that can respond to user operations.
  • the portable electronic device 200 can always store the playback information of the multimedia playback device 250, for example, using an external memory card connected to the internal memory module 205 or the external memory interface 203, so that the broadcast control card can be implemented.
  • Perpetual existence users prefer to obtain a broadcast control card with a certain timeliness. Therefore, this embodiment of the present application provides an implementation solution that only shows that the device status is online or online within a certain period of time in the contextual smart interface 369. Multimedia playback equipment (for example, within 30 minutes) play control card.
  • the online device displays the play control card 409 shown in FIG.
  • the play control card 409 shown in FIG. 5B or FIG. 5C is displayed.
  • the broadcast control card is not displayed.
  • the portable electronic device 200 creates (step 805) a long connection to the smart multimedia playback device 250 whose device status is online.
  • a long connection is relative to a short connection.
  • a short connection refers to disconnecting the connection after the device is connected and completing the data interaction
  • a long connection refers to the connection between the devices and the connection is maintained after the data interaction is completed.
  • the period for the smart multimedia playback device 250 to synchronously play information to the portable electronic device 200 is 30 minutes. If the smart TV 111 is forcibly cut off at a certain time within 30 minutes, and the mobile phone 407 is always on the control center interface 353, it will take about 30 minutes to determine that the smart TV 111 is offline.
  • the mobile phone 407 By establishing a long connection between the portable electronic device 200 and each intelligent multimedia playback device 250, the judgment can be speeded up. For example, after the smart TV 111 generates the broadcast control card 409, the mobile phone 407 establishes a long connection with the smart TV 111, and the mobile phone 407 sends the first long connection information to the smart TV 111 every 15 seconds. After the smart TV 111 receives the first long connection information Return the second long connection information to the mobile phone 407. If the mobile phone 407 does not receive the second long connection information within a certain period of time, indicating that the long connection is interrupted, the smart TV 111 is considered to be offline, and the device status of the smart TV 111 is modified to be offline.
  • the content of the persistent connection information is a status code, for example, the content of the first persistent connection information is "1", and the content of the second persistent connection information is "2". This method can reduce the transmitted data. quantity.
  • the content of the first persistent connection information is a request to obtain playback information
  • the content of the second persistent connection information is the playback information.
  • the portable electronic device 200 refreshes (step 807) the broadcast control card.
  • the broadcast control card needs to refresh the broadcast control card according to the change of the broadcast control information/device status/user location and other factors. Whether the broadcast control card exists/the content in the broadcast control card and the broadcast control card Sort of.
  • the portable electronic device 200 calls the local play information subscription interface. When the locally stored playback information changes, the portable electronic device receives a notification and refreshes the playback control card in the scene smart interface 369.
  • the broadcast control card does not need to be refreshed.
  • the portable electronic device 200 cancels calling the local playback information subscription interface, and disconnects the long connection with each online smart multimedia playback device 250.
  • the device status of all the local smart multimedia playback devices 250 is set to offline. If the current interface of the portable electronic device 200 is in the control center interface 353, and the broadcast control card is refreshed through the process of refreshing the broadcast control card in step 807, for example, the broadcast control card 409 of the smart TV 111 changes from that shown in FIG. 4C to As shown in Figure 4I or Figure 4J. If the current interface of the portable electronic device 200 is not the control center interface 353, the broadcast control card 409 shown in FIG. 5B or 5C will be displayed when the user input is entered into the control center interface 353 next time.
  • FIG. 9 shows the process of resuming the multimedia content played on the smart multimedia playback device 250 on the portable electronic device 200.
  • the portable electronic device 200 detects (step 901) to the user input.
  • the user input is that the user clicks on the replay icon 435 on the play control card 409.
  • the portable electronic device 200 collects (step 903) playback information.
  • the portable electronic device 200 checks the locally stored latest playback information of the smart multimedia playback device 250.
  • the portable electronic device 200 can also view the latest playback information of the smart multimedia playback device 250 stored locally.
  • the portable electronic device 200 reconnects to the device to obtain the latest playback information again. This way of reconnecting and acquiring the playback information can make the playback information up-to-date and improve the user experience.
  • the portable electronic device 200 opens (step 905) the video playback application, takes the playback information obtained in step 903 as input, and continues to play the multimedia content.
  • the multimedia content For example, if the type of multimedia content is video, the mobile phone 407 opens Huawei Video 32 to continue playing the video; for example, the type of multimedia content is audio, and the mobile phone 407 opens music 321 to continue playing the audio.
  • FIG. 10 shows the process of using the portable electronic device 200 to broadcast and control the multimedia playback device 250.
  • the portable electronic device 200 detects (step 1001) the user input acting on the icon on the play control card that can be operated by the user, for example, click the volume icon 421, click the play icon 423, drag the volume size display bar 425, drag the playback progress Display bar 427, click the fast-rewind icon 429, click the fast-forward icon 431, and click the next episode icon 433.
  • the portable electronic device 200 sends (step 1003) a play control command to the smart multimedia playback device 250 corresponding to the play control card, and receives a return code from the smart multimedia playback device 250 after the execution success/failure.
  • the portable electronic device 200 modifies the device status of the device to offline.
  • the portable electronic device 200 refreshes (step 1005) the play control card, which includes play information and icons on the play control card that can respond to user operations. For example, after the video playback status changes from playback to pause, the playback icon 423 becomes the pause playback icon 445; refresh the content on the playback control card, for example, after the user drags the volume size display bar 425, the volume size display bar 425 will be based on the adjusted volume Show the correct location.
  • the broadcast control card can optionally stop displaying, optionally one or more icons become unacceptable for user operations; optionally one or more icons change color, such as shown in Figure 4I Broadcast control card 409; Optionally, one or more icons stop displaying, such as the broadcast control card 409 shown in Figure 4J; Optionally, it prompts the user that the broadcast control fails, such as the prompt on the control center interface 353 shown in Figure 4K Block 451; optionally one or more combinations of the above embodiments.
  • the second device is configured to send first play information to the first device, where the first play information corresponds to the first multimedia content played by the second device, and the first multimedia content is played by the second device.
  • a device and a second device are in the same wireless network; the first device is configured to: display a first broadcast control card corresponding to the first multimedia content, the first broadcast control card includes a first control and a second control, and the second The control is used to control the playback of the first multimedia content; in response to the first user input acting on the first control, the first multimedia content is obtained from the server based on the first playback information, and the first multimedia content is resumed based on the first playback information.
  • Multimedia content Multimedia content.
  • a mobile phone receives first playback information sent by a TV, where the first playback information corresponds to a video played by the TV, and the mobile phone and the TV are connected to the same Wi-Fi;
  • the mobile phone displays a first play control card corresponding to the video, the first play control card includes a first control and a second control, the second control is used to control the playback of the video;
  • the mobile phone responds to The operation of the first control is to obtain the video from the server based on the video identifier in the first play information, and to replay the video based on the play progress in the first play information.
  • the embodiments of the present application provide an electronic device, including a memory and one or more processors; wherein the memory is used to store computer program code, and the computer program code includes computer instructions; when the computer instructions are processed When the device is executed, the electronic device executes the method of resuming the multimedia content between the devices.
  • the embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute a method for replaying multimedia content between devices.
  • the embodiments of the present application provide a schematic structural diagram of a portable electronic device 200, as shown in FIG. 11, including one or more processing units 1101, a storage unit 1102 and a communication unit 1103, which can execute The embodiment provides a method for replaying multimedia content.
  • the embodiments of the present application provide a schematic structural diagram of a portable electronic device 200.
  • the processing unit 1101 is a processor
  • the storage unit 1102 is a memory
  • the communication unit 1103 is a communication module
  • the portable electronic device 200 includes one or more processors 1201, a memory 1202, and a communication module 1203, which can execute the method for resuming multimedia content provided by the embodiment of the present application.
  • embodiments of the present application provide a schematic structural diagram of a smart multimedia playback device 250, as shown in FIG. 13, including one or more processing units 1301, storage units 1302 and communication units 1303, which can execute this The method for resuming multimedia content provided by the application embodiment.
  • embodiments of the present application provide a schematic structural diagram of a smart multimedia playback device 250.
  • the processing unit 1301 is a processor
  • the storage unit 1302 is a memory
  • the communication unit 1303 is a communication module, as shown in the figure
  • the intelligent multimedia playback device 250 includes one or more processors 1401, a memory 1402, and a communication module 1403, and can execute the method for resuming multimedia content provided by the embodiment of the present application.
  • the disclosed device and method may be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components may be divided. It can be combined or integrated into another device, or some features can be omitted or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate parts may or may not be physically separate.
  • the parts displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed to multiple different places. . Some or all of the units can be selected according to actual needs to achieve the objectives of the embodiments of the present application.
  • the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium.
  • the technical solutions of the embodiments of the present application are essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of a software product, and the software product is stored in a storage medium. It includes several instructions to make a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)
  • Indexing, Searching, Synchronizing, And The Amount Of Synchronization Travel Of Record Carriers (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

本申请实施例提供一种设备间多媒体内容续播的方法,能够在第二设备上续播在第一设备上播放的多媒体内容,使得多媒体内容的播放更为灵活,用户使用体验更好。具体方案为:第一设备接收第二设备发送的第一播放信息,其中,所述第一播放信息对应所述第二设备播放的第一多媒体内容,所述第一设备和所述第二设备处于同一无线网络;所述第一设备显示对应于所述第一多媒体内容的第一播控卡片,所述第一播控卡片包括第一控件和第二控件,所述第二控件用于控制所述第一多媒体内容的播放;所述第一设备响应作用于所述第一控件的第一用户输入,基于所述第一播放信息从服务器获取所述第一多媒体内容,并基于所述第一播放信息续播所述第一多媒体内容。

Description

一种设备间多媒体内容续播的方法
本申请要求在2020年3月26日提交中国国家知识产权局、申请号为202010225233.7的中国专利申请的优先权,发明名称为“一种设备间多媒体内容续播的方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。本申请要求在2020年5月18日提交中国国家知识产权局、申请号为202010419691.4的中国专利申请的优先权,发明名称为“一种设备间多媒体内容续播的方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及电子技术领域,尤其是一种设备间多媒体内容续播的方法。
背景技术
随着终端技术和物联网技术的不断发展,用户拥有越来越多种类和功能的电子设备。其中的一些电子设备可以用于播放多媒体内容(例如,图片、音频和视频等)。对于用户来说,在一个电子设备上播放的多媒体内容,能够在另一个电子设备上续播,将会提升用户的使用体验。
发明内容
本申请实施例提供一种设备间多媒体内容续播的方法,涉及电子技术领域,能够在设备间续播多媒体内容,使得多媒体内容的播放更为灵活,用户使用体验更好。为达到上述目的,本申请实施例采用如下技术方案:
第一方面,第一设备首先接收第二设备发送的第一播放信息,其中,第一播放信息对应于第二设备播放的第一多媒体内容,第一设备和第二设备处于同一无线网络。第一设备然后显示对应于第一多媒体内容的第一播控卡片,第一播控卡片包括第一控件和第二控件,其中,第二控件用于控制第一多媒体内容的播放。第一设备最后响应作用于第一控件的第一用户输入,基于第一播放信息从服务器获取第一多媒体内容,并基于第一播放信息续播第一多媒体内容。
例如,第一设备为手机,第二设备为智能电视,手机首先接收智能电视发送的第一播放信息,第一播放信息对应于智能电视播放的电视节目,其中手机和智能电视连接同一WLAN。手机显示对应于智能电视正在播放电视节目的第一播控卡片,其中第一播控卡片包括续播选项、播放选项和暂停播放选项,播放选项和暂停播放选项可以用于控制智能电视正在播放的电视节目。其中手机显示播控卡片可以是在息屏的时候手机亮起显示,还可以是接收用户的操作手势,在控制 中心界面显示。当手机响应于用户点击续播选项的用户输入,手机根据第一播放信息中的URL地址或多媒体内容标识获取电视节目的内容,并根据第一播放信息中的视频播放进度续播电视节目。通过这种设计,能够实现在第一设备上接续播放第二设备上播放的多媒体内容,能够提升用户的使用体验。
为了满足续播实时性的要求,在一种可能的设计中,第二设备同步第一播放信息到第二设备,包括:第二设备检测到第一播放信息发生变化;第二设备通过无线网络发送第一播放信息至第一设备。在一种可能的设计中,第二设备周期性同步第一播放信息到第二设备,包括:第二设备启动循环定时器;当循环定时器到达定时时间后,第二设备通过无线网络发送第一播放信息至第一设备。在一种可能的设计中,第二设备还可以基于第一设备的请求同步第一播放信息到第一设备,还包括:第一设备启动事件监听器,用于监听以下任一事件:第一设备解锁屏幕的事件,第一设备加入无线网络的事件,第一设备断开无线网络的事件;当事件监听器触发后,第一设备发送用于获取第一播放信息的请求;第二设备通过无线连接发送第一播放信息至第一设备。
在一种可能的设计中,第一设备显示对应于第一多媒体内容的第一播控卡片,包括:响应作用于第一设备的主界面上从左往右滑动至第一界面的滑动手势,第一设备在第一界面显示第一播控卡片。例如,第一界面为控制中心界面。通过在控制中心界面集中显示播控卡片,能给用户带来良好的视觉体验。且打开/关闭控制中心界面的操作便捷。
在一种可能的设计中,第二控件包括下列项中的至少一项:音量图标,音量大小显示条,播放图标,播放进度显示条,快退图标,快进图标,或下一集图标。通过这种设计,电子设备能够通过接收用户作用于第二控件的播控命令,控制第一多媒体内容的播放。
在一种可能的设计中,第一播放信息包括第一多媒体内容的标识和第一多媒体内容的播放进度。
在一种可能的设计中,第一播放信息还包括以下项中的至少一项:第一多媒体内容的源地址,第一多媒体内容的播放状态,第一多媒体内容的音量状态,或第一多媒体内容的播放音量。
通过这种设计,第一播放信息中包括的内容越多,越能够将在第二设备上播放的多媒体内容的信息在第一设备上提供给用户,能够带给用户更好的使用体验,用户能够看到更多关于第一多媒体内容的信息。
在一种可能的设计中,第一设备续播的第一多媒体内容的播放进度与第二设备播放的第一多媒体内容的播放进度相同。
通过这种设计,第一设备从相同的播放进度续播第一多媒体内容,用户不需要再调整播放进度,衔接更合适,能够带给用户更好的使用体验。
在一种可能的设计中,第一设备响应作用于第一控件的第一用户输入,打开用于播放第一多媒体内容的应用程序。
通过这种设计,第一设备实现在应用程序中续播第一多媒体内容。第一设备 还可选地在播控卡片上续播第一多媒体内容。
在一种可能的设计中,第一界面还显示有第二播控卡片,第二播控卡片对应于第三设备播放的第二多媒体内容。例如,控制中心界面还显示第二播控卡片,第二播控卡片对应于智能音箱播放的音频。通过这种方式,使得多张卡片可以在控制中心界面同时显示,便捷了用户的操作。
在一种可能的设计中,第二设备与第一区域关联,第三设备与第二区域关联,第一播控卡片和第二播控卡片的显示效果基于第一设备与第一区域和第二区域的位置关系确定。
在一种可能的设计中,第一播控卡片和第二播控卡片的显示效果基于第一设备与第一区域和第二区域的位置关系确定,包括:当第一设备位于第一区域,第一播控卡片在第一界面的显示位置位于第二播控卡片的显示位置的上方。
在一种可能的设计中,当第一设备位于第二区域,第二播控卡片在第一界面的显示位置位于第一播控卡片的显示位置的上方,且第一设备显示第一提示信息,第一提示信息用于提示是否在第三设备上续播第一多媒体内容。
例如,当智能电视处于第一房间,智能投影仪处于第二房间,当手机处于第一房间时,智能电视的播控卡片显示在智能投影仪的播控卡片的上方;当手机处于第二房间时,智能投影仪的播控卡片显示在智能电视的播控卡片的上方,且在用户停留一段时间后询问用户是否需要在智能投影仪上续播在智能电视上播放的多媒体内容。通过这种设计,能够使得用户在不同的区域以及不同区域的电子设备调整播控卡片的排列顺序,查看更为方便,使得用户的体验效果更好。
在一种可能的设计中,第一设备响应作用于第二控件的第二用户输入,发送播控命令至第二设备;第一设备未收到对应于播控命令的响应消息,第一设备显示第一提示信息,第一提示信息用于提示播控失败。
在一种可能的设计中,第一设备检测到与无线网络断开连接;第一设备显示对应于第二设备播放的第一多媒体内容的第三播控卡片,第三播控卡片包括第一控件,但不包括第二控件。
通过这种设计,第一播控卡片包括第一控件(例如,第一控件为续播选项),在第一设备断开网络连接后响应于作用于第一控件的输入还能够支持续播。在用户重新连接网络后,第一设备还可以生成播控卡片,此时能够通过第二控件对第一多媒体内容进行播放控制,但不支持续播功能,使得用户可以专注于第二设备(例如,智能电视),体验效果更好。
在一种可能的设计中,第一设备接收第二设备发送的第二播放信息,其中,第二设备正在同时播放第一多媒体内容和第三多媒体内容,第二播放信息对应于第二设备播放的第三多媒体内容;第一设备显示对应于第二设备播放的第一多媒体内容的第一播控卡片和对应于第三多媒体内容的第三播控卡片;第一设备响应于第三用户输入,同时续播第一多媒体内容和第三多媒体内容。
通过这种设计,在第二设备支持同时播放多个多媒体内容的情况下,第一设备能够显示多个播控卡片供用户操作。使得本申请能够适用于多个多媒体内容播 放的情况。
例如,第二设备的屏幕区域包括第一屏幕区域和第二屏幕区域,第一屏幕区域播放第一多媒体内容,第二屏幕区域播放第三多媒体内容,即,第一多媒体内容和第三多媒体内容同时在第二设备进行播放(例如,第二设备为电视机时,用户在电视上通过分屏观看第一多媒体内容和第三多媒体内容这两个视频节目)。此时,第一设备可显示对应于第二设备播放的第一多媒体内容的第一播控卡片和对应于第三多媒体内容的第三播控卡片。如果第一设备接收到第三用户输入,可以同时播放第一多媒体内容和第三多媒体内容(例如,第一设备为手机时,响应于第三用户输入用户在手机上通过分屏观看第一多媒体内容和第三多媒体内容这两个视频节目)。
在一种可能的设计中,第一设备接收第四设备发送的第三播放信息,其中,第四设备正在播放第一多媒体内容,第三播放信息对应于第四设备播放的第一多媒体内容;第一设备显示对应于第二设备和第四设备播放的第一多媒体内容的第四播控卡片。
在一种可能的设计中,第四设备播放的第一多媒体内容的播放进度和第二设备播放的第一多媒体内容的播放进度相同。
在一种可能的设计中,第一设备和第二设备登陆同一用户账户,例如华为账户,荣耀账户,Apple ID等。通过这种设计能够使得第一设备和第二设备之间的数据交互更为安全,保护用户的隐私。
在一种可能的设计中,无线网络为无线保真Wi-Fi无线网络。Wi-Fi技术是现有技术中实现电子设备间数据交互的常用技术手段,该手段还可以为蓝牙技术(Bluetooth,BT),近场通信技术(near field communication,NFC),超宽带技术(ultra wide band,UWB),红外技术(infrared,IR),ZigBee技术,通用2.4G/5G频段无线通信技术等。通过这些近场连接技术,使得数据不通过服务器和/或云服务进行交互,使得数据传输更为安全,同样也能够保护用户的隐私。
在一种可能的设计中,第一设备为手机,第二设备为电视。在一种可能的设计中,第一设备为手机,第二设备为智能音箱。在一种可能的设计中,第一设备为手机,第二设备为智能投影仪。在一种可能的设计中,第一设备为手机,第二设备为VR眼镜。
在一种可能的设计中,第一设备为平板,第二设备为电视。在一种可能的设计中,第一设备为平板,第二设备为智能音箱。在一种可能的设计中,第一设备为平板,第二设备为智能投影仪。在一种可能的设计中,第一设备为平板,第二设备为VR眼镜。
在一种可能的设计中,本申请还包括一种电子设备,电子设备包括存储器和一个或多个处理器;其中,存储器用于存储计算机程序代码,计算机程序代码包括计算机指令;当计算机指令被处理器执行时,使得电子设备执行设备间多媒体内容续播的方法。
在一种可能的设计中,本申请还包括一种计算机可读存储介质,包括计算机 指令,当计算机指令在电子设备上运行时,使得电子设备执行设备间多媒体内容续播的方法。
在一种可能的设计中,本申请还包括一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行设备间多媒体内容续播的方法。
第二方面,在一个系统中,第二设备被配置为:发送第一播放信息至第一设备,其中,第一播放信息对应第二设备播放的第一多媒体内容,第一设备和第二设备处于同一无线网络;第一设备被配置为:显示对应于第一多媒体内容的第一播控卡片,第一播控卡片包括第一控件和第二控件,第二控件用于控制第一多媒体内容的播放;响应作用于第一控件的第一用户输入,基于第一播放信息从服务器获取第一多媒体内容,并基于第一播放信息续播第一多媒体内容。
本申请的有益效果已在上述部分陈述,此处不再赘述。
附图说明
图1A示出了根据一些实施方案的示例性家庭场景的示意图;
图1B示出了根据一些实施方案的示例性应用程序的用户界面图;
图2A示出了根据一些实施方案的便携式电子设备的硬件结构图;
图2B示出了根据一些实施方案的智能多媒体播放设备的硬件结构图;
图3A示出了根据一些实施方案的便携式电子设备的示例性用户界面图;
图3B示出了根据一些实施方案的便携式电子设备检测到用户操作手势的示意图;
图3C示出了根据一些实施方案的便携式电子设备显示控制中心界面的示意图;
图4A示出了根据一些实施方案的用户观看智能电视的场景示意图;
图4B示出了根据一些实施方案的用户拿起手机进入控制中心界面的示意图;
图4C示出了根据一些实施方案的智能电视在情景智能界面中生成播控卡片的示意图;
图4D示出了根据一些实施方案的用户通过遥控器遥控智能电视的示意图;
图4E示出了根据一些实施方案的遥控生效后智能电视的播控卡片发生变化的示意图;
图4F示出了根据一些实施方案的用户通过播控卡片播控智能电视的示意图;
图4G示出了根据一些实施方案的播控生效后智能电视的播放信息发生变化的示意图;
图4H示出了根据一些实施方案的视频播放应用程序的示例性界面图;
图4I示出了根据一些实施方案的出现播控失败情况的示意图;
图4J示出了根据一些实施方案的出现播控失败情况的示意图;
图4K示出了根据一些实施方案的出现播控失败情况的示意图;
图4L示出了根据一些实施方案的播控卡片在锁屏界面显示的示意图;
图4M示出了根据一些实施方案的播控卡片在通知中心界面显示的示意图;
图5A示出了根据一些实施方案的用户离家后使用手机的场景示意图;
图5B示出了根据一些实施方案的一种用户离家后智能电视在情景智能界面中生成播控卡片的示意图;
图5C示出了根据一些实施方案的另一种用户离家后智能电视在情景智能界面中生成播控卡片的示意图;
图5D示出了根据一些实施方案的出现续播失败情况的示意图;
图5E示出了根据一些实施方案的用户离家后再次回家的场景示意图;
图5F示出了根据一些实施方案的用户离家后再次回家智能电视在情景智能界面生成播控卡片的示意图;
图6A示出了根据一些实施方案的当多个智能多媒体播放设备在情景智能界面生成播控卡片显示其中一个的示意图;
图6B示出了根据一些实施方案的当多个智能多媒体播放设备在情景智能界面生成播控卡片显示全部的示意图;
图6C示出了根据一些实施方案的用户在家庭场景中的移动轨迹示意图;
图6D示出了根据一些实施方案的在用户发生移动后播控卡片顺序发生变化的示意图;
图6E示出了根据一些实施方案的便携式电子设备提示用户在多媒体播放设备间续播多媒体内容的示意图;
图6F示出了根据一些实施方案的用户在多媒体播放设备间实现续播多媒体内容的场景示意图;
图6G示出了根据一些实施方案的多个智能多媒体播放设备在情景智能界面显示播控卡片的示意图;
图6H示出了根据一些实施方案的用户使用智能电视分屏观看视频的场景示意图;
图6I-6K示出了根据一些实施方案的用户使用智能电视分屏观看视频时在情景智能界面生成播控卡片的示意图;
图6L-6O示出了根据一些实施方案的用户在便携式电子设备上续播分屏播放的多媒体内容的示意图;
图6P示出了根据一些实施方案的在便携式电子设备上配置智能多媒体播放设备生成播控卡片功能的示意图;
图6Q示出了根据一些实施方案的在便携式电子设备上配置智能多媒体播放设备续播功能的示意图;
图6R-图6U示出了根据一些实施方案的多个智能多媒体播放设备播放同一个多媒体内容在情景智能界面生成播控卡片的示意图;
图7A示出了根据一些实施方案的本申请实施例的流程图;
图7B示出了根据一些实施方案的智能多媒体播放设备同步播放信息至便携式电子设备的流程图;
图7C示出了根据一些实施方案的智能多媒体播放设备同步播放信息至便携 式电子设备的流程图;
图7D示出了根据一些实施方案的便携式电子设备采集智能多媒体播放设备播放信息的流程图;
图7E示出了根据一些实施方案的便携式电子设备和智能多媒体播放设备间数据交互的示例图;
图8示出了根据一些实施方案的便携式电子设备显示并刷新播控卡片的流程图;
图9示出了根据一些实施方案的便携式电子设备续播多媒体内容的流程图;
图10示出了根据一些实施方案的便携式电子设备播控智能多媒体播放设备的流程图;
图11-12示出了根据一些实施方案的便携式电子设备的结构示意图;
图13-14示出了根据一些实施方案的智能多媒体播放设备的结构示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行描述。其中,在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;本文中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,在本申请实施例的描述中,“多个”是指两个或多于两个。
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。
随着终端技术和物联网技术的不断发展,用户拥有越来越多种类和功能的智能电子设备,这些智能电子设备在具有数据处理功能的同时还具有通信功能。在一些可能的实施方案中,智能多媒体播放设备是一种可以播放多媒体内容(例如图片,音频,视频等)的智能电子设备,例如智能音箱,智能电视,智能投影仪,智能VR眼镜,智能车载显示屏等。多媒体内容可选地存储在智能多媒体播放设备上,还可选地由其他智能电子设备与智能多媒体播放设备共享,还可选地为智能多媒体播放设备从服务器获取。
这些智能多媒体播放设备在能够播放多媒体内容外,还能够通过其通信功能与其他智能电子设备进行数据交互。用户可以通过便携式电子设备(例如手机,平板,可穿戴设备等)对智能多媒体播放设备进行控制和/或管理。在一些可能的实施方案中,智能多媒体播放设备也可以是便携式电子设备的一种。
在一些可能的实施方案中,智能多媒体播放设备能够登陆账户,当便携式电子设备与该智能多媒体播放设备登陆相同的账户,设备间能够进行数据交互。在另一些实施方案中,智能多媒体播放设备不能够登陆账户,便携式电子设备可选 地不需要验证账户,与该设备进行数据交互。
在一些可能的实施方案中,智能多媒体播放设备可选地能够支持播放一种类型的多媒体内容,例如智能音箱能够支持播放音频文件。在另一些实施方案中,智能多媒体播放设备能够支持播放多种类型的多媒体内容,例如智能电视能够支持播放图片,音频文件和视频文件。
可以理解的是,建立设备间的连接关系是进行数据交互的前提。现有技术中,出于安全和设备成本因素考虑,智能多媒体播放设备通常包括无线通信模块,并通过该无线通信模块与其他智能多媒体播放设备和/或便携式电子设备建立近场连接。建立近场连接后的设备间能够进行数据交互。建立近场连接的技术包括但不局限于:无线局域网(wireless local area network,WLAN(如无线保真技术(wireless fidelity,Wi-Fi)),蓝牙技术(Bluetooth,BT),近场通信技术(near field communication,NFC),超宽带技术(ultra wide band,UWB),红外技术(infrared,IR),ZigBee技术,通用2.4G/5G频段无线通信技术等。
在一些可能的实施方案中,近场连接的一种表现形式为数据交互在设备间进行,可选地为设备间直接传输,可选地为设备间间接传输。这种交互方式使得数据不通过云平台或服务器进行传输。近场连接能够在一定程度上保证数据的安全,尤其适用于传输一些涉及用户隐私的数据。
本申请实施例介绍了一种设备间多媒体内容续播的方法,下面将以家庭场景作为示例性场景进行说明,以WLAN作为一种建立近场连接的示例性技术。
在一些可能的实施方案中,家庭场景可选地被划分为一个或多个区域,其中的一个或多个区域可选地包括一个或多个智能多媒体播放设备。图1A示出了一个示例性家庭场景100,该家庭场景100可选地被划分为五个区域:第一房间110,第二房间120,第三房间130,第四房间140和连接以上房间的走廊150。其中,就智能多媒体播放设备的种类和数量而言,第一房间110可选地包括智能电视111和智能音箱113,第二房间120可选地包括智能电视121和智能音箱123,第三房间130可选地包括智能电视131,第四房间140可选地包括智能投影仪141和智能音箱143。以上智能多媒体播放设备处于同一WLAN中且该WLAN可选地由图1A中第四房间140中的路由器145提供。
在一些可能的实施方案中,应用程序作为控制和/或管理智能多媒体播放设备的方式,安装在用户的便携式电子设备中。下面将以华为技术有限公司(Huawei Technologies Co.,Ltd)提供的“智慧生活”应用程序为例进行说明。可以理解的是,该应用程序除了用于控制和/或管理智能多媒体播放设备外,还可以用于控制和/或管理其他类型的智能电子设备,例如智能家居设备。图1B示出了根据一些实施方案的“智慧生活”应用程序的示例性用户界面图151。
用户界面151可选地包括家庭场景名称153(此处的示例性家庭场景名称153为“我的家”)。当便携式电子设备检测到用户点击位于家庭场景名称153后的图标155的操作,应用程序可选地供用户修改家庭场景名称153,还可选地供用户通过“房间管理”选项设置家庭场景100中的房间,例如添加房间,删除房间, 更改房间名称。
在一些可能的实施方案中,这里所说的房间是根据现实中的房间生成的,例如用户在“智慧生活”应用程序中建立家庭场景100的栅格地图/点云地图后计算出的房间。在另一些实施方案中,这里所说的房间是虚拟的,是用户根据自己的需求建立的虚拟位置标签。家庭场景100中的智能电子设备具有可供用户配置的虚拟位置标签,并且具有相同虚拟位置标签的智能电子设备处于同一虚拟房间中。
用户界面151可选地包括指示家庭场景100中智能电子设备数量和智能场景数量的指示符157(此处家庭场景100的示例为“8个设备|12个智能场景”)。
用户界面151可选地包括“家居”图标159,“商城”图标161,“智能”图标163和“我的”图标165共四个可响应用户操作的图标,当便携式电子设备检测到用户点击上述图标的操作,会跳转到该图标对应的界面。图1B示出了“家居”图标159对应的界面,此时“家居”图标159可选地被选中(此处图标被选中的示例性表现为“家居”图标159被填充)。
在“家居”图标159对应的界面中,每个在家庭场景100中且与“智慧生活”应用程序相关联的智能电子设备会生成一张卡片,可选地供用户在卡片中查看设备名称、设备状态以及所处的房间。其中,设备名称是可选的,是可以根据用户喜好自行设置的。
在一些可能的实施方案中,设备状态可选地包括在线状态和离线状态两种,在线状态可选地指该设备通电且与处于WLAN中,例如图1A家庭场景100中的智能电视111通电且接入路由器145提供的WLAN,智能电视111可选地处于待机状态/播放状态/暂停状态。离线状态可选地指该设备断电和/或未处于WLAN中,例如图1A中家庭场景100中的智能电视111处于断电状态和/或智能电视111未接入路由器145提供的WLAN。
下面介绍示例性家庭场景100中的智能多媒体播放设备在“家居”图标159对应的界面中对应的卡片,其中:
位于第一房间110的智能电视111,对应于图1B中示出的卡片167,其中“第一房间的电视”为该智能电视111的名称,“在线”为其设备状态,“第一房间”为其所处的房间;
位于第二房间120的智能电视121,对应于图1B中示出的卡片169,其中“第二房间的电视”为该智能电视121的名称,“在线”为其设备状态,“第二房间”为其所处的房间;
位于第三房间130的智能电视131,对应于图1B中示出的卡片171,其中“第三房间的电视”为该智能电视131的名称,“在线”为其设备状态,“第三房间”为其所处的房间;
位于第一房间110的智能音箱113,对应于图1B中示出的卡片173,其中“第一房间的音箱”为该智能音箱113的名称,“离线”为其设备状态,“第一房间”为其所处的房间;
位于第二房间120的智能音箱123,对应于图1B中示出的卡片175,其中“第二房间的音箱”为该智能音箱123的名称,“离线”为其设备状态,“第二房间”为其所处的房间;
位于第四房间140的智能音箱143,对应于图1B中示出的卡片177,其中“第四房间的音箱”为该智能音箱143的名称,“离线”为其设备状态,“第四房间”为其所处的房间;
位于第四房间140的智能投影仪141,对应于图1B中示出的卡片179,其中“第四房间的投影仪”为该智能投影仪141的名称,“离线”为其设备状态,“第四房间”为其所处的房间。
除了智能多媒体播放设备外的智能电子设备也可以在“家居”图标159对应的界面中生成卡片,例如位于第四房间140的路由器145对应于图1B中示出的卡片181,其中“华为路由器”为该路由器145的名称,“在线”为其设备状态,“第四房间”为其所处的房间。
在“商城”图标161对应的界面中,用户可以查看和/或购置市面上的智能多媒体播放设备和其他类型的智能电子设备。
为了实现智能电子设备的智能化运行,提高用户的使用体验,“智慧生活”应用程序可选地提供给用户设置智能场景的功能,例如回家场景(用户回家后打开智能电视111和智能音箱113),离家场景(用户离家后关闭所有智能多媒体播放设备)。
在一些可能的实施方案中,智能场景按照执行方式可选地分为手动场景和自动场景。手动场景指用户设置场景参数后,智能场景需要用户手动启动/停止。自动场景指在用户设置场景参数后,智能场景根据一些条件(连接/断开WLAN、当地时间等)自动启动/停止。场景参数可选地为一个或多个设备的启停和/或运行参数。
在“智能”图标163对应的界面中,“智慧生活”应用程序可选地供用户查看现有智能场景,可选地供用户添加/删除智能场景,可选地供用户设置一个或多个智能场景的场景参数。
在“我的”图标163对应的界面中,“智慧生活”应用程序供用户进行账户的相关设置,例如登陆账户,修改账户,退出登陆账户等。
在一些可能的实施方案中,当便携式电子设备检测到用户点击“更多”图标183的操作,会出现更多选项,例如“添加设备”,“创建智能”和“连接三方平台”。
“添加设备”选项可选地供用户添加并关联新的智能电子设备。
“共享设备”选项可选地供用户将家庭场景100中的一个或多个智能电子设备的控制权分享给其他用户,使得其他用户对分享后的一个或多个智能电子设备进行管理和/或控制,从而满足家庭场景100满足多用户使用的需求。
“连接三方平台”选项可选地供用户将其他用于管理家庭智能设备的应用程序中的账户关联到“智慧生活”应用程序中,从而使得“智慧生活”应用程序能够管理更多的智能电子设备。
上面介绍了本申请的示例性家庭场景100和示例性用于控制和/或管理智能多媒体播放设备的应用程序的界面示意图,下面将对便携式电子设备和智能多媒体播放设备的硬件结构进行说明。
在一些可能的实施方案中,便携式电子设备包括但不局限于手机,平板电脑,智能穿戴设备(例如耳机,手表,手环)等。
图2A示出了根据一些实施方案的便携式电子设备200的结构示意图。便携式电子设备200可以包括处理器201,外部存储器接口203,内部存储器205,通用串行总线(universal serial bus,USB)接口207,充电管理模块209,电源管理模块211,电池213,天线1,天线2,移动通信模块215,无线通信模块217,音频模块219,扬声器219A,受话器219B,麦克风219C,耳机接口219D,传感器模块221,摄像头223以及显示屏225等。
可以理解的是,本申请实施例示意的结构并不构成对便携式电子设备200的具体限定。在本申请另一些实施例中,便携式电子设备200可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
在一些可能的实施方案中,手机可以包括处理器201,外部存储器接口203,内部存储器205,通用串行总线(universal serial bus,USB)接口207,充电管理模块209,电源管理模块211,电池213,天线1,天线2,移动通信模块215,无线通信模块217,音频模块219,扬声器219A,受话器219B,麦克风219C,耳机接口219D,传感器模块221,摄像头223以及显示屏225等。
在一些可能的实施方案中,平板电脑可以包括处理器201,外部存储器接口203,内部存储器205,通用串行总线(universal serial bus,USB)接口207,充电管理模块209,电源管理模块211,电池213,无线通信模块217,音频模块219,扬声器219A,受话器219B,麦克风219C,耳机接口219D,传感器模块221,摄像头223以及显示屏225等。
处理器201可以包括一个或多个处理单元,例如:处理器201可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
处理器201中还可以设置存储器,用于存储指令和数据。在一些可能的实施方案中,处理器201中的存储器为高速缓冲存储器。该存储器可以保存处理器201刚用过或循环使用的指令或数据。如果处理器201需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器201的等待时间,因而提高了系统的效率。
在一些可能的实施方案中,处理器201可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated  circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
充电管理模块209用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块209可以通过USB接口207接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块209可以通过便携式电子设备200的无线充电线圈接收无线充电输入。充电管理模块209为电池213充电的同时,还可以通过电源管理模块211为便携式电子设备200供电。
电源管理模块211用于连接电池213,充电管理模块209与处理器201。电源管理模块211接收电池213和/或充电管理模块209的输入,为处理器201,内部存储器205,外部存储器,显示屏225,摄像头223,和无线通信模块217等供电。电源管理模块211还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块211也可以设置于处理器201中。在另一些实施例中,电源管理模块211和充电管理模块209也可以设置于同一个器件中。
便携式电子设备200的无线通信功能可以通过天线1,天线2,移动通信模块215,无线通信模块217,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。便携式电子设备200中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块215可以提供应用在便携式电子设备200上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块215可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块215可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块215还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些可能的实施方案中,移动通信模块215的至少部分功能模块可以被设置于处理器201中。在一些可能的实施方案中,移动通信模块215的至少部分功能模块可以与处理器201的至少部分模块被设置在同一个器件中。
无线通信模块217可以提供应用在便携式电子设备200上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(Bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块217可以 是集成至少一个通信处理模块的一个或多个器件。无线通信模块217经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器201。无线通信模块217还可以从处理器201接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些可能的实施方案中,便携式电子设备200的天线1和移动通信模块215耦合,天线2和无线通信模块217耦合,使得便携式电子设备200可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenith satellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
便携式电子设备200通过GPU,显示屏225,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏225和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器201可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏225用于显示图像,视频等。显示屏225包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些可能的实施方案中,便携式电子设备200可以包括一个或多个显示屏225。
便携式电子设备200可以通过ISP,摄像头223,视频编解码器,GPU,显示屏225以及应用处理器等实现拍摄功能。
ISP用于处理摄像头223反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些可能的实施方案中,ISP可以设置在摄像头223中。
摄像头223用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。 ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些可能的实施方案中,便携式电子设备200可以包括一个或多个摄像头223。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当便携式电子设备200在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。便携式电子设备200可以支持一种或多种视频编解码器。这样,便携式电子设备200可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
外部存储器接口203可以用于连接外部存储卡,例如Micro SD卡,实现扩展便携式电子设备200的存储能力。外部存储卡通过外部存储器接口203与处理器201通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器205可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器201通过运行存储在内部存储器205的指令,从而执行便携式电子设备200的各种功能应用以及数据处理。内部存储器205可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储便携式电子设备200使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器205可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。
便携式电子设备200可以通过音频模块219,扬声器219A,受话器219B,麦克风219C,耳机接口219D,以及应用处理器等实现音频功能。例如播放音频文件,录音等。
音频模块219用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块219还可以用于对音频信号编码和解码。在一些可能的实施方案中,音频模块219可以设置于处理器201中,或将音频模块219的部分功能模块设置于处理器201中。
扬声器219A,也称“喇叭”,用于将音频电信号转换为声音信号。便携式电子设备200可以通过扬声器219A收听音乐,或收听免提通话。
受话器219B,也称“听筒”,用于将音频电信号转换成声音信号。当便携式电子设备200接听电话或语音信息时,可以通过将受话器219B靠近人耳接听语音。
麦克风219C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风219C发声,将声音信号输入到麦克风219C。便携式电子设备200可以设置至少一个麦克风219C。在另一些实施例中,便携式电子设备200可以设置两个麦克风219C,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,便携式电子设备200还可 以设置三个,四个或更多麦克风219C,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。
耳机接口219D用于连接有线耳机。耳机接口219D可以是USB接口207,也可以是3.5mm的开放移动便携式电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
传感器模块221可以包括压力传感器,陀螺仪传感器,气压传感器,磁传感器,加速度传感器,距离传感器,接近光传感器,指纹传感器,温度传感器,触摸传感器,环境光传感器,骨传导传感器等。
当然,上述便携式电子设备200还可以包括按键、马达、指示器以及SIM卡接口等一项或多项器件,本申请实施例对此不做任何限制。
图2B示出了根据一些实施方案的智能多媒体播放设备250的结构示意图。智能多媒体播放设备250可以包括处理器251,外部存储器接口253,内部存储器255,通用串行总线(universal serial bus,USB)接口257,充电管理模块259,电源管理模块261,电池263,天线,无线通信模块265,音频模块267,扬声器267A,麦克风267B,耳机接口267C,传感器模块269,摄像头271以及显示屏273等。
可以理解的是,本申请实施例示意的结构并不构成对智能多媒体播放设备250的具体限定。在本申请另一些实施例中,智能多媒体播放设备250可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
在一些可能的实施方案中,智能音箱可选地包括有线蓝牙音箱和无线蓝牙音箱。有线蓝牙音箱可以包括处理器251,外部存储器接口253,内部存储器255,充电管理模块259,电源管理模块261,无线通信模块265,音频模块267,扬声器267A,麦克风267B,传感器模块269等。无线蓝牙音箱相比于有线蓝牙音箱,除了包括上述部件,还可以包括电池263等。
在一些可能的实施方案中,智能电视可以包括处理器251,外部存储器接口253,内部存储器255,通用串行总线(universal serial bus,USB)接口257,充电管理模块259,电源管理模块261,无线通信模块265,音频模块267,扬声器267A,麦克风267B,耳机接口267C,传感器模块269,摄像头271以及显示屏273等。
处理器251可以包括一个或多个处理单元,例如:处理器251可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
处理器251中还可以设置存储器,用于存储指令和数据。在一些可能的实施 方案中,处理器251中的存储器为高速缓冲存储器。该存储器可以保存处理器251刚用过或循环使用的指令或数据。如果处理器251需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器251的等待时间,因而提高了系统的效率。
在一些可能的实施方案中,处理器251可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
充电管理模块259用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块259可以通过USB接口257接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块259可以通过智能多媒体播放设备250的无线充电线圈接收无线充电输入。充电管理模块259为电池263充电的同时,还可以通过电源管理模块261为智能多媒体播放设备250供电。
电源管理模块261用于连接电池263,充电管理模块259与处理器251。电源管理模块261接收电池263和/或充电管理模块259的输入,为处理器251,内部存储器255,外部存储器,显示屏273,摄像头271和无线通信模块265等供电。电源管理模块261还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块261也可以设置于处理器251中。在另一些实施例中,电源管理模块261和充电管理模块259也可以设置于同一个器件中。
智能多媒体播放设备250的无线通信功能可以通过天线,无线通信模块265,等实现。无线通信模块265可以提供应用在智能多媒体播放设备250上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(Bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块265可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块265经由天线接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器251。无线通信模块265还可以从处理器251接收待发送的信号,对其进行调频,放大,经天线转为电磁波辐射出去。
智能多媒体播放设备250的显示屏273通过显示驱动芯片进行驱动,用于显示图像,视频等。显示屏273包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light  emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些可能的实施方案中,智能多媒体播放设备250可以包括一个或多个显示屏273。
外部存储器接口253可以用于连接外部存储卡,例如Micro SD卡,实现扩展智能多媒体播放设备250的存储能力。外部存储卡通过外部存储器接口253与处理器251通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器255可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器251通过运行存储在内部存储器255的指令,从而执行智能多媒体播放设备250的各种功能应用以及数据处理。内部存储器255可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储智能多媒体播放设备250使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器255可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。
智能多媒体播放设备250可以通过音频模块267,扬声器267A,麦克风267B,耳机接口267C,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块267用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块267还可以用于对音频信号编码和解码。在一些可能的实施方案中,音频模块267可以设置于处理器251中,或将音频模块267的部分功能模块设置于处理器251中。
扬声器267A,也称“喇叭”,用于将音频电信号转换为声音信号。智能多媒体播放设备250可以通过扬声器267A播放多媒体内容。
麦克风267B,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风267B发声,将声音信号输入到麦克风267B。智能多媒体播放设备250可以设置至少一个麦克风267B。在另一些实施例中,智能多媒体播放设备250可以设置两个麦克风267B,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,智能多媒体播放设备250还可以设置三个,四个或更多麦克风267B,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。
传感器模块269可以包括压力传感器,陀螺仪传感器,磁传感器,距离传感器,接近光传感器,指纹传感器,触摸传感器,环境光传感器等。
上面介绍了便携式电子设备200和智能多媒体播放设备250的硬件结构,下面将介绍本申请的软件实现,以手机作为便携式电子设备200的一个实施例进行说明。
图3A示出了根据一些实施方案的便携式电子设备200的示例性用户界面 301,该用户界面301可选地显示在便携式电子设备200的显示屏225上。
在一些可能的实施方案中,用户界面301可选地包括以下元件或其子集或其超集:
●固定在用户界面301顶部状态栏且用于指示本机状态的图标:一个或多个信号强度(例如移动网络,Wi-Fi)指示符303,当前时间305,用于指示电池213电量的电量指示符307;
●主界面的应用程序:时钟309,日历311,图库313,备忘录315,文件管理317,电子邮件319,音乐321,钱包323,华为视频325,运动健康327,天气329,浏览器331,智慧生活333,设置335,录音机337,应用商城339;
●固定在用户界面301底部的常应用程序:相机341,通讯录343,电话345,信息347;
●指示当前所在界面的指示符349。
可以理解的是,主界面的应用程序包括时钟309,日历311,图库313,备忘录315,文件管理317,电子邮件319,音乐321,钱包323,华为视频325,运动健康327,天气329,浏览器331,智慧生活333,设置335,录音机337,应用商城339。当用户界面301处于其他用于显示应用程序的界面,指示当前所在界面的指示符349指向切换后的界面,固定在用户界面301顶部状态栏的图标不变,固定在用户界面301底部的常应用程序不变。
可以理解的是,上述的应用程序及其显示的图标仅仅是一个示例,还可以为其他应用程序和/或图标。
在一些可能的实施方案中,当便携式电子设备200检测到用户点击应用程序的操作,会启动应用程序并显示其运行界面。例如便携式电子设备200检测到用户点击智慧生活图标333的操作,可选地显示图1B示出的示例性用户界面151。
卡片是一种用于显示信息的且具有封闭外形的交互设计模块,通常用于显示系统/应用程序的信息,可选地提供一种便捷的方式供用户与系统/应用程序交互。在视觉设计上卡片具有灵活的尺寸。使用卡片作为信息载体,操作便捷,能够提高用户的使用体验。
可以理解的是,在安装不同系统的多个设备间使用卡片,还能够提高不同系统间的兼容性。每个设备的系统根据自己的规则生成卡片外形,对采用相同数据结构的数据进行处理,在卡片中显示数据。
在一些可能的实施方案中,控制中心界面/通知中心界面可选地提供给用户设备的系统信息(例如时间,天气,电量),可选地提供给用户应用程序的信息(例如应用程序推送的通知,应用程序的状态);可选地供用户在控制中心界面/通知中心界面完成一些快捷操作。在一些可能的实施方案中,卡片可选地在便携式电子设备200的控制中心界面/通知中心界面显示。本申请实施例以控制中心界面为例进行说明。
在一些可能的实施方案中,控制中心界面可以通过检测用户的手势触发并显示。例如图3B中的便携式电子设备200检测到在用户界面301从左侧向右侧的 滑动手势,得到图3C中的示例性控制中心界面353。
可以理解的是,图3B中的手势是控制中心界面/通知中心界面的一个示例性触发方式,还可以为其他的手势类型(例如捏合,长按,旋转,用户自定义手势,隔空手势等),还可以为其他触发方向(例如从上侧向下侧,从下侧向上侧)。除手势触发外,触发方式还可以为按键触发,语音识别触发,图像识别触发和脑电波触发等。
下面将对图3C中的控制中心界面353中的内容进行一些说明。
控制中心界面353可选地包括问候语标签355,用户头像357,本地或在线内容搜索框359。
控制中心界面353可选地包括一些应用程序的快捷操作,例如:“扫一扫”361,“付款码”363,“手机充值”365。例如,“手机充值”365可选地与应用程序钱包323关联。控制中心界面353还包括展示更多快捷操作的“更多”图标367。这些支持快捷操作的应用程序,可选地为用户手动选择的,可选地为用户最近使用的,可选地为用户使用程序频率较高的。
控制中心界面353可选地包括情景智能界面369以及在情景智能界面369中由系统/应用程序生成的一张或多张具有封闭外形的情景智能卡片。情景智能界面369可选地能够自动刷新情景智能卡片,例如添加/删除卡片,例如修改卡片中的内容;刷新方式可选地为当用户界面301为控制中心界面353时刷新,还可选地为后台刷新。
在一些可能的实施方案中,情景智能卡片可选地为应用使用详情卡片371,该应用使用详情卡片371提供给用户便携式电子设备200的总使用时间和各应用程序的使用比例。
在一些可能的实施方案中,情景智能卡片可选地为停车卡片373,该停车卡片373反映用户的出行工具的停放地点,停车时长,距离用户,局部地图以及出行工具在地图中的定位。该停车卡片373还可选地包括“导航”图标375。当便携式电子设备200检测到用户点击“导航”图标375的操作,便携式电子设备200打开地图软件并指引用户到达停车位置。
在一些可能的实施方案中,情景智能卡片中的内容还包括“更多”图标377,当便携式电子设备200检测到用户点击“更多”图标377的操作,弹出选项表,提供给用户更多操作情景智能卡片的选择,选项表中的选项可选地包括下面选项或其子集或其超集:忽略本次,分享,置顶,锁屏时显示,取消订阅,在其他界面显示等。
上面首先说明了情景智能界面369中的内容,再对一些示例性的情景智能卡片进行了展示。下面将说明智能播放多媒体设备250的使用场景和在情景智能界面369中对应生成的情景智能卡片。
图4A示出了家庭场景100中,用户正在观看第一房间110中的智能电视111的场景示意图,此时智能电视111正在通过华为视频播放《勇敢地跨步》。这里的华为视频可以和手机侧的应用程序华为视频325相同,还可以为适用于智能电 视111的华为视频的版本,还可以为其他视频播放应用程序。图4A中的智能电视111示例性地显示了《勇敢地跨步》其中的一帧401。图4A还显示了智能电视111的播放图标403(此时的播放状态为播放,播放状态还可选地为暂停,播放状态还可选地为缓冲中),播放进度显示条405和滑块405A,滑块405A相对于播放进度显示条405的位置指示了智能电视111上的视频《勇敢地跨步》的播放进度。此时智能电视111连接路由器145提供的WLAN。
图4B示出了用户拿起手机407,此时手机407也处于路由器145提供的WLAN中。用户希望能够在手机407上续播在智能电视111上播放的视频《勇敢地跨步》。本申请实施例提供的一种设备间多媒体内容续播的方法,能够满足用户的这种需求。图4C示出了智能电视111在情景智能界面369对应的示例性播控卡片409。下面将对播控卡片409的内容进行说明。
播控卡片409可选地包括用于播放多媒体内容的应用程序的名称411,对应的的图标413,此处示例性地使用华为视频325作为播放视频的应用程序并使用华为视频325对应的图标。
播控卡片409可选地包括多媒体内容的名称415,多媒体内容的关联图片417,其中关联图片可选地为多媒体内容的封面图,还可选地为多媒体内容的其中一帧,还可选地为手机407接收用户设定的图片,此处对应于智能电视111播放的视频《勇敢地跨步》和其视频封面图,例如视频封面图包括一个骑单车的人。可以理解的是,多媒体内容的关联图片417可以是不变的;可以是持续变化的,此时相当于在播控卡片409中播放《勇敢地跨步》。
播控卡片409可选地包括智能多媒体播放设备250的名称419,此处示例性地对应于智能电视111的名称“第一房间的电视”。
播控卡片409可选地包括音量图标421。当播控卡片409显示音量图标421时,智能多媒体播放设备250可以播放多媒体内容对应的音频(例如通过内置扬声器267A,外接耳机,外接音箱等),例如,智能电视111在播放视频画面的同时播放视频对应的音频。音量图标421可选地为可接收用户操作的图标,当手机407检测到用户点击音量图标421的操作,将会出现图4F示出的静音图标441,此时多媒体内容可选地正常播放,多媒体内容对应的音频不能够播放。
播控卡片409可选地包括播放图标423。当播控卡片409显示播放图标423时,智能电视111播放多媒体内容。播放图标423可选地为可响应用户操作的图标,当手机407检测到用户点击播放图标423的操作,将会出现图4F示出的暂停播放图标445,此时多媒体内容暂停播放。
播控卡片409可选地包括音量大小显示条425。该音量大小显示条425可选地通过滑块425A显示当前音量占最大音量的百分比,还可选地显示可量化音量(例如50分贝)。音量大小显示条425可选地为可响应用户操作的图标,例如手机407接收用户作用于滑块425A的拖动手势,实现音量的调节。在一些可能的实施方案中,当播控卡片409出现静音图标441时,滑块425A可选地显示在音量大小显示条425的最左侧,在出现音量图标421后恢复原先的位置。
播控卡片409可选地包括播放进度显示条427。该播放进度显示条427可选地通过滑块427A以时间作为单位(例如秒,分)显示播放进度,还可选地以比例显示播放进度。播放进度显示条427可选地为可响应用户操作的图标,例如接收用户作用于滑块427A的拖动手势,实现播放进度的调节。
播控卡片409可选地包括快退图标429。例如,当手机407检测到用户点击快退图标429的操作,播放进度后退到当前视频帧的前一帧或多帧并继续播放视频,播放进度显示条425上的滑块425A也会向左滑动。快退图标429可选地识别用户的点按操作,手机407每检测到用户点击快退图标429的操作,就后退一次视频进度。快退图标429可选地识别用户的长按操作,手机407检测到用户按下快退图标429的操作,记录长按时间直到用户抬起,计算需要后退的视频帧数,可选地在长按的过程中后退播放进度,可选地在长按结束后后退播放进度。
播控卡片409可选地包括快进图标431。例如,当手机407检测到用户点击快进图标431的操作,播放进度前进到当前视频帧的后一帧或多帧并继续播放视频,播放进度显示条425上的滑块425A也会向右滑动。快进图标431可选地识别用户的点按操作,手机407每检测到用户点击快进图标431的操作,就前进一次视频进度。快进图标431可选地识别用户的长按操作,手机407检测到用户按下快进图标431的操作,记录长按时间直到用户抬起,计算需要前进的视频帧数,可选地在长按的过程中前进播放进度,可选地在长按结束后前进播放进度。
播控卡片409可选地包括下一集图标433。例如,当手机407检测到用户点击下一集图标433的操作,智能电视111将播放下一个视频,播控卡片409将刷新并显示智能电视111当前播放视频的播放信息。下一个视频可选地为同一个剧集的下一集,可选地为其他根据视频播放应用程序(华为视频325)推荐的下一个视频,可选地为用户自己设定的下一集。
播控卡片409可选地包括续播图标435。例如,当手机407检测到用户点击续播图标435的操作,可选地为手机407进入视频播放应用程序(华为视频325),续播在智能电视111上正在播放的视频。在一些可能的实施方案中,智能电视111在手机407续播视频后不发生变化,继续播放当前正在播放的视频。在一些可能的实施方案中,智能电视111在手机407续播视频后结束播放视频。在一些可能的实施方案中,智能电视111在手机407续播视频后,智能电视111/手机407上提示用户是否需要结束播放在智能电视111上播放的视频。
播控卡片409可选地包括“更多”图标377。当手机407检测到用户点击“更多”图标377的操作,可选地显示下面选项或其子集或其超集:忽略本次,分享,置顶,锁屏时显示,取消订阅,在其他界面显示等。
图4L示出了播控卡片409在锁屏时显示的示例性界面。图4L示出了手机407的锁屏界面453,锁屏界面453包括播控卡片409,还包括提示手机407处于锁屏界面453的指示符455,指示符455中的内容示例性地为“滑动解锁”。
可以理解的是,播控卡片409为一个示例性实施例,在另一些实施例中还可选地具有更多/更少的播放信息,可选地具有播放信息不同的命名,可选地播放 信息以不同的样式和/或布局呈现。
在一些可能的实施方案中,图4M示出了播控卡片409在通知中心界面457显示的示例性界面图。通知中心界面457包括播控卡片409。该通知中心界面457可以在图3A中示出的用户界面301中,通过手机407检测用户从上往下的滑动手势得到。
图4D-图4E示出了智能电视111上的播放信息发生变化后(例如播放进度发生变化,音量发生变化),播控卡片409上的显示的播放信息也会跟着变化的过程。
在一些可能的实施方案中,智能电视111在接收用户遥控器遥控指令后,一些播放信息会发生变化。图4D示出了智能电视111在接收遥控器遥控指令后的播放进度显示条405,播放进度显示条405上的滑块405A,音量图标437,音量大小显示条439,音量大小显示条439上439的滑块439A。相比于图4C示出的对应于图4B中智能电视111的播控卡片409,可以看出智能电视111的播放进度和音量发生变化。智能电视111在播放信息发生变化后会通过无线通信模块265将播放信息同步至手机407。图4E示出了智能电视111的播控卡片409在播放信息同步后的音量大小显示条425,音量大小显示条425上的滑块425A,播放进度显示条427,播放进度显示条427上的滑块427A。可以看出,图4D中的智能电视111和图4E中的播控卡片409显示的播放信息基本相同,对应的滑块位置基本一致,表示智能电视111的播放信息实时同步到播控卡片409上。这种实时同步由于信息传递和/或处理等因素的影响,可以理解为在一定误差允许范围内的实时同步。
图4F-图4G示出了用户通过播控卡片409播控智能电视111的过程。
在一些可能的实施方案中,当手机407检测到用户点击图4C中的音量图标421的操作,播控卡片409的音量图标421将变为图4F中示出的静音图标441。在手机407通过无线通信模块发送播控命令至智能电视111后,智能电视111也会出现图4G中示出的静音图标443。
在一些可能的实施方案中,当手机407检测到用户点击图4C中的播放图标423的操作,播控卡片409的播放图标423将变为图4F中的暂停播放图标445。在手机407通过无线通信模块发送播控命令至智能电视111后,智能电视111的播放图标403也会变为图4G中示出的暂停播放图标447。
下面将说明用户通过播控卡片409续播智能电视111中正在播放的视频的过程。
在一些可能的实施方案中,当手机407检测用户点击图4C中的续播图标435的操作,会跳入视频播放应用程序并继续播放视频。此处以图4D中示出的播放信息为例,手机407在用户点击播控卡片409上的续播图标435后,出现图4H中示出的华为视频325的示例性用户界面449,用户能够在用户界面449中续播视频《勇敢地跨步》。可以看出,此时图4H华为视频325中示出的播放信息与图4D中示出的播放信息基本保持一致。可以理解的是,这种一致是一定误差允 许范围内的一致。
在一些可能的实施方案中,用户在手机上播放多媒体内容的应用程序和在电视上播放多媒体内容的应用程序为完全相同的应用程序,即该应用程序既支持在手机上使用又支持在电视上使用。在一些可能的实施方案中,用户在手机上播放多媒体内容的应用程序和在电视上播放多媒体内容的应用程序为相同应用程序的不同版本,例如,手机上的应用程序为华为视频325的手机版,电视上的应用程序为华为视频的电视版。在一些可能的实施方案中,用户在手机上播放多媒体内容的应用程序和在电视上播放多媒体内容的应用程序为关联应用,电视上通过第一应用播放多媒体内容,手机接收播放信息,播放信息包括多媒体内容标识,手机上能通过该多媒体标识在第二应用中续播多媒体内容。
在一些可能的实施方案中,用户在手机上续播的多媒体内容和智能电视上播放的多媒体内容具有相同的类型。在一些可能的实施方案中,用户在手机上续播的多媒体内容和智能电视上播放的多媒体内容具有不同的类型,例如电视上播放的多媒体内容为《勇敢地跨步》的4K版本,手机上续播的多媒体内容为《勇敢地跨步》的1080P版本;又例如电视上播放的内容为《勇敢地跨步》的VR版本,手机上续播的多媒体内容为《勇敢地跨步》的VR版本对应的平面版本;又例如智能VR眼镜中播放的内容为《勇敢地跨步》的包括景深数据的全景视频版本,手机上续播的多媒体内容为《勇敢地跨步》的全景视频版本。
在一些可能的实施方案中,智能电视111可能会出现断电/断开WLAN等突发情况,此时智能电视111相对于手机407的设备状态为离线状态,手机407对智能电视111的播控命令失效。为了在手机407上提示用户播控失败,可选地为播控卡片409停止显示;可选地为一个或多个图标变为不可接收用户操作的;可选地为一个或多个图标变色,例如图4I所示的播控卡片409中的音量图标421,播放图标423,音量大小显示条425,滑块425A,播放进度显示条427,滑块427A,快退图标429,快进图标431,下一集图标433变为灰色;可选地为一个或多个图标停止显示,例如图4C播控卡片409中的音量图标421,播放图标423,音量大小显示条425,滑块425A,播放进度显示条427,滑块427A,快退图标429,快进图标431,下一集图标433停止显示(如图4J所示);可选地为提示用户播控失败,例如图4K所示在控制中心界面353的提示框451,提示框451中的内容示例地为“提示:不在同一WLAN中,播控失败!”,内容还可以示例地为“XXX设备离线,播控失败!”;可选地为上面实施方案的一种或多种组合,还可以为其他实施方案。
在一些可能的实施方案中,手机407可能会出现续播失败的情况,例如出现视频源丢失,视频解析错误,不具备打开视频播放应用权限等情况。为了在手机407上提示用户续播失败,可选地采用类似于图4K中示出的方案,例如在控制中心界面353/视频应用程序的用户界面449生成提示框451,提示用户续播失败,例如“视频解析错误,播放失败”,此处不再赘述。
本申请实施例提供的一种设备间多媒体内容续播的方法,在便携式电子设备 200侧保留一定时间内的智能多媒体播放设备250的播放信息,使得用户在最后一次断开WLAN/智能多媒体播放设备250退出播放状态/智能多媒体播放设备250断电的一定时间内等情况下还能够实现续播多媒体内容,例如用户在关闭智能电视111后离家(断开WLAN)的一段时间内还能够在手机407续播《勇敢地跨步》。下面将通过用户离家后继续在手机407上观看智能电视111上最近播放的视频进行说明。
在一些可能的实施方案中,用户希望能够在离家后的一段时间内续播在智能电视111上播放的视频,例如图5A中示出的场景,用户在一段时间内观看了智能电视111上播放的视频并且离开了家,此时用户的手机407和智能电视111不处于同一WLAN中,智能电视111相对于手机407的设备状态为离线。
图5B中的信号强度指示符303中用于指示WLAN连接的指示符停止显示。在一些可能的实施方案中,图5B还示出了在情景智能界面369下的播控卡片409。此时手机407与智能电视111不在同一WLAN中,用户不能够通过播控卡片409对智能电视111实现播控。音量图标421,音量大小显示条425,滑块425A,快退图标429,快进图标431,下一集图标433,播放图标423,播放进度显示条427,滑块427A停止显示。在一些可能的实施方案中,图5C中示出的播控卡片409保留了播放图标423,播放进度显示条427和滑块427A,手机407通过采集本地存储的最近一次的播放信息,通过滑块427A指示最近播放视频的播放进度,带给用户更好的视觉体验。
当手机407检测到用户点击图5B中续播图标435的操作,可选地显示图4H中示出的视频播放应用程序华为视频325的用户界面449。可以理解的是,用户界面449中显示的可以为实时性较强的播放信息,与用户离家时/智能电视111关闭时的播放信息基本一致(因为离家前的一段时间内发生过播放信息同步),还可以为较早前的播放信息(离家的前一段时间内未发生过播放信息同步)。
在一些可能的实施方案中,手机407可能会出现续播失败的情况,例如视频源丢失,视频解析错误,不具备打开视频播放应用权限等。为了在手机407上提示用户续播失败,可选地为播控卡片409停止显示,可选地生成图5D中示出的提示框501,示例性的内容为“提示:视频解析错误,续播失败!”,还可选地为其他实施方案,此处不再赘述。
图5E示出了用户在离家后重新回到家庭场景100中的示意图,用户再次拿起手机407查看智能电视111的播控卡片409,此时手机407和智能电视111处于同一WLAN中,图5F中的信号强度指示符303中用于指示WLAN连接的指示符重新显示。播控卡片409从图5B/图5C中示出的播控卡片409变为图5F中示出的播控卡片409,可以看出,音量图标421,播放图标423,音量大小显示条425,滑块425A,播放进度显示条427,滑块427A,快退图标429,快进图标431,下一集图标433重新显示,此时播控信息再次进行同步,且此时用户能够通过播控卡片播控智能电视111。
下面将说明有多个智能多媒体播放设备250需要在情景智能界面369中生成 播控卡片的过程。在一种实施方案中,可选地显示全部播控卡片。在一种实施方案中,可选地显示其中的一张或多张,将剩余的卡片通过例如“展开-收起”的形式在情景智能界面369显示。在另一种实施方案中,显示其中的一张或多张,将剩余的卡片通过例如“显示全部-返回”的方式在不同于情景智能界面369的其他界面显示。
图6A-6B示出了当有多张播控卡片需要显示的时候的一种实施方案。图6A中情景智能界面369包括了播控卡片409和“展开”图标601。当手机407检测到用户点击“展开”图标601的操作,出现图6B中示出的情景智能界面369。情景智能界面369包括智能电视111对应的播控卡片409;包括智能音箱113对应的播控卡片603,播放示例性的音频《瑜伽伴奏》607,显示示例性图片609;包括智能投影仪141对应的播控卡片605,播放示例性的视频《美丽风景》611,显示示例性图片613。情景智能界面369还包括“收起”图标615。当手机407检测到用户点击“收起”图标615的操作,情景智能界面369回到图6A中示出的界面。
在一些可能的实施方案中,文件类型为视频的多媒体内容能够通过视频播放应用程序播放,例如华为视频325。在另一些实施方案中,文件类型为音频的多媒体内容能够通过音频播放应用程序播放,例如音乐321。在续播时,手机407需要通过处理器201判断多媒体内容的类型,并使用对应的应用程序去播放该类型的多媒体内容。
在一些可能的实施方案中,当有多张播控卡片需要显示的时候,需要考虑播控卡片的排序。播控卡片排序的方法可选地为按照智能多媒体播放设备250的名称419(例如长短,首字母等)进行排序;可选地为按照设备的播放状态(播放/暂停/缓冲中)进行排序;还可选地为按照设备状态(在线/离线)进行排序,其中在线的设备支持播控和/或续播,离线状态的设备可选地在一段时间内支持续播;还可选地为按照用户所处的房间进行排序;还可选地通过播控卡片上的“更多”图标377置顶播控卡片,人为改变排列顺序。
图6C-图6D示出了根据用户所处的位置进行播控卡片排序的一种实施方案。
图6C示出了用户在家庭场景100中的运动轨迹617,用户从第一房间110离开,经过走廊150,最后到达第四房间140。用户在第一房间110中时,情景智能界面369示例性地显示图6B中示出的用户界面,排列顺序首先是第一房间110的智能电视111对应的播控卡片409,然后是第一房间110的智能音箱113对应的播控卡片603,最后是第四房间140的智能投影仪141对应的播控卡片605。
图6D示出了用户在第四房间140中示出的情景智能界面369,排列顺序首先是第四房间140的智能投影仪141对应的播控卡片605,然后是第一房间110的智能电视111对应的播控卡片409,最后是第一房间110的智能音箱113对应的播控卡片603。
上述实施方案需要识别用户的位置,可以通过室内定位技术实现,室内定位技术包括但不局限于Wi-Fi定位技术,RFID定位技术,红外技术,超声波技术, 蓝牙技术,惯性导航技术,UWB定位技术,图像识别定位技术。
可选地,定位技术能够通过便携式电子设备200和/或智能多媒体播放设备250实现,还可选地,除了便携式电子设备200和/或智能多媒体播放设备250外,还通过其他设备(例如使用家庭摄像头)实现辅助定位。
在一些可能的实施方案中,定位技术需要处理的房间是虚拟的位置标签,可以通过判便携式电子设备200和一个或多个设备间的距离确定相对位置。在另一些实施方案中,定位技术需要处理的房间是实体的房间,这时候可以通过定位技术中的惯性导航技术,RFID定位技术等确定便携式电子设备200在家庭场景100中的具体位置。
在一些可能的实施方案中,便携式电子设备200能够将在第一智能多媒体播放设备250上播放的多媒体内容在第二智能多媒体播放设备250上续播。可以理解的是,第二智能多媒体播放设备250需要支持播放第一智能多媒体播放设备250上播放的多媒体内容类型。例如图6E中示出的用户从第一房间110移动至第四房间140后,手机407的情景智能界面369出现提示框619,询问用户是否需要在智能投影仪141上续播智能电视111上正在播放的《勇敢地跨步》。图6F示出了在便携式电子设备200在接收到用户点击“是”的操作后,智能投影仪141续播智能电视111上播放的《勇敢地跨步》的场景示意图。图6F中示出了智能投影仪141的播放图标621,播放进度显示条623和播放进度显示条623上的滑块623A。图6F中示出的智能投影仪141的播放信息和图6D中示出的智能电视111的播放信息基本保持一致。图6G示出了便携式电子设备200在接收到用户点击“是”的操作后,情景智能界面369中显示的播控卡片。可以看出智能投影仪141的播控卡片605显示的播放信息刷新,与智能电视111的播控卡片409示出的播放信息基本保持一致,实现了智能投影仪141上续播在智能电视111上播放的多媒体内容。
第二智能多媒体播放设备250在续播第一多媒体播放设备250的多媒体内容后。在一些可能的实施方案中,第一智能多媒体播放设备250保持不变,继续播放多媒体内容。在一些可能的实施方案中,第一智能多媒体播放设备250停止播放多媒体内容。在一些可能的实施方案中,在便携式电子设备200/第一智能多媒体播放设备250/第二智能多媒体播放设备250上询问用户第一智能多媒体播放设备250是否需要结束播放。
图6H示出了用户通过分屏模式使用智能电视111的场景,此时智能电视111的第一分屏625正在播放视频《勇敢地跨步》,智能电视111的第二分屏627正在播放视频《足球》。其中,第一分屏625和第二分屏627正在播放的视频对应的音频可选地由同一设备输出,例如通过智能电视111输出;还可选地由不同设备输出,例如第一分屏625播放的视频对应的音频通过智能音箱113输出,第二分屏627播放的视频对应的音频通过智能电视111输出,还可以通过其他的设备例如音箱,耳机等输出。
图6I示出了智能电视111在情景智能界面369分别对应于第一分屏625的 播控卡片629和第二分屏627的播控卡片631,播控卡片中的智能多媒体播放设备的名称均为第一房间的电视111。在一些可能的实施方案中,第一分屏625对应的播控卡片629显示在第二分屏627对应的播控卡片631的上方。在一些可能的实施方案中,还可选地在播控卡片629和播控卡片631中分别标注“第一分屏”和“第二分屏”用于提示用户(该方案未在图6I中示出)。
图6J示出了智能电视111在情景智能界面369显示对应于第一分屏625和第二分屏627的播控卡片633,播控卡片633同时包括第一分屏625和第二分屏的播放信息。在这种实施例中,可选地将在一个智能多媒体播放设备250中的多个不同的多媒体内容显示在一个播控卡片中。
图6K示出了当用户通过分屏模式使用智能电视111观看多个视频时,多个视频在情景智能界面369播放的示意图,情景智能界面369包括第一分屏625对应的播控卡片635和第二分屏627对应的播控卡片637。此时多媒体内容的关联图片639对应在第一分屏625播放的视频中对应于播放进度实时的一帧,多媒体内容的关联图片641对应在第二分屏627播放的视频中对应于视频播放进度实时的一帧。通过这种方式,用户能够在播控卡片中实时观看多媒体内容。
在一些可能的实施方案中,便携式电子设备200检测到用户长按续播图标643的行为,便携式电子设备200示出了图6L中示出的界面,界面的第一区域645播放对应于第一分屏625中播放的视频,界面的第二区域647对应于用户界面301。当便携式电子设备200检测到用户在第二区域647从左向右滑动的手势649,第二区域647显示为图6M中示出的控制中心界面353,控制中心界面353中包括播控卡片651。可以理解的是,长按可选地为一种示例性的表现方式,还可选地为语义为分屏观看的语音输入,还可选地为便携式电子设备200检测到用户按下续播图标643,接着拖动至播控卡片637的操作。在一些可能的实施方案中,便携式电子设备200检测到用户点击续播图标653的行为,便携式电子设备200示出了图6N中示出的界面,界面的第一区域645播放对应于第一分屏625中播放的视频,界面的第二区域647播放对应于第二分屏627中播放的视频。可以理解的是,点击可选地为一种示例性的表现方式,还可选地为语义为分屏观看的语音输入。
在一些可能的实施方案中,便携式电子设备200还可以通过一个或多个浮动窗口的形式显示,如图6O中示出的界面,界面包括第一浮动窗口655和第二浮动窗口657。便携式电子设备200可选地能够检测到用户输入,实现浮动窗口的大小和位置的调整。可以理解的是,便携式电子设备200可选地包括比图6O所示更多或更少的浮动窗口。
在一些可能的实施方案中,便携式电子设备200可以接收用户的操作,决定是否在便携式电子设备200上生成智能多媒体播放设备250的播控卡片,例如图6P中示出的播控卡片设置界面659,界面659包括界面标识“播控卡片设置”661,界面659显示与“智慧生活”应用程序关联且用于配置的智能多媒体播放设备250,例如第一房间的电视111,第二房间的电视121等。
在一些可能的实施方案中,便携式电子设备200还可以接收用户的操作,决定播控卡片是否支持续播功能,例如图6Q中示出的续播功能设置界面663,界面663包括界面标识“续播功能设置”665,界面663包括界面标识“播控卡片设置”665,界面663显示与“智慧生活”应用程序关联且用于配置的智能多媒体播放设备250,例如第一房间的电视111,第二房间的电视121等。
在一些可能的实施方案中,智能多媒体播放设备250在具有生成播控卡片的前提下才能够支持续播功能。在一些可能的实施方案中,智能多媒体播放设备250在不显示播控卡片的前提下也能够支持续播功能,例如通过语音输入实现续播功能,例如,便携式电子设备200接收到用户语音“小艺小艺,在手机上继续播放电视上的《勇敢的跨步》”即可在便携式电子设备200续播电视上播放的视频内容。
在一些可能的实施方案中,多个类型相同的智能多媒体播放设备250播放相同的多媒体内容,且播放信息相同,多个智能多媒体播放设备250在一个播控卡片中显示。此种场景在大户型家庭中可以实现多个房间的家庭成员通过各自房间的多媒体设备同时观看同一多媒体内容,且该多媒体内容在各个房间的播放进度或音量大小是相同的,此时播控卡片可以显示音量和播放进度。在一些示例中,多个房间的家庭成员通过各自房间的多媒体设备同时观看同一多媒体内容的场景下,该多媒体内容在各个房间的播放进度或音量大小也可以是不同的(例如,第一房间的用户喜欢大音量,第一房间的电视可以在播放《勇敢的跨步》时调大音量),此时播控卡片可以不显示音量和播放进度。如图6R所示,第一房间的电视111和第二房间的电视121正在播放相同的多媒体内容,在情景智能界面369中显示播控卡片667。通过这种方式,能够在一个播控卡片中对多个智能多媒体播放设备进行播控。
在一些可能的实施方案中,多个类型不同的智能多媒体播放设备250播放相同的多媒体内容,例如智能电视在播放多媒体内容的视频,智能音箱正在播放多媒体内容对应的音频。此时多个智能多媒体播放设备250在一个播控卡片中显示。如图6S所示,第一房间的电视111和第一房间的音箱113正在播放相同的多媒体内容,在情景智能界面369中显示播控卡片669。在一些可能的实施方案中,播控卡片669可选地包括分别对应于每个智能多媒体播放设备250的音量大小显示条,从而能够接收用户输入对每个智能多媒体播放设备250的音量大小进行分别调整。
在一些可能的实施方案中,多个类型不同的智能多媒体播放设备250播放相同的多媒体内容,多个智能多媒体播放设备250可选地在一个播控卡片中显示。如图6T所示,第一房间的电视111和智能投影仪141正在播放相同的多媒体内容,在情景智能界面369中显示播控卡片671,播控卡片671包括显示多媒体内容的区域671A、显示第一房间的电视111播放信息的区域671B和显示第四房间的投影仪141播放信息的区域671C,此时智能电视111和投影仪141的至少一个播放信息不同,若相同,则可选地如图6S中示出的播控卡片669所示。其中 区域671B和区域671C的显示顺序可以根据便携式电子设备200在家庭场景100中的位置调整显示。如图6T所示,便携式电子设备200处于第一房间110,用户正在通过智能电视111观看《勇敢的跨步》,区域671B显示在区域671C的上方。如图6U所示,便携式电子设备200处于第四房间140,用户正在通过投影仪141观看《勇敢的跨步》,区域671C显示在区域671B的上方,从而带给用户更好的观影体验。
下面将说明本申请实施例的具体方法流程。
播放信息可选地包括多媒体内容名称(例如图4C示出的播控卡片409中播放视频的名称415《勇敢地跨步》),多媒体内容标识,多媒体内容类型(例如音频,视频),多媒体内容时长,多媒体内容的关联图片(例如图4C示出的播控卡片409中播放视频的关联图片417),多媒体内容源地址等;可选地包括播放状态(例如播放/暂停,可选地通过播放图标423/暂停播放图标445体现),播放进度(例如通过播放进度显示条427显示),音量状态(例如未静音状态/静音状态,通过音量图标421/静音图标441显示),播放音量(例如通过音量大小显示条425显示)。
其中,多媒体内容标识和多媒体内容源地址,可以使本设备或其他设备从服务器获取该多媒体内容。
设备信息可选地包括设备名称(例如智能多媒体播放设备250的名称419,示例性地为智能电视111的名称“第一房间的电视”),设备标识,设备类型(例如智能电视111,智能音箱113)。
图7A示出了本申请的一个实施例。其中步骤701为可选的执行步骤。
便携式电子设备200与智能多媒体播放设备250建立(步骤701)近场连接,建立近场连接的设备间能够进行数据交互。例如,图4B中的用户手机407通过无线通信模块217接入图1A中示出的路由器145提供的WLAN,智能电视111和智能音箱113通过无线通信模块265接入图1A中示出的路由器145提供的WLAN。此时手机407、智能电视111和智能音箱113处于同一无线网络,设备间能够进行数据交互。
在一些可能的实施方案中,便携式电子设备200与智能多媒体播放设备250可登陆同一用户账户(例如,华为账户或者华为视频账户)。
智能多媒体播放设备250正在播放(步骤703)第一多媒体内容。可以理解的是,智能多媒体播放设备250可以在步骤701发生前已经在播放多媒体内容,还可以在步骤701发生后开始播放多媒体内容。例如,图4A中的智能电视111正在播放视频文件《勇敢地跨步》,并显示了其中一帧401。可以理解的是,智能电视111可以在与手机407处于同一WLAN中之前已经在播放《勇敢地跨步》,还可以在与手机407处于同一WLAN中之后开始播放《勇敢地跨步》。
便携式电子设备200接收(步骤705)智能多媒体播放设备250发送的第一播放信息,其中,第一播放信息对应于智能多媒体播放设备250播放的第一多媒体内容。获取方式可选地为智能多媒体播放设备250定时发送播放信息给便携式 电子设备200;可选地为智能多媒体播放设备250在播放信息发生变化后发送播放信息给便携式电子设备200;可选地为便携式电子设备200发送获取请求后,智能多媒体播放设备250发送播放信息给便携式电子设备200。第一播放信息包括第一多媒体内容的标识和第一多媒体内容的播放进度,可选地包括第一多媒体内容的源地址,第一多媒体内容的播放状态,第一多媒体内容的音量状态,或第一多媒体内容的播放音量。
便携式电子设备200显示(步骤707)对应于第一多媒体内容的第一播控卡片,第一播控卡片包括第一控件和第二控件,所述第二控件用于控制所述第一多媒体内容的播放。例如,第一控件为续播选项,第二控件为用于显示或播控第一多媒体内容。当手机407检测到用户手势351,在控制中心界面353的情景智能界面369中显示图4C中示出的智能电视111对应的播控卡片409,播控卡片409包括续播图标435。可以理解的是,播控卡片409还可以在手机407其他界面显示,例如通知中心界面。
便携式电子设备200响应(步骤709)作用于第一控件上的第一用户输入,基于第一播放信息从服务器获取第一多媒体内容,并基于第一播放信息续播第一多媒体内容。在一些可能的实施方案中,第一设备续播的第一多媒体内容的播放进度与第二设备播放的第一多媒体内容的播放进度相同。例如续播视频,以图4D中示出的智能电视111对应的播控卡片409和播放信息为例,此时手机407响应用户点击续播图标435的操作,打开用于播放视频的华为视频325并实现续播(示例性地显示图4H中示出的用户界面449)。又例如续播音频,以图6B中示出的智能音箱113对应的播控卡片603和播放信息为例,手机407响应用户点击续播图标的操作(续播图标未标出),打开用于播放音频的音乐321并实现续播。可选地通过搜索多媒体内容名称,可选地通过搜索多媒体内容标识,可选地通过搜索多媒体文件源地址,进而实现续播多媒体内容。
在一些可能的实施方案中,便携式电子设备200可以获取其他多媒体播放设备的播放信息并生成对应的播控卡片。例如,除了获取智能电视111的播放信息生成智能电视111的播控卡片外,便携式电子设备200还可以获取智能音箱123播放的音频内容的播放信息,并生成智能音箱113的播控卡片。智能电视111的播控卡片和智能音箱123的播控卡片可以同时在情景智能界面369显示,如图6D所示。
在一些可能的实施方案中,情景智能界面369显示有多个播控卡片。例如,情景智能界面369显示有智能电视111对应的第一播控卡片和智能音箱123对应的第二播控卡片。其中,第一播控卡片和第二播控卡片的显示效果基于便携式电子设备200与智能电视111对应的第一区域(例如第一房间110)和智能音箱123对应的第二区域(例如第二房间120)的位置关系确定。
下面给出第一播控卡片和第二播控卡片的显示效果基于便携式电子设备200与智能电视111对应的第一区域(例如第一房间110)和智能音箱123对应的第二区域(例如第二房间120)的位置关系确定的一个具体例子:当便携式电 子设备200位于第一区域(例如第一房间110)时,在情景智能界面369的第一播控卡片显示在第二播控卡片上方。
在一些可能的实施方案中,便携式电子设备200断开与无线网络的连接后,可以显示对应于智能多媒体播放设备250的播控卡片,该播控卡片包含第一控件(即续播选项)。而在便携式电子设备200处于无线网络下时,显示的对应于智能多媒体播放设备250的播控卡片不包含第一控件(即续播选项)。这样,用户在家庭时,可以专注于智能多媒体播放设备250的播放内容上,用户离家时可以通过播控卡片的续播选项继续播放多媒体内容。
下面将结合图7B-7D示出便携式电子设备200获取智能多媒体播放设备250上播放的多媒体内容的播放信息的过程。
图7B示出了智能多媒体播放设备250在播放信息发生变化后,同步播放信息至便携式电子设备200的过程。
智能多媒体播放设备250在设备启动后调用(步骤711)视频播放应用程序提供的播放信息订阅接口。当播放信息发生变化时,智能多媒体播放设备250收到播放信息订阅接口的通知。例如,播放信息发生变化可选地在智能多媒体播放设备250从没有播放多媒体内容变为播放多媒体内容时发生,可选地在智能多媒体播放设备250播放多媒体内容时发生,可选地在智能多媒体播放设备250从播放多媒体内容到没有播放多媒体内容时发生。
智能多媒体播放设备250获取并存储变化后的播放信息,刷新播放信息的本机当前UTC时间戳。例如,智能电视111启动后调用智能电视111侧华为视频提供的播放信息订阅接口。图4D示出了用户通过遥控器遥控智能电视111后的场景,遥控后播放进度显示条405上的滑块405A相比于原先图4A中示出的滑块405A位置发生变化,音量大小显示条439上的滑块439A发生变化(图4A中音量大小显示条439未示出,但可选地从图4A中智能电视111对应的图4C中示出的播控卡片409的音量大小显示条427上的滑块427A,看出发生了变化)。智能电视111收到播放信息订阅接口通知后,获取并存储变化后的播放信息,刷新播放信息的本机当前UTC时间戳。
在一些可能的实施方案中,智能多媒体播放设备250直接同步播放信息至便携式电子设备200,但是由于一些持续变化的播放信息的存在(例如多媒体内容的播放进度:正在播放中的多媒体内容,播放进度会一直发生变化),带来同步频率过高,导致功耗增加的问题。在另一些实施方案中,智能多媒体播放设备250在获取并存储变化后的播放信息后,会首先判断(步骤713)是否需要进行本次同步,当只有持续变化的播放信息(例如,播放进度)发生随时间的递增变化时,不需要同步,略过下面的步骤,结束本次同步;当有除持续变化的播放信息以外的其他播放信息发生变化时,需要同步,继续下面的步骤。例如,图4D中示出的智能电视111在接收用户遥控后,采集的播放信息中,相对于图4A,除了显示播放进度的滑块405A发生变化外,显示音量的滑块439A也发生变化,需要同步这次采集的播放信息。在另一些实施方案中,智能多媒体播放设备250 可以根据播放信息的类型决定是否进行播放信息的同步。
智能多媒体播放设备250发现(步骤715)同一网络下的智能电子设备,采集这些智能电子设备的设备信息。例如,例如,智能电视111通过无线通信模块265发现处于路由器145提供的WLAN下的其他设备包括智能音箱113和手机407。智能电视111采集并存储两个设备的设备信息。
智能多媒体播放设备250连接(步骤717)同一网络下的便携式电子设备200。连接的方式可选地为智能多媒体播放设备250发送本设备绑定的登陆账号给便携式电子设备200,若便携式电子设备200判断接收的登陆账号与本设备的登陆账号相同,则可以建立连接。例如,智能电视111向手机407发送本设备的登陆账号,手机407验证通过后可选地返回表示连接成功的返回码,验证失败后可选地返回表示连接失败的返回码。
在一些可能的实施方案中,智能多媒体播放设备250连接设备类型为便携式电子设备200的设备。在一些可能的实施方案中,智能多媒体播放设备250除了连接设备类型为便携式电子设备200的设备外还连接其他类型的智能电子设备。
智能多媒体播放设备250发送(步骤719)播放信息至连接成功的便携式电子设备200。例如,智能电视111通过无线通信模块265发送步骤711中采集的播放信息至手机407。
便携式电子设备200存储(步骤721)播放信息。便携式电子设备200在收到步骤721中智能多媒体播放设备250发送的播放信息后,存储本次收到的播放信息,将发送该播放信息的智能多媒体设备的设备状态设置为在线,刷新播放信息的本机当前UTC时间戳。可选地,便携式电子设备200在存储后发送表示同步成功的返回码。例如,手机407在接收到智能电视111发送的播放信息后存储本次收到的播放信息,并将电视111的设备状态设置为在线,刷新播放信息的本机当前UTC时间戳。
图7C示出了智能多媒体播放设备250周期性同步播放信息至便携式电子设备200的过程。
便携式电子设备200上存储的是不具有时效性的智能多媒体播放设备250的播放信息,例如当智能多媒体播放设备250出现强行关机的情况,导致智能多媒体播放设备250长时间未同步播放信息到便携式电子设备200。
因此智能多媒体播放设备250周期性同步播放信息至便携式电子设备200,可以作为便携式电子设备200判断智能多媒体播放设备250是否在线的依据。
智能多媒体播放设备250启动(步骤723)循环定时器,示例性的循环定时器的周期为30分钟。循环定时器可以由处理器251生成,还可以由处理器251连接的其他定时器模块/芯片生成。
到达定时时间后,智能多媒体播放设备250发现(步骤725)发现同一网络下的智能电子设备,连接(步骤727)同一网络下的便携式电子设备200,发送(步骤729)播放信息。便携式电子设备200在接收到播放信息后存储(步骤731)播放信息。步骤725-步骤731与图7B中示出的步骤715-步骤721相同,此处不 再赘述。
播放信息的同步除了以智能多媒体播放设备250同步至便携式电子设备200的方式进行,还可以表现为便携式电子设备200主动采集多媒体播放设备250的播放信息。图7D示出了这个主动采集的过程。
便携式电子设备200在设备启动后设置(步骤733)事件监听器,可选地用于监听便携式电子设备200的屏幕解锁事件和便携式电子设备200建立/退出近场连接的事件,还可以为其他触发事件。当这些监听器监听的事件触发时,便携式电子设备200收到监听器的通知。例如,当便携式电子设备200发生屏幕解锁事件,便携式电子设备200收到事件监听器的通知;当便携式电子设备200接入路由器145提供的WLAN,便携式电子设备200收到事件监听器的通知;当便携式电子设备200断开路由器145提供的WLAN,便携式电子设备200收到事件监听器的通知。
便携式电子设备200判断(步骤735)是否需要采集播放信息。当监听器触发后,便携式电子设备200判断自身是否与周围设备建立近场连接,建立了近场连接则继续下面的步骤,未建立/断开近场连接则跳过下面的步骤,结束本次主动采集的过程。
在一些可能的实施方案中,由于网络不稳定,便携式电子设备200接入/退出WLAN比较频繁,或用户解锁屏幕比较频繁,需要进行抑制。在一些可能的实施方案中,可以设置最短采集周期T S,例如本地最近一次存储的播放信息的本机当前UTC时间戳为T 0,本次发起判断是否采集的本机当前UTC时间戳为T 1,则判断T 1-T 0是否大于等于最短采集周期T S,大于等于则进行采集,小于则跳过下面步骤并完成本次主动采集的过程。
便携式电子设备200发现(步骤737)同一网络下的智能电子设备,采集这些智能电子设备的设备信息。例如,手机407通过无线通信模块217发现处于路由器145提供的WLAN下的其他设备包括智能电视111和智能音箱113。手机407采集并存储两个设备的设备信息。
便携式电子设备200连接(步骤739)同一网络下的智能多媒体播放设备250。连接的方式可选地为便携式电子设备200发送本设备绑定的登陆账号给智能多媒体播放设备250,若智能多媒体播放设备250判断接收的登陆账号与本设备的登陆账号相同,则可以建立连接。例如,手机407向智能电视111和智能音箱113发送本设备的登陆账号,智能电视111和智能音箱113验证通过后可选地返回表示连接成功的返回码,验证失败后可选地返回表示连接失败的返回码。
在一些可能的实施方案中,便携式电子设备200只连接设备类型为智能多媒体播放设备250的设备。在一些可能的实施方案中,便携式电子设备200除了连接设备类型为智能多媒体播放设备250的设备外还连接其他类型的智能电子设备。在另一些实施方案中,便携式电子设备200连接所有类型的智能电子设备。
在一些可能的实施方案中,一些智能电子设备不具有登陆账户的能力,便携式电子设备200可选地连接这些智能电子设备,还可选地处于安全因素考虑不连 接这些智能电子设备。
在一些可能的实施方案中,一些智能电子设备和应用程序关联后可视为具有了安装应用程序的设备账户,便携式电子设备200可选地连接这些智能电子设备,还可选地出于安全因素考虑不连接这些智能电子设备。
便携式电子设备200发送(步骤741)获取播放信息请求至智能多媒体播放设备250并接收其发送的播放信息。对于步骤735中连接成功的智能多媒体播放设备250,便携式电子设备200发送获取播放信息的请求。智能多媒体播放设备250在接收到来自便携式电子设备200的请求后,采集并返回播放信息。便携式电子设备200在接收到返回的播放信息后,将成功发送播放信息的多媒体播放设备250的设备状态设置为在线,并刷新播放信息的本机当前UTC时间戳;对于步骤737中发现的但没有连接(步骤739)成功/发送(步骤741)播放信息成功的多媒体播放设备250,设备状态设置为离线,不刷新播放信息的本机当前UTC时间戳。
通过上面图7B-7D示出的播放信息同步的几种方式,便携式电子设备200能够获得智能多媒体播放设备250具有时效性的播放信息。
图7E示出了便携式电子设备200和智能多媒体播放设备250间数据交互的一个示例图。其中数字的单位可选地为分钟。T0,T1,T2…之间的时间差可选地为10分钟。
可以看出,第T0分钟时,智能多媒体播放设备250发送播放信息至便携式电子设备200,此时的状态可选地为智能多媒体播放设备250从空闲状态转为播控多媒体内容的状态,或智能多媒体播放设备250与便携式电子设备200接入同一WLAN,触发图7B中示出的流程。在T1-T2分钟中,智能多媒体播放设备250发送播放信息至便携式电子设备200,此时的状态可选地为用户通过遥控器遥控智能多媒体播放设备250,多媒体内容的播放信息发生变化,触发图7B中示出的流程。第T3分钟时,智能多媒体播放设备250同步播放信息至便携式电子设备200,此时正好到达周期性发送的时间,触发图7C中示出的流程。在T3-T4分钟中,便携式电子设备200解锁屏幕,触发图7D中示出的流程,便携式电子设备200发送获取播放信息的请求至智能多媒体播放设备250,智能多媒体播放设备250收到请求后返回播放信息。第T6分钟时,智能多媒体播放设备250同步播放信息至便携式电子设备200,此时正好到达周期性发送的时间,触发图7C中示出的流程。说明图7B-图7D中示出的流程是并列执行的。当有冲突时,可选地执行其中任意一个,还可选地按照顺序全部执行。
图8示出了便携式电子设备200显示并刷新播控卡片的过程。
便携式电子设备200响应(步骤801)用户输入,显示控制中心界面。例如,用户输入可选地为图3B中示出的示例性手势351。当手机407检测到用户输入的手势351,显示示例性控制中心界面353。示例性控制中心界面353包括情景智能界面369。可以理解的是,控制中心界面353只是一个示例性界面,还可以为其他界面,例如通知中心界面。
便携式电子设备200查询(步骤803)每个智能多媒体播放设备250最近一次存储的播放信息,显示播控卡片,播控卡片包括播放信息和/或可响应用户操作的图标。例如图4C中,手机407查询智能电视111最后一次刷新的本机当前UTC时间戳,选择该本机当前UTC时间戳对应的播放信息。在情景智能界面369显示播控卡片409,播控卡片409中包括播放信息和/或可响应用户操作的图标。
可以理解的是,从技术实现的角度,便携式电子设备200可以一直保存多媒体播放设备250的播放信息,例如采用内部存储器模块205或外部存储器接口203连接的外部存储卡,因此可以实现播控卡片可以永久存在。但是从用户体验的角度,用户更偏向于获得具有一定时效性的播控卡片,因此本申请实施例提供一种实施方案,仅在情景智能界面369显示设备状态为在线或一定时间内在线的智能多媒体播放设备(例如30分钟内)的播控卡片。例如,在线设备显示例如图4C中示出的播控卡片409,对于设备状态为离线且离线时间小于30分钟的智能多媒体播放设备250,显示图5B或图5C中示出的播控卡片409,对于设备状态为离线且离线时间大于等于30分钟的智能多媒体播放设备250,不显示播控卡片。
便携式电子设备200创建(步骤805)到设备状态为在线的智能多媒体播放设备250的长连接。长连接是相对于短连接而言的,短连接指设备间连接并完成数据交互后就断开该连接,长连接指设备间连接并完成数据交互后会保持该连接。例如,智能多媒体播放设备250同步播放信息给便携式电子设备200的周期是30分钟。如果智能电视111在30分钟内的某一时刻强行断电,且手机407一直处于控制中心界面353,那就需要30分钟左右的时间才能够判断智能电视111离线。通过建立便携式电子设备200到每个智能多媒体播放设备250的长连接,能加快判断。例如,智能电视111生成播控卡片409后,手机407建立与智能电视111的长连接,手机407每15秒发送第一长连接信息给智能电视111,智能电视111收到第一长连接信息后返回第二长连接信息给手机407。若手机407在一定时间内没有接收到第二长连接信息,说明长连接中断,则认为智能电视111离线,修改智能电视111的设备状态为离线。在一些可能的实施方案中,长连接信息的内容为状态码,例如第一长连接信息的内容为“1”,第二长连接信息的内容为“2”,这种方式能够降低传递的数据量。在另一些实施方案中,可选地第一长连接信息的内容为获取播放信息的请求,第二长连接信息的内容为播放信息。
便携式电子设备200刷新(步骤807)播控卡片。当便携式电子设备显示控制中心界面353的时候,播控卡片需要根据播控信息的变化/设备状态/用户所处的位置等因素刷新播控卡片是否存在/播控卡片中的内容以及播控卡片的排序。便携式电子设备200调用本地的播放信息订阅接口。当本地存储的播放信息发生变化,便携式电子设备收到通知,刷新情景智能界面369中的播控卡片。
当便携式电子设备200的当前界面离开控制中心界面353,播控卡片不需要再刷新。便携式电子设备200取消调用本地的播放信息订阅接口,断开与每个在线的智能多媒体播放设备250的长连接。
下面考虑便携式电子设备200断开WLAN的情况,如图5A中示出的用户离开家的场景。便携式电子设备200断开WLAN后将本地所有的智能多媒体播放设备250的设备状态设置为离线。如果便携式电子设备200的当前界面在控制中心界面353,并通过步骤807中的刷新播控卡片的过程完成刷新播控卡片,例如智能电视111的播控卡片409从图4C中示出的变为图4I或图4J中示出的。如果便携式电子设备200的当前界面不是控制中心界面353,则在下一次接收用户输入划入控制中心界面353的时候显示图5B或图5C中示出的播控卡片409。
图9示出了在便携式电子设备200上续播智能多媒体播放设备250上播放的多媒体内容的过程。
便携式电子设备200检测(步骤901)到用户输入。例如,用户输入为用户点击播控卡片409上的续播图标435。
便携式电子设备200采集(步骤903)播放信息。当便携式电子设备200与需要续播的智能多媒体播放设备250未建立近场连接,便携式电子设备200查看本地存储的最近一次的该智能多媒体播放设备250的播放信息。当便携式电子设备200与需要续播的智能多媒体播放设备250处于近场连接中,便携式电子设备200也可以查看本地存储的最近一次的该智能多媒体播放设备250的播放信息。在另一些实施方案中,便携式电子设备200重新连接该设备,再次获取最新的播放信息。这种再次连接并获取播放信息的方式,能够使得播放信息为最新的,能够提高用户的使用体验。
便携式电子设备200打开(步骤905)视频播放应用程序,将步骤903中获得的播放信息作为输入,续播该多媒体内容。例如多媒体内容的类型为视频,手机407打开华为视频32续播该视频;例如多媒体内容的类型为音频,手机407打开音乐321续播该音频。
图10示出了使用便携式电子设备200播控多媒体播放设备250的过程。
便携式电子设备200检测(步骤1001)到作用于播控卡片上可供用户操作的图标上的用户输入,例如点击音量图标421,点击播放图标423,拖动音量大小显示条425,拖动播放进度显示条427,点击快退图标429,点击快进图标431,点击下一集图标433。
便携式电子设备200发送(步骤1003)播控命令到该播控卡片对应的智能多媒体播放设备250,并接收来自智能多媒体播放设备250在执行成功/失败后的返回码。对于执行播控命令失败的智能多媒体播放设备,便携式电子设备200将该设备的设备状态修改为离线。
便携式电子设备200刷新(步骤1005)播控卡片,包括播放信息和播控卡片上的可响应用户操作的图标。例如,视频播放状态从播放变化暂停后,播放图标423变为暂停播放图标445;刷新播控卡片上的内容,例如用户拖动音量大小显示条425后,音量大小显示条425根据调整后的音量显示正确的位置。出现播控失败的情况,播控卡片可选地停止显示,可选地为一个或多个图标变为不可接收用户操作的;可选地为一个或多个图标变色,例如图4I所示的播控卡片409; 可选地为一个或多个图标停止显示,例如图4J所示的播控卡片409;可选地为提示用户播控失败,例如图4K所示在控制中心界面353的提示框451;可选地为上面实施方案的一种或多种组合。
在一些可能的实施方案中,在一个系统中,第二设备被配置为:发送第一播放信息至第一设备,其中,第一播放信息对应第二设备播放的第一多媒体内容,第一设备和第二设备处于同一无线网络;第一设备被配置为:显示对应于第一多媒体内容的第一播控卡片,第一播控卡片包括第一控件和第二控件,第二控件用于控制第一多媒体内容的播放;响应作用于第一控件的第一用户输入,基于第一播放信息从服务器获取第一多媒体内容,并基于第一播放信息续播第一多媒体内容。
在一些可能的实施方案中,手机接收电视发送的第一播放信息,其中,所述第一播放信息对应于所述电视播放的视频,所述手机和所述电视连接同一Wi-Fi;所述手机显示对应于所述视频的第一播控卡片,所述第一播控卡片包括第一控件和第二控件,所述第二控件用于控制所述视频的播放;所述手机响应作用于所述第一控件的操作,基于所述第一播放信息中的视频标识从服务器获取所述视频,并基于所述第一播放信息中的播放进度续播所述视频。
在一些可能的实施方案中,本申请实施例提供一种电子设备,包括存储器和一个或多个处理器;其中,存储器用于存储计算机程序代码,计算机程序代码包括计算机指令;当计算机指令被处理器执行时,使得电子设备执行设备间多媒体内容续播的方法。
在一些可能的实施方案中,本申请实施例提供一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行设备间多媒体内容续播的方法。
在一些可能的实施方案中,本申请实施例提供一种便携式电子设备200的结构示意图,如图11所示,包括一个或多个处理单元1101,存储单元1102和通信单元1103,可以执行本申请实施例提供的多媒体内容续播的方法。
在一些可能的实施方案中,本申请实施例提供一种便携式电子设备200的结构示意图,当处理单元1101为处理器时,存储单元1102为存储器时,通信单元1103为通信模块时,如图12所示,便携式电子设备200包括一个或多个处理器1201,存储器1202和通信模块1203,可以执行本申请实施例提供的多媒体内容续播的方法。
在一些可能的实施方案中,本申请实施例提供一种智能多媒体播放设备250的结构示意图,如图13所示,包括一个或多个处理单元1301,存储单元1302和通信单元1303,可以执行本申请实施例提供的多媒体内容续播的方法。
在一些可能的实施方案中,本申请实施例提供一种智能多媒体播放设备250的结构示意图,当处理单元1301为处理器时,存储单元1302为存储器时,通信单元1303为通信模块时,如图14所示,智能多媒体播放设备250包括一个或多个处理器1401,存储器1402和通信模块1403,可以执行本申请实施例提供的多媒体内容续播的方法。
通过以上实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本申请实施方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该软件产品存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(read only memory,ROM)、随机存取存储器(random access memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上内容,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。

Claims (23)

  1. 一种设备间多媒体内容续播的方法,其特征在于,所述方法包括:
    第一设备接收第二设备发送的第一播放信息,其中,所述第一播放信息对应于所述第二设备播放的第一多媒体内容,所述第一设备和所述第二设备处于同一无线网络;
    所述第一设备显示对应于所述第一多媒体内容的第一播控卡片,所述第一播控卡片包括第一控件和第二控件,所述第二控件用于控制所述第一多媒体内容的播放;
    所述第一设备响应作用于所述第一控件的第一用户输入,基于所述第一播放信息从服务器获取所述第一多媒体内容,并基于所述第一播放信息续播所述第一多媒体内容。
  2. 根据权利要求1所述的方法,其特征在于,所述第一设备显示对应于所述第一多媒体内容的所述第一播控卡片,包括:
    响应作用于所述第一设备的主界面上从左往右滑动至第一界面的滑动手势,所述第一设备在所述第一界面显示所述第一播控卡片。
  3. 根据权利要求1或2所述的方法,其特征在于,所述第二控件包括下列项中的至少一项:音量图标,音量大小显示条,播放图标,播放进度显示条,快退图标,快进图标,或下一集图标。
  4. 根据权利要求1至3中任一项所述的方法,其特征在于,所述第一播放信息包括所述第一多媒体内容的标识和所述第一多媒体内容的播放进度。
  5. 根据权利要求4所述的方法,其特征在于,所述第一播放信息还包括以下项中的至少一项:所述第一多媒体内容的源地址,所述第一多媒体内容的播放状态,所述第一多媒体内容的音量状态,或所述第一多媒体内容的播放音量。
  6. 根据权利要求1至5中任一所述的方法,其特征在于,所述第一设备续播的所述第一多媒体内容的播放进度与所述第二设备播放的所述第一多媒体内容的播放进度相同。
  7. 根据权利要求1至6中任一所述的方法,其特征在于,所述方法还包括:
    所述第一设备响应作用于所述第一控件的第一用户输入,打开用于播放所述第一多媒体内容的应用程序。
  8. 根据权利要求2至7中任一所述的方法,其特征在于,所述第一界面还显示有第二播控卡片,所述第二播控卡片对应于第三设备播放的第二多媒体内容。
  9. 根据权利要求8所述的方法,其特征在于,所述第二设备与第一区域关联,所述第三设备与第二区域关联,所述第一播控卡片和所述第二播控卡片的显示效果基于所述第一设备与所述第一区域和所述第二区域的位置关系确定。
  10. 根据权利要求9所述的方法,其特征在于,所述第一播控卡片和所述第二播控卡片的显示效果基于所述第一设备与所述第一区域和所述第二区域的位置关系确定,包括:
    当所述第一设备位于所述第一区域,所述第一播控卡片在所述第一界面的显示位置位于所述第二播控卡片的显示位置的上方。
  11. 根据权利要求10所述的方法,其特征在于,所述方法还包括:
    当所述第一设备位于所述第二区域,所述第二播控卡片在所述第一界面的所述显示位置位于所述第一播控卡片的所述显示位置的上方,且所述第一设备显示第一提示信息,所述第一提示信息用于提示是否在所述第三设备上续播所述第一多媒体内容。
  12. 根据权利要求1至11中任一所述的方法,其特征在于,所述方法还包括:
    所述第一设备响应作用于所述第二控件的第二用户输入,发送播控命令至所述第二设备;
    所述第一设备未收到对应于所述播控命令的响应消息,所述第一设备显示第一提示信息,所述第一提示信息用于提示播控失败。
  13. 根据权利要求1至12中任一所述的方法,其特征在于,所述方法还包括:
    所述第一设备检测到与所述无线网络断开连接;
    所述第一设备显示对应于所述第二设备播放的所述第一多媒体内容的第三播控卡片,所述第三播控卡片包括所述第一控件,但不包括所述第二控件。
  14. 根据权利要求1至13中任一所述的方法,其特征在于,所述方法还包括:
    所述第一设备接收所述第二设备发送的第二播放信息,其中,所述第二设备正在同时播放所述第一多媒体内容和第三多媒体内容,所述第二播放信息对应于所述第二设备播放的所述第三多媒体内容;
    所述第一设备显示对应于所述第二设备播放的所述第一多媒体内容的所述第一播控卡片和对应于所述第三多媒体内容的第三播控卡片;
    所述第一设备响应于第三用户输入,同时续播所述第一多媒体内容和所述第三多媒体内容。
  15. 根据权利要求1至13中任一所述的方法,其特征在于,所述方法还包括:
    所述第一设备接收所述第四设备发送的第三播放信息,其中,所述第四设备正在播放所述第一多媒体内容,所述第三播放信息对应于所述第四设备播放的所述第一多媒体内容;
    所述第一设备显示对应于所述第二设备和所述第四设备播放的所述第一多媒体内容的第四播控卡片。
  16. 根据权利要求15所述的方法,其特征在于,所述第四设备播放的所述第一多媒体内容的播放进度和所述第二设备播放的所述第一多媒体内容的播放进度相同。
  17. 根据权利要求1至16中任一所述的方法,其特征在于,所述第一设备和所述第二设备登陆同一用户账户。
  18. 根据权利要求1至17中任一所述的方法,其特征在于,所述无线网络为无线保真Wi-Fi无线网络。
  19. 根据权利要求1至18中任一所述的方法,其特征在于,所述第一设备为 手机,所述第二设备为电视。
  20. 一种电子设备,其特征在于,所述电子设备包括存储器和一个或多个处理器;其中,所述存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令;当所述计算机指令被所述处理器执行时,使得所述电子设备执行如权利要求1至19中任一项所述的设备间多媒体内容续播的方法。
  21. 一种计算机可读存储介质,其特征在于,包括计算机指令,当所述计算机指令在电子设备上运行时,使得所述电子设备执行如权利要求1至19中任一项所述的设备间多媒体内容续播的方法。
  22. 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求1至19中任一项所述的设备间多媒体内容续播的方法。
  23. 一种系统,包括第一电子设备和第二电子设备,其特征在于,
    所述第二设备被配置为:
    发送第一播放信息至所述第一设备,其中,所述第一播放信息对应所述第二设备播放的第一多媒体内容,所述第一设备和所述第二设备处于同一无线网络;
    所述第一设备被配置为:
    显示对应于所述第一多媒体内容的第一播控卡片,所述第一播控卡片包括第一控件和第二控件,所述第二控件用于控制所述第一多媒体内容的播放;
    响应作用于所述第一控件的第一用户输入,基于所述第一播放信息从服务器获取所述第一多媒体内容,并基于所述第一播放信息续播所述第一多媒体内容。
PCT/CN2021/082246 2020-03-26 2021-03-23 一种设备间多媒体内容续播的方法 WO2021190466A1 (zh)

Priority Applications (5)

Application Number Priority Date Filing Date Title
US17/914,438 US20230119300A1 (en) 2020-03-26 2021-03-23 Method for Resuming Playing Multimedia Content Between Devices
BR112022019309A BR112022019309A2 (pt) 2020-03-26 2021-03-23 Método para retomar a reprodução de conteúdo multimídia entre dispositivos
CN202180020838.5A CN115552915A (zh) 2020-03-26 2021-03-23 一种设备间多媒体内容续播的方法
EP21774473.9A EP4114023A4 (en) 2020-03-26 2021-03-23 CONTINUATION PROCEDURE OF PLAYBACK OF MULTIMEDIA CONTENT BETWEEN DEVICES
JP2022558009A JP7494313B2 (ja) 2020-03-26 2021-03-23 装置間でマルチメディアコンテンツの再生を再開するための方法

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202010225233.7 2020-03-26
CN202010225233 2020-03-26
CN202010419691.4 2020-05-18
CN202010419691.4A CN111726678B (zh) 2020-03-26 2020-05-18 一种设备间多媒体内容续播的方法

Publications (1)

Publication Number Publication Date
WO2021190466A1 true WO2021190466A1 (zh) 2021-09-30

Family

ID=72564643

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/082246 WO2021190466A1 (zh) 2020-03-26 2021-03-23 一种设备间多媒体内容续播的方法

Country Status (6)

Country Link
US (1) US20230119300A1 (zh)
EP (1) EP4114023A4 (zh)
JP (1) JP7494313B2 (zh)
CN (3) CN111726678B (zh)
BR (1) BR112022019309A2 (zh)
WO (1) WO2021190466A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111726678B (zh) * 2020-03-26 2022-04-29 华为技术有限公司 一种设备间多媒体内容续播的方法
CN112398855B (zh) * 2020-11-16 2023-04-07 Oppo广东移动通信有限公司 应用内容跨设备流转方法与装置、电子设备
CN112995731B (zh) * 2021-05-08 2021-08-13 荣耀终端有限公司 切换多媒体设备的方法和系统
CN113301403B (zh) * 2021-05-25 2022-12-09 惠州Tcl移动通信有限公司 基于穿戴设备的媒体播放控制方法、装置、设备及介质
CN113766301B (zh) * 2021-09-18 2023-11-28 海信视像科技股份有限公司 显示设备及交互控制方法
CN114189729A (zh) * 2021-12-14 2022-03-15 海信视像科技股份有限公司 一种数据接力播放方法及智能设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102685579A (zh) * 2012-05-02 2012-09-19 合一网络技术(北京)有限公司 一种实现本地网络中多装置间媒体分享及控制的方法
CN103037244A (zh) * 2011-09-30 2013-04-10 深圳市龙视传媒有限公司 多个智能终端之间切换网络视频的方法、系统及智能终端
US20140029913A1 (en) * 2012-07-30 2014-01-30 General Instrument Corporation Controlling Trick Play And Progress of Media Playback For Multiple Media Devices
CN103796076A (zh) * 2014-03-03 2014-05-14 联想(北京)有限公司 数据处理方法及相应的媒体播放设备和播放控制设备
CN111726678A (zh) * 2020-03-26 2020-09-29 华为技术有限公司 一种设备间多媒体内容续播的方法

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110059199A (ko) * 2009-11-27 2011-06-02 삼성전자주식회사 단말장치와, 그 단말 장치와 연결된 미디어 처리 장치 및 그 제어 방법
JP5947604B2 (ja) 2012-04-16 2016-07-06 シャープ株式会社 コンテンツ再生装置、テレビジョン受像機、コンテンツ再生方法、プログラムおよび記録媒体
JP6101438B2 (ja) 2012-06-15 2017-03-22 サターン ライセンシング エルエルシーSaturn Licensing LLC 情報処理装置及び情報処理方法、コンピューター・プログラム、並びに情報通信システム
FI124940B (fi) * 2012-08-31 2015-03-31 Gurulogic Microsystems Oy Laitteen ja näytön yhteistoiminta
KR102125856B1 (ko) * 2012-11-12 2020-06-23 삼성전자주식회사 데이터를 송수신하기 위한 멀티미디어 장치들간 출력 장치 공유 방법 및 시스템
US9179199B2 (en) 2013-03-14 2015-11-03 Apple Inc. Media playback across multiple devices
CN103546453B (zh) * 2013-08-22 2015-08-19 合一网络技术(北京)有限公司 一种跨设备播放多媒体的方法及设备
US9679054B2 (en) 2014-03-05 2017-06-13 Sonos, Inc. Webpage media playback
US9594482B2 (en) * 2014-04-07 2017-03-14 The Directv Group, Inc. Method and system for transferring the display of content from a first device to a second device
US9519413B2 (en) * 2014-07-01 2016-12-13 Sonos, Inc. Lock screen media playback control
US20170171270A1 (en) * 2015-12-14 2017-06-15 Le Holdings (Beijing) Co., Ltd. Method and electronic device for controlling video playing
US10555031B1 (en) * 2016-04-18 2020-02-04 CSC Holdings, LLC Media content controller
US20180310050A1 (en) * 2017-04-24 2018-10-25 Crackle, Inc. Streaming with seamless transitions between devices
AU2018203023B2 (en) * 2017-05-16 2019-09-19 Apple Inc. Transferring playback queues between devices
US10783929B2 (en) 2018-03-30 2020-09-22 Apple Inc. Managing playback groups
CN110381197B (zh) * 2019-06-27 2021-06-15 华为技术有限公司 多对一投屏中音频数据的处理方法、装置及系统
US11394806B2 (en) * 2019-07-18 2022-07-19 Arris Enterprises Llc System and method for the transfer of content between devices

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103037244A (zh) * 2011-09-30 2013-04-10 深圳市龙视传媒有限公司 多个智能终端之间切换网络视频的方法、系统及智能终端
CN102685579A (zh) * 2012-05-02 2012-09-19 合一网络技术(北京)有限公司 一种实现本地网络中多装置间媒体分享及控制的方法
US20140029913A1 (en) * 2012-07-30 2014-01-30 General Instrument Corporation Controlling Trick Play And Progress of Media Playback For Multiple Media Devices
CN103796076A (zh) * 2014-03-03 2014-05-14 联想(北京)有限公司 数据处理方法及相应的媒体播放设备和播放控制设备
CN111726678A (zh) * 2020-03-26 2020-09-29 华为技术有限公司 一种设备间多媒体内容续播的方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4114023A4

Also Published As

Publication number Publication date
EP4114023A4 (en) 2023-08-30
CN115278377A (zh) 2022-11-01
EP4114023A1 (en) 2023-01-04
JP7494313B2 (ja) 2024-06-03
BR112022019309A2 (pt) 2022-12-06
US20230119300A1 (en) 2023-04-20
CN115552915A (zh) 2022-12-30
CN111726678B (zh) 2022-04-29
CN111726678A (zh) 2020-09-29
JP2023519291A (ja) 2023-05-10

Similar Documents

Publication Publication Date Title
WO2021190466A1 (zh) 一种设备间多媒体内容续播的方法
EP4044609A1 (en) Cross-device content projection method and electronic device
CN110109636B (zh) 投屏方法、电子设备以及系统
WO2020098437A1 (zh) 一种播放多媒体数据的方法及电子设备
CN111316598B (zh) 一种多屏互动方法及设备
WO2021078284A1 (zh) 一种内容接续方法及电子设备
CN112988102B (zh) 投屏方法和装置
WO2022257977A1 (zh) 电子设备的投屏方法和电子设备
WO2020034227A1 (zh) 一种多媒体内容同步方法及电子设备
JP7324311B2 (ja) オーディオ及びビデオ再生方法、端末、並びにオーディオ及びビデオ再生装置
WO2022121775A1 (zh) 一种投屏方法及设备
WO2020132818A1 (zh) 无线短距离音频共享方法及电子设备
WO2021023055A1 (zh) 一种视频通话的方法
WO2021017909A1 (zh) 一种通过nfc标签实现功能的方法、电子设备及系统
WO2020259542A1 (zh) 一种显示设备的控制方法及相关装置
WO2020119464A1 (zh) 一种视频拆分方法及电子设备
WO2021233161A1 (zh) 一种家庭日程融合的方法及装置
WO2022052791A1 (zh) 一种多媒体流的播放方法和电子设备
WO2022042769A2 (zh) 多屏交互的系统、方法、装置和介质
WO2022135527A1 (zh) 一种视频录制方法及电子设备
WO2022166618A1 (zh) 一种投屏的方法和电子设备
WO2022028537A1 (zh) 一种设备识别方法及相关装置
WO2022062998A1 (zh) 一种设备推荐方法及设备
WO2023030056A1 (zh) 一种通知消息的处理方法及设备
WO2022267974A1 (zh) 一种投屏方法及相关装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21774473

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022558009

Country of ref document: JP

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112022019309

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 2021774473

Country of ref document: EP

Effective date: 20220929

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 112022019309

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20220926