WO2022052791A1 - 一种多媒体流的播放方法和电子设备 - Google Patents

一种多媒体流的播放方法和电子设备 Download PDF

Info

Publication number
WO2022052791A1
WO2022052791A1 PCT/CN2021/113769 CN2021113769W WO2022052791A1 WO 2022052791 A1 WO2022052791 A1 WO 2022052791A1 CN 2021113769 W CN2021113769 W CN 2021113769W WO 2022052791 A1 WO2022052791 A1 WO 2022052791A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
user
broadcast control
control record
multimedia stream
Prior art date
Application number
PCT/CN2021/113769
Other languages
English (en)
French (fr)
Inventor
方荣杰
李德永
陈向军
王云路
崔云颀
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022052791A1 publication Critical patent/WO2022052791A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • H04N21/4415—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks

Definitions

  • the embodiments of the present application relate to the field of electronic devices, and in particular, to a method and electronic device for playing a multimedia stream.
  • the multimedia files may include video stream files, network audio streams, and the like.
  • Video stream file Take the multimedia file acquired and played by the electronic device as a video stream file (referred to as a video stream for short) acquired by the electronic device through the network as an example.
  • the user's mobile phone can provide the user with the service of playing video streams during the user's commute.
  • the user's other electronic devices such as the home's television, can also provide the user with the service of playing the video stream after the user returns to the home.
  • the user wants to continue watching the video played on the mobile phone on the TV after going out and returning to the residence, the user needs to turn on the TV and then reopen the relevant video, or the user needs to perform multiple operations to actively associate the video playback information of the two devices.
  • the continuous playback of videos between different devices is troublesome, and there is currently no smarter video switching and playback solution between devices.
  • Embodiments of the present application provide a method and an electronic device for playing a multimedia stream, so that the continuous playing of the multimedia stream between different devices can be more accurate, stable, and easy to operate.
  • a method for playing a multimedia stream is provided, which is applied to a first electronic device having a function of playing a multimedia stream.
  • the method includes: the first electronic device detects first biometric information, and the first biometric information is used to identify the first One user, different users have different biometric information.
  • the first electronic device acquires a first broadcast control record corresponding to the first user according to the first biometric identification information.
  • the first broadcast control record is obtained from the second electronic device, the first broadcast control record includes the first time of the first multimedia stream recorded by the second electronic device, and the second electronic device corresponds to the first user Electronic equipment.
  • the first electronic device plays the first multimedia stream from the first time according to the first broadcast control record.
  • the first electronic device can actively acquire the biometric information of the current user (eg, the first user).
  • the TV can obtain the face information and/or voiceprint information of the current user.
  • the TV can also determine the broadcast control record corresponding to the biometric information according to the acquired biometric information.
  • the TV may store biometric identification information corresponding to different users and broadcast control records corresponding to different users.
  • the TV can use the current biometric information to compare with multiple stored biometric information to determine the current user (or the current user's identity).
  • the TV can determine its corresponding broadcast control record according to the current user (or the current user's identity). It can be understood that the current user is the user who currently uses the TV.
  • the TV can resume the broadcast according to the broadcast control record corresponding to the current user, so that the current user does not need to input any operation.
  • the multimedia stream that has not been watched on the second electronic device (such as a mobile phone) before can be continued to be watched through the TV.
  • the TV can accurately match the corresponding broadcast control record according to the current user's biometric information, the interruption of the broadcast based on the broadcast control record is accurate.
  • the biometric identification information and the broadcast control record are only shared between the first electronic device and the second electronic device, and do not need to pass through other transfer devices (such as a server, etc.), it is more stable.
  • the TV resumes the broadcast according to the first broadcast control record it can also start playing the first multimedia stream from a time slightly earlier than the first time, so that the user can Get a better resume viewing experience.
  • the first time of the first multimedia stream recorded by the second electronic device is the time when the second electronic device is interrupted in the process of playing the first multimedia stream.
  • the operation corresponding to the interruption includes the operation of stopping, pausing or exiting the playback of the first multimedia stream.
  • the first time may be that the second electronic device (such as a mobile phone) receives an operation input by the user to interrupt the playback of the first multimedia stream.
  • the user can input the above operation by touching corresponding controls, buttons and other methods on the mobile phone, or the user can input the above operation through voice control or other input devices. In this way, the first electronic device can accurately continue to play the first multimedia stream from the position last viewed by the user when the playback needs to be resumed from a break point.
  • the method further includes: when the second electronic device and the first electronic device are in the same local area network, the first electronic device acquires the first broadcast control record from the second electronic device.
  • a sharing mechanism of broadcast control records is provided.
  • the first broadcast control record is stored in the mobile phone.
  • the mobile phone follows the user. Therefore, when the user returns to his residence, the mobile phone will be in the same local area network as the TV in the residence. There may be a need to resume the broadcast from a breakpoint according to the first broadcast control record on the TV.
  • the TV can send a request for obtaining the broadcast control record to the mobile phone, so that the mobile phone responds to the request and sends the corresponding broadcast control record to the TV.
  • the mobile phone when the mobile phone and the TV are in the same local area network, the mobile phone can actively send the broadcast control record to the TV without requiring the TV to send a corresponding request.
  • the TV may acquire the corresponding broadcast control record from the mobile phone only when it is determined that the current user is the user corresponding to the mobile phone.
  • the first electronic device detecting the first biometric identification information includes: when the first electronic device wakes up the screen, triggering and detecting the first biometric identification information.
  • the first electronic device triggers the detection of the first biometric identification information.
  • the first electronic device detects an operation of the first electronic device by the user, the detection of the first biometric identification information is triggered.
  • a mechanism is provided for the first electronic device (such as a TV) to actively detect the biometric information of the user.
  • the TV can start to detect the biometric information of the current user when the screen wakes up.
  • the TV may start to detect the biometric information of the current user when the user's voice or face is detected.
  • the TV may start to detect the biometric information of the current user when it receives the user's operation on the TV, for example, when the user inputs an instruction to the TV through the TV remote control.
  • the first electronic device acquires the first broadcast control record corresponding to the first user according to the first biometric information, which specifically includes: the first electronic device stores the detected first biometric information with storage The second biometric identification information of the first user is matched, and according to the matching result, the first broadcast control record corresponding to the first user is acquired.
  • the second biometric identification information of the first user is obtained from the second electronic device.
  • a specific solution is provided in which the TV determines the corresponding broadcast control record according to the current user's biometric information. It can be understood that, through this solution, the TV can accurately obtain the broadcast control record corresponding to the current user.
  • the TV can obtain the broadcast control records of all users before obtaining the biometric information of the current user, and after determining the matching result, the TV can obtain the corresponding broadcast control records locally.
  • the TV may determine the identity of the current user locally after obtaining the biometric information of the current user, and then obtain the corresponding broadcast control record from the mobile phone of the user with the identity.
  • the TV may acquire the corresponding broadcast control record from the mobile phone of the corresponding user directly according to the biometric information. This application does not limit the specific implementation of the broadcast control record obtained by the TV.
  • the method further includes: when the second electronic device and the first electronic device are in the same local area network, the first electronic device acquires the second biometric identification information of the first user from the second electronic device.
  • the TV can obtain and store the biometric identification information of the corresponding user stored in the mobile phone. So that the TV can determine the current user according to the stored correspondence between the biometric identification information and the user (or user ID) after acquiring the identification information of the current user. It should be noted that, in some implementation manners, the TV can obtain the biometric identification information of the user corresponding to the mobile phone when the TV and the mobile phone are in the same local area network for the first time.
  • the TV can no longer obtain the corresponding biometric information from the mobile phone. Therefore, the TV will not repeatedly acquire the biometric information of the same user, and the signaling overhead between the TV and the mobile phone can also be reduced.
  • the first electronic device acquires the second biometric identification information of the first user from the second electronic device when the second electronic device acquires the authorization information of the first user.
  • a solution that can improve the security of user biometric information is provided.
  • the mobile phone can display the corresponding authorization interface to the user before sending the corresponding user's biometric information to the TV, so as to share the biometric information under the user's authorization.
  • the first electronic device is provided with a secure world TE, and the method further includes: the first electronic device stores the acquired second biometric identification information of the first user in the TE.
  • the method further includes: the first electronic device stores the acquired second biometric identification information of the first user in the TE.
  • TE and RE can be set in a TV and/or a cell phone.
  • the TV can store the biometric information in the TE and isolate it from other information (such as broadcast control information) to improve information security.
  • the method further includes: the first electronic device detects third biometric identification information, and the third biometric identification information is used to identify the second user.
  • the first electronic device acquires a second broadcast control record corresponding to the second user according to the third biometric identification information.
  • the second broadcast control record is obtained from the third electronic device.
  • the second broadcast control record includes the second time of the second multimedia stream recorded by the third electronic device, where the third electronic device is an electronic device corresponding to the second user.
  • the first electronic device plays the second multimedia stream from the second time according to the second broadcast control record.
  • the TV can also obtain the biometric information of the corresponding user, and execute the corresponding breakpoint resuming.
  • the solution of this example can provide accurate, stable and easy-to-operate breakpoint resuming for different users.
  • the first electronic device plays the first multimedia stream from the first time according to the first broadcast control record, including: The first multimedia stream continues to be played on the interface of the device from the first time.
  • the first electronic device displays a first prompt corresponding to the first broadcast control record on the interface of the first electronic device according to the first broadcast control record.
  • the first electronic device receives the first operation for the first prompt, and in response to the first operation, the first electronic device continues to play the first multimedia stream from the first time on the interface.
  • the first electronic device may directly display on its interface the continuous playback from the breakpoint according to the first playback control record, for example, continue to play the corresponding video stream from the first time.
  • the first electronic device may display a prompt corresponding to the broadcast control record on its interface, and the prompt may be displayed to the user in the form of a card.
  • the prompt may include relevant content in the first broadcast control record, such as the name of the video stream, relevant information of the APP that plays the video stream, and screenshots of key frames of the video stream.
  • the user can intuitively confirm whether the video stream that is resumed at the break point is the video stream that the user wants to continue watching. Therefore, it is more reliable for the TV to resume the broadcast according to the user's confirmation of the prompt.
  • the method further includes: the first electronic device according to the first broadcast The first multimedia stream or the second multimedia stream is played according to the priority. Or the first electronic device randomly selects and plays the first multimedia stream or the second multimedia stream according to the first broadcast control record and the second broadcast control record. Or according to the user's selection, the first electronic device plays the first multimedia stream or the second multimedia stream.
  • a coping strategy is provided when the TV detects two users at the same time. For example, the TV can select the corresponding broadcast control record according to the user's low priority to resume the broadcast from a breakpoint.
  • the TV can select the corresponding broadcast control record according to the priority of the broadcast control record to resume the broadcast from a break point.
  • the TV can select a broadcast control record from the current broadcast control records corresponding to multiple users, and resume the broadcast from a breakpoint accordingly.
  • the TV may display a prompt corresponding to each broadcast control record on its interface, so as to resume the broadcast according to the corresponding broadcast control record according to the operation input by the user.
  • the specific implementation of resuming the playback from a breakpoint in a scenario where there are multiple current users may be flexibly selected according to needs, or may be selected and determined according to the user's pre-configuration.
  • the method further includes: the first electronic device displays prompt information recorded by the first broadcast control, and the prompt information hides all or part of the information related to the first multimedia stream.
  • the TV may display on its interface respectively/together display prompts corresponding to each broadcast control record.
  • the prompt may be a card displayed on the interface. In the card corresponding to each broadcast control record, information corresponding to the broadcast control record may be displayed.
  • the information in the card can hide part or all of the information corresponding to the broadcast control record, and only provide the content that the user can identify the corresponding relationship between the card and the user, which can help users Confidentiality effects related to privacy of the viewing history of video streams.
  • the first broadcast control record further includes device information of the second electronic device.
  • the broadcast control record may also include device information of the mobile phone that generated the broadcast control record, that is, the mobile phone that played the video stream before.
  • the device information may include the model of the mobile phone, software information, and the like.
  • the first electronic device adjusts and plays the first multimedia stream according to the device information of the second electronic device.
  • a method for ensuring that the TV can play the first multimedia stream normally is provided.
  • the TV can know the playback environment of the video stream on the mobile phone according to the device information included in the broadcast control record. Combined with the playback capability of the multimedia stream that the TV can provide, it can ensure the normal playback of the multimedia stream on the TV.
  • the method further includes: when the first electronic device plays the first multimedia stream, acquiring a third broadcast control record for playing the first multimedia stream, and the third broadcast control record is used to indicate The third time to which the first multimedia stream is currently being played.
  • the first electronic device sends the third broadcast control record to the second electronic device, so that the second electronic device can continue to play the first multimedia stream from a third time according to the third broadcast control record.
  • the TV can generate the corresponding broadcast control record according to the video stream being played, and generate the broadcast control record according to a certain period or in real time and send it to the mobile phone. So that when the user wants to use the mobile phone to continue watching the video stream, the mobile phone can provide the user with a breakpoint resuming service according to the broadcast control record.
  • a device for playing a multimedia stream which is applied to a first electronic device having a function of playing a multimedia stream.
  • the device includes: a detection unit, an acquisition unit, and a playback unit.
  • the detection unit is used for detecting the first biometric information
  • the first biometric information is used to identify the first user, and different users have different biometric information.
  • the obtaining unit is configured to obtain the first broadcast control record corresponding to the first user according to the first biometric identification information.
  • the first broadcast control record is obtained from the second electronic device, the first broadcast control record includes the first time of the first multimedia stream recorded by the second electronic device, and the second electronic device corresponds to the first user Electronic equipment.
  • the playing unit is configured to play the first multimedia stream from the first time according to the first broadcast control record.
  • the first time of the first multimedia stream recorded by the second electronic device is the time when the second electronic device is interrupted in the process of playing the first multimedia stream.
  • the operation corresponding to the interruption includes the operation of stopping, pausing or exiting the playback of the first multimedia stream.
  • the obtaining unit is further configured to obtain the first broadcast control record from the second electronic device when the second electronic device and the first electronic device are in the same local area network.
  • the detection unit is configured to trigger the detection of the first biometric identification information when the screen is woken up.
  • the detection unit is configured to trigger the detection of the first biometric identification information when the image acquisition module and/or the sound acquisition module provided on the first electronic device detects the user.
  • the detection unit is configured to trigger the detection of the first biometric identification information when an operation of the first electronic device by the user is detected.
  • the obtaining unit is configured to match the detected first biometric information with the stored second biometric information of the first user, and obtain the first broadcast corresponding to the first user according to the matching result. control records.
  • the second biometric identification information of the first user is obtained from the second electronic device.
  • the acquiring unit is further configured to acquire the second biometric identification information of the first user from the second electronic device when the second electronic device and the first electronic device are in the same local area network.
  • the obtaining unit is configured to obtain the second biometric identification information of the first user from the second electronic device when the second electronic device obtains the authorization information of the first user.
  • a secure world is provided in the first electronic device, and the apparatus further includes: a storage unit configured to store the acquired second biometric identification information of the first user in the TE.
  • the detection unit is further configured to detect third biometric identification information, and the third biometric identification information is used to identify the second user.
  • the obtaining unit is configured to obtain the second broadcast control record corresponding to the second user according to the third biometric information.
  • the second broadcast control record is obtained from the third electronic device.
  • the second broadcast control record includes the second time of the second multimedia stream recorded by the third electronic device, where the third electronic device is an electronic device corresponding to the second user.
  • the playing unit is configured to play the second multimedia stream from the second time according to the second broadcast control record.
  • the playing unit is configured to continue playing the first multimedia stream from the first time directly on the interface of the first electronic device according to the first broadcast control record.
  • a playback unit configured to display a first prompt corresponding to the first broadcast control record on the interface of the first electronic device according to the first broadcast control record. The first electronic device receives the first operation to the first prompt, and in response to the first operation, the first electronic device continues to play the first multimedia stream from the first time on the interface.
  • the playback unit when the first electronic device detects the first biometric identification information of the first user and the second biometric identification information of the second user at the same time, the playback unit is configured to record and Second broadcast control recording, play the first multimedia stream or the second multimedia stream according to the priority. Or a playing unit, configured to randomly select and play the first multimedia stream or the second multimedia stream according to the first broadcast control record and the second broadcast control record. Or a playing unit, configured to play the first multimedia stream or the second multimedia stream according to the user's selection.
  • the playing unit is further configured to display prompt information recorded by the first broadcast control, where the prompt information hides all or part of the information related to the first multimedia stream.
  • the first broadcast control record further includes device information of the second electronic device.
  • the playing unit is further configured to adjust and play the first multimedia stream according to the device information of the second electronic device.
  • the obtaining unit is further configured to obtain a third broadcast control record for playing the first multimedia stream when the first multimedia stream is played, and the third broadcast control record is used to indicate the first multimedia stream.
  • the device further includes a sending unit for the first electronic device to send the third broadcast control record to the second electronic device, so that the second electronic device can continue to play the first multimedia stream from a third time according to the third broadcast control record .
  • an electronic device comprising one or more processors and one or more memories; one or more memories coupled to the one or more processors, the one or more memories Computer instructions are stored; when the one or more processors execute the computer instructions, the communication device is caused to perform the method for playing a multimedia stream according to any one of the first aspect and possible designs thereof.
  • a chip system in a fourth aspect, is provided, and the chip system can be applied to public equipment (such as a TV).
  • the chip system includes an interface circuit and a processor; the interface circuit and the processor are interconnected by a line; the interface circuit is used to receive a signal from a memory of the electronic device and send a signal to the processor, and the signal includes computer instructions stored in the memory. ;
  • the processor executes the computer instruction, the chip system executes the method for playing a multimedia stream according to any one of the first aspect and its possible designs.
  • a fifth aspect provides a computer-readable storage medium, the computer-readable storage medium comprising computer instructions that, when the computer instructions are executed, execute the multimedia stream as described in any one of the first aspect and possible designs thereof. play method.
  • a sixth aspect provides a computer program product, the computer program product includes instructions, when the computer program product runs on a computer, the computer can execute any one of the first aspect and its possible designs according to the instructions The playback method of the multimedia stream.
  • a method for playing a multimedia stream is provided, which is applied to a first electronic device having a function of playing a multimedia stream.
  • the method includes: the first electronic device obtains a first broadcast control record, and the first broadcast control record includes the first The first time of the first multimedia stream recorded by the electronic device, where the first multimedia stream is played by the first electronic device to the first user.
  • the first electronic device sends the first broadcast control record to the second electronic device, so that the second electronic device can continue to play the first multimedia stream to the first user from the first time according to the first broadcast control record.
  • a solution is provided so that a first electronic device (eg, a mobile phone) can provide a second electronic device (eg, a TV) with a broadcast control record for resuming the broadcast from a break point.
  • a first electronic device eg, a mobile phone
  • a second electronic device eg, a TV
  • a broadcast control record for resuming the broadcast from a break point.
  • acquiring the first broadcast control record by the first electronic device includes: when the first electronic device detects an operation of interrupting the playback of the first multimedia stream, generating the first broadcast control record, wherein, The operation corresponding to the interruption includes the operation of stopping, pausing or exiting the playback of the first multimedia stream.
  • a specific solution for generating a broadcast control record by a mobile phone is provided.
  • the mobile phone may generate and store the playback control record when receiving an instruction to interrupt playback input by the user.
  • the first electronic device sending the first broadcast control record to the second electronic device includes: when the second electronic device and the first electronic device are in the same local area network, sending the first electronic device to the second electronic device.
  • the second electronic device sends the first broadcast control record.
  • a solution for sharing broadcast control records among different electronic devices is provided.
  • a broadcast control record can be stored in the mobile phone.
  • the mobile phone and the second electronic device such as a TV
  • the mobile phone can actively send the broadcast control record to the TV, or the mobile phone can receive the broadcast control record from the TV.
  • the broadcast control record is sent to the TV.
  • the method before the first electronic device sends the first broadcast control record to the second electronic device, the method further includes: the first electronic device sends the first biometric identification of the first user to the second electronic device information, so that the second electronic device determines, according to the first biometric identification information, to continue playing the first multimedia stream according to the first broadcast control record.
  • a sharing scheme of biometric information is provided.
  • the user's biometric information can be stored in the mobile phone, and the mobile phone can actively send the biometric information to the TV when it is in the same local area network as the TV for the first time, or send the biometric information at the request of the TV.
  • the mobile phone may obtain authorization from the user before sending the biometric information to the TV, thereby enhancing the security of the biometric information.
  • a device for playing a multimedia stream which is applied to a first electronic device having a function of playing a multimedia stream, the device comprising: an acquiring unit and a sending unit.
  • the acquiring unit is configured to acquire a first broadcast control record, where the first broadcast control record includes the first time of the first multimedia stream recorded by the first electronic device, wherein the first multimedia stream is the first electronic device to the first multimedia stream. played by a user.
  • the sending unit is configured to send the first broadcast control record to the second electronic device, so that the second electronic device can continue to play the first multimedia stream to the first user from the first time according to the first broadcast control record.
  • the acquiring unit is specifically configured to generate a first broadcast control record when an operation of interrupting the playback of the first multimedia stream is detected, wherein the operation corresponding to the interruption includes stopping, pausing or exiting the first broadcast control record.
  • a multimedia stream playback operation is specifically configured to generate a first broadcast control record when an operation of interrupting the playback of the first multimedia stream is detected, wherein the operation corresponding to the interruption includes stopping, pausing or exiting the first broadcast control record.
  • the sending unit is configured to send the first broadcast control record to the second electronic device when the second electronic device and the first electronic device are in the same local area network.
  • the sending unit is further configured to send the first biometric identification information of the first user to the second electronic device when the second electronic device is in the same local area network as the first electronic device, so as to facilitate the second electronic device
  • the electronic device determines, according to the first biometric identification information, to continue playing the first multimedia stream according to the first broadcast control record.
  • an electronic device comprising one or more processors and one or more memories; one or more memories coupled to the one or more processors, the one or more memories Computer instructions are stored; when the one or more processors execute the computer instructions, the communication device is caused to perform the method for playing a multimedia stream according to any one of the first aspect and possible designs thereof.
  • a chip system in a tenth aspect, is provided, and the chip system can be applied to public equipment (such as a TV).
  • the chip system includes an interface circuit and a processor; the interface circuit and the processor are interconnected by a line; the interface circuit is used to receive a signal from a memory of the electronic device and send a signal to the processor, and the signal includes computer instructions stored in the memory. ;
  • the processor executes the computer instruction, the chip system executes the method for playing a multimedia stream according to any one of the first aspect and its possible designs.
  • a computer-readable storage medium includes computer instructions that, when the computer instructions are executed, execute the multimedia stream as described in any one of the first aspect and possible designs thereof. playback method.
  • a twelfth aspect provides a computer program product, the computer program product includes instructions, when the computer program product runs on a computer, the computer can execute any one of the first aspect and its possible designs according to the instructions The playback method of the multimedia stream described in item.
  • a thirteenth aspect provides a system for playing multimedia streams.
  • the playback system includes at least a first electronic device and a second electronic device.
  • the first electronic device may be a public device involved in the embodiments of the application, for example, the first electronic device may be a television.
  • the second electronic device may be a private device involved in the embodiment of the application, for example, the second electronic device may be a mobile phone.
  • the first electronic device may be the apparatus provided by the second aspect or the electronic device provided by the third aspect.
  • the second electronic device may be the apparatus provided in the eighth aspect or the electronic device provided in the ninth aspect.
  • the system for playing multimedia streams can be used to execute any one of the methods for playing multimedia streams provided in the above first aspect and its possible designs, and/or the user executes the above seventh aspect and The playback method of the multimedia stream provided in any one of its possible designs.
  • the second electronic device may be configured to acquire a first broadcast control record, where the first broadcast control record includes the first time of the first multimedia stream recorded by the second electronic device, wherein the first multimedia stream is played by the second electronic device to the first user.
  • the second electronic device may also be used to send the first broadcast control record to the first electronic device.
  • the first electronic device may be used to detect first biometric information, the first biometric information is used to identify the first user, and different users have different biometric information.
  • the first electronic device may also be configured to acquire the first broadcast control record corresponding to the first user according to the first biometric information.
  • the first electronic device may also be configured to play the first multimedia stream from the first time according to the first broadcast control record.
  • system for playing multimedia streams may also be used to perform all or part of the steps in the methods for playing other multimedia streams provided in the embodiments of the present application.
  • Fig. 1 is a kind of schematic diagram of breakpoint resuming
  • FIG. 2 is a schematic diagram of the composition of an electronic device provided by an embodiment of the present application.
  • FIG. 3 is a schematic diagram of a scenario of resuming playback of a multimedia stream from a breakpoint according to an embodiment of the present application
  • FIG. 4 is a schematic flowchart of a method for resuming playback of a multimedia stream from a breakpoint according to an embodiment of the present application
  • 5A is a schematic diagram of an input interface for biometric identification information provided by an embodiment of the present application.
  • FIG. 5B is a schematic diagram of sharing biometric identification information according to an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a user authorization interface provided by an embodiment of the present application.
  • FIG. 7 is a schematic diagram of a screen wake-up scenario provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram of a public device actively collecting biometric identification information of a user according to an embodiment of the present application
  • FIG. 9 is a schematic diagram of another public device actively collecting biometric identification information of a user according to an embodiment of the present application.
  • FIG. 10 is a schematic diagram of an interface for resuming playback from a breakpoint provided by an embodiment of the present application.
  • FIG. 11 is a schematic diagram of another interface for resuming playback from a breakpoint provided by an embodiment of the present application.
  • FIG. 12 is a schematic diagram of another kind of prompt information for resuming playback from a breakpoint provided by an embodiment of the present application.
  • FIG. 13 is another interface schematic diagram of resuming playback from a breakpoint provided by an embodiment of the present application.
  • FIG. 14 is a schematic flowchart of another method for resuming playback of a multimedia stream from a breakpoint provided by an embodiment of the present application
  • 15 is a schematic diagram of the composition of a device for playing a multimedia stream provided by an embodiment of the present application.
  • FIG. 16 is a schematic diagram of the composition of an electronic device provided by an embodiment of the application.
  • FIG. 17 is a schematic diagram of the composition of a chip system provided by an embodiment of the present application.
  • FIG. 18 is a schematic diagram of the composition of another apparatus for playing a multimedia stream provided by an embodiment of the present application.
  • 19 is a schematic diagram of the composition of another electronic device provided by an embodiment of the present application.
  • FIG. 20 is a schematic diagram of the composition of another chip system provided by an embodiment of the present application.
  • FIG. 21 is a schematic group diagram of a system for playing a multimedia stream provided by an embodiment of the present application.
  • the multimedia playback service provided by electronic equipment has become one of its essential functions.
  • the multimedia playing service provided by the electronic device may be used to play multimedia files, and the multimedia files may include but are not limited to multimedia files obtained from a network.
  • multimedia files may include continuous data streams, such as video streams, audio streams, and the like.
  • the multimedia file may be referred to as a multimedia stream.
  • the video stream may also be referred to as a network video, or a network video stream, or an online video, or an online video stream.
  • the electronic device capable of playing the video stream may include, but is not limited to, a mobile phone, a tablet computer, a laptop computer, a TV, etc., which are provided with a display screen and can perform data interaction with the network.
  • the electronic device can obtain the data of the video stream from the network, and play the video stream through a corresponding application (application, APP) or webpage or a local player, thereby providing the user with the corresponding video stream.
  • Multimedia playback service may include, but is not limited to, a mobile phone, a tablet computer, a laptop computer, a TV, etc., which are provided with a display screen and can perform data interaction with the network.
  • the electronic device can obtain the data of the video stream from the network, and play the video stream through a corresponding application (application, APP) or webpage or a local player, thereby providing the user with the corresponding video stream.
  • Multimedia playback service may include, but is not limited to, a mobile phone, a tablet computer, a laptop computer, a TV
  • switching playback of video streams between different electronic devices has become a common scenario.
  • a user may use his mobile phone to watch a video stream while commuting (eg, to or from get off work). After the user returns to their home, the video stream can continue to be viewed using the TV in the home.
  • the switched playback device (such as a TV) can Provide users with the service of resuming playback from a breakpoint, so that when the video stream is switched from the mobile phone to the TV for playback, the TV can continue to play the video stream from the breakpoint of the video stream played on the mobile phone, thereby providing users with a better viewing experience .
  • the above-mentioned continuous playback of the video stream from the breakpoint position may be referred to as the breakpoint continuation of the video stream.
  • FIG. 1 shows a schematic diagram of resuming playback from a breakpoint.
  • the user can watch the video stream 1 through his mobile phone.
  • the video stream 1 is 90 minutes long, and the user currently uses a mobile phone to watch a position of 20 minutes and 12 seconds (ie, 20:12 as shown in (a) of FIG. 1 ).
  • the TV can obtain the current video stream 1 through direct or indirect interaction with the mobile phone (such as through a network server, etc.).
  • the timestamp position of the playback eg 20 minutes and 12 seconds).
  • the television can continue to play the video stream 1 from the time stamp position, so that the user can continue to watch the video stream 1 on the television.
  • Option 1 Display the relevant information of the breakpoint resuming to the user in the form of a QR code, so that the user can request the breakpoint resuming on different electronic devices by scanning the QR code.
  • the information about resuming the broadcast may include the address of the remote server.
  • Playback information such as the type and progress of the video stream watched by the user on the electronic device 1 can be stored in the remote server.
  • the user wants to resume the broadcast from a breakpoint through the electronic device 2 he can scan the two-dimensional code displayed on the electronic device 2 to connect to the above-mentioned remote server, and use the two-dimensional code as the entry to request the remote server to send the electronic device 2 to the remote server.
  • Sending playback information so that the electronic device 2 can resume playback from a breakpoint according to the playback information.
  • Option 2 Resuming playback from a breakpoint can also be implemented through the built-in mechanism of the APP.
  • the playback progress of the video stream and the login account information for watching the video stream can be stored in the corresponding application server.
  • the user wants to continue watching the video stream through the electronic device 2 he can use the above login account information to log in to the APP1 on the electronic device 2, so as to obtain the playback progress of the video stream from the application server and implement a breakpoint on the electronic device 2 Resume.
  • the user needs to scan the QR code on the electronic device 2 to request playback information, so as to control the electronic device 2 to resume playback from a breakpoint.
  • this solution relies on the user's active control, and cannot realize the active breakpoint continuation on the electronic device side.
  • the interaction problem between the user and the electronic device (such as the above-mentioned electronic device 2 ) is prone to occur.
  • the solution also requires the participation of a remote server. Therefore, when there is a problem in the communication between the electronic device 1 and the remote server and/or the communication between the electronic device 2 and the remote server, it will result in a failure to resume playback.
  • the login account information of the fixed APP is relied on, so it has great limitations.
  • the user uses APP2 to watch the video stream on the electronic device 1, but the APP2 does not directly or indirectly provide the service of resuming the playback from a breakpoint, then the resumable playback on different electronic devices cannot be realized.
  • this solution also has problems such as relying on the user's active control and requiring many electronic devices to participate (eg, requiring the participation of an application server), which increases the instability of resuming playback from a breakpoint.
  • an embodiment of the present application provides a method for resuming playback of a multimedia stream from a breakpoint.
  • different electronic devices can interact autonomously to realize the sharing of broadcast information.
  • the electronic device that plays the multimedia stream can adaptively select relevant information of the multimedia stream corresponding to the current user according to the user's biometric information (such as face information, voiceprint information, etc.) to resume the playback from a breakpoint. Therefore, while providing a fast and stable resuming function from a breakpoint, the user can be actively identified and a corresponding resuming of the breakpoint can be provided without requiring the user to perform active control. As a result, users can be provided with an accurate and stable resuming service from a breakpoint.
  • the method for resuming playback from a breakpoint may be applied to an electronic device of a user.
  • the electronic device may be a mobile phone, a tablet computer, a personal digital assistant (PDA), an augmented reality (AR) ⁇ virtual reality (VR) device, a media player, a TV, a speaker, etc.
  • PDA personal digital assistant
  • AR augmented reality
  • VR virtual reality
  • media player a TV
  • TV a speaker
  • the specific form of the device is not particularly limited in this embodiment of the present application.
  • FIG. 2 is a schematic diagram of the composition of an electronic device 100 according to an embodiment of the present application.
  • the methods for resuming playback of multimedia streams provided in the embodiments of the present application can all be applied to the electronic device 100 shown in FIG. 2 .
  • the electronic device 100 may include a processor 101, a display screen 103, a communication module 102, and the like.
  • the processor 101 may include one or more processing units, for example, the processor 101 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal Image signal processor (ISP), controller, memory, video stream codec, digital signal processor (DSP), baseband processor, and/or neural-network processing unit , NPU) etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors 101 .
  • application processor application processor, AP
  • modem processor graphics processor
  • ISP image signal Image signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • different processing units may be independent devices, or may be integrated in one or more processors 101 .
  • the controller may be the nerve center and command center of the electronic device 100 .
  • the controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 101 for storing instructions and data.
  • the memory in processor 101 is a cache memory.
  • the memory may hold instructions or data that have just been used or recycled by the processor 101 . If the processor 101 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 101 is reduced, thereby improving the efficiency of the system.
  • the processor 101 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor 101 interface (mobile industry processor interface, MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface 111 and the like.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • mobile industry processor 101 interface mobile industry processor interface, MIPI
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB universal serial bus
  • the electronic device 100 implements a display function through a GPU, a display screen 103, an application processor 101, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 103 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 101 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display screen 103 is used to display images, video streams, and the like.
  • the display screen 103 includes a display panel.
  • the display panel can be a liquid crystal display 103 (liquid crystal display, LCD), an organic light-emitting diode (organic light-emitting diode, OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
  • light emitting diode, AMOLED organic light-emitting diode
  • flexible light emitting diode flex light-emitting diode, FLED
  • Miniled MicroLed, Micro-oLed, quantum dot light emitting diode (quantum dot light emitting diodes, QLED), etc.
  • the electronic device 100 may include 1 or N display screens 103 , where N is a positive integer greater than 1.
  • Communication module 102 may include antenna 1, antenna 2, mobile communication module 102A, and/or wireless communication module 102B. Take the communication module 102 including the antenna 1, the antenna 2, the mobile communication module 102A and the wireless communication module 102B as an example.
  • the wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 102A, the wireless communication module 102B, the modem processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 102A can provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the electronic device 100 .
  • the mobile communication module 102A may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and the like.
  • the mobile communication module 102A can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 102A can also amplify the signal modulated by the modulation and demodulation processor, and then convert it into electromagnetic waves and radiate it out through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 102A may be provided in the processor 101 .
  • at least part of the functional modules of the mobile communication module 102A may be provided in the same device as at least part of the modules of the processor 101 .
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low frequency baseband signal is processed by the baseband processor and passed to the application processor.
  • the application processor outputs sound signals through an audio device (not limited to the speaker 106A, the receiver 106B, etc.), or displays an image or video stream through the display screen 103 .
  • the modem processor may be a stand-alone device.
  • the modulation and demodulation processor may be independent of the processor 101, and be provided in the same device as the mobile communication module 102A or other functional modules.
  • the wireless communication module 102B can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellites Wireless communication solutions such as global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared technology (IR).
  • WLAN wireless local area networks
  • BT Bluetooth
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication
  • IR infrared technology
  • the wireless communication module 102B may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 102B receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 101 .
  • the wireless communication module 102B can also receive the signal to be sent from the processor 101, perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
  • the antenna 1 of the electronic device 100 is coupled with the mobile communication module 102A, and the antenna 2 is coupled with the wireless communication module 102B, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (global positioning system, GPS), global navigation satellite system (global navigation satellite system, GLONASS), Beidou navigation satellite system (beidou navigation satellite system, BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite based augmentation systems (SBAS).
  • global positioning system global positioning system, GPS
  • global navigation satellite system global navigation satellite system, GLONASS
  • Beidou navigation satellite system beidou navigation satellite system, BDS
  • quasi-zenith satellite system quadsi -zenith satellite system, QZSS
  • SBAS satellite based augmentation systems
  • the communication module 102 in the mobile phone may include a mobile communication module 102A and a wireless communication module 102B.
  • the video stream data of the video stream can be obtained from the network through the 3G/4G/5G-based communication solution of the mobile communication module 102A, and the video stream can be played according to the video stream data.
  • the mobile phone can also acquire the video stream data of the video stream from the network through the wireless communication module 102B based on a communication solution such as WLAN/BT, and play the video stream according to the video stream data.
  • the electronic device 100 is taken as an example of a television.
  • the communication module 102 in the television may include a wireless communication module 102B.
  • the video stream data of the video stream can be obtained from the network through the wireless communication module 102B based on a communication solution such as WLAN/BT, and the video stream can be played according to the video stream data.
  • the communication module 102 may also be used for interaction between electronic devices without passing through them.
  • the electronic device 1 and the electronic device 2 may share the biometric information through the communication module 102 provided therein.
  • the electronic device 1 and the electronic device 2 may also share the broadcast control record through the communication module 102 provided therein.
  • the electronic device 100 may further include an external memory interface 110 , an internal memory 104 , a universal serial bus (USB) interface, a charging management module 112 , and a power management module 113 , battery 114, audio module 106, speaker 106A, receiver 106B, microphone 106C, headphone jack 106D, sensor module 105, button 109, motor, indicator 108, camera 107, and subscriber identification module (SIM) card interface Wait.
  • an external memory interface 110 an internal memory 104 , a universal serial bus (USB) interface, a charging management module 112 , and a power management module 113 , battery 114, audio module 106, speaker 106A, receiver 106B, microphone 106C, headphone jack 106D, sensor module 105, button 109, motor, indicator 108, camera 107, and subscriber identification module (SIM) card interface Wait.
  • SIM subscriber identification module
  • the electronic device 100 can realize the shooting function through the ISP, the camera 107, the video stream codec, the GPU, the display screen 103 and the application processor 101 and the like.
  • the ISP is used to process the data fed back by the camera 107 .
  • the shutter is opened, the light is transmitted to the photosensitive element of the camera 107 through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera 107 transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin tone. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be located in the camera 107.
  • Camera 107 is used to capture still images or video streams.
  • the object is projected through the lens to generate an optical image onto the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the electronic device 100 may include 1 or N cameras 107 , where N is a positive integer greater than 1.
  • a digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy and so on.
  • Video stream codecs are used to compress or decompress digital video streams.
  • the electronic device 100 may support one or more video stream codecs. In this way, the electronic device 100 can play or record video streams in various encoding formats, such as: Moving Picture Experts Group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
  • MPEG Moving Picture Experts Group
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the electronic device 100 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • the charging management module 112 is used to receive charging input from the charger.
  • the charger may be a wireless charger or a wired charger.
  • the charging management module 112 may receive charging input from the wired charger through the USB interface 111 .
  • the charging management module 112 may receive wireless charging input through a wireless charging coil of the electronic device 100 . While the charging management module 112 charges the battery 114 , the electronic device 100 can also be powered by the power management module 113 .
  • the power management module 113 is used to connect the battery 114 , the charging management module 112 and the processor 101 .
  • the power management module 113 receives input from the battery 114 and/or the charging management module 112, and supplies power to the processor 101, the internal memory 104, the external memory, the display screen 103, the camera 107, and the wireless communication module 102B.
  • the power management module 113 can also be used to monitor parameters such as the capacity of the battery 114 , the number of cycles of the battery 114 , and the health status (electric leakage, impedance) of the battery 114 .
  • the power management module 113 may also be provided in the processor 101 .
  • the power management module 113 and the charging management module 112 may also be provided in the same device.
  • the external memory interface 110 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 .
  • the external memory card communicates with the processor 101 through the external memory interface 110 to realize the data storage function. For example to save files like music, video stream etc in external memory card.
  • Internal memory 104 may be used to store computer executable program code, which includes instructions.
  • the processor 101 executes various functional applications and data processing of the electronic device 100 by executing the instructions stored in the internal memory 104 .
  • the internal memory 104 may include a stored program area and a stored data area.
  • the storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like.
  • the storage data area can store data (such as audio data, phone book, etc.) created during the use of the electronic device 100 and the like.
  • the internal memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the electronic device 100 may implement audio functions through the audio module 106 , the speaker 106A, the receiver 106B, the microphone 106C, the headphone jack 106D, and the application processor 101 and the like. Such as music playback, recording, etc.
  • the audio module 106 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 106 may also be used to encode and decode audio signals. In some embodiments, the audio module 106 may be provided in the processor 101 , or some functional modules of the audio module 106 may be provided in the processor 101 .
  • Speaker 106A also referred to as “speaker” is used to convert audio electrical signals into sound signals.
  • Electronic device 100 can listen to music through speaker 106A, or listen to hands-free calls.
  • the receiver 106B also referred to as an "earpiece" is used to convert audio electrical signals into sound signals.
  • the voice can be answered by placing the receiver 106B close to the human ear.
  • the microphone 106C also referred to as “microphone” or “microphone”, is used to convert sound signals into electrical signals.
  • the user can make a sound by approaching the microphone 106C through a human mouth, and input the sound signal into the microphone 106C.
  • the electronic device 100 may be provided with at least one microphone 106C.
  • the electronic device 100 may be provided with two microphones 106C, which may implement a noise reduction function in addition to collecting sound signals.
  • the electronic device 100 may further be provided with three, four or more microphones 106C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.
  • the headphone jack 106D is used to connect wired headphones.
  • the sensor module 105 in the electronic device 100 may include a touch sensor, a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, an ambient light sensor, a fingerprint sensor, a temperature sensor, a bone conduction sensor, etc. components to achieve sensing and/or acquisition functions for different signals.
  • the keys 109 include a power-on key, a volume key, and the like.
  • the keys 109 may be mechanical keys 109 .
  • the touch key 109 may also be used.
  • the electronic device 100 may receive key 109 inputs and generate key signal inputs related to user settings and function control of the electronic device 100 .
  • the motor can generate vibrating cues.
  • the motor can be used for incoming call vibration alerts or for touch vibration feedback.
  • touch operations acting on different applications can correspond to different vibration feedback effects.
  • touch operations on different areas of the display screen 103 the motors can also correspond to different vibration feedback effects.
  • Different application scenarios for example: time reminder, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 108 can be an indicator light, which can be used to indicate the charging status, the change of power, and can also be used to indicate messages, missed calls, notifications, and the like.
  • the SIM card interface is used to connect the SIM card.
  • the SIM card can be contacted and separated from the electronic device 100 by inserting into the SIM card interface or pulling out from the SIM card interface.
  • the electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • the SIM card interface can support Nano SIM card, Micro SIM card, SIM card, etc.
  • the same SIM card interface can insert multiple cards at the same time.
  • the types of the plurality of cards may be the same or different.
  • the SIM card interface can also be compatible with different types of SIM cards.
  • the SIM card interface is also compatible with external memory cards.
  • the electronic device 100 interacts with the network through the SIM card to implement functions such as call and data communication.
  • the electronic device 100 employs an eSIM, ie: an embedded SIM card.
  • the eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100 .
  • the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100 .
  • the electronic device 100 may include more or fewer components than shown, or some components may be combined, or some components may be split, or a different arrangement of components.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • an operating system may run, and different application programs (ie, APPs) may be installed in the operating system.
  • the electronic device 100 may run one or more APPs through its operating system to implement corresponding functions.
  • a media player may be installed in the operating system, and when the media player is running, the multimedia streaming playback function of the electronic device 100 may be implemented.
  • Video streaming APPs can also be installed in the operating system, such as (BilibiliTM APP, iQIYI TM APP, YouTubeTM APP), etc. When running this video streaming APP, electronic devices can be implemented. 100 The function of acquiring and playing the video stream from the application server corresponding to the APP.
  • a secure world trusted execution environment, TE
  • a common world rich execution environment, RE
  • the TE and the RE may be virtual operating systems provided in the electronic device 100 with functions of independent storage, processing, and communication.
  • TE can be used to process data with higher security requirements.
  • TEs can be used to process/store operations related to biometric information.
  • RE can be used to process data with less security requirements.
  • the RE may be used for processing/storing operations related to the broadcast control information of the multimedia stream.
  • the TE may send the user matching result to the RE, so that the RE can resume the broadcast according to the breakpoint.
  • communication may also be performed between TEs in different electronic devices, or between REs in different electronic devices.
  • the TE1 in the electronic device 1 can share the biometric information of the user stored therein to the TE2 in the electronic device 2 .
  • the RE1 in the electronic device 1 may share the broadcast control record stored therein to the RE2 in the electronic device 2.
  • the above-mentioned secure world can also be used to refer to a trusted execution environment (for example, the English abbreviation can be TEE), and the above-mentioned common world can also be used to refer to a non-secure world or a common execution environment (such as The English abbreviation can be REE).
  • TEE trusted execution environment
  • REE common execution environment
  • the method for resuming playback from a breakpoint may be implemented by the electronic device 100 as shown in FIG. 2 .
  • the electronic device 100 can be used to monitor the operation of interrupting the playing of the video stream input by the user in the process of watching the video stream.
  • the operation may include an operation inputted by the user to stop the playback of the video stream, or pause the playback of the video stream, or exit the playback of the video stream.
  • the electronic device 100 may be configured to generate and store a playback control record corresponding to the video stream according to the operation of interrupting the playback of the video stream input by the user.
  • the electronic device 100 can also be used to share the broadcast control record with other electronic devices 100 in the same local area network.
  • the electronic device 100 can also be used to share other information, such as the user's biometric identification information, with other electronic devices in the same local area network.
  • the electronic device 100 can also be used to actively detect the biometric information of the current user, and determine the user and the broadcast control record corresponding to the user accordingly. Further, according to the broadcast control record, the broadcast is resumed from the breakpoint.
  • the electronic devices may be an electronic device (eg, electronic device A) that stores a part of the multimedia stream that has been played for the user.
  • the other electronic device may be the electronic device that is about to continue playing the multimedia stream (eg, referred to as electronic device B).
  • the breakpoint resuming method provided by the embodiment of the application can be applied to the above scenario including one electronic device A and one electronic device B, and can also be applied to the scenario including multiple electronic devices A.
  • FIG. 3 shows a schematic diagram of a scenario of resuming playback of a multimedia stream from a breakpoint provided by an embodiment of the present application.
  • the scenario may include N+1 electronic devices, where N is an integer greater than or equal to 1.
  • One of the electronic devices may correspond to the electronic device B, that is, the electronic device that will continue to play the multimedia stream.
  • Other electronic devices (mobile phone 1 to mobile phone N as shown in FIG. 3 ) may correspond to electronic device A, that is, electronic devices that store a part of the multimedia stream that has been played for the user.
  • each mobile phone may correspond to a user. Therefore, in this scenario, the TV can be used to provide the N users respectively corresponding to the N mobile phones with the breakpoint resuming service.
  • an electronic device such as a television as shown in FIG. 3
  • An electronic device (mobile phone 1 to mobile phone N as shown in FIG. 3 ) that only provides a multimedia stream playing service for one user is called a private device.
  • the public device is a TV and the private device is a mobile phone as an example for illustration, and in some other implementation scenarios, the public device and the private device may have different implementations.
  • public devices may include TVs, smart speakers, etc.
  • private devices may include mobile phones, smart watches, and the like.
  • the method for resuming playback from a breakpoint provided by the embodiment of the application will be described in detail below.
  • the following solution provided by the embodiments of the present application is applied to the scenario shown in FIG. 3 , that is, including one public device (such as a TV) and N private devices (such as mobile phone 1 to mobile phone N),
  • the multimedia stream that is resumed from a breakpoint is a video stream obtained from the network.
  • FIG. 4 is a schematic flowchart of a method for resuming playback of a multimedia stream from a breakpoint according to an embodiment of the present application. As shown in FIG. 4, the method may include S401-S408.
  • the mobile phone sends the biometric information to the TV.
  • the television receives biometric information.
  • the TV stores the corresponding relationship between the biometric information and the user.
  • the biometric information may be the biometric information of the corresponding user of the mobile phone.
  • the biometric information may include the user's face information, and/or the user's voiceprint information. It should be understood that the biometric information of different users is different, and therefore, the biometric information can be used to distinguish different users.
  • the user's biometric information may be stored in the user's mobile phone.
  • face information can be set and stored in his mobile phone, so that the mobile phone can detect the face information of the user using the mobile phone and match the stored face information to confirm the user's identity and realize convenience.
  • Operations related to mobile phone payment, mobile phone unlocking and other functions As an example, when a user wants to enter face information, he or she can enter a corresponding operation on the mobile phone, for example, an operation of entering a "face recognition" interface. In response to this operation, the mobile phone can implement the interface shown in (a) of FIG. 5A . As shown in (a) of FIG.
  • the mobile phone can start collecting the user's face information. After the collection of face information is completed, the interface shown in (b) of FIG. 5A can be displayed. As shown in (b) of FIG. 5A , the entry of the current face information has been completed. After that, the mobile phone can be operated by the user (such as a touch or click operation on the arrow 503 ), or automatically jump to the upper-level interface. For example, the mobile phone can display the interface shown in (c) of FIG. 5A . In this interface, the face information that has been entered can be displayed in the area 501 (face information 1 in the figure). Thus, the input of face information is completed. The mobile phone can save the face information so as to realize subsequent related functions.
  • the biometric identification information is the face information as an example for description.
  • the biometric information may also be voiceprint information, and the input process thereof is similar, which will not be repeated here.
  • the mobile phone may share the biometric identification information stored therein with the TV.
  • the mobile phone when the mobile phone and the TV are in the same local area network, the mobile phone can perform the above-mentioned sharing of biometric information with the TV. That is, S401 shown in FIG. 4 is executed. Since the TV can obtain the biometric information from the mobile phone, the TV does not need to enter the biometric information of each user in advance, and the user only needs to enter the biometric information on the mobile phone, and there is no need to enter the biometric identification for user authentication or identification on the TV. information, which not only simplifies user operations, but biometric information comes from private devices such as mobile phones, which can be more secure.
  • the sharing of biometric information between different devices is taken as an example for description.
  • the user may actively share the biometric information with other devices.
  • a share button 504 as shown in (a) in FIG. 5B may be displayed on the "face recognition" interface.
  • the user wants to control the mobile phone 1 to share the face information 1 with the TV 1, the user can input an operation on the share button 504, for example, click or touch, or control by voice.
  • the mobile phone 1 may perform a sharing process of the face information 1 .
  • the mobile phone 1 can search for other devices in the local area network where it is located.
  • the mobile phone 1 can display a prompt box 505 as shown in (b) in FIG. 5B on the interface.
  • the prompt box 505 can include text prompts, such as "Searching for devices".
  • the prompt box 505 may further include icons, dynamic images, etc., for showing the current search status to the user.
  • the mobile phone 1 may display a prompt box 506 as shown in (c) in FIG. 5B on its interface.
  • a text prompt may be displayed in the prompt box 506 to display the search result to the user.
  • the text prompt in the prompt box 506 may include the searched device, such as TV 1 .
  • the user wants to share the face information 1 with the TV 1, he can input an operation on the area corresponding to the device displayed in the prompt box 506, so that the mobile phone 1 can share the face information 1 with the corresponding device.
  • user 1 can input a touch or click operation on "TV 1" in the prompt box 506 shown in (c) of FIG. 5B , and in response to this operation, mobile phone 1 can share face information 1 with TV 1 .
  • biometric information is more important to users and belongs to private data that needs to be kept secret
  • the user's biometric information can be obtained first. authorized.
  • the mobile phone and the TV are in the same local area network as an example.
  • the mobile phone can display a card 601 on the “Face Recognition” interface, so that the mobile phone can determine whether the user is Authorize, and perform subsequent operations.
  • the card 601 may include authorized content.
  • the authorized content may be displayed to the user in the form of a text prompt.
  • the card 601 may also include controls for collecting user input authorization or non-authorization.
  • the card 601 may include a "yes" button 602, and a "no" button 603.
  • the mobile phone receives the operation that the user clicks or touches the "Yes” button, the mobile phone determines that the user agrees to the authorization.
  • the mobile phone receives the operation that the user clicks or touches the "No” button, the mobile phone determines that the user does not agree to the authorization.
  • the mobile phone can also display the card 601 to the user through voice, animation, etc., and the mobile phone can also receive the user's voice instructions, gesture instructions and other operations to determine whether the user is currently operating (such as a face information sharing operations) are authorized.
  • This embodiment of the present application does not specifically limit the authorization mode of the user. After determining that the user is authorized, the mobile phone can transmit the user's biometric identification information stored in it to the TV.
  • the TV After receiving the biometric information sent by the mobile phone, the TV can store the corresponding relationship between the biometric information and the corresponding user.
  • the corresponding relationship may be the corresponding relationship between the face information and the user's identification.
  • the above S401-S403 may be executed when the conditions are met (eg, when it is in the same local area network as the TV).
  • the N mobile phones can respectively transmit the stored biometric identification information of the corresponding user to the TV.
  • the TV may store the acquired correspondence between the N pieces of biometric identification information and the corresponding user.
  • the TV can determine the corresponding user according to the face information. For example, the TV can determine the corresponding user as the user 1 corresponding to the user ID 1 according to the face information 1 .
  • the TV can determine the corresponding user as the user 2 corresponding to the user ID 2 according to the face information 2 .
  • the TV can determine the corresponding user to be the user N corresponding to the user ID N according to the face information N.
  • the television may also store the correspondence between the face information and the user in other manners.
  • the TV when the TV receives the biometric information, it can label the biometric information with a tag corresponding to the user, so that different users can be distinguished and determined according to the biometric information.
  • the mobile phone monitors the playback of the video stream, and obtains a corresponding playback control record.
  • the mobile phone sends the broadcast control record to the TV.
  • the broadcast control record may include video stream information of the corresponding video stream.
  • the video stream information may include the name of the video stream and information used to indicate the current playback position of the video stream.
  • the name of the video stream can be identified by a movie ID (for example, called vodid).
  • the above video stream information may further include the package name of the APP that plays the video stream.
  • the package name can be com.huawei.video, or com.xxx.youku, etc.
  • the electronic device can know the network location (such as the location of the corresponding application server) corresponding to the APP that opens the video stream.
  • the electronic device can extract the video stream data of the video stream from the corresponding network location and play the video stream according to the movie ID.
  • the current playback position of the video stream may be used to indicate the playback progress of the video stream when the playback is interrupted.
  • the current playback position may be identified by the elapsed playback time (eg, called playTime).
  • the current playback progress may be the time stamp of the video stream playing when the playback is paused, stopped, or exited.
  • the current playback progress may be the already played percentage of the video stream playing when the playback is paused, stopped, or exited.
  • the current playback progress may be the unplayed percentage of the video stream when playback is paused, stopped, or exited.
  • the video stream information may also include other information related to the playback of the video stream, such as the playback volume of the video stream, the classification of the video stream, and other information.
  • the broadcast control record may also include device information of the mobile phone.
  • the device information may be used to indicate related information of the mobile phone.
  • the device information may include a unique identifier (Unified Device ID, UDID) of the mobile phone, device type, device manufacturer information, device model, and software version information of the mobile phone, and the like.
  • UDID Unique identifier
  • the electronic device such as a TV
  • the electronic device can know the environment when the video stream is played on the mobile phone when it needs to resume the broadcast according to the broadcast control record. It can guarantee the normal playback of the video stream on the TV.
  • the mobile phone can monitor the playback of the video stream on the mobile phone, and when detecting the operation of interrupting the playback of the video stream input by the user, obtain the playback control record corresponding to the video stream.
  • the operation of interrupting the playback of the video stream input by the user may include the operation of pausing playback or stopping playback or exiting playback.
  • the mobile phone detects that the user has input the above operation of interrupting the playback of the video stream, it can acquire the playback progress information of the current video stream.
  • the mobile phone 1 can monitor the operation of interrupting the playback of the video stream 1 input by the user during the user's viewing of the video stream 1 .
  • the mobile phone 1 can generate the broadcast control information 1 corresponding to the video stream 1 in response to the operation.
  • the mobile phone can share its stored broadcast control record with the TV, so that the TV can resume the broadcast according to the broadcast control record.
  • the mobile phone when the mobile phone and the TV are in the same local area network, the mobile phone can send the broadcast control record stored therein to the TV, so as to realize the sharing of the broadcast control record between the mobile phone and the TV.
  • the TV can respectively receive and store the N mobile phones sent by the N mobile phones.
  • a broadcast control record it should be noted that, in combination with the description of the method shown in FIG. 5B , the user can actively share the broadcast control record on the mobile phone to the TV.
  • the process of the user sharing the broadcast control record may be similar to the operation when the mobile phone 1 shares the face information 1 as shown in FIG. 5B .
  • the user can control the mobile phone 1 to search for devices that can be recorded by the shared broadcast control by operating the mobile phone 1.
  • a device such as TV 1
  • the mobile phone 1 can display the search results to the user, and under the user's operation , and establish a connection with TV 1 to share the broadcast control record with TV 1.
  • a device such as TV 1
  • the mobile phone 1 can display the search results to the user, and under the user's operation , and establish a connection with TV 1 to share the broadcast control record with TV 1.
  • FIG. 5B which will not be repeated here. Understandably, the user can also actively share the broadcast control record on the TV to the mobile phone.
  • the above S401-S403 provide an example of a method for sharing biometric information between a public device and a private device.
  • the above S404-S405 provide an example of a method for sharing a broadcast control record between a public device and a private device.
  • the above-mentioned sharing process of biometric identification information and the sharing process of broadcast control records are not limited in time sequence. For example, when the private device and the public device are under the same local area network for the first time, that is, the sharing of biometric identification information can be performed according to the above S401-S403. At this time, if there is no broadcast control record in the private device, S404-S405 may not be executed.
  • the private device may execute the above S404-S405 when the public device is in the same local area network after acquiring the broadcast control record, so as to realize the sharing of the broadcast control record, and at this time, if the biometric information corresponding to the private device has been If the biometric information stored in the public device (that is, the biometric information stored in the private device has been shared with the public device through the above methods S401-S403 or other methods), the above-mentioned biometric information sharing process may not be performed.
  • the private device may transmit the biometric information stored therein to the public device synchronously or asynchronously each time the broadcast control record is transmitted.
  • the TV obtains the biometric information of the current user.
  • the TV resumes the broadcast from a breakpoint according to the broadcast control record corresponding to the user matching result.
  • the TV can obtain the biometric information of the current user when the screen wakes up.
  • the TV when no user is using the TV (for example, the user is not at home, or the user is resting, etc.), the TV may be in an off-screen state.
  • the screen-off state refers to a state in which the display screen of the TV is turned off, or a screen saver image/black image is displayed on the display screen of the TV.
  • the TV can be switched from the screen-off state to the normal working state.
  • the display screen of the TV can be switched from the off state to the state of displaying the home page interface.
  • the process of switching from the screen-on-screen state to the normal working state is called screen-on-screen wake-up.
  • the wake-up on the TV screen may have different triggering mechanisms.
  • the wake-up on the screen of the TV may be realized by the user through active control.
  • a user can use a device such as a smart speaker, a smart gateway, or a TV remote control to send a wake-up instruction to the TV through voice or operation of the TV remote control.
  • the TV may receive the wake-up instruction, and in response to the wake-up instruction, perform screen wake-up.
  • the TV may determine to perform wake-up on the screen through autonomous detection.
  • some components such as some sensors, cameras, etc.
  • the sensor can actively reduce its sensitivity, and the camera can reduce its image resolution to reduce power consumption while continuing to monitor the surrounding environment. That is to say, when the screen is off, the TV can still detect whether the user appears within a certain range.
  • FIG. 7 When the TV is in an off-screen state, an interface 701 as shown in (a) of FIG. 7 may be displayed.
  • the interface 701 may display a screen saver image, or may be in a black screen state.
  • the TV When the TV detects that the user appears within its playback range, the TV can switch from the screen-off state to the home page shown in (b) in Figure 7 for display, for example, the home page can be as shown in Figure 7 ( b) The interface of 702 shown.
  • the playing range of the TV may be preset, or it may be determined by the TV itself according to the user's usage habits. For example, when the TV is in the screen-off state, when the infrared sensor in the TV detects that the user is within the playback range of the TV, or when the camera in the TV detects that the user is within the playback range of the TV, the TV can determine that there is a playback demand, Then perform screen wake-up.
  • the triggering mechanism for the TV to determine to execute the wake-up on the screen may also be automatically triggered in the smart scenario preset by the user. This embodiment of the present application does not limit the triggering conditions for the TV to perform wake-up on the screen.
  • the TV obtains the biometric information of the current user when the TV wakes up the screen. It may be that the TV starts to collect the biometric information of the current user when the TV starts to wake up the screen, or the TV starts to collect the biometric information of the current user when the screen wakes up. After waking up, such as when the home page interface has been displayed, it starts to obtain the biometric information of the current user.
  • This embodiment of the present application does not limit this. It should be understood that the current user is the user who appears within the range of the television broadcast. The implementation manner of collecting the biometric information of the current user is exemplarily described below.
  • the biometric information is the user's face information as an example.
  • the TV can collect the face information of the users within the broadcasting range of the TV through the components with the image collection function, such as the camera set on the TV.
  • the broadcast range of the TV is AOB.
  • the camera can collect the face information of the user within the range of the AOB, so as to realize the collection of the face information of the user.
  • the television can determine whether the user is within the playing range of the television through the clarity of the collected facial information. It can be understood that when the user is in the AOB area but is far away from the TV, the clarity of the face information acquired by the TV collection will be poor. The TV may not be able to determine the corresponding user based on the face information. Therefore, in this example, the television can determine whether the user is within the play range of the television according to the magnitude relationship between the clarity of the collected facial information and the corresponding preset threshold (eg, the first threshold). For example, when the resolution is greater than the first threshold, it is determined that the user is within the broadcast range of the TV, and the TV can store the face information obtained by this collection as valid information.
  • the first threshold eg, the first threshold
  • the TV can process the corresponding face information as invalid information, such as discarding it.
  • the TV can also be used to determine whether to continue to perform S407-S408 accordingly. For example, if the user is within the playing range of the TV, continue to execute S407. Conversely, if the user is not within the broadcast range of the TV, S407 is not executed.
  • the biometric information is taken as an example of the user's voiceprint information.
  • the TV can collect the user's voiceprint information through a component with a voice collection function, such as a receiver set on the TV. Referring to Figure 9, the TV can collect the user's voiceprint information through its receiver.
  • the TV can determine whether the user is within the playback range of the TV through the volume of the collected voiceprint information, and selectively retain the collected voiceprint information, thereby Improve the reliability of user identification information.
  • the TV can determine whether the user is within the playback range of the TV according to the magnitude relationship between the volume of the collected voiceprint information and the corresponding preset threshold (eg, the second threshold). For example, when the volume of the sound is greater than the second threshold, it is determined that the user is within the playback range of the TV, and the TV can store the voiceprint information obtained by this collection as valid information.
  • the TV can treat the corresponding voiceprint information as invalid information, such as discarding it. It should be understood that the TV can also determine whether the user is within the playing range of the TV through other methods. For example, the TV can collect the user's voiceprint information at the same time through two or more receivers located at different positions (the two receivers shown in FIG. 9 ), respectively, and locate the user accordingly, so as to determine the user Whether it is within the playback range of the TV.
  • the biometric identification information is voiceprint information or face information as an example for description.
  • the biometric information may also include voiceprint information and face information at the same time, or the biometric information may also include other information that can be used to identify the user.
  • the biometric information is used as the face information for exemplary description below.
  • the biometric identification information of the current user is collected as an example when the TV screen wakes up.
  • the TV may trigger the detection of the biometric information of the current user under the control of the user. For example, after detecting the user's operation of opening the video APP1, the TV starts to detect the biometric information of the current user when the video APP1 is opened.
  • the video APP1 may be an APP that plays multimedia streams.
  • the TV can collect and store the face information of the current user.
  • the television may also store a correspondence between the face information of the user using the television and the user's identifier (for example, the correspondence may be the correspondence shown in Table 1).
  • the TV can compare the stored face information obtained from the mobile phone, thereby determining the current user.
  • the TV can determine that the current user can be the user 1 corresponding to the user ID 1.
  • the TV can determine that the current user can be the user 2 corresponding to the user ID 2.
  • the TV can determine that the current user can be the user N corresponding to the user ID N.
  • the TV can obtain the broadcast control record corresponding to the user using the mobile phone from the mobile phone.
  • the mobile phone and the TV are also in the same local area network. Therefore, the TV can obtain the broadcast control record corresponding to the current user from the mobile phone of the current user.
  • the TV can also obtain other broadcast control records from the mobile phones of other users in the same local area network. Therefore, in this example, in order to enable the TV to accurately provide the current user with accurate resuming from the break point, the TV can determine the broadcast control record corresponding to the current user according to the determined current user, and perform the interruption according to the broadcast control record. Click to resume.
  • the TV obtains the corresponding broadcast control record from the mobile phone of the first user before detecting the biometric information of the current user as an example for description.
  • the TV may also acquire the corresponding broadcast control record from the user's mobile phone after detecting the biometric information of the current user and determining the user accordingly.
  • the TV may determine that the biometric information corresponds to User 1 according to the correspondence between the user's biometric information obtained in S401-S403 and the user's identification. Then the TV can initiate a transmission request of the broadcast control record to the mobile phone 1 of the user 1, and in response to the request, the mobile phone 1 can send the broadcast control record 1 stored in it to the TV. In this way, the TV obtains the broadcast control record corresponding to the current user.
  • the TV resumes the broadcast from a breakpoint according to the broadcast control record corresponding to the current user, which can be implemented in various ways.
  • the TV may display information related to the video stream to be resumed from a breakpoint on its home page interface, so as to resume the broadcast from a breakpoint under the user's instruction.
  • the TV determines that the current user is user A, and determines the relevant information of the video stream A to be resumed according to the user A, it can display the information on its interface (the “welcome” interface shown in (a) in FIG. 10 ). ) displays the card 1001 corresponding to the video stream A. This card can be used to ask user A to confirm whether to resume the video stream A displayed on the card 1001 from a break point.
  • the card 1001 may include text prompts, such as "prompt for resuming playback at a breakpoint: whether to continue watching video stream A", or "you have watched video stream A on mobile phone A until 25:50, do you want to continue watching video stream A?” keep watching” etc.
  • User A can input a corresponding operation according to the card 1001 .
  • the card 1001 may further include other controls. As shown in (b) of FIG. 10 , the control may include a “Yes” button 1002 and a “No” button 1003 .
  • the TV determines to resume the broadcast from the breakpoint according to the text prompt of the card corresponding to the broadcast control record. That is to say, in response to the operation of the "Yes” button input by the user A, the TV can continue to perform the breakpoint continuation of the video stream A on its display screen according to the information indicated by the broadcast control record. Conversely, when the TV receives the operation of the “No” button clicked or touched by user A or input through the TV remote control, the TV determines not to resume the broadcast from a breakpoint according to the text prompt of the card corresponding to the broadcast control record.
  • the TV can display its home page interface normally, so that user A can use other functions of the TV.
  • the "No" button 1003 may not be included in the card shown in (b) of FIG. 10 .
  • User A can use other operations to enter the home page interface of the TV. For example, user A can input an operation that can be used to enter the home page interface through the remote control of the TV, such as clicking the "Home" button on the remote control, or clicking the "Return” button on the remote control, or through voice control, etc., Realize the control TV to display the home page interface.
  • the TV when the TV determines that there is only one user in the current playback area, it can directly resume the playback from a breakpoint according to the playback control record corresponding to the current user, so that the TV can play the video without any operation input by the user.
  • the user selects the corresponding broadcast control record to resume the broadcast from a breakpoint.
  • the TV may display cards corresponding to multiple broadcast control records corresponding to one user on its interface. Therefore, the TV can display to the user selections corresponding to multiple different broadcast control records through its interface, so that the user can independently select the corresponding broadcast control records for viewing. For example, the TV may display the broadcast control record 1, the broadcast control record 2 and the broadcast control record 3 corresponding to the user 1 on the interface. Users can select the corresponding broadcast control record to play according to their needs. If the user selects the broadcast control record 2, the TV can resume the broadcast according to the broadcast control record 2.
  • the user may actively select the video stream that needs to be played on the TV to continue playing.
  • the user can say to the TV: "Continue to play the video A just played on the mobile phone A”
  • the TV can search for the matching broadcast control record in the TV, and continue to play the video A according to the broadcast control record.
  • the TV can search for the corresponding broadcast control record through video A, or search for the corresponding broadcast control record according to video A and mobile phone A.
  • the broadcast control record Before receiving the user's instruction, the broadcast control record has been obtained from the mobile phone A by the TV.
  • the TV also obtains the broadcast control record corresponding to the video A from the mobile phone A after receiving the user's instruction, and then the TV resumes the broadcast from a breakpoint according to the obtained broadcast control record.
  • the description is given by taking as an example that there is only one user in the broadcast range of the television. It will be appreciated that in other scenarios, there may be two or more users within the broadcast range of the TV. At this point, the TV can also provide users with different resuming services from a breakpoint. For example, there are two users (such as user 1 and user 2) within the broadcast range of the TV.
  • the TV may determine a broadcast control record 1 corresponding to user 1 and a broadcast control record 2 corresponding to user 2, respectively.
  • the TV can display Card 1 (1101 in FIG. 11 ) and Card 2 (1102 in FIG. 11 ) respectively on its current display interface (eg, the home page interface).
  • the card 1 includes relevant information of the video stream 1 corresponding to the broadcast control record 1.
  • the card 1 may include a text prompt similar to (b) in FIG. 10 .
  • the card 2 includes relevant information of the video stream 2 corresponding to the broadcast control record 2.
  • the card 2 may also include a text prompt similar to (b) in FIG. 10 .
  • the user 1 and the user 2 can clearly know the current situation of the video stream that can be resumed from a break point, and make selections accordingly.
  • a command for continuing to play the video stream 1 can be input to the TV through a TV remote control or voice control.
  • the television can resume the video stream 1 based on the broadcast control record 1.
  • a command to continue playing video stream 2 can be input to the TV through a TV remote control or voice control.
  • the television can resume the video stream 2 from a break point based on the broadcast control record 2 .
  • card 1 and card 2 may also be two controls or two areas in one card. This embodiment of the present application does not limit the display manner of the information corresponding to the broadcast control record 1 and the broadcast control record 2.
  • the TV can only display part of the information that can distinguish the broadcast control records in the above-mentioned cards, and at the same time hide other information corresponding to the broadcast control records.
  • the TV can display a card 1201 including part of the information recorded by the broadcast control on the current display interface.
  • the card may include text prompts, such as "prompt for resuming playback from a breakpoint: perform playback from user 1's breakpoint; perform playback from breakpoint for user 2".
  • the text prompts of "Resume the playback from the breakpoint of user 1" and “Resume the playback from the breakpoint of user 2" in the text prompts may also have the control 1202 and the control 1203 as shown in FIG. 12 .
  • the function of the operation corresponding to the user So that the user can select the corresponding control through the TV remote control to execute the corresponding breakpoint and resume the playback.
  • the TV receives the user's click input on the control 1202, it will resume the playback of the corresponding video stream 1 according to the playback control record 1 corresponding to the user 1 from a breakpoint.
  • the TV When the TV receives the user's click input on the control 1203, it will continue the playback of the corresponding video stream 2 according to the broadcast control record 2 corresponding to the user 2 from a breakpoint. In this way, the TV will not directly display the video stream viewing history information of two or more users on its interface, thereby achieving the purpose of protecting user privacy.
  • the TV may determine, according to the user's priority, which user's corresponding broadcast control record is used to resume the broadcast from a break point.
  • the priority of the user may be preset in the TV, or may be determined by the TV itself.
  • the TV can prioritize each user according to the usage frequency of different users in the TV usage history, the user with the highest usage frequency has the highest priority, and the user with the lowest usage frequency has the lowest priority.
  • the TV can also resume the broadcast from a breakpoint according to the priority of the broadcast control record.
  • the TV can prioritize multiple broadcast control records according to the time sequence of obtaining the breakpoint and resume the broadcast.
  • the broadcast control record obtained later is most likely to be resumed, so it can have a higher priority.
  • a broadcast control record with an earlier acquisition time is less likely to be replayed, and therefore may have a lower priority.
  • the TV can directly enter the video stream according to the corresponding broadcast control record to resume playback at the breakpoint.
  • the TV may also perform a corresponding breakpoint resuming according to an instruction input by the user. For example, take the current user including user 1 and user 2 as an example.
  • User 1 can input a voice control instruction to the TV.
  • User 1 can say to the TV: "Continue to play the video 1 played on the mobile phone 1".
  • the TV After the TV receives the instruction, it can select the broadcast control record corresponding to the video 1 and the mobile phone 1 to resume the broadcast from a breakpoint. It should be noted that, in some implementations, the TV can also perform voice recognition by receiving the voice instruction of user 1, determine the corresponding user, and select the broadcast control record corresponding to the user to resume the broadcast from a break point; It is also possible to trigger face recognition to determine the corresponding user after receiving the voice instruction of user 1, and then further acquire the user-related broadcast control records to resume the broadcast from a breakpoint.
  • the TV when the TV plays the video stream, it can also synchronize the playback of the video stream to the mobile phone in the same local area network, so that the user can also use the mobile phone to play the current broadcast based on the TV.
  • the progress is resumed from a breakpoint.
  • the TV can synchronize its playback progress of the video stream and related information of the video stream (ie, the playback control record corresponding to the video stream being played) to the mobile phone 1 in real time.
  • a corresponding card may be displayed on the interface of the mobile phone 1 .
  • the card can be used to display the relevant information of the broadcast control record corresponding to the video stream currently being played by the TV to the user.
  • the mobile phone 1 can display a text prompt in the card 1301 , such as “video stream broadcast control information: video stream 1 is being watched, currently playing until 20:12” .
  • the mobile phone 1 can display the relevant video stream playing information in the form of multimedia in the card 1302 .
  • the card 1302 may include the name of the video stream currently being played by the TV "Video Stream 1”, the card 1302 may also include the progress "20:12" of the video stream currently being played by the TV, and the card 1302 may also include the current Keyframe images under playback progress, etc.
  • the user can know the current video streaming on the TV through the card.
  • a relevant operation such as touch or click, etc.
  • the mobile phone 1 can receive the operation.
  • the mobile phone can resume the playback from a breakpoint based on the playback control record corresponding to the card on its interface. For example, continue playing video stream 1 from 20:12.
  • the TV can determine whether the user is still within the playback range, and if so, the TV also The video stream 1 can continue to be played. However, if the TV determines that the user is no longer within its playing range, the TV can quit playing the video stream 1 . For example, enter the screen-off state.
  • the TV sends its broadcast control record to the mobile phone 1 in real time as an example for illustration.
  • the TV can also obtain the corresponding video streams played on the TV according to a preset time period. and send the broadcast control record to mobile phone 1.
  • the TV may also acquire the corresponding broadcast control record when monitoring the operation of interrupting the playback of the video stream input by the user, and send the broadcast control record to the mobile phone 1 .
  • This embodiment of the present application does not limit the timing when the TV sends the broadcast control record to the mobile phone 1 .
  • the TV can send the current broadcast control record to the corresponding collection according to different scene requirements.
  • the video stream 1 currently being played on the TV is resumed from a breakpoint according to the broadcast control record 1 sent by the mobile phone 1 .
  • the TV can send the broadcast control record corresponding to the video stream 1 to the mobile phone 1 in real time, so that the corresponding user 1 can accurately know the playback progress of the video stream 1 on his mobile phone 1 .
  • the mobile phone 1 can provide the user 1 with a corresponding breakpoint resuming service according to the playback progress.
  • the video stream currently played on the TV is not resumed from a breakpoint according to the broadcast control record of any mobile phone as an example.
  • the TV can send the broadcast control record corresponding to the video stream to all mobile phones in the current local area network in real time, so that users who watch the current video stream through the TV can know the playback progress of the current video stream on the TV through their respective mobile phones, At the same time, when the user wants to continue watching the video stream on the mobile phone, the user's mobile phone can provide the corresponding user with a breakpoint resuming service according to the broadcast control record.
  • the TV can also share its broadcast control record with any mobile phone, thereby reducing the communication pressure on the local area network where the TV and the mobile phone are located.
  • the TV synchronizes the broadcast control record of the currently playing video stream to the mobile phone 1 in the local area network. Then the TV can perform the operation of synchronizing the broadcast control record to the mobile phone 1 according to the strategy.
  • the TV plays any video stream, user 1 can know the playback progress of the current video stream through his mobile phone 1, thereby realizing user 1's active control of TV playback resources, such as parental control.
  • the TV when the TV does not play any multimedia stream, it is described as an example of continuing the broadcast from a breakpoint according to the above-mentioned method for playing a multimedia stream.
  • the TV can also provide the user with a continuous broadcast service according to the above method while playing the multimedia stream.
  • the TV playing video stream 1 for user 1 takes the TV playing video stream 1 for user 1 as an example.
  • the TV detects the biometric identification information of the user 2 it can obtain the corresponding broadcast control record according to the biometric identification information of the user 2 .
  • the TV may consider that there may be a demand for user 2 to resume the broadcast from a break point.
  • the TV can display the card 1001 as shown in (a) in FIG. 10 or (b) in FIG. 10 on the interface while playing the video stream 1, so that the user can pass the operation, instructing the TV to resume the broadcast according to the broadcast control record corresponding to the user 2.
  • the TV can switch from playing video stream 1 to the corresponding video stream 2 to continue playing.
  • a corresponding operation such as clicking the return/exit button, or indicating by voice that no breakpoint resume is required
  • the TV can continue to play the video stream 2.
  • video stream 1 It can be understood that, if the user does not input any operation to the card 1001, the TV can eliminate the display of the card 1001 on the interface after a preset time, so as to better play the video stream 1 for the user.
  • the multimedia stream is only a video stream as an example.
  • the multimedia stream may also be an audio stream, etc.
  • the execution mode of the video stream will not be repeated here.
  • the method for resuming playback from a breakpoint enables a public device (eg, a TV) to share a broadcast control record with a private device (eg, a mobile phone) by itself.
  • the biometric identification information of the current user can be obtained by itself without the user's input of any operation, and the broadcast control record matched with the current user can be determined accordingly.
  • the user can confirm the card information to perform the corresponding resuming from the breakpoint, or directly perform the resuming from the breakpoint for the user, thereby providing the user with a convenient resuming service from the breakpoint.
  • the stability of the breakpoint resume service is also improved. .
  • a public device such as a TV
  • a private device such as a mobile phone
  • a public device such as a TV
  • a private device such as a mobile phone
  • the method in the above example calls the corresponding data for transmission.
  • a TV and a mobile phone can complete all data interactions (such as the processing and storage of biometric identification information and broadcast control records) and various steps in the above-mentioned multimedia streaming file playback method in the RE.
  • the public device and/or the private device may separately process data with different security requirements.
  • the storage and processing of biometric information can be separated from the storage and processing of broadcast control records, so as to realize the isolation of data with different security requirements.
  • the security of biometric information can be improved through the user authorization mechanism shown in FIG. 4 and FIG. 6 in the above description.
  • electronic devices such as private devices and public devices
  • the TE and RE in the electronic device can be isolated in various ways.
  • the REs and TEs in the electronic device may be physically isolated.
  • the electronic device can configure its internal memory so that a certain fixed physical storage address segment is used as TE, and other physical storage address segments are used as RE.
  • the RE and TE may also be virtual isolation implemented by software configuration.
  • the electronic device may be configured with a virtual operating system corresponding to the TE and a virtual operating system corresponding to the RE, respectively.
  • the virtual operating system can provide processing, storage and communication functions.
  • the electronic device can store and process information with a higher security level through the TE, and store and process other information with a lower security level, such as broadcast control records, through the RE. In this way, the user's biometric information is isolated from other information, and thus the security of the biometric information can be improved.
  • both the public device and the private device are provided with a virtual operating system corresponding to TE (such as TE for short) and a virtual operating system corresponding to RE (such as RE), wherein TE1 and RE1 are set in the private device, and the public device is
  • TE2 and RE2 are set in the example to illustrate the method for resuming the broadcast from a breakpoint provided by the embodiment of the present application. As shown in FIG. 14, the method may include S1401-S1410.
  • TE1 sends biometric information to TE2.
  • TE1 before TE1 sends the biometric information to TE2, it can be determined that the authorization module (not shown in FIG. 14 ) in the private device has obtained the authorization of the user, and then sends the biometric information, thereby improving the biometric identification. Information security.
  • S1403, TE2 stores the correspondence between the biometric information and the user.
  • S1404 monitors the playback of the multimedia stream, and obtains a playback control record.
  • RE1 sends a broadcast control record to RE2.
  • TE2 obtains the biometric information of the current user.
  • TE2 determines a user matching result according to the acquired biometric information of the current user.
  • TE2 sends the user matching result to RE2.
  • RE2 determines the broadcast control record corresponding to the user matching result.
  • the execution process of the foregoing S1401-S1410 is related to the description of the foregoing FIG. 4 , and the execution process thereof is similar, and will not be repeated here.
  • the data related to the biometric information is processed in the TE (such as TE1 of a private device, and TE2 of a public device), thereby realizing the integration of biometric information and
  • the separate processing of other information can ensure the security of biometric information while providing users with a convenient breakpoint resuming service.
  • TE1 can directly share the biometric information with TE2 through its communication function.
  • the TE1 may also share the biometric information with the TE2 through the communication function between the RE1 and the RE2.
  • the private device can exchange the public key between the RE1 set therein and the RE2 of the public device, so that the TE1 that needs to transmit the biometric information can exchange the public key according to the public device.
  • the key and the private key of TE1 encrypt the biometric information, and transmit the encrypted biometric information through the transmission channel between RE1 and RE2.
  • RE2 can forward the received encrypted biometric information to TE2, and TE2 can decrypt the encrypted biometric information according to the public key and TE2's private key to obtain the biometric information to be sent by TE1. Therefore, data communication between TE1 and TE2 does not need to be performed directly, so that neither TE1 nor TE2 need to provide a communication function between devices, thereby reducing hardware requirements in the process of configuring TE1 and TE2.
  • each functional module may be divided into each function, or two or more functions may be integrated into one processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. It should be noted that, the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.
  • FIG. 15 is a schematic diagram of the composition of an apparatus 1500 for playing a multimedia stream according to an embodiment of the present application.
  • the apparatus 1500 for playing the multimedia stream may be a public device such as a TV, or may be a chip inside the public device, and may implement FIG. 4 and FIG. 14 and the above-mentioned optional embodiments.
  • the playback device 1500 of the multimedia stream may include: a detection module 1501 , an acquisition module 1502 and a playback module 1503 .
  • the detection module 1501 is used to detect the first biometric information
  • the first biometric information is used to identify the first user
  • the biometric information of different users is different.
  • the obtaining module 1502 is configured to obtain the first broadcast control record corresponding to the first user according to the first biometric information.
  • the first broadcast control record is obtained from the second electronic device, the first broadcast control record includes the first time of the first multimedia stream recorded by the second electronic device, and the second electronic device corresponds to the first user Electronic equipment.
  • the playing module 1503 is configured to play the first multimedia stream from the first time according to the first broadcast control record.
  • the first time of the first multimedia stream recorded by the second electronic device is the time when the second electronic device is interrupted in the process of playing the first multimedia stream.
  • the operation corresponding to the interruption includes the operation of stopping, pausing or exiting the playback of the first multimedia stream.
  • the obtaining module 1502 is further configured to obtain the first broadcast control record from the second electronic device when the second electronic device and the first electronic device are in the same local area network.
  • the detection module 1501 is configured to trigger the detection of the first biometric identification information when the screen is awake. Alternatively, the detection module 1501 is configured to trigger the detection of the first biometric identification information when the image acquisition module and/or the sound acquisition module provided on the first electronic device detects the user. Alternatively, the detection module 1501 is configured to trigger detection of the first biometric identification information when an operation of the first electronic device by the user is detected.
  • the obtaining module 1502 is configured to match the detected first biometric information with the stored second biometric information of the first user, and obtain the first user corresponding to the first user according to the matching result. Play control record. Wherein, the second biometric identification information of the first user is obtained from the second electronic device.
  • the obtaining module 1502 is further configured to obtain the second biometric identification information of the first user from the second electronic device when the second electronic device and the first electronic device are in the same local area network.
  • the obtaining module 1502 is configured to obtain the second biometric identification information of the first user from the second electronic device when the second electronic device obtains the authorization information of the first user.
  • a secure world is provided in the first electronic device, and the apparatus further includes: a storage module 1504, configured to store the acquired second biometric identification information of the first user in the TE.
  • the detection module 1501 is further configured to detect third biometric information, and the third biometric information is used to identify the second user.
  • the obtaining module 1502 is configured to obtain the second broadcast control record corresponding to the second user according to the third biometric identification information. Wherein, the second broadcast control record is obtained from the third electronic device.
  • the second broadcast control record includes the second time of the second multimedia stream recorded by the third electronic device, where the third electronic device is an electronic device corresponding to the second user.
  • the playing module 1503 is configured to play the second multimedia stream from the second time according to the second broadcast control record.
  • the playing module 1503 is configured to continue playing the first multimedia stream from the first time directly on the interface of the first electronic device according to the first broadcast control record. Or the playing module 1503 is configured to display a first prompt corresponding to the first broadcast control record on the interface of the first electronic device according to the first broadcast control record. The first electronic device receives the first operation for the first prompt, and in response to the first operation, the first electronic device continues to play the first multimedia stream from the first time on the interface.
  • the playback module 1503 when the first electronic device detects the first biometric information of the first user and the second biometric information of the second user at the same time, the playback module 1503 is configured to record and play according to the first playback control.
  • the second broadcast control record is to play the first multimedia stream or the second multimedia stream according to the priority.
  • the playing module 1503 is configured to randomly select and play the first multimedia stream or the second multimedia stream according to the first broadcast control record and the second broadcast control record.
  • the playing module 1503, configured to play the first multimedia stream or the second multimedia stream according to the user's selection.
  • the playing module 1503 is further configured to display prompt information of the first broadcast control record, where the prompt information hides all or part of the information related to the first multimedia stream.
  • the first broadcast control record further includes device information of the second electronic device.
  • the playing module 1503 is further configured to adjust and play the first multimedia stream according to the device information of the second electronic device.
  • the obtaining module 1502 is further configured to obtain a third broadcast control record for playing the first multimedia stream when the first multimedia stream is played, and the third broadcast control record is used to indicate the first The third time to which the multimedia stream is currently being played.
  • the device further includes a sending module 1505 for the first electronic device to send the third broadcast control record to the second electronic device, so that the second electronic device can continue to play the first multimedia from a third time according to the third broadcast control record flow.
  • the apparatus for playing the multimedia stream in the embodiments of the present application may be implemented by software, for example, a computer program or instruction having the above-mentioned functions, and the corresponding computer program or instruction may be stored in a memory inside a public device, and the The processor reads the corresponding computer program or instructions inside the memory to realize the above functions.
  • the apparatus for playing the multimedia stream in the embodiment of the present application may also be implemented by hardware.
  • the apparatus for playing a multimedia stream in the embodiment of the present application may also be implemented by a combination of a processor and a software module.
  • FIG. 16 shows a schematic diagram of the composition of an electronic device 1600 .
  • the electronic device may be any public device in the above examples, for example, the electronic device may be a television.
  • the apparatus 1600 for playing the multimedia stream may include: a processor 1601 and a memory 1602.
  • the memory 1602 is used to store computer-implemented instructions.
  • the processor 1601 executes the instructions stored in the memory 1602
  • the electronic device 1600 can be made to perform any function of the public device in the above-mentioned embodiments, so as to realize any of the above-mentioned examples.
  • a method for playing multimedia streams is described in some embodiments, when the processor 1601 executes the instructions stored in the memory 1602, the electronic device 1600 can be made to perform any function of the public device in the above-mentioned embodiments, so as to realize any of the above-mentioned examples.
  • FIG. 17 shows a schematic diagram of the composition of a chip system 1700 .
  • the chip system 1700 can be provided in public equipment.
  • the system-on-a-chip 1700 may be provided in a television.
  • the system-on-a-chip 1700 may include: a processor 1701 and a communication interface 1702 for supporting public devices to implement the functions involved in the foregoing embodiments.
  • the chip system further includes a memory for storing necessary program instructions and data of the electronic device.
  • the chip system may be composed of chips, or may include chips and other discrete devices.
  • the communication interface 1702 may also be referred to as an interface circuit.
  • FIG. 18 is a schematic diagram of the composition of an apparatus 1800 for playing a multimedia stream according to an embodiment of the present application.
  • the apparatus 1800 for playing the multimedia stream may be a private device such as a mobile phone, or a chip inside the private device, and may implement FIG. 4 and FIG. 14 and the above-mentioned optional embodiments.
  • the apparatus 1800 for playing the multimedia stream may include: an obtaining module 1801 and a sending module 1802 .
  • the obtaining module 1801 is configured to obtain a first broadcast control record, where the first broadcast control record includes the first time of the first multimedia stream recorded by the first electronic device, wherein the first multimedia stream is the data sent by the first electronic device to the first multimedia stream. Played by the first user.
  • the sending module 1802 is configured to send the first broadcast control record to the second electronic device, so that the second electronic device can continue to play the first multimedia stream to the first user from the first time according to the first broadcast control record.
  • the obtaining module 1801 is specifically configured to generate a first broadcast control record when an operation of interrupting the playback of the first multimedia stream is detected, wherein the operation corresponding to the interruption includes stopping, pausing or exiting The operation of playing the first multimedia stream.
  • the sending module 1802 is configured to send the first broadcast control record to the second electronic device when the second electronic device and the first electronic device are in the same local area network.
  • the sending module 1802 is further configured to send the first biometric identification information of the first user to the second electronic device when the second electronic device is in the same local area network as the first electronic device, so as to facilitate the second electronic device
  • the second electronic device determines, according to the first biometric identification information, to continue playing the first multimedia stream according to the first broadcast control record.
  • the apparatus for playing the multimedia stream in the embodiment of the present application may be implemented by software, for example, a computer program or instruction having the above-mentioned functions, and the corresponding computer program or instruction may be stored in the memory inside the private device, and the The processor reads the corresponding computer program or instructions inside the memory to realize the above functions.
  • the apparatus for playing the multimedia stream in the embodiment of the present application may also be implemented by hardware.
  • the apparatus for playing a multimedia stream in the embodiment of the present application may also be implemented by a combination of a processor and a software module.
  • FIG. 19 shows a schematic diagram of the composition of an electronic device 1900 .
  • the electronic device may be any of the above-mentioned private devices, for example, the electronic device may be a mobile phone.
  • the apparatus 1900 for playing the multimedia stream may include: a processor 1901 and a memory 1902 .
  • the memory 1902 is used to store computer-implemented instructions.
  • the processor 1901 executes the instructions stored in the memory 1902, the electronic device 1900 can be made to perform any function of the private device in the above-mentioned embodiments, so as to realize any of the above-mentioned functions.
  • a method for playing multimedia streams when the processor 1901 executes the instructions stored in the memory 1902, the electronic device 1900 can be made to perform any function of the private device in the above-mentioned embodiments, so as to realize any of the above-mentioned functions.
  • FIG. 20 shows a schematic diagram of the composition of a chip system 2000 .
  • the chip system 2000 can be provided in a private device.
  • the chip system 2000 can be provided in a mobile phone.
  • the system-on-a-chip 2000 may include: a processor 2001 and a communication interface 2002 for supporting a private device to implement the functions involved in the foregoing embodiments.
  • the chip system further includes a memory for storing necessary program instructions and data of the electronic device.
  • the chip system may be composed of chips, or may include chips and other discrete devices.
  • the communication interface 2002 may also be referred to as an interface circuit.
  • FIG. 21 shows a schematic diagram of the composition of a system 2100 for playing a multimedia stream provided by an embodiment of the present application.
  • the multimedia stream playing system 2100 may include a first electronic device 2101 and a second electronic device 2102 .
  • the first electronic device 2101 may be a television as shown in FIG. 3
  • the second electronic device 2102 may be any one of the mobile phones 1 to N shown in FIG. 3 .
  • the multimedia stream playing system 2100 may be used to implement the multimedia stream playing method involved in the embodiments of the present application according to the method shown in FIG. 4 or FIG. 14 .
  • the multimedia stream playing system 2100 may be used to implement other multimedia stream playing methods involved in the embodiments of the present application.
  • the multimedia stream playing system 2100 may further include other second electronic devices for implementing any of the multimedia stream playing methods provided in the embodiments of the present application.
  • the functions or actions or operations or steps in the above embodiments may be implemented in whole or in part by software, hardware, firmware or any combination thereof.
  • a software program When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product.
  • the computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, all or part of the processes or functions described in the embodiments of the present application are generated.
  • the computer may be a general purpose computer, special purpose computer, computer network, or other programmable device.
  • the computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server, or data center Transmission to another website site, computer, server, or data center by wire (eg, coaxial cable, optical fiber, digital subscriber line, DSL) or wireless (eg, infrared, wireless, microwave, etc.).
  • the computer-readable storage medium can be any available medium that can be accessed by a computer, or data storage devices including one or more servers, data centers, etc. that can be integrated with the medium.
  • the usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), or semiconductor media (eg, solid state disks (SSDs)), and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

本申请实施例公开了一种多媒体流的播放方法和电子设备，涉及电子设备领域，使得多媒体流在不同设备间进行接续播放时可以更加准确稳定，并且易于操作。具体方案为：第一电子设备检测第一生物识别信息，第一生物识别信息用于标识第一用户，不同用户的生物识别信息不同。第一电子设备根据第一生物识别信息，获取与第一用户对应的第一播控记录。其中，第一播控记录是从第二电子设备获取的，第一播控记录包括第二电子设备记录的第一多媒体流的第一时间，第二电子设备是与第一用户对应的电子设备。第一电子设备根据第一播控记录从第一时间开始，播放第一多媒体流。

Description

一种多媒体流的播放方法和电子设备
本申请要求于2020年9月10日提交国家知识产权局、申请号为202010949875.1、申请名称为“一种多媒体流的播放方法和电子设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及电子设备领域，尤其涉及一种多媒体流的播放方法和电子设备。
背景技术
目前，电子设备(如手机，又如电视等)大多能够从网络获取多媒体文件并进行播放。示例性的，该多媒体文件可以包括视频流文件，以及网络音频流等。
以电子设备获取并播放的多媒体文件为电子设备通过网络获取的视频流文件(简称为视频流)为例。用户的手机可以在用户通勤过程中为用户提供播放视频流的服务。用户的其他电子设备(如住所的电视)也可以在用户回到住所之后为用户提供播放视频流的服务。但若用户外出回到住所后，想在电视上继续观看之前在手机播放的视频时，需要用户打开电视后重新打开相关视频，或需要用户多次操作来主动关联两个设备的视频播放信息，不同设备间的视频的接续播放较为麻烦，当前没有较为智能的设备间视频切换播放方案。
发明内容
本申请实施例提供一种多媒体流的播放方法和电子设备，使得多媒体流在不同设备间进行接续播放时可以更加准确稳定，并且易于操作。
为了达到上述目的，本申请实施例采用如下技术方案：
第一方面，提供一种多媒体流的播放方法，应用于具有播放多媒体流的功能的第一电子设备，方法包括：第一电子设备检测第一生物识别信息，第一生物识别信息用于标识第一用户，不同用户的生物识别信息不同。第一电子设备根据第一生物识别信息，获取与第一用户对应的第一播控记录。其中，第一播控记录是从第二电子设备获取的，第一播控记录包括第二电子设备记录的第一多媒体流的第一时间，第二电子设备是与第一用户对应的电子设备。第一电子设备根据第一播控记录从第一时间开始，播放第一多媒体流。
基于该方案，第一电子设备(如电视)可以主动地获取当前用户(如第一用户)的生物识别信息。例如，电视可以获取当前用户的人脸信息和/或声纹信息等。电视还可以根据获取的生物识别信息，确定与该生物识别信息对应的播控记录。作为一种示例，电视中可以存储有不同用户对应的生物识别信息，以及不同用户对应的播控记录。那么，电视可以使用当前的生物识别信息与存储的多个生物识别信息进行比对，确定当前用户(或当前用户的标识)。电视可以根据当前用户(或当前用户的标识)确定其对应的播控记录。可以理解的是，当前用户就是目前使用电视的用户，因此，显然存在使用电视的需求，那么电视就可以根据当前用户对应的播控记录进行断点续播，以使得当前用户不需要输入任何操作，即可通过电视继续观看之前没有在第二电子设 备(如手机)上看完的多媒体流。同时，由于电视可以准确地根据当前用户的生物识别信息匹配到对应的播控记录，因此基于该播控记录的断点续播是准确的。另外，由于生物识别信息和播控记录只在第一电子设备和第二电子设备之间共享，而不需要通过其他中转设备(如服务器等)，因此具有更加稳定。需要说明的是，在本申请的一些示例中，电视在根据第一播控记录进行续播时，也可以从比第一时间略早的时间开始播放该第一多媒体流，以便用户能够获取更好的续播观看体验。
在一种可能的设计中，第二电子设备记录的第一多媒体流的第一时间是第二电子设备播放第一多媒体流的过程中被中断时的时间。中断对应的操作包括停止、暂停或退出第一多媒体流播放的操作。基于该方案，提供了一种具体的第一时间的示例。例如，该第一时间可以是第二电子设备(如手机)接收到用户输入的中断播放第一多媒体流的操作。其中，用户可以通过触摸手机上对应的控件，按钮等方法输入上述操作，或者用户可以通过语音控制，或者通过其他输入设备实现对上述操作的输入。由此，就使得第一电子设备能够在需要进行断点续播时，准确地从用户上次观看的位置继续播放该第一多媒体流。
在一种可能的设计中，该方法还包括：在第二电子设备与第一电子设备处于同一个局域网中的情况下，第一电子设备从第二电子设备获取第一播控记录。基于该方案，提供了一种播控记录的共享机制。例如，手机中存储有第一播控记录，一般而言，手机都是跟随用户的，因此，在用户回到其住所时，手机也就会与住所的电视处于同一局域网中，此时也就可能会出现在电视上根据该第一播控记录进行断点续播的需求。那么在本示例中，当手机与电视处于同一局域网中时，则电视就可以向手机发送获取播控记录的请求，以便手机响应于该请求，将对应的播控记录发送给电视。需要说明的是，在另一些实现方式中，当手机和电视处于同一局域网中时，手机可以主动地将播控记录发送给电视，而不需要电视发送对应的请求。在另一些实现方式中，电视可以在确定当前用户为手机对应的用户时，才从手机获取对应的播控记录。
在一种可能的设计中，第一电子设备检测第一生物识别信息，包括：第一电子设备在息屏唤醒时，触发检测第一生物识别信息。或者，第一电子设备在第一电子设备上设置的图像采集模块和/或声音采集模块检测到用户时，触发检测第一生物识别信息。或者，第一电子设备在检测到用户对第一电子设备的操作时，触发检测第一生物识别信息。基于该方案，提供了一种第一电子设备(如电视)主动检测用户的生物识别信息的机制。例如，电视可以在息屏唤醒时，开始检测当前用户的生物识别信息。又如，电视可以在检测到用户的声音或人脸时，开始检测当前用户的生物识别信息。又如，电视可以在接收到用户对电视的操作，如用户通过电视遥控器对电视输入指令时，开始检测当前用户的生物识别信息。
在一种可能的设计中，第一电子设备根据第一生物识别信息，获取与第一用户对应的第一播控记录，具体包括：第一电子设备将检测到的第一生物识别信息与存储的第一用户的第二生物识别信息匹配，根据匹配结果，获取与第一用户对应的第一播控记录。其中，第一用户的第二生物识别信息是从第二电子设备获取的。基于该方案，提供了一种具体的电视根据当前用户的生物识别信息，确定对应播控记录的方案。可以理解的是，通过该方案能够使得电视准确地获取与当前用户对应的播控记录。示例 性的，电视可以在获取当前用户的生物识别信息之前，就已经获取了所有用户的播控记录，那么在确定匹配结果后，电视就可以从本地获取对应的播控记录。在另一些实现方式中，电视可以在获取当前用户的生物识别信息之后，在本地确定当前用户的标识，进而从具有该标识的用户的手机获取对应的播控记录。在另一些实现方式中，电视可以在获取当前用户的生物识别信息后，直接根据该生物识别信息，从对应的用户的手机获取对应的播控记录。本申请对于电视获取播控记录的具体实现不作限制。
在一种可能的设计中，该方法还包括：在第二电子设备与第一电子设备处于同一个局域网时，第一电子设备从第二电子设备获取第一用户的第二生物识别信息。基于该方案，电视可以在与手机在同一个局域网中时，获取手机中存储的对应用户的生物识别信息并存储。以便电视能够在获取当前用户的识别信息之后，根据存储的生物识别信息与用户(或用户标识)的对应关系确定当前用户。需要说明的是，在一些实现方式中，电视可以在首次与手机在处于同一局域网中时，获取该手机对应用户的生物识别信息。而在该手机下次与电视处于同一局域网中时，电视可以不再从该手机获取对应的生物识别信息。由此使得电视不会重复获取同一个用户的生物识别信息，也能够减少电视与手机之间的信令开销。
在一种可能的设计中，第一电子设备是在第二电子设备获取第一用户的授权信息的情况下，从第二电子设备获取第一用户的第二生物识别信息的。基于该方案，提供了一种能够提升用户生物识别信息的安全性的方案。例如，手机可以在将对应的用户的生物识别信息发送给电视之前，向用户展示对应的授权界面，以便在用户的授权下进行生物识别信息的共享。
在一种可能的设计中，第一电子设备中设置有安全世界TE，方法还包括：第一电子设备将获取的第一用户的第二生物识别信息存储在TE中。基于该方案，提供了又一种提升生物识别信息的安全性的方案。例如，可以在电视和/或手机中设置TE和RE。电视可以将生物识别信息存储在TE中，与其他信息(如播控信息)进行隔离，以提升信息安全性。
在一种可能的设计中，该方法还包括：第一电子设备检测第三生物识别信息，第三生物识别信息用于标识第二用户。第一电子设备根据第三生物识别信息，获取与第二用户对应的第二播控记录。其中，第二播控记录是从第三电子设备获取的。第二播控记录包括第三电子设备记录的第二多媒体流的第二时间，第三电子设备是与第二用户对应的电子设备。第一电子设备根据第二播控记录从第二时间开始，播放第二多媒体流。基于该方案，如果当前用户不再是第一用户，例如，当前用户为第二用户，电视也能够获取对应用户的生物识别信息，并执行对应的断点续播。由此使得本示例的方案对不同用户都能够提供准确稳定并且易于操作的断点续播。
在一种可能的设计中，第一电子设备根据第一播控记录从第一时间开始，播放第一多媒体流，包括：第一电子设备根据第一播控记录，直接在第一电子设备的界面上从第一时间开始继续播放第一多媒体流。或者，第一电子设备根据第一播控记录，在第一电子设备的界面上显示与第一播控记录对应的第一提示。第一电子设备接收对第一提示的第一操作，并响应于第一操作，第一电子设备在界面上从第一时间继续播放第一多媒体流。基于该方案，提供了至少两种可能的第一电子设备(如电视)进行断 点续播的方案。例如，第一电子设备可以直接在其界面上显示根据第一播控记录进行的断点续播，如从第一时间开始继续播放对应的视频流。又如，第一电子设备可以在其界面上显示与播控记录对应的提示，该提示可以以卡片的形式展示给用户。在该提示中，可以包括第一播控记录中的相关内容，比如视频流的名称，播放视频流的APP的相关信息，视频流的关键帧截图等。通过该提示，用户能够直观地确认断点续播的视频流是否是想要继续观看的视频流。因此电视根据用户对该提示的确认进行的断点续播更加可靠。
在一种可能的设计中，在第一电子设备同时检测到第一用户的第一生物识别信息和第二用户的第二生物识别信息时，该方法还包括：第一电子设备根据第一播控记录和第二播控记录，根据优先级播放第一多媒体流或第二多媒体流。或者第一电子设备根据第一播控记录和第二播控记录，随机选择播放第一多媒体流或第二多媒体流。或者根据用户的选择，第一电子设备播放第一多媒体流或第二多媒体流。基于该方案，提供了当电视同时检测到两个用户时的应对策略。例如，电视可以根据用户低优先级选取对应的播控记录进行断点续播。又如，电视可以根据播控记录的优先级选取对应的播控记录进行断点续播。又如，电视可以从当前的多个用户对应的播控记录中自行选取一个播控记录，并据此进行断点续播。又如，电视可以在其界面上显示与各个播控记录对应的提示，以便根据用户输入的操作，根据对应的播控记录进行断点续播。本申请实施例对于存在多个当前用户的场景下的断点续播的具体实现，可以根据需要灵活选取，也可根据用户的预先配置来选取确定。
在一种可能的设计中，若第一电子设备同时检测到第一用户和第三用户，在第一电子设备根据第一播控记录从第一时间开始，播放第一多媒体流之前，该方法还包括：第一电子设备显示第一播控记录的提示信息，提示信息隐藏了全部或部分第一多媒体流相关的信息。基于该方案，提供了一种能够起到用户隐私保密作用的方案。在该示例中，电视可以在根据当前用户确定出多个播控记录时，在其界面上分别显示/一同显示与各个播控记录对应的提示。作为一种可能的实现方式，该提示可以是显示在界面上的卡片。在每个播控记录对应的卡片中，可以显示有与该播控记录对应的信息。在该示例中，由于多个用户的存在，卡片中的信息可以隐藏部分或全部播控记录对应的信息，只提供用户能够辨识出卡片与用户的对应关系的内容，由此能够起到对用户观看视频流的历史的相关隐私的保密作用。
在一种可能的设计中，第一播控记录还包括第二电子设备的设备信息。基于该方案，提供了一种播控记录的实现方式。例如，在该播控记录中还可以包括生成该播控记录的手机，也就是之前播放视频流的手机的设备信息。比如，该设备信息可以包括手机的型号，软件信息等。
在一种可能的设计中，第一电子设备根据第二电子设备的设备信息，调整播放第一多媒体流。基于该方案，提供一种保证电视能够正常播放第一多媒体流的方法。例如电视可以根据播控记录中包括的设备信息，就能够知晓视频流在手机上的播放环境，结合电视能够提供的多媒体流的播放能力，保证多媒体流在电视上的正常续播。
在一种可能的设计中，该方法还包括：第一电子设备在播放第一多媒体流时，获取播放第一多媒体流的第三播控记录，第三播控记录用于指示第一多媒体流当前被播 放到的第三时间。第一电子设备将第三播控记录发送给第二电子设备，以便于第二电子设备根据第三播控记录从第三时间继续播放第一多媒体流。基于该方案，提供了一种第一电子设备(如电视)向第二电子设备(如手机)断点续播方案。例如，电视可以根据正在播放的视频流生成对应的播控记录，根据一定周期，或者实时地生成该播控记录并发送给手机。以便用户想要使用手机继续观看视频流时，手机可以根据该播控记录为用户提供断点续播服务。
第二方面，提供一种多媒体流的播放装置，应用于具有播放多媒体流的功能的第一电子设备，该装置包括：检测单元，获取单元和播放单元。其中，检测单元，用于检测第一生物识别信息，第一生物识别信息用于标识第一用户，不同用户的生物识别信息不同。获取单元，用于根据第一生物识别信息，获取与第一用户对应的第一播控记录。其中，第一播控记录是从第二电子设备获取的，第一播控记录包括第二电子设备记录的第一多媒体流的第一时间，第二电子设备是与第一用户对应的电子设备。播放单元，用于根据第一播控记录从第一时间开始，播放第一多媒体流。
在一种可能的设计中，第二电子设备记录的第一多媒体流的第一时间是第二电子设备播放第一多媒体流的过程中被中断时的时间。中断对应的操作包括停止、暂停或退出第一多媒体流播放的操作。
在一种可能的设计中，获取单元，还用于在第二电子设备与第一电子设备处于同一个局域网中的情况下，第一电子设备从第二电子设备获取第一播控记录。
在一种可能的设计中，检测单元，用于在息屏唤醒时，触发检测第一生物识别信息。或者，检测单元，用于在第一电子设备上设置的图像采集模块和/或声音采集模块检测到用户时，触发检测第一生物识别信息。或者，检测单元，用于在检测到用户对第一电子设备的操作时，触发检测第一生物识别信息。
在一种可能的设计中，获取单元，用于将检测到的第一生物识别信息与存储的第一用户的第二生物识别信息匹配，根据匹配结果，获取与第一用户对应的第一播控记录。其中，第一用户的第二生物识别信息是从第二电子设备获取的。
在一种可能的设计中，获取单元，还用于在第二电子设备与第一电子设备处于同一个局域网时，从第二电子设备获取第一用户的第二生物识别信息。
在一种可能的设计中，所述获取单元，用于在第二电子设备获取第一用户的授权信息的情况下，从第二电子设备获取第一用户的第二生物识别信息。
在一种可能的设计中，第一电子设备中设置有安全世界(TE)，装置还包括：存储单元，用于将获取的第一用户的第二生物识别信息存储在TE中。
在一种可能的设计中，检测单元，还用于检测第三生物识别信息，第三生物识别信息用于标识第二用户。获取单元，用于根据第三生物识别信息，获取与第二用户对应的第二播控记录。其中，第二播控记录是从第三电子设备获取的。第二播控记录包括第三电子设备记录的第二多媒体流的第二时间，第三电子设备是与第二用户对应的电子设备。播放单元，用于根据第二播控记录从第二时间开始，播放第二多媒体流。
在一种可能的设计中，播放单元，用于根据第一播控记录，直接在第一电子设备的界面上从第一时间开始继续播放第一多媒体流。或者播放单元，用于根据第一播控记录，在第一电子设备的界面上显示与第一播控记录对应的第一提示。第一电子设备 接收对第一提示的第一操作，并响应于第一操作，第一电子设备在界面上从第一时间继续播放第一多媒体流。
在一种可能的设计中，在第一电子设备同时检测到第一用户的第一生物识别信息和第二用户的第二生物识别信息时，播放单元，用于根据第一播控记录和第二播控记录，根据优先级播放第一多媒体流或第二多媒体流。或者播放单元，用于根据第一播控记录和第二播控记录，随机选择播放第一多媒体流或第二多媒体流。或者播放单元，用于根据用户的选择，播放第一多媒体流或第二多媒体流。
在一种可能的设计中，若第一电子设备同时检测到第一用户和第三用户，在第一电子设备根据第一播控记录从第一时间开始，播放第一多媒体流之前，播放单元，还用于显示第一播控记录的提示信息，提示信息隐藏了全部或部分第一多媒体流相关的信息。
在一种可能的设计中，第一播控记录还包括第二电子设备的设备信息。
在一种可能的设计中，播放单元，还用于根据第二电子设备的设备信息，调整播放第一多媒体流。
在一种可能的设计中，获取单元，还用于在播放第一多媒体流时，获取播放第一多媒体流的第三播控记录，第三播控记录用于指示第一多媒体流当前被播放到的第三时间。该设备还包括发送单元，用于第一电子设备将第三播控记录发送给第二电子设备，以便于第二电子设备根据第三播控记录从第三时间继续播放第一多媒体流。
第三方面，提供一种电子设备，该电子设备包括一个或多个处理器和一个或多个存储器；一个或多个存储器与所述一个或多个处理器耦合，所述一个或多个存储器存储有计算机指令；当所述一个或多个处理器执行所述计算机指令时，使得所述通信装置执行如第一方面及其可能的设计中任一项所述的多媒体流的播放方法。
第四方面，提供一种芯片系统，该芯片系统可以应用于公有设备(如电视)中。示例性的，该芯片系统包括接口电路和处理器；接口电路和处理器通过线路互联；接口电路用于从电子装置的存储器接收信号，并向处理器发送信号，信号包括存储器中存储的计算机指令；当处理器执行该计算机指令时，芯片系统执行如第一方面及其可能的设计中任一项所述的多媒体流的播放方法。
第五方面，提供一种计算机可读存储介质，该计算机可读存储介质包括计算机指令，当该计算机指令运行时，执行如第一方面及其可能的设计中任一项所述的多媒体流的播放方法。
第六方面，提供一种计算机程序产品，该计算机程序产品中包括指令，当该计算机程序产品在计算机上运行时，使得计算机可以根据该指令执行如第一方面及其可能的设计中任一项所述的多媒体流的播放方法。
应当理解的是，上述第二方面，第三方面，第四方面，第五方面以及第六方面提供的技术方案，其技术特征均可对应到第一方面及其可能的设计中提供的多媒体流的播放方法，因此能够达到的有益效果类似，此处不再赘述。
第七方面，提供一种多媒体流的播放方法，应用于具有播放多媒体流的功能的第一电子设备，的方法包括：第一电子设备获取第一播控记录，第一播控记录包括第一电子设备记录的第一多媒体流的第一时间，其中，第一多媒体流是第一电子设备向第 一用户播放的。第一电子设备向第二电子设备发送第一播控记录，以便于第二电子设备根据第一播控记录从第一时间开始，继续向第一用户播放第一多媒体流。
基于该方案，提供了一种方案，使得第一电子设备(如手机)能够向第二电子设备(如电视)提供用于进行断点续播的播控记录。进而使得仅通过两个设备的交互，即实现多媒体流再不同设备之间的断点续播，由此使得断点续播服务更加准确稳定，并由于可以不需要用户的任何操作，因此更加易于操作。
在一种可能的设计中，第一电子设备获取第一播控记录，包括：第一电子设备在检测到中断第一多媒体流的播放的操作时，生成第一播控记录，其中，中断对应的操作包括停止、暂停或退出第一多媒体流播放的操作。基于该方案，提供了一种手机生成播控记录的具体方案。例如，手机可以在接收到用户输入的中断播放的指令时，生成并存储该播控记录。
在一种可能的设计中，第一电子设备向第二电子设备发送第一播控记录，包括：在第二电子设备与第一电子设备处于同一个局域网中的情况下，第一电子设备向第二电子设备发送第一播控记录。基于该方案，提供了一种播控记录在不同电子设备之间进行共享的方案。例如，手机中可以存储有播控记录，在手机与第二电子设备(如电视)处于同一局域网中时，手机就可以主动将播控记录发送给电视，或者，手机可以在接收到电视的播控记录的请求时，向电视发送播控记录。
在一种可能的设计中，在所第一电子设备向第二电子设备发送第一播控记录之前，该方法还包括：第一电子设备向第二电子设备发送第一用户的第一生物识别信息，以便于第二电子设备根据第一生物识别信息，确定根据第一播控记录继续播放第一多媒体流。基于该方案，提供了一种生物识别信息的共享方案。例如，手机中可以存储有用户的生物识别信息，则手机可以在第一次与电视处于同一局域网下时，向电视主动发送生物识别信息，或者在电视的请求下，发送生物识别信息。需要说明的是，在一些实现方式中，手机可以在向电视发送生物识别信息之前，获取用户的授权，由此提升生物识别信息的安全性。
第八方面，提供一种多媒体流的播放装置，应用于具有播放多媒体流的功能的第一电子设备，该装置包括：获取单元，发送单元。获取单元，用于获取第一播控记录，第一播控记录包括第一电子设备记录的第一多媒体流的第一时间，其中，第一多媒体流是第一电子设备向第一用户播放的。发送单元，用于向第二电子设备发送第一播控记录，以便于第二电子设备根据第一播控记录从第一时间开始，继续向第一用户播放第一多媒体流。
在一种可能的设计中，获取单元，具体用于在检测到中断第一多媒体流的播放的操作时，生成第一播控记录，其中，中断对应的操作包括停止、暂停或退出第一多媒体流播放的操作。
在一种可能的设计中，发送单元，用于在第二电子设备与第一电子设备处于同一个局域网中的情况下，向第二电子设备发送第一播控记录。
在一种可能的设计中，发送单元，还用于第二电子设备在与第一电子设备处于同一个局域网时，向第二电子设备发送第一用户的第一生物识别信息，以便于第二电子设备根据第一生物识别信息，确定根据第一播控记录继续播放第一多媒体流。
第九方面，提供一种电子设备，该电子设备包括一个或多个处理器和一个或多个存储器；一个或多个存储器与所述一个或多个处理器耦合，所述一个或多个存储器存储有计算机指令；当所述一个或多个处理器执行所述计算机指令时，使得所述通信装置执行如第一方面及其可能的设计中任一项所述的多媒体流的播放方法。
第十方面，提供一种芯片系统，该芯片系统可以应用于公有设备(如电视)中。示例性的，该芯片系统包括接口电路和处理器；接口电路和处理器通过线路互联；接口电路用于从电子装置的存储器接收信号，并向处理器发送信号，信号包括存储器中存储的计算机指令；当处理器执行该计算机指令时，芯片系统执行如第一方面及其可能的设计中任一项所述的多媒体流的播放方法。
第十一方面，提供一种计算机可读存储介质，该计算机可读存储介质包括计算机指令，当该计算机指令运行时，执行如第一方面及其可能的设计中任一项所述的多媒体流的播放方法。
第十二方面，提供一种计算机程序产品，该计算机程序产品中包括指令，当该计算机程序产品在计算机上运行时，使得计算机可以根据该指令执行如第一方面及其可能的设计中任一项所述的多媒体流的播放方法。
应当理解的是，上述第八方面，第九方面，第十方面，第十一方面以及第十二方面提供的技术方案，其技术特征均可对应到第一方面及其可能的设计中提供的多媒体流的播放方法，因此能够达到的有益效果类似，此处不再赘述。
第十三方面，提供一种多媒体流的播放系统。该播放系统中至少包括第一电子设备和第二电子设备。示例性的，该第一电子设备可以为本申请实施例中涉及的公有设备，例如，该第一电子设备可以为电视。该第二电子设备可以为本申请实施例中涉及的私有设备，例如，该第二电子设备可以为手机。在一些实现方式中，第一电子设备可以为第二方面提供的装置或第三方面提供的电子设备。第二电子设备可以为第八方面提供的装置或第九方面提供的电子设备。在该示例中，该多媒体流的播放系统，可以用于执行以上第一方面及其可能的设计中提供的任一项所述的多媒体流的播放方法，和/或用户执行以上第七方面及其可能的设计中提供的任一项所述的多媒体流的播放方法。
作为一种示例，第二电子设备可以用于获取第一播控记录，第一播控记录包括第二电子设备记录的第一多媒体流的第一时间，其中，第一多媒体流是第二电子设备向第一用户播放的。第二电子设备还可以用于向第一电子设备发送第一播控记录。第一电子设备可以用于检测第一生物识别信息，第一生物识别信息用于标识第一用户，不同用户的生物识别信息不同。第一电子设备还可以用于根据第一生物识别信息，获取与第一用户对应的第一播控记录。第一电子设备还可以用于根据第一播控记录从第一时间开始，播放第一多媒体流。
正在另一些示例中，多媒体流的播放系统还可用于执行本申请实施例中提供的其他多媒体流的播放方法中的全部步骤或部分步骤。
应当理解的是，第十三方面提供的多媒体流的播放系统，其技术特征均可对应到第一方面及其可能的设计，或者第二方面及其可能的设计中提供的多媒体流的播放方法，因此能够达到的有益效果类似，此处不再赘述。
附图说明
图1为一种断点续播的示意图；
图2为本申请实施例提供的一种电子设备的组成示意图；
图3为本申请实施例提供的一种多媒体流的断点续播的场景示意图；
图4为本申请实施例提供的一种多媒体流的断点续播方法的流程示意图；
图5A为本申请实施例提供的一种生物识别信息的录入界面示意图；
图5B为本申请实施例提供的一种生物识别信息的共享示意图；
图6为本申请实施例提供的一种用户授权界面的示意图；
图7为本申请实施例提供的一种息屏唤醒的场景的示意图；
图8为本申请实施例提供的一种公有设备主动采集用户的生物识别信息的示意图；
图9为本申请实施例提供的又一种公有设备主动采集用户的生物识别信息的示意图；
图10为本申请实施例提供的一种断点续播的界面示意图；
图11为本申请实施例提供的又一种断点续播的界面示意图；
图12为本申请实施例提供的又一种断点续播的提示信息的示意图；
图13为本申请实施例提供的又一种断点续播的界面示意图；
图14为本申请实施例提供的又一种多媒体流的断点续播方法的流程示意图；
图15为本申请实施例提供的一种多媒体流的播放装置的组成示意图；
图16为本申请实施例提供的一种电子设备的组成示意图；
图17为本申请实施例提供的一种芯片系统的组成示意图；
图18为本申请实施例提供的又一种多媒体流的播放装置的组成示意图；
图19为本申请实施例提供的又一种电子设备的组成示意图；
图20为本申请实施例提供的又一种芯片系统的组成示意图；
图21为本申请实施例提供的一种多媒体流的播放系统的组示意图。
具体实施方式
电子设备提供的多媒体播放服务已经成为其必不可少的功能之一。其中，电子设备提供的多媒体播放服务可以用于播放多媒体文件，该多媒体文件可以包括但不限于从网络获取的多媒体文件等。在一些示例中，多媒体文件可以包括连续的数据流，如视频流，音频流等。在本示例中，可以将多媒体文件称为多媒体流。其中，以多媒体流为视频流为例，该视频流也可称为网络视频，或网络视频流，或在线视频，或在线视频流。
以播放的多媒体流为视频流为例。能够播放该视频流的电子设备可以包括但不限于手机、平板电脑、笔记本电脑、电视等设置有显示屏，能够与网络进行数据交互的设备。示例性的，电子设备可以在用户的控制下，从网络获取视频流的数据，并通过对应的应用程序(application，APP)或网页或者本地播放器播放该视频流，由此为用户提供对应的多媒体播放服务。
目前，在不同电子设备之间的视频流的切换播放已经成为一个普遍的场景。作为一种示例，用户可以在通勤(如上班或下班)路上使用其手机观看视频流。在用户回到其住所后，可以使用住所中的电视继续观看该视频流。为了避免用户在切换视频流 的播放设备的过程中，需要手动控制以在切换后的电子设备(如称为播放设备)上能够跳过已观看的部分，切换后的播放设备(如电视)可以为用户提供断点续播的服务，以便在视频流从手机切换到电视进行播放时，电视能够从手机播放视频流的断点位置继续播放该视频流，由此为用户提供更好的观看体验。本申请实施例中，可以将上述从断点位置继续播放视频流称为对视频流的断点续播。示例性的，图1示出了一种断点续播的示意图。用户可以用通过其手机观看视频流1。如图1中的(a)所示，该视频流1时长为90分钟，用户当前使用手机观看到20分12秒(即如图1中的(a)所示的20:12)的位置。在用户需要使用如图1中的(b)所示的电视继续观看该视频流1时，电视可以通过与手机之间的直接或间接(如通过网络服务器等)的交互，获取视频流1当前播放的时间戳位置(如20分12秒)。电视可以从该时间戳位置开始继续播放视频流1，以便可以使得用户能够在电视上继续观看该视频流1。
为了使得电子设备能够为用户提供上述断点续播服务，目前存在多种不同的方案：
方案1：通过将断点续播的相关信息以二维码的形式展示给用户，以便用户可以通过扫描二维码请求在不同电子设备上进行断点续播。示例性的，该断点续播的信息可以包括远程服务器的地址。用户在电子设备1上观看的视频流的类型以及进度等播放信息可以被保存在该远程服务器中。在用户想要通过电子设备2进行断点续播时，可以通过扫描电子设备2上所展示的二维码，连接到上述远程服务器，以该二维码为入口，请求远程服务器向电子设备2发送播放信息，以便电子设备2可以根据该播放信息进行断点续播。
方案2：断点续播也可通过APP内建的机制实现。示例性的，当用户通过电子设备1上的APP1观看视频流时，该视频流的播放进度，以及观看该视频流时的登录账号信息可以被保存在对应的应用服务器中。当用户想要通过电子设备2继续观看该视频流时，可以在电子设备2上使用上述登录账号信息登录APP1，以便从应用服务器中获取视频流的播放进度，并在电子设备2上实现断点续播。
上述方案都能够实现视频流的断点续播，但是，也存在一些问题。
示例性的，在上述方案1中，用户需要通过扫描电子设备2上的二维码，请求播放信息，才能控制电子设备2实现断点续播。可以看到，该方案依赖于用户的主动控制，无法实现电子设备侧主动的断点续播。同时，由于需要用户的主动控制，因此容易出现用户与电子设备(如上述电子设备2)之间的交互问题。另外，该方案除了涉及电子设备1和电子设备2之外，还需要远程服务器的参与。因此，当电子设备1与远程服务器之间通信和/或电子设备2与远程服务器之间的通信出现问题时，则会导致断点续播的失败。
在上述方案2中，依赖于固定APP的登陆账号信息，因此具有较大的局限性。例如，当用户使用APP2在电子设备1上观看视频流，但是该APP2并未直接或间接提供断点续播的服务，那么就无法实现在不同电子设备上的断点续播。另外，该方案也存在依赖用户的主动控制，并且需要参与的电子设备较多(如需要应用服务器参与)等问题，由此会增加断点续播的不稳定性。
因此，就需要一种方案，能够在稳定的为用户提供断点续播服务的同时，能够避免上述问题。
为了解决上述问题，本申请实施例提供一种多媒体流的断点续播方法。基于该方案，不同电子设备之间可以通过自主交互，实现播放信息的共享。另外，播放多媒体流的电子设备可以根据用户的生物识别信息(如人脸信息，声纹信息等)，自适应地选取与当前用户对应的多媒体流的相关信息进行断点续播。由此在提供快捷稳定的断点续播功能的同时，能够在不需要用户进行主动控制的前提下，主动识别用户并提供对应的断点续播。由此使得为用户提供准确并稳定的断点续播服务。
以下结合附图对本申请实施例提供的方案进行详细说明。
需要说明的是，本申请实施例提供的断点续播方法，可以应用在用户的电子设备中。该电子设备可以是手机、平板电脑、个人数字助理(personal digital assistant，PDA)、增强现实(augmented reality，AR)\虚拟现实(virtual reality，VR)设备、媒体播放器、电视、只能音箱等具有多媒体流播放功能的电子设备。本申请实施例对该设备的具体形态不作特殊限制。
作为一种示例，请参考图2，为本申请实施例提供的一种电子设备100的组成示意图。本申请实施例提供的多媒体流的断点续播方法均可应用于如图2所示的电子设备100中。
如图2所示，该电子设备100可以包括处理器101，显示屏103，通信模块102等。
其中，处理器101可以包括一个或多个处理单元，例如：处理器101可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频流编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器101中。
控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。
处理器101中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器101中的存储器为高速缓冲存储器。该存储器可以保存处理器101刚用过或循环使用的指令或数据。如果处理器101需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器101的等待时间，因而提高了系统的效率。
在一些实施例中，处理器101可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuit sound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器101接口(mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口，和/或通用串行总线(universal serial bus，USB)接口111等。
电子设备100通过GPU，显示屏103，以及应用处理器101等实现显示功能。GPU为图像处理的微处理器，连接显示屏103和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器101可包括一个或多个GPU，其执行程序指令以生成或改 变显示信息。
显示屏103用于显示图像，视频流等。显示屏103包括显示面板。显示面板可以采用液晶显示屏103(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，电子设备100可以包括1个或N个显示屏103，N为大于1的正整数。
通信模块102可以包括天线1，天线2，移动通信模块102A，和/或无线通信模块102B。以通信模块102同时包括天线1，天线2，移动通信模块102A和无线通信模块102B为例。
电子设备100的无线通信功能可以通过天线1，天线2，移动通信模块102A，无线通信模块102B，调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。例如：可以将天线1复用为无线局域网的分集天线。在另外一些实施例中，天线可以和调谐开关结合使用。
移动通信模块102A可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块102A可以包括至少一个滤波器，开关，功率放大器，低噪声放大器(low noise amplifier，LNA)等。移动通信模块102A可以由天线1接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调处理器进行解调。移动通信模块102A还可以对经调制解调处理器调制后的信号放大，经天线1转为电磁波辐射出去。在一些实施例中，移动通信模块102A的至少部分功能模块可以被设置于处理器101中。在一些实施例中，移动通信模块102A的至少部分功能模块可以与处理器101的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中，调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后，被传递给应用处理器。应用处理器通过音频设备(不限于扬声器106A，受话器106B等)输出声音信号，或通过显示屏103显示图像或视频流。在一些实施例中，调制解调处理器可以是独立的器件。在另一些实施例中，调制解调处理器可以独立于处理器101，与移动通信模块102A或其他功能模块设置在同一个器件中。
无线通信模块102B可以提供应用在电子设备100上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。无线通信模块102B可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块102B经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器101。无 线通信模块102B还可以从处理器101接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。
在一些实施例中，电子设备100的天线1和移动通信模块102A耦合，天线2和无线通信模块102B耦合，使得电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications，GSM)，通用分组无线服务(general packet radio service，GPRS)，码分多址接入(code division multiple access，CDMA)，宽带码分多址(wideband code division multiple access，WCDMA)，时分码分多址(time-division code division multiple access，TD-SCDMA)，长期演进(long term evolution，LTE)，BT，GNSS，WLAN，NFC，FM，和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system，GPS)，全球导航卫星系统(global navigation satellite system，GLONASS)，北斗卫星导航系统(beidou navigation satellite system，BDS)，准天顶卫星系统(quasi-zenith satellite system，QZSS)和/或星基增强系统(satellite based augmentation systems，SBAS)。
示例性的，以电子设备100为手机为例。手机中的通信模块102可以包括移动通信模块102A以及无线通信模块102B。在手机播放来自网络的视频流时，可以通过移动通信模块102A的基于3G/4G/5G的通信解决方案从网络获取视频流的视频流数据，并根据视频流数据进行视频流的播放。手机也可通过无线通信模块102B的基于WLAN/BT等通信解决方案从网络获取视频流的视频流数据，并根据视频流数据进行视频流的播放。
在另一些实施例中，以电子设备100为电视为例。电视中的通信模块102可以包括无线通信模块102B。在电视播放来自网络的视频流时，可以通过无线通信模块102B的基于WLAN/BT等通信解决方案从网络获取视频流的视频流数据，并根据视频流数据进行视频流的播放。
需要说明的是，在本申请实施例中，通信模块102还可以用于不通过电子设备之间的交互。示例性的，电子设备1与电子设备2可以通过其中各自设置的通信模块102进行生物识别信息的共享。电子设备1与电子设备2还可以通过其中各自设置的通信模块102进行播控记录的共享。
如图2所示，在一些实现方式中，该电子设备100还可以包括外部存储器接口110，内部存储器104，通用串行总线(universal serial bus，USB)接口，充电管理模块112，电源管理模块113，电池114，音频模块106，扬声器106A，受话器106B，麦克风106C，耳机接口106D，传感器模块105，按键109，马达，指示器108，摄像头107，以及用户标识模块(subscriber identification module，SIM)卡接口等。
电子设备100可以通过ISP，摄像头107，视频流编解码器，GPU，显示屏103以及应用处理器101等实现拍摄功能。
ISP用于处理摄像头107反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头107感光元件上，光信号转换为电信号，摄像头107感光元件将所述电信号传递给ISP处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例 中，ISP可以设置在摄像头107中。
摄像头107用于捕获静态图像或视频流。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device，CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。在一些实施例中，电子设备100可以包括1个或N个摄像头107，N为大于1的正整数。
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。例如，当电子设备100在频点选择时，数字信号处理器用于对频点能量进行傅里叶变换等。
视频流编解码器用于对数字视频流压缩或解压缩。电子设备100可以支持一种或多种视频流编解码器。这样，电子设备100可以播放或录制多种编码格式的视频流，例如：动态图像专家组(moving picture experts group，MPEG)1，MPEG2，MPEG3，MPEG4等。
NPU为神经网络(neural-network，NN)计算处理器，通过借鉴生物神经网络结构，例如借鉴人脑神经元之间传递模式，对输入信息快速处理，还可以不断的自学习。通过NPU可以实现电子设备100的智能认知等应用，例如：图像识别，人脸识别，语音识别，文本理解等。
充电管理模块112用于从充电器接收充电输入。其中，充电器可以是无线充电器，也可以是有线充电器。在一些有线充电的实施例中，充电管理模块112可以通过USB接口111接收有线充电器的充电输入。在一些无线充电的实施例中，充电管理模块112可以通过电子设备100的无线充电线圈接收无线充电输入。充电管理模块112为电池114充电的同时，还可以通过电源管理模块113为电子设备100供电。
电源管理模块113用于连接电池114，充电管理模块112与处理器101。电源管理模块113接收电池114和/或充电管理模块112的输入，为处理器101，内部存储器104，外部存储器，显示屏103，摄像头107，和无线通信模块102B等供电。电源管理模块113还可以用于监测电池114容量，电池114循环次数，电池114健康状态(漏电，阻抗)等参数。在其他一些实施例中，电源管理模块113也可以设置于处理器101中。在另一些实施例中，电源管理模块113和充电管理模块112也可以设置于同一个器件中。
外部存储器接口110可以用于连接外部存储卡，例如Micro SD卡，实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口110与处理器101通信，实现数据存储功能。例如将音乐，视频流等文件保存在外部存储卡中。
内部存储器104可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器101通过运行存储在内部存储器104的指令，从而执行电子设备100的各种功能应用以及数据处理。内部存储器104可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比 如音频数据，电话本等)等。此外，内部存储器104可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。
电子设备100可以通过音频模块106，扬声器106A，受话器106B，麦克风106C，耳机接口106D，以及应用处理器101等实现音频功能。例如音乐播放，录音等。
音频模块106用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块106还可以用于对音频信号编码和解码。在一些实施例中，音频模块106可以设置于处理器101中，或将音频模块106的部分功能模块设置于处理器101中。
扬声器106A，也称“喇叭”，用于将音频电信号转换为声音信号。电子设备100可以通过扬声器106A收听音乐，或收听免提通话。
受话器106B，也称“听筒”，用于将音频电信号转换成声音信号。当电子设备100接听电话或语音信息时，可以通过将受话器106B靠近人耳接听语音。
麦克风106C，也称“话筒”，“传声器”，用于将声音信号转换为电信号。当拨打电话或发送语音信息或需要通过语音助手触发电子设备100执行某些功能时，用户可以通过人嘴靠近麦克风106C发声，将声音信号输入到麦克风106C。电子设备100可以设置至少一个麦克风106C。在另一些实施例中，电子设备100可以设置两个麦克风106C，除了采集声音信号，还可以实现降噪功能。在另一些实施例中，电子设备100还可以设置三个，四个或更多麦克风106C，实现采集声音信号，降噪，还可以识别声音来源，实现定向录音功能等。
耳机接口106D用于连接有线耳机。
电子设备100中的传感器模块105可以包括触摸传感器、压力传感器、陀螺仪传感器、气压传感器、磁传感器、加速度传感器、距离传感器、接近光传感器、环境光传感器、指纹传感器、温度传感器、骨传导传感器等部件，以实现对于不同信号的感应和/或获取功能。
按键109包括开机键，音量键等。按键109可以是机械按键109。也可以是触摸式按键109。电子设备100可以接收按键109输入，产生与电子设备100的用户设置以及功能控制有关的键信号输入。
马达可以产生振动提示。马达可以用于来电振动提示，也可以用于触摸振动反馈。例如，作用于不同应用(例如拍照，音频播放等)的触摸操作，可以对应不同的振动反馈效果。作用于显示屏103不同区域的触摸操作，马达也可对应不同的振动反馈效果。不同的应用场景(例如：时间提醒，接收信息，闹钟，游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。
指示器108可以是指示灯，可以用于指示充电状态，电量变化，也可以用于指示消息，未接来电，通知等。
SIM卡接口用于连接SIM卡。SIM卡可以通过插入SIM卡接口，或从SIM卡接口拔出，实现和电子设备100的接触和分离。电子设备100可以支持1个或N个SIM卡接口，N为大于1的正整数。SIM卡接口可以支持Nano SIM卡，Micro SIM卡，SIM卡等。同一个SIM卡接口可以同时插入多张卡。所述多张卡的类型可以相同，也可以 不同。SIM卡接口也可以兼容不同类型的SIM卡。SIM卡接口也可以兼容外部存储卡。电子设备100通过SIM卡和网络交互，实现通话以及数据通信等功能。在一些实施例中，电子设备100采用eSIM，即：嵌入式SIM卡。eSIM卡可以嵌在电子设备100中，不能和电子设备100分离。
可以理解的是，本实施例示意的结构并不构成对电子设备100的具体限定。在另一些实施例中，电子设备100可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
需要说明的是，在如图2所示的电子设备100中，可以运行有操作系统，该操作系统中可以安装不同的应用程序(即APP)。电子设备100可以通过其操作系统，运行一个或多个APP，实现对应的功能。示例性的，在操作系统中可以安装有媒体播放器，在运行该媒体播放器时，可以实现电子设备100的多媒体流播放功能。在该操作系统中还可以安装有视频流类APP，如(哔哩哔哩TM的APP，爱奇艺TM的APP，YouTubeTM的APP)等，在运行该视频流类APP时，可以实现电子设备100从APP对应的应用服务器获取视频流并进行播放的功能。
在本申请的一些实现方式中，在如图2所示的电子设备100的操作系统中，还可以设置有安全世界(trusted execution environment，TE)以及普通世界(rich execution environment，RE)。作为一种实现方式，TE和RE可以为在电子设备100中设置的具有独立存储、处理、通信的功能的虚拟操作系统。其中，TE可以用于处理对于安全性要求较高的数据。例如，TE可以用于处理/存储与生物识别信息相关的操作。RE可以用于处理对于安全性要求较低的数据。例如RE可以用于处理/存储与多媒体流的播控信息相关的操作。在一些实现中，同一个电子设备中的TE和RE之间可以进行通信。例如，TE可以在获取当前用户的生物识别信息并据此获取用户匹配结果后，将用户匹配结果发送给RE，以便RE据此进行断点续播。在另一些实现中，不同电子设备中的TE之间，或者，不同电子设备中的RE之间也可进行通信。例如，电子设备1中的TE1可以将其中存储的用户的生物识别信息共享给电子设备2中的TE2。又如，电子设备1中的RE1可以将其中存储的播控记录共享给电子设备2中的RE2。需要说明的是，在另一些实现方式中，上述安全世界也可用于指代可信执行环境(如英文缩写可以为TEE)，上述普通世界也可用于指代非安全世界或普通执行环境(如英文缩写可以为REE)。
本申请实施例提供的断点续播方法可通过如图2所示的电子设备100实现。
示例性的，以多媒体流为视频流为例。电子设备100在播放视频流时，可以用于监控用户在观看视频流的过程中，输入的中断视频流的播放的操作。例如，该操作可以包括用户输入的停止视频流播放，或者暂停视频流播放，或者退出视频流播放的操作。电子设备100可以用于根据用户输入的中断视频流的播放的操作，生成并存储与该视频流对应的播控记录。电子设备100还可以用于与处于同一局域网中的其他电子设备100共享该播控记录。电子设备100还可以用于与处于同一局域网中的其他电子设备共享其他信息，例如用户的生物识别信息等。
在本申请实施例中，电子设备100还可以用于通过主动检测当前用户的生物识别 信息，并据此确定用户，以及与用户对应的播控记录。进而根据该播控记录进行断点续播。
应当理解的是，在进行断点续播的场景中，至少存在两个电子设备。其中一个电子设备可以为保存有已经为用户播放了一部分多媒体流的电子设备(如称电子设备A)。另一个电子设备可以为即将继续播放该多媒体流的电子设备(如称为电子设备B)。申请实施例提供的断点续播方法，可以应用于上述包括一个电子设备A和一个电子设备B的场景中，也可应用于包括多个电子设备A的场景中。示例性的，请参考图3，示出了本申请实施例提供的一种多媒体流的断点续播的场景示意图。如图3所示，该场景中可以包括N+1个电子设备，N为大于或等于1的整数。其中一个电子设备(如图3所示的电视)可以对应到电子设备B，即为即将继续播放该多媒体流的电子设备。其他电子设备(如图3所示的手机1到手机N)可以对应到电子设备A，即为保存有已经为用户播放了一部分多媒体流的电子设备。其中，每个手机可以对应到一个用户。因此，在该场景下，电视可以用于向N个手机分别对应的N用户提供断点续播服务。
需要说明的是，在本申请实施例中，可以将可能同时为多个用户提供多媒体流的播放服务的电子设备(如图3所示的电视)称为公有设备。将只会为一个用户提供多媒体流的播放服务的电子设备(如图3所示的手机1到手机N)称为私有设备。应当理解的是，图3中是以公有设备为电视，私有设备为手机为例进行说明的，在其他一些实现场景中，公有设备和私有设备可以具有不同的实现。示例性的，公有设备可以包括电视，智能音箱等，私有设备可以包括手机，智能手表等。
另外，在如图3所示的场景中是仅包括一个公有设备为例进行说明的。在本申请实施例的另一些实现场景中，也可包括多个公有设备为不同用户提供多媒体流的播放服务。本申请实施例对此不作限制。
以下对申请实施例提供的断点续播方法进行详细说明。为了便于说明，以下以本申请实施例提供的方案应用于如图3所示的场景中，即包括1个公有设备(如电视)，以及N个私有设备(如手机1到手机N)，进行断点续播的多媒体流为从网络获取的视频流为例。
请参考图4，为本申请实施例提供的一种多媒体流的断点续播方法的流程示意图。如图4所示，该方法可以包括S401-S408。
S401、手机将生物识别信息发送给电视。
S402、电视接收生物识别信息。
S403、电视存储生物识别信息与用户之间的对应关系。
其中，该生物识别信息可以为该手机对应用户的生物识别信息。示例性的，该生物识别信息可以包括用户的人脸信息，和/或用户的声纹信息。应当理解的是，不同用户的生物识别信息不同，因此，生物识别信息可以用于区分不同的用户。
一般而言，用户的手机中，可以存储有用户的生物识别信息。示例性的，在用户使用手机时，可以在其手机中设置并存储人脸信息，以便手机可以通过检测使用手机的用户的人脸信息，通过匹配存储的人脸信息，确认用户身份，实现便捷地对手机支付、手机解锁等功能的相关操作。作为一种示例，用户在想要录入人脸信息时，可以对手机输入对应的操作，例如，进入“人脸识别”界面的操作。作为对该操作的响应， 手机可以现实如图5A中的(a)所示的界面。如图5A中的(a)所示，在显示已经保存的人脸信息的区域501中并未显示任何信息，因此用户可以确认当前手机并未存储任何人脸信息。用户可以输入新建人脸信息的操作，例如触摸或点击控件502。响应于该操作，手机即可开始采集用户的人脸信息。在完成人脸信息的采集后，即可显示如图5A中的(b)所示的界面。如图5A中的(b)所示，已经完成了当前的人脸信息的录入。此后，手机即可在用户的操作下(如对箭头503的触摸或点击操作)，或者自动跳转到上一级界面。例如，手机可以显示如图5A所示的(c)所示的界面。在该界面中，即可在区域501中显示已经录入的人脸信息(如图中的人脸信息1)。由此，即完成了人脸信息的输入。手机可以保存该人脸信息，以便实现后续的相关功能。
应当理解的是，上述示例中是以生物识别信息为人脸信息为例进行说明的。在另一些示例中，该生物识别信息还可以为声纹信息，其录入的过程类似，此处不再赘述。
在本申请实施例中，手机可以将其中保存的生物识别信息共享给电视。在一些实现方式中，当手机与电视处于相同的局域网中时，手机可以执行上述与电视之间的生物识别信息的共享。即执行如图4所示的S401。由于电视可以从手机获取生物识别信息，因此电视无需提前录入各个用户的生物识别信息，用户也只需在手机上录入生物识别信息即可，无需再在电视上录入用户鉴权或识别的生物识别信息，这不仅简化了用户操作，且生物识别信息来源于手机等私有设备，能更安全。
另外，上述示例中，是以不同设备(如手机和电视)之间自行进行生物识别信息的共享为例进行说明。在本申请的另一些实现方式中，用户可以主动将生物识别信息共享给其他设备。示例性的，结合图5B。在用户1完成人脸信息1在其手机1上的录入之后，在“人脸识别”界面上可以显示有如图5B中的(a)所示的分享按钮504。用户在想要控制手机1将人脸信息1共享给电视1时，可以输入对该分享按钮504的操作，例如，点击或触摸，或通过语音控制等。响应于用户输入的操作，手机1可以执行对人脸信息1的共享处理。例如，手机1可以在其所在的局域网中搜索其他设备，此时手机1可以在界面上显示如图5B中的(b)所示的提示框505，该提示框505中可以包括文字提示，如“正在搜索设备……”。在另一些实现方式中，该提示框505中还可以包括图标，动态图像等，用于向用户展现当前的搜索状态。在搜索到对应的设备后，手机1可以在其界面上显示如图5B中的(c)所示的提示框506。该提示框506中可以显示有文字提示，以便向用户展示搜索结果。例如，该提示框506中的文字提示可以包括搜索到的设备，如电视1。当用户想要将人脸信息1共享给该电视1时，可以通过输入对该提示框506中所显示设备对应的区域的操作，以便手机1能够将人脸信息1共享给对应的设备。比如，用户1可以输入对如图5B中的(c)所示的提示框506中的“电视1”的触摸或点击操作，响应于该操作，手机1可以将人脸信息1共享给电视1。
需要说明的是，由于生物识别信息对于用户而言较为重要，属于需要保密的隐私数据，因此，在本申请的一些实施例中，在手机在进行生物识别信息的共享之前，可以先获取用户的授权。示例性的，结合图5A，以用户在录入人脸信息时，手机即与电视处于同一局域网为例。在完成人脸信息的录入之后，如图6所示，手机可以在“人脸识别”界面上显示卡片601，以手机能够根据用户通过对该卡片601中包括的控件 输入的操作，确定用户是否授权，并执行后续操作。作为一种示例，该卡片601中可以包括授权内容。例如，可以通过文字提示的形式，向用户展示授权内容。如“检测到新的新的人脸信息，是否将该人脸信息同步到电视”。该卡片601中还可以包括用于采集用户输入授权或不进行授权的控件。例如，该卡片601中可以包括“是”按钮602，以及“否”按钮603。当手机接收到用户点击或触摸该“是”按钮的操作时，则手机确定用户同意授权。当手机接收到用户点击或触摸该“否”按钮的操作时，则手机确定用户不同意授权。在另一些实现方式中，手机还可以通过语音，动画等形式，向用户展示该卡片601，手机也可以通过接收用户的语音指示，手势指示等操作，确定用户是否对当前操作(如对人脸信息的共享操作)进行了授权。本申请实施例对于用户的授权方式不作具体限定。在确定用户进行了授权后，手机即可将其中存储的用户的生物识别信息传输给电视。
电视在接收到手机发送的生物识别信息后，即可存储该生物识别信息与对应用户的对应关系。例如，该对应关系可以为人脸信息与用户的标识的对应关系。
需要说明的是，对于如图3所示的N个手机中的每个手机，均可在符合条件(如在与电视处于同一局域网时)执行上述S401-S403。这样，如果每个手机都获取了用户的授权，则N个手机可以分别将其存储的对应用户的生物识别信息传输给电视。对应的，电视则可以存储有获取的N个生物识别信息与对应用户的对应关系。
作为一种可能的实现方式，电视中可以存储中如下表1所示的对应关系。
表1
生物识别信息 对应用户
人脸信息1 用户标识1
人脸信息2 用户标识2
…… ……
人脸信息N 用户标识N
通过该表1，电视即可根据人脸信息确定对应的用户。例如，电视可以根据人脸信息1，确定对应的用户为用户标识1对应的用户1。电视可以根据人脸信息2，确定对应的用户为用户标识2对应的用户2。类似的，电视可以根据人脸信息N，确定对应的用户为用户标识N对应的用户N。需要说明的是，在本申请的另一些实现方式中，电视还可通过其他方式存储该人脸信息与用户的对应关系。示例性的，电视可以在接收到生物识别信息时，为该生物识别信息打上对应用户的标签，以便根据生物识别信息可以区分并确定不同用户。
S404、手机监测视频流的播放，获取对应的播控记录。
S405、手机将播控记录发送给电视。
在本示例中，播控记录可以包括对应视频流的视频流信息。
其中，视频流信息可以包括视频流的名称，以及用于指示该视频流当前的播放位置的信息。示例性的，视频流的名称可以通过影片ID(如称为vodid)进行标识。
需要说明的是，在一些实现方式中，上述视频流信息还可以包括播放视频流的APP的包名。例如，包名可以为com.huawei.video，或者com.xxx.youku等。可以理解的是，根据该包名，电子设备就能够知晓该打开视频流的APP对应的网络位置(如对应的应 用服务器的位置)。在需要播放该视频流时，电子设备可以从对应的网络位置，根据影片ID，提取该视频流的视频流数据进行播放。另外，在示例中，视频流当前的播放位置可以用于指示视频流在被中断播放时的播放进度。例如，当前的播放位置可以通过已播放时长(如称为playTime)进行标识。在另一些实现方式中，该当前播放进度可以为暂停播放或者停止播放或者退出播放时视频流播放的时间戳。又如，该当前播放进度可以为暂停播放或者停止播放或者退出播放时视频流播放的已播放百分比。又如，该当前播放进度可以为暂停播放或者停止播放或者退出播放时视频流播放的未播放百分比。在另一些实现方式中，该视频流信息还可包括其他视频流播放相关的信息，例如视频流播放的音量，视频流的分类等信息。
该播控记录还可以包括手机的设备信息。示例性的，该设备信息可以用于指示手机的相关信息。作为一种示例，该设备信息可以包括手机的唯一标识(Unified Device ID，UDID)，设备类型，设备制造商信息，设备型号，以及手机的软件版本信息等。通过该手机的设备信息，电子设备(如电视)在需要根据该播控记录进行断点续播时，就能够知晓视频流在手机上播放时的环境，通过结合电视的播放环境，通过调整就可以保证视频流在电视上的正常播放。
在本示例中，手机中可以监测视频流在手机上的播放，并在检测到用户输入的中断视频流播放的操作时，获取与该视频流对应的播控记录。其中，用户输入的中断视频流播放的操作可以包括暂停播放或者停止播放或者退出播放的操作。当手机检测到用户输入了上述中断视频流播放的操作时，可以获取当前视频流的播放进度信息。
示例性的，以用户1通过其手机1观看视频流1为例。手机1可以在用户观看视频流1的过程中，监测用户输入的中断视频流1的播放的操作。在接收到该操作时，手机1可以响应于该操作，生成与视频流1对应的播控信息1。
手机可以将其存储的播控记录共享给电视，以便电视能够根据播控记录进行断点续播。在本申请的一些实施例中，手机可以在与电视处于同一局域网中时，将其中存储的播控记录发送给电视，实现播控记录在手机与电视之间的共享。可以理解的是，当存在N个手机与电视处于同一个局域网中，并且这N个手机中均存储有对应的播控记录时，则电视就可以分别接收并存储这N个手机分别发送的N个播控记录。需要说明的是，结合如图5B所示的方法说明，用户可以主动将手机上的播控记录分享给电视。用户共享播控记录的过程可以与如图5B所示的手机1进行人脸信息1的共享时的操作类似。例如，用户可以通过对手机1的操作，控制手机1搜索能够被共享播控记录的设备，在搜索到设备(如电视1)时，手机1可以向用户展示搜索结果，并在用户的操作下，与电视1建立连接，以便将播控记录共享给电视1。其具体执行过程可以参考图5B所示的过程，此处不再赘述。可以理解的，用户也可主动将电视上的播控记录共享给手机。
可以看到，上述S401-S403提供了生物识别信息的在公有设备和私有设备之间共享的方法示例。上述S404-S405提供了播控记录的在公有设备和私有设备之间共享的方法示例。需要说明的是，上述关于生物识别信息的共享过程与关于播控记录的共享过程不存在先后时间顺序的限定。例如，私有设备可以在第一次与公有设备处于相同局域网下时，即按照上述S401-S403执行生物识别信息的共享。此时，如果私有设备 中没有播控记录，则可以不执行S404-S405。又如，私有设备可以在获取播控记录后与公有设备处于相同的局域网下时，执行上述S404-S405，以便实现播控记录的共享，而此时如果该私有设备对应的生物识别信息已经被公有设备所存储(即该私有设备中存储的生物识别信息已经通过上述S401-S403的方法，或者其他方法共享给公有设备)，则可以不执行上述生物识别信息的共享过程。又如，私有设备可以在每次进行播控记录的传输时，同步或异步将其中保存的生物识别信息传输给公有设备。
S406、电视获取当前用户的生物识别信息。
S407、根据获取的当前用户的生物识别信息，确定用户匹配结果。
S408、电视根据与用户匹配结果对应的播控记录进行断点续播。
在本示例中，电视可以在息屏唤醒时，获取当前用户的生物识别信息。
需要说明的是，当没有用户使用(如用户不在住所，或者用户在休息等)电视时，电视可以处于息屏状态。其中，息屏状态是指电视的显示屏处于关闭的状态，或者，在电视的显示屏上显示屏幕保护图像/黑色图像。在用户需要使用电视时，电视可以从息屏的状态切换为正常工作的状态，示例性的，电视的显示屏可以从关闭的状态切换为显示首页界面的状态。本申请实施例的说明中，将该从息屏状态切换为正常工作状态的过程称为息屏唤醒。
在不同的实现方式中，电视的息屏唤醒可以具有不同的触发机制。
示例性的，在一些实施例中，电视的息屏唤醒可以是用户通过主动控制实现的。例如，用户可以使用智能音响，智能网关，或者电视遥控器等设备，通过语音或对电视遥控器的操作，向电视发送唤醒指示。电视可以接收该唤醒指示，并响应于该唤醒指示，执行息屏唤醒。
在另一些实施例中，电视可以通过自主检测，确定执行息屏唤醒。应当理解的是，在电视处于息屏状态时，其中有部分部件(如部分传感器，摄像头等部件)可以处于低电待机状态。在息屏状态下，传感器可以通过主动降低其灵敏度，摄像头可以降低其图像分辨率，以便在对周围环境继续保持监测的同时降低功耗。也就是说，在息屏状态下时，电视依然能够在一定范围内检测到用户是否出现。示例性的，请参考图7。电视处于息屏状态下时，可以如图7中的(a)所示的界面701。该界面701可以是显示有屏幕保护图像，也可以是处于黑屏状态。在电视检测到用户出现在其的播放范围内时，电视可以从息屏状态下切换到如图7中的(b)所示的首页进行显示，例如，该首页可以为如图7中的(b)所示的702的界面。其中，该电视的播放范围可以是预先设置的，也可以是电视根据用户的使用习惯自行确定的。例如，电视在息屏状态下，其中的红外传感器检测到用户出现在电视的播放范围内时，或者电视中的摄像头检测到用户出现在电视的播放范围内时，则电视可以确定存在播放需求，进而执行息屏唤醒。另外，在智能家居场景下，电视确定执行息屏唤醒的触发机制也可是在用户预设的智能场景中自动触发的。本申请实施例对于电视执行息屏唤醒的触发条件不作限制。
在本申请实施例中，电视在息屏唤醒时，获取当前用户的生物识别信息，可以是电视在开始执行息屏唤醒时，即开始采集当前用户的生物识别信息，或，电视在完成息屏唤醒之后，如已经显示了首页界面时，开始获取当前用户的生物识别信息的。本申请实施例对此不作限制。应当理解的是，当前用户即为出现在电视播放范围内的用 户。以下对采集当前用户的生物识别信息的实现方式作示例性说明。
示例性的，在一些实施例中，以生物识别信息为用户的人脸信息为例。电视可以通过其上设置的摄像头等具有图像采集功能的部件，对电视的播放范围内的用户进行人脸信息的采集。请参考图8，以电视的播放范围为AOB为例。摄像头可以采集该AOB范围内的用户的面部信息，实现该用户的人脸信息的采集。
需要说明的是，在本示例的一些实现方式中，电视可以通过采集的面部信息的清晰度，确定用户是否在电视的播放范围内。可以理解的是，当用户在AOB区域内，但是距离电视较远时，电视采集获取的人脸信息的清晰度就会较差。电视可能无法根据该人脸信息确定对应的用户。因此，在本示例中，电视可以根据采集的面部信息的清晰度与对应的预设阈值(如第一阈值)之间的大小关系，确定用户是否在电视的播放范围内。例如，当清晰度大于第一阈值时，则确定用户在电视的播放范围内，电视可以将该次采集获取的人脸信息作为有效信息进行保存。反之，当清晰度小于第一阈值时，则确定用户不在电视的播放范围内，则电视可以将对应的人脸信息作为无效信息处理，如丢弃等。电视通过确定用户是否在播放范围内，也可用于据此确定是否继续执行S407-S408。例如，如果用户在电视的播放范围内，则继续执行S407。反之，如果用户不在电视的播放范围内，则不执行S407。
在另一些实施例中，以生物识别信息为用户的声纹信息为例。电视可以通过其上设置的受话器等具有声音采集功能的部件，对用户的声纹信息进行采集。请参考图9，电视可以通过其受话器，采集用户的声纹信息。
需要说明的是，在本示例的一些实现方式中，电视可以通过采集的声纹信息的声音大小，确定用户是否在电视的播放范围内，并对采集的声纹信息进行选择性保留，由此提高用户识别信息的可靠度。在本申请实施例中，电视可以根据采集的声纹信息的声音大小与对应的预设阈值(如第二阈值)之间的大小关系，确定用户是否在电视的播放范围内。例如，当声音大小大于第二阈值时，则确定用户在电视的播放范围内，电视可以将该次采集获取的声纹信息作为有效信息进行保存。反之，当声音大小小于第二阈值时，则确定用户不在电视的播放范围内，则电视可以将对应的声纹信息作为无效信息处理，如丢弃等。应当理解的是，电视还可以通过其他方法确定用户是否在电视的播放范围内。如，电视可以通过其上设置的两个或多个位于不同位置的受话器(如图9所示的两个受话器)分别同时收集用户的声纹信息，据此对用户进行定位，由此确定用户是否在电视的播放范围内。
另外，上述示例中是以生物识别信息为声纹信息或人脸信息为例进行说明的。在另一些实现场景中，该生物识别信息还可同时包括声纹信息和人脸信息，或者，该生物识别信息还可同时包括其他能够用于识别用户的信息。为了便于说明，以下以生物识别信息为人脸信息进行示例性说明。
需要说明的是，在上述示例中，是以电视息屏唤醒时，采集当前用户的生物识别信息为例进行说明的。在本申请的另一些实现方式中，电视可以在用户的控制下，触发检测当前用户的生物识别信息。例如，检测到用户打开视频APP1的操作电视在打开视频APP1时，开始检测当前用户的生物识别信息。其中，该视频APP1可以是具有播放多媒体流的APP。
通过上述说明，电视可以采集并存储当前用户的人脸信息。结合S401-S403的说明，电视中还可以存储有使用该电视的用户的人脸信息与用户的标识之间的对应关系(例如，该对应关系可以为如表1所示的对应关系)。电视可以根据当前用户的人脸信息，在已经存储的从手机获取的人脸信息进行比对，由此即可确定当前用户。示例性的，以电视存储的从手机获取的人脸信息为表1所示的对应关系为例。当前用户的人脸信息为人脸信息1时，则电视可以确定当前用户可以为用户标识1对应的用户1。当前用户的人脸信息为人脸信息2时，则电视可以确定当前用户可以为用户标识2对应的用户2。以此类推，当前用户的人脸信息为人脸信息N时，则电视可以确定当前用户可以为用户标识N对应的用户N。
结合S404-S405的说明，电视可以从手机中获取与使用手机的用户对应的播控记录。一般而言，用户出现在电视的播放范围内时，则其手机也会与电视处于同一个局域网中。因此，电视可以从当前用户的手机中获取到与该用户对应的播控记录。在实际使用场景中，电视还可以从其他处于同一个局域网中的用户的手机获取其他的播控记录。因此，在本示例中，为了使得电视能够准确地为当前用户提供准确的断点续播，电视可以根据确定的当前用户，确定与当前用户对应的播控记录，并根据该播控记录进行断点续播。
需要说明的是，以上示例中，是以电视在检测到当前用户的生物识别信息之前就从第一用户的手机中获取了对应的播控记录为例进行说明的。
在本申请的另一些实现方式中，电视还可以在检测到当前用户的生物识别信息，并据此确定用户后，在从该用户的手机获取对应的播控记录。示例性的，以电视检测到当前用户的生物识别信息1为例。电视可以根据上述S401-S403中获取的用户的生物识别信息与用户的标识的对应关系，确定该生物识别信息对应与用户1。那么电视可以向用户1的手机1发起播控记录的传输请求，响应于该请求，手机1可以将其存储的播控记录1发送给电视。这样，电视就获取了当前用户对应的播控记录。
在本示例中，电视根据当前用户对应的播控记录进行的断点续播，可以通过多种方式实现。
示例性的，在一些实现方式中，电视可以在其首页界面上显示与要进行断点续播的视频流的相关信息，以便在用户的指示下，进行断点续播。作为一种实现方式的说明，请参考图10。电视在确定当前用户为用户A，并根据该用户A确定要进行断点续播的视频流A的相关信息时，可以在其界面(如图10中的(a)所示的“欢迎”界面)显示与视频流A对应的卡片1001。该卡片可以用于请用户A确认是否对卡片1001所展示的视频流A进行断点续播。作为一种示例，该卡片1001中可以包括文字提示，如“断点续播提示：是否续观看视频流A”，又如“您之前在手机A上已观看视频流A到25:50，是否继续观看”等。用户A可以根据该卡片1001输入对应的操作。示例性的，在一些实现方式中，该卡片1001中，还可包括其他控件。如图10中的(b)所示，该控件可以包括“是”按钮1002，以及“否”按钮1003。当电视接收到用户A点击或触摸或通过电视遥控器输入的对“是”按钮的操作时，则电视确定根据该卡片的文字提示对应的播控记录进行断点续播。也就是说，电视可以响应于用户A输入的对该“是”按钮的操作，在其显示屏上继续根据播控记录所指示的信息进行视频流A 的断点续播。相对的，当电视接收到用户A点击或触摸或通过电视遥控器输入的对“否”按钮的操作时，则电视确定不根据该卡片的文字提示对应的播控记录进行断点续播。此时电视可以正常显示其首页界面，以便用户A使用电视的其他功能。需要说明的是，在如图10中的(b)所示的卡片中，也可以不包括“否”按钮1003。用户A可以用过其他操作进入电视的首页界面。例如，用户A可以通过电视的遥控器输入能够用于进入首页界面的操作，如点击遥控器上的“首页”按钮，又如点击遥控器上的“返回”按钮，或者通过语音控制等方式，实现控制电视显示首页界面。
在另一些实现方式中，在电视确定当前播放区域内只有一个用户时，可以直接根据当前用户对应的播控记录进行断点续播，由此使得电视在不需用户输入任何操作的情况下为用户自行选择对应的播控记录进行断点续播。
在另一些实现方式中，电视可以在其界面上显示一个用户对应的多个播控记录对应的卡片。由此电视可以通过其界面向用户展示多个不同播控记录对应的选择，以便与用户可以自主选择对应的播控记录进行观看。例如，电视在界面上可以显示有用户1对应的播控记录1，播控记录2和播控记录3。用户可以根据其需求，选取对应的播控记录进行播放。如用户选取了播控记录2，则电视可以根据播控记录2进行断点续播。
在另一些实现方式中，用户可以主动选择需要在电视上续播的视频流进行续播。例如，用户可以对电视说：“继续播放刚才在手机A上播放的视频A”，电视接收到该指示后，可以在电视中查找与其匹配的播控记录，并根据播控记录继续播放视频A。例如，电视可以通过视频A去查找对应的播控记录，也可以根据视频A和手机A去查找相应的播控记录。该播控记录在收到用户指示前，电视已从手机A获取。可选的，电视也在收到用户的指示后从手机A获取与视频A对应的播控记录，然后电视根据获取的播控记录进行断点续播。
需要说明的是，在对图10的说明中，是以电视的播放范围内只有一个用户为例进行说明的。可以理解的是，在另一些场景中，电视的播放范围内可能会存在两个或更多用户。此时，电视也可以为用户提供不同的断点续播服务。以在电视的播放范围内有两个用户(如用户1和用户2)为例。
示例性的，电视可以分别确定与用户1对应的播控记录1，以及与用户2对应的播控记录2。如图11所示，电视可以在其当前的显示界面上(如首页界面)分别显示卡片1(如图11中的1101)和卡片2(如图11中的1102)。其中，卡片1中包括与播控记录1对应的视频流1的相关信息，例如该卡片1中可以包括如图10中的(b)类似的文字提示。类似的，卡片2中包括与播控记录2对应的视频流2的相关信息，例如该卡片2中也可以包括如图10中的(b)类似的文字提示。这样，就使得用户1和用户2能够明确地知晓当前能够进行断点续播的视频流的情况，并据此进行选择。示例性的，当用户1和用户2想要继续观看视频流1时，可以通过电视遥控器，或者语音控制，向电视输入继续播放视频流1的命令。响应于该命令，电视可以基于播控记录1进行视频流1的断点续播。类似的，当用户1和用户2想要继续观看视频流2时，可以通过电视遥控器，或者语音控制，向电视输入继续播放视频流2的命令。响应于该命令，电视可以基于播控记录2进行视频流2的断点续播。应当理解的是，在 另一些实现方式中，卡片1和卡片2也可以为一个卡片中的两个控件，或者两个区域。本申请实施例对播控记录1和播控记录2对应的信息的展示方式不作限制。
可以理解的是，当电视的播放范围内有两个或多个用户时，电视可以在上述卡片中仅显示部分能够区分播控记录的信息，同时隐藏播控记录对应的其他信息，由此达到保护用户隐私的目的。示例性的，请参考图12，电视可以在当前的显示界面上显示包括部分播控记录的信息的卡片1201。例如，该卡片中可以包括文字提示，如“断点续播提示：进行用户1的断点续播；进行用户2的断点续播”。在一些实现方式中，文字提示中的“进行用户1的断点续播”以及“进行用户2的断点续播”的文字提示也可以具有如图12所示的控件1202和控件1203的接收用户对应的操作的功能。以便用户可以通过电视遥控器，选定对应的控件执行相应的断点续播。示例性的，当电视接收到用户对于控件1202的点击输入时，则根据用户1对应的播控记录1对对应的视频流1进行断点续播。当电视接收到用户对于控件1203的点击输入时，则根据用户2对应的播控记录2对对应的视频流2进行断点续播。这样，就使得电视不会直接在其界面上显示出两个或多个用户的视频流观看历史信息，由此达到保护用户隐私的目的。
另外，在本申请的另一些实现方式中，电视可以根据用户的优先级，确定根据哪个用户对应的播控记录进行断点续播。示例性的，该用户的优先级可以为预设在电视中的，也可以是电视自行确定的。例如，电视可以根据使用电视的历史记录中，不同用户的使用频率对各个用户进行优先级排序，使用频率最高的用户的优先级最高，使用频率最低的用户的优先级最低。或者，电视也可以根据播控记录的优先级进行断点续播。例如电视可以根据获取断点续播的时间先后，为多个播控记录进行优先级排序，获取时间较晚的播控记录被续播的可能性最大，因此可以具有较高的优先级。对应的，获取时间较早的播控记录被续播的可能性则相对较小，因此可以具有较低的优先级。在确定用户/播控记录的优先级后，电视可以直接根据对应的播控记录进入视频流的断点续播。在本申请的另一些实现方式中，电视还可以根据用户输入的指示，执行对应的断点续播。例如，以当前用户包括用户1和用户2为例。用户1可以向电视输入语音控制指示，例如，用户1可以对电视说：“继续播放在手机1上播放的视频1”。电视接收到该指示后，可以选取与视频1和手机1对应的播控记录进行断点续播。需要说明的是，在一些实现方式中，电视还可以通过接收到用户1的语音指示，进行声音识别，确定对应用户，并选取与该用户对应的播控记录进行断点续播；或者，电视还可以通过接收到用户1的语音指示后，触发人脸识别来确定对应用户，然后进一步获取用户相关的播控记录进行断点续播。
需要说明的是，在本申请的另一些实施例中，电视在播放视频流时，也可以将视频流的播放情况同步给处于相同局域网中的手机，以便用户也可通过手机进行基于电视当前播放进度的断点续播。
示例性的，以电视和手机1在同一个局域网中为例。在一些实现方式中，电视可以实时地将其对视频流的播放进度以及视频流的相关信息(即正在播放的视频流对应的播控记录)同步给手机1。手机1的界面上可以显示有对应的卡片。该卡片可以用于向用户展示当前电视正在播放的视频流对应的播控记录的相关信息。例如，在一些实现方式中，如图13中的(a)所示，手机1可以在卡片1301中显示文字提示，如“视 频流播控信息：正在观看视频流1，目前播放到20:12”。在另一些实现方式中，如图13中的(b)所示，手机1可以在卡片1302中以多媒体的形式展示相关的视频流播放信息。如，卡片1302中可以包括当前电视正在播放的视频流的名称“视频流1”，卡片1302中还可以包括当前电视正在播放的视频流的进度“20:12”，卡片1302中还可以包括当前播放进度下的关键帧图像等。
用户可以通过该卡片知晓当前视频流在电视上的播放情况。当用户想要通过手机1继续观看该视频流时，可以通过对该卡片输入相关的操作(如触摸或点击等)。手机1可以接收该操作。作为对该操作的相应，手机可以在其界面上基于该卡片对应的播控记录进行断点续播。例如，从20：12开始继续播放视频流1。
需要说明的是，当用户通过对手机1上的卡片的操作，实现通过手机1对视频流1进行断点续播时，电视可以确定用户是否仍在其播放范围内，如果是，则电视也可继续播放该视频流1。而如果电视确定用户已经不再其播放范围内，则电视可以退出对该视频流1的播放。例如，进入息屏状态。
上述示例中，是以电视实时地将其播控记录发送给手机1为例进行说明的，在另一些实施例中，电视还可以根据预设的时间周期，获取在电视上播放的视频流对应的播控记录，并将该播控记录发送给手机1的。在另一些实施例中，电视还可以是在监测到用户输入的中断视频流播放的操作时，获取对应的播控记录，并将该播控记录发送给手机1的。本申请实施例对于电视向手机1发送播控记录的时机不做限制。
另外，当电视前有多个用户同时在观看电视播放的视频流时，电视可以根据不同的场景需求，将当前的播控记录发送给对应的收集。
示例性的，在一些实现方式中，以电视当前播放的视频流1是根据手机1发送的播控记录1进行的断点续播为例。电视可以实时地将该视频流1对应的播控记录发送给手机1，以便对应的用户1可以在其手机1能够准确地知晓视频流1的播放进度。当用户1想要通过手机1继续观看该视频流1时，手机1就可以根据该播放进度为用户1提供对应的断点续播服务。
在另一些实现方式中，以电视当前播放的视频流并非根据任一个手机的播控记录进行的断点续播为例。电视可以实时地将该视频流对应的播控记录发送给当前局域网中的所有手机，以便使得通过电视观看当前视频流的用户都能够通过其各自的手机知晓当前视频流在电视上的播放进度，同时使得用户的手机能够在用户想要继续在手机上观看视频流时，能够根据该播控记录为对应的用户提供断点续播服务。当然，在另一些实施例中，如果电视当前所播放的视频流并非断点续播，那么电视也可以向任何手机共享其播控记录，由此能够减少电视与手机所在局域网中的通信压力。
另外，在另一些实现方式中，如果电视中已经预设了相关策略，例如，电视将当前播放的视频流的播控记录同步给局域网中的手机1。则电视可以根据该策略，执行将播控记录同步给手机1的操作。由此使得电视可以在播放任何视频流时，用户1都可以通过其手机1知晓当前视频流的播放进度，进而实现用户1对于电视播放资源的主动控制，例如，实现家长控制等。
需要说明的是，上述示例中，是以电视在没有播放任何多媒体流时，根据上述多媒体流的播放方法进行断点续播为例进行说明的。在本申请的另一些实施例中，电视 也可以在播放多媒体流的同时，按照上述方法为用户提供断点续播服务。
示例性的，以电视正在为用户1播放视频流1为例。根据如图4提供的方法，当电视检测到用户2的生物识别信息时，可以根据该用户2的生物识别信息，获取对应的播控记录。此时，电视就可以认为可能出现了对用户2进行断点续播的需求。那么，在该示例中，电视可以在播放视频流1的同时，在界面上显示如图10中的(a)或如图10中的(b)所示的卡片1001，以便用户可以通过对电视的操作，指示电视根据该用户2对应的播控记录进行断点续播，例如，根据该用户2对应的播控记录，电视可以从播放视频流1切换为对应视频流2继续播放。当然，在用户不需要对视频流2进行断点续播时，则可以输入对应的操作(如点击返回/退出键，或者通过语音指示不需要断点续播等)，则电视可以继续播放该视频流1。可以理解的是，如果用户没有对卡片1001输入任何操作，那么电视可以在预设的时间后，在界面上消除对该卡片1001的显示，以便能够更好地为用户播放视频流1。
至此，本领域技术人员应当对本申请实施例提供的断点续播方案有清楚明确的了解。需要说明的是，上述示例中，仅以多媒体流为视频流为例，在本申请的另一些实现方式中，该多媒体流还可以是音频流等，其具体的执行方式可参考上述示例中对于视频流的执行方式，对此不再赘述。
可以理解的是，结合上述说明，本申请实施例提供的断点续播方法，能够使得公有设备(如电视)可以自行与私有设备(如手机)进行播控记录的共享。并且能够在不需用户输入任何操作的情况，下自行获取当前用户的生物识别信息，并据此确定与当前用户所匹配的播控记录。通过在其界面上显示对应的卡片以便用户通过确认卡片信息执行对应的断点续播，或者直接为用户进行断点续播，由此为用户提供便利的断点续播服务。另外，由于整个过程只有公有设备和私有设备参与交互，而不需要同其他设备进行信息的确认(如从应用服务器获取播控记录等)，因此也使得该断点续播服务的稳定性得以提升。
在上述示例中，涉及到生物识别信息和播控记录等数据的采集以及传输。在一些实现方式中，公有设备(如电视)和/或私有设备(如手机)可以根据其内建的存储机制，将获取的生物识别信息以及播控记录存储到相应的存储区域中，并根据上述示例中的方法调用对应的数据进行传输。例如，电视和手机可以在RE中完成所有数据的交互(如生物识别信息以及播控记录的处理和存储)以及上述多媒体流文件的播放方法中各个步骤。
在申请的另一些实现方式中，公有设备和/或私有设备可以对具有不同安全性要求的数据进行单独处理。例如可以将生物识别信息的存储和处理，与对播控记录的存储和处理分开，以实现对不同安全性要求的数据的隔离。应当理解的是，由于生物识别信息的安全性要求较高，可以通过上述说明中的如图4以及图6所示的用户授权的机制，提升生物识别信息的安全性。在本申请的另一些实现方式中，为了能够进一步提升生物识别信息的安全，结合上述图2的说明，电子设备(如私有设备和公有设备)中可以设置有TE和RE，通过对数据的独立处理，实现提升生物识别信息安全性的目的。
示例性的，电子设备中的TE和RE可以通过多种方式来实现隔离。在一些实现方 式中，电子设备中的RE和TE可以是物理隔离的。例如，电子设备可以通过配置其内部存储器，以将某一固定的物理存储地址段作为TE，其他物理存储地址段作为RE。以实现TE存储的数据与RE存储的数据之间的物理隔离。在另一些实现方式中，该RE和TE也可以是通过软件配置实现的虚拟隔离。例如，电子设备中可以分别配置有TE对应的虚拟操作系统和RE对应的虚拟操作系统。该虚拟操作系统能够提供处理，存储以及通信的功能。电子设备可以将安全等级较高的信息，通过TE进行存储和处理，将其他安全等级较低的信息，如播控记录通过RE进行存储和处理。由此实现用户的生物识别信息与其他信息的隔离，因而能够提升生物识别信息的安全性。
以下以公有设备和私有设备中均设置有TE对应的虚拟操作系统(如简称为TE)和RE对应的虚拟操作系统(如简称为RE)，其中，私有设备中设置有TE1和RE1，公有设备中设置有TE2和RE2为例，对本申请实施例提供的断点续播方法进行示例性说明。如图14所示，该方法可以包括S1401-S1410。
S1401、TE1向TE2发送生物识别信息。
结合上述说明，在TE1向TE2发送生物识别信息之前，可以确定私有设备中的授权模块(图14中未示出)确定已经获取用户的授权，再进行生物识别信息的发送，由此提高生物识别信息的安全性。
S1402、TE2接收生物识别信息。
S1403、TE2存储生物识别信息与用户之间的对应关系。
S1404、RE1监测多媒体流的播放，获取播控记录。
S1405、RE1向RE2发送播控记录。
S1406、TE2获取当前用户的生物识别信息。
S1407、TE2根据获取的当前用户的生物识别信息，确定用户匹配结果。
S1408、TE2向RE2发送用户匹配结果。
S1409、RE2确定与用户匹配结果对应的播控记录。
S1410、RE2根据该播控记录，进行断点续播。
上述S1401-S1410的执行过程与前述图4的说明相关，其执行过程类似，此处不再赘述。
可以看到，在如图14所示的方法中，与生物识别信息相关的数据均在TE(如私有设备的TE1，又如公有设备的TE2)中进行处理，由此实现了生物识别信息与其他信息(如播控记录)的分别处理，能够在保证生物识别信息安全的同时，为用户提供便利的断点续播服务。
需要说明的是，在执行S1401时，TE1可以直接通过其通信功能，与TE2进行生物识别信息的共享。在另一些实现方式中，TE1也可通过RE1与RE2之间的通信功能，实现与TE2之间的生物识别信息的共享。示例性的，私有设备的TE1与公有设备的TE2进行通信时，私有设备可以通过其中设置的RE1与公有设备的RE2之间可以进行公钥的交换，以便需要传输生物识别信息的TE1根据该公钥以及TE1的私钥对生物识别信息进行加密，并将加密之后的生物识别信息通过RE1与RE2之间的传输通道进行传输。RE2可以将接收到的加密之后的生物识别信息转发给TE2，TE2可以根据公钥以及TE2的私钥对该加密的生物识别信息进行解密，以获取TE1要发送的生物识别信 息。由此可以使得TE1和TE2之间不需要直接进行数据通信，由此能够使得TE1和TE2均不需要提供设备间的通信功能，进而降低配置TE1和TE2过程中对于硬件的要求。
上述主要从电子设备(如电视以及手机)的角度对本申请实施例提供的方案进行了介绍。为了实现上述功能，其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
本申请实施例可以根据上述方法示例对其中涉及的设备进行功能模块的划分，例如，可以对应各个功能划分各个功能模块，也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。需要说明的是，本申请实施例中对模块的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。
请参考图15，为本申请实施例提供的一种多媒体流的播放装置1500的组成示意图。该多媒体流的播放装置1500可以是电视等公有设备，也可以是公有设备内部的芯片，并且可以实现如图4和图14以及上述各可选实施例。
如图15所示，该多媒体流的播放装置1500可包括：检测模块1501，获取模块1502和播放模块1503。其中，检测模块1501，用于检测第一生物识别信息，第一生物识别信息用于标识第一用户，不同用户的生物识别信息不同。获取模块1502，用于根据第一生物识别信息，获取与第一用户对应的第一播控记录。其中，第一播控记录是从第二电子设备获取的，第一播控记录包括第二电子设备记录的第一多媒体流的第一时间，第二电子设备是与第一用户对应的电子设备。播放模块1503，用于根据第一播控记录从第一时间开始，播放第一多媒体流。
在一种可能的设计中，第二电子设备记录的第一多媒体流的第一时间是第二电子设备播放第一多媒体流的过程中被中断时的时间。中断对应的操作包括停止、暂停或退出第一多媒体流播放的操作。
在一种可能的设计中，获取模块1502，还用于在第二电子设备与第一电子设备处于同一个局域网中的情况下，第一电子设备从第二电子设备获取第一播控记录。
在一种可能的设计中，检测模块1501，用于在息屏唤醒时，触发检测第一生物识别信息。或者，检测模块1501，用于在第一电子设备上设置的图像采集模块和/或声音采集模块检测到用户时，触发检测第一生物识别信息。或者，检测模块1501，用于在检测到用户对第一电子设备的操作时，触发检测第一生物识别信息。
在一种可能的设计中，获取模块1502，用于将检测到的第一生物识别信息与存储的第一用户的第二生物识别信息匹配，根据匹配结果，获取与第一用户对应的第一播控记录。其中，第一用户的第二生物识别信息是从第二电子设备获取的。
在一种可能的设计中，获取模块1502，还用于在第二电子设备与第一电子设备处于同一个局域网时，从第二电子设备获取第一用户的第二生物识别信息。
在一种可能的设计中，所述获取模块1502，用于在第二电子设备获取第一用户的授权信息的情况下，从第二电子设备获取第一用户的第二生物识别信息。
在一种可能的设计中，第一电子设备中设置有安全世界(TE)，装置还包括：存储模块1504，用于将获取的第一用户的第二生物识别信息存储在TE中。
在一种可能的设计中，检测模块1501，还用于检测第三生物识别信息，第三生物识别信息用于标识第二用户。获取模块1502，用于根据第三生物识别信息，获取与第二用户对应的第二播控记录。其中，第二播控记录是从第三电子设备获取的。第二播控记录包括第三电子设备记录的第二多媒体流的第二时间，第三电子设备是与第二用户对应的电子设备。播放模块1503，用于根据第二播控记录从第二时间开始，播放第二多媒体流。
在一种可能的设计中，播放模块1503，用于根据第一播控记录，直接在第一电子设备的界面上从第一时间开始继续播放第一多媒体流。或者播放模块1503，用于根据第一播控记录，在第一电子设备的界面上显示与第一播控记录对应的第一提示。第一电子设备接收对第一提示的第一操作，并响应于第一操作，第一电子设备在界面上从第一时间继续播放第一多媒体流。
在一种可能的设计中，在第一电子设备同时检测到第一用户的第一生物识别信息和第二用户的第二生物识别信息时，播放模块1503，用于根据第一播控记录和第二播控记录，根据优先级播放第一多媒体流或第二多媒体流。或者播放模块1503，用于根据第一播控记录和第二播控记录，随机选择播放第一多媒体流或第二多媒体流。或者播放模块1503，用于根据用户的选择，播放第一多媒体流或第二多媒体流。
在一种可能的设计中，若第一电子设备同时检测到第一用户和第三用户，在第一电子设备根据第一播控记录从第一时间开始，播放第一多媒体流之前，播放模块1503，还用于显示第一播控记录的提示信息，提示信息隐藏了全部或部分第一多媒体流相关的信息。
在一种可能的设计中，第一播控记录还包括第二电子设备的设备信息。
在一种可能的设计中，播放模块1503，还用于根据第二电子设备的设备信息，调整播放第一多媒体流。
在一种可能的设计中，获取模块1502，还用于在播放第一多媒体流时，获取播放第一多媒体流的第三播控记录，第三播控记录用于指示第一多媒体流当前被播放到的第三时间。该设备还包括发送模块1505，用于第一电子设备将第三播控记录发送给第二电子设备，以便于第二电子设备根据第三播控记录从第三时间继续播放第一多媒体流。
应理解的是，本申请实施例中的多媒体流的播放装置可以由软件实现，例如，具有上述功能的计算机程序或指令来实现，相应计算机程序或指令可以存储在公有设备内部的存储器中，通过处理器读取该存储器内部的相应计算机程序或指令来实现上述功能。或者，本申请实施例中的多媒体流的播放装置还可以由硬件来实现。或者，本申请实施例中的多媒体流的播放装置还可以由处理器和软件模块的结合实现。
图16示出了的一种电子设备1600的组成示意图。该电子设备可以为上述示例中的任一种公有设备，例如，该电子设备可以为电视。示例性的，如图16所示，该多媒 体流的播放装置1600可以包括：处理器1601和存储器1602。该存储器1602用于存储计算机执行指令。示例性的，在一些实施例中，当该处理器1601执行该存储器1602存储的指令时，可以使得该电子设备1600执行上述实施例中公有设备的任一种功能，以实现以上示例中的任一种多媒体流的播放方法。
需要说明的是，上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述，在此不再赘述。
图17示出了的一种芯片系统1700的组成示意图。该芯片系统1700可以设置于公有设备中。例如该芯片系统1700可以设置于电视中。示例性的，该芯片系统1700可以包括：处理器1701和通信接口1702，用于支持公有设备实现上述实施例中所涉及的功能。在一种可能的设计中，芯片系统还包括存储器，用于保存电子设备必要的程序指令和数据。该芯片系统，可以由芯片构成，也可以包含芯片和其他分立器件。需要说明的是，在本申请的一些实现方式中，该通信接口1702也可称为接口电路。
需要说明的是，上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述，在此不再赘述。
请参考图18，为本申请实施例提供的一种多媒体流的播放装置1800的组成示意图。该多媒体流的播放装置1800可以是手机等私有设备，也可以是私有设备内部的芯片，并且可以实现如图4和图14以及上述各可选实施例。
如图18所示，该多媒体流的播放装置1800可包括：获取模块1801，发送模块1802。获取模块1801，用于获取第一播控记录，第一播控记录包括第一电子设备记录的第一多媒体流的第一时间，其中，第一多媒体流是第一电子设备向第一用户播放的。发送模块1802，用于向第二电子设备发送第一播控记录，以便于第二电子设备根据第一播控记录从第一时间开始，继续向第一用户播放第一多媒体流。
在一种可能的设计中，获取模块1801，具体用于在检测到中断第一多媒体流的播放的操作时，生成第一播控记录，其中，中断对应的操作包括停止、暂停或退出第一多媒体流播放的操作。
在一种可能的设计中，发送模块1802，用于在第二电子设备与第一电子设备处于同一个局域网中的情况下，向第二电子设备发送第一播控记录。
在一种可能的设计中，发送模块1802，还用于第二电子设备在与第一电子设备处于同一个局域网时，向第二电子设备发送第一用户的第一生物识别信息，以便于第二电子设备根据第一生物识别信息，确定根据第一播控记录继续播放第一多媒体流。
应理解的是，本申请实施例中的多媒体流的播放装置可以由软件实现，例如，具有上述功能的计算机程序或指令来实现，相应计算机程序或指令可以存储在私有设备内部的存储器中，通过处理器读取该存储器内部的相应计算机程序或指令来实现上述功能。或者，本申请实施例中的多媒体流的播放装置还可以由硬件来实现。或者，本申请实施例中的多媒体流的播放装置还可以由处理器和软件模块的结合实现。
图19示出了的一种电子设备1900的组成示意图。该电子设备可以为上述示例中的任一种私有设备，例如，该电子设备可以为手机。示例性的，如图19所示，该多媒体流的播放装置1900可以包括：处理器1901和存储器1902。该存储器1902用于存储计算机执行指令。示例性的，在一些实施例中，当该处理器1901执行该存储器1902 存储的指令时，可以使得该电子设备1900执行上述实施例中私有设备的任一种功能，以实现以上示例中的任一种多媒体流的播放方法。
需要说明的是，上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述，在此不再赘述。
图20示出了的一种芯片系统2000的组成示意图。该芯片系统2000可以设置于私有设备中。例如该芯片系统2000可以设置于手机中。示例性的，该芯片系统2000可以包括：处理器2001和通信接口2002，用于支持私有设备实现上述实施例中所涉及的功能。在一种可能的设计中，芯片系统还包括存储器，用于保存电子设备必要的程序指令和数据。该芯片系统，可以由芯片构成，也可以包含芯片和其他分立器件。需要说明的是，在本申请的一些实现方式中，该通信接口2002也可称为接口电路。
需要说明的是，上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述，在此不再赘述。
图21示出了本申请实施例提供的一种多媒体流的播放系统2100的组成示意图。如图21所示，该多媒体流的播放系统2100可以包括第一电子设备2101和第二电子设备2102。在一些实现方式中，该第一电子设备2101可以为如图3所示的电视，第二电子设备2102可以为如图3所示的手机1到手机N中任意一个手机。该多媒体流的播放系统2100可以用于根据如图4或图14所示的方法实现本申请实施例中涉及的多媒体流的播放方法。或者，该多媒体流的播放系统2100可以用于实现本申请实施例中涉及的其他多媒体流的播放方法。需要说明的是，在本申请的一些实现方式中，该多媒体流的播放系统2100还可以包括其他第二电子设备，用于实现本申请实施例提供的任一种多媒体流的播放方法。
在上述实施例中的功能或动作或操作或步骤等，可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件程序实现时，可以全部或部分地以计算机程序产品的形式来实现。该计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行计算机程序指令时，全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或者数据中心通过有线(例如同轴电缆、光纤、数字用户线(digital subscriber line，DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包括一个或多个可以用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质(例如，软盘、硬盘、磁带)，光介质(例如，DVD)、或者半导体介质(例如固态硬盘(solid state disk，SSD))等。
尽管结合具体特征及其实施例对本申请进行了描述，显而易见的，在不脱离本申请的精神和范围的情况下，可对其进行各种修改和组合。相应地，本说明书和附图仅仅是所附权利要求所界定的本申请的示例性说明，且视为已覆盖本申请范围内的任意和所有修改、变化、组合或等同物。显然，本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样，倘若本申请的这些修改和变型属于 本申请权利要求及其等同技术的范围之内，则本申请也意图包括这些改动和变型在内。

Claims (24)

  1. 一种多媒体流的播放方法，其特征在于，应用于具有播放所述多媒体流的功能的第一电子设备，所述方法包括：
    所述第一电子设备检测第一生物识别信息，所述第一生物识别信息用于标识第一用户，不同用户的生物识别信息不同；
    所述第一电子设备根据所述第一生物识别信息，获取与所述第一用户对应的第一播控记录；其中，所述第一播控记录是从第二电子设备获取的，所述第一播控记录包括所述第二电子设备记录的第一多媒体流的第一时间，所述第二电子设备是与所述第一用户对应的电子设备；
    所述第一电子设备根据所述第一播控记录从所述第一时间开始，播放所述第一多媒体流。
  2. 根据权利要求1所述的方法，其特征在于，所述第二电子设备记录的第一多媒体流的第一时间是所述第二电子设备播放所述第一多媒体流的过程中被中断时的时间；
    所述中断对应的操作包括停止、暂停或退出所述第一多媒体流播放的操作。
  3. 根据权利要求1或2所述的方法，其特征在于，所述方法还包括：
    在所述第二电子设备与所述第一电子设备处于同一个局域网中的情况下，所述第一电子设备从所述第二电子设备获取所述第一播控记录。
  4. 根据权利要求1-3中任一项所述的方法，其特征在于，所述第一电子设备检测第一生物识别信息，包括：
    所述第一电子设备在息屏唤醒时，触发检测所述第一生物识别信息；或者，
    所述第一电子设备在所述第一电子设备上设置的图像采集模块和/或声音采集模块检测到用户时，触发检测所述第一生物识别信息；或者，
    所述第一电子设备在检测到用户对第一电子设备的操作时，触发检测所述第一生物识别信息。
  5. 根据权利要求1-4中任一项所述的方法，其特征在于，所述第一电子设备根据所述第一生物识别信息，获取与所述第一用户对应的第一播控记录，具体包括：
    所述第一电子设备将检测到的所述第一生物识别信息与存储的所述第一用户的第二生物识别信息匹配，根据匹配结果，获取所述与所述第一用户对应的第一播控记录；其中，所述第一用户的第二生物识别信息是从所述第二电子设备获取的。
  6. 根据权利要求5所述的方法，其特征在于，所述方法还包括：
    在所述第二电子设备与所述第一电子设备处于同一个局域网时，所述第一电子设备从所述第二电子设备获取所述第一用户的第二生物识别信息。
  7. 根据权利要求6所述的方法，其特征在于，所述第一电子设备是在所述第二电子设备获取所述第一用户的授权信息的情况下，从所述第二电子设备获取所述第一用户的第二生物识别信息的。
  8. 根据权利要求5-7中任一项所述的方法，其特征在于，所述第一电子设备中设置有安全世界TE，所述方法还包括：
    所述第一电子设备将获取的所述第一用户的所述第二生物识别信息存储在所述TE中。
  9. 根据权利要求1-8中任一项所述的方法，其特征在于，所述方法还包括：
    所述第一电子设备检测第三生物识别信息，所述第三生物识别信息用于标识第二用户；
    所述第一电子设备根据所述第三生物识别信息，获取与所述第二用户对应的第二播控记录；其中，所述第二播控记录是从第三电子设备获取的；所述第二播控记录包括所述第三电子设备记录的第二多媒体流的第二时间，所述第三电子设备是与所述第二用户对应的电子设备；
    所述第一电子设备根据所述第二播控记录从所述第二时间开始，播放所述第二多媒体流。
  10. 根据权利要求1-9中任一项所述的方法，其特征在于，所述第一电子设备根据所述第一播控记录从所述第一时间开始，播放所述第一多媒体流，包括：
    所述第一电子设备根据所述第一播控记录，直接在所述第一电子设备的界面上从所述第一时间开始继续播放所述第一多媒体流；或者，
    所述第一电子设备根据所述第一播控记录，在所述第一电子设备的界面上显示与所述第一播控记录对应的第一提示；所述第一电子设备接收对所述第一提示的第一操作，并响应于所述第一操作，所述第一电子设备在界面上从所述第一时间继续播放所述第一多媒体流。
  11. 根据权利要求9或10所述的方法，其特征在于，在所述第一电子设备同时检测到所述第一用户的第一生物识别信息和所述第二用户的第二生物识别信息时，所述方法还包括：
    所述第一电子设备根据所述第一播控记录和所述第二播控记录，根据优先级播放所述第一多媒体流或所述第二多媒体流；或者
    所述第一电子设备根据所述第一播控记录和所述第二播控记录，随机选择播放所述第一多媒体流或所述第二多媒体流；或者
    根据用户的选择，所述第一电子设备播放所述第一多媒体流或所述第二多媒体流。
  12. 根据权利要求1-11中任一项所述的方法，其特征在于，若所述第一电子设备同时检测到所述第一用户和第三用户，在所述第一电子设备根据所述第一播控记录从所述第一时间开始，播放所述第一多媒体流之前，所述方法还包括：
    所述第一电子设备显示所述第一播控记录的提示信息，所述提示信息隐藏了全部或部分第一多媒体流相关的信息。
  13. 根据权利要求1-12中任一项所述的方法，其特征在于，所述第一播控记录还包括所述第二电子设备的设备信息。
  14. 根据权利要求13所述的方法，其特征在于，所述第一电子设备根据所述第二电子设备的设备信息，调整播放所述第一多媒体流。
  15. 根据权利要求1-14中任一项所述的方法，其特征在于，所述方法还包括：
    所述第一电子设备在播放所述第一多媒体流时，获取播放所述第一多媒体流的第三播控记录，所述第三播控记录用于指示所述第一多媒体流当前被播放到的第三时间；
    所述第一电子设备将所述第三播控记录发送给所述第二电子设备，以便于所述第二电子设备根据所述第三播控记录从所述第三时间继续播放所述第一多媒体流。
  16. 一种多媒体流的播放方法，其特征在于，应用于具有播放所述多媒体流的功能的第一电子设备，所述方法包括：
    所述第一电子设备获取第一播控记录，所述第一播控记录包括所述第一电子设备记录的第一多媒体流的第一时间；
    所述第一电子设备向第二电子设备发送所述第一播控记录，以便于所述第二电子设备根据所述第一播控记录从所述第一时间开始，继续向所述第一用户播放所述第一多媒体流。
  17. 根据权利要求16所述的方法，其特征在于，所述第一电子设备获取第一播控记录，包括：
    所述第一电子设备在检测到中断所述第一多媒体流的播放的操作时，生成所述第一播控记录，其中，所述中断对应的操作包括停止、暂停或退出所述第一多媒体流播放的操作。
  18. 根据权利要求16或17所述的方法，其特征在于，所述第一电子设备向第二电子设备发送所述第一播控记录，包括：
    在所述第二电子设备与所述第一电子设备处于同一个局域网中的情况下，所述第一电子设备向所述第二电子设备发送所述第一播控记录。
  19. 根据权利要求16-18中任一项所述的方法，其特征在于，在所述第一电子设备向第二电子设备发送所述第一播控记录之前，所述方法还包括：
    所述第一电子设备向所述第二电子设备发送所述第一用户的第一生物识别信息，以便于所述第二电子设备根据所述第一生物识别信息，根据所述第一播控记录继续播放所述第一多媒体流。
  20. 一种电子设备，其特征在于，所述电子设备具有播放多媒体流的功能，所述电子设备包括一个或多个处理器和一个或多个存储器；所述一个或多个存储器与所述一个或多个处理器耦合，所述一个或多个存储器存储有计算机指令；
    当所述一个或多个处理器执行所述计算机指令时，使得所述电子设备执行如权利要求1-15中任一项所述的多媒体流的播放方法。
  21. 一种电子设备，其特征在于，所述电子设备具有播放多媒体流的功能，所述电子设备包括一个或多个处理器和一个或多个存储器；所述一个或多个存储器与所述一个或多个处理器耦合，所述一个或多个存储器存储有计算机指令；
    当所述一个或多个处理器执行所述计算机指令时，使得所述电子设备执行如权利要求16-19中任一项所述的多媒体流的播放方法。
  22. 一种芯片系统，其特征在于，所述芯片包括处理电路和接口；所述处理电路用于从存储介质中调用并运行所述存储介质中存储的计算机程序，以执行如权利要求1-15中任一项所述的多媒体流的播放方法，或者，执行如权利要求16-19中任一项所述的多媒体流的播放方法。
  23. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质包括计算机指令，当所述计算机指令运行时，执行如权利要求1-15中任一项所述的多媒体流的播放方法，或者，执行如权利要求16-19中任一项所述的多媒体流的播放方法。
  24. 一种多媒体流的播放系统，其特征在于，所述播放系统包括如权利要求20所 述的电子设备，以及如权利要求21所述的电子设备。
PCT/CN2021/113769 2020-09-10 2021-08-20 一种多媒体流的播放方法和电子设备 WO2022052791A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010949875.1A CN114173193A (zh) 2020-09-10 2020-09-10 一种多媒体流的播放方法和电子设备
CN202010949875.1 2020-09-10

Publications (1)

Publication Number Publication Date
WO2022052791A1 true WO2022052791A1 (zh) 2022-03-17

Family

ID=80475914

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/113769 WO2022052791A1 (zh) 2020-09-10 2021-08-20 一种多媒体流的播放方法和电子设备

Country Status (2)

Country Link
CN (1) CN114173193A (zh)
WO (1) WO2022052791A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115567741A (zh) * 2022-03-24 2023-01-03 荣耀终端有限公司 设备控制方法、多媒体数据播放系统及电子设备

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114780002A (zh) * 2022-04-19 2022-07-22 北京悦学帮网络技术有限公司 一种音频文件标记方法、播放方法、装置及电子设备
CN115086284B (zh) * 2022-05-20 2024-06-14 阿里巴巴（中国）有限公司 云应用的流媒体数据传输方法
CN115379273B (zh) * 2022-08-11 2023-09-26 慕思健康睡眠股份有限公司 基于智能床垫的视频播放控制方法及相关产品

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103037244A (zh) * 2011-09-30 2013-04-10 深圳市龙视传媒有限公司 多个智能终端之间切换网络视频的方法、系统及智能终端
CN103997686A (zh) * 2014-04-30 2014-08-20 小米科技有限责任公司 基于智能电视的播放管理方法和装置
CN105282610A (zh) * 2014-07-25 2016-01-27 深圳Tcl新技术有限公司 电视机的自动切换方法及系统
US20160148042A1 (en) * 2008-01-03 2016-05-26 Apple Inc. Personal computing device control using face detection and recognition
CN105872619A (zh) * 2015-12-15 2016-08-17 乐视网信息技术（北京）股份有限公司 一种视频播放记录的匹配方法及匹配装置
CN107423020A (zh) * 2017-08-22 2017-12-01 京东方科技集团股份有限公司 播放方法及播放系统
US20170374419A1 (en) * 2012-09-04 2017-12-28 Google Inc. Automatic transition of content based on facial recognition
CN107995505A (zh) * 2017-12-14 2018-05-04 深圳Tcl新技术有限公司 一种节目续播方法、电视设备及计算机可读存储介质

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516791A (zh) * 2014-09-29 2016-04-20 宇龙计算机通信科技(深圳)有限公司 一种智能家居中流媒体数据无缝连接实现方法及系统
US9491517B2 (en) * 2015-03-03 2016-11-08 Google Inc. Systems and methods for broadcast audience interaction and participation
CN110769280A (zh) * 2019-10-23 2020-02-07 北京地平线机器人技术研发有限公司 一种接续播放文件的方法及装置

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160148042A1 (en) * 2008-01-03 2016-05-26 Apple Inc. Personal computing device control using face detection and recognition
CN103037244A (zh) * 2011-09-30 2013-04-10 深圳市龙视传媒有限公司 多个智能终端之间切换网络视频的方法、系统及智能终端
US20170374419A1 (en) * 2012-09-04 2017-12-28 Google Inc. Automatic transition of content based on facial recognition
CN103997686A (zh) * 2014-04-30 2014-08-20 小米科技有限责任公司 基于智能电视的播放管理方法和装置
CN105282610A (zh) * 2014-07-25 2016-01-27 深圳Tcl新技术有限公司 电视机的自动切换方法及系统
CN105872619A (zh) * 2015-12-15 2016-08-17 乐视网信息技术（北京）股份有限公司 一种视频播放记录的匹配方法及匹配装置
CN107423020A (zh) * 2017-08-22 2017-12-01 京东方科技集团股份有限公司 播放方法及播放系统
CN107995505A (zh) * 2017-12-14 2018-05-04 深圳Tcl新技术有限公司 一种节目续播方法、电视设备及计算机可读存储介质

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115567741A (zh) * 2022-03-24 2023-01-03 荣耀终端有限公司 设备控制方法、多媒体数据播放系统及电子设备
CN115567741B (zh) * 2022-03-24 2024-02-20 荣耀终端有限公司 设备控制方法、多媒体数据播放系统及设备、存储介质

Also Published As

Publication number Publication date
CN114173193A (zh) 2022-03-11

Similar Documents

Publication Publication Date Title
US20230094272A1 (en) Notification Processing System, Method, and Electronic Device
CN109660842B (zh) 一种播放多媒体数据的方法及电子设备
WO2022052791A1 (zh) 一种多媒体流的播放方法和电子设备
WO2020228645A1 (zh) 音视频的播放方法、终端及装置
WO2020224486A1 (zh) 一种通话方法、设备及系统
CN111316598B (zh) 一种多屏互动方法及设备
US20240192912A1 (en) Screen projection method for electronic device and electronic device
WO2021258809A1 (zh) 数据同步方法、电子设备和计算机可读存储介质
CN111726678B (zh) 一种设备间多媒体内容续播的方法
WO2021036898A1 (zh) 折叠屏设备中应用打开方法及相关装置
WO2022166618A1 (zh) 一种投屏的方法和电子设备
US12028300B2 (en) Method, apparatus, and system for sending pictures after thumbnail selections
US20240094972A1 (en) Page Display Method and Apparatus, Electronic Device, and Readable Storage Medium
WO2023030056A1 (zh) 一种通知消息的处理方法及设备
CN113365274B (zh) 一种网络接入方法和电子设备
CN114915834A (zh) 一种投屏的方法和电子设备
WO2022267974A1 (zh) 一种投屏方法及相关装置
WO2022037405A1 (zh) 信息验证的方法、电子设备及计算机可读存储介质
WO2021110117A1 (zh) 事件订阅方法及电子设备
WO2023093778A1 (zh) 一种截屏方法及相关装置
WO2023025059A1 (zh) 一种通信系统及通信方法
WO2023142935A1 (zh) 应用组件管理方法及相关设备
CN118118740A (zh) 基于数据流的播放方法、装置、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21865847

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21865847

Country of ref document: EP

Kind code of ref document: A1